Upload v2.4.x ‐ tasks

Update: Development team, 12-Jul-2024

Back to Home - SciELO Publishing Platform Guide

Start task

Once everything is set up, create the start task which will create all the tasks that will carry out the migration and publication:

1. Go to the menu item Task > Periodic Tasks
2. Click on Add Periodic task
3. Create a task called Start
4. The task name field must contain the value: bigbang.tasks.task_start
5. Add a schedule in the field: Crontab Schedule
6. In the Keyword Arguments field, add the value: {"user_id": 1, "enable": false}. Changing false to true will make the task scheduled an will be ran frequently.
7. Remove the check of Enable field
8. Click on "Run" button, to execute the start task and get all the tasks created

Migration and publication tasks

1. Go to Tasks > Periodic Tasks
2. Perform the task migrate_and_publish:

migrate_and_publish task

• Dependency:

  • classic web site folders
    • bases/pdf
    • bases/xml
    • bases/translation
    • htdocs/img/revistas
    • https://github.com/scieloorg/classic_webiste_migration_tools?tab=readme-ov-file#introdu%C3%A7%C3%A3o
      • new_platform/bases_for_upload/title.id
      • new_platform/bases_for_upload/issue.id
      • new_platform/bases_for_upload/bases-work/acron/acron.id
  • MinIO
  • Core

• Objectives:

  • obtain the journal records from the classic website database, insert them into the new system and publish them on the new website
  • obtain the issue records from the classic website database, insert them into the new system and publish them on the new website
  • obtain the article records from the classic website folder
  • obtain the article files from the classic website folder
  • convert XML from HTML files
  • generate SPS Package (SciELO Publishing Schema package)
  • request new PID (version 3) and add in the XML
  • optimize the package (generating miniature images for web publication and add them in the XML)
  • upload the optimized package on the MinIO
  • publish the articles on the new website

• Follow-up: Consult the logs of the celeryworker container

Results for journals

• Consult the Processing menu > Journal Proc
• Consult the Migration menu > Migrated Journals menu
• Consult the Journals menu

Results for issues

• Consult the Processing menu > Issue Proc
• Consult the Migration menu > Migrated Issues menu
• Consult the Issues menu

Results for articles

• Consult the Processing menu > Article Proc

• Consult the Migration menu > Migrated Articles menu

• Consult the Migration menu > Article Id file menu

• Consult the Migration menu > Migrated Files menu

• Consult the Processing menu > XML from HTML menu

• Consult the Processing menu > SPS Package menu

• Consult the Articles menu

• Check the columns and status filters

• Check the 'Events newest to oldest' tab (since v2.3.0) | 'Result' tab (previous releases)

• Check that all the migration steps have been recorded.

• Consult the Unexpected E... menu to identify unexpected problems. In this case, send an e-mail reporting the problem.

• Check the new website

Note: in all listings, the column headings can be clicked to reorder the list by column.

---

Journals migration and publication task

1. Go to Tasks > Periodic Tasks
2. Perform the task migrate_and_publish_journals:

migrate_and_publish_journals task

• Dependency: title.id from classic website folder
• Objective: to obtain the journal records from the classic website database, insert them into the new system and publish them on the new website
• Follow-up: Consult the logs of the celeryworker container

Result

• Consult the Processing menu > Journal Proc

• Consult the Migration menu > Migrated Journals menu

• Consult the Journals menu

• Check the columns and status filters

• Check the 'Events newest to oldest' tab (since v2.3.0) | 'Result' tab (previous releases)

• Check that all the migration steps have been recorded.

• Consult the Unexpected E... menu to identify unexpected problems. In this case, send an e-mail reporting the problem.

• Check the new website

Note: in all listings, the column headings can be clicked to reorder the list by column.

Issues migration and publication task

1. Go to Tasks > Periodic Tasks
2. Perform the task migrate_and_publish_issues:

migrate_and_publish_issues task

• Dependency: issue.id from classic website folder
• Objective: to obtain the journal records from the classic website database, insert them into the new system and publish them on the new website
• Follow-up: Consult the logs of the celeryworker container

Result

• Consult the Processing menu > Issue Proc

• Consult the Migration menu > Migrated Issues menu

• Consult the Issues menu

• Check the columns and status filters

• Check the 'Events newest to oldest' tab (since v2.3.0) | 'Result' tab (previous releases)

• Check that all the migration steps have been recorded.

• Consult the Unexpected E... menu to identify unexpected problems. In this case, send an e-mail reporting the problem.

• Check the new website

Note: in all listings, the column headings can be clicked to reorder the list by column.

Articles migration and publication task

1. Go to Tasks > Periodic Tasks
2. Perform the task migrate_and_publish_articles:

migrate_and_publish_articles task

• Dependency:

  • classic web site folders
    • bases-work/acron/acron.id
    • bases/pdf
    • bases/xml
    • bases/translation
    • htdocs/img/revistas
  • MinIO
  • Core

• Objectives:

  • obtain the article records from the classic website folder
  • obtain the article files from the classic website folder
  • convert XML from HTML files
  • generate SPS Package (SciELO Publishing Schema package)
  • request new PID (version 3) and add in the XML
  • optimize the package (generating miniature images for web publication and add them in the XML)
  • upload the optimized package on the MinIO
  • publish the articles on the new website

• Follow-up: Consult the logs of the celeryworker container

Result

• Consult the Processing menu > Article Proc

• Consult the Migration menu > Migrated Articles menu

• Consult the Migration menu > Article Id file menu

• Consult the Migration menu > Migrated Files menu

• Consult the Processing menu > XML from HTML menu

• Consult the Processing menu > SPS Package menu

• Consult the Articles menu

• Check the columns and status filters

• Check the 'Events newest to oldest' tab (since v2.3.0) | 'Result' tab (previous releases)

• Check that all the migration steps have been recorded.

• Consult the Unexpected E... menu to identify unexpected problems. In this case, send an e-mail reporting the problem.

• Check the new website

Note: in all listings, the column headings can be clicked to reorder the list by column.