New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Problem: migration packages will now contain a logical metadata file #98

Closed

sallain opened this issue Dec 4, 2024 · 1 comment · Fixed by #101

Assignees

Labels

Contributor

sallain commented Dec 4, 2024 •

edited

Loading

Describe the bug

The migration packages will include an extra metadata file going forward (the logical metadata extracted from Preservica). SFA would like there to be a check to confirm that the file has been included in the package, that it is valid, and then move it to the metadata directory. This affects the BornDigitalAIP and DigitizedAIP transfer types.

Expected behavior

Some activity (could re-use the Validate SIP structure activity) will look for a file located at package-name/data/additional/package-name-premis.xml. The activity will confirm that the file is present and that the name of the file preceding -premis.xml matches the name of the package.

Another activity (perhaps Validate SIP metadata or Validate PREMIS) will validate the above listed file. It should be valid PREMIS. The output for the activity should indicate that this PREMIS file has been validated.

Finally, the file should be moved to the metadata directory during the Restructure SIP activity.

I will provide sample packages once the structure is confirmed by SFA.

Additional context

See #97 for more information about the new package structure.

The text was updated successfully, but these errors were encountered:

sallain added the Client: SFA label

sallain added this to Enduro

sallain moved this to 🛠 Refining in Enduro

sallain changed the title ~~WIP ISSUE Problem: need to confirm that migration packages contain logical metadata file~~ WIP ISSUE Problem: migration packages will now contain a logical metadata file

sallain changed the title ~~WIP ISSUE Problem: migration packages will now contain a logical metadata file~~ Problem: migration packages will now contain a logical metadata file

sallain moved this from 🛠 Refining to 👍 Ready in Enduro

sevein mentioned this issue

Unbag bagged SIPs, fixes #94 #100

Merged

djjuhasz self-assigned this

djjuhasz moved this from 👍 Ready to ⏳ In Progress in Enduro

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file, fixes #98

7887cef

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD.

Setps;
- Verify that an SFA AIP includes a logical metadata file
- Create a local PREMIS v3 XSD file for validating the logical metadata
  file
- Validate the logical metadata file against the PREMIS v3 XSD

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file, fixes #98

f664952

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD.

Setps;
- Verify that an SFA AIP includes a logical metadata file
- Create a local PREMIS v3 XSD file for validating the logical metadata
  file
- Validate the logical metadata file against the PREMIS v3 XSD

djjuhasz added a commit that referenced this issue


          Add logical metadata file to AIP structure

b9974bc

Refs #98

Add the logical metadata file to the expected SIP structure for the AIP
SIP types. Update activities related to SIP structure: identify SIP,
validate files, validate structure, and verify manifest.

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file

2d7f5ea

Refs #98.

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD. To avoid downloading the PREMIS XSD
every time the activity runs I've embedded a local copy of the XSD in
the worker Go binary, and write the contents to a file on disk so it can
be loaded by xmllint.

djjuhasz added a commit that referenced this issue


          Move logical metadata file when transforming SIP

06ee8b3

Refs #98.

Move the logical metadata file to the metadata directory when
transforming the SIP.

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file

3b593cf

Refs #98.

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD. To avoid downloading the PREMIS XSD
every time the activity runs I've embedded a local copy of the XSD in
the worker Go binary, and write the contents to a file on disk so it can
be loaded by xmllint.

djjuhasz added a commit that referenced this issue


          Move logical metadata file when transforming SIP

6c26b0c

Refs #98.

Move the logical metadata file to the metadata directory when
transforming the SIP.

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file

Refs #98.

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD. To avoid downloading the PREMIS XSD
every time the activity runs I've embedded a local copy of the XSD in
the worker Go binary, and write the contents to a file on disk so it can
be loaded by xmllint.

djjuhasz added a commit that referenced this issue


          Move logical metadata file when transforming SIP

9e9f87c

Refs #98.

Move the logical metadata file to the metadata directory when
transforming the SIP.

djjuhasz linked a pull request

that will close this issue

Add logical metadata file validation, fixes #98 #101

Merged

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file

e73f651

Refs #98.

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD. To avoid downloading the PREMIS XSD
every time the activity runs I've embedded a local copy of the XSD in
the worker Go binary, and write the contents to a file on disk so it can
be loaded by xmllint.

djjuhasz added a commit that referenced this issue


          Move logical metadata file when transforming SIP

3d770f1

Refs #98.

Move the logical metadata file to the metadata directory when
transforming the SIP.

djjuhasz closed this as completed in #101

djjuhasz added a commit that referenced this issue


          Add logical metadata file to AIP structure

Refs #98

Add the logical metadata file to the expected SIP structure for the AIP
SIP types. Update activities related to SIP structure: identify SIP,
validate files, validate structure, and verify manifest.

djjuhasz added a commit that referenced this issue


          Validate the logical metadata file

a54cf91

Refs #98.

Add an activity to validate the logical metadata PREMIS XML file against
a local copy of the PREMIS v3 XSD. To avoid downloading the PREMIS XSD
every time the activity runs I've embedded a local copy of the XSD in
the worker Go binary, and write the contents to a file on disk so it can
be loaded by xmllint.

djjuhasz added a commit that referenced this issue


          Move logical metadata file when transforming SIP

32fdee0

Refs #98.

Move the logical metadata file to the metadata directory when
transforming the SIP.

github-project-automation bot moved this from ⏳ In Progress to 🎉 Done in Enduro

djjuhasz moved this from 🎉 Done to 🧐 QA in Enduro

Contributor Author

sallain commented Jan 8, 2025 •

edited

Loading

LGTM! I see the error reported in two places:

This is good, since SFA wants to have all preprocessing errors reported at once.

A bag WITH the logical metadata file succeeds as expected:

I also confirmed that this only applies to SIPs identified as DigitizedAIP and BornDigitalAIP.

sallain moved this from 🧐 QA to 🎉 Done in Enduro

sallain mentioned this issue

Problem: Born Digital AIPs fail with a "verify manifest" error #90

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment