Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Issue trying to generate schemas 1E00 and 1D00 #852

Open
jordanpadams opened this issue Dec 10, 2024 · 0 comments
Open

Issue trying to generate schemas 1E00 and 1D00 #852

jordanpadams opened this issue Dec 10, 2024 · 0 comments
Assignees
@jshughes
Labels
B15.1 bug Something isn't working s.high sprint-backlog

Comments

@jordanpadams
Copy link
Member

jordanpadams commented Dec 10, 2024 •
edited
Loading

Checked for duplicates

Yes - I've already checked

🐛 Describe the bug

Looks like this bug was created on multiple occasions, and we said it was fixed, but I cannot find any commit where this actually works as expected with any LDDs.

#776
#770

There are 2 different versions of the dictionary referenced in the released bundles: PDS4_LCROSS_1D00_1000 and PDS4_LCROSS_1E00_1100. I do have an ingest file for each, so I guess the procedure would be to push to Github and release the 1000 version and then do it again for the 1100 version? Or is there a simpler way?

That said, the newest versions of LDDTool (v15+) don’t appear to be compatible with such old versions of the information model. I’m getting errors that I don’t get with older LDDTool versions. Is there a way around this? I assume the Github procedures use the newest LDDTool version.

🕵️ Expected behavior

I expected the schema and schematron to be generated.

📜 To Reproduce

$ lddtool-15.3.0-SNAPSHOT/bin/lddtool -lpJm -V 1D00 ~/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml


>>  DEBUG - Parent Directory:/Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/
>>  DEBUG - IM Directory Path:/Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/
>>  DEBUG - NS Directory Path:/Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/
>>  DEBUG - IM Versions Available:[1N00, 1M00, 1L00, 1K00, 1J00, 1I00, 1H00, 1G00, 1F00, 1E00, 1D00, 1C00, 1B10, 1B00]
>>  DEBUG Found input file: /Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml
...
>>  DEBUG Found required file: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/dd11179.pins
>>  DEBUG Found required file: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/DMDocument.pins
>>  DEBUG Found required file: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/Glossary.pins
>>  DEBUG GetDOMModelDoc Done
>>  DEBUG Found required file: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/UpperModel.pont
>>  DEBUG getMasterObjectDict - Set LDDToolSingletonClass - DMDocument.LDDToolSingletonDOMClass.title:USER
>>  DEBUG Found required file: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/1D00/UpperModel.pins
>>  DEBUG getLocalDD.parseXmlFile() Done
>>  DEBUG Found directory: ./export/defnAttr/
>>  DEBUG Found directory: ./export/defnClass/
>>  DEBUG getLocalDD.parseDocument.getAttributes() Done
>>  DEBUG getLocalDD.parseDocument.getAttributesExtended() Done
>>  DEBUG getLocalDD.parseDocument.getClass() Done
>>  DEBUG getLocalDD.parseDocument.getRule() Done
>>  DEBUG getLocalDD.parseDocument.getPropMap() Done
>>  DEBUG getLocalDD.parseDocument() Done
>>  DEBUG getLocalDD.parseDocument.resolveComponentsForAssociation() Done
>>  DEBUG getLocalDD.parseDocument.scanRulesForExternalNamespaces() Done
>>  DEBUG getLocalDD.parseDocument.validateReservedNames() Done
>>  DEBUG getLocalDD.parseDocument.validateAttributeUsed() Done
>>  DEBUG parseDocument.validateNoDuplicateNames() Done
>>  DEBUG parseDocument.validateTypeAttributes() Done
>>  DEBUG parseDocument.validateNoUnitsAttributes() Done
>>  DEBUG parseDocument.validateNilRequiredAttributes() Done
>>  DEBUG parseDocument.validateEnumeratedFlags() Done
>>  DEBUG resolveComponentsReferences() Done
>>  DEBUG getLocalDD.validateParsedHeader() Done
>>  DEBUG getLocalDD.addLDDtoMaster() Done
>>  DEBUG getLocalDD.validateNoNestedExposedClasses() Done
>>  DEBUG getLocalDD Done
>>  DEBUG getAttrAssocArr Done
>>  DEBUG
>>  DEBUG Active Namespace Ids:
>>  DEBUG      - namespace_id:pds
>>  DEBUG
>>  DEBUG Master DOM Structures Initiated
>>  DEBUG Master Class Map Sizes     - DOMInfoModel.masterDOMClassMap.size():380
>>  DEBUG                            - DOMInfoModel.masterDOMClassIdMap.size():380
>>  DEBUG                            - DOMInfoModel.masterDOMClassArr.size():380
>>  DEBUG
>>  DEBUG Master Property Map Sizes  - DOMInfoModel.masterDOMPropMap.size():1434
>>  DEBUG                            - DOMInfoModel.masterDOMPropIdMap.size():1434
>>  DEBUG                            - DOMInfoModel.masterDOMPropArr.size():1434
>>  DEBUG
>>  DEBUG Master Attribute Map Sizes - DOMInfoModel.masterDOMAttrMap.size():1030
>>  DEBUG                            - DOMInfoModel.masterDOMAttrIdMap.size():1030
>>  DEBUG                            - DOMInfoModel.masterDOMAttrArr.size():1030
>>  DEBUG
>>  DEBUG Master Rule Map Sizes      - DOMInfoModel.masterDOMRuleMap.size():247
>>  DEBUG                            - DOMInfoModel.masterDOMRuleIdMap.size():244
>>  DEBUG                            - DOMInfoModel.masterDOMRuleArr.size():247
>>  DEBUG
>>  DEBUG Master Data Type Sizes     - DOMInfoModel.masterDOMDataTypeMap.size():64
>>  DEBUG                            - DOMInfoModel.masterDOMDataTypeTitleMap.size():64
>>  DEBUG                            - DOMInfoModel.masterDOMDataTypeArr.size():64
>>  DEBUG
>>  DEBUG Master Unit Sizes          - DOMInfoModel.masterDOMUnitMap.size():36
>>  DEBUG                            - DOMInfoModel.masterDOMUnitTitleMap.size():36
>>  DEBUG                            - DOMInfoModel.masterDOMUnitArr.size():36
>>  DEBUG
>>  DEBUG GetDOMModel Done
>>  DEBUG Found directory: ./export/
>>  DEBUG writeXMLSchemaFiles - lSchemaFileDefn.identifier:/Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml
>>  DEBUG writeXMLSchemaFileHeader - lSchemaFileDefn.nameSpaceIdNC:lcross
>>  DEBUG writeXMLSchemaFileHeader - DMDocument.masterNameSpaceIdNCLC:pds
>>  DEBUG writeXMLSchemaFiles - Write Classes - classHierMap.size():6
>>  DEBUG writeLDDArtifacts - XML Schema - lSchemaFileDefn.identifier:/Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml - Done
>>  DEBUG writeLDDArtifacts - Schematron - lSchemaFileDefn.identifier:/Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml - Done
>>  DEBUG writeAllArtifacts - Schema Label - lSchemaFileDefn.identifier:/Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml - Done
>>  DEBUG writeLDDArtifacts - JSON Done
>>  DEBUG Next UID: 100004625

>>  ERROR 11179 data dictionary attribute is missing for overwrite - Identifier:DataElement.DE.0001_NASA_PDS_1.pds.DD_Associate_External_Class.pds.class_name
>>  ERROR 11179 data dictionary attribute is missing for overwrite - Identifier:DataElement.DE.0001_NASA_PDS_1.pds.DD_Associate_External_Class.pds.namespace_id
>>  ERROR 11179 data dictionary attribute is missing for overwrite - Identifier:DataElement.DE.0001_NASA_PDS_1.pds.DD_Context_Value_List.pds.attribute_name
>>  ERROR 11179 data dictionary attribute is missing for overwrite - Identifier:DataElement.DE.0001_NASA_PDS_1.pds.DD_Context_Value_List.pds.attribute_relative_xpath
>>  ERROR 11179 data dictionary class is missing for overwrite - Identifier:ObjectClass.OC.0001_NASA_PDS_1.pds.Cartography_Group
>>  ERROR 11179 data dictionary class is missing for overwrite - Identifier:ObjectClass.OC.0001_NASA_PDS_1.pds.DD_Associate_External_Class
>>  ERROR 11179 data dictionary class is missing for overwrite - Identifier:ObjectClass.OC.0001_NASA_PDS_1.pds.DD_Context_Value_List
>>  ERROR 11179 data dictionary class is missing for overwrite - Identifier:ObjectClass.OC.0001_NASA_PDS_1.pds.Rings
>>  INFO Configured NameSpaceIds:[alt, apollo, atm, bc, bc_mpo_bel, bc_mpo_ber, bc_mpo_isa, bc_mpo_mag, bc_mpo_mer, bc_mpo_mgn, bc_mpo_mix, bc_mpo_mre, bc_mpo_phe, bc_mpo_sim, bc_mpo_six, bc_mpo_srn, bc_mtm_cam, cart, chan1, clementine, clipper, clps, ctli, dart, darts, disp, ebt, em16, em16_tgo_acs, em16_tgo_cas, em16_tgo_frd, em16_tgo_nmd, emrsp, emrsp_rm, emrsp_rm_arm, emrsp_rm_clu, emrsp_rm_ise, emrsp_rm_loc, emrsp_rm_mic, emrsp_rm_mis, emrsp_rm_mom, emrsp_rm_nav, emrsp_rm_pan, emrsp_rm_rls, emrsp_rm_wis, epn, geo, geom, hst, hyb2, img, img_surface, iras, isda, juice, juice_3gm, juice_gala, juice_haa, juice_janus, juice_jmag, juice_jmc, juice_majis, juice_navcam, juice_pephi, juice_peplo, juice_pride, juice_radem, juice_rime, juice_rpwi, juice_swi, juice_uvs, kpds, kplo, lcross, lt, lucy, mars2020, mer, mgn, ml, mro, msl, msn, msn_surface, multi, naif, near, neas, nh, nucspec, ody, particle, pds, ppi, proc, psa, psyche, radar, rings, rs, rssa, sb, sp, speclib, survey, vco, vg1, vg2, vgr, vikinglander, viper, wave]
>>  INFO LDDTOOL Version: 15.3.0-SNAPSHOT
>>  INFO IM Version Id: 1.13.0.0
>>  INFO IM Namespace Id: pds
>>  INFO IM Label Version Id: 1.19
>>  INFO Date: Tue Dec 10 14:35:36 PST 2024
>>  INFO PARENT_DIR: /Users/jpadams/proj/pds/pdsen/workspace/pds4-information-model/lddtool-15.3.0-SNAPSHOT/Data/

>>> ERROR Init:  - LDD Dictionary_Type not Found:TBD_dictionary_type  Defaulting to Discipline
>>> INFO Init:  - Config.Properties Namespace Id Found:lcross
>>> INFO Init:  - Config.Properties Namespace Id Using:lcross
>>> INFO Attribute: <intercept_point_latitude> - The default minimum value provided by the attribute's data type is being overridden with -90.0
>>> INFO Attribute: <intercept_point_latitude> - The default maximum value provided by the attribute's data type is being overridden with 90.0
>>> INFO Attribute: <intercept_point_longitude> - The default minimum value provided by the attribute's data type is being overridden with 0.0
>>> INFO Attribute: <intercept_point_longitude> - The default maximum value provided by the attribute's data type is being overridden with 360.0
>>> INFO Attribute: <operating_setting_value> - The default minimum value provided by the attribute's data type is being overridden with 0
>>> INFO Attribute: <operating_setting_value> - The default maximum value provided by the attribute's data type is being overridden with 15
>>> INFO Attribute: <integration_time> - The default minimum value provided by the attribute's data type is being overridden with 0
>>> INFO Attribute: <gain_value> - The default minimum value provided by the attribute's data type is being overridden with 0

 -- LDDTool Execution Summary --
     0 warning(s)
     9 error(s)
     0 fatal error(s)

Input:

     - IM Version: 1D00
     - PDS4 Flag: true
     - LDD Flag: true
     - IM Version: true
     - Merge Flag: true
     - Export JSON Flag: true

     - Ingest LDD(s): /Users/jpadams/test/lcross_testing/PDS4_LCROSS_IngestLDD_1000.xml

Output:

     - ./PDS4_LCROSS_1D00_1000.xsd
     - ./PDS4_LCROSS_1D00_1000.sch
     - ./PDS4_LCROSS_1D00_1000.xml
     - ./export/PDS4_PDS_1D00.JSON

>>  INFO Exit(0)

Test Data

lcross_testing.zip
@jordanpadams jordanpadams added bug Something isn't working needs:triage labels Dec 10, 2024
@jordanpadams jordanpadams self-assigned this Dec 10, 2024
@jordanpadams jordanpadams changed the title Issue trying to generate schemas for older LCROSS LDD Issue trying to generate schemas 1E00 and 1D00 Dec 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@jshughes jshughes

Labels
B15.1 bug Something isn't working s.high sprint-backlog
Projects
EN Portfolio Backlog
Status: ToDo
Milestone
No milestone
Development

No branches or pull requests
2 participants
@jshughes @jordanpadams