Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate and fix types mismatches in registry mappings from all node cluster to OpenSearch serverless #280

Closed
3 tasks
jordanpadams opened this issue May 3, 2024 · 4 comments

Comments

@jordanpadams
Copy link
Member

jordanpadams commented May 3, 2024

💡 Description

We need to preserve the explicit typing of fields from our existing OpenSearch instances over to the new OpenSearch. here is what

  • Export current mappings from each node registry index
GET registry/_mapping
  • Make necessary changes outlined below for some of the index mappings that are incorrect
  • Import into new index in OpenSearch serverles (TBD instructions)

Updates needed

Per this warning from our current CCS config:

Screenshot 2024-05-03 at 10 48 29 AM

We might as well resolve these issues now before we migrate the data. Some of them we can explicitly see where the conflict arises, while others will require grepping through the mappings after they are exported to make the update.

Conflicts

Field Conflicting Node Registry Current Type Expected Type
vid naif keyword float
insight:Observation_Information/insight:release_number atm integer keyword
insight:Observation_Information/insight:start_sol_number geo keyword integer
insight:Observation_Information/insight:start_solar_longitude geo keyword double
insight:Observation_Information/insight:stop_sol_number geo keyword integer
insight:Observation_Information/insight:stop_solar_longitude geo keyword double
ops:Data_File_Info/ops:file_size naif keyword long
ops:Label_File_Info/ops:blob naif keyword binary
ops:Label_File_Info/ops:file_size naif keyword long
ops:Label_File_Info/ops:json_blob naif keyword binary
pds:Checksum_Manifest/pds:offset naif keyword long
pds:Citation_Information/pds:publication_year naif keyword date
pds:Document/pds:document_editions naif keyword long
pds:Document_Edition/pds:files naif keyword long
pds:Document_File/pds:file_size naif keyword long
pds:Field_Character/pds:field_length naif keyword long
pds:Field_Character/pds:field_location naif keyword long
pds:Field_Character/pds:field_number naif keyword long
pds:Field_Delimited/pds:field_number naif keyword long
pds:Field_Delimited/pds:maximum_field_length naif keyword long
pds:File/pds:file_size naif keyword long
pds:Header/pds:object_length naif keyword long
pds:Header/pds:offset naif keyword long
pds:Inventory/pds:offset naif keyword long
pds:Inventory/pds:records naif keyword long
pds:Record_Character/pds:fields naif keyword long
pds:Record_Character/pds:groups naif keyword long
pds:Record_Character/pds:record_length naif keyword long
pds:Record_Delimited/pds:fields naif keyword long
pds:Record_Delimited/pds:groups naif keyword long
pds:SPICE_Kernel/pds:object_length naif keyword long
pds:SPICE_Kernel/pds:offset naif keyword long
pds:Stream_Text/pds:offset naif keyword long
pds:Table_Character/pds:offset naif keyword long
pds:Table_Character/pds:records naif keyword long

⚔️ Parent Epic / Related Tickets

No response

@jordanpadams
Copy link
Member Author

Output comparing the types across clusters:

insight:Observation_Information/insight:release_number

{
  "integer": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com"
  ]
}

insight:Observation_Information/insight:start_sol_number

{
  "integer": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com"
  ]
}

insight:Observation_Information/insight:start_solar_longitude

{
  "double": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com"
  ]
}

insight:Observation_Information/insight:stop_sol_number

{
  "integer": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com"
  ]
}

insight:Observation_Information/insight:stop_solar_longitude

{
  "double": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com"
  ]
}

ops:Data_File_Info/ops:file_size

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

ops:Label_File_Info/ops:blob

{
  "binary": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

ops:Label_File_Info/ops:file_size

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

ops:Label_File_Info/ops:json_blob

{
  "binary": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Checksum_Manifest/pds:offset

{
  "long": [
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Citation_Information/pds:publication_year

{
  "date": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Document/pds:document_editions

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Document_Edition/pds:files

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Document_File/pds:file_size

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Field_Character/pds:field_length

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Field_Character/pds:field_location

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Field_Character/pds:field_number

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Field_Delimited/pds:field_number

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Field_Delimited/pds:maximum_field_length

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:File/pds:file_size

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Header/pds:object_length

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Header/pds:offset

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Inventory/pds:offset

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Inventory/pds:records

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Record_Character/pds:fields

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Record_Character/pds:groups

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Record_Character/pds:record_length

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Record_Delimited/pds:fields

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Record_Delimited/pds:groups

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:SPICE_Kernel/pds:object_length

{
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ],
  "long": [
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ]
}

pds:SPICE_Kernel/pds:offset

{
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ],
  "long": [
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ]
}

pds:Stream_Text/pds:offset

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Table_Character/pds:offset

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

pds:Table_Character/pds:records

{
  "long": [
    "https://search-atm-prod-mkvgzojag2ta65bnotqdpopzju.us-west-2.es.amazonaws.com",
    "https://search-en-prod-di7dor7quy7qwv3husi2wt5tde.us-west-2.es.amazonaws.com",
    "https://search-geo-prod-6iz6lwiw6luyffpsq52ndsrtbu.us-west-2.es.amazonaws.com",
    "https://search-img-prod-tlnl5qlzgk5iknwhiemnc6aogy.us-west-2.es.amazonaws.com",
    "https://search-rms-prod-hgkpolys7ww6cdoogbx5gsfy6m.us-west-2.es.amazonaws.com",
    "https://search-sbnpsi-prod-egowc5td43xn744siksghckq4i.us-west-2.es.amazonaws.com",
    "https://search-sbnumd-prod-o5i2rnn265gnwmv2quk4n7uram.us-west-2.es.amazonaws.com",
    "https://search-ppi-prod-2dnlixccilgow52iqgn2fs4jo4.us-west-2.es.amazonaws.com",
    "https://search-psa-prod-fec4omrmor3hhu5cflf7zigvtm.us-west-2.es.amazonaws.com"
  ],
  "keyword": [
    "https://search-naif-prod-pm7hsg36wqejex3whlnpj3d6ma.us-west-2.es.amazonaws.com"
  ]
}

@jordanpadams
Copy link
Member Author

Used these steps to fix NAIF and GEO indexes: https://opster.com/guides/elasticsearch/data-architecture/elasticsearch-change-field-type/

@alexdunnjpl
Copy link
Contributor

@sjoshi-jpl @jordanpadams the simplest* way to make these corrections, imho, would be to manually edit the relevant properties' types when copypasting the index definition from the old managed index to the new index creation query.

*there's an argument to be made that there's less room for human error if you perform all the fixes, then perform the index "migration" separately, but per @jordanpadams the naif fixes have already been made (in the old managed indices?) so the manual edits would only affect five properties (the atm/geo ones)

@tloubrieu-jpl
Copy link
Member

tloubrieu-jpl commented May 16, 2024

The mappings are as we would like them to be in MCP production for all node and in Dev for EN.

@github-project-automation github-project-automation bot moved this from Release Backlog to 🏁 Done in B14.1 May 16, 2024
@github-project-automation github-project-automation bot moved this from Release Backlog to 🏁 Done in B15.0 May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Status: 🏁 Done
Status: 🏁 Done
Development

No branches or pull requests

4 participants