2023.8

[javierggt]

ska3-matlab 2023.8

This PR includes:

• A list of packages is being removed from ska3-flight. These packages, which have a narrow scope an audience, will be grouped in a separate category and installed separately. In order to improve flexibility and reduce unnecessary labor of full FSDS review, these packages will be delegated from FSDS control to a lower level (see here)
• One new package: chandra_limits, a package for limit management.
• Changes to proseco, sparkles and starcheck to make the ACA penalty limit optional.
• Changes in parse_cm to handle machine-readable comments (see here)
• Small updates to improve chandra_models access, including a change to xija so it will use ska_helpers.chandra_models.
• changes in agasc to handle a HEALPix-index catalog
• allow specifying the AGASC file/version in proseco and sparkles (in preparation for AGASC 1.8)

Interface Impacts:

• 11 packages removed.
• parse_cm.or_list.read_or_list is deprecated. parse_cm.or_list.read_or_list_full should be used instead. Use of parse_cm.or_list.read_or_list will result in a warning.
• parse_cm.common. _coerce_type is deprecated. Use ska_helpers.utils.convert_to_int_float_str instead.
• xija models now will respect the CHANDRA_MODELS_DEFAULT_VERSION and CHANDRA_MODELS_REPO_DIR env vars end determine which model is used.

Testing:

• Automated tests.
• GRETA.
• HEAD.

The latest release candidates will be installed in /proj/sot/ska3/matlab/test on GRETA,
and all release candidates will be available for testing from the usual channels:

conda create -n ska3-matlab-2023.8rc1 --override-channels \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/flight \
  -c https://icxc.cfa.harvard.edu/aspect/ska3-conda/test \
  ska3-matlab==2023.8rc1

Review

All operations critical or impacting PR's are independently and carefully reviewed. For other PR's the level of detail for review is calibrated to operations criticality. Some PR's that are confined to aspect-team-specific processing may have little to no independent review.

Deployment

ska3-matlab 2023.8 will be promoted to flight conda channel and installed on GRETA Linux after approval from FOT team.

Code changes

ska3-matlab changes (2023.6 -> 2023.8rc1)

New Packages

• chandra_limits: 0.5.0

Removed Packages

• aca_hi_bgd
• aca_weekly_report
• acdc
• aimpoint_mon
• annie
• astromon
• jobwatch
• kalman_watch
• perigee_health_plots
• ska_report_ranges

Updated Packages

• aca_view: 0.12.0 -> 0.13.0 (0.12.0 -> -> 0.13.0)
  • PR 171 (Javier Gonzalez): Updates to dark style
  • PR 169 (Javier Gonzalez): Data improvements
  • PR 174 (Javier Gonzalez): Show AABGDTYP
  • PR 173 (Javier Gonzalez): Change log color scale so negative values are not nan
  • PR 176 (Javier Gonzalez): Dynbgd fixes
• acis_thermal_check: 4.6.0 -> 4.7.0 (4.6.0 -> 4.7.0)
  • PR 65 (John ZuHone): Improve logging to screen and run.dat
• agasc: 4.15.0 -> 4.17.0 (4.15.0 -> 4.16.0 -> 4.17.0)
  • PR 154 (Javier Gonzalez): In agasc supplement processing, only process observations that already happened.
  • PR 155 (Tom Aldcroft): Support HEALpix-indexed AGASC HDF5 files and more
• chandra_aca: 4.41.0 -> 4.42.0 (4.41.0 -> 4.42.0)
  • PR 156 (Tom Aldcroft): Convert docstrings to numpydocs format and add dark_model API docs
• cheta: 4.59.0 -> 4.60.0 (4.59.0 -> 4.60.0)
  • PR 250 (Tom Aldcroft): Fix problems that came up in pitch/roll-comp when using real-time data
• cxotime: 3.6.0 -> 3.6.1 (3.6.0 -> 3.6.1)
  • PR 39 (Javier Gonzalez): Fix tests on GRETA
• hopper: 4.5.4 -> 4.6.0 (4.5.4 -> 4.6.0)
  • PR 25 (Jean Connelly): Update to use parse_cm.read_or_list_full
• kadi: 7.5.0 -> 7.6.0 (7.5.0 -> 7.6.0)
  • PR 291 (Tom Aldcroft): Improve SPM eclipse enable state
• mica: 4.33.0 -> 4.33.2 (4.33.0 -> 4.33.1 -> 4.33.2)
  • PR 284 (Jean Connelly): Change acq anomaly notification from aca_alert to aca email
  • PR 285 (Jean Connelly): Set mica agasc calls to use miniagasc*
• parse_cm: 3.11.0 -> 3.13.0 (3.11.0 -> 3.12.0 -> 3.13.0)
  • PR 42 (Tom Aldcroft): Add support for machine readable comments
  • PR 43 (Tom Aldcroft): Apply black and organize imports in acis_tables.py + update flake8 workflow
  • PR 44 (Tom Aldcroft): Use ska_helpers.utils.convert_to_int_float_str instead of _coerce_type
• proseco: 5.10.0 -> 5.11.0 (5.10.0 -> 5.11.0)
  • PR 387 (Tom Aldcroft): Allow specifying AGASC HDF5 file or latest proseco_agasc as default
• ska_helpers: 0.11.0 -> 0.12.0 (0.11.0 -> 0.12.0)
  • PR 49 (Tom Aldcroft): Add function convert_to_int_float_str
• ska_sun: 3.10.1 -> 3.11.0 (3.10.1 -> -> 3.11.0)
  • PR 24 (Tom Aldcroft): Performance
  • PR 25 (Tom Aldcroft): Support multiple sun position dispatch methods
  • PR 34 (Jean Connelly): Set to use nominal roll range 0-360
• skare3_tools: 1.0.10 -> 1.1.0 (1.0.10 -> -> 1.1.0)
  • PR 99 (Jean Connelly): Update docstring to note it works on non-metapackages
  • PR 98 (Javier Gonzalez): Fixes to package info summaries
  • PR 101 (Tom Aldcroft): Add module for converting docstrings to numpydoc format
  • PR 103 (Javier Gonzalez): Requirements
• sparkles: 4.23.0 -> 4.24.0 (4.23.0 -> 4.24.0)
  • PR 197 (Tom Aldcroft): Update tests for AGASC >= 1.8 and lazy import matplotlib
• starcheck: 14.3.0 -> 14.5.0 (14.3.0 -> 14.4.0 -> 14.5.0)
  • PR 424 (Jean Connelly): Set 'too cold for fid placement' check to use acq t_ccd
  • PR 430 (Jean Connelly): Update to use read_or_list_full

Related Issues

Fixes #1189
Fixes #1191
Fixes #1192
Fixes #1193
Fixes #1194
Fixes #1195
Fixes #1196
Fixes #1197
Fixes #1198
Fixes #1199