Add Python 3.13 to CI

[benclifford]

Type of change

• Code maintenance/cleanup

[benclifford]

This needs a radical pilot upgrade, which doesn't work immediately in my dev environment. If I change to radical pilot and utils 1.83, and run pytest parsl/tests/ --config parsl/tests/configs/local_radical.py --log-cli-level=DEBUG, I get a hang and the below stack trace. I haven't dug in any deeper.

$ cat pmgr_launching.0000.err 
Traceback (most recent call last):
  File "/home/benc/parsl/virtualenv-3.12/bin/radical-pilot-component", line 147, in <module>
    ru.daemonize(main=main, args=[sid, reg_addr, uid, evt],
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/utils/daemon.py", line 114, in daemonize
    else           : main(*args)
                     ^^^^^^^^^^^
  File "/home/benc/parsl/virtualenv-3.12/bin/radical-pilot-component", line 64, in main
    wrapped_main(sid, reg_addr, uid, log, prof, evt)
  File "/home/benc/parsl/virtualenv-3.12/bin/radical-pilot-component", line 92, in wrapped_main
    comp = rp.utils.BaseComponent.create(c_cfg, session)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/pilot/utils/component.py", line 301, in create
    return comp[cfg.kind].create(cfg, session)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/pilot/pmgr/launching/base.py", line 167, in create
    return cls(cfg, session)
           ^^^^^^^^^^^^^^^^^
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/pilot/pmgr/launching/base.py", line 135, in __init__
    from .saga  import PilotLauncherSAGA
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/pilot/pmgr/launching/saga.py", line 15, in <module>
    import radical.saga
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/saga/__init__.py", line 10, in <module>
    from .version    import *
  File "/home/benc/parsl/virtualenv-3.12/lib/python3.12/site-packages/radical/saga/version.py", line 9, in <module>
    version_short, version_detail, version_base, version_branch, \
ValueError: not enough values to unpack (expected 6, got 5)

@AymenFJA @andre-merzky

[andre-merzky]

Hi Ben - you would also need to update radical.saga. Or, probably better, you could uninstall radical.saga and the RP dependency would pull psij-python instead as batch API, which is where we are heading to generally.

[benclifford]

after radical upgrade in #3725, the next block is in parsl-visualize, with a tangle between pandas (which needs upgrading to compile on Python 3.13) ... which loosens the numpy bounds ... which breaks networkx ... and also the pandas sqlalchemy interface has changed (now it cannot take an engine and needs a connection object? https://stackoverflow.com/questions/38332787/pandas-to-sql-to-sqlite-returns-engine-object-has-no-attribute-cursor)

[benclifford]

possibly there should be a monitoring upgrade to sqlalchemy 2 -- I did a port before so that LSST people could use that even though the in-tree dependency spec is for 1.x, and one of the above pandas problems is due to using sqlalchemy 1.x

[benclifford]

networkx is fixed for numpy 2 in b0c380499d97489369d7eabbc116964de84859b9 in the numpy repo

$ git tag --contains b0c380499d97489369d7eabbc116964de84859b9
networkx-3.2
networkx-3.2.1
networkx-3.2rc0
networkx-3.3
networkx-3.3rc0
networkx-3.4
networkx-3.4.1
networkx-3.4.2
networkx-3.4rc0

[khk-globus]

I love when PRs get to be this simple. Assuming tests pass, approved. 👏