[ARM] CMSSW_12_5_X: all unit tests for DQM/Integration failed

[iarspider]

Log example:

edmFileUtil --catalog file:/cvmfs/cms-ib.cern.ch/SITECONF/local/PhEDEx/storage.xml?protocol=ibeos --events /store/express/Run2022B/ExpressPhysics/FEVT/Express-v1/000/355/380/00000/b8a57fc4-5656-42b4-9b7b-2e647baf65e8.root | tail -n +9 | head -n -5 | awk '{ print $3 }'
----- Begin Fatal Exception 12-Jun-2023 13:39:07 CEST-----------------------
An exception of category 'ConfigFileReadError' occurred while
   [0] Processing the python configuration file named ./src/DQM/Integration/python/clients/ctpps_dqm_sourceclient-live_cfg.py
Exception Message:
 unknown python problem occurred.
IndexError: list index out of range

At:
  /cvmfs/cms-ib.cern.ch/sw/aarch64/week1/el8_aarch64_gcc10/cms/cmssw/CMSSW_12_5_X_2023-06-12-1100/src/DQM/Integration/python/config/unittestinputsource_cfi.py(113): <module>
  <frozen importlib._bootstrap>(228): _call_with_frames_removed
  <frozen importlib._bootstrap_external>(850): exec_module
  <frozen importlib._bootstrap>(695): _load_unlocked
  <frozen importlib._bootstrap>(986): _find_and_load_unlocked
  <frozen importlib._bootstrap>(1007): _find_and_load
  /cvmfs/cms-ib.cern.ch/sw/aarch64/week1/el8_aarch64_gcc10/cms/cmssw/CMSSW_12_5_X_2023-06-12-1100/src/FWCore/ParameterSet/python/Config.py(744): load
  ./src/DQM/Integration/python/clients/ctpps_dqm_sourceclient-live_cfg.py(15): <module>

----- End Fatal Exception -------------------------------------------------

I think the real issue is in edmFileUtil or the way it is invoked, since the listed command fails:

Singularity> edmFileUtil --catalog file:/cvmfs/cms-ib.cern.ch/SITECONF/local/PhEDEx/storage.xml?protocol=ibeos --events /store/express/Run2022B/ExpressPhysics/FEVT/Express-v1/000/355/380/00000/b8a57fc4-5656-42b4-9b7b-2e647baf65e8.root                                               
cms::Exception caught in EdmFileUtil
An exception of category 'FileCatalog' occurred while
   [0] Calling edm::InputFileCatalog::init()
Exception Message:
Trying to override input file catalog but invalid input override string file:/cvmfs/cms-ib.cern.ch/SITECONF/local/PhEDEx/storage.xml?protocol=ibeos (Should be site,subSite,storageSite,volume,protocol)

[cmsbuild]

A new Issue was created by @iarspider .

@Dr15Jones, @perrotta, @dpiparo, @rappoccio, @makortel, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

[iarspider]

assign dqm

[cmsbuild]

New categories assigned: dqm

@tjavaid,@micsucmed,@nothingface0,@rvenditti,@emanueleusai,@syuvivida,@pmandrik you have been requested to review this Pull request/Issue and eventually sign? Thanks

[makortel]

The tests fail on x86 as well. The cause is likely #41309. The same issues was reported in 12_6_X in #39262, and was fixed in #39266. That needs to be done is to backport #39266 to 12_5_X (and apologies for missing that from the backport #41309).

[makortel]

What needs to be done is to backport #39266 to 12_5_X (and apologies for missing that from the backport #41309).

Done in #41926

[makortel]

The unit tests run successfully now in CMSSW_12_5_X_2023-06-13-1100

[iarspider]

Fixed by #41926