Add AAA fallback to DQMRootSource

[dan131riley]

PR description:

This PR adds AAA fallback file open logic to the DQMRootSource, resolving issue #27724. The logic is patterned on RootInputFileSequence, which is structurally very similar. There is some annoying code repetition because of slight differences in the logic for the main and fallback case.

PR validation:

The fallback logic was tested with the test case from #27724. Fallback logic worked as expected:

24-Sep-2019 17:02:14 CEST  Initiating request to open file root://eoscms.cern.ch//eos/cms/store/data/Run2018D/ZeroBias/DQMIO/PromptReco-v2/000/323/940/00000/9F411A2F-9C94-D54F-894B-83D60BF55C41.root
%MSG-w XrdAdaptorInternal:  AfterModBeginStream 24-Sep-2019 17:02:16 CEST  BeforeEvents
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/data/Run2018D/ZeroBias/DQMIO/PromptReco-v2/000/323/940/00000/9F411A2F-9C94-D54F-894B-83D60BF55C41.root.
%MSG
%MSG-w XrdAdaptorInternal:  AfterModBeginStream 24-Sep-2019 17:02:16 CEST  BeforeEvents
Failed to open file at URL root://eoscms.cern.ch:1094//eos/cms/store/data/Run2018D/ZeroBias/DQMIO/PromptReco-v2/000/323/940/00000/9F411A2F-9C94-D54F-894B-83D60BF55C41.root?tried=.
%MSG
24-Sep-2019 17:02:16 CEST  Initiating request to open fallback file root://xrootd-cms.infn.it//store/data/Run2018D/ZeroBias/DQMIO/PromptReco-v2/000/323/940/00000/9F411A2F-9C94-D54F-894B-83D60BF55C41.root
%MSG-w XrdAdaptor:  AfterModBeginStream 24-Sep-2019 17:02:18 CEST BeforeEvents
Data is served from T2_ES_IFCA instead of original site infn.it
%MSG
24-Sep-2019 17:02:20 CEST  Successfully opened fallback file root://xrootd-cms.infn.it//store/data/Run2018D/ZeroBias/DQMIO/PromptReco-v2/000/323/940/00000/9F411A2F-9C94-D54F-894B-83D60BF55C41.root

and it was confirmed that the FJR contained the correct fallback PFN.

A limited matrix is in process, but no regressions are expected as the matrix test cases do not use remote DQM files so the fallback logic would not be engaged.

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28064/12006

• This PR adds an extra 20KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File DQMServices/FwkIO/plugins/DQMRootSource.cc modified in PR(s): DQM: Remove Tags. #28042

[cmsbuild]

A new Pull Request was created by @dan131riley (Dan Riley) for master.

It involves the following packages:

DQMServices/FwkIO

@andrius-k, @kmaeshima, @schneiml, @cmsbuild, @jfernan2, @fioriNTU can you please review it and eventually sign? Thanks.
@barvic this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[jfernan2]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/2653/console Started: 2019/09/24 17:56

[cmsbuild]

+1
Tested at: d443beb
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-db90f0/2653/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-db90f0/2653/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 34
• DQMHistoTests: Total histograms compared: 2958092
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2957750
• DQMHistoTests: Total skipped: 341
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
• Checked 145 log files, 15 edm output root files, 34 DQM output files

[jfernan2]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

[fabiocos]

+1