New developments using multiple data catalogs provided in site-local-config.xml

[nhduongvn]

PR description:

This request proposes code changes to use multiple data catalogs listed in site-local-config.xml. Previously, the site-local-config.xml contains two data catalogs, primary and fallback ones. These are parsed and used by CMSSW using dedicated methods and functions.

The idea is to add a pfns_ variable to FileCatalogItem class (FWCore/Catalog/interface/InputFileCatalog.h ), to store all the physical file names. Each of them corresponds to a data catalog. The collection of data catalogs is returned by SiteLocalConfigService. The FileCatalogItems for all input files (each item corresponds to an input file) are store in InputFileCatalog, which is the interface to access input file catalog.

When an input file is read or opened by a source (PoolSource for example), a loop over its names formed from available catalogs is used until the file can be opened successfully by a valid catalog. Otherwise, exception is thrown. This mechanism replaces the use of primary and fallback catalogs in the past. Examples can be found in "initTheFile" (https://github.com/nhduongvn/cmssw/blob/dev-dataCatalog-1-forPR/IOPool/Input/src/RootInputFileSequence.cc)

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13702

• This PR adds an extra 76KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

• code-checks:
  https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13702/code-checks.patch
  e.g. curl https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13702/code-checks.patch | patch -p1
  You can also run scram build code-checks to apply code checks directly

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13704

• This PR adds an extra 80KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

• code-checks:
  https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13704/code-checks.patch
  e.g. curl https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13704/code-checks.patch | patch -p1
  You can also run scram build code-checks to apply code checks directly

[silviodonato]

Please update the title of this to PR to something more readable.
Please rebase this PR starting from a recent release (eg. CMSSW_11_1_X_2020-02-11-1100) or at least CMSSW_11_1_0_pre2.

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13783

• This PR adds an extra 84KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

• code-format:
  https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13783/code-format.patch
  e.g. curl https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13783/code-format.patch | patch -p1
  You can also run scram build code-format to apply code format directly

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13784

• This PR adds an extra 84KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

• code-format:
  https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13784/code-format.patch
  e.g. curl https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28911/13784/code-format.patch | patch -p1
  You can also run scram build code-format to apply code format directly

[slava77]

+1

for #28911 9072f1d

• there were no changes affecting reco since the last signoff https://github.com/cms-sw/cmssw/pull/28911/files/a8958755df1d4c54bf1d727c23577de49fb646a2..9072f1d0b913a01ad992d051f70ed45233ada7c7

[agrohsje]

+1

[mommsen]

+1

[pohsun]

+1

[silviodonato]

Do you have any comments @rekovic ?

[rekovic]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

[silviodonato]

+1