Moved creating SiPixelTemplateStore from DB to an ESProducer [13_2]

[Dr15Jones]

PR description:

All DB construction was switched to using EventSetup. Cases using reading from files were kept local to module.
The new ESProducer was added as a Task to all needed Sequences.

PR validation:

Code compiles.

backport of #42514 and #42597

[cmsbuild]

A new Pull Request was created by @Dr15Jones (Chris Jones) for CMSSW_13_2_X.

It involves the following packages:

• Alignment/OfflineValidation (alca)
• CalibTracker/SiPixelLorentzAngle (alca)
• Calibration/TkAlCaRecoProducers (alca)
• CondFormats/SiPixelTransient (db, reconstruction)
• DQM/SiPixelPhase1Config (dqm)
• DQM/SiPixelPhase1Track (dqm)
• DQMOffline/Trigger (dqm)
• FastSimulation/Configuration (fastsim)
• FastSimulation/TrackingRecHitProducer (fastsim)
• HLTrigger/Configuration (hlt)
• RecoHI/HiTracking (reconstruction)
• RecoLocalTracker/SiPixelRecHits (reconstruction)
• RecoTracker/FinalTrackSelectors (reconstruction)
• RecoTracker/TrackProducer (reconstruction)
• RecoTracker/TransientTrackingRecHit (reconstruction)

@perrotta, @Martin-Grunewald, @ssekmen, @tvami, @nothingface0, @civanch, @emanueleusai, @consuegs, @mdhildreth, @mandrenguyen, @cmsbuild, @missirol, @saumyaphor4252, @clacaputo, @syuvivida, @sbein, @pmandrik, @tjavaid, @micsucmed, @francescobrivio, @rvenditti can you please review it and eventually sign? Thanks.
@VourMa, @felicepantaleo, @Martin-Grunewald, @Fedespring, @tlampen, @threus, @mmusich, @seemasharmafnal, @silviodonato, @JanFSchulte, @jhgoh, @missirol, @yenjie, @cericeci, @ferencek, @trocino, @yetkinyilmaz, @fioriNTU, @sroychow, @GiacomoSguazzoni, @rovere, @VinInn, @mroguljic, @tocheng, @jandrea, @idebruyn, @ebrondol, @mtosi, @dgulhan, @arossi83, @HuguesBrun, @adewit, @mandrenguyen, @jazzitup, @dkotlins, @kurtejung, @gpetruc, @matt-komm, @rociovilar, @tvami this is something you requested to watch as well.
@perrotta, @dpiparo, @antoniovilela, @rappoccio you are the release manager for this.

cms-bot commands are listed here

• Backported from Moved creating SiPixelTemplateStore from DB to an ESProducer #42514

[mmusich]

this branch has conflicts to be resolved.

[cmsbuild]

Pull request #42644 was updated. @perrotta, @Martin-Grunewald, @ssekmen, @tvami, @nothingface0, @civanch, @emanueleusai, @consuegs, @mdhildreth, @mandrenguyen, @cmsbuild, @missirol, @saumyaphor4252, @clacaputo, @syuvivida, @sbein, @pmandrik, @tjavaid, @micsucmed, @francescobrivio, @rvenditti can you please check and sign again.

[Dr15Jones]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-67adef/34452/summary.html
COMMIT: 1e1d2a0
CMSSW: CMSSW_13_2_X_2023-08-23-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42644/34452/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @CMSTrackingPOG [13.2.X] Added efficiencies of matched and unmatched tracks (between HLT and offline) vs LS, vs online lumi and vs PU #42593

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-67adef/34452/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-67adef/34452/git-merge-result

Comparison Summary

Summary:

• You potentially added 4 lines to the logs
• Reco comparison results: 8 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3196338
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 4
• DQMHistoTests: Total successes: 3196309
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 55.254 KiB( 47 files compared)
• DQMHistoSizes: changed ( 12434.0,... ): 27.627 KiB HLT/Tracking
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: no differences found

[missirol]

+hlt

(This update will require the 'parsing' of the next CMSSW_13_2_X release into ConfDB, in order to add the new ESProducer to the HLT menus in the db, I think.)

[missirol]

backport of #42514
backport of #42597

[perrotta]

The three backports in 13_2_X, 13_1_X and 13_0_X are identical, and all verbatim backports of the combination of #42514 and #42597. Therefore the same comments made here are also valid for #42647 and #42648

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-67adef/34528/summary.html
COMMIT: 7e32389
CMSSW: CMSSW_13_2_X_2023-08-29-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/42644/34528/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially removed 11 lines from the logs
• Reco comparison results: 4 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3197913
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3197888
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 207 log files, 159 edm output root files, 48 DQM output files
• TriggerResults: no differences found

[mandrenguyen]

+1

[mmusich]

+hlt

[perrotta]

+alca

[perrotta]

+db

[emanueleusai]

+1

[civanch]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_13_2_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_13_3_X is complete. This pull request will now be reviewed by the release team before it's merged. @rappoccio, @dpiparo, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[rappoccio]

+1