Update a few MC Gts in autoCond to the latest version available on 14/10/2024

[perrotta]

PR description:

The following GTs are updated in autoCond (in some cases they are not yet the final ones, but they can be tested as such in the IBs).

• phase1_2022_realistic : 140X_mcRun3_2022_realistic_v11
  • Difference with previous version in confDB (v9) is here and it comprises:
    • Update Tracker alignment (same as the one for the 2023 MC, as for https://cms-talk.web.cern.ch/t/call-for-conditions-full-2022-2023-data-rereco-and-mc-production-in-140x/32887/41) and the corresponding BeamSpot (see https://cms-talk.web.cern.ch/t/call-for-conditions-full-2022-2023-data-rereco-and-mc-production-in-140x/32887/45)
    • Update (fix) the SiStripBadComponents tag as for https://cms-talk.web.cern.ch/t/call-for-conditions-full-2022-2023-data-rereco-and-mc-production-in-140x/32887/47
• phase1_2023_realistic: 140X_mcRun3_2023_realistic_v7
  • Difference with previous version in confDB (v6) is here and it comprises:
    • Update the SiStripBadComponents tag as for https://cms-talk.web.cern.ch/t/call-for-conditions-full-2022-2023-data-rereco-and-mc-production-in-140x/32887/47
• phase1_2024_realistic: 140X_mcRun3_2024_realistic_v26
  • Difference with previous version in confDB (v25) is here and it comprises:
    • Fix the EcalLaserAPDPNRatios_2024_outliers_cleaned_3sigma_mc with the correct EcalLasrtAPDPNRatiosRcd (while it had been previously wrongly uploaded in the EcalLaserAPDPNRatiosMCRcd)
• phase1_2024_realistic_hi: 141X_mcRun3_2024_realistic_HI_v8
  • Difference with previous version in confDB (v5) is here and it comprises:
    • Update L1T menu to L1Menu_CollisionsHeavyIons2024_v1_0_5_xml, see https://cms-talk.web.cern.ch/t/gt-mc-update-of-l1t-menu-v1-0-0-in-pbpb-mc-gt-for-14-1-x/51295/13
    • Update tags to synchronize with the pp ref MC, see https://cms-talk.web.cern.ch/t/gt-mc-update-of-l1t-menu-v1-0-0-in-pbpb-mc-gt-for-14-1-x/51295/8
• phase1_2024_realistic_ppRef5TeV: 141X_mcRun3_2024_realistic_ppRef5TeV_v5
  • Difference with previous version in confDB (v4) is here and it comprises:
    • Fix the EcalLaserAPDPNRatios_2024_outliers_cleaned_3sigma_mc with the correct EcalLasrtAPDPNRatiosRcd (while it had been previously wrongly uploaded in the EcalLaserAPDPNRatiosMCRcd)
• phase2_realistic: 141X_mcRun4_realistic_v3
  • Difference with previous version in confDB (v2) is here and it comprises:
    • Remove geometry tags to address a reported source of confusion caused by geometry mismatch crashes due to Phase 1 ideal simulation / reconstruction geometry present in the Phase 2 GTs, see https://cms-talk.web.cern.ch/t/mc-request-for-updates-to-the-phase2-realistic-gt/51430/6

Backports to CMSSW_14_1_X and CMSSW_14_0_X (limitately to the relevant GTs) wil be provided

[cmsbuild]

cms-bot internal usage

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46379/42223

[cmsbuild]

A new Pull Request was created by @perrotta for master.

It involves the following packages:

• Configuration/AlCa (alca)

@atpathak, @cmsbuild, @consuegs, @perrotta can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @missirol, @mmusich, @rsreds, @tocheng, @yuanchao this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

[perrotta]

please test

[cmsbuild]

+1

Size: This PR adds an extra 16KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-be2eca/42169/summary.html
COMMIT: 0cd9b4f
CMSSW: CMSSW_14_2_X_2024-10-14-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46379/42169/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 145 lines to the logs
• Reco comparison results: 17169 differences found in the comparisons
• DQMHistoTests: Total files compared: 44
• DQMHistoTests: Total histograms compared: 3331066
• DQMHistoTests: Total failures: 96809
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3234237
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 4.721 KiB( 43 files compared)
• DQMHistoSizes: changed ( 13034.0 ): 4.721 KiB SiStrip/MechanicalView
• Checked 193 log files, 163 edm output root files, 44 DQM output files
• TriggerResults: found differences in 4 / 42 workflows

[mmusich]

please test for CMSSW_14_2_DBG_X

[perrotta]

I would be curious to understand why 2024 MC workflows show differences in tracking (e.g. generalTracks in wf 12834.0) when the only difference between the GTs used for them in reference and PR produced samples is the EcalLaserAPDPNRatios tag, see here the diff wrt the 2024MC GT in autoCond in the reference IB.

If someone has an explanation I would be happy to hear about it. On the other hand, since the GT update is quite simple and clear, I would be tempted to approve this PR nonetheless.

[mmusich]

If someone has an explanation I would be happy to hear about it.

differences look widespread and compatible with a randomizing effect from regenerated random number sequences in the digitization step. I see that EcalLaserAPDPNRatiosRcd is used in the DIGI step as well in simulation in this twiki - which I think explains why the tag used in the digitization should be compatible with the one used in reconstruction.

[perrotta]

If someone has an explanation I would be happy to hear about it.

differences look widespread and compatible with a randomizing effect from regenerated random number sequences in the digitization step. I see that EcalLaserAPDPNRatiosRcd is used in the DIGI step as well in simulation in this twiki - which I think explains why the tag used in the digitization should be compatible with the one used in reconstruction.

It makes sense, indeed. Thank you Marco.

[perrotta]

+1

• The tests ongoing with CMSSW_14_2_DBG_X are only meant to verify whether the updtates in the 2022MC GT are sufficient to solve issue [DBG_X] Multiple relvals failing due to "looking for SiStripNoises for a strip out of range: strip 0" #46250 : no reason to wait for their conclusion since the standard tests were already successful, see Update a few MC Gts in autoCond to the latest version available on 14/10/2024 #46379 (comment)

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @antoniovilela, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[mandrenguyen]

+1

[cmsbuild]

-1

Failed Tests: HeaderConsistency UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-be2eca/42187/summary.html
COMMIT: 0cd9b4f
CMSSW: CMSSW_14_2_DBG_X_2024-10-10-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46379/42187/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @Dr15Jones Protect getenv in Pythia8Interface #46128
• @bsunanda Phase2-hgx360D Replace cout with logvervatim #46338
• @smuzaffar [L1-UPGRADE] Applying code checks/format #46218
• @bsunanda Run3-hcx376 Get rid of the obsolete constructor of the HcalTopology class #46357
• @bsunanda Run3-376Y Modify the testing code of HcalTopology #46363
• @iarspider [LLVM Analyzer][AlCa] Cleanup clang analyzer warnings #46344
• @iarspider edm::FileInPath: return reference to paths; cleanup code #46200
• @smuzaffar [DB] [Clang]Cleanup clang-analyzer warnings #46320
• @iarspider [LLVM Analyzer] Avoid storing pointer to a temporary string's internal buffer in SiPixelFakeGenErrorDBObjectESSource::produce and SiPixelTemplateDBObjectReader::analyze  #46181
• @fabiocos DQM: restore Muon POG sequence (and CSC Monitor), revert #46293 #46364
• @bsunanda Run3-hcx375 Extend the topology modes to accommodate different scenarios during the Run2 period #46351
• @wddgit Fix potential data race in ESProductResolver #46330
• @bsunanda Run3-hcx373 Correct the HcalTopology class for 2 new geometry modes #46308
• @mmusich Improvements to hltPhase2UpgradeIntegrationTests #46362
• @JHiltbrand Two Small Changes Related to ZDC LUTs #46345

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-be2eca/42187/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-be2eca/42187/git-merge-result

Unit Tests

I found 4 errors in the following unit tests:

---> test TestDQMOfflineConfigurationGotAll had ERRORS
---> test test_MC_22_crosscheck had ERRORS
---> test test_MC_23_crosscheck had ERRORS
and more ...

Comparison Summary

Summary:

• You potentially added 9793347 lines to the logs
• Reco comparison results: 36532 differences found in the comparisons
• DQMHistoTests: Total files compared: 44
• DQMHistoTests: Total histograms compared: 3331066
• DQMHistoTests: Total failures: 227046
• DQMHistoTests: Total nulls: 86
• DQMHistoTests: Total successes: 3103914
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: -0.262 KiB( 43 files compared)
• DQMHistoSizes: changed ( 10224.0 ): -0.070 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 13034.0 ): 0.469 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 250202.181 ): -0.915 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 25202.0 ): 0.254 KiB SiStrip/MechanicalView
• Checked 193 log files, 163 edm output root files, 44 DQM output files
• TriggerResults: found differences in 9 / 42 workflows