Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HLT menu development for 14_0_X (5/N) #44718

Merged
merged 7 commits into from
Apr 12, 2024

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Apr 11, 2024

backport of #44717

PR description:

Development of HLT menus for CMSSW_14_0_X.

  • This version of the GRun HLT menu corresponds to the list of updates to the "V1.1" menu for the 2024 pp data-taking period.

This update includes the integration of the following JIRA tickets:

  • CMSHLT-3087 [HIG] New HLT Path (low pT single lepton + HT + B-tag) for HH to bbWW for 2024
  • CMSHLT-3104 [BTV] Migration of MC_PFBTag to ParticleNet
  • CMSHLT-3110 [HIG] Moving HLT_QuadJet* control paths to ParkingVBF
  • CMSHLT-3119 [EXO] Migration of the QuadPFJet with 3 B-tag trigger to Particle Net
  • CMSHLT-3120 [JME] Adding Dimuon+Jets & Photon+Jets paths for monitoring (CaloJet/Ak8PFJet/Ak8CaloJet)
  • CMSHLT-3122 [EXO] Adding new barrel-only displaced single muon paths
  • CMSHLT-3125 [TSG] Integrate Alpaka version of Status_On* Paths and Pixel local+track+vertex reconstruction
  • CMSHLT-3127 [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_PFBtagDeepJet_*_v
  • CMSHLT-3132 [TSG] Enforce a naming convention for Alpaka-related modules and their "SerialSync" variants
  • CMSHLT-3133 [TSG] Add PS column "2p0E34_NoScouting"
  • CMSHLT-3134 [TSG] Technical: "drop" statement in EventContents of Calibration, EcalCalibration and HLTMonitor streams
  • CMSHLT-3135 [TSG] Fix "prescale offsets" of Special* PDs
  • CMSHLT-3136 [TSG] Remove unused global PSets (post Run2023)
  • CMSHLT-3138 [Scouting] Update of the smart prescale of the DoubleEG path in the ScoutingPFMonitor PD
  • CMSHLT-3140 [TSG] Set smartPS=1 for HLT_ZeroBias_Alignment_v in ExpressPhysics
  • CMSHLT-3141 [TRK] Add Doublet-Recovery Track collection to EventContent of DQM stream
  • CMSHLT-3142 [TSG/EXO] Fix crashes from hltDisplacedhltIter4PixelLessHitDoubletsForDisplacedTkMuons at start of Run2024B
  • CMSHLT-3144 [PF] Increase hltParticleFlowClusterHBHESoA*.pfRecHitFractionAllocation to 250
  • CMSHLT-3145 [TSG] Disable Ele28+HT and Ele30+Jet cross-triggers
  • CMSHLT-3146 [TSG] Remove (temporarily) paths with reproducibility issues (in PRef and HIon)
  • CMSHLT-3150 [PF] Modify DQMGPUvsCPU EventContent to include hltParticleFlowClusterHCAL and SerialSync version
  • CMSHLT-3151 [TSG] Backport of online updates to cosmics and circulating menus (V1.1)

Also, move the HLT release template to CMSSW_14_0_5, remove customizeHLTfor44591

In addition, the following changes are included:

  • 7a581d2: update customizeHLTforAlpakaPixelReco
  • 98d5408: equip HLT offline customization function to remove unnecessary strain on Frontier
  • 07d11a1 : update of L1T FULL,GRun,2024v10,Special menus in TSG GTs to L1Menu_Collisions2024_v1_1_0_xml
  • f7e5c69 : update the list of HLT path owners: menu 2024 V1.1
  • d13c3a6: added customizeHLTforAlpakaRename and removed customizeHLTforAlpaka calls in customizeHLTforCMSSW
  • 2ebf215 : Introduce 2024v1.1 frozen menu and remove 2024v1.0

PR validation:

TSG Integration tests

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

backport of #44717 to the 2024 production cycle (CMSSW_14_0_X)

mmusich and others added 7 commits April 11, 2024 23:13
This version of the GRun HLT menu corresponds to the list of updates to the "V1.1" menu for the 2024 pp data-taking period.
This update includes the integration of the following JIRA tickets:
- [CMSHLT-3087](https://its.cern.ch/jira/browse/CMSHLT-3087) [HIG] New HLT Path (low pT single lepton + HT + B-tag) for HH to bbWW for 2024
- [CMSHLT-3104](https://its.cern.ch/jira/browse/CMSHLT-3104) [BTV] Migration of MC_PFBTag to ParticleNet
- [CMSHLT-3110](https://its.cern.ch/jira/browse/CMSHLT-3110) [HIG] Moving HLT_QuadJet* control paths to ParkingVBF
- [CMSHLT-3119](https://its.cern.ch/jira/browse/CMSHLT-3119) [EXO] Migration of the QuadPFJet with 3 B-tag trigger to Particle Net
- [CMSHLT-3120](https://its.cern.ch/jira/browse/CMSHLT-3120) [JME] Adding Dimuon+Jets & Photon+Jets paths for monitoring (CaloJet/Ak8PFJet/Ak8CaloJet)
- [CMSHLT-3122](https://its.cern.ch/jira/browse/CMSHLT-3122) [EXO] Adding new barrel-only displaced single muon paths
- [CMSHLT-3125](https://its.cern.ch/jira/browse/CMSHLT-3125) [TSG] Integrate Alpaka version of Status_On* Paths and Pixel local+track+vertex reconstruction
- [CMSHLT-3127](https://its.cern.ch/jira/browse/CMSHLT-3127) [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_PFBtagDeepJet_*_v
- [CMSHLT-3132](https://its.cern.ch/jira/browse/CMSHLT-3132) [TSG] Enforce a naming convention for Alpaka-related modules and their "SerialSync" variants
- [CMSHLT-3133](https://its.cern.ch/jira/browse/CMSHLT-3133) [TSG] Add PS column "2p0E34_NoScouting"
- [CMSHLT-3134](https://its.cern.ch/jira/browse/CMSHLT-3134) [TSG] Technical: "drop" statement in EventContents of Calibration, EcalCalibration and HLTMonitor streams
- [CMSHLT-3135](https://its.cern.ch/jira/browse/CMSHLT-3135) [TSG] Fix "prescale offsets" of Special* PDs
- [CMSHLT-3136](https://its.cern.ch/jira/browse/CMSHLT-3136) [TSG] Remove unused global PSets (post Run2023)
- [CMSHLT-3138](https://its.cern.ch/jira/browse/CMSHLT-3138) [Scouting] Update of the smart prescale of the DoubleEG path in the ScoutingPFMonitor PD
- [CMSHLT-3140](https://its.cern.ch/jira/browse/CMSHLT-3140) [TSG] Set smartPS=1 for HLT_ZeroBias_Alignment_v in ExpressPhysics
- [CMSHLT-3141](https://its.cern.ch/jira/browse/CMSHLT-3141) [TRK] Add Doublet-Recovery Track collection to EventContent of DQM stream
- [CMSHLT-3142](https://its.cern.ch/jira/browse/CMSHLT-3142) [TSG/EXO] Fix crashes from hltDisplacedhltIter4PixelLessHitDoubletsForDisplacedTkMuons at start of Run2024B
- [CMSHLT-3144](https://its.cern.ch/jira/browse/CMSHLT-3144) [PF] Increase hltParticleFlowClusterHBHESoA*.pfRecHitFractionAllocation to 250
- [CMSHLT-3145](https://its.cern.ch/jira/browse/CMSHLT-3145) [TSG] Disable Ele28+HT and Ele30+Jet cross-triggers
- [CMSHLT-3146](https://its.cern.ch/jira/browse/CMSHLT-3146) [TSG] Remove (temporarily) paths with reproducibility issues (in PRef and HIon)
- [CMSHLT-3150](https://its.cern.ch/jira/browse/CMSHLT-3150) [PF] Modify DQMGPUvsCPU EventContent to include hltParticleFlowClusterHCAL and SerialSync version
- [CMSHLT-3151](https://its.cern.ch/jira/browse/CMSHLT-3151) [TSG] Backport of online updates to cosmics and circulating menus (V1.1)

Also, move the HLT release template to CMSSW_14_0_5, remove customizeHLTfor44591
… on Frontier

- see [CMSHLT-3123](https://its.cern.ch/jira/browse/CMSHLT-3123) [TSG] Remove refreshing of Frontier conditions for offline processing
@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

type hlt-integration

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 11, 2024

A new Pull Request was created by @mmusich for CMSSW_14_0_X.

It involves the following packages:

  • Configuration/HLT (hlt)
  • HLTrigger/Configuration (hlt)

@mmusich, @cmsbuild, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@missirol, @fabiocos, @silviodonato, @Martin-Grunewald this is something you requested to watch as well.
@sextonkennedy, @rappoccio, @antoniovilela you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 11, 2024

cms-bot internal usage

@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

enable gpu

@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

@cmsbuild, please test with #44598

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-cbfe9a/38796/summary.html
COMMIT: 2ebf215
CMSSW: CMSSW_14_0_X_2024-04-11-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/44718/38796/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 149 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 82 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3296548
  • DQMHistoTests: Total failures: 3123
  • DQMHistoTests: Total nulls: 89
  • DQMHistoTests: Total successes: 3293316
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 614.3119999999999 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 12834.0,... ): 130.517 KiB HLT/HLTEgammaValidation
  • DQMHistoSizes: changed ( 12834.0,... ): 13.436 KiB HLT/Filters
  • DQMHistoSizes: changed ( 12834.0,... ): -0.164 KiB L1T/L1TStage2uGT
  • DQMHistoSizes: changed ( 139.001,... ): 0.001 KiB HLT/Filters
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: found differences in 3 / 46 workflows

GPU Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 22 differences found in the comparisons
  • DQMHistoTests: Total files compared: 3
  • DQMHistoTests: Total histograms compared: 39740
  • DQMHistoTests: Total failures: 980
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 38760
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 2 files compared)
  • Checked 8 log files, 10 edm output root files, 3 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented Apr 12, 2024

+hlt

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

Exceptionally not going to wait for the main branch IBs since it's the weekend.

@cmsbuild cmsbuild merged commit 4d08b22 into cms-sw:CMSSW_14_0_X Apr 12, 2024
13 checks passed
@mmusich mmusich deleted the HLTdevelopment140X branch April 12, 2024 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants