Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HLT menu development for 14_0_X (7/N) #44949

Merged
merged 4 commits into from
May 14, 2024

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented May 10, 2024

backport of #44948

PR description:

Development of HLT menus for CMSSW_14_0_X.

  • This is the PR for the 14.0.X branch (thi is the release cycle currently used for Run-3 HLT-menu development).
  • This version of the GRun HLT menu corresponds to the list of updates to the "V1.2" menu for the 2024 pp data-taking period.

This update includes the integration of the following JIRA tickets:

  • CMSHLT-3079 : [MUO] Removal pixel hits requirement in Outside-In
  • CMSHLT-3162 : [L1T] uGT Test crate data in the NanoDST stream
  • CMSHLT-3169 : [HIG] MVA-Based Diphoton HLT Path
  • CMSHLT-3171 : [BTV] Migration of emu+1btag to ParticleNet
  • CMSHLT-3172 : [L1T] NanoDST stream: store RAW data (hltFEDSelectorL1) instead of digis (hltGtStage2Digis)
  • CMSHLT-3173 : [EXO,Scouting] AXOL1TL Paths with VTight, Loose and VLoose Thresholds
  • CMSHLT-3175 : [BPH,Scouting,EXO] Scouting ZeroBias (DST_PFScouting_ZeroBias)
  • CMSHLT-3176 : [BPH,Scouting] update list of L1 bits for scouting muon path
  • CMSHLT-3178 : [EXO] Set PS=0 for HLT_HT360_DisplacedDijet40_Inclusive1PtrkShortSig5_v
  • CMSHLT-3179 : [MUO,Scouting] Update of the NoVtx reconstruction to include extended ROIs (but no pixel doublet recovery)
  • CMSHLT-3180 : [BPH] Paths for new low pT BMTF bits
  • CMSHLT-3182 : [EGM,EXO,HIG] Reducing the threshold of the high rate single photon path
  • CMSHLT-3183 : [EXO] Enabling of AXOL1TL L1 Seeds
  • CMSHLT-3184 : [TSG] Backport of online updates in EventDisplay dataset for Cosmics and Circulating menus
  • CMSHLT-3185 : [TSG] Prescales of random-based HLTs of GRun in Emergency column (2024 rampup)
  • CMSHLT-3186 : [TSG] Add Status_On{CPU,GPU} Paths to all online special menus
  • CMSHLT-3191 : [BTV] Adding PNet Info to HLTMonitor
  • CMSHLT-3193 : [TSG] Add ZeroBias/HLTPhysics PS columns (Run2024D)
  • CMSHLT-3194 : [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_CaloDiJet30

In addition, the following changes are included:

  • 90d704b : update of L1T FULL,GRun,2024v11,Special menus in TSG GTs to L1Menu_Collisions2024_v1_2_0_xml
  • 09b47ae : update the list of HLT path owners: menu 2024 V1.2
  • bbe2e43 : Introduce 2024v1.2 frozen menu and remove 2024v1.1

PR validation:

TSG Integration tests

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

backport of #44948 to the 2024 production cycle (CMSSW_14_0_X)

@mmusich
Copy link
Contributor Author

mmusich commented May 10, 2024

type hlt-integration

@cmsbuild cmsbuild added this to the CMSSW_14_0_X milestone May 10, 2024
@mmusich
Copy link
Contributor Author

mmusich commented May 10, 2024

enable gpu

@cmsbuild
Copy link
Contributor

cmsbuild commented May 10, 2024

A new Pull Request was created by @mmusich for CMSSW_14_0_X.

It involves the following packages:

  • Configuration/HLT (hlt)
  • HLTrigger/Configuration (hlt)

@cmsbuild, @mmusich, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@silviodonato, @fabiocos, @missirol, @Martin-Grunewald this is something you requested to watch as well.
@rappoccio, @sextonkennedy, @antoniovilela you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented May 10, 2024

cms-bot internal usage

@mmusich
Copy link
Contributor Author

mmusich commented May 10, 2024

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ffe24d/39337/summary.html
COMMIT: 801e689
CMSSW: CMSSW_14_0_X_2024-05-10-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/44949/39337/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 92 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 198 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3317561
  • DQMHistoTests: Total failures: 3868
  • DQMHistoTests: Total nulls: 72
  • DQMHistoTests: Total successes: 3313601
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 777.594 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 12834.0,... ): 83.939 KiB HLT/EGM
  • DQMHistoSizes: changed ( 12834.0,... ): 35.131 KiB HLT/HLTEgammaValidation
  • DQMHistoSizes: changed ( 12834.0,... ): 7.070 KiB HLT/Filters
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: found differences in 7 / 46 workflows

GPU Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 11 differences found in the comparisons
  • DQMHistoTests: Total files compared: 3
  • DQMHistoTests: Total histograms compared: 39740
  • DQMHistoTests: Total failures: 496
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 39244
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 2 files compared)
  • Checked 8 log files, 10 edm output root files, 3 DQM output files
  • TriggerResults: no differences found

mmusich added 4 commits May 10, 2024 22:44
This version of the GRun HLT menu corresponds to few updates to the "V1.2" menu for the 2024 pp data-taking period.
This update includes the integration of the following JIRA tickets:
- [CMSHLT-3079](https://its.cern.ch/jira/browse/CMSHLT-3079) : [MUO] Removal pixel hits requirement in Outside-In
- [CMSHLT-3162](https://its.cern.ch/jira/browse/CMSHLT-3162) : [L1T] uGT Test crate data in the NanoDST stream
- [CMSHLT-3169](https://its.cern.ch/jira/browse/CMSHLT-3169) : [HIG] MVA-Based Diphoton HLT Path
- [CMSHLT-3171](https://its.cern.ch/jira/browse/CMSHLT-3171) : [BTV] Migration of emu+1btag to ParticleNet
- [CMSHLT-3172](https://its.cern.ch/jira/browse/CMSHLT-3172) : [L1T] NanoDST stream: store RAW data (hltFEDSelectorL1) instead of digis (hltGtStage2Digis)
- [CMSHLT-3173](https://its.cern.ch/jira/browse/CMSHLT-3173) : [EXO,Scouting] AXOL1TL Paths with VTight, Loose and VLoose Thresholds
- [CMSHLT-3175](https://its.cern.ch/jira/browse/CMSHLT-3175) : [BPH,Scouting,EXO] Scouting ZeroBias (DST_PFScouting_ZeroBias)
- [CMSHLT-3176](https://its.cern.ch/jira/browse/CMSHLT-3176) : [BPH,Scouting] update list of L1 bits for scouting muon path
- [CMSHLT-3178](https://its.cern.ch/jira/browse/CMSHLT-3178) : [EXO] Set PS=0 for HLT_HT360_DisplacedDijet40_Inclusive1PtrkShortSig5_v
- [CMSHLT-3179](https://its.cern.ch/jira/browse/CMSHLT-3179) : [MUO,Scouting] Update of the NoVtx reconstruction to include extended ROIs (but no pixel doublet recovery)
- [CMSHLT-3180](https://its.cern.ch/jira/browse/CMSHLT-3180) : [BPH] Paths for new low pT BMTF bits
- [CMSHLT-3182](https://its.cern.ch/jira/browse/CMSHLT-3182) : [EGM,EXO,HIG] Reducing the threshold of the high rate single photon path
- [CMSHLT-3183](https://its.cern.ch/jira/browse/CMSHLT-3183) : [EXO] Enabling of AXOL1TL L1 Seeds
- [CMSHLT-3184](https://its.cern.ch/jira/browse/CMSHLT-3184) : [TSG] Backport of online updates in EventDisplay dataset for Cosmics and Circulating menus
- [CMSHLT-3185](https://its.cern.ch/jira/browse/CMSHLT-3185) : [TSG] Prescales of random-based HLTs of GRun in Emergency column (2024 rampup)
- [CMSHLT-3191](https://its.cern.ch/jira/browse/CMSHLT-3191) : [BTV] Adding PNet Info to HLTMonitor
- [CMSHLT-3193](https://its.cern.ch/jira/browse/CMSHLT-3193) : [TSG] Add ZeroBias/HLTPhysics PS columns (Run2024D)
- [CMSHLT-3194](https://its.cern.ch/jira/browse/CMSHLT-3194) : [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_CaloDiJet30
@cmsbuild
Copy link
Contributor

Pull request #44949 was updated. @Martin-Grunewald, @mmusich, @cmsbuild can you please check and sign again.

@mmusich
Copy link
Contributor Author

mmusich commented May 10, 2024

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ffe24d/39341/summary.html
COMMIT: bbe2e43
CMSSW: CMSSW_14_0_X_2024-05-10-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/44949/39341/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 3 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 188 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3317561
  • DQMHistoTests: Total failures: 3721
  • DQMHistoTests: Total nulls: 72
  • DQMHistoTests: Total successes: 3313748
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 777.594 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 12834.0,... ): 83.939 KiB HLT/EGM
  • DQMHistoSizes: changed ( 12834.0,... ): 35.131 KiB HLT/HLTEgammaValidation
  • DQMHistoSizes: changed ( 12834.0,... ): 7.070 KiB HLT/Filters
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: found differences in 7 / 46 workflows

GPU Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 11 differences found in the comparisons
  • DQMHistoTests: Total files compared: 3
  • DQMHistoTests: Total histograms compared: 39740
  • DQMHistoTests: Total failures: 566
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 39174
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 2 files compared)
  • Checked 8 log files, 10 edm output root files, 3 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented May 12, 2024

+hlt

  • changes in the outputs of PR tests are in line with updates to the HLT GRun menu, and the change in name of the frozen HLT menus

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

@antoniovilela
Copy link
Contributor

+1

  • HLT V1.2 menu dump.

@cmsbuild cmsbuild merged commit 36a3799 into cms-sw:CMSSW_14_0_X May 14, 2024
13 checks passed
@mmusich mmusich deleted the HLTdevelopment140X branch May 14, 2024 14:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants