Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HLT menu development for 13_0_X (12/N) #42540

Merged
merged 7 commits into from
Aug 14, 2023

Conversation

missirol
Copy link
Contributor

backport of #42537

PR description:

Development of HLT menus for CMSSW_13_0_X.

This update includes the integration of the following JIRA tickets.

  • CMSHLT-2820: [EXO] tighter isolation cut on L2Taus in displaced-tau trigger (and addition of backup trigger)
  • CMSHLT-2836: [TSG] addition of looser L1T seeds to dilepton Scouting triggers
  • CMSHLT-2862: [TRK,ECAL] use only CPU products in CPU branch of DQMGPUvsCPU triggers
  • CMSHLT-2867: [EXO] remove Tracker-HV filters in calo-only LLP triggers
  • CMSHLT-2872: [SMP] looser DiTau trigger for W-3pi search (plus control trigger)
  • CMSHLT-2873: [AlCa] set smartPS=2 for HLT_Physics_v in ExpressPhysics PD
  • CMSHLT-2874: [EXO,HIG] new VBF-parking triggers without PFJet-CHF cut
  • CMSHLT-2875: [EXO] triggers for displaced mu-tau and e-tau final states
  • CMSHLT-2877: [GEM] save GEM FEDRawData in RPCMON stream
  • CMSHLT-2878: [TRK] add pixel-doublet-recovery iteration to standard tracking sequence, and disable track-looper reconstruction

In addition, the following updates relevant to HLT-menu development are included.

  • a929fae: fix function getHltConfiguration
  • 4d35442: change compression settings of OutputModule in hltIntegrationTests
  • 9235615: use bash arrays in test/get*HLT.sh scripts
  • b8a7771: remove module siPixelQualityESProducer from HLT cff files
  • 4387831: update of L1T pp menu in TSG GTs to L1Menu_Collisions2023_v1_3_0
  • af77e18: update of Run-3 data EDM input in HLT tests (HLT-Validation and HLT-addOn tests)

PR validation:

TSG tests.

If this PR is a backport, please specify the original PR and why you need to backport that PR. If this PR will be backported, please specify to which release cycle the backport is meant for:

#42537

Development of HLT pp menus for 2023/2024.

The ESProducer siPixelQualityESProducer can be removed from
the cff fragments of the HLT configurations, as it is provided by the cff file

Configuration.StandardSequences.FrontierConditions_GlobalTag_cff

This avoids picking up the version of siPixelQualityESProducer defined in ConfDB
when a command like the following is used.

cmsDriver.py step2 --conditions 130X_mcRun3_2023_realistic_relvals2023D_v1 \
--datatier GEN-SIM-DIGI-RAW --era Run3_2023 --eventcontent FEVTDEBUGHLT \
--filein "dbs:/RelValTTbar_14TeV/CMSSW_13_0_11-130X_mcRun3_2023_realistic_relvals2023D_v1_RV204-v1/GEN-SIM" \
--fileout "file:step2.root" --geometry DB:Extended --nThreads 8 --no_exec --number 1 \
--pileup 2023_Fills_8807_8901_ProjectedPileup_PoissonOOTPU \
--pileup_input das:/RelValMinBias_14TeV/CMSSW_13_0_11-130X_mcRun3_2023_realistic_relvals2023D_v1_RV204-v1/GEN-SIM \
--python_filename step_2_cfg.py --step DIGI:pdigi_valid,L1,DIGI2RAW,HLT:run3:/dev/CMSSW_13_0_0/GRun/V151

Using HLT:[db]:[config] (as opposed to HLT:[menuKeyword], e.g. HLT:GRun)
leads to a call to the function loadHltConfiguration
after the process has loaded FrontierConditions_GlobalTag_cff,
thus overwriting the ESProducer from the latter cff with
the one defined in the HLT configuration as taken from ConfDB.
For details on a concrete use case, see

https://its.cern.ch/jira/browse/PDMVRELVALS-204
Update of the scripts

HLTrigger/Configuration/test/getHLT.sh , and
HLTrigger/Configuration/test/getFrozenHLT.sh

to use an associative array to specify which
HLT configurations should be downloaded from ConfDB.

This allows for more flexibility for non-standard use cases
(e.g. having to specify different version numbers for different subtables).
In getFrozenHLT.sh , this change also avoids having
to specify the list of configurations in a separate string
(which was named TABLES prior to this commit):
now, it is sufficient to add a new configuration to the associative array.

The downside of using associative arrays is that
the configurations are not downloaded anymore in a specific order,
but said order is (and should be) unimportant in this context.
Update of the functions "getHltConfiguration" and "loadHltConfiguration" defined in

HLTrigger/Configuration/python/Utilities.py

 - remove unnecessary dependencies on external packages like "types"
 - fix "getHltConfiguration" (was broken since the changes in cms-sw#34563)
 - return cms.Process object in "loadHltConfiguration" (backward-compatible change)
 - add checks in both functions to catch errors in ConfDB queries
Development of HLT menus for `CMSSW_13_0_X`.

This update includes the integration of the following JIRA tickets.

 - [CMSHLT-2820](https://its.cern.ch/jira/browse/CMSHLT-2820): [EXO] tighter isolation cut on L2Taus in displaced-tau trigger (and addition of backup trigger)
 - [CMSHLT-2836](https://its.cern.ch/jira/browse/CMSHLT-2836): [TSG] addition of looser L1T seeds to dilepton Scouting triggers
 - [CMSHLT-2862](https://its.cern.ch/jira/browse/CMSHLT-2862): [TRK,ECAL] use only CPU products in CPU branch of `DQMGPUvsCPU` triggers
 - [CMSHLT-2867](https://its.cern.ch/jira/browse/CMSHLT-2867): [EXO] remove Tracker-HV filters in calo-only LLP triggers
 - [CMSHLT-2872](https://its.cern.ch/jira/browse/CMSHLT-2872): [SMP] looser DiTau trigger for W-3pi search (plus control trigger)
 - [CMSHLT-2873](https://its.cern.ch/jira/browse/CMSHLT-2873): [AlCa] set smartPS=2 for `HLT_Physics_v` in `ExpressPhysics` PD
 - [CMSHLT-2874](https://its.cern.ch/jira/browse/CMSHLT-2874): [EXO,HIG] new VBF-parking triggers without PFJet-CHF cut
 - [CMSHLT-2875](https://its.cern.ch/jira/browse/CMSHLT-2875): [EXO] triggers for displaced mu-tau and e-tau final states
 - [CMSHLT-2877](https://its.cern.ch/jira/browse/CMSHLT-2877): [GEM] save GEM `FEDRawData` in `RPCMON` stream
 - [CMSHLT-2878](https://its.cern.ch/jira/browse/CMSHLT-2878): [TRK] add pixel-doublet-recovery iteration to standard tracking sequence, and disable track-looper reconstruction
@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 11, 2023

A new Pull Request was created by @missirol (Marino Missiroli) for CMSSW_13_0_X.

It involves the following packages:

  • Configuration/HLT (hlt)
  • HLTrigger/Configuration (hlt)

@cmsbuild, @missirol, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @silviodonato, @fabiocos this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@missirol
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25356a/34223/summary.html
COMMIT: 5d1949b
CMSSW: CMSSW_13_0_X_2023-08-10-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/42540/34223/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 11 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 23 differences found in the comparisons
  • DQMHistoTests: Total files compared: 49
  • DQMHistoTests: Total histograms compared: 3281270
  • DQMHistoTests: Total failures: 125
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3281123
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
  • Checked 213 log files, 164 edm output root files, 49 DQM output files
  • TriggerResults: no differences found

@missirol
Copy link
Contributor Author

+hlt

No changes in the outputs of PR tests (as expected), except for spurious DQM differences in some Phase-2 wfs (likely an occurrence of #39754).

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next CMSSW_13_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_13_3_X is complete. This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@perrotta
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 9d1409f into cms-sw:CMSSW_13_0_X Aug 14, 2023
@missirol missirol deleted the HLTdevelopment130X branch August 14, 2023 16:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants