HLT menu development for `14_0_X` (10/N) #46050

mmusich · 2024-09-19T07:51:42Z

backport of #46048

PR description:

Development of HLT menus for CMSSW_14_0_X (this is the release cycle currently used for Run-3 HLT-menu development).

These updates correspond to the changes accumulated in the 14_0_X release cycle after the "V1.4" (last) menu for the 2024 pp data-taking period was released, and target the 2024 HIon and PRef data-taking as well as the first pp menu for 2025.

This update includes the integration of the following JIRA tickets:

CMSHLT-3296 [TSG] Remove unused Paths of the Special table
CMSHLT-3298 [TSG] Remove suppression of warnings and errors from HLT MessageLogger for hltOnlineBeamSpot
CMSHLT-3303 [EXO] Add missing hltIter2MergedForDisplaced from HLTMonitor event content
CMSHLT-3310 [TSG] Update to 2024 eras in TSG tests
CMSHLT-3306 [HIon/DQM] Review of HIDQM EventContent (HI Run 2024)
CMSHLT-3307 [BRIL] Update "LumiScan" offline menu (post Run2024G)
CMSHLT-3329 [Egamma/PF] Fix mismatch of EB and EE recHits in supercluster producer modules
CMSHLT-3284 [HIon/TRK] Move to Pixel-Alpaka modules in the HIon menu
CMSHLT-3309 [DQM] Update DeltaR matching cut for hltPixelTracksSoACompareGPUvsCPU and hltSiPixelTracksSoACompareGPUvsCPUPPOnAA
CMSHLT-3323 [HIon] Muon Triggers for pp Reference Run 2024
CMSHLT-3332 [DQM] Fix inconsistent module labels for HLTDQMPixelReconstruction vs HLTDQMPixelReconstructionPPOnAA

In addition, the following changes are included:

aa33888 update of L1T PRef menu in TSG GTs to L1Menu_CollisionsPPRef2024_v0_0_2_xml

PR validation:

TSG Integration tests

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

backport of #46048 to the 2024 pp production cycle (CMSSW_14_0_X)

These updates correspond to the changes accumulated in the 14_0_X release cycle after the "V1.4" (last) menu for the 2024 pp data-taking period was released. This update includes the integration of the following JIRA tickets: - [CMSHLT-3296](https://its.cern.ch/jira/browse/CMSHLT-3296) [TSG] Remove unused Paths of the Special table - [CMSHLT-3298](https://its.cern.ch/jira/browse/CMSHLT-3298) [TSG] Remove suppression of warnings and errors from HLT MessageLogger for hltOnlineBeamSpot - [CMSHLT-3303](https://its.cern.ch/jira/browse/CMSHLT-3303) [EXO] Add missing hltIter2MergedForDisplaced from HLTMonitor event content - [CMSHLT-3310](https://its.cern.ch/jira/browse/CMSHLT-3310) [TSG] Update to 2024 eras in TSG tests - [CMSHLT-3306](https://its.cern.ch/jira/browse/CMSHLT-3306) [HIon/DQM] Review of HIDQM EventContent (HI Run 2024) - [CMSHLT-3307](https://its.cern.ch/jira/browse/CMSHLT-3307) [BRIL] Update "LumiScan" offline menu (post Run2024G) - [CMSHLT-3329](https://its.cern.ch/jira/browse/CMSHLT-3329) [Egamma/PF] Fix mismatch of EB and EE recHits in supercluster producer modules - [CMSHLT-3284](https://its.cern.ch/jira/browse/CMSHLT-3284) [HIon/TRK] Move to Pixel-Alpaka modules in the HIon menu - [CMSHLT-3309](https://its.cern.ch/jira/browse/CMSHLT-3309) [DQM] Update DeltaR matching cut for hltPixelTracksSoACompareGPUvsCPU and hltSiPixelTracksSoACompareGPUvsCPUPPOnAA - [CMSHLT-3323](https://its.cern.ch/jira/browse/CMSHLT-3323) [HIon] Muon Triggers for pp Reference Run 2024 - [CMSHLT-3332](https://its.cern.ch/jira/browse/CMSHLT-3332) [DQM] Fix inconsistent module labels for HLTDQMPixelReconstruction vs HLTDQMPixelReconstructionPPOnAA

…_2_xml

cmsbuild · 2024-09-19T07:52:06Z

A new Pull Request was created by @mmusich for CMSSW_14_0_X.

It involves the following packages:

Configuration/HLT (hlt)
HLTrigger/Configuration (hlt)

@Martin-Grunewald, @cmsbuild, @mmusich can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @fabiocos, @missirol, @silviodonato this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

Backported from HLT menu development for 14_0_X (10/N) [14_2_X] #46048

cmsbuild · 2024-09-19T07:52:06Z

cms-bot internal usage

mmusich · 2024-09-19T07:52:30Z

enable gpu

mmusich · 2024-09-19T07:52:36Z

@cmsbuild, please test

cmsbuild · 2024-09-19T11:28:42Z

-1

Failed Tests: RelVals-GPU
Size: This PR adds an extra 792KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-66ff18/41614/summary.html
COMMIT: aa33888
CMSSW: CMSSW_14_0_X_2024-09-18-2300/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46050/41614/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-GPU

ValueError: Undefined workflows: 12834.402, 12834.422, 12834.406, 12834.403, 12834.412, 12834.423

Comparison Summary

Summary:

You potentially removed 94 lines from the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 43 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3349140
DQMHistoTests: Total failures: 843
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3348277
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: no differences found

mmusich · 2024-09-19T11:29:57Z

@cmsbuild, please test with #45959

cmsbuild · 2024-09-19T14:46:27Z

+1

Size: This PR adds an extra 792KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-66ff18/41620/summary.html
COMMIT: aa33888
CMSSW: CMSSW_14_0_X_2024-09-19-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46050/41620/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

You potentially added 6 lines to the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 54 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3349140
DQMHistoTests: Total failures: 840
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3348280
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 202 log files, 165 edm output root files, 48 DQM output files
TriggerResults: no differences found

GPU Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 1
DQMHistoTests: Total histograms compared: 0
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 0
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
Checked 0 log files, 0 edm output root files, 1 DQM output files

mmusich · 2024-09-19T14:57:04Z

test parameters:

workflow = 142.0

mmusich · 2024-09-19T14:57:12Z

@cmsbuild, please test with #45959

cmsbuild · 2024-09-19T18:49:10Z

-1

Failed Tests: RelVals-GPU
Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-66ff18/41631/summary.html
COMMIT: aa33888
CMSSW: CMSSW_14_0_X_2024-09-19-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46050/41631/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-GPU

ValueError: Undefined workflows: 12834.402, 12834.422, 12834.406, 12834.403, 12834.412, 12834.423

Comparison Summary

Summary:

You potentially removed 6 lines from the logs
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 64 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3407520
DQMHistoTests: Total failures: 2669
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3404831
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 206 log files, 168 edm output root files, 49 DQM output files
TriggerResults: found differences in 1 / 47 workflows

mmusich · 2024-09-19T20:33:05Z

@cmsbuild, please test with #45959

cmsbuild · 2024-09-19T23:58:24Z

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-66ff18/41649/summary.html
COMMIT: aa33888
CMSSW: CMSSW_14_0_X_2024-09-19-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46050/41649/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 50 differences found in the comparisons
DQMHistoTests: Total files compared: 49
DQMHistoTests: Total histograms compared: 3407520
DQMHistoTests: Total failures: 1460
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3406040
DQMHistoTests: Total skipped: 20
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
Checked 206 log files, 168 edm output root files, 49 DQM output files
TriggerResults: found differences in 1 / 47 workflows

GPU Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 1
DQMHistoTests: Total histograms compared: 0
DQMHistoTests: Total failures: 0
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 0
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0 KiB( 0 files compared)
Checked 0 log files, 0 edm output root files, 1 DQM output files

mmusich · 2024-09-20T06:56:45Z

+hlt

changes observed in the HLT EXO DQM output (HLT menu development for 14_0_X (10/N) #46050 (comment)) are due to the integration of CMSHLT-3303
changes observed in the HLT tracking DQM output of wf 142.0 (https://tinyurl.com/2xjrm6zo) is due to the integration of CMSHLT-3284

cmsbuild · 2024-09-20T06:57:09Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_2_X is complete. This pull request will now be reviewed by the release team before it's merged. @rappoccio, @antoniovilela, @sextonkennedy, @mandrenguyen (and backports should be raised in the release meeting by the corresponding L2)
Notice This PR was tested with additional Pull Request(s), please also merge them if necessary: #45959

mandrenguyen · 2024-09-20T13:46:42Z

+1

mmusich added 2 commits September 19, 2024 09:34

update of L1T PRef menu in TSG GTs to L1Menu_CollisionsPPRef2024_v0_0…

aa33888

…_2_xml

cmsbuild added this to the CMSSW_14_0_X milestone Sep 19, 2024

cmsbuild added hlt-pending pending-signatures tests-pending orp-pending backport labels Sep 19, 2024

cmsbuild added tests-started and removed tests-pending labels Sep 19, 2024

cmsbuild added tests-rejected and removed tests-started labels Sep 19, 2024

cmsbuild added requires-external tests-started and removed tests-rejected labels Sep 19, 2024

cmsbuild added tests-approved and removed tests-started labels Sep 19, 2024

cmsbuild added tests-started requires-external and removed requires-external tests-approved labels Sep 19, 2024

cmsbuild added tests-rejected and removed tests-started labels Sep 19, 2024

cmsbuild added tests-started and removed tests-rejected labels Sep 19, 2024

cmsbuild added tests-approved and removed tests-started labels Sep 19, 2024

cmsbuild added hlt-approved fully-signed and removed hlt-pending pending-signatures labels Sep 20, 2024

cmsbuild mentioned this pull request Sep 20, 2024

[14_0_X] Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows #45959

Merged

cmsbuild added backport-ok and removed backport labels Sep 20, 2024

cmsbuild added orp-approved and removed orp-pending labels Sep 20, 2024

cmsbuild merged commit aa3f7ae into cms-sw:CMSSW_14_0_X Sep 20, 2024
13 checks passed

mmusich deleted the HLTdevelopment140X branch September 20, 2024 13:47

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HLT menu development for `14_0_X` (10/N) #46050

HLT menu development for `14_0_X` (10/N) #46050

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024 •

edited

Loading

mmusich commented Sep 19, 2024

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

mmusich commented Sep 19, 2024

mmusich commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

mmusich commented Sep 20, 2024

cmsbuild commented Sep 20, 2024

mandrenguyen commented Sep 20, 2024

HLT menu development for 14_0_X (10/N) #46050

HLT menu development for 14_0_X (10/N) #46050

Conversation

mmusich commented Sep 19, 2024

PR description:

PR validation:

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

cmsbuild commented Sep 19, 2024 • edited Loading

cmsbuild commented Sep 19, 2024 • edited Loading

mmusich commented Sep 19, 2024

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

RelVals-GPU

Comparison Summary

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

Comparison Summary

GPU Comparison Summary

mmusich commented Sep 19, 2024

mmusich commented Sep 19, 2024 • edited Loading

cmsbuild commented Sep 19, 2024

RelVals-GPU

Comparison Summary

mmusich commented Sep 19, 2024

cmsbuild commented Sep 19, 2024

Comparison Summary

GPU Comparison Summary

mmusich commented Sep 20, 2024

cmsbuild commented Sep 20, 2024

mandrenguyen commented Sep 20, 2024

HLT menu development for `14_0_X` (10/N) #46050

HLT menu development for `14_0_X` (10/N) #46050

cmsbuild commented Sep 19, 2024 •

edited

Loading

cmsbuild commented Sep 19, 2024 •

edited

Loading

mmusich commented Sep 19, 2024 •

edited

Loading