QTest Tracking Summary DQM

[alaperto]

PR description:

Offline DQM GUI for Cosmics runs:

• add two QTests in Tracking Summary to monitor Number of Clusters in Pixel and Strip (warning: 800 and 200, hard cut limit: 1000 and 300)
  • motivation of this change: https://cms-talk.web.cern.ch/t/significant-reduction-in-the-number-of-cosmics-tracks/48672
  • recent PR to increase of limit on Number of Pixel Clusters: Increase threshold of max number of pixel clusters for cosmic tracking #46283
• change S/N minimum value: lower from 15 to 10 (TIB L1, TID and TEC 7/8/9 mean S/N is close to 15, due to radiation damage)

PR validation:

DQM plots production:

• cmsDriver.py step1 -s RAW2DIGI,L1Reco,RECO,DQM -n 1000 --eventcontent DQM --datatier DQMIO --conditions 140X_dataRun3_Prompt_v4 --filein file:/eos/cms/store/data/Run2024G/Cosmics/RAW/v1/000/385/054/00000/01253f11-88ba-4d33-8cc8-545c2a8b8d65.root --scenario cosmics --data --no_exec --python_filename=runFirst.py --era Run3_2024

• cmsRun runFirst.py

QTest execution on DQM plots:

• cmsDriver.py step3_DT1_1 -s HARVESTING:dqmHarvesting --filein file:step1_RAW2DIGI_L1Reco_RECO_DQM.root --filetype DQM --scenario cosmics --data --no_exec --conditions 140X_dataRun3_Prompt_v4 --python_filename=runSecond.py --era Run3_2024

• cmsRun runSecond.py

Results checked in private Offline QUI (to access need lxplus tunneling):

385054

About backport:

This PR is intended for 2024 data taking. Corresponding Backports to:

• 14_0_X: QTest Tracking Summary DQM (BP to 14_0_X) #46533
• 14_1_X: QTest Tracking Summary DQM (BP to 14_1_X) #46534

[cmsbuild]

cms-bot internal usage

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-46532/42395

[cmsbuild]

A new Pull Request was created by @alaperto for master.

It involves the following packages:

• DQM/SiStripMonitorClient (dqm)
• DQM/TrackingMonitorClient (dqm)

@antoniovagnerini, @cmsbuild, @nothingface0, @rvenditti, @syuvivida, @tjavaid can you please review it and eventually sign? Thanks.
@VinInn, @VourMa, @arossi83, @fioriNTU, @idebruyn, @jandrea, @mmusich, @mtosi, @sroychow, @threus, @venturia this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

[antoniovagnerini]

please test

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9298d2/42453/summary.html
COMMIT: 22e9713
CMSSW: CMSSW_14_2_X_2024-10-29-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46532/42453/install.sh to create a dev area with all the needed externals and cmssw changes.

• DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals-INPUT

• 2024.0000012024.000001_RunJetMET02024D_10k/step1_dasquery.log
• 2024.0010012024.001001_RunZeroBias2024D_10k/step1_dasquery.log
• 2024.1000012024.100001_RunJetMET02024C_10k/step1_dasquery.log

Expand to see more relval errors ...

• 2024.101001
• 2024.000001
• 2024.001001
• 2024.100001
• 2024.101001

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 6 differences found in the comparisons
• DQMHistoTests: Total files compared: 47
• DQMHistoTests: Total histograms compared: 3676083
• DQMHistoTests: Total failures: 422
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3675641
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.99 KiB( 46 files compared)
• DQMHistoSizes: changed ( 4.22,... ): 0.178 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 4.22,... ): 0.152 KiB Tracking/EventInfo
• Checked 205 log files, 176 edm output root files, 47 DQM output files
• TriggerResults: no differences found

[alaperto]

Not clear to me why it failed RelVal, I guess this PR affects only DQM.
The tests on Backports to 14_0_X and 14_1_X were both successuful.

[antoniovagnerini]

Not clear to me why it failed RelVal, I guess this PR affects only DQM. The tests on Backports to 14_0_X and 14_1_X were both successuful.

It was a transient DAS error (missing relval input) , it will be sufficient to trigger again the tests

[antoniovagnerini]

please test

[cmsbuild]

-1

Failed Tests: RelVals-INPUT
Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9298d2/42501/summary.html
COMMIT: 22e9713
CMSSW: CMSSW_14_2_X_2024-10-30-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/46532/42501/install.sh to create a dev area with all the needed externals and cmssw changes.

• DAS Queries: The DAS query tests failed, see the summary page for details.

RelVals-INPUT

• 2024.0000012024.000001_RunJetMET02024D_10k/step1_dasquery.log
• 2024.0010012024.001001_RunZeroBias2024D_10k/step1_dasquery.log
• 2024.1000012024.100001_RunJetMET02024C_10k/step1_dasquery.log

Expand to see more relval errors ...

• 2024.101001
• 2024.000001
• 2024.001001
• 2024.100001
• 2024.101001

Comparison Summary

Summary:

• You potentially removed 2 lines from the logs
• Reco comparison results: 12 differences found in the comparisons
• DQMHistoTests: Total files compared: 47
• DQMHistoTests: Total histograms compared: 3676083
• DQMHistoTests: Total failures: 389
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3675674
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.99 KiB( 46 files compared)
• DQMHistoSizes: changed ( 4.22,... ): 0.178 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 4.22,... ): 0.152 KiB Tracking/EventInfo
• Checked 205 log files, 176 edm output root files, 47 DQM output files
• TriggerResults: no differences found

[antoniovagnerini]

please test

[antoniovagnerini]

please abort

[antoniovagnerini]

please test with #46559

[cmsbuild]

+1

Size: This PR adds an extra 12KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9298d2/42575/summary.html
COMMIT: 22e9713
CMSSW: CMSSW_14_2_X_2024-11-04-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/46532/42575/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 79 lines to the logs
• Reco comparison results: 5 differences found in the comparisons
• DQMHistoTests: Total files compared: 47
• DQMHistoTests: Total histograms compared: 3676293
• DQMHistoTests: Total failures: 420
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3675853
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.99 KiB( 46 files compared)
• DQMHistoSizes: changed ( 4.22,... ): 0.178 KiB SiStrip/MechanicalView
• DQMHistoSizes: changed ( 4.22,... ): 0.152 KiB Tracking/EventInfo
• Checked 205 log files, 176 edm output root files, 47 DQM output files
• TriggerResults: no differences found

[antoniovagnerini]

+1

• spurious differences from HGCal DQM test (open issue Non reproducibility in HGCal DQM #46416)

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @mandrenguyen, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[mandrenguyen]

+1