restrict RunHI2011 to 182124:40, used in the short matrix wf 140.53

[slava77]

this is to improve stability in PR tests where DAS occasionally returns different files for wf 140.53

Due to a rather large number of files in 182124 /HIMinBiasUPC/HIRun2011-v1/RAW (301 file) the order of files in the das query changes occasionally, which leads to different events produced in PR tests for wf 140.53.

This PR is selecting LS 40 from the run, which should select just one file, the same file that was processed in the PR tests for this workflow in a recent IB CMSSW_12_1_X_2021-10-28-2300. The number of events in the selection is still fairly large (1428) for PR-like or even somewhat longer tests.

I'm not sure if the LS selection in relval_steps.py directly applies to relval submission, where more events may be needed. However, it's very likely that we will not run relvals for this data (I see that the last /HIMinBiasUPC/CMSSW_*/DQMIO was in 11_1_0)

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-35912/26309

• This PR adds an extra 48KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/PyReleaseValidation/python/relval_steps.py modified in PR(s): Use pdigi_hi_nogen for HI MC wfs #35028, Move Phase2 wf in the short matrix to D77 #35862, Fixed the PPS alignment relval - 1042 #35874, Add DQM Matrix to RelVals #35678

[cmsbuild]

A new Pull Request was created by @slava77 (Slava Krutelyov) for master.

It involves the following packages:

• Configuration/PyReleaseValidation (pdmv, upgrade)

@jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen can you please review it and eventually sign? Thanks.
@makortel, @kpedro88, @Martin-Grunewald, @missirol, @fabiocos, @slomeo this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[slava77]

@cmsbuild please test

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6216aa/20072/summary.html
COMMIT: 8fa12cd
CMSSW: CMSSW_12_2_X_2021-10-29-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/35912/20072/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @bsunanda Run3-alca207 Update the macros used in IsoTrack calibration of HCAL #35831
• @slava77 introduce COPYPASTER3 and use it as step2 in wf 138.3 #35890
• @slava77 default initialize HiPuRhoProducer::postOrphan_ #35857
• @bbilin Common alignment algorithm consumes migration #35861
• @smuzaffar [PDMV] Fix needed for python3: Use of subprocess instead of commands #35819
• @bsunanda Phase2-hgx292X Update the cfg's in Validation/HGCalValidation for more general usage #35793
• @mmusich add process.runType.commissioning_run in the supported types of beampixel_dqm_sourceclient-live #35869
• @bsunanda Phase2-hgx292 Bug fix for real partial wafer simulations in versions V15 and V16 #35765

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6216aa/20072/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6216aa/20072/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test TestDQMServicesDemo had ERRORS

Comparison Summary

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

Summary:

• No significant changes to the logs found
• Reco comparison results: 2959 differences found in the comparisons
• DQMHistoTests: Total files compared: 42
• DQMHistoTests: Total histograms compared: 2901440
• DQMHistoTests: Total failures: 32682
• DQMHistoTests: Total nulls: 7
• DQMHistoTests: Total successes: 2868729
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 41 files compared)
• Checked 177 log files, 37 edm output root files, 42 DQM output files
• TriggerResults: no differences found

[slava77]

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

this is expected here (only one file is selected now) and the comparisons show no differences in 140.53 (confirming that the same input is used here and in the baseline).
So, this PR tests worked as expected.

[slava77]

@cms-sw/pdmv-l2 @cms-sw/upgrade-l2
please check this PR.
Thank you.

[srimanob]

Regarding your question in the PR description, relvals submission will use this setting also. @slava77

[srimanob]

+1

This PR is to limit the LS used for HI 2011 workflow. It should be OK, to make PR test more stable. If we need relvals, PdmV should modify this before submission happens.

[slava77]

@cms-sw/pdmv-l2
please check this PR.
Thank you.

[kskovpen]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

+1

[perrotta]

merge

• unit test erro had been solved since a while