Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modernize / optimize DisappearingMuonsSkimming #41225

Merged
merged 5 commits into from
Apr 11, 2023

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Mar 29, 2023

PR description:

I noticed that the code introduced in #40666 could be optimized in a few places, mostly:

  • do not use track matching in dR / dPt when direct comparison of track references is available
  • use range-based loops
  • modernize access to event collections
  • avoid repeated calculations
  • avoid code duplication
  • use deltaR2 in lieu of deltaR

I propose these optimizations here, as well as a test configuration that I have been using to make sure the update code results in exactly the same output as the old one.

PR validation:

Run the Configuration/Skimming/test/test_DisMuon_cfg.py file introduced here in a vanilla CMSSW_13_1_X_2023-03-27-1100 release and in this branch and checked that the exact same events are selected.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Not a backport.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-41225/34941

  • This PR adds an extra 20KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @mmusich (Marco Musich) for master.

It involves the following packages:

  • Configuration/Skimming (pdmv)

@cmsbuild, @bbilin, @sunilUIET, @kskovpen can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @missirol, @fabiocos, @youyingli this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@mmusich
Copy link
Contributor Author

mmusich commented Mar 31, 2023

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ee9a20/31706/summary.html
COMMIT: 0504895
CMSSW: CMSSW_13_1_X_2023-03-30-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/41225/31706/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 19 lines from the logs
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 49
  • DQMHistoTests: Total histograms compared: 3553709
  • DQMHistoTests: Total failures: 6
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3553681
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
  • Checked 213 log files, 164 edm output root files, 49 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-41225/34986

  • This PR adds an extra 16KB to repository

@cmsbuild
Copy link
Contributor

Pull request #41225 was updated. @cmsbuild, @bbilin, @sunilUIET, @kskovpen can you please check and sign again.

@mmusich
Copy link
Contributor Author

mmusich commented Mar 31, 2023

please test

@mmusich
Copy link
Contributor Author

mmusich commented Mar 31, 2023

type performance-improvement

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 6, 2023

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-41225/35093

  • This PR adds an extra 20KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 6, 2023

Pull request #41225 was updated. @cmsbuild, @bbilin, @sunilUIET, @kskovpen can you please check and sign again.

@mmusich
Copy link
Contributor Author

mmusich commented Apr 6, 2023

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 6, 2023

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ee9a20/31872/summary.html
COMMIT: 7a3a15d
CMSSW: CMSSW_13_1_X_2023-04-06-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/41225/31872/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially added 2 lines to the logs
  • Reco comparison results: 11 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3459609
  • DQMHistoTests: Total failures: 6
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3459581
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 207 log files, 159 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2023

@youyingli

thank you for the optimization. Could you please also make another PR to backport this PR to 13_0_X milestone for 2023 data taking?

sure, here it is: #41311.
Let me point out - though - that pdmv still didn't sign this one (after 5 days from the last trivial update).

@kskovpen
Copy link
Contributor

+pdmv

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@perrotta
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants