Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix in SiPixelQualityESProducer to support two labelled records #40061

Merged

Conversation

ferencek
Copy link
Contributor

PR description:

This PR addresses the problem with the Run3Summer22 MC campaign reported on Jira where production jobs were crashing when the SiPixelRawToDigi module tried to load a labelled SiPixelQuality payload.

PR validation:

The code compiles and fixes the problem which was occurring in step2.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

If the tests are successful, the PR will be backported to 12_5_X and 12_4_X.

@tvami
Copy link
Contributor

tvami commented Nov 14, 2022

@cmsbuild , please test

  • though no RelVals will test this

@cmsbuild
Copy link
Contributor

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40061/33038

  • This PR adds an extra 12KB to repository

Code check has found code style and quality issues which could be resolved by applying following patch(s)

@francescobrivio
Copy link
Contributor

urgent

  • if this solution is accepted, its backports (especially to 12_4_X) are needed for the MC production

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40061/33039

  • This PR adds an extra 12KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @ferencek (Dinko F.) for master.

It involves the following packages:

  • CalibTracker/SiPixelESProducers (alca)

@malbouis, @yuanchao, @cmsbuild, @saumyaphor4252, @francescobrivio, @ChrisMisan, @tvami can you please review it and eventually sign? Thanks.
@tocheng, @mroguljic, @dkotlins, @ferencek, @mmusich, @tvami this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@francescobrivio
Copy link
Contributor

type bug-fix

@sroychow
Copy link
Contributor

please test

labelTokens_ =
Tokens(setWhatProduced(this, &SiPixelQualityESProducer::produceWithLabel, edm::es::Label(label)), label);
}

label = conf_.exists("siPixelQualityLabel_RawToDigi")
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

exists is a deprecated API. The replacement is the use of fillDescriptions.

Copy link
Contributor Author

@ferencek ferencek Nov 14, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sure, I was actually surprised that there was not even an empty fillDescriptions but then I thought that rules were different for EDProducers and ESProducers. So thank you for pointing out that fillDescriptions should be used. However, I would leave this for a follow-up PR as this one deals with a very specific problem and, as far as I understood, needs to be backported to 12_4_X rather urgently. Any additions to this PR will just cause further delays.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @ferencek!
How long would it take to implement the fillDescriptions?
If it's a matter of delaying this PR of 1 day, I believe we can afford to wait and have it correctly implemented in one go, rhather than splitting it into 2 PRs I think.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, not really sure, I haven't really dealt with fillDescriptions in a while. For a complete implementation one also needs to switch to an automatically generated cfi file which potentially leads to some knock-on effects in other parts of the code. In any case, this is likely at least 1 day of delay assuming I get to it tomorrow. On the other hand, I really don't see much point in backporting fillDescriptions to already closed release cycles. However, since I already have a working area set up, it would be a pity not to implement fillDescriptions for the currently open release cycle. I would just do it in a separate PR.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ferencek ok, from my (alca) side, we can then have the backports to 12_4_X and 12_5_X identical to this PR, and later a followup PR to add fillDescriptions in master only.

@cms-sw/orp-l2 @Dr15Jones do you think this plan is acceptable?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ferencek while we wait for feedback from you and release managers on the plan I detailed detailed above I will open tha backports of this PR based on what is implemented now. I hope that is fine with you and everyone!

Copy link
Contributor Author

@ferencek ferencek Nov 15, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @ferencek thank you very much for the branches!
I have opened the backports (#40075 and #40076) and I also opened an issue (#40077) in order not to forget to update the fillDescriptions.

@francescobrivio
Copy link
Contributor

@smuzaffar the tests of this PR have been running for 23hours and the DQM bin-by-bin comparison is still missing.
Could you have a look in case something is stuck?
Thanks a lot!

@aandvalenzuela
Copy link
Contributor

Hi @francescobrivio,

Comparison job is now running, I will keep an eye on the build. We have had some delays in the testing due to failures in the IB infrastructure.
Sorry for the inconvenience,
Andrea.

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-437665/28997/summary.html
COMMIT: c61a662
CMSSW: CMSSW_12_6_X_2022-11-14-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40061/28997/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 7 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3417074
  • DQMHistoTests: Total failures: 9
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3417043
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 206 log files, 48 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@francescobrivio
Copy link
Contributor

+alca

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

Backports are eventually needed for next 12_4

@cmsbuild cmsbuild merged commit edb4347 into cms-sw:master Nov 15, 2022
@ferencek ferencek deleted the SiPixelQualityESProducer_fix-12_6_X branch November 15, 2022 21:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants