Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a unit Test for OnlineBeamMonitor #40727

Merged
merged 1 commit into from
Feb 11, 2023
Merged

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Feb 8, 2023

PR description:

Title says it all, prompted by PR #40716.

PR validation:

Run the unit tests: scram b runtests
They are currently failing because of the issue detailed at #39948, but one #40716 is integrated it should solve the issue.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

N/A

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2023

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40727/34125

  • This PR adds an extra 12KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2023

A new Pull Request was created by @mmusich (Marco Musich) for master.

It involves the following packages:

  • DQM/BeamMonitor (dqm, db)

@malbouis, @pmandrik, @emanueleusai, @tvami, @cmsbuild, @saumyaphor4252, @syuvivida, @ggovi, @francescobrivio, @micsucmed, @rvenditti can you please review it and eventually sign? Thanks.
@mmusich, @francescobrivio this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

@mmusich
Copy link
Contributor Author

mmusich commented Feb 8, 2023

please test

  • expected to fail, just to show it is able to capture the issue

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2023

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-454de8/30522/summary.html
COMMIT: 08591c1
CMSSW: CMSSW_13_0_X_2023-02-08-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40727/30522/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test testOnlineBeamMonitor had ERRORS

Comparison Summary

Summary:

  • You potentially added 9 lines to the logs
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 49
  • DQMHistoTests: Total histograms compared: 3555852
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3555830
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
  • Checked 213 log files, 164 edm output root files, 49 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 9, 2023

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40727/34134

  • This PR adds an extra 12KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 9, 2023

Pull request #40727 was updated. @malbouis, @pmandrik, @emanueleusai, @tvami, @cmsbuild, @saumyaphor4252, @syuvivida, @ggovi, @francescobrivio, @micsucmed, @rvenditti can you please check and sign again.

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 9, 2023

Pull request #40727 was updated. @malbouis, @pmandrik, @emanueleusai, @tvami, @cmsbuild, @saumyaphor4252, @syuvivida, @ggovi, @francescobrivio, @micsucmed, @rvenditti can you please check and sign again.

@francescobrivio
Copy link
Contributor

@mmusich should we trigger tests here given in #40716 it's working fine?

@tvami
Copy link
Contributor

tvami commented Feb 9, 2023

@mmusich should we trigger tests here given in #40716 it's working fine?

I think we can just sign this based on #40716

@mmusich
Copy link
Contributor Author

mmusich commented Feb 9, 2023

should we trigger tests here given in #40716 it's working fine?

actually either you test it together with #40716 or only after that one is merged and an IB with it is available -- otherwise it is expected to fail 😓 (see #40727 (comment)).

----- Begin Fatal Exception 08-Feb-2023 19:17:07 CET-----------------------
An exception of category 'StdException' occurred while
   [0] Processing global begin LuminosityBlock run: 326479 luminosityBlock: 1
   [1] Calling method for module OnlineBeamMonitor/'onlineBeamMonitor'
Exception Message:
A std::exception was thrown.
Parameter with index 0 is out of range.
----- End Fatal Exception -------------------------------------------------

@francescobrivio
Copy link
Contributor

+1

@francescobrivio
Copy link
Contributor

@cmsbuild please test with #40716

  • just to have clean tests

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 9, 2023

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-454de8/30543/summary.html
COMMIT: 0a7d669
CMSSW: CMSSW_13_0_X_2023-02-09-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40727/30543/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

The relvals timed out after 4 hours.

Comparison Summary

Summary:

  • You potentially removed 3 lines from the logs
  • Reco comparison results: 7 differences found in the comparisons
  • DQMHistoTests: Total files compared: 49
  • DQMHistoTests: Total histograms compared: 3555852
  • DQMHistoTests: Total failures: 6
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3555824
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
  • Checked 213 log files, 164 edm output root files, 49 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented Feb 10, 2023

relval timeout is unrelated.
Now that #40716 is merged this can be merged as well.

@perrotta
Copy link
Contributor

relval timeout is unrelated. Now that #40716 is merged this can be merged as well.

@emanueleusai do you have any objection?

@emanueleusai
Copy link
Member

no objections

@emanueleusai
Copy link
Member

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (but tests are reportedly failing). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

@perrotta
Copy link
Contributor

+1

  • This PR simply adds a unit test, letting all workflows untouched: therefore it can be merged in 13_0_X before switching the master to 13_1_X, to make it already available also in 13_0_X

@perrotta
Copy link
Contributor

merge

@cmsbuild cmsbuild merged commit a6e0e91 into cms-sw:master Feb 11, 2023
@mmusich mmusich deleted the addTestOB branch February 11, 2023 07:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants