Add NVML python bindings

[fwyzard]

No description provided.

[fwyzard]

please test

[cmsbuild]

A new Pull Request was created by @fwyzard for branch IB/CMSSW_14_1_X/master.

@smuzaffar, @iarspider, @aandvalenzuela can you please review it and eventually sign? Thanks.
@antoniovilela, @sextonkennedy, @rappoccio you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

cms-bot internal usage

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38828/summary.html
COMMIT: 9603896
CMSSW: CMSSW_14_1_X_2024-04-12-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/9134/38828/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 35 lines to the logs
• Reco comparison results: 48 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3317870
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3317847
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 202 log files, 165 edm output root files, 48 DQM output files
• TriggerResults: no differences found

[smuzaffar]

@fwyzard , only adding a ackage here will not build/include it for cmssw. Please add it in to https://github.com/fwyzard/cmsdist/blob/IB/CMSSW_14_1_X/master_nvml/python_tools.spec too e.g. Requires: py3-nvidia-ml-py so that cmsBuild can built it for cmssw-tool-conf

[fwyzard]

Thanks, I'll add that.

[fwyzard]

please test

[cmsbuild]

Pull request #9134 was updated.

[smuzaffar]

please test for el8_aarch64_gcc12

[smuzaffar]

please test for el9_amd64_gcc12

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38916/summary.html
COMMIT: 8cffe60
CMSSW: CMSSW_14_1_X_2024-04-16-2300/el8_aarch64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9134/38916/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @cms-sw Update tag for RecoBTag-Combined to V01-22-00 #9139
• @belforte Update crab-dev to latest tag #9138
• @cms-sw Rivet: use eigen flags; update rivet analysis path for multi-arch #9141

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38916/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38916/git-merge-result

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38908/summary.html
COMMIT: 8cffe60
CMSSW: CMSSW_14_1_X_2024-04-17-1100/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9134/38908/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @belforte Update crab-dev to latest tag #9138
• @cms-sw Rivet: use eigen flags; update rivet analysis path for multi-arch #9141

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38908/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38908/git-merge-result

Comparison Summary

There are some workflows for which there are errors in the baseline:
24834.78 step 2
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

• You potentially added 10 lines to the logs
• Reco comparison results: 2982 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3319599
• DQMHistoTests: Total failures: 6038
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3313541
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
• Checked 202 log files, 165 edm output root files, 48 DQM output files
• TriggerResults: found differences in 1 / 46 workflows

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38917/summary.html
COMMIT: 8cffe60
CMSSW: CMSSW_14_1_X_2024-04-16-2300/el9_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9134/38917/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @belforte Update crab-dev to latest tag #9138
• @cms-sw Update tag for RecoBTag-Combined to V01-22-00 #9139
• @cms-sw Rivet: use eigen flags; update rivet analysis path for multi-arch #9141

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38917/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ebb1a5/38917/git-merge-result

Comparison Summary

Summary:

• You potentially added 3846 lines to the logs
• Reco comparison results: 1370 differences found in the comparisons
• DQMHistoTests: Total files compared: 12
• DQMHistoTests: Total histograms compared: 389898
• DQMHistoTests: Total failures: 3213
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 386679
• DQMHistoTests: Total skipped: 6
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 11 files compared)
• Checked 152 log files, 76 edm output root files, 12 DQM output files

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_14_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @rappoccio, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)