Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Do not merge] Testing TF 2.15 GPU #9394

Closed
wants to merge 1 commit into from

Conversation

smuzaffar
Copy link
Contributor

No description provided.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 4, 2024

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_14_2_X/tf.

@aandvalenzuela, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 4, 2024

cms-bot internal usage

@smuzaffar
Copy link
Contributor Author

smuzaffar commented Sep 4, 2024

test parameters:

  • enable = gpu
  • addpkg = RecoTracker/PixelTrackFitting,PhysicsTools/TensorFlow

@smuzaffar
Copy link
Contributor Author

please test for CMSSW_14_2_TF_X/el8_amd64_gcc12

@smuzaffar
Copy link
Contributor Author

please test for CMSSW_14_2_TF_X/el8_amd64_gcc12

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2024

-1

Failed Tests: GpuUnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7f8188/41310/summary.html
COMMIT: 0fd2549
CMSSW: CMSSW_14_2_TF_X_2024-09-02-2300/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9394/41310/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7f8188/41310/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-7f8188/41310/git-merge-result

GPU Unit Tests

I found 9 errors in the following unit tests:

---> test testTFConstSessionCUDA had ERRORS
---> test testTFHelloWorldCUDA had ERRORS
---> test testTFGraphLoadingCUDA had ERRORS
and more ...

Comparison Summary

Summary:

  • You potentially added 608 lines to the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 2446 differences found in the comparisons
  • DQMHistoTests: Total files compared: 44
  • DQMHistoTests: Total histograms compared: 3328276
  • DQMHistoTests: Total failures: 34988
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3293268
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 36.092000000000006 KiB( 43 files compared)
  • DQMHistoSizes: changed ( 11634.0,... ): 2.879 KiB Physics/NanoAODDQM
  • DQMHistoSizes: changed ( 13234.0,... ): 1.771 KiB Physics/NanoAODDQM
  • Checked 193 log files, 163 edm output root files, 44 DQM output files
  • TriggerResults: found differences in 2 / 42 workflows

@smuzaffar smuzaffar closed this Sep 16, 2024
@smuzaffar smuzaffar deleted the smuzaffar-patch-7 branch September 18, 2024 21:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants