Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Get it to work on powerpc #4

Closed
wants to merge 2 commits into from

Conversation

mrodozov
Copy link

Changes to make it work on ppc. If the results from comparison are reasonable this additions can (and probably should) be trimmed as they use tiny part of the entire NEON _2_SSE 17k lines functionality. This PR is to make sure it doesn't interfere with the base build (i.e. wont brake the external on Intel arch)

@mrodozov
Copy link
Author

please test

@cmsbuild
Copy link

cmsbuild commented Jan 16, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/4254/console Started: 2020/01/16 18:54

@cmsbuild
Copy link

A new Pull Request was created by @mrodozov (Mircho Rodozov) for branch cms/v1.0.0.

@cmsbuild, @smuzaffar, @mrodozov, @tulamor can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

@cmsbuild
Copy link

-1

Tested at: e750412

  • Build:

I found compilation error when building:

-- Performing Test AVX512BW_COMPILES
-- Performing Test AVX512BW_COMPILES - Success
-- Configuring incomplete, errors occurred!
See also "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-90a298/build/CMakeFiles/CMakeOutput.log".
See also "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-90a298/build/CMakeFiles/CMakeError.log".
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.2thM47 (%build)


RPM build errors:
Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.2thM47 (%build)



You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-90a298/4254/summary.html

@mrodozov
Copy link
Author

please test

@cmsbuild
Copy link

cmsbuild commented Jan 16, 2020

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/4258/console Started: 2020/01/16 23:14

@cmsbuild
Copy link

-1

Tested at: e750412

  • Build:

I found compilation error when building:

-- Performing Test AVX512BW_COMPILES
-- Performing Test AVX512BW_COMPILES - Success
-- Configuring incomplete, errors occurred!
See also "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-90a298/build/CMakeFiles/CMakeOutput.log".
See also "/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-90a298/build/CMakeFiles/CMakeError.log".
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.1hAJG5 (%build)


RPM build errors:
Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.1hAJG5 (%build)



You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-90a298/4258/summary.html

@mrodozov
Copy link
Author

please test with cms-sw/cms-bot#1249

@cmsbuild
Copy link

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cms-bot#1249

@cmsbuild
Copy link

cmsbuild commented Jan 21, 2020

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmsdist#5477,cms-sw/cmsdist#5478
Test Parameters:

@cmsbuild
Copy link

-1

Tested at: e750412

CMSSW: CMSSW_11_1_X_2020-01-20-2300
SCRAM_ARCH: slc7_ppc64le_gcc820
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-70bf23/4296/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

  • Unit Tests:

I found errors in the following unit tests:

---> test test_PrepareInputDb had ERRORS
---> test test_MpsWorkFlow had ERRORS
---> test testSerializationCommon had ERRORS
---> test testUnits had ERRORS
---> test testDD4hepFilteredView had ERRORS
---> test DetectorDescriptionDDCMSTestDriver had ERRORS
---> test testFWCoreConcurrency had ERRORS
---> test TestFWCoreParameterSetDriver had ERRORS
---> test testONNXRuntime had ERRORS
---> test testNumba had ERRORS
---> test testRootpy had ERRORS
---> test test_pycurl had ERRORS
---> test GeometryDTGeometryBuilderTestDriver had ERRORS

@cmsbuild
Copy link

Comparison job queued.

@mrodozov
Copy link
Author

please test

@cmsbuild
Copy link

cmsbuild commented Jan 21, 2020

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmsdist#5477,cms-sw/cmsdist#5478
Test Parameters:

@cmsbuild
Copy link

+1
Tested at: e750412
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-70bf23/4299/summary.html
CMSSW: CMSSW_11_1_X_2020-01-21-1100
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link

Comparison job queued.

@cmsbuild
Copy link

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-70bf23/4299/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/1.0_ProdMinBias+ProdMinBias+DIGIPROD1+RECOPROD1
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/2.0_ProdTTbar+ProdTTbar+DIGIPROD1+RECOPROD1
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/3.0_ProdQCD_Pt_3000_3500+ProdQCD_Pt_3000_3500+DIGIPROD1+RECOPROD1
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.23_ValSkim2011A+ValSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.24_WMuSkim2011A+WMuSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.25_WElSkim2011A+WElSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2697090
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2696743
  • DQMHistoTests: Total skipped: 346
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@cmsbuild
Copy link

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-70bf23/4296/summary.html

The workflows 1001.0, 1000.0, 140.53, 136.85, 136.8311, 136.7611, 136.731, 4.22 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/1.0_ProdMinBias+ProdMinBias+DIGIPROD1+RECOPROD1
  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/2.0_ProdTTbar+ProdTTbar+DIGIPROD1+RECOPROD1
  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/3.0_ProdQCD_Pt_3000_3500+ProdQCD_Pt_3000_3500+DIGIPROD1+RECOPROD1
  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.23_ValSkim2011A+ValSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT
  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.24_WMuSkim2011A+WMuSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT
  • /build/cmsbld/jenkins_b/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-70bf23/4.25_WElSkim2011A+WElSkim2011A+HLTDSKIM+RECODR1reHLT+HARVESTDR1reHLT

Comparison Summary:

  • No significant changes to the logs found
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 49931 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2697090
  • DQMHistoTests: Total failures: 129526
  • DQMHistoTests: Total nulls: 18
  • DQMHistoTests: Total successes: 2567200
  • DQMHistoTests: Total skipped: 346
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: -6517.129 KiB( 33 files compared)
  • DQMHistoSizes: changed ( 1000.0,... ): -259.963 KiB DQM/TimerService
  • DQMHistoSizes: changed ( 10224.0 ): 0.129 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 1306.0,... ): -204.107 KiB DQM/TimerService
  • DQMHistoSizes: changed ( 1325.7,... ): -204.104 KiB DQM/TimerService
  • DQMHistoSizes: changed ( 136.731,... ): -204.115 KiB DQM/TimerService
  • DQMHistoSizes: changed ( 136.731 ): 0.004 KiB JetMET/SUSYDQM
  • DQMHistoSizes: changed ( 136.85 ): 0.008 KiB JetMET/SUSYDQM
  • DQMHistoSizes: changed ( 250202.181 ): 0.102 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 25202.0 ): -0.410 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 7.3 ): -0.987 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 8.0 ): ...
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@mrodozov mrodozov closed this Feb 12, 2020
valsdav pushed a commit to valsdav/onnxruntime that referenced this pull request Mar 6, 2024
### Description
Release OrtEnv before main function returns. Before this change, OrtEnv
is deleted when C/C++ runtime destructs all global variables in ONNX
Runtime's core framework.
The callstack is like this:
```
  * frame #0: 0x00007fffee39f5a6 libonnxruntime.so.1.16.0`onnxruntime::Environment::~Environment(this=0x00007fffee39fbf2) at environment.h:20:7
    frame cms-externals#1: 0x00007fffee39f614 libonnxruntime.so.1.16.0`std::default_delete<onnxruntime::Environment>::operator()(this=0x00007ffff4c30e50, __ptr=0x0000000005404b00) const at unique_ptr.h:85:2
    frame cms-externals#2: 0x00007fffee39edca libonnxruntime.so.1.16.0`std::unique_ptr<onnxruntime::Environment, std::default_delete<onnxruntime::Environment>>::~unique_ptr(this=0x5404b00) at unique_ptr.h:361:17
    frame cms-externals#3: 0x00007fffee39e2ab libonnxruntime.so.1.16.0`OrtEnv::~OrtEnv(this=0x00007ffff4c30e50) at ort_env.cc:43:1
    frame cms-externals#4: 0x00007fffee39fa96 libonnxruntime.so.1.16.0`std::default_delete<OrtEnv>::operator()(this=0x00007fffefff8f78, __ptr=0x00007ffff4c30e50) const at unique_ptr.h:85:2
    frame cms-externals#5: 0x00007fffee39f394 libonnxruntime.so.1.16.0`std::unique_ptr<OrtEnv, std::default_delete<OrtEnv>>::~unique_ptr(this=0x7ffff4c30e50) at unique_ptr.h:361:17
    frame cms-externals#6: 0x00007ffff78574b5 libc.so.6`__run_exit_handlers + 261
    frame cms-externals#7: 0x00007ffff7857630 libc.so.6`exit + 32
    frame cms-externals#8: 0x00007ffff783feb7 libc.so.6`__libc_start_call_main + 135
    frame cms-externals#9: 0x00007ffff783ff60 libc.so.6`__libc_start_main@@GLIBC_2.34 + 128
    frame cms-externals#10: 0x0000000000abbdee node`_start + 46
```
After this change, OrtEnv will be deleted before the main function
returns and nodejs is still alive.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants