[ONNX runtime] Update for powerpc #5743

mrodozov · 2020-04-14T15:52:11Z

please test
patch is taken from here onnx/onnx#2482

cmsbuild · 2020-04-14T15:52:36Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5690/console Started: 2020/04/14 17:53

cmsbuild · 2020-04-14T15:52:38Z

A new Pull Request was created by @mrodozov (Mircho Rodozov) for branch IB/CMSSW_11_1_X/master.

@cmsbuild, @smuzaffar, @mrodozov, @tulamor can you please review it and eventually sign? Thanks.
cms-bot commands are listed here

smuzaffar · 2020-04-14T16:28:38Z

@mrodozov , I think we need cmssw PR too to go with protobuf.

cmsbuild · 2020-04-14T18:36:34Z

-1

Tested at: 675cbe1

Build:

I found compilation error when building:

/cvmfs/cms-ib.cern.ch/nweek-02624/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/../lib/gcc/x86_64-unknown-linux-gnu/8.3.1/../../../../x86_64-unknown-linux-gnu/bin/ld: onnx/libonnx_proto.a(onnx-ml.pb.cc.o):(.data.rel.ro._ZTVN4onnx13FunctionProtoE[_ZTVN4onnx13FunctionProtoE]+0x20): undefined reference to `google::protobuf::Message::GetTypeName[abi:cxx11]() const'
/cvmfs/cms-ib.cern.ch/nweek-02624/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/../lib/gcc/x86_64-unknown-linux-gnu/8.3.1/../../../../x86_64-unknown-linux-gnu/bin/ld: onnx/libonnx_proto.a(onnx-ml.pb.cc.o):(.data.rel.ro._ZTVN4onnx13FunctionProtoE[_ZTVN4onnx13FunctionProtoE]+0x58): undefined reference to `google::protobuf::Message::InitializationErrorString[abi:cxx11]() const'
/cvmfs/cms-ib.cern.ch/nweek-02624/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/../lib/gcc/x86_64-unknown-linux-gnu/8.3.1/../../../../x86_64-unknown-linux-gnu/bin/ld: onnx/libonnx_proto.a(onnx-ml.pb.cc.o):(.data.rel.ro._ZTVN4onnx13FunctionProtoE[_ZTVN4onnx13FunctionProtoE]+0x60): undefined reference to `google::protobuf::Message::CheckTypeAndMergeFrom(google::protobuf::MessageLite const&)'
/cvmfs/cms-ib.cern.ch/nweek-02624/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/../lib/gcc/x86_64-unknown-linux-gnu/8.3.1/../../../../x86_64-unknown-linux-gnu/bin/ld: onnx/libonnx_proto.a(onnx-ml.pb.cc.o):(.data.rel.ro._ZTVN4onnx13FunctionProtoE[_ZTVN4onnx13FunctionProtoE]+0xa0): undefined reference to `google::protobuf::Message::DiscardUnknownFields()'
/cvmfs/cms-ib.cern.ch/nweek-02624/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/../lib/gcc/x86_64-unknown-linux-gnu/8.3.1/../../../../x86_64-unknown-linux-gnu/bin/ld: onnx/libonnx_proto.a(onnx-ml.pb.cc.o):(.data.rel.ro._ZTVN4onnx13FunctionProtoE[_ZTVN4onnx13FunctionProtoE]+0xa8): undefined reference to `google::protobuf::Message::SpaceUsedLong() const'
collect2: error: ld returned 1 exit status
[650/660] /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc820/external/gcc/8.2.0-pafccj/bin/c++  -DEIGEN_MPL2_ONLY -DPLATFORM_POSIX -DUSE_EIGEN_FOR_BLAS -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-3f990d/onnxruntime-1.0.0/include/onnxruntime -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/BUILD/slc7_amd64_gcc820/external/onnxruntime/1.0.0-3f990d/onnxruntime-1.0.0/include/onnxruntime/core/session -I/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/slc7_amd64_gcc820/external/protobuf/3.11.4-3f990d/include -Ionnx/.. -I. -Ionnx -Dgsl_CONFIG_CONTRACT_VIOLATION_THROWS -Wall -Wextra -ffunction-sections -fdata-sections -Wno-parentheses -O3 -DNDEBUG -DGSL_UNENFORCED_ON_CONTRACT_VIOLATION -fPIC   -Wno-unused-parameter -Wno-unused-variable -Wno-unused-but-set-variable -std=gnu++14 -MD -MT CMakeFiles/onnx_test_data_proto.dir/tml.pb.cc.o -MF CMakeFiles/onnx_test_data_proto.dir/tml.pb.cc.o.d -o CMakeFiles/onnx_test_data_proto.dir/tml.pb.cc.o -c tml.pb.cc
ninja: build stopped: subcommand failed.
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.3h2p3E (%build)

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3f990d/5690/summary.html

cmsbuild · 2020-04-15T15:43:54Z

Pull request #5743 was updated.

mrodozov · 2020-04-15T15:47:34Z

please test
I'll fix the cmssw part, but lets see the external built
protobuf builds with cmake now. the installation is the same except it has a cmake config in /lib

cmsbuild · 2020-04-15T15:47:58Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5704/console Started: 2020/04/15 17:50

mrodozov · 2020-04-15T20:17:08Z

abort

mrodozov · 2020-04-15T20:17:28Z

test parameters:

full_cmssw = true
pull_requests = [Protobuf update] Bump to 3.11.3 cmssw#29486, Fix ONNX model file version in the unittest cmssw#29510

mrodozov · 2020-04-15T20:17:35Z

please test

cmsbuild · 2020-04-15T20:17:37Z

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmssw#29486

cmsbuild · 2020-04-24T22:55:27Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-325b32/5850/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 34
DQMHistoTests: Total histograms compared: 2696435
DQMHistoTests: Total failures: 2
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2696114
DQMHistoTests: Total skipped: 319
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
Checked 147 log files, 16 edm output root files, 34 DQM output files

smuzaffar · 2020-04-26T10:23:11Z

please test

cmsbuild · 2020-04-26T10:23:38Z

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmssw#29486
Test Parameters:

BUILD_FULL_CMSSW = true
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/5860/console Started: 2020/04/26 12:24

cmsbuild · 2020-04-26T20:54:40Z

+1
Tested at: ae3d561
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-325b32/5860/summary.html
CMSSW: CMSSW_11_1_X_2020-04-25-1100
SCRAM_ARCH: slc7_amd64_gcc820

cmsbuild · 2020-04-26T20:54:45Z

Comparison job queued.

cmsbuild · 2020-04-26T22:41:18Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-325b32/5860/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 34
DQMHistoTests: Total histograms compared: 2696435
DQMHistoTests: Total failures: 2
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2696114
DQMHistoTests: Total skipped: 319
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
Checked 147 log files, 16 edm output root files, 34 DQM output files

smuzaffar · 2020-04-27T07:26:04Z

unhold

cmsbuild · 2020-04-27T07:26:28Z

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_11_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo (and backports should be raised in the release meeting by the corresponding L2)

silviodonato · 2020-04-27T18:27:43Z

+1

[ONNX runtime] Update for powerpc

675cbe1

cmsbuild added comparison-pending externals-pending orp-pending pending-signatures tests-pending labels Apr 14, 2020

cmsbuild added tests-started and removed tests-pending labels Apr 14, 2020

cmsbuild added tests-rejected and removed tests-started labels Apr 14, 2020

Move protobuf to 3.11.3 and build it with cmake. Also update onnxruntime

79cdf9b

cmsbuild added tests-pending and removed tests-rejected labels Apr 15, 2020

cmsbuild added tests-started and removed tests-pending labels Apr 15, 2020

cmsbuild added tests-pending and removed tests-started labels Apr 15, 2020

cmsbuild mentioned this pull request Apr 15, 2020

[Protobuf update] Bump to 3.11.3 cms-sw/cmssw#29486

Merged

cmsbuild removed the tests-pending label Apr 15, 2020

cmsbuild added comparison-available and removed comparison-pending labels Apr 24, 2020

cmsbuild added comparison-pending tests-pending and removed comparison-available tests-approved labels Apr 26, 2020

cmsbuild added tests-started and removed tests-pending labels Apr 26, 2020

cmsbuild added tests-approved and removed tests-started labels Apr 26, 2020

cmsbuild added comparison-available and removed comparison-pending labels Apr 26, 2020

cmsbuild added fully-signed and removed hold pending-signatures labels Apr 27, 2020

cmsbuild added orp-approved and removed orp-pending labels Apr 27, 2020

cmsbuild merged commit ade07ff into IB/CMSSW_11_1_X/master Apr 27, 2020

hqucms mentioned this pull request Apr 28, 2020

Restore TF and MXNet-based inference for DeepJet, DeepDoubleX and DeepAK8 cms-sw/cmssw#29172

Closed

smuzaffar deleted the update_onnxruntime_ppc branch April 30, 2020 11:03

slava77 mentioned this pull request May 1, 2020

recover TF inference for deepJet and deepDoubleX and MXNET inf for deepBoosted (migrated to ONNX in #28112) cms-sw/cmssw#28959

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ONNX runtime] Update for powerpc #5743

[ONNX runtime] Update for powerpc #5743

mrodozov commented Apr 14, 2020

cmsbuild commented Apr 14, 2020 •

edited

Loading

cmsbuild commented Apr 14, 2020

smuzaffar commented Apr 14, 2020

cmsbuild commented Apr 14, 2020

cmsbuild commented Apr 15, 2020

mrodozov commented Apr 15, 2020

cmsbuild commented Apr 15, 2020 •

edited

Loading

mrodozov commented Apr 15, 2020

mrodozov commented Apr 15, 2020 •

edited

Loading

mrodozov commented Apr 15, 2020

cmsbuild commented Apr 15, 2020

cmsbuild commented Apr 24, 2020

smuzaffar commented Apr 26, 2020

cmsbuild commented Apr 26, 2020 •

edited

Loading

cmsbuild commented Apr 26, 2020

cmsbuild commented Apr 26, 2020

cmsbuild commented Apr 26, 2020

smuzaffar commented Apr 27, 2020

cmsbuild commented Apr 27, 2020

silviodonato commented Apr 27, 2020

[ONNX runtime] Update for powerpc #5743

[ONNX runtime] Update for powerpc #5743

Conversation

mrodozov commented Apr 14, 2020

cmsbuild commented Apr 14, 2020 • edited Loading

cmsbuild commented Apr 14, 2020

smuzaffar commented Apr 14, 2020

cmsbuild commented Apr 14, 2020

cmsbuild commented Apr 15, 2020

mrodozov commented Apr 15, 2020

cmsbuild commented Apr 15, 2020 • edited Loading

mrodozov commented Apr 15, 2020

mrodozov commented Apr 15, 2020 • edited Loading

mrodozov commented Apr 15, 2020

cmsbuild commented Apr 15, 2020

cmsbuild commented Apr 24, 2020

smuzaffar commented Apr 26, 2020

cmsbuild commented Apr 26, 2020 • edited Loading

cmsbuild commented Apr 26, 2020

cmsbuild commented Apr 26, 2020

cmsbuild commented Apr 26, 2020

smuzaffar commented Apr 27, 2020

cmsbuild commented Apr 27, 2020

silviodonato commented Apr 27, 2020

cmsbuild commented Apr 14, 2020 •

edited

Loading

cmsbuild commented Apr 15, 2020 •

edited

Loading

mrodozov commented Apr 15, 2020 •

edited

Loading

cmsbuild commented Apr 26, 2020 •

edited

Loading