Update DQMServices for protobuf 3.6.1.2 and tensorflow interfaces for TF 1.13.1

[mrodozov]

Following instructions to update those file when updating protobuf in here:
https://github.com/cms-sw/cmsdist/blob/IB/CMSSW_10_5_X/gcc700/protobuf.spec

[cmsbuild]

The code-checks are being triggered in jenkins.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-25889/8357

• This PR adds an extra 20KB to repository

[cmsbuild]

A new Pull Request was created by @mrodozov (Mircho Rodozov) for master.

It involves the following packages:

DQMServices/Core

@cmsbuild, @kmaeshima, @andrius-k, @jfernan2, @schneiml can you please review it and eventually sign? Thanks.
@barvic this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

[mrodozov]

please test with cms-sw/cmsdist#4684

[cmsbuild]

The tests are being triggered in jenkins.
Using externals from cms-sw/cmsdist#4684
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/33050/console

[cmsbuild]

-1

Tested at: 4df864a

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25889/33050/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

• Unit Tests:

I found errors in the following unit tests:

---> test testTheano had ERRORS
---> test testTFMetaGraphLoading had ERRORS
---> test testTFGraphLoading had ERRORS
---> test testImports had ERRORS

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25889/33050/summary.html

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 32
• DQMHistoTests: Total histograms compared: 3097440
• DQMHistoTests: Total failures: 1
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3097242
• DQMHistoTests: Total skipped: 197
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
• Checked 133 log files, 14 edm output root files, 32 DQM output files

[smuzaffar]

please test with cms-sw/cmsdist#4684

[mrodozov]

please test with cms-sw/cmsdist#4890

[cmsbuild]

The tests are being triggered in jenkins.
Tested with other pull request(s) cms-sw/cmsdist#4890
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/34379/console

[cmsbuild]

-1

Tested at: 43e84aa

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25889/34379/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests RelVals

• Unit Tests:

I found errors in the following unit tests:

---> test testConditionDatabase_2 had ERRORS

• RelVals:

The relvals timed out after 4 hours.

[cmsbuild]

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

[mrodozov]

Relvals doesn't finish because of gdb hang on runtime error:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25889/34379/runTheMatrix-results/27434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D35_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D35+RecoFullGlobal_2023D35+HARVESTFullGlobal_2023D35/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D35_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D35+RecoFullGlobal_2023D35+HARVESTFullGlobal_2023D35.log

In the first test, different relval crashed with the same reason:
Module: DeepFlavourTFJetTagsProducer:pfDeepFlavourJetTagsSlimmedDeepFlavour (crashed)
see
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25889/34363/runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017/step3_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017.log

[slava77]

@mrodozov please clarify on the status of this PR.
Thank you.
It looks like it is still not ready for review, a work in progress.

[mrodozov]

@slava77 we merged the changes from here into DEVEL to have an IB to work against.

[slava77]

@slava77 we merged the changes from here into DEVEL to have an IB to work against.

Please clarify on the status of making this PR applicable for the regular master version of CMSSW.
Thank you.

[davidlange6]

it needs to run without hanging first... Any review is certainly useful in the meanwhile.

…

On May 16, 2019, at 3:56 PM, Slava Krutelyov ***@***.***> wrote: @slava77 we merged the changes from here into DEVEL to have an IB to work against. Please clarify on the status of making this PR applicable for the regular master version of CMSSW. Thank you. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

[slava77]

@mrodozov
please clarify on the status of this PR.
Thank you.

[slava77]

it needs to run without hanging first... Any review is certainly useful in the meanwhile.
…

is the origin of the hanging understood?

I noticed in 1.12 notes https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md#bug-fixes-and-other-changes-2 that there was a change from jemalloc to the system malloc.
Could a mix of allocators lead to problems?

[slava77]

@mrodozov
please clarify on the status of this PR.
Thank you.

ping

[mrodozov]

I'll reopen it when we are ready