Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EMTF NN version update #37825

Merged
merged 1 commit into from
May 6, 2022
Merged

Conversation

eyigitba
Copy link
Contributor

@eyigitba eyigitba commented May 5, 2022

PR description:

This PR updates the version of the data file for the EMTF displaced NN v10.1. The previous version is outdated, and needs to replaced with the version available in firmware at P5. Some performance changes are expected with respect to the old version v5

PR validation:

Validated with runTheMatrix.py -l limited -i all --ibeos.

if this PR is a backport please specify the original PR and why you need to backport that PR:

This change requires cms-data/L1Trigger-L1TMuon#22 to work

@cmsbuild
Copy link
Contributor

cmsbuild commented May 5, 2022

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-37825/29742

  • This PR adds an extra 20KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented May 5, 2022

A new Pull Request was created by @eyigitba for master.

It involves the following packages:

  • L1Trigger/L1TMuonEndCap (l1)

@epalencia, @cmsbuild, @cecilecaillol, @rekovic can you please review it and eventually sign? Thanks.
@dinyar, @missirol, @thomreis, @Martin-Grunewald this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@epalencia
Copy link
Contributor

Please test

@cmsbuild
Copy link
Contributor

cmsbuild commented May 5, 2022

-1

Failed Tests: RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ba32ce/24486/summary.html
COMMIT: d99de4c
CMSSW: CMSSW_12_4_X_2022-05-05-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

----- Begin Fatal Exception 05-May-2022 23:58:51 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 274199 lumi: 21 event: 39389360 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module L1TDigiToRaw/'packGmtStage2'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2_skimSinglePh
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2022 23:58:52 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 301998 lumi: 9 event: 8792128 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module L1TDigiToRaw/'packGmtStage2'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/136.793_RunDoubleEG2017C+RunDoubleEG2017C+HLTDR2_2017+RECODR2_2017reHLT_skimDoubleEG_Prompt+HARVEST2017_skimDoubleEG
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2022 23:58:58 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 319450 lumi: 76 event: 105676750 stream: 0
   [1] Running path 'HLTAnalyzerEndpath'
   [2] Prefetching for module L1TRawToDigi/'hltGtStage2Digis'
   [3] Prefetching for module RawDataCollectorByLabel/'rawDataCollector'
   [4] Prefetching for module L1TDigiToRaw/'packGmtStage2'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-relvals/matrix-results/136.874_RunEGamma2018C+RunEGamma2018C+HLTDR2_2018+RECODR2_2018reHLT_skimEGamma_Offline_L1TEgDQM+HARVEST2018_L1TEgDQM
----- End Fatal Exception -------------------------------------------------
Expand to see more relval errors ...

RelVals-INPUT

  • 136.721136.721_RunHLTPhy2016B+RunHLTPhy2016B+HLTDR2_2016+RECODR2_2016reHLT_HIPM+HARVESTDR2/step2_RunHLTPhy2016B+RunHLTPhy2016B+HLTDR2_2016+RECODR2_2016reHLT_HIPM+HARVESTDR2.log
  • 136.723136.723_RunDoubleMuon2016B+RunDoubleMuon2016B+HLTDR2_2016+RECODR2_2016reHLT_HIPM+HARVESTDR2/step2_RunDoubleMuon2016B+RunDoubleMuon2016B+HLTDR2_2016+RECODR2_2016reHLT_HIPM+HARVESTDR2.log
  • 136.722136.722_RunDoubleEG2016B+RunDoubleEG2016B+HLTDR2_2016+RECODR2_2016reHLT_skimDoubleEG_HIPM+HARVESTDR2_skimDoubleEG/step2_RunDoubleEG2016B+RunDoubleEG2016B+HLTDR2_2016+RECODR2_2016reHLT_skimDoubleEG_HIPM+HARVESTDR2_skimDoubleEG.log
Expand to see more relval errors ...

AddOn Tests

----- Begin Fatal Exception 05-May-2022 23:58:08 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 3 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/hlt_mc_Fake2
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2022 23:58:58 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 1 stream: 3
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/hlt_mc_GRun
----- End Fatal Exception -------------------------------------------------
----- Begin Fatal Exception 05-May-2022 23:58:58 CEST-----------------------
An exception of category 'FileInPathError' occurred while
   [0] Processing  Event run: 1 lumi: 1 event: 2 stream: 1
   [1] Running path 'L1TAnalyzerEndpath'
   [2] Prefetching for module L1TGlobalSummary/'L1TGlobalSummary'
   [3] Prefetching for module L1TGlobalProducer/'simGtStage2Digis'
   [4] Prefetching for module L1TMuonProducer/'simGmtStage2Digis'
   [5] Calling method for module L1TMuonEndCapTrackProducer/'simEmtfDigis'
Exception Message:
edm::FileInPath unable to find file L1Trigger/L1TMuon/data/emtf_luts/model_graph.displ.10.1.pb anywhere in the search path.
The search path is defined by: CMSSW_SEARCH_PATH
${CMSSW_SEARCH_PATH} is: /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24486/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/poison:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/src:/cvmfs/cms-ib.cern.ch/nweek-02731/slc7_amd64_gcc10/cms/cmssw-patch/CMSSW_12_4_X_2022-05-05-1100/external/slc7_amd64_gcc10/data
Current directory is: /data/cmsbld/jenkins/workspace/ib-run-pr-addon/addOnTests/hlt_mc_HIon
----- End Fatal Exception -------------------------------------------------
Expand to see more addon errors ...

@eyigitba
Copy link
Contributor Author

eyigitba commented May 6, 2022

This PR requires cms-data/L1Trigger-L1TMuon#22 to work. Can you please add that to the testing parameters? Thanks!

@cecilecaillol
Copy link
Contributor

please test with cms-data/L1Trigger-L1TMuon#22

@cmsbuild
Copy link
Contributor

cmsbuild commented May 6, 2022

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ba32ce/24492/summary.html
COMMIT: d99de4c
CMSSW: CMSSW_12_4_X_2022-05-05-2300/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/37825/24492/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ba32ce/24492/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ba32ce/24492/git-merge-result

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 49
  • DQMHistoTests: Total histograms compared: 3700704
  • DQMHistoTests: Total failures: 46
  • DQMHistoTests: Total nulls: 1
  • DQMHistoTests: Total successes: 3700635
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: -0.004 KiB( 48 files compared)
  • DQMHistoSizes: changed ( 312.0 ): -0.004 KiB MessageLogger/Warnings
  • Checked 206 log files, 45 edm output root files, 49 DQM output files
  • TriggerResults: no differences found

@cecilecaillol
Copy link
Contributor

+l1

@cmsbuild
Copy link
Contributor

cmsbuild commented May 6, 2022

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@@ -21,8 +21,8 @@ void PtAssignmentEngineDxy::configure(int verbose, const std::string pbFileNameD
pbFileNameDxy_ = pbFileNameDxy;
std::string pbFilePathDxy_ = "L1Trigger/L1TMuon/data/emtf_luts/" + pbFileNameDxy_;

inputNameDxy_ = "batch_normalization_1_input";
outputNamesDxy_ = {"dense_4/BiasAdd"};
inputNameDxy_ = "input1";
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are changes in this file related to the update of the EMTF displaced NN?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes. The names of the input and output nodes changed in the new protobuf file. The changes are made to adapt to that.

@perrotta
Copy link
Contributor

perrotta commented May 6, 2022

+1

@cmsbuild cmsbuild merged commit 4932ec0 into cms-sw:master May 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants