[MiniAOD] Backport of #43965 (Increase AK4 CHS pt cut and remove unsupported taggers for AK4 CHS and AK8 Puppi jets) to 14_0_X

[nurfikri89]

Backport of #43965

Original PR description:

This PR is the long awaited follow up of Issue #37167. The following changes to MiniAOD content are introduced:

• AK4 CHS jets (slimmedJets) pT threshold increase from 10 GeV to 15 GeV.
• Remove PileupJetID and Quark-Gluon Likelihood taggers for AK4 CHS jets.
• Remove unsupported taggers for AK4 CHS jets.
• Remove unsupported taggers for AK8 Puppi jets (slimmedJetsAK8).

Event size decreases by about 2.6%. The size comparison test was performed with 5000 events from a Run3Summer23 TTTo4Q AODSIM file.

List of tagger outputs stored for AK4CHS jets:

pfJetBProbabilityBJetTags
pfJetProbabilityBJetTags
pfTrackCountingHighEffBJetTags
pfDeepCSVJetTags:probb
pfDeepCSVJetTags:probc
pfDeepCSVJetTags:probudsg
pfDeepCSVJetTags:probbb
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probb
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probc
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probele
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probg
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probmu
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaum1h0p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaum1h1p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaum1h2p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaum3h0p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaum3h1p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaup1h0p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaup1h1p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaup1h2p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaup3h0p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probtaup3h1p
pfParticleNetFromMiniAODAK4CHSCentralJetTags:probuds
pfParticleNetFromMiniAODAK4CHSCentralJetTags:ptcorr
pfParticleNetFromMiniAODAK4CHSCentralJetTags:ptnu
pfParticleNetFromMiniAODAK4CHSCentralJetTags:ptreshigh
pfParticleNetFromMiniAODAK4CHSCentralJetTags:ptreslow
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:BvsAll
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:CvsB
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:CvsL
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:QvsG
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:TauVsEle
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:TauVsJet
pfParticleNetFromMiniAODAK4CHSCentralDiscriminatorsJetTags:TauVsMu

List of tagger outputs stored for AK4Puppi jets:

pfDeepCSVJetTags:probb
pfDeepCSVJetTags:probbb
pfDeepCSVJetTags:probc
pfDeepCSVJetTags:probudsg
pfJetBProbabilityBJetTags
pfJetProbabilityBJetTags
pfTrackCountingHighEffBJetTags
pfDeepFlavourJetTags:probb
pfDeepFlavourJetTags:probbb
pfDeepFlavourJetTags:probc
pfDeepFlavourJetTags:probg
pfDeepFlavourJetTags:problepb
pfDeepFlavourJetTags:probuds
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probb
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probc
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probele
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probg
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probmu
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaum1h0p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaum1h1p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaum1h2p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaum3h0p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaum3h1p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaup1h0p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaup1h1p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaup1h2p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaup3h0p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probtaup3h1p
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:probuds
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:ptcorr
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:ptnu
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:ptreshigh
pfParticleNetFromMiniAODAK4PuppiCentralJetTags:ptreslow
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:probg
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:probq
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:ptcorr
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:ptnu
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:ptreshigh
pfParticleNetFromMiniAODAK4PuppiForwardJetTags:ptreslow
pfParticleTransformerAK4JetTags:probb
pfParticleTransformerAK4JetTags:probbb
pfParticleTransformerAK4JetTags:probc
pfParticleTransformerAK4JetTags:probg
pfParticleTransformerAK4JetTags:problepb
pfParticleTransformerAK4JetTags:probuds
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:BvsAll
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:CvsB
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:CvsL
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:QvsG
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:TauVsEle
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:TauVsJet
pfParticleNetFromMiniAODAK4PuppiCentralDiscriminatorsJetTags:TauVsMu
pfParticleNetFromMiniAODAK4PuppiForwardDiscriminatorsJetTags:QvsG
pfParticleTransformerAK4DiscriminatorsJetTags:BvsAll
pfParticleTransformerAK4DiscriminatorsJetTags:BvsL
pfParticleTransformerAK4DiscriminatorsJetTags:CvsB
pfParticleTransformerAK4DiscriminatorsJetTags:CvsL
pfParticleTransformerAK4DiscriminatorsJetTags:QvsG

List of tagger outputs stored for AK8Puppi jets:

pfParticleNetFromMiniAODAK8JetTags:masscorr
pfParticleNetFromMiniAODAK8JetTags:probHbb
pfParticleNetFromMiniAODAK8JetTags:probHcc
pfParticleNetFromMiniAODAK8JetTags:probHgg
pfParticleNetFromMiniAODAK8JetTags:probHqq
pfParticleNetFromMiniAODAK8JetTags:probHte
pfParticleNetFromMiniAODAK8JetTags:probHtm
pfParticleNetFromMiniAODAK8JetTags:probHtt
pfParticleNetFromMiniAODAK8JetTags:probQCD0hf
pfParticleNetFromMiniAODAK8JetTags:probQCD1hf
pfParticleNetFromMiniAODAK8JetTags:probQCD2hf
pfParticleNetJetTags:probHbb
pfParticleNetJetTags:probHcc
pfParticleNetJetTags:probHqqqq
pfParticleNetJetTags:probQCDb
pfParticleNetJetTags:probQCDbb
pfParticleNetJetTags:probQCDc
pfParticleNetJetTags:probQCDcc
pfParticleNetJetTags:probQCDothers
pfParticleNetJetTags:probTbc
pfParticleNetJetTags:probTbcq
pfParticleNetJetTags:probTbel
pfParticleNetJetTags:probTbmu
pfParticleNetJetTags:probTbq
pfParticleNetJetTags:probTbqq
pfParticleNetJetTags:probTbta
pfParticleNetJetTags:probWcq
pfParticleNetJetTags:probWqq
pfParticleNetJetTags:probZbb
pfParticleNetJetTags:probZcc
pfParticleNetJetTags:probZqq
pfParticleNetDiscriminatorsJetTags:H4qvsQCD
pfParticleNetDiscriminatorsJetTags:HbbvsQCD
pfParticleNetDiscriminatorsJetTags:HccvsQCD
pfParticleNetDiscriminatorsJetTags:TvsQCD
pfParticleNetDiscriminatorsJetTags:WvsQCD
pfParticleNetDiscriminatorsJetTags:ZbbvsQCD
pfParticleNetDiscriminatorsJetTags:ZccvsQCD
pfParticleNetDiscriminatorsJetTags:ZvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HbbvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HccvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HggvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HqqvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HtevsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HtmvsQCD
pfParticleNetFromMiniAODAK8DiscriminatorsJetTags:HttvsQCD

FYI JME L2 (@abenecke @alkaloge), BTV L2 (@SWuchterl @mondalspandan) and XPOG (@vlimant @hqucms)

PR validation:

passes the usual runTheMatrix test: runTheMatrix.py -l limited -i all --ibeos

[cmsbuild]

A new Pull Request was created by @nurfikri89 for CMSSW_14_0_X.

It involves the following packages:

• PhysicsTools/NanoAOD (xpog)
• PhysicsTools/PatAlgos (xpog, reconstruction)

@vlimant, @cmsbuild, @hqucms, @mandrenguyen, @jfernan2 can you please review it and eventually sign? Thanks.
@rappoccio, @seemasharmafnal, @schoef, @jdamgov, @emilbols, @gkasieczka, @azotz, @ahinzmann, @Ming-Yan, @mariadalfonso, @hatakeyamak, @andrzejnovak, @nhanvtran, @gpetruc, @AlexDeMoor, @JyothsnaKomaragiri, @gouskos, @AnnikaStein, @demuller, @mbluj, @jdolen, @Senphy, @mmarionncern this is something you requested to watch as well.
@rappoccio, @sextonkennedy, @antoniovilela you are the release manager for this.

cms-bot commands are listed here

• Backported from [MiniAOD] Increase AK4 CHS pt cut and remove unsupported taggers for AK4 CHS and AK8 Puppi jets  #43965

[cmsbuild]

cms-bot internal usage

[vlimant]

enable nano

[vlimant]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-11dc78/37522/summary.html
COMMIT: 2c3010b
CMSSW: CMSSW_14_0_X_2024-02-16-1100/el8_amd64_gcc12
Additional Tests: NANO
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/43995/37522/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 2 lines to the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 8402 differences found in the comparisons
• DQMHistoTests: Total files compared: 48
• DQMHistoTests: Total histograms compared: 3248446
• DQMHistoTests: Total failures: 6259
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3242165
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: -21.884999999999998 KiB( 47 files compared)
• DQMHistoSizes: changed ( 11634.0,... ): -1.459 KiB Physics/NanoAODDQM
• Checked 200 log files, 161 edm output root files, 48 DQM output files
• TriggerResults: no differences found

NANO Comparison Summary

Summary:

• You potentially added 3 lines to the logs
• ROOTFileChecks: Some differences in event products or their sizes found
• Reco comparison results: 20 differences found in the comparisons
• DQMHistoTests: Total files compared: 15
• DQMHistoTests: Total histograms compared: 16416
• DQMHistoTests: Total failures: 20
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 16396
• DQMHistoTests: Total skipped: 0
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: -13.186 KiB( 14 files compared)
• DQMHistoSizes: changed ( 2500.001,... ): -0.735 KiB Physics/NanoAODDQM
• DQMHistoSizes: changed ( 2500.311,... ): -1.459 KiB Physics/NanoAODDQM
• Checked 38 log files, 18 edm output root files, 15 DQM output files

Nano size comparison Summary:

Sample	kb/ev	ref kb/ev	diff kb/ev	ev/s/thd	ref ev/s/thd	diff rate	mem/thd	ref mem/thd
2500.0	2.545	2.545	0.000 ( +0.0% )	5.26	5.24	+0.4%	2.098	2.237
2500.001	2.692	2.692	0.000 ( +0.0% )	4.69	4.73	-0.9%	2.107	2.664
2500.002	2.631	2.631	0.000 ( +0.0% )	4.87	4.84	+0.4%	2.122	2.649
2500.01	1.315	1.315	0.000 ( +0.0% )	9.52	9.76	-2.5%	1.973	2.353
2500.011	1.732	1.732	0.000 ( +0.0% )	5.16	5.22	-1.1%	1.977	2.548
2500.012	1.578	1.578	0.000 ( +0.0% )	7.43	7.53	-1.4%	1.956	2.453
2500.1	2.193	2.193	0.000 ( +0.0% )	5.28	5.25	+0.5%	1.936	2.075
2500.2	2.307	2.307	0.000 ( +0.0% )	6.05	6.07	-0.4%	1.818	1.986
2500.21	1.183	1.183	0.000 ( +0.0% )	4.30	4.36	-1.3%	1.853	2.284
2500.211	1.547	1.547	0.000 ( +0.0% )	3.76	3.76	+0.2%	1.948	2.368
2500.3	2.058	2.063	-0.005 ( -0.2% )	12.65	12.60	+0.3%	1.880	1.976
2500.31	1.256	1.259	-0.003 ( -0.2% )	20.16	19.14	+5.3%	2.272	2.378
2500.311	1.644	1.648	-0.004 ( -0.2% )	12.53	12.07	+3.9%	2.313	2.445
2500.312	7.159	7.159	0.000 ( +0.0% )	1.45	1.41	+2.7%	1.707	1.702
2500.313	1.564	1.564	0.000 ( +0.0% )	6.71	6.56	+2.3%	1.054	1.056
2500.4	2.058	2.063	-0.005 ( -0.2% )	12.74	12.60	+1.1%	1.883	1.976
2500.5	19.575	19.575	0.000 ( +0.0% )	1.14	1.05	+8.6%	1.106	1.360

[mandrenguyen]

type btv, jetmet

[mandrenguyen]

+1

[vlimant]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_14_0_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_14_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @rappoccio, @sextonkennedy, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[antoniovilela]

+1