Update to relval_gpu.pyfor Alpaka and Pixel Triplets Alpaka Workflows

[AdrianoDee]

PR description:

This PR proposes to:

• add *.406, *.407, *.408 Alpaka PixelOnly triplets wf (standard, profiling, validation);
• add *.486 triplet equivalent of .482 (full reco + pixel-only);
• remove the CUDA wfs from relval_gpu.py;
• add 2024 and D110 Alpaka wfs to relval_gpu.py (with D110 fixed after Alpaka Pixel: Reading layerStart at Runtime and Variable thePitch*  #45421);
• keeping 2023 wfs for the moment as needed by the bot (12434.402,12434.403,12434.412,12434.422,12434.423). Once this is merged Update GPU RelVals to 2024 wfs cms-bot#2310 can go in and those can be removed;
• fixing DQM pixel GPUvsCPU for Phase2 workflows (needed to run Phase2 Alpaka wfs).

[AdrianoDee]

enable gpu

[cmsbuild]

cms-bot internal usage

[AdrianoDee]

@fwyzard let me know if this makes sense to you.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45694/41280

• There are other open Pull requests which might conflict with changes you have proposed:
  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, CMSSW Integration of LST #45117, TICLv5 : Superclustering DNN #45333, Clean up Phase-2 Geometry D86, D88, D91, D92, D93, D94, D97 #45370, Allowing Jumping BPix2->FPix2 For Pixel Doublets (and Alpaka Pixel Triplets *.406 wf) #45478, Update Pixel GPU DQM online client #45666, Add Phase2 PbPb reco process modifier #45683
  • File RecoTracker/Configuration/python/customizePixelTracksForTriplets.py modified in PR(s): Allowing Jumping BPix2->FPix2 For Pixel Doublets (and Alpaka Pixel Triplets *.406 wf) #45478

[cmsbuild]

A new Pull Request was created by @AdrianoDee for master.

It involves the following packages:

• Configuration/PyReleaseValidation (upgrade, pdmv)
• RecoTracker/Configuration (reconstruction)

@AdrianoDee, @cmsbuild, @jfernan2, @kskovpen, @mandrenguyen, @miquork, @srimanob, @subirsarkar, @sunilUIET can you please review it and eventually sign? Thanks.
@GiacomoSguazzoni, @JanFSchulte, @Martin-Grunewald, @VinInn, @VourMa, @dgulhan, @fabiocos, @felicepantaleo, @gpetruc, @makortel, @missirol, @mmusich, @mtosi, @rovere, @slomeo this is something you requested to watch as well.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

[AdrianoDee]

please test

[cmsbuild]

-1

Failed Tests: Build
Size: This PR adds an extra 36KB to repository
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-853b3c/40898/summary.html
COMMIT: 2d7742a
CMSSW: CMSSW_14_1_X_2024-08-13-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/45694/40898/install.sh to create a dev area with all the needed externals and cmssw changes.

Build

I found compilation error when building:

SyntaxError: invalid syntax

gmake[1]: *** [config/SCRAM/GMake/Makefile.rules:2004: CompilePython] Error 1
gmake[1]: Target 'PostBuild' not remade because of errors.
gmake[1]: Leaving directory '/data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_14_1_X_2024-08-13-1100'
gmake: *** [config/SCRAM/GMake/Makefile.rules:1890: src] Error 2
gmake: Target 'all' not remade because of errors.
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 2
+ eval scram build outputlog '&&' '(python3' /data/cmsbld/jenkins/workspace/ib-run-pr-tests/cms-bot/buildLogAnalyzer.py --logDir /data/cmsbld/jenkins/workspace/ib-run-pr-tests/CMSSW_14_1_X_2024-08-13-1100/tmp/el8_amd64_gcc12/cache/log/src '||' 'true)'
++ scram build outputlog
>> Entering Package Configuration/PyReleaseValidation


[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-45694/41282

• There are other open Pull requests which might conflict with changes you have proposed:
  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, CMSSW Integration of LST #45117, TICLv5 : Superclustering DNN #45333, Clean up Phase-2 Geometry D86, D88, D91, D92, D93, D94, D97 #45370, Allowing Jumping BPix2->FPix2 For Pixel Doublets (and Alpaka Pixel Triplets *.406 wf) #45478, Update Pixel GPU DQM online client #45666, Add Phase2 PbPb reco process modifier #45683
  • File RecoTracker/Configuration/python/customizePixelTracksForTriplets.py modified in PR(s): Allowing Jumping BPix2->FPix2 For Pixel Doublets (and Alpaka Pixel Triplets *.406 wf) #45478

[fwyzard]

+heterogeneous

[AdrianoDee]

@cms-sw/dqm-l2 @cms-sw/upgrade-l2 any comment on this?

[tjavaid]

+1

• spurious differences seen from unstable WF 12834.7 (open issue spurious differences in outputs of Run-3 wfs *.7 #39803 )

[AdrianoDee]

@cms-sw/upgrade-l2 sorry to bother but this would be useful for a series of things (removing IB failures, monitoring Alpaka wfs and CUDA removal). Thanks ( :

[srimanob]

+Upgrade

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @sextonkennedy, @mandrenguyen, @antoniovilela, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[fwyzard]

@fwyzard

Indeed the memory usage has a non-negligible jump (4-5%) when running:

* `14_0_14` GRun menu;

* in `14_0_14_MULTIARCHS`;

* on TTBar PU with 2024 conditions (`140X_mcRun3_2024_realistic_v14`);

* 4 concurrent jobs with 16 threads, 16 streams.

My proposal here would be to define anyway the triplets wfs. Then I'm not sure if we want to have or not Phase2 PU triplet wf in the relval_gpu.py matrix given it will show up as a failure in the IBs. For the moment I've removed it. I've left an (hopefully) explicative comment in ZVertexDefinitions.h.

@AdrianoDee coming back to this: given the very visible impact on the memory, I guess we should resurrect #43952 even before figuring out a less cumbersome interface.

I'll try to rebase it to the latest master.

[fwyzard]

I'll try to rebase it to the latest master.

#45887 is a work-in-progress reimplementation, that also makes the ZVertexSoA collections run-time sized.

[AdrianoDee]

@cms-sw/orp-l2 gentle ping ( :

[mandrenguyen]

+1

[srimanob]

Typo.