[14.1.X] Backport multi-arch chanegs from 15.0.X

[smuzaffar]

same as #9572

[smuzaffar]

test parameters:

• full_cmssw = true

[smuzaffar]

please test

[cmsbuild]

A new Pull Request was created by @smuzaffar for branch IB/CMSSW_14_1_X/master.

@aandvalenzuela, @cmsbuild, @iarspider, @smuzaffar can you please review it and eventually sign? Thanks.
@antoniovilela, @mandrenguyen, @rappoccio, @sextonkennedy you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

cms-bot internal usage

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-2a786d/43405/summary.html
COMMIT: e9ae703
CMSSW: CMSSW_14_1_X_2024-12-11-2300/el8_amd64_gcc12
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/9573/43405/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially removed 148 lines from the logs
• Reco comparison results: 2 differences found in the comparisons
• DQMHistoTests: Total files compared: 46
• DQMHistoTests: Total histograms compared: 3565709
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3565686
• DQMHistoTests: Total skipped: 20
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 45 files compared)
• Checked 199 log files, 169 edm output root files, 46 DQM output files
• TriggerResults: no differences found

[antoniovilela]

@smuzaffar
Will you need this for 14_1_7? If so, it would be good to merge today, so that we build tomorrow.

[smuzaffar]

@antoniovilela , I would like to get this in for 14.2.X first.
OK, let me merge #9572 for 14.2.X first and I can trigger an IB now and if 14.2.X IB has no issues then I can merge this before 23h00 14.1.X IB

[antoniovilela]

@antoniovilela , I would like to get this in for 14.2.X first. OK, let me merge #9572 for 14.2.X first and I can trigger an IB now and if 14.2.X IB has no issues then I can merge this before 23h00 14.1.X IB

Sounds good

[smuzaffar]

+externals

14.2.X IB looks good so lets merge this for 14.1.X

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_14_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @mandrenguyen, @rappoccio, @sextonkennedy, @antoniovilela (and backports should be raised in the release meeting by the corresponding L2)

[antoniovilela]

@smuzaffar
Hi Shahzad, do you understand why we started having the unit test failure from FWCore/Integration ?

[smuzaffar]

@antoniovilela , no idea but I am looking in to it

[antoniovilela]

@antoniovilela , no idea but I am looking in to it

Many thankks. We will wait a bit, before we launch the 14_2 & 15_0 builds.

[smuzaffar]

I think cms-sw/cmssw-config@91e7bf6 change broke the python impor. I am reverting that change . Change was needed for runing edm class check during patch release built. We have a work around for that cms-sw/cmssw#46922 . Can you please integrate cms-sw/cmssw#46922 .

I will revert the cms-sw/cmssw-config@91e7bf6 foo all release cycles 14.1 and above

[antoniovilela]

I think cms-sw/cmssw-config@91e7bf6 change broke the python impor. I am reverting that change . Change was needed for runing edm class check during patch release built. We have a work around for that cms-sw/cmssw#46922 . Can you please integrate cms-sw/cmssw#46922 .

I will revert the cms-sw/cmssw-config@91e7bf6 foo all release cycles 14.1 and above

cms-sw/cmssw#46922 is merged.

Ok, we will wait for the revert.

[smuzaffar]

@makortel , cms-sw/cmssw-config@91e7bf6 change was using the realpath of imported python package. This was done so that edm class check script can import FWCore.Reflection.ClassesDefXmlUtils during the build phase of patch release. This change broke TestIntegrationParameterSet unit test. Here is what python directory looks like in patch release

• If FWCore is not part of patch release then we create symlink cmssw-patch/python/FWCore pointing to full release

cmssw-patch/python/FWCore  -- symlink to --> cmssw/python/FWCore

• if FWCore is part of patch release then we create cmssw-patch/python/FWCore directory and create symlink for Integration

cmssw-patch/python/FWCore/Integration  -- symlink to --> cmssw/python/FWCore/Integration

After the cmssw-config update for python imports, in patch releases , imported python module path starts with

• CMSSW_FULL_RELEASE_BASE: If package is not part of patch release
• CMSSW_RELEASE_BASE: If package is part of patch release
• CMSSW_BASE: In devel area, if patch was locally checkout

The reason unit test https://cmssdt.cern.ch/SDT/cgi-bin/logreader/el8_amd64_gcc12/CMSSW_15_0_X_2024-12-13-1100/unitTestLogs/FWCore/Integration#/3356-3356 start failing was that https://github.com/cms-sw/cmssw/blob/master/FWCore/ParameterSet/python/Config.py#L55 only allows CMSSW_RELEASE_BASE and CMSSW_BASE. For now I have reverted the cmssw-config change. But do you think we should update https://github.com/cms-sw/cmssw/blob/master/FWCore/ParameterSet/python/Config.py#L55 and also allow CMSSW_FULL_RELEASE_BASE ?

[smuzaffar]

I have opened a cmssw issue for this