Update OpenMPI to version 4.1.5 [13.0.x]

[fwyzard]

The Open MPI community is pleased to announce the Open MPI v4.1.5 release. This release is a bug fix release.

Open MPI v4.1.5 can be downloaded from the Open MPI website:

https://www.open-mpi.org/software/ompi/v4.1/

Changes to v4.1.5 compared to v4.1.4:

• fix crash in one-sided applications for certain process layouts.
• update embedded OpenPMIx to version 3.2.4
• fix issue building with ifort on MacOS.
• backport patches to Libevent for CVE-2016-10195, CVE-2016-10196, and CVE-2016-10197. Note that Open MPI's internal libevent does not use the impacted portions of the Libevent code base.
• SHMEM improvements:
  • fix initializer bugs in SHMEM interface.
  • fix unsigned type comparisons generating warnings.
  • fix use after clear issue in shmem_ds_reset.
• UCX improvements:
  • fix memory registration bug that could occur when UCX was built but not selected.
  • reduce overhead of add_procs with intercommunicators.
  • enable multi_send_nb by default.
  • call opal_progress while waiting for a UCX fence to complete.
• fix data corruption bug in osc/rdma component.
• fix overflow bug in alltoall collective
• fix crash when displaying topology.
• add some MPI_F_XXX constants that were missing from mpi.h.
• coll/ucc bug fixes.

[fwyzard]

type bugfix

[cmsbuild]

A new Pull Request was created by @fwyzard (Andrea Bocci) for branch IB/CMSSW_13_0_X/master.

@cmsbuild, @smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

• Backported from Update OpenMPI to version 4.1.5 #8333

[fwyzard]

backport #8333

[fwyzard]

please test

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ef839a/30864/summary.html
COMMIT: d351d87
CMSSW: CMSSW_13_0_X_2023-02-23-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8334/30864/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test testmat had ERRORS
---> test dumpDDCompactView had ERRORS
---> test dumpDDExpandedView had ERRORS
---> test testDDCompactView had ERRORS
and more ...

Comparison Summary

There are some workflows for which there are errors in the baseline:
22034.911 step 1
23234.911 step 1
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

• You potentially added 11 lines to the logs
• Reco comparison results: 6 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3556944
• DQMHistoTests: Total failures: 3
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3556919
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[iarspider]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-ef839a/30924/summary.html
COMMIT: d351d87
CMSSW: CMSSW_13_0_X_2023-02-26-2300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/8334/30924/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially removed 8 lines from the logs
• Reco comparison results: 8 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3556944
• DQMHistoTests: Total failures: 1155
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3555767
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 78.21 KiB( 48 files compared)
• DQMHistoSizes: changed ( 11634.0,... ): 13.035 KiB HLT/Muon
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[fwyzard]

@perrotta @rappoccio I think this is in master since a few days... can we merge it for 13.0.0 ?

[perrotta]

+1

[perrotta]

@smuzaffar feel free to merge it for 13.0.X

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_0_X/master IBs (tests are also fine). This pull request will be automatically merged.