[BuildRules] More fixes for running tests in individual dirs

[smuzaffar]

Base on cms-sw/cmssw-config@f269ce2

• use full path of top level unit test directory
• create hard links instead of full copy of tests dependencies
• ignore copy of dependency contents if its directory does not exists e.g. if the test was skipped

[smuzaffar]

test parameters:

• full_cmssw = true

[smuzaffar]

please test

[cmsbuild]

A new Pull Request was created by @smuzaffar (Malik Shahzad Muzaffar) for branch IB/CMSSW_13_1_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.
cms-bot commands are listed here

[cmsbuild]

-1

Failed Tests: UnitTests
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31142/summary.html
COMMIT: eb51068
CMSSW: CMSSW_13_1_X_2023-03-08-1300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8366/31142/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @smuzaffar [Core] Unit tests fixes/improvements cmssw#40988
• @brallmond Add plugin to use existing HLTDoubleSinglet module with two PFJets and one RecoEcalCandidate cmssw#40994

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31142/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31142/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test validateAlignments had ERRORS
---> test DiMuonVertex had ERRORS
---> test EoP had ERRORS
---> test Miscellanea had ERRORS
and more ...

Comparison Summary

Summary:

• You potentially removed 156 lines from the logs
• Reco comparison results: 7 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3530381
• DQMHistoTests: Total failures: 8
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3530351
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[smuzaffar]

please test

[cmsbuild]

Pull request #8366 was updated.

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31149/summary.html
COMMIT: 7247148
CMSSW: CMSSW_13_1_X_2023-03-08-1300/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/8366/31149/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @smuzaffar [Core] Unit tests fixes/improvements cmssw#40988
• @brallmond Add plugin to use existing HLTDoubleSinglet module with two PFJets and one RecoEcalCandidate cmssw#40994

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31149/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-46ccae/31149/git-merge-result

Comparison Summary

Summary:

• You potentially removed 164 lines from the logs
• Reco comparison results: 19 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3530381
• DQMHistoTests: Total failures: 126
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3530233
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 48 files compared)
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[smuzaffar]

+externals

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next IB/CMSSW_13_1_X/master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)