-
Notifications
You must be signed in to change notification settings - Fork 4.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Circular dependencies in DataFormats #31019
Comments
A new Issue was created by @davidlange6 David Lange. @Dr15Jones, @dpiparo, @silviodonato, @smuzaffar, @makortel, @qliphy can you please review it and eventually sign/assign? Thanks. cms-bot commands are listed here |
assign reconstruction |
the description is pretty unreadable. |
I fixed up some incorrect line breaks - but right, presumably some digging is needed to know the potential solution to each one. I provided the digging that I have done so far |
thanks, this is a bit better already. Does this provide the same information as in the ignominy (IB QA)?
Can ignominy be used to get a more readable/detailed information? |
On Aug 2, 2020, at 6:30 PM, Slava Krutelyov <[email protected]<mailto:[email protected]>> wrote:
Can ignominy be used to get a more readable/detailed information?
Indeed it looks like some of these are reported by ignominy as well. Scram seems to have picked up more after BuildFIles that match what’s #included are used.
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQ47CJZCKY4XFTI7MCTR6WICXANCNFSM4PSNHS3A>.
|
since the issue is not reported in an obvious way, |
currently one can do
git cms-merge-topic 31005
scram b
On Aug 2, 2020, at 6:40 PM, Slava Krutelyov <[email protected]<mailto:[email protected]>> wrote:
since the issue is not reported in an obvious way,
how to reproduce the report to see that a specific item is gone?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQ76BKZWVIWOPBXDQP3R6WJIRANCNFSM4PSNHS3A>.
|
The dependencies appear to be a bit more complex
|
Or probably
Doing grep PackageA PackageB/BuildFile.xml PackageB/interface/* PackageB/src/*
And vice versa is sufficient for most I suspect..
On Aug 2, 2020, at 6:43 PM, David Lange <[email protected]<mailto:[email protected]>> wrote:
currently one can do
git cms-merge-topic 31005
scram b
On Aug 2, 2020, at 6:40 PM, Slava Krutelyov <[email protected]<mailto:[email protected]><mailto:[email protected]>> wrote:
since the issue is not reported in an obvious way,
how to reproduce the report to see that a specific item is gone?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQ76BKZWVIWOPBXDQP3R6WJIRANCNFSM4PSNHS3A>.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQZ7XATBQIGKYXKLLCTR6WJTJANCNFSM4PSNHS3A>.
|
Took a look because of personal history. Seems to me that the only reason cmssw/DataFormats/TrackReco/src/classes_def.xml Lines 476 to 479 in e1d7658
cmssw/DataFormats/TrackReco/src/classes_def.xml Lines 483 to 486 in e1d7658
so an alternative could be to move those instead. On the other hand TrackReco has more dependencies than TrackCandidate , which would favor moving TrajectoryStopReason.h .
|
I've fixed the TrackReco/Candidate item. |
@davidlange6 |
Apparently one needs a full build to get a reliable report. I know of at least one more (which is typically reported in the IB q/a information)
On Sep 5, 2020, at 3:43 AM, Slava Krutelyov <[email protected]<mailto:[email protected]>> wrote:
@davidlange6<https://github.com/davidlange6>
can I conclude based on the ignominy report https://cmssdt.cern.ch/SDT/cgi-bin/newQA.py?arch=slc7_amd64_gcc820&release=CMSSW_11_2_X_2020-09-04-2300
that we are done and this issue can be closed?
Or do you see some more issue detected by some other way?
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQ5CM4UQQEWRFU5B4HTSEGJUPANCNFSM4PSNHS3A>.
|
https://cmssdt.cern.ch/SDT/cgi-bin/newQA.py?arch=slc7_amd64_gcc10&release=CMSSW_11_2_X_2020-09-04-2300 |
Cycle 7 is not one I’ve seen before (Eg I didn’t notice it on Thursday). Any recent PR?
On 5 Sep 2020, at 17:22, Slava Krutelyov <[email protected]> wrote:
Apparently one needs a full build to get a reliable report. I know of at least one more (which is typically reported in the IB q/a information)
https://cmssdt.cern.ch/SDT/cgi-bin/newQA.py?arch=slc7_amd64_gcc10&release=CMSSW_11_2_X_2020-09-04-2300
from a gcc10 full build
indeed, we still have plenty (4?) cycles with DataFormats included.
[Screen Shot 2020-09-05 at 8 20 14 AM]<https://user-images.githubusercontent.com/4676718/92308176-ac93a200-ef50-11ea-9625-2129285e09a3.png>
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQ5WN7NXH6TGOHSEGCLSEJJRPANCNFSM4PSNHS3A>.
|
I think it's already in CMSSW_11_2_X_2020-08-30-0000 |
Thx. Probably I was looking at patch builds:(
Cheers,
David
On 5 Sep 2020, at 18:09, Slava Krutelyov <[email protected]> wrote:
Cycle 7 is not one I’ve seen before (Eg I didn’t notice it on Thursday). Any recent PR?
I think it's already in CMSSW_11_2_X_2020-08-30-0000
slc7_amd64_gcc820
https://cmssdt.cern.ch/SDT/cgi-bin/newQA.py?arch=slc7_amd64_gcc820&release=CMSSW_11_2_X_2020-08-30-0000
[Screen Shot 2020-09-05 at 9 08 06 AM]<https://user-images.githubusercontent.com/4676718/92309094-57a75a00-ef57-11ea-91c9-b82c4b268c4a.png>
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub<#31019 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/ABGPFQY2QAQQQRY34LCKPALSEJPBJANCNFSM4PSNHS3A>.
|
I can't find a connection between
I did that in today's |
If this is a package level cycle (not the same include file), here is one example:
is this a source of the problem? |
so this step is naively the problem: |
Seems like FFTJet.h should just move to CondFormats/JetMETObjects. Not sure that will fix everything or not.. (JetMETCorrections/FFTJetObjects seems to be combo of condformats and es producers) |
I proposed it - #31370 |
it looks like the cycle was split into two after #31370 |
It seems to me the cycle 4 in #31019 (comment) is at least partially caused by cmssw/DataFormats/RecoCandidate/interface/TrackAssociation.h Lines 14 to 19 in 3220826
This file (and corresponding dictionaries) should be moved to SimDataFormats/TrackingAnalysis that already depends on DataFormats/TrackReco .
|
This was implemented since last April with #33186 @davidlange6 which is the status of those circular dependencies now? |
I looked a few IBs back but apparently there is no ignominy results available https://cmssdt.cern.ch/SDT/cgi-bin/newQA.py?arch=slc7_amd64_gcc900&release=CMSSW_12_0_X_2021-07-06-0300#ignominy @smuzaffar is it still produced? |
@slava77 , as we moved to python based SCRAM so |
@smuzaffar |
I gave it a look and it is not easy to change ignominy. I will try to port it but it is not on a high priorty list |
From pr #31005 by adding the dependencies needed according to #includes, scram finds a number of circular dependencies. @Dr15Jones has fixed one. Here are some others... I inlined what I learned before stopping..
gmake: Circular lib/slc7_amd64_gcc820/DataFormatsSiPixelDetId_xr_rdict.pcm <- tmp/slc7_amd64_gcc820/src/DataFormats/SiPixelDetId/src/DataFormatsSiPixelDetId/a/DataFormatsSiPixelDetId_xr.cc dependency dropped.
Pixel*Name classes should be moved ?
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/SiStripCluster/src/DataFormatsSiStripCluster/a/DataFormatsSiStripCluster_xr.cc <- tmp/slc7_amd64_gcc820/rootpcms/DataFormatsSiStripDetId dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TrackCandidate/src/DataFormatsTrackCandidate/a/DataFormatsTrackCandidate_xr.cc <- tmp/slc7_amd64_gcc820/rootpcms/DataFormatsTrackReco dependency dropped.
This looks simple to fix. Move TrajectoryStopReason
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TrackerCommon/src/DataFormatsTrackerCommon/libDataFormatsTrackerCommon.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsSiStripCluster dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TrackCandidate/src/DataFormatsTrackCandidate/libDataFormatsTrackCandidate.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/HLTReco/src/DataFormatsHLTReco/libDataFormatsHLTReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsEgammaCandidates dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/HLTReco/src/DataFormatsHLTReco/libDataFormatsHLTReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsJetReco dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/METReco/src/DataFormatsMETReco/libDataFormatsMETReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsEgammaReco dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/METReco/src/DataFormatsMETReco/libDataFormatsMETReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsJetReco dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/RecoCandidate/src/DataFormatsRecoCandidate/libDataFormatsRecoCandidate.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsEgammaReco dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/GsfTrackReco/src/DataFormatsGsfTrackReco/libDataFormatsGsfTrackReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/GsfTrackReco/src/DataFormatsGsfTrackReco/libDataFormatsGsfTrackReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TrajectorySeed/src/DataFormatsTrajectorySeed/libDataFormatsTrajectorySeed.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TrajectorySeed/src/DataFormatsTrajectorySeed/libDataFormatsTrajectorySeed.so <- tmp/slc7_amd64_gcc820/cache/prod/libGeometryCommonTopologies dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/RecoCandidate/src/DataFormatsRecoCandidate/libDataFormatsRecoCandidate.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/RecoCandidate/src/DataFormatsRecoCandidate/libDataFormatsRecoCandidate.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/METReco/src/DataFormatsMETReco/libDataFormatsMETReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/METReco/src/DataFormatsMETReco/libDataFormatsMETReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/VertexReco/src/DataFormatsVertexReco/libDataFormatsVertexReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped
.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/VertexReco/src/DataFormatsVertexReco/libDataFormatsVertexReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped
.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TauReco/src/DataFormatsTauReco/libDataFormatsTauReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsJetReco dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TauReco/src/DataFormatsTauReco/libDataFormatsTauReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsParticleFlowCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TauReco/src/DataFormatsTauReco/libDataFormatsTauReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/TauReco/src/DataFormatsTauReco/libDataFormatsTauReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/HLTReco/src/DataFormatsHLTReco/libDataFormatsHLTReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackCandidate dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/DataFormats/HLTReco/src/DataFormatsHLTReco/libDataFormatsHLTReco.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsTrackingRecHit dependency dropped.
gmake: Circular tmp/slc7_amd64_gcc820/src/Geometry/CommonTopologies/src/GeometryCommonTopologies/libGeometryCommonTopologies.so <- tmp/slc7_amd64_gcc820/cache/prod/libDataFormatsJetReco dependency dropped.
The text was updated successfully, but these errors were encountered: