Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ASAN] SubmitPVsplit and test_MC_23_setup failing for unknown reason #45751

Open
iarspider opened this issue Aug 20, 2024 · 9 comments
Open

[ASAN] SubmitPVsplit and test_MC_23_setup failing for unknown reason #45751

iarspider opened this issue Aug 20, 2024 · 9 comments

Comments

@iarspider
Copy link
Contributor

Log for SubmitPVsplit:

./batchHarvester_Prompt_0.sh: line 15: 2055448 Killed                  ls -lh .
Failure running PVSplit script: status 137

ASAN reports memory leaks in bash, could be the cause?

Leaks
==2055325==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 18 byte(s) in 1 object(s) allocated from:
    #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 18 byte(s) leaked in 1 allocation(s).
=================================================================
==2055331==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 19 byte(s) in 1 object(s) allocated from:
    #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 19 byte(s) leaked in 1 allocation(s).
=================================================================
==2055337==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 17 byte(s) in 1 object(s) allocated from:
    #0 0x1528256b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55669b68a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 17 byte(s) leaked in 1 allocation(s).
=================================================================
==2055344==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 11 byte(s) in 1 object(s) allocated from:
    #0 0x14a62f4b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55579c68a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 11 byte(s) leaked in 1 allocation(s).
=================================================================
==2055351==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 32 byte(s) in 1 object(s) allocated from:
    #0 0x14b927cb8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x561e4d28a691 in xmalloc (/usr/bin/bash+0x8a691)
Indirect leak of 88 byte(s) in 3 object(s) allocated from:
    #0 0x14b927cb8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x561e4d28a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 120 byte(s) leaked in 4 allocation(s).
=================================================================
==2055354==ERROR: LeakSanitizer: detected memory leaks
Direct leak of 11 byte(s) in 1 object(s) allocated from:
    #0 0x14a62f4b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55579c68a691 in xmalloc (/usr/bin/bash+0x8a691)
SUMMARY: AddressSanitizer: 11 byte(s) leaked in 1 allocation(s).

Log for test_MC_23_setup doesn't provide any details (not even error code), only leak reports in Python3.6 and bash:

Leaks
=================================================================
==2027053==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 1534027 byte(s) in 177 object(s) allocated from:
    #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1645
    #2 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1638

Direct leak of 2066 byte(s) in 2 object(s) allocated from:
    #0 0x14f1126b7ae5 in __interceptor_realloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:85
    #1 0x14f112322796 in resize_compact Objects/unicodeobject.c:1084

Direct leak of 96 byte(s) in 3 object(s) allocated from:
    #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x14f1123ea775 in PyThread_allocate_lock Python/thread_pthread.h:389

Indirect leak of 197575 byte(s) in 209 object(s) allocated from:
    #0 0x14f1126b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1645
    #2 0x14f112305d57 in _PyObject_Malloc Objects/obmalloc.c:1638

SUMMARY: AddressSanitizer: 1733764 byte(s) leaked in 391 allocation(s).

=================================================================
==2027044==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 32 byte(s) in 1 object(s) allocated from:
    #0 0x1506114b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55a184c8a691 in xmalloc (/usr/bin/bash+0x8a691)

Indirect leak of 88 byte(s) in 3 object(s) allocated from:
    #0 0x1506114b8bdf in __interceptor_malloc ../../../../libsanitizer/asan/asan_malloc_linux.cpp:69
    #1 0x55a184c8a691 in xmalloc (/usr/bin/bash+0x8a691)
@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 20, 2024

cms-bot internal usage

@cmsbuild
Copy link
Contributor

A new Issue was created by @iarspider.

@Dr15Jones, @antoniovilela, @makortel, @mandrenguyen, @rappoccio, @sextonkennedy, @smuzaffar can you please review it and eventually sign/assign? Thanks.

cms-bot commands are listed here

@makortel
Copy link
Contributor

Is the LeakSanitizer something new?

@iarspider
Copy link
Contributor Author

LeakSanitizer is a part of ASAN: link. We can try suppressing diagnostics from bash and python

@mmusich
Copy link
Contributor

mmusich commented Nov 18, 2024

the issue with SubmitPVsplit is solved by #46719

@mmusich
Copy link
Contributor

mmusich commented Nov 18, 2024

assign alca, pdmv

@cmsbuild
Copy link
Contributor

New categories assigned: alca,pdmv

@AdrianoDee,@atpathak,@consuegs,@DickyChant,@miquork,@perrotta you have been requested to review this Pull request/Issue and eventually sign? Thanks

@mmusich
Copy link
Contributor

mmusich commented Nov 19, 2024

the issue with SubmitPVsplit is solved by #46719

SubmitPVsplit succeeded in CMSSW_14_2_ASAN_X_2024-11-18-2300 (see log).

@perrotta
Copy link
Contributor

+alca

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

5 participants