Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

buffermgrd crashed causing unit test failing #1076

Closed
stcheng opened this issue Sep 30, 2019 · 0 comments
Closed

buffermgrd crashed causing unit test failing #1076

stcheng opened this issue Sep 30, 2019 · 0 comments
Labels
Bug 🐛

Comments

@stcheng
Copy link
Contributor

stcheng commented Sep 30, 2019 

Sep 30 17:53:33.182980 66b2939258a2 NOTICE #buffermgrd: :- main: --- Starting buffermgrd ---
Sep 30 17:53:33.183361 66b2939258a2 NOTICE #buffermgrd: :- loadRedisScript: lua script loaded, sha: 88270a7c5c90583e56425aca8af8a4b8c39fe757
Sep 30 17:53:33.188459 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: Read lookup configuration file...
Sep 30 17:53:33.188564 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 10000 and cable 5m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188584 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 25000 and cable 5m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188589 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 40000 and cable 5m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188594 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 50000 and cable 5m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188600 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 100000 and cable 5m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188606 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 10000 and cable 40m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188612 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 25000 and cable 40m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188616 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 40000 and cable 40m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188622 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 50000 and cable 40m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188629 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 100000 and cable 40m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188635 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 10000 and cable 300m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188641 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 25000 and cable 300m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188646 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 40000 and cable 300m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188650 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 50000 and cable 300m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188656 66b2939258a2 NOTICE #buffermgrd: :- readPgProfileLookupFile: PG profile for speed 100000 and cable 300m is: size:56368, xon:18432, xoff:55120, th:-3, xon_offset:2496
Sep 30 17:53:33.188683 66b2939258a2 NOTICE #buffermgrd: :- main: starting main loop
Sep 30 17:53:33.188852 66b2939258a2 INFO #supervisord: buffermgrd *** Error in `/usr/bin/buffermgrd': corrupted size vs. prev_size: 0x00005621490ae790 ***
Sep 30 17:53:33.189509 66b2939258a2 INFO #supervisord: buffermgrd ======= Backtrace: =========
Sep 30 17:53:33.189563 66b2939258a2 INFO #supervisord: buffermgrd /lib/x86_64-linux-gnu/libc.so.6(+0x70bfb)[0x7f6935cc8bfb]
Sep 30 17:53:33.189570 66b2939258a2 INFO #supervisord: buffermgrd /lib/x86_64-linux-gnu/libc.so.6(+0x76fc6)[0x7f6935ccefc6]
Sep 30 17:53:33.189576 66b2939258a2 INFO #supervisord: buffermgrd /lib/x86_64-linux-gnu/libc.so.6(+0x780c1)[0x7f6935cd00c1]
Sep 30 17:53:33.189587 66b2939258a2 INFO #supervisord: buffermgrd /usr/lib/x86_64-linux-gnu/libswsscommon.so.0(_ZNSt5dequeISt5tupleIJNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES6_St6vectorISt4pairIS6_S6_ESaIS9_EEEESaISC_EE19_M_destroy_data_auxESt15_Deque_iteratorISC_RSC_PSC_ESI_+0x175)[0x7f6936cf7a75]
Sep 30 17:53:33.189596 66b2939258a2 INFO #supervisord: buffermgrd /usr/lib/x86_64-linux-gnu/libswsscommon.so.0(_ZN4swss20SubscriberStateTable4popsERSt5dequeISt5tupleIJNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEES8_St6vectorISt4pairIS8_S8_ESaISB_EEEESaISE_EERKS8_+0x252)[0x7f6936d049f2]
Sep 30 17:53:33.189601 66b2939258a2 INFO #supervisord: buffermgrd /usr/bin/buffermgrd(+0x1544f)[0x56214754544f]
Sep 30 17:53:33.189608 66b2939258a2 INFO #supervisord: buffermgrd /usr/bin/buffermgrd(+0x570c)[0x56214753570c]
Sep 30 17:53:33.189614 66b2939258a2 INFO #supervisord: buffermgrd /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7f6935c782e1]
Sep 30 17:53:33.189621 66b2939258a2 INFO #supervisord: buffermgrd /usr/bin/buffermgrd(+0x5c2a)[0x562147535c2a]
Sep 30 17:53:33.189627 66b2939258a2 INFO #supervisord: buffermgrdSep 30 17:53:33.189627 66b2939258a2 INFO #supervisord: buffermgrd ======= Memory map: ========
Sep 30 17:53:33.189634 66b2939258a2 INFO #supervisord: buffermgrd 562147530000-562147555000 r-xp 00000000 08:21 47073151                   /usr/bin/buffermgrd
Sep 30 17:53:33.189640 66b2939258a2 INFO #supervisord: buffermgrd 562147754000-562147755000 r--p 00024000 08:21 47073151                   /usr/bin/buffermgrd
Sep 30 17:53:33.189647 66b2939258a2 INFO #supervisord: buffermgrd 562147755000-562147756000 rw-p 00025000 08:21 47073151                   /usr/bin/buffermgrd
Sep 30 17:53:33.189652 66b2939258a2 INFO #supervisord: buffermgrd 562149098000-5621490d8000 rw-p 00000000 00:00 0                          [heap]
Sep 30 17:53:33.189658 66b2939258a2 INFO #supervisord: buffermgrd 7f6928000000-7f6928021000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189664 66b2939258a2 INFO #supervisord: buffermgrd 7f6928021000-7f692c000000 ---p 00000000 00:00 0
Sep 30 17:53:33.189671 66b2939258a2 INFO #supervisord: buffermgrd 7f6930000000-7f6930021000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189677 66b2939258a2 INFO #supervisord: buffermgrd 7f6930021000-7f6934000000 ---p 00000000 00:00 0
Sep 30 17:53:33.189683 66b2939258a2 INFO #supervisord: buffermgrd 7f6934db2000-7f6934db3000 ---p 00000000 00:00 0
Sep 30 17:53:33.189689 66b2939258a2 INFO #supervisord: buffermgrd 7f6934db3000-7f69355b3000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189700 66b2939258a2 INFO #supervisord: buffermgrd 7f69355b3000-7f69355d2000 r-xp 00000000 08:21 47072739                   /lib/x86_64-linux-gnu/libnl-3.so.200.22.0
Sep 30 17:53:33.189705 66b2939258a2 INFO #supervisord: buffermgrd 7f69355d2000-7f69357d1000 ---p 0001f000 08:21 47072739                   /lib/x86_64-linux-gnu/libnl-3.so.200.22.0
Sep 30 17:53:33.189711 66b2939258a2 INFO #supervisord: buffermgrd 7f69357d1000-7f69357d3000 r--p 0001e000 08:21 47072739                   /lib/x86_64-linux-gnu/libnl-3.so.200.22.0
Sep 30 17:53:33.189717 66b2939258a2 INFO #supervisord: buffermgrd 7f69357d3000-7f69357d4000 rw-p 00020000 08:21 47072739                   /lib/x86_64-linux-gnu/libnl-3.so.200.22.0
Sep 30 17:53:33.189729 66b2939258a2 INFO #supervisord: buffermgrd 7f69357d4000-7f6935832000 r-xp 00000000 08:21 47074618                   /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.22.0
Sep 30 17:53:33.189752 66b2939258a2 INFO #supervisord: buffermgrd 7f6935832000-7f6935a31000 ---p 0005e000 08:21 47074618                   /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.22.0
Sep 30 17:53:33.189758 66b2939258a2 INFO #supervisord: buffermgrd 7f6935a31000-7f6935a34000 r--p 0005d000 08:21 47074618                   /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.22.0
Sep 30 17:53:33.189764 66b2939258a2 INFO #supervisord: buffermgrd 7f6935a34000-7f6935a39000 rw-p 00060000 08:21 47074618                   /usr/lib/x86_64-linux-gnu/libnl-route-3.so.200.22.0
Sep 30 17:53:33.189770 66b2939258a2 INFO #supervisord: buffermgrd 7f6935a39000-7f6935a3b000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189776 66b2939258a2 INFO #supervisord: buffermgrd 7f6935a3b000-7f6935a53000 r-xp 00000000 08:21 51918209                   /lib/x86_64-linux-gnu/libpthread-2.24.so
Sep 30 17:53:33.189782 66b2939258a2 INFO #supervisord: buffermgrd 7f6935a53000-7f6935c52000 ---p 00018000 08:21 51918209                   /lib/x86_64-linux-gnu/libpthread-2.24.so
Sep 30 17:53:33.189788 66b2939258a2 INFO #supervisord: buffermgrd 7f6935c52000-7f6935c53000 r--p 00017000 08:21 51918209                   /lib/x86_64-linux-gnu/libpthread-2.24.so
Sep 30 17:53:33.189794 66b2939258a2 INFO #supervisord: buffermgrd 7f6935c53000-7f6935c54000 rw-p 00018000 08:21 51918209                   /lib/x86_64-linux-gnu/libpthread-2.24.so
Sep 30 17:53:33.189800 66b2939258a2 INFO #supervisord: buffermgrd 7f6935c54000-7f6935c58000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189806 66b2939258a2 INFO #supervisord: buffermgrd 7f6935c58000-7f6935ded000 r-xp 00000000 08:21 51918146                   /lib/x86_64-linux-gnu/libc-2.24.so
Sep 30 17:53:33.189813 66b2939258a2 INFO #supervisord: buffermgrd 7f6935ded000-7f6935fed000 ---p 00195000 08:21 51918146                   /lib/x86_64-linux-gnu/libc-2.24.so
Sep 30 17:53:33.189818 66b2939258a2 INFO #supervisord: buffermgrd 7f6935fed000-7f6935ff1000 r--p 00195000 08:21 51918146                   /lib/x86_64-linux-gnu/libc-2.24.so
Sep 30 17:53:33.189824 66b2939258a2 INFO #supervisord: buffermgrd 7f6935ff1000-7f6935ff3000 rw-p 00199000 08:21 51918146                   /lib/x86_64-linux-gnu/libc-2.24.so
Sep 30 17:53:33.189830 66b2939258a2 INFO #supervisord: buffermgrd 7f6935ff3000-7f6935ff7000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189836 66b2939258a2 INFO #supervisord: buffermgrd 7f6935ff7000-7f693600d000 r-xp 00000000 08:21 51918166                   /lib/x86_64-linux-gnu/libgcc_s.so.1
Sep 30 17:53:33.189841 66b2939258a2 INFO #supervisord: buffermgrd 7f693600d000-7f693620c000 ---p 00016000 08:21 51918166                   /lib/x86_64-linux-gnu/libgcc_s.so.1
Sep 30 17:53:33.189847 66b2939258a2 INFO #supervisord: buffermgrd 7f693620c000-7f693620d000 r--p 00015000 08:21 51918166                   /lib/x86_64-linux-gnu/libgcc_s.so.1
Sep 30 17:53:33.189853 66b2939258a2 INFO #supervisord: buffermgrd 7f693620d000-7f693620e000 rw-p 00016000 08:21 51918166                   /lib/x86_64-linux-gnu/libgcc_s.so.1
Sep 30 17:53:33.189859 66b2939258a2 INFO #supervisord: buffermgrd 7f693620e000-7f6936311000 r-xp 00000000 08:21 51918175                   /lib/x86_64-linux-gnu/libm-2.24.so
Sep 30 17:53:33.189880 66b2939258a2 INFO #supervisord: buffermgrd 7f6936311000-7f6936510000 ---p 00103000 08:21 51918175                   /lib/x86_64-linux-gnu/libm-2.24.so
Sep 30 17:53:33.189913 66b2939258a2 INFO #supervisord: buffermgrd 7f6936510000-7f6936511000 r--p 00102000 08:21 51918175                   /lib/x86_64-linux-gnu/libm-2.24.so
Sep 30 17:53:33.189919 66b2939258a2 INFO #supervisord: buffermgrd 7f6936511000-7f6936512000 rw-p 00103000 08:21 51918175                   /lib/x86_64-linux-gnu/libm-2.24.so
Sep 30 17:53:33.189924 66b2939258a2 INFO #supervisord: buffermgrd 7f6936512000-7f6936684000 r-xp 00000000 08:21 51918931                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
Sep 30 17:53:33.189946 66b2939258a2 INFO #supervisord: buffermgrd 7f6936684000-7f6936884000 ---p 00172000 08:21 51918931                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
Sep 30 17:53:33.189951 66b2939258a2 INFO #supervisord: buffermgrd 7f6936884000-7f693688e000 r--p 00172000 08:21 51918931                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
Sep 30 17:53:33.189956 66b2939258a2 INFO #supervisord: buffermgrd 7f693688e000-7f6936890000 rw-p 0017c000 08:21 51918931                   /usr/lib/x86_64-linux-gnu/libstdc++.so.6.0.22
Sep 30 17:53:33.189961 66b2939258a2 INFO #supervisord: buffermgrd 7f6936890000-7f6936894000 rw-p 00000000 00:00 0
Sep 30 17:53:33.189966 66b2939258a2 INFO #supervisord: buffermgrd 7f6936894000-7f69368a3000 r-xp 00000000 08:21 47074571                   /usr/lib/x86_64-linux-gnu/libhiredis.so.0.14
Sep 30 17:53:33.189971 66b2939258a2 INFO #supervisord: buffermgrd 7f69368a3000-7f6936aa2000 ---p 0000f000 08:21 47074571                   /usr/lib/x86_64-linux-gnu/libhiredis.so.0.14
Sep 30 17:53:33.189976 66b2939258a2 INFO #supervisord: buffermgrd 7f6936aa2000-7f6936aa3000 r--p 0000e000 08:21 47074571                   /usr/lib/x86_64-linux-gnu/libhiredis.so.0.14
Sep 30 17:53:33.189981 66b2939258a2 INFO #supervisord: buffermgrd 7f6936aa3000-7f6936aa4000 rw-p 0000f000 08:21 47074571                   /usr/lib/x86_64-linux-gnu/libhiredis.so.0.14
Sep 30 17:53:33.189986 66b2939258a2 INFO #supervisord: buffermgrd 7f6936aa4000-7f6936aa9000 r-xp 00000000 08:21 47072741                   /lib/x86_64-linux-gnu/libnl-genl-3.so.200.22.0
Sep 30 17:53:33.189990 66b2939258a2 INFO #supervisord: buffermgrd 7f6936aa9000-7f6936ca8000 ---p 00005000 08:21 47072741                   /lib/x86_64-linux-gnu/libnl-genl-3.so.200.22.0
Sep 30 17:53:33.189995 66b2939258a2 INFO #supervisord: buffermgrd 7f6936ca8000-7f6936ca9000 r--p 00004000 08:21 47072741                   /lib/x86_64-linux-gnu/libnl-genl-3.so.200.22.0
Sep 30 17:53:33.190000 66b2939258a2 INFO #supervisord: buffermgrd 7f6936ca9000-7f6936caa000 rw-p 00005000 08:21 47072741                   /lib/x86_64-linux-gnu/libnl-genl-3.so.200.22.0
Sep 30 17:53:33.190005 66b2939258a2 INFO #supervisord: buffermgrd 7f6936caa000-7f6936d1c000 r-xp 00000000 08:21 49966924                   /usr/lib/x86_64-linux-gnu/libswsscommon.so.0.0.0
Sep 30 17:53:33.190010 66b2939258a2 INFO #supervisord: buffermgrd 7f6936d1c000-7f6936f1b000 ---p 00072000 08:21 49966924                   /usr/lib/x86_64-linux-gnu/libswsscommon.so.0.0.0
Sep 30 17:53:33.190015 66b2939258a2 INFO #supervisord: buffermgrd 7f6936f1b000-7f6936f1d000 r--p 00071000 08:21 49966924                   /usr/lib/x86_64-linux-gnu/libswsscommon.so.0.0.0
Sep 30 17:53:33.190021 66b2939258a2 INFO #supervisord: buffermgrd 7f6936f1d000-7f6936f1e000 rw-p 00073000 08:21 49966924                   /usr/lib/x86_64-linux-gnu/libswsscommon.so.0.0.0
Sep 30 17:53:33.190025 66b2939258a2 INFO #supervisord: buffermgrd 7f6936f1e000-7f6936f1f000 rw-p 00000000 00:00 0
Sep 30 17:53:33.190031 66b2939258a2 INFO #supervisord: buffermgrd 7f6936f1f000-7f6936f42000 r-xp 00000000 08:21 51918128                   /lib/x86_64-linux-gnu/ld-2.24.so
Sep 30 17:53:33.190035 66b2939258a2 INFO #supervisord: buffermgrd 7f6937135000-7f693713e000 rw-p 00000000 00:00 0
Sep 30 17:53:33.190040 66b2939258a2 INFO #supervisord: buffermgrd 7f6937141000-7f6937142000 rw-p 00000000 00:00 0
Sep 30 17:53:33.190045 66b2939258a2 INFO #supervisord: buffermgrd 7f6937142000-7f6937143000 r--p 00023000 08:21 51918128                   /lib/x86_64-linux-gnu/ld-2.24.so
Sep 30 17:53:33.190050 66b2939258a2 INFO #supervisord: buffermgrd 7f6937143000-7f6937144000 rw-p 00024000 08:21 51918128                   /lib/x86_64-linux-gnu/ld-2.24.so
Sep 30 17:53:33.190055 66b2939258a2 INFO #supervisord: buffermgrd 7f6937144000-7f6937145000 rw-p 00000000 00:00 0
Sep 30 17:53:33.190069 66b2939258a2 INFO #supervisord: buffermgrd 7fff65557000-7fff65578000 rw-p 00000000 00:00 0                          [stack]
Sep 30 17:53:33.190074 66b2939258a2 INFO #supervisord: buffermgrd 7fff6558d000-7fff65590000 r--p 00000000 00:00 0                          [vvar]
Sep 30 17:53:33.190079 66b2939258a2 INFO #supervisord: buffermgrd 7fff65590000-7fff65592000 r-xp 00000000 00:00 0                          [vdso]
Sep 30 17:53:33.190084 66b2939258a2 INFO #supervisord: buffermgrd ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]
Sep 30 17:53:33.338179 66b2939258a2 INFO #supervisord: start.sh buffermgrd: ERROR (spawn error)
oleksandrivantsiv pushed a commit to oleksandrivantsiv/sonic-swss that referenced this issue Mar 1, 2023
@smaheshm
[submodule update] SAI submodule update to v1.6.3 (sonic-net#628)
ef72159 
- Update SAI VoQ support (sonic-net#1107) …
- Voq system (sonic-net#1081) …
- [meta] Add support for ignored enum values (sonic-net#1099)
- TPID SAI proposal (sonic-net#1089) …
- ACL GRE key match (sonic-net#1076) …
- Add IPv6 NS and NA Traps (sonic-net#1092) …
- MACsec flow list attribute added in MACsec object (sonic-net#1095) …
- Add Enterprise Number for IPFIX Report Type (sonic-net#1072) …
- Provide TTL and QoS treatment during MPLS encap and decap (sonic-net#1079)
- Create and Set for Tunnel Attributes (sonic-net#1086) …
@stcheng stcheng closed this as completed Sep 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Bug 🐛
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@stcheng