Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Sporadic test failure (12x): TomcatServlet3Test* #436

Closed
trask opened this issue May 24, 2020 · 2 comments · Fixed by #480
Closed

Sporadic test failure (12x): TomcatServlet3Test* #436

trask opened this issue May 24, 2020 · 2 comments · Fixed by #480
Labels
contribution welcome Request makes sense, maintainers probably won't have time, contribution would be welcome

Comments

@trask
Copy link
Member

trask commented May 24, 2020 •
edited
Loading 

Condition not satisfied:

traces[it * 2 + 1][0].traceId.toLowerBase16() == traceId
|     ||  |   |   |   |       |               |  |
|     |2  4   5   |   |       |               |  d35de502750216e6a1f033af412825b9
|     |           |   |       |               false
|     |           |   |       |               29 differences (9% similarity)
|     |           |   |       |               (ab11ff6-)7(aca)1(2523)6(6d4)0(df2)a(9-)1(cbfac-)
|     |           |   |       |               (d35de502)7(502)1(6e--)6(a1f)0(33-)a(f4)1(2825b9)
|     |           |   |       ab11ff67aca1252366d40df2a91cbfac
|     |           |   TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}
|     |           SpanData{traceId=TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}, spanId=SpanId{spanId=334a07b825f23b33}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984736000820, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59864}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984737185013, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}
|     [SpanData{traceId=TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}, spanId=SpanId{spanId=334a07b825f23b33}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984736000820, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59864}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984737185013, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}, spanId=SpanId{spanId=363dc994034f9e41}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=334a07b825f23b33}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590277984736598914, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984736853340, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]
[[SpanData{traceId=TraceId{traceId=9733b8ed7c2678a60b1d71747a83f59e}, spanId=SpanId{spanId=d9b69ad04b617a7e}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590277984730001727, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984731400948, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=06cbce234c74b7eb08c17a08385f9da6}, spanId=SpanId{spanId=f3613030888007b1}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984731000909, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59860}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984732233413, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=06cbce234c74b7eb08c17a08385f9da6}, spanId=SpanId{spanId=99a015fc0f5df900}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=f3613030888007b1}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590277984731615738, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984731861058, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=88810481a85818f93738a8aa003ea7fa}, spanId=SpanId{spanId=e1ea1c18b34fee28}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590277984733001122, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984734261390, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=3b25d59582c9352ddd185b966e5d9532}, spanId=SpanId{spanId=add399d988ec2394}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984733000852, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59862}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984734126764, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=3b25d59582c9352ddd185b966e5d9532}, spanId=SpanId{spanId=0e7fc1177ffdafb8}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=add399d988ec2394}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590277984733562401, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984733799400, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=85af6c6b9b96b3b677acea963533c407}, spanId=SpanId{spanId=050c6ee412c742fb}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590277984736001137, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984737294143, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}, spanId=SpanId{spanId=334a07b825f23b33}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984736000820, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59864}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984737185013, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=ab11ff67aca1252366d40df2a91cbfac}, spanId=SpanId{spanId=363dc994034f9e41}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=334a07b825f23b33}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590277984736598914, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984736853340, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=b5cd2b3fec8369932e779cfea190359f}, spanId=SpanId{spanId=dc9f67629e9cbcbf}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590277984738001135, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984739370832, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=d35de502750216e6a1f033af412825b9}, spanId=SpanId{spanId=3a5266549df99234}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=HTTP GET, kind=SERVER, startEpochNanos=1590277984739000772, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:37319/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=59866}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984740091245, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=d35de502750216e6a1f033af412825b9}, spanId=SpanId{spanId=04295d5ebe320b84}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=3a5266549df99234}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590277984739539435, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590277984739751862, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]]

	at TomcatServlet3Test.$spock_feature_4_0_closure3$_closure5(TomcatServlet3Test.groovy:133)
	at groovy.lang.Closure.call(Closure.java:405)
	at groovy.lang.Closure.call(Closure.java:421)
	at TomcatServlet3Test.access log has ids for #count requests_closure3(TomcatServlet3Test.groovy:123)
	at io.opentelemetry.auto.test.asserts.InMemoryExporterAssert.assertTraces(InMemoryExporterAssert.groovy:52)
	at io.opentelemetry.auto.test.AgentTestRunner.assertTraces(AgentTestRunner.java:207)
	at TomcatServlet3Test.access log has ids for #count requests(TomcatServlet3Test.groovy:122)

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-auto-instr-java/1101/workflows/a27b0da4-8a89-4964-a493-f95bdc4a4dc2/jobs/9204/tests

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-auto-instr-java/1126/workflows/25aa664c-e0ed-41be-a966-b1646680a77e/jobs/9378/tests

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-java-instrumentation/1223/workflows/130b8517-903d-4d4f-91c1-661be85952f9/jobs/10031/tests
@trask trask added the contribution welcome Request makes sense, maintainers probably won't have time, contribution would be welcome label May 26, 2020
@trask trask changed the title Sporadic test failure: TomcatServlet3TestAsync Sporadic test failure: TomcatServlet3TestAsync (2x) May 27, 2020
@trask trask changed the title Sporadic test failure: TomcatServlet3TestAsync (2x) Sporadic test failure (2x): TomcatServlet3TestAsync May 27, 2020
@trask
Copy link
Member Author

trask commented May 27, 2020 •
edited
Loading

Also TomcatServlet3TestDispatchImmediate

Condition not satisfied:

traces[it * 2 + 1][0].traceId.toLowerBase16() == traceId
|     ||  |   |   |   |       |               |  |
|     |0  0   1   |   |       |               |  797640b35c3f61cffa592a9de8650686
|     |           |   |       |               false
|     |           |   |       |               26 differences (18% similarity)
|     |           |   |       |               (bdec2b)4(6-)3(4)c(de)6(a717)a(8)59(0)a9(942c879--)
|     |           |   |       |               (7976--)4(0b)3(5)c(3f)6(1cff)a(-)59(2)a9(de8650686)
|     |           |   |       bdec2b4634cde6a717a8590a9942c879
|     |           |   TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}
|     |           SpanData{traceId=TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}, spanId=SpanId{spanId=2839987a1726209a}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590603123629001924, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=50226}, servlet.path=AttributeValueString{stringValue=/dispatch/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:43747/tomcat-context/dispatch/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123630066614, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}
|     [SpanData{traceId=TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}, spanId=SpanId{spanId=2839987a1726209a}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590603123629001924, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=50226}, servlet.path=AttributeValueString{stringValue=/dispatch/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:43747/tomcat-context/dispatch/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123630066614, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}, spanId=SpanId{spanId=5a5993c2b34f112d}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=2839987a1726209a}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590603123629787999, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123629966528, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]
[[SpanData{traceId=TraceId{traceId=dbc054a87afa8e16038f2b30200c50b6}, spanId=SpanId{spanId=b2ecd15cee1ebada}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590603123629002485, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123629868585, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}, spanId=SpanId{spanId=2839987a1726209a}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590603123629001924, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=50226}, servlet.path=AttributeValueString{stringValue=/dispatch/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:43747/tomcat-context/dispatch/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123630066614, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=bdec2b4634cde6a717a8590a9942c879}, spanId=SpanId{spanId=5a5993c2b34f112d}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=2839987a1726209a}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590603123629787999, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590603123629966528, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]]

	at TomcatServlet3Test.$spock_feature_4_0_closure3$_closure5(TomcatServlet3Test.groovy:138)
	at groovy.lang.Closure.call(Closure.java:405)
	at groovy.lang.Closure.call(Closure.java:421)
	at TomcatServlet3Test.access log has ids for #count requests_closure3(TomcatServlet3Test.groovy:128)
	at io.opentelemetry.auto.test.asserts.InMemoryExporterAssert.assertTraces(InMemoryExporterAssert.groovy:52)
	at io.opentelemetry.auto.test.AgentTestRunner.assertTraces(AgentTestRunner.java:233)
	at TomcatServlet3Test.access log has ids for #count requests(TomcatServlet3Test.groovy:127)

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-auto-instr-java/1130/workflows/79a1ec5e-172f-444a-af21-88c6837b8a03/jobs/9410/tests

And TomcatServlet3TestAsync:

Condition not satisfied:

traces[it * 2 + 1][0].traceId.toLowerBase16() == traceId
|     ||  |   |   |   |       |               |  |
|     |2  4   5   |   |       |               |  c60aeb2afd056f7ce2629c86150e9c1f
|     |           |   |       |               false
|     |           |   |       |               29 differences (9% similarity)
|     |           |   |       |               (d3f931)e(6c)a(8622893d-)2(5)6(5e)c(9e771)e(28--)
|     |           |   |       |               (c60a--)e(b2)a(fd056f7ce)2(-)6(29)c(86150)e(9c1f)
|     |           |   |       d3f931e6ca8622893d2565ec9e771e28
|     |           |   TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}
|     |           SpanData{traceId=TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}, spanId=SpanId{spanId=edf499cf064ef5df}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101923000804, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44556}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101924353559, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}
|     [SpanData{traceId=TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}, spanId=SpanId{spanId=edf499cf064ef5df}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101923000804, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44556}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101924353559, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}, spanId=SpanId{spanId=99f02f58c4df933c}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=edf499cf064ef5df}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590602101923666243, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101924007044, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]
[[SpanData{traceId=TraceId{traceId=7a1ca3569bc220b9eb47299506ae1327}, spanId=SpanId{spanId=af0a5343b1867072}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590602101917001723, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101918527692, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=9aca385093cb0ef19688d61752777474}, spanId=SpanId{spanId=0acbb86f80b17318}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101917001462, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44468}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101918249409, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=9aca385093cb0ef19688d61752777474}, spanId=SpanId{spanId=3dd8afbf132f11e9}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0acbb86f80b17318}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590602101917645165, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101917923271, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=3429e171642eb7152f2d72c522a5010c}, spanId=SpanId{spanId=2f89960602b63ffd}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590602101919001235, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101920354332, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=31b005ddebe0e28c1da4081d70958754}, spanId=SpanId{spanId=0b8912ebda29bc64}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101920000934, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44470}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101921291167, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=31b005ddebe0e28c1da4081d70958754}, spanId=SpanId{spanId=9cd366fded3e0349}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0b8912ebda29bc64}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590602101920608064, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101920875016, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=8d92b08078f474739351429f4f774c92}, spanId=SpanId{spanId=b895aa9a6c4e4aaa}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590602101922001881, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101923474235, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}, spanId=SpanId{spanId=edf499cf064ef5df}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101923000804, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44556}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101924353559, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=d3f931e6ca8622893d2565ec9e771e28}, spanId=SpanId{spanId=99f02f58c4df933c}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=edf499cf064ef5df}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590602101923666243, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101924007044, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=09606ad7a42ee86686bf2e788616949e}, spanId=SpanId{spanId=b998c11469e0822d}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590602101925001418, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101926222470, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=c60aeb2afd056f7ce2629c86150e9c1f}, spanId=SpanId{spanId=aab8506aa0120c1a}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590602101925001062, attributes={servlet.context=AttributeValueString{stringValue=/tomcat-context}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.status_code=AttributeValueLong{longValue=200}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}, http.url=AttributeValueString{stringValue=http://localhost:44469/tomcat-context/success}, servlet.path=AttributeValueString{stringValue=/success}, net.peer.port=AttributeValueLong{longValue=44558}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101926076102, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=c60aeb2afd056f7ce2629c86150e9c1f}, spanId=SpanId{spanId=99b6999ffa345629}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=aab8506aa0120c1a}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590602101925563448, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590602101925788614, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]]

	at TomcatServlet3Test.$spock_feature_4_0_closure3$_closure5(TomcatServlet3Test.groovy:138)
	at groovy.lang.Closure.call(Closure.java:405)
	at groovy.lang.Closure.call(Closure.java:421)
	at TomcatServlet3Test.access log has ids for #count requests_closure3(TomcatServlet3Test.groovy:128)
	at io.opentelemetry.auto.test.asserts.InMemoryExporterAssert.assertTraces(InMemoryExporterAssert.groovy:52)
	at io.opentelemetry.auto.test.AgentTestRunner.assertTraces(AgentTestRunner.java:207)
	at TomcatServlet3Test.access log has ids for #count requests(TomcatServlet3Test.groovy:127)

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-auto-instr-java/1129/workflows/f7fb54e3-429b-435e-8009-45601549743f/jobs/9405/tests

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-java-instrumentation/1221/workflows/61e5e340-83d4-4dc3-892a-c1ea3af563d9/jobs/10017/tests

And TomcatServlet3TestFakeAsync

Condition not satisfied:

traces[it * 2 + 1][0].traceId.toLowerBase16() == traceId
|     ||  |   |   |   |       |               |  |
|     |1  2   3   |   |       |               |  f3d8758ef67ccd4c0d67972c03110397
|     |           |   |       |               false
|     |           |   |       |               28 differences (12% similarity)
|     |           |   |       |               (2050c3235)f(-)7(5378738514)72(3eb)1(c)1(6d)3(--)
|     |           |   |       |               (f3d8758e-)f(6)7(ccd4c0d679)72(c03)1(-)1(0-)3(97)
|     |           |   |       2050c3235f75378738514723eb1c16d3
|     |           |   TraceId{traceId=2050c3235f75378738514723eb1c16d3}
|     |           SpanData{traceId=TraceId{traceId=2050c3235f75378738514723eb1c16d3}, spanId=SpanId{spanId=09c5ab5b59ea3dcc}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510391003034, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36314}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391677246, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}
|     [SpanData{traceId=TraceId{traceId=2050c3235f75378738514723eb1c16d3}, spanId=SpanId{spanId=09c5ab5b59ea3dcc}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510391003034, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36314}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391677246, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=2050c3235f75378738514723eb1c16d3}, spanId=SpanId{spanId=5548e1b3817c6524}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=09c5ab5b59ea3dcc}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590614510391349720, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391500092, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]
[[SpanData{traceId=TraceId{traceId=39a40280f05d3465637082d1e55e2370}, spanId=SpanId{spanId=34c9d758bb7a6b58}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590614510388002996, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510389381187, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=f54864e2d480e1ac2eebe66f57a70768}, spanId=SpanId{spanId=ac4f5eaa33c62ce6}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510388002677, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36312}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510389007075, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=f54864e2d480e1ac2eebe66f57a70768}, spanId=SpanId{spanId=61b5730d824f2616}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=ac4f5eaa33c62ce6}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590614510388415549, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510388601997, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=9b2cc332068f9aca76f6fd02e69250f5}, spanId=SpanId{spanId=b2be5f444b30346f}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590614510391002228, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391948009, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=2050c3235f75378738514723eb1c16d3}, spanId=SpanId{spanId=09c5ab5b59ea3dcc}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510391003034, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36314}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391677246, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=2050c3235f75378738514723eb1c16d3}, spanId=SpanId{spanId=5548e1b3817c6524}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=09c5ab5b59ea3dcc}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590614510391349720, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510391500092, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=cd2d252a68e6533c6395075f709f7839}, spanId=SpanId{spanId=6f17e39cf90df3b6}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590614510394002459, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510395239691, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=f3d8758ef67ccd4c0d67972c03110397}, spanId=SpanId{spanId=52c2b2a02d27f94c}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510395001489, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36324}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510395660439, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=f3d8758ef67ccd4c0d67972c03110397}, spanId=SpanId{spanId=f4dcf599a39bae00}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=52c2b2a02d27f94c}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590614510395368024, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510395503507, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=d6b8172ab5f25ee9fac149b3b09f3474}, spanId=SpanId{spanId=d78dc719961c260c}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=TEST_SPAN, kind=INTERNAL, startEpochNanos=1590614510404020196, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510405225618, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}], [SpanData{traceId=TraceId{traceId=5dad157f83f59fe07cda60b94e3f1e91}, spanId=SpanId{spanId=5194ae273c3b7d67}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=0000000000000000}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto.servlet-3.0, version=null}, name=ApplicationFilterChain.doFilter, kind=SERVER, startEpochNanos=1590614510405002720, attributes={http.status_code=AttributeValueLong{longValue=200}, net.peer.port=AttributeValueLong{longValue=36326}, servlet.path=AttributeValueString{stringValue=/success}, servlet.context=AttributeValueString{stringValue=/tomcat-context}, http.url=AttributeValueString{stringValue=http://localhost:38949/tomcat-context/success}, net.peer.ip=AttributeValueString{stringValue=127.0.0.1}, http.method=AttributeValueString{stringValue=GET}, span.origin.type=AttributeValueString{stringValue=org.apache.catalina.core.ApplicationFilterChain}}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510405783377, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=7}, SpanData{traceId=TraceId{traceId=5dad157f83f59fe07cda60b94e3f1e91}, spanId=SpanId{spanId=1f27496ba047e35e}, traceFlags=TraceFlags{sampled=true}, traceState=TraceState{entries=[]}, parentSpanId=SpanId{spanId=5194ae273c3b7d67}, resource=Resource{attributes={}}, instrumentationLibraryInfo=InstrumentationLibraryInfo{name=io.opentelemetry.auto, version=null}, name=controller, kind=INTERNAL, startEpochNanos=1590614510405452733, attributes={}, timedEvents=[], links=[], status=Status{canonicalCode=OK, description=null}, endEpochNanos=1590614510405605957, hasRemoteParent=false, hasEnded=true, totalRecordedEvents=0, totalRecordedLinks=0, totalAttributeCount=0}]]

	at TomcatServlet3Test.$spock_feature_4_0_closure3$_closure5(TomcatServlet3Test.groovy:138)
	at groovy.lang.Closure.call(Closure.java:405)
	at groovy.lang.Closure.call(Closure.java:421)
	at TomcatServlet3Test.access log has ids for #count requests_closure3(TomcatServlet3Test.groovy:128)
	at io.opentelemetry.auto.test.asserts.InMemoryExporterAssert.assertTraces(InMemoryExporterAssert.groovy:52)
	at io.opentelemetry.auto.test.AgentTestRunner.assertTraces(AgentTestRunner.java:233)
	at TomcatServlet3Test.access log has ids for #count requests(TomcatServlet3Test.groovy:127)

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-auto-instr-java/1133/workflows/94518ef0-c16e-466d-8577-b85a216a6018/jobs/9442/tests

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-java-instrumentation/1192/workflows/fa620626-4c96-4615-ab1b-20b96d09e685/jobs/9838/tests

@trask trask changed the title Sporadic test failure (2x): TomcatServlet3TestAsync Sporadic test failure (3x): TomcatServlet3Test* May 27, 2020
@trask trask changed the title Sporadic test failure (3x): TomcatServlet3Test* Sporadic test failure (4x): TomcatServlet3Test* May 27, 2020
@iNikem iNikem changed the title Sporadic test failure (4x): TomcatServlet3Test* Sporadic test failure (5x): TomcatServlet3Test* May 31, 2020
@iNikem
Copy link
Contributor

iNikem commented May 31, 2020

https://app.circleci.com/pipelines/github/open-telemetry/opentelemetry-java-instrumentation/1154/workflows/27255f13-ae35-4020-8c78-9cc89650f931/jobs/9591

@trask trask changed the title Sporadic test failure (5x): TomcatServlet3Test* Sporadic test failure (6x): TomcatServlet3Test* May 31, 2020
@trask trask changed the title Sporadic test failure (6x): TomcatServlet3Test* Sporadic test failure (7x): TomcatServlet3Test* Jun 4, 2020
@iNikem iNikem changed the title Sporadic test failure (7x): TomcatServlet3Test* Sporadic test failure (8x): TomcatServlet3Test* Jun 5, 2020
@iNikem iNikem changed the title Sporadic test failure (8x): TomcatServlet3Test* Sporadic test failure (9x): TomcatServlet3Test* Jun 5, 2020
@iNikem iNikem changed the title Sporadic test failure (9x): TomcatServlet3Test* Sporadic test failure (10x): TomcatServlet3Test* Jun 5, 2020
@trask trask changed the title Sporadic test failure (10x): TomcatServlet3Test* Sporadic test failure (11x): TomcatServlet3Test* Jun 5, 2020
@trask trask changed the title Sporadic test failure (11x): TomcatServlet3Test* Sporadic test failure (12x): TomcatServlet3Test* Jun 6, 2020
@iNikem iNikem mentioned this issue Jun 8, 2020
Merged
@trask trask mentioned this issue Jun 14, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
contribution welcome Request makes sense, maintainers probably won't have time, contribution would be welcome
Projects
None yet
Milestone
No milestone
2 participants
@trask @iNikem