-
Notifications
You must be signed in to change notification settings - Fork 147
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OTel span support #1886
Draft
sdaubin
wants to merge
22
commits into
main
Choose a base branch
from
saxon/replace-otel-spans2
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
OTel span support #1886
Changes from all commits
Commits
Show all changes
22 commits
Select commit
Hold shift + click to select a range
b108750
Add OTel span support
sdaubin 53a0a96
Documentation
sdaubin 50ada7a
Add static constructor
sdaubin fe873d7
Add test showing the SpanBuilder.setParent doesn't link async work
sdaubin 8faee60
Implement more of the OTel API for spans
sdaubin 583a36a
Add a switch to disable custom otel span builder
sdaubin bcb9146
Merge remote-tracking branch 'origin' into saxon/replace-otel-spans2
sdaubin c7bdc0a
Fix test
sdaubin 4563453
Log if `otel.exporter.otlp.endpoint` is set
sdaubin 224947c
Update DefaultTracerTest.java
sdaubin 6041d13
Allow individual opentelemetry instrumentation scopes to be disabled
sdaubin a9029cc
Try to fix test
sdaubin 67efb93
Use OpenTelemetry no op Span instance
sdaubin 509ce8a
Fix sql obfuscation of QueryConverter used by otel spans
sdaubin 4911fc1
Add another external span test
sdaubin ba4835a
Merge branch 'main' into saxon/replace-otel-spans2
jasonjkeller 972a16c
Add copyright header and formatting
jasonjkeller 12e2ef4
Merge branch 'main' of github.com:newrelic/newrelic-java-agent into s…
jasonjkeller f99b9ed
Merge branch 'main' of github.com:newrelic/newrelic-java-agent into s…
jasonjkeller 35c91f8
Add some comments
jasonjkeller 0750c0b
Merge main
jasonjkeller c308a60
Add readme for OTel functionality
jasonjkeller File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
27 changes: 27 additions & 0 deletions
27
agent-bridge/src/main/java/com/newrelic/agent/bridge/datastore/SqlQueryConverter.java
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
/* | ||
* | ||
* * Copyright 2024 New Relic Corporation. All rights reserved. | ||
* * SPDX-License-Identifier: Apache-2.0 | ||
* | ||
*/ | ||
|
||
package com.newrelic.agent.bridge.datastore; | ||
|
||
import com.newrelic.api.agent.QueryConverter; | ||
|
||
public final class SqlQueryConverter implements QueryConverter<String> { | ||
public static final QueryConverter<String> INSTANCE = new SqlQueryConverter(); | ||
|
||
private SqlQueryConverter() { | ||
} | ||
|
||
@Override | ||
public String toRawQueryString(String rawQuery) { | ||
return rawQuery; | ||
} | ||
|
||
@Override | ||
public String toObfuscatedQueryString(String rawQuery) { | ||
return null; | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
93 changes: 93 additions & 0 deletions
93
instrumentation/opentelemetry-sdk-extension-autoconfigure-1.28.0/README.md
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,93 @@ | ||
# OpenTelemetry Instrumentation | ||
|
||
This instrumentation module weaves parts of the OpenTelemetry SDK to incorporate bits of OpenTelemetry functionality into the New Relic Java agent. | ||
|
||
Specifically it can: | ||
* Detect OpenTelemetry Spans and include them in New Relic Java agent traces. | ||
* Detect OpenTelemetry dimensional metrics and report them to the APM entity being monitored by the Java agent. | ||
* Autoconfigure the OpenTelemetry SDK so that OpenTelemetry data is sent to New Relic and properly associated with an APM entity guid. | ||
|
||
## New Relic Java Agent Configuration | ||
|
||
To use the OpenTelemetry Span and dimensional metric functionality incorporated into the New Relic Java agent you must enable the following config options: | ||
|
||
Configuration via yaml: | ||
``` | ||
opentelemetry: | ||
sdk: | ||
autoconfigure: | ||
enabled: true | ||
spans: | ||
enabled: true | ||
``` | ||
|
||
Configuration via system property: | ||
``` | ||
-Dopentelemetry.sdk.autoconfigure.enabled=true | ||
-Dopentelemetry.sdk.spans.enabled=true | ||
``` | ||
|
||
Configuration via environment variable: | ||
``` | ||
NEW_RELIC_OPENTELEMETRY_SDK_AUTOCONFIGURE_ENABLED=true | ||
NEW_RELIC_OPENTELEMETRY_SDK_SPANS_ENABLED=true | ||
``` | ||
|
||
## OpenTelemetry Dimensional Metrics | ||
|
||
OpenTelemetry APIs can be used to create dimensional metrics which will be detected by the New Relic Java agent and reported to the APM entity being monitored by the New Relic Java agent. | ||
|
||
To use this functionality, enable the feature as documented above, add the required `opentelemetry` dependencies to your application: | ||
```groovy | ||
implementation(platform("io.opentelemetry:opentelemetry-bom:1.44.1")) | ||
implementation("io.opentelemetry:opentelemetry-sdk-extension-autoconfigure") | ||
implementation("io.opentelemetry:opentelemetry-exporter-otlp") | ||
``` | ||
|
||
Then utilize the OpenTelemetry APIs to record dimensional metrics: | ||
```java | ||
LongCounter longCounter = GlobalOpenTelemetry.get().getMeterProvider().get("my-application").counterBuilder("my.application.counter").build(); | ||
longCounter.add(1, Attributes.of(AttributeKey.stringKey("foo"), "bar")); | ||
``` | ||
|
||
Any recorded dimensional metrics can be found in the Metrics Explorer for the associated APM entity and can be used to build custom dashboards. | ||
|
||
## OpenTelemetry Spans | ||
|
||
Documented below are several approaches for incorporating OpenTelemetry Spans into New Relic Java agent traces. | ||
|
||
### `@WithSpan` Annotation | ||
|
||
The New Relic Java agent will detect usage of the OpenTelemetry [@WithSpan](https://opentelemetry.io/docs/zero-code/java/agent/annotations/) annotation. The `@WithSpan` annotation can be used as an alternative to the `@Trace` annotation. | ||
|
||
This does not currently support the following config options: | ||
* [Suppressing @WithSpan instrumentation](https://opentelemetry.io/docs/zero-code/java/agent/annotations/#suppressing-withspan-instrumentation) | ||
* [Creating spans around methods with otel.instrumentation.methods.include](https://opentelemetry.io/docs/zero-code/java/agent/annotations/#creating-spans-around-methods-with-otelinstrumentationmethodsinclude) | ||
|
||
Note that OpenTelemetry config properties can be set through environment or system properties, like our agent, and eventually through a config file. We can use our existing OpenTelemetry instrumentation model to get access to the normalized version of the instrumentation settings to include and exclude methods and pass those to the core agent through the bridge. | ||
|
||
See `ClassTransformerConfigImpl.java` for implementation details of the `@WithSpan` annotation. | ||
|
||
### Spans Emitted From OpenTelemetry Instrumentation | ||
|
||
The New Relic Java agent will detect Spans emitted by [OpenTelemetry instrumentation](https://opentelemetry.io/docs/languages/java/instrumentation/). It does this by weaving the `io.opentelemetry.sdk.trace.SdkTracerProvider` so that it will create a New Relic Tracer each time an OpenTelemetry Span is started and weaving the `io.opentelemetry.context.Context` to propagate context between New Relic and OpenTelemetry Spans. | ||
|
||
Currently, the New Relic Java agent does not load any OpenTelemetry instrumentation it simply detects Spans emitted by OpenTelemetry manual instrumentation, native instrumentation, library instrumentation, or zero code instrumentation (i.e. bytecode instrumentation that would also require running the OpenTelemetry Java agent). | ||
|
||
Depending on the OpenTelemetry Span `SpanKind`, it may result in the New Relic Java agent starting a transaction (when one doesn't already exist). | ||
|
||
* `SpanKind.INTERNAL` | ||
* Creating a span with no `SpanKind`, which defaults to `SpanKind.INTERNAL`, will not start a transaction | ||
* If `SpanKind.INTERNAL` spans occur within an already existing New Relic transaction they will be included in the trace | ||
* `SpanKind.CLIENT` | ||
* Creating a span with `SpanKind.CLIENT` will not start a transaction. If a `CLIENT` span has certain db attributes it will be treated as a DB span, and other specific attributes will cause it to be treated as an external span | ||
* If `SpanKind.CLIENT` spans occur within an already existing New Relic transaction they will be included in the trace | ||
* `SpanKind.SERVER` | ||
* Creating a span with `SpanKind.SERVER` will start a `WebTransaction/Uri/*` transaction. | ||
* If `SpanKind.SERVER` spans occur within an already existing New Relic transaction they will be included in the trace | ||
* `SpanKind.CONSUMER` | ||
* Creating a span with `SpanKind.CONSUMER` will start a `OtherTransaction/*` transaction. | ||
* If `SpanKind.CONSUMER` spans occur within an already existing New Relic transaction they will be included in the trace | ||
* `SpanKind.PRODUCER` | ||
* Creating a span with `SpanKind.PRODUCER` will not start a transaction. There is no explicit processing for `PRODUCER` spans currently. | ||
* If `SpanKind.PRODUCER` spans occur within an already existing New Relic transaction they will be included in the trace (though it's effectively no different from a `SpanKind.INTERNAL` span) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
57 changes: 57 additions & 0 deletions
57
...-extension-autoconfigure-1.28.0/src/main/java/io/opentelemetry/context/ContextHelper.java
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,57 @@ | ||
/* | ||
* | ||
* * Copyright 2024 New Relic Corporation. All rights reserved. | ||
* * SPDX-License-Identifier: Apache-2.0 | ||
* | ||
*/ | ||
|
||
package io.opentelemetry.context; | ||
|
||
import com.newrelic.agent.bridge.AgentBridge; | ||
import com.newrelic.agent.bridge.ExitTracer; | ||
import com.newrelic.agent.bridge.Transaction; | ||
import com.newrelic.api.agent.TracedMethod; | ||
import io.opentelemetry.api.trace.Span; | ||
import io.opentelemetry.sdk.trace.ExitTracerSpan; | ||
|
||
/** | ||
* Helper class for managing the OpenTelemetry Context | ||
*/ | ||
class ContextHelper { | ||
private ContextHelper() { | ||
} | ||
|
||
/** | ||
* If there's no span on the context, but there is a NR tracer on the stack, return a context with our span. | ||
*/ | ||
public static Context current(Context context) { | ||
Span currentSpan = Span.fromContext(context); | ||
if (currentSpan == Span.getInvalid()) { | ||
Transaction transaction = AgentBridge.getAgent().getTransaction(false); | ||
if (transaction != null) { | ||
TracedMethod tracedMethod = transaction.getTracedMethod(); | ||
if (tracedMethod instanceof ExitTracer) { | ||
return context.with(ExitTracerSpan.wrap((ExitTracer) tracedMethod)); | ||
} | ||
} | ||
} | ||
return context; | ||
} | ||
|
||
/** | ||
* If there's currently no NR transaction but the current contains a NR span, create a | ||
* {@link com.newrelic.api.agent.Token} related to that span's transaction and hook it into | ||
* the returned {@link Scope}. | ||
*/ | ||
public static Scope makeCurrent(Context context, Scope scope) { | ||
final Transaction currentTransaction = AgentBridge.getAgent().getTransaction(false); | ||
if (currentTransaction == null) { | ||
Span currentSpan = Span.fromContext(context); | ||
|
||
if (currentSpan instanceof ExitTracerSpan) { | ||
return ((ExitTracerSpan) currentSpan).createScope(scope); | ||
} | ||
} | ||
return scope; | ||
} | ||
} |
26 changes: 26 additions & 0 deletions
26
...-autoconfigure-1.28.0/src/main/java/io/opentelemetry/context/Context_Instrumentation.java
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,26 @@ | ||
/* | ||
* | ||
* * Copyright 2024 New Relic Corporation. All rights reserved. | ||
* * SPDX-License-Identifier: Apache-2.0 | ||
* | ||
*/ | ||
|
||
package io.opentelemetry.context; | ||
|
||
import com.newrelic.api.agent.weaver.MatchType; | ||
import com.newrelic.api.agent.weaver.Weave; | ||
import com.newrelic.api.agent.weaver.Weaver; | ||
|
||
/** | ||
* Weaved to manage the OpenTelemetry Context | ||
*/ | ||
@Weave(type = MatchType.Interface, originalName = "io.opentelemetry.context.Context") | ||
public abstract class Context_Instrumentation { | ||
public static Context current() { | ||
return ContextHelper.current(Weaver.callOriginal()); | ||
} | ||
|
||
public Scope makeCurrent() { | ||
return ContextHelper.makeCurrent((Context) this, Weaver.callOriginal()); | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The
createSegment
API still generates an asynchronous tracer, which is not what we want. And from the bridge there's no easy way to register a signature to get asignatureId
. This was the easiest way to get a normal, synchronous tracer.