Skip to content

Commit

Permalink
Updated roadmap (#499)
Browse files Browse the repository at this point in the history
  • Loading branch information
jverre authored Oct 29, 2024
1 parent 209f729 commit 2e5aadf
Show file tree
Hide file tree
Showing 2 changed files with 29 additions and 11 deletions.
4 changes: 2 additions & 2 deletions apps/opik-documentation/documentation/docs/quickstart.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -116,7 +116,7 @@ as described in the [Traces / Logging Additional Data section](/tracing/log_trac
### Logging chains

It is common for LLM applications to use chains rather than just calling the LLM once. This is achieved by either using a framework
like [LangChain](/tracing/integrations/langchain.md), [LangGraph](/tracing/integrations/langgraph.md) or [LLamaIndex](/tracing/integrations/llamaindex.md),
like [LangChain](/tracing/integrations/langchain.md), [LangGraph](/tracing/integrations/langgraph.md) or [LLamaIndex](/tracing/integrations/llama_index.md),
or by writing custom python code.

Opik makes it easy for your to log your chains no matter how you implement them:
Expand Down Expand Up @@ -217,7 +217,7 @@ set_global_handler("opik")
opik_callback_handler = global_handler
```

You LlamaIndex calls from that point forward will be logged to Opik. You can learn more about the LlamaIndex integration in the [LLamaIndex integration docs](/tracing/integrations/llamaindex.md).
You LlamaIndex calls from that point forward will be logged to Opik. You can learn more about the LlamaIndex integration in the [LLamaIndex integration docs](/tracing/integrations/llama_index.md).
</TabItem>

</Tabs>
Expand Down
36 changes: 27 additions & 9 deletions apps/opik-documentation/documentation/docs/roadmap.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,23 +13,41 @@ If you have any ideas or suggestions for the roadmap, you can create a [new disc

:::

## What are we currently working on ?

We are currently working on both improving existing features and developing new features:

- **Tracing**:
- [ ] Allow users to sort the project table
- [ ] Integration with AWS Bedrock
- **Evaluation**:
- [ ] Add dashboard for analyzing experiment results
- **New features**:
- [ ] Introduce a prompt library:
- [ ] Add ability to store prompt templates in Opik
- [ ] Add ability to version prompt templates in Opik
- [ ] Add ability to link prompt versions to logged traces and experiments
- [ ] Introduce monitoring dashboard for Trace projects
- [ ] Add average metrics for feedback scores in the traces page
- [ ] Add dashboard with key metrics tracked over time

You can view all the features we have released in our [changelog](/changelog.md).
## What is planned next ?

We are currently working on both improvements to the existing features in Opik as well as new features:

- **Tracing**:
- [ ] Add online evaluations for logged traces
- [ ] Release Gemini, Groq and Bedrock integrations
- [ ] Integration with Anthropic Python SDK
- [ ] Integration with AWS SageMaker
- [ ] Introduce a "Pretty" format mode for trace inputs and outputs
- [ ] Improved display of chat conversations
- **Evaluation**:
- [ ] Introduce new task agnostic LLM as a judge evaluation metric
- [ ] Add dashboard for analyzing experiment results
- [ ] Dataset versioning
- **Prompt versioning**:
- [ ] Add ability to store prompt templates in Opik
- [ ] Add ability to version prompt templates in Opik
- [ ] Add ability to link prompt versions to logged traces and experiments
- **Playground**:
- [ ] Introduce playground in Opik UI
- [ ] Log LLM calls from the playground to the traces table
- **Online scoring**:
- [ ] Add the ability for Opik to score traces logged to the platform


You can vote on these items as well as suggest new ideas on our [Ideas discussion board](https://github.com/comet-ml/opik/discussions/categories/ideas).
Expand All @@ -39,4 +57,4 @@ You can vote on these items as well as suggest new ideas on our [Ideas discussio
We are relying on your feedback to shape the roadmap and decided which features to work on next. You can upvote existing ideas or even
add your own on [Github Discussions](https://github.com/comet-ml/opik/discussions).

You can also find a list of all the features we have released in our [weekly release notes](/releases).
You can also find a list of all the features we have released in our [weekly release notes](/changelog.md).

0 comments on commit 2e5aadf

Please sign in to comment.