LunaryAI automatic Thread and User tracking #2667
Conversation
|
Great contribution! Is this also supporting the open source variant of lunary? So, if we install lunary locally, can we use your integration in this PR to natively connect to the local variant or only the commercial one? |
|
Hi @BigFoxMedia yes absolutely, this is completely compatible with the open-source version. If you install Lunary locally, you just have to set the correct endpoint to |
| uploads: incomingInput.uploads, | ||
| prependMessages | ||
| }) | ||
| const runParams = { |
There was a problem hiding this comment.
i think the correct placement is here
There was a problem hiding this comment.
Hi @HenryHengZJ are there events for "on user message" and "on assistant response"? Couldn't find it in the callback handlers space, which seems to be more related with Langchain events (as this PR is for tracking the high level user conversation)
There was a problem hiding this comment.
We don't need on user message as we can already have input from the callbacks in AnalyticHandler
For instance, open a thread when onChainStart, and close when onChainEnd. I'd like to keep 3rd party integration on components level and try to reuse the callbacks that are already exposed
|
Closing in favor of #3233 |
Hi!
This PR extends the Lunary integration to automatically report user conversations using the Threads feature (not just the LLM calls), as well as report the user data if lead capture is enabled.
(Lunary is an open-source LLM monitoring toolkit :) ).
This was requested by many of our mutual users.
For example this is a Flowise conversation:
Now visible into Lunary:
Also with full support for tracing each assistant's message:
I extensively tested this (both with and without Lunary enabled) but let me know if something else is required!
Cheers