[Obs AI Assistant] Knowledge base entries are not consistently updated correctly by LLM due to changing identifiers

[sorenlouv]

Steps to reproduce

• Start a new conversation with the prompt: "My favourite color is green. Remember this."
• Close the first conversation and start another with the prompt: "My favourite color is red. Remember this."
• (repeat this multiple times with different colors)

Expected behaviour
The LLM should create a knowledge base entry after the first prompt. Any subsequent requests to store a color should update the existing one so there should only ever be a single knowledge base entry about "favourite color" regardless how many times the user asks the LLM.

Actual behaviour
Instead of updating the first entry the LLM (sometimes) creates new entries. This is because the identifier that the LLM assigns to the entry is not stable. In my testing we do not send the existing knowledge base entry to the LLM because during re-ranking it is filtered out with a score of 0 (see screenshot for details).

[sorenlouv]

Closed by #191043