Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Observability AI Assistant] Boost user prompts in recall #180995

Closed
dgieselaar opened this issue Apr 17, 2024 · 0 comments · Fixed by #184933
Closed

[Observability AI Assistant] Boost user prompts in recall #180995

dgieselaar opened this issue Apr 17, 2024 · 0 comments · Fixed by #184933
Assignees
Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant Observability AI Assistant
Milestone

Comments

@dgieselaar
Copy link
Member

We've had reports of where the screen description pollutes results from the knowledge base, resulting in too much noise. We send over both the user prompt and the screen description, we should boost the user prompt to make sure it contributes more to scoring, in order to get more relevant results. Something like x3 would be a good starting point to evaluate.

@dgieselaar dgieselaar added the Team:Obs AI Assistant Observability AI Assistant label Apr 17, 2024
@emma-raffenne emma-raffenne added this to the 8.14 milestone Apr 23, 2024
@emma-raffenne emma-raffenne added the bug Fixes for quality problems that affect the customer experience label Apr 23, 2024
@emma-raffenne emma-raffenne modified the milestones: 8.14, 8.15 May 31, 2024
@sorenlouv sorenlouv self-assigned this Jun 4, 2024
sorenlouv added a commit that referenced this issue Jun 8, 2024
eokoneyo pushed a commit to eokoneyo/kibana that referenced this issue Jun 13, 2024
sorenlouv added a commit to sorenlouv/kibana that referenced this issue Jul 1, 2024
Closes: elastic#180995

---------

Co-authored-by: Dario Gieselaar <[email protected]>
(cherry picked from commit baa22bb)

# Conflicts:
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/get_context_function_request_if_needed.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/index.test.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant/server/service/client/index.ts
#	x-pack/plugins/observability_solution/observability_ai_assistant_app/public/components/chat/chat_body.test.tsx
sorenlouv referenced this issue Jul 2, 2024
)

# Backport

This will backport the following commits from `main` to `8.14`:
- [[Obs AI Assistant] Boost user prompt in recall
(#184933)](#184933)

<!--- Backport version: 9.5.1 -->

### Questions ?
Please refer to the [Backport tool
documentation](https://github.com/sorenlouv/backport)

<!--BACKPORT [{"author":{"name":"Søren
Louv-Jansen","email":"[email protected]"},"sourceCommit":{"committedDate":"2024-06-08T20:32:49Z","message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<[email protected]>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746","branchLabelMapping":{"^v8.15.0$":"main","^v(\\d+).(\\d+).\\d+$":"$1.$2"}},"sourcePullRequest":{"labels":["release_note:skip","auto-backport","Team:Obs
AI
Assistant","ci:project-deploy-observability","v8.15.0","v8.14.2"],"title":"[Obs
AI Assistant] Boost user prompt in
recall","number":184933,"url":"https://github.com/elastic/kibana/pull/184933","mergeCommit":{"message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<[email protected]>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746"}},"sourceBranch":"main","suggestedTargetBranches":["8.14"],"targetPullRequestStates":[{"branch":"main","label":"v8.15.0","branchLabelMappingKey":"^v8.15.0$","isSourceBranch":true,"state":"MERGED","url":"https://github.com/elastic/kibana/pull/184933","number":184933,"mergeCommit":{"message":"[Obs
AI Assistant] Boost user prompt in recall (#184933)\n\nCloses:
https://github.com/elastic/kibana/issues/180995\r\n\r\n---------\r\n\r\nCo-authored-by:
Dario Gieselaar
<[email protected]>","sha":"baa22bb16a179f7c5f13caf06afca315f62d0746"}},{"branch":"8.14","label":"v8.14.2","branchLabelMappingKey":"^v(\\d+).(\\d+).\\d+$","isSourceBranch":false,"state":"NOT_CREATED"}]}]
BACKPORT-->
sorenlouv added a commit to sorenlouv/kibana that referenced this issue Dec 10, 2024
Closes: elastic#180995

---------

Co-authored-by: Dario Gieselaar <[email protected]>
(cherry picked from commit baa22bb)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Team:Obs AI Assistant Observability AI Assistant
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants