Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Observability AI Assistant] Test functions in API tests #180787

Open
dgieselaar opened this issue Apr 15, 2024 · 0 comments
Open

[Observability AI Assistant] Test functions in API tests #180787

dgieselaar opened this issue Apr 15, 2024 · 0 comments
Labels
Team:Obs AI Assistant Observability AI Assistant technical debt Improvement of the software architecture and operational architecture

Comments

@dgieselaar
Copy link
Member

We are currently not really testing the functionality of our functions in API tests. We have the evaluation framework, but it doesn't give us YES/NO answers and we can't run it on every PR.

Testing the functionality is not straight-forward, so we should write a helper framework/function that allows us to easily test the functions against real data (e.g. given this input, and this data, I expect this output).
@dgieselaar dgieselaar added Team:Obs AI Assistant Observability AI Assistant technical debt Improvement of the software architecture and operational architecture labels Apr 15, 2024
@dgieselaar dgieselaar changed the title [Observability AI Assistant] Tests functions in API tests [Observability AI Assistant] Test functions in API tests Apr 15, 2024
@emma-raffenne emma-raffenne added this to the 8.15 milestone Apr 17, 2024
@sorenlouv sorenlouv mentioned this issue Jul 3, 2024
Merged
sorenlouv added a commit that referenced this issue Jul 6, 2024
@sorenlouv
[Obs AI Assistant] Add ES function API test (#187465)
4504088 
Related to #180787
kibanamachine pushed a commit to kibanamachine/kibana that referenced this issue Jul 6, 2024
@sorenlouv
[Obs AI Assistant] Add ES function API test (elastic#187465)
1d1502e 
Related to elastic#180787

(cherry picked from commit 4504088)
sorenlouv added a commit to sorenlouv/kibana that referenced this issue Jul 8, 2024
@sorenlouv
[Obs AI Assistant] Add ES function API test (elastic#187465)
a1ac319 
Related to elastic#180787

(cherry picked from commit 4504088)
@emma-raffenne emma-raffenne removed this from the 8.15 milestone Jul 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
Team:Obs AI Assistant Observability AI Assistant technical debt Improvement of the software architecture and operational architecture
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@sorenlouv @dgieselaar @emma-raffenne