Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/slos/fetch_historical_summary·ts - SLO API Tests fetch historical summary computes the historical summary for a rolling occurrences SLO #183750

Closed
Tracked by #190068
kibanamachine opened this issue May 17, 2024 · 32 comments
Closed
Tracked by #190068

Failing test: X-Pack API Integration Tests.x-pack/test/api_integration/apis/slos/fetch_historical_summary·ts - SLO API Tests fetch historical summary computes the historical summary for a rolling occurrences SLO #183750

kibanamachine opened this issue May 17, 2024 · 32 comments
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:obs-ux-management Observability Management User Experience Team

Comments

@kibanamachine
Copy link
Contributor

kibanamachine commented May 17, 2024 •
edited
Loading

A test failed on a tracked branch

Error: expected [ { date: '2024-05-10T00:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T01:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T02:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T03:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T04:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T05:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T06:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T07:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T08:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T09:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T10:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T11:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T12:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T13:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T14:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T15:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T16:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T17:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T18:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T19:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T20:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T21:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T22:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-10T23:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T00:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T01:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T02:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T03:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T04:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T05:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T06:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T07:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T08:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T09:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T10:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T11:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T12:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T13:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T14:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T15:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T16:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T17:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sliValue: 0.9,
    status: 'HEALTHY' },
  { date: '2024-05-11T18:00:00.000Z',
    errorBudget: 
     { initial: 0.1,
       consumed: 1,
       remaining: 0,
       isEstimated: false },
    sli
[report_failure] output truncated to 8192 characters

First failure: kibana-on-merge - main
@kibanamachine kibanamachine added the failed-test A test failure on a tracked branch, potentially flaky-test label May 17, 2024
@botelastic botelastic bot added the needs-team Issues missing a team label label May 17, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@delanni
Copy link
Contributor

delanni commented May 17, 2024

/skip

@kibanamachine
Copy link
Contributor Author

Skipped

main: 8f9c4ab

kibanamachine added a commit that referenced this issue May 17, 2024
@kibanamachine
skip failing test suite (#183750)
8f9c4ab
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@wayneseymour wayneseymour added the Team:obs-ux-management Observability Management User Experience Team label May 17, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/obs-ux-management-team (Team:obs-ux-management)

@botelastic botelastic bot removed the needs-team Issues missing a team label label May 17, 2024
@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@kibanamachine
Copy link
Contributor Author

New failure: kibana-on-merge - main

@jasonrhodes jasonrhodes mentioned this issue Aug 7, 2024
Open
@kdelemme
Copy link
Contributor

kdelemme commented Oct 8, 2024

@jasonrhodes I'm in favour of removing this integration test since the API output is difficult to predict.

@jasonrhodes
Copy link
Member

jasonrhodes commented Oct 8, 2024 •
edited
Loading

@jasonrhodes I'm in favour of removing this integration test since the API output is difficult to predict.

Fine by me. Are we testing this functionality in any other way, or is it just not possible to test this reliably at all, in your opinion?

@kdelemme
Copy link
Contributor

kdelemme commented Oct 8, 2024

We have some unit tests heavily relying on mocks

@kdelemme
Copy link
Contributor

This test will be removed when we move to the agnostic framework

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
failed-test A test failure on a tracked branch, potentially flaky-test Team:obs-ux-management Observability Management User Experience Team
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@jasonrhodes @kdelemme @delanni @wayneseymour @elasticmachine @kibanamachine