Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Create alternative task claimer that performs client-side updates w/ mget to prune stale docs #181325

Closed
3 tasks
mikecote opened this issue Apr 22, 2024 · 1 comment · Fixed by #180485
Closed
3 tasks

Create alternative task claimer that performs client-side updates w/ mget to prune stale docs #181325

mikecote opened this issue Apr 22, 2024 · 1 comment · Fixed by #180485
Assignees
@pmuellr
Labels
Feature:Task Manager Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)

Comments

@mikecote
Copy link
Contributor

Part of #155770

Feature Description

Change the task manager task claiming algorithm to use a _search to retrieve candidate tasks, a _mget to prune the docs whose version number doesn't match, and then a _bulk to claim the tasks. This will increase the background task capacity in Serverless.

Business Value

Increased background task capacity, reducing the COGS for running alerting rules and actions, and providing a lower MTTD/MTTR.

Definition of Done

  • Algorithm is available for testing purposes by setting xpack.task_manager.claim_strategy: mget
  • Unit tests
  • End-to-end jest integration tests
@mikecote mikecote added Feature:Task Manager Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams) labels Apr 22, 2024
@elasticmachine
Copy link
Contributor

Pinging @elastic/response-ops (Team:ResponseOps)

@mikecote mikecote moved this from Awaiting Triage to In Progress in AppEx: ResponseOps - Execution & Connectors Apr 22, 2024
This was referenced Apr 22, 2024
Open
Merged
pmuellr added a commit that referenced this issue Jun 13, 2024
@pmuellr
[ResponseOps] implement task claiming strategy mget (#180485)
f016398 
resolves: #181325

## Summary

Adds a new task claiming strategy `unsafe_mget`, which can be used instead of
the default one `default`. Add the following to your `kibana.yml` to
enable it:

    xpack.task_manager.claim_strategy: 'unsafe_mget'
@mikecote mikecote mentioned this issue Jul 12, 2024
Open
48 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@pmuellr pmuellr

Labels
Feature:Task Manager Team:ResponseOps Label for the ResponseOps team (formerly the Cases and Alerting teams)
Projects
No open projects
AppEx: ResponseOps - Execution & Connectors
Status: In Progress
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[ResponseOps] implement task claiming strategy mget pmuellr/kibana
3 participants
@pmuellr @mikecote @elasticmachine