Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Buildkite] ES Snapshots Pipeline #97130

Closed
11 tasks done
brianseeders opened this issue Apr 14, 2021 · 1 comment
Closed
11 tasks done

[Buildkite] ES Snapshots Pipeline #97130

brianseeders opened this issue Apr 14, 2021 · 1 comment
Assignees
Labels
Feature:Buildkite Feature:CI Continuous integration Team:Operations Team label for Operations Team

Comments

@brianseeders
Copy link
Contributor

brianseeders commented Apr 14, 2021

ES Snapshots Pipeline

Create a pipeline for creating, testing, and promoting ES snapshots, based on the TeamCity implementation (since it's mostly node and easily portable).

The testing pipeline required for ES snapshots is essentially a subset of that required for tracked branches / PRs, so it's a good candidate to do first.

  • ci.kibana.dev dashboard support for Buildkite or remove "Latest Verification" link for time being
  • Build snapshot job
  • Verify snapshot job
  • Promote snapshot job
  • Try c2-16 for ES build and see if it roughly doubles the speed
    • It doesn't
  • Use depends_on for verify->promote trigger, so that post-build can always run
  • Promote job is blocking asking for ES_SNAPSHOT_MANIFEST
  • Add Input/Block step to Verify job for manual triggers
  • Retries
  • Migrate to current production bucket instead of ci-artifacts.kibana.dev test buckets
  • Turn on daily schedule
@brianseeders brianseeders added Feature:Buildkite Feature:CI Continuous integration Team:Operations Team label for Operations Team labels Apr 14, 2021
@brianseeders brianseeders self-assigned this Apr 14, 2021
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature:Buildkite Feature:CI Continuous integration Team:Operations Team label for Operations Team
Projects
None yet
Development

No branches or pull requests

3 participants