[Ops] POC: PR-build on CI-Systems buildkite (cont'd) #171317
Closed
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
WIP prep things to test elastic buildkite system and without secrets Make vars exist but be empty Switch to n1s for now Output pipeline instead of upload Comment out function A few more fixes Bring back the secrets Fix paths Fix path Bring back all the FTR configs Use util Fix dynamic agents n1 -> n2 Fix commented out yaml Add umask debug step Test commit test commit test commit test commit Move to new image family Remove umask step Remove commented out section [CI] Auto-commit changed files from 'node scripts/precommit_hook.js --ref HEAD~1..HEAD --fix' Test new git config Private repo instead Make agents spot instances Update a few missed agent configs
|
buildkite build this |
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
6c2405c to
c4de3bd
Compare
|
buildkite build this |
…ems scaffold runs pipelines from shell files
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
81cca24 to
57623d1
Compare
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
57623d1 to
efd5aa3
Compare
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
9f068b9 to
eda32dc
Compare
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
eda32dc to
b98ecd8
Compare
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
7e78e04 to
24bd3b1
Compare
CoenWarmer
pushed a commit
to CoenWarmer/kibana
that referenced
this pull request
Feb 15, 2024
…ic#174688) ## Summary Creates a CLI script to rewrite buildkite agent targeting rules to the ones we need to use with the Elastic-wide buildkite agents. This version tries to map all fittable fields from https://github.com/elastic/kibana-buildkite/blob/main/agents.json to https://github.com/elastic/ci/blob/0df8430357109a19957dcfb1d867db9cfdd27937/docs/gobld/providers.mdx#L96 Based on: elastic#171317 (demonstrated here: elastic@ca0f455) Part of: elastic/kibana-operations#15
CoenWarmer
pushed a commit
to CoenWarmer/kibana
that referenced
this pull request
Feb 15, 2024
## Summary On the new Buildkite infra, our agents won't have write access to the paths we used to write the deployment information upon deployment. We're allowed to use KV writes if we enable it (https://docs.elastic.dev/ci/using-secrets#using-shared-secrets, enabling PRs below). I've built this in a way that we can enable the feature before the final rollout, and we can clear up the branches once done with the rollout. Cloud deployment works on the old infra as well as the new, tested on this PR and elastic#171317 Enabled by: elastic/ci#2594 & elastic/ci#2553 Part of: elastic/kibana-operations#15 Related: https://elasticco.atlassian.net/browse/ENGPRD-414
delanni
force-pushed
the
buildkite-on-elastic-ci-poc
branch
from
af3cc1a to
24bd3b1
Compare
|
buildkite build this |
💚 Build Succeeded
History
To update your PR or re-run it, just comment with: |
|
This was just a POC, it's done in: #183158 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
This doesn't need to be merged, it's a working POC.
Continued, refreshed work on trying to run crucial build jobs on the CI-systems pipelines.
Continuation of #157220
KME test runs here: https://buildkite.com/elastic/kibana-kme-test
Main issue: https://github.com/elastic/kibana-operations/issues/22
Meta issue: https://github.com/elastic/kibana-operations/issues/15
Remaining problems: