Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix visual baseline job #59348

Merged
merged 6 commits into from
Mar 5, 2020
Merged

Conversation

spalger
Copy link
Contributor

@spalger spalger commented Mar 4, 2020

I implemented the visual baseline job in #52154 but it doesn't work (intended) and now that the Jenkins related changes are complete I'm working on getting the job functional.

This updates the .ci/Jenkinsfile_visual_baseline file to run the test/scripts/jenkins_visual_regression.sh and test/scripts/jenkins_xpack_visual_regression.sh scripts, which both build Kibana and run the visual regression suites.

The primary goal with this PR is to start running the visual baseline job regularly so we can measure stability in the baseline and then move forward with further optimizations and changes necessary to start using this baseline in testing.

@spalger spalger force-pushed the fix/visual-baseline-job branch from 1cf8669 to 24f88a0 Compare March 4, 2020 20:18
@spalger spalger force-pushed the fix/visual-baseline-job branch from cd5d943 to d20a8b0 Compare March 5, 2020 05:03
@spalger
Copy link
Contributor Author

spalger commented Mar 5, 2020

On d20a8b0 you can see the status of running the .ci/Jenkinsfile_visual_baseline as the primary Jenkinsfile, before I moved it back into its spot.

@spalger
Copy link
Contributor Author

spalger commented Mar 5, 2020

@elasticmachine merge upstream

@spalger spalger marked this pull request as ready for review March 5, 2020 17:35
@spalger spalger added release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.7.0 v8.0.0 labels Mar 5, 2020
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-operations (Team:Operations)

@spalger spalger requested a review from brianseeders March 5, 2020 17:36
source "$KIBANA_DIR/src/dev/ci_setup/setup_percy.sh"

checks-reporter-with-killswitch "Kibana visual regression tests" \
yarn run percy exec -t 500 \
echo " -> building and extracting OSS Kibana distributable for use in functional tests"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'll plan to take a pass over these shell scripts to clean them up at some point, so that this doesn't need to be duplicated

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

@spalger spalger merged commit 4bc9e8b into elastic:master Mar 5, 2020
spalger pushed a commit to spalger/kibana that referenced this pull request Mar 5, 2020
* Establish Percy baselines

* move Jenkinsfile changed back to `.ci` directory

* rename xpack workers

Co-authored-by: Elastic Machine <[email protected]>
spalger pushed a commit to spalger/kibana that referenced this pull request Mar 5, 2020
* Establish Percy baselines

* move Jenkinsfile changed back to `.ci` directory

* rename xpack workers

Co-authored-by: Elastic Machine <[email protected]>
@spalger spalger removed the v6.8.8 label Mar 5, 2020
spalger pushed a commit that referenced this pull request Mar 6, 2020
* Establish Percy baselines

* move Jenkinsfile changed back to `.ci` directory

* rename xpack workers

Co-authored-by: Elastic Machine <[email protected]>

Co-authored-by: Elastic Machine <[email protected]>
@spalger
Copy link
Contributor Author

spalger commented Mar 6, 2020

7.7/7.x: 5cfc73d
7.6: 692e2a5

jloleysens added a commit to jloleysens/kibana that referenced this pull request Mar 6, 2020
…x-closed-index

* 'master' of github.com:elastic/kibana: (32 commits)
  [ML] Use Kibana's HttpHandler for HTTP requests (elastic#59320)
  [APM] Create settings page to manage Custom Links (elastic#57788)
  [Upgrade Assistant] Server-side batch reindexing (elastic#58598)
  completes navigation test (elastic#59141)
  [SIEM] Fixes dragging entries to the Timeline while data is loading may trigger a partial page reload (elastic#59476)
  [Reporting/Screenshots] Handle page setup errors and capture the page, don't fail the job (elastic#58683)
  [SIEM] [CASES] API with io-ts validation (elastic#59265)
  Use camelCase rather than snakeCase for plugin name (elastic#59461)
  [Maps] top term percentage field property (elastic#59386)
  Add custom action to registry and show actions list in siem (elastic#58395)
  [Search service] Add enhanced ES search strategy (elastic#59224)
  [Logs UI] Speed up stream rendering using memoization (elastic#59163)
  expand max-old-space-size for xpack jest tests (elastic#59455)
  Added possibility to embed connectors create and edit flyouts (elastic#58514)
  Revert "Temporarily disabling PR project mappings (elastic#59485)" (elastic#59491)
  Temporarily disabling PR project mappings (elastic#59485)
  [Endpoint] Fix alert list functional test error (elastic#59357)
  Rename status_page to statusPage (elastic#59186)
  Fix visual baseline job (elastic#59348)
  Extended AlertContextValue with metadata optional property (elastic#59391)
  ...

# Conflicts:
#	x-pack/plugins/upgrade_assistant/common/types.ts
#	x-pack/plugins/upgrade_assistant/server/lib/reindexing/reindex_actions.ts
#	x-pack/plugins/upgrade_assistant/server/lib/reindexing/reindex_service.test.ts
#	x-pack/plugins/upgrade_assistant/server/lib/reindexing/reindex_service.ts
#	x-pack/plugins/upgrade_assistant/server/routes/reindex_indices/reindex_indices.test.ts
#	x-pack/plugins/upgrade_assistant/server/routes/reindex_indices/reindex_indices.ts
spalger pushed a commit that referenced this pull request Mar 6, 2020
* Establish Percy baselines

* move Jenkinsfile changed back to `.ci` directory

* rename xpack workers

Co-authored-by: Elastic Machine <[email protected]>

Co-authored-by: Elastic Machine <[email protected]>
@spalger spalger deleted the fix/visual-baseline-job branch March 6, 2020 15:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release_note:skip Skip the PR/issue when compiling release notes Team:Operations Team label for Operations Team v7.6.0 v7.7.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants