Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Calculate flaky tests from reruns #2121

Merged
merged 6 commits into from
Aug 20, 2021
Merged

feat: Calculate flaky tests from reruns #2121

merged 6 commits into from
Aug 20, 2021

Conversation

jan-goral
Copy link
Contributor

@jan-goral jan-goral commented Aug 5, 2021 •
edited
Loading

Fixes #2083

README.md

New execution graph:

TestAndroid.execute

Test Plan

How do we know the code works?

From repository root, build flank:

. .env
flankScripts assemble flank -d

Run tests:

flank corellium test android run -c="./test_configs/flank-corellium-many.yml"
  • The execution should finish without errors.
  • According to configuration file flank-corellium-many.yml additional JUnitReport files should be generated:
    • JUnitReport_failures.xml - failed and flaky tests.
    • JUnitReport_passed.xml - passed tests.
    • JUnitReport_passed.xml - skipped tests.

Checklist

  • Documented
  • Unit tested
  • Integration tests updated

@jan-goral jan-goral force-pushed the 2083_Calculate_flaky_tests_from_reruns branch 2 times, most recently from 43d3303 to de9b650 Compare August 5, 2021 11:13
@github-actions
Copy link
Contributor

github-actions bot commented Aug 5, 2021 •
edited
Loading

Timestamp: 2021-08-20 20:15:42
Buildscan url for ubuntu-workflow run 1151926615
https://gradle.com/s/2dkxpvgofqaz6

@jan-goral jan-goral marked this pull request as ready for review August 5, 2021 14:33
@jan-goral jan-goral changed the title 2083 calculate flaky tests from reruns feat: Calculate flaky tests from reruns Aug 6, 2021
@bootstraponline bootstraponline force-pushed the 2083_Calculate_flaky_tests_from_reruns branch 9 times, most recently from 198b796 to b163ffe Compare August 13, 2021 13:55
@bootstraponline bootstraponline force-pushed the 2083_Calculate_flaky_tests_from_reruns branch from b163ffe to 7f12927 Compare August 16, 2021 11:27
@pawelpasterz pawelpasterz enabled auto-merge (squash) August 16, 2021 11:41
@bootstraponline bootstraponline force-pushed the 2083_Calculate_flaky_tests_from_reruns branch from 7f12927 to 0a6edc1 Compare August 16, 2021 12:20
@bootstraponline bootstraponline force-pushed the 2083_Calculate_flaky_tests_from_reruns branch from 0a6edc1 to f7478e3 Compare August 17, 2021 15:35
@pawelpasterz pawelpasterz merged commit f4c5b0d into master Aug 20, 2021
@pawelpasterz pawelpasterz deleted the 2083_Calculate_flaky_tests_from_reruns branch August 20, 2021 20:17
@github-actions github-actions bot locked and limited conversation to collaborators Aug 20, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@pawelpasterz pawelpasterz pawelpasterz approved these changes

@Sloox Sloox Sloox approved these changes

@adamfilipow92 adamfilipow92 Awaiting requested review from adamfilipow92

@zuziaka zuziaka Awaiting requested review from zuziaka

@piotradamczyk5 piotradamczyk5 Awaiting requested review from piotradamczyk5

Assignees

@jan-goral jan-goral

Labels
Corellium Feature
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Flaky test detection
4 participants
@jan-goral @Sloox @pawelpasterz @piotradamczyk5