Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Vcr ignore tests #3486

Merged
merged 9 commits into from
May 14, 2020
Merged

Conversation

slevenick
Copy link
Contributor

@slevenick slevenick commented May 8, 2020

Add support for ignoring tests during VCR test runs. Fix more tests

Move writing new seeds to the end of a test process alongside writing the cassette yaml. This prevents the seed and yaml from getting out of sync if a test fails during RECORDING mode.

~20 tests failing at this point

Release Note Template for Downstream PRs (will be copied)

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 22 files changed, 65 insertions(+), 21 deletions(-))
Terraform Beta: Diff ( 26 files changed, 69 insertions(+), 29 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 22 files changed, 66 insertions(+), 21 deletions(-))
Terraform Beta: Diff ( 26 files changed, 70 insertions(+), 29 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

1 similar comment
@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 22 files changed, 66 insertions(+), 21 deletions(-))
Terraform Beta: Diff ( 26 files changed, 70 insertions(+), 29 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 31 files changed, 81 insertions(+), 21 deletions(-))
Terraform Beta: Diff ( 34 files changed, 85 insertions(+), 29 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 30 files changed, 80 insertions(+), 21 deletions(-))
Terraform Beta: Diff ( 34 files changed, 84 insertions(+), 29 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 34 files changed, 123 insertions(+), 39 deletions(-))
Terraform Beta: Diff ( 38 files changed, 127 insertions(+), 47 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@slevenick slevenick requested a review from danawillow May 12, 2020 16:38
@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 34 files changed, 153 insertions(+), 39 deletions(-))
Terraform Beta: Diff ( 38 files changed, 157 insertions(+), 47 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@slevenick slevenick requested a review from danawillow May 13, 2020 18:23
@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 34 files changed, 153 insertions(+), 39 deletions(-))
Terraform Beta: Diff ( 38 files changed, 157 insertions(+), 47 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@modular-magician
Copy link
Collaborator

Hi! I'm the modular magician. Your PR generated some diffs in downstreams - here they are.

Diff report:

Terraform GA: Diff ( 34 files changed, 153 insertions(+), 39 deletions(-))
Terraform Beta: Diff ( 38 files changed, 157 insertions(+), 47 deletions(-))
TF Conversion: Diff ( 1 file changed, 7 insertions(+), 2 deletions(-))

@slevenick slevenick merged commit 269619f into GoogleCloudPlatform:master May 14, 2020
nathkn pushed a commit to nathkn/magic-modules that referenced this pull request May 18, 2020
* Missed acctest.Randoms, add support for skipIfVcr

* Add skip_vcr to tests, more fixes for failing vcr tests

* Fix compile

* Comment on why / path replace is needed

* Rubocop line length

* Ignores for instance template tests with generated ids, multiple fine-grained resources in single step

* Add more ignores, rework VCR file writing to only write when test succeeds

* Add notes on why specific tests fail VCR

* Spaces...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants