Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix bats based MS Graph acceptance test #85

Merged
merged 6 commits into from
Feb 24, 2022

Conversation

benashz
Copy link
Contributor

@benashz benashz commented Nov 25, 2021

The permissions for the MS Graph tests were incomplete, unfortunately
the issue was not caught by the bats test. Essentially doing a local
variable assignment from a sub-shell's stdout does not result in the
test failing when the sub-shell exits with a non-zero status

Summary of fixes:

  • bats: add support testing Azure data plane roles
  • terraform: ensure that 'MS Graph' test has all required permissions for
    the plugin to generate secrets
  • terraform: wait for grant assignment after admin-consent
  • bats: factor out common code to common.sh
  • bats: ensure that all variable assignment from sub-shell values fail the
    test in the case that the sub-shell process exits with a non-zero
    status
  • bats: add better test logging
  • bats: add support for specifying a custom log file
  • build: optionally build the plugin for the target vault docker image
    os/arch
  • build: extend to better support bats acceptance test from make

The permissions for the MS Graph tests were incomplete, unfortunately
the issue was not caught by the bats test. Essentially doing a local
variable assignment from a sub-shell's stdout does not result in the
test failing when the sub-shell exits with a non-zero status

Summary of fixes:
- bats: add support testing Azure data plane roles
- terraform: ensure that 'MS Graph' test has all required permissions for
  the plugin to generate secrets
- terraform: wait for grant assignment after `admin-consent`
- bats: factor out common code to `common.sh`
- bats: ensure that all variable assignment from sub-shell values fail the
  test in the case that the sub-shell process exits with a non-zero
  status
- bats: add better test logging
- bats: add support for specifying a custom log file
- build: optionally build the plugin for the target vault docker image
  os/arch
- build: extend to better support bats acceptance test from make
@benashz benashz requested review from tomhjp and tvoran December 6, 2021 21:51
Makefile Show resolved Hide resolved
tests/acceptance/common.sh Outdated Show resolved Hide resolved
@benashz benashz requested a review from tvoran February 4, 2022 22:08
Copy link
Member

@tvoran tvoran left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left a few questions, but nothing blocking as far as I'm concerned.

tests/acceptance/basic.bats Show resolved Hide resolved
tests/acceptance/common.sh Outdated Show resolved Hide resolved
tests/acceptance/common.sh Outdated Show resolved Hide resolved
@benashz benashz merged commit 2ab6ddc into master Feb 24, 2022
@benashz benashz deleted the VAULT-4348/fix-acceptance-tests branch February 24, 2022 15:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants