Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(FIR-35165): Optional external id for arn auth #130

Merged
merged 16 commits into from
Jul 30, 2024

Conversation

ptiurin
Copy link
Collaborator

@ptiurin ptiurin commented Jul 29, 2024

Description

As per our docs ARN auth's external id is optional. Reflecting this in code.
Also adding a test for arn auth. Passing.

Checklist

  • I have run this code in development and it appears to resolve the stated issue.
  • This PR includes tests, or tests are not required/relevant for this PR.
  • I have run changie new and committed everything in .changes folder
  • I have removed any print or log calls that were added for debugging.
  • I have verified that this PR contains only code changes relevant to this PR.
  • If further integration tests are now passing I've edited tests/functional/adapter/* to account for this.
  • I have pulled/merged from the main branch if there are merge conflicts.
  • After pulling/merging main I have run pytest on the included or updated tests/functional/adapter/.

@ptiurin ptiurin marked this pull request as ready for review July 29, 2024 13:53
@ptiurin ptiurin requested a review from a team as a code owner July 29, 2024 13:53
Copy link

Copy link
Collaborator

@stepansergeevitch stepansergeevitch left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, one comment

if [[ -n "$AWS_ACCESS_ROLE_ARN" ]]; then
# Can't test this on FB 1.0
cp ../dbt-firebolt/.github/workflows/jaffle_shop/sources_external_tables_iam.yml models/staging/sources_external_tables.yml
dbt run-operation stage_external_sources --vars "ext_full_refresh: true"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already run this operation before this if block. Can we just execute it once after the if block?

Copy link
Collaborator Author

@ptiurin ptiurin Jul 30, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's intentional - we're changing the table configuration by doing cp into sources_external_tables.yml. First time we're testing no auth, then auth with id and secret and finally (conditional, on fb2.0) IAM role auth. Each one of them to trigger needs dbt run-operation

@ptiurin ptiurin changed the title feat: Optional external id for arn auth feat(FIR-35165): Optional external id for arn auth Jul 30, 2024
@ptiurin ptiurin merged commit 6afdbd1 into main Jul 30, 2024
7 checks passed
@ptiurin ptiurin deleted the ci-test-iam-external-tables branch July 30, 2024 16:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants