FIX #582: User Configurable OAuth Scopes in profiles.yml

[stevenayers]

Resolves #582

Description

As @benc-db mentioned here, it could be worth adding user configurable options for oauth apps to profiles.

@benc-db adds oauth_redirect_url to profiles.yml in #638 but we also need to make oauth_scopes user-configurable.

Usage

Given the app connection:

Profile configuration would be:

jaffle_shop:
  outputs:
    test:
      catalog: CATALOG
      host: WORKSPACE_URL
      http_path: /sql/1.0/warehouses/WAREHOUSE_ID
      schema: SCHEMA
      threads: 10
      auth_type: oauth
      oauth_redirect_url: "http://localhost:8050"
      oauth_scopes:
        - sql
        - offline_access
      type: databricks
  target: test

Checklist

• I have run this code in development and it appears to resolve the stated issue
• This PR includes tests, or tests are not required/relevant for this PR
• I have updated the CHANGELOG.md and added information about my change to the "dbt-databricks next" section.

[benc-db]

So, there's an issue that I'm trying to work through with the Databricks SDK folks where the scopes get overridden for Azure which is why I hadn't done this already, but if you can verify this fixes things for your AWS use-case, we can consider merging before that fix is ready.

[benc-db]

Appreciate you updating the readme :)

[stevenayers]

So, there's an issue that I'm trying to work through with the Databricks SDK folks where the scopes get overridden for Azure which is why I hadn't done this already, but if you can verify this fixes things for your AWS use-case, we can consider merging before that fix is ready.

Ah I see. Well, for AWS it seems to be working well with just this fix. I'm pointing our requirements.txt to my fork on github for now, but would be great to have it merged in and released. 🙂

[stevenayers]

Hi @benc-db, will this be released in v1.7.14 or will it come out in 1.8/2.0? 🚀

[benc-db]

Hi @benc-db, will this be released in v1.7.14 or will it come out in 1.8/2.0? 🚀

1.7.14, we just forgot to update the changelog.

[matthewchoy-envisso]

Would be good to add this to the docs!
Eg: https://docs.databricks.com/en/partners/prep/dbt.html