Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add functionality to cater for deployment to databricks #198

Open
JacquesInsight opened this issue Jan 22, 2025 · 0 comments
Open

Add functionality to cater for deployment to databricks #198

JacquesInsight opened this issue Jan 22, 2025 · 0 comments
Assignees

Comments

@JacquesInsight
Copy link
Contributor

A request has been received to alter the framework and add functionality to support deployment to databricks.

The same approach should be taken to generate the notebooks offline and upload the notebooks into a databricks workspace and execute.

Approach

Integrate dbt databricks adapter into the framework
Create a version of the dbt-databricks adapter that includes notebooks templates
Alter the notebooks to be compatible with Databricks
Add databricks as a config option to the wrapper objects to use the databricks versions
Test notebook creation
Test notebook upload
Test notebook execution

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant