Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Plugin] SQLAlchemy based plugin for querying from RDBMS #749

Closed
1 of 5 tasks
kumare3 opened this issue Feb 20, 2021 · 3 comments
Closed
1 of 5 tasks

[Plugin] SQLAlchemy based plugin for querying from RDBMS #749

kumare3 opened this issue Feb 20, 2021 · 3 comments
Labels
flytekit FlyteKit Python related issue plugins Plugins related labels (backend or frontend)
Milestone
0.13.0

Comments

@kumare3
Copy link
Contributor

kumare3 commented Feb 20, 2021

Why would this plugin be helpful to the Flyte community
It is often that data resides in Relational databases and Flyte should be able to connect to SQL databases and retrieve data for processing it.

Python flytekit already has a plugin for SQLite3. This can be easily extended / replicated for SQLAlchemy supported databases like postgres, mysql, oracle, MS-sql etc. This would make it extremely easy for many users to access data into a pandas data-frame using Flyte - just by providing a query.

Type of Plugin

  • Python interface only plugin
  • Web Service (e.g. AWS Sagemaker, GCP DataFlow, Qubole etc...)
  • Kubernetes Operator (e.g. TfOperator, SparkOperator, FlinkK8sOperator, etc...)
  • Customized Plugin using native kubernetes constructs
  • Other
@kumare3 kumare3 added untriaged This issues has not yet been looked at by the Maintainers flytekit FlyteKit Python related issue plugins Plugins related labels (backend or frontend) good first issue Good for newcomers and removed untriaged This issues has not yet been looked at by the Maintainers labels Feb 20, 2021
@yindia yindia assigned yindia and unassigned yindia Feb 21, 2021
@fediazgon
Copy link

I think this one is fixed by flyteorg/flytekit@d77a773

@kumare3 kumare3 removed the good first issue Good for newcomers label May 5, 2021
@kumare3
Copy link
Contributor Author

kumare3 commented May 5, 2021

@fediazgon you are right - @max-hoffman

@kumare3
Copy link
Contributor Author

kumare3 commented May 5, 2021

I cannot assign to Max hoffman till he gets added to as a contributor. Invite is on its way.

@kumare3 kumare3 closed this as completed May 5, 2021
@kumare3 kumare3 added this to the 0.13.0 milestone May 5, 2021
eapolinario pushed a commit to eapolinario/flyte that referenced this issue Dec 20, 2022
@SmritiSatyanV
Add pre commit description (flyteorg#749)
e7f4120 
* Resolving pre-commit-hook changes

* Resolving pre-commit-hook changes

* Resolving pre-commit-hook changes

* updated makefile

Signed-off-by: SmritiSatyanV <[email protected]>

* Updated makefile

Added spellcheck
Signed-off-by: SmritiSatyanV <[email protected]>

* spellcheck

Signed-off-by: SmritiSatyanV <[email protected]>

* Updated contribute.rst

Updated broken link
Added description of pre-commit hooks to contribution page
Signed-off-by: SmritiSatyanV <[email protected]>

* Changes based on comments

Signed-off-by: SmritiSatyanV <[email protected]>

* updated contribute.rst

Signed-off-by: SmritiSatyanV <[email protected]>
@Future-Outlier Future-Outlier mentioned this issue Mar 8, 2024
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
flytekit FlyteKit Python related issue plugins Plugins related labels (backend or frontend)
Projects
None yet
Milestone
0.13.0
Development

No branches or pull requests
3 participants
@yindia @fediazgon @kumare3