Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix #685 - [Do Not Merge] - DuckDB - E2E Integration #734

Closed
wants to merge 36 commits into from
Closed

Conversation

kdetry
Copy link
Contributor

@kdetry kdetry commented Mar 4, 2024

Fixes #685

Changes included in this PR:

[Process 1 - Ingestion + Load]

@kdetry kdetry requested a review from idiom-bytes March 4, 2024 17:55
@idiom-bytes idiom-bytes changed the title #685 - DuckDB E2E RawDB #685 - DuckDB - E2E Integration Mar 4, 2024
kdetry and others added 2 commits March 4, 2024 17:51
* issue650 renaming

* issue650 - test fixes

* issue650 black format

* issue650: fixes after merges

* black fix

* take-back the gql_data_factory from the main branch

* Removed print statements

---------

Co-authored-by: idiom-bytes <[email protected]>
@idiom-bytes idiom-bytes changed the title #685 - DuckDB - E2E Integration Fix #685 - [Do Not Merge] - DuckDB - E2E Integration Mar 5, 2024
@idiom-bytes
Copy link
Member

idiom-bytes commented Mar 5, 2024

PR Feedback

The following are updates designed to clean the code. I'm writing them now so we can improve as we go, and to avoid these further. Do not do these now. Let's create tickets and complete these as we move forward.

Data Store Objects:

  • Please use sql/db nomenclature for function names. Rename fill operations -> insert operations... if it's supposed to override, then update.

Other Cleanup:

  • From #681 Update ohlcv to separate CSVDataStore logic from ccxt fetch, cleanup, and other logic

@idiom-bytes idiom-bytes closed this Mar 6, 2024
@idiom-bytes idiom-bytes deleted the issue685 branch March 6, 2024 19:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Lake][ETL] DuckDB E2E - Ingestion -> Dashboards
2 participants