Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

POC Postgres cache database design #1607

Merged
merged 22 commits into from
Apr 26, 2024
Merged

POC Postgres cache database design #1607

merged 22 commits into from
Apr 26, 2024

Conversation

filipmacek
Copy link
Member

@filipmacek filipmacek commented Apr 23, 2024 •
edited
Loading

Pull Request

  • renamed the feature sql to postgres in the infrastructure crate to closely follow the technology feature naming (like we have redis there)
  • moved get_schema_dir , init_postgres and drop_postgres from cli crate to infrastructure crate
  • removed manual redis install in github actions workflow and added redis and postgres container service there
  • deleted old SqlCacheDatabase that used sqlx Any db driver
  • Implemented a new PostgresCacheDatabase that spawns a new tokio thread and listens for INSERT queries and saved them to database

@filipmacek filipmacek force-pushed the cache-database-psql-poc branch from 3dc18ce to 4191f67 Compare April 23, 2024 14:51
@filipmacek filipmacek requested a review from cjdsellers April 24, 2024 14:44
@filipmacek filipmacek self-assigned this Apr 24, 2024
@filipmacek filipmacek added the rust Relating to the Rust core label Apr 24, 2024
@filipmacek filipmacek force-pushed the cache-database-psql-poc branch 6 times, most recently from 683a031 to ee06525 Compare April 25, 2024 12:25
filipmacek added 20 commits April 25, 2024 19:07
@filipmacek
create build-postgres action that runs on every commit
5efe0e7
@filipmacek
add redis docker service
281e42f
@filipmacek
currency pyo3 cython transformers
de87964
@filipmacek
bootstrap CachePostgresAdapter
3ce212d
@filipmacek
implement currency fromRow
3087ac1
@filipmacek
move postgres database code to infrastructure crate sql module
b0c14d2
@filipmacek
remove old cache file unused
9032f6c
@filipmacek
remove old database file unused
44e6411
@filipmacek
psql cache database all
a7eac2f
@filipmacek
add loging in sql statement execution
ace8ff0
@filipmacek
add postgres service to github action
229d03b
@filipmacek
implement postgres cache e2e tests
7019e93
@filipmacek
fix precommit
3931c8b
@filipmacek
refactor statement exeuction in init-postgres
0773a00
@filipmacek
add nautilus-cli install and init-postgres in github action workflow
f0daa70
@filipmacek
refactor test cache database postgres without init and drop postgres
6614b2c
@filipmacek
fixup! add nautilus-cli install and init-postgres in github action wo…
b10f79a 
…rkflow
@filipmacek
update cli and database opt with schema dir path
b61950f
@filipmacek
refactor nautilus cli install and run for github build action
28c411a
@filipmacek
reset datebase any before tests
1e2ee86
@filipmacek filipmacek force-pushed the cache-database-psql-poc branch from 84a8876 to c748c70 Compare April 25, 2024 17:09
@filipmacek filipmacek marked this pull request as ready for review April 25, 2024 17:09
@cjdsellers cjdsellers merged commit 6513d20 into develop Apr 26, 2024
9 checks passed
@cjdsellers cjdsellers deleted the cache-database-psql-poc branch April 26, 2024 06:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@cjdsellers cjdsellers cjdsellers approved these changes

Assignees

@filipmacek filipmacek

Labels
rust Relating to the Rust core
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@filipmacek @cjdsellers