Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] Implement data cache by using Alluxio's paging store #16375

Closed
wants to merge 5 commits into from

Conversation

beinan
Copy link
Member

@beinan beinan commented Mar 5, 2023

Description

Additional context and related issues

Release notes

( ) This is not user-visible or docs only and no release notes are required.
( ) Release notes are required, please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Mar 5, 2023
@github-actions github-actions bot added hive Hive connector hudi Hudi connector iceberg Iceberg connector jdbc Relates to Trino JDBC driver tests:hive labels Mar 5, 2023
@beinan beinan force-pushed the alluxio_local_cache branch 2 times, most recently from c47f844 to 13b044d Compare April 10, 2023 05:18
@cla-bot
Copy link

cla-bot bot commented Apr 27, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to [email protected]. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@cla-bot cla-bot bot removed the cla-signed label Apr 27, 2023
@beinan beinan force-pushed the alluxio_local_cache branch from d032cf8 to e85d2c1 Compare May 5, 2023 03:07
@cla-bot
Copy link

cla-bot bot commented May 5, 2023

Thank you for your pull request and welcome to the Trino community. We require contributors to sign our Contributor License Agreement, and we don't seem to have you on file. Continue to work with us on the review and improvements in this PR, and submit the signed CLA to [email protected]. Photos, scans, or digitally-signed PDF files are all suitable. Processing may take a few days. The CLA needs to be on file before we merge your changes. For more information, see https://github.com/trinodb/cla

@cla-bot cla-bot bot added the cla-signed label May 18, 2023
@beinan beinan changed the title [WIP] Implement local cache by using Alluxio's paging cache [WIP] Implement data cache by using Alluxio's paging store Jun 6, 2023
@amoghmargoor
Copy link
Member

@beinan is this only for HDFS file system and not for S3 ?

@rwilliams-r7
Copy link

rwilliams-r7 commented Aug 1, 2023

Is this merging into trino? Just based on https://www.alluxio.io/blog/trino-optimization-with-distributed-caching-on-data-lakes-trino-fest-2023-session-recap/ -> seems like it was going to be merged soon. @beinan do you have an update?

@beinan
Copy link
Member Author

beinan commented Aug 1, 2023

Is this merging into trino? Just based on https://www.alluxio.io/blog/trino-optimization-with-distributed-caching-on-data-lakes-trino-fest-2023-session-recap/ -> seems like it was going to be merged soon. @beinan do you have an update?

Apologies for the delay. I am still working on this PR, but several urgent tasks have arisen recently, taking up my time.

@cdowey-r7
Copy link

Hey @beinan do you have any idea when you might get time to complete/merge this? We'd love to try it out when it's ready.

@vasuLicious
Copy link

Hey @beinan any updates around timeline..

@Pluies Pluies mentioned this pull request Aug 17, 2023
Copy link

This pull request has gone a while without any activity. Tagging the Trino developer relations team: @bitsondatadev @colebow @mosabua

@github-actions github-actions bot added the stale label Jan 17, 2024
@mosabua
Copy link
Member

mosabua commented Jan 17, 2024

The actual progress is being made in #18723 . I am closing this PR. Please help out in the other PR as possible @beinan .. once it is merged we would love a follow up PR for Hive connector.

@mosabua mosabua closed this Jan 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed hive Hive connector hudi Hudi connector iceberg Iceberg connector jdbc Relates to Trino JDBC driver stale
Development

Successfully merging this pull request may close these issues.

7 participants