Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Modify alluxio version to stable 2.9.5 #22350

Merged
merged 1 commit into from
Jun 14, 2024

Conversation

jja725
Copy link
Member

@jja725 jja725 commented Jun 10, 2024

Description

2.9.4 is a more stable version and we would keep backporting changes from 3xx to 2.9.x line. With 2.9.4 we would have the same code of local cache manager as 3xx and compatibility with the stable Alluxio Filesystem interface. That's why we chose to have 2.9.4 here

Additional context and related issues

https://github.com/trinodb/trino/pull/21603/files#r1628261795

Release notes

( ) This is not user-visible or is docs only, and no release notes are required.
(x) Release notes are required. Please propose a release note for me.
( ) Release notes are required, with the following suggested text:

# Section
* Fix some things. ({issue}`issuenumber`)

@cla-bot cla-bot bot added the cla-signed label Jun 10, 2024
@jja725 jja725 requested a review from mosabua June 10, 2024 17:47
@jja725 jja725 mentioned this pull request Jun 10, 2024
Copy link
Contributor

@wendigo wendigo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claim that 2.9.4 is "more stable" lacks evidence. Is there any issue that 2.9.4 solves?

@jja725
Copy link
Member Author

jja725 commented Jun 10, 2024

Claim that 2.9.4 is "more stable" lacks evidence. Is there any issue that 2.9.4 solves?

Hi thanks for raising the concern, 2.9.x is the stable branch that we have been tested in customer env for a long time. While 3xx is still a beta version that have breaking compatibility changes so that's why we want to avoid bring it into Trino in early stage. Regarding the local cache manager Trino is using right now, 2.9.4 & 312 should have the exactly same code.

@jja725 jja725 force-pushed the update-alluxio-version branch from a4b6f7b to 43bfb18 Compare June 10, 2024 19:10
@wendigo
Copy link
Contributor

wendigo commented Jun 11, 2024

There are related failures.

Copy link
Member

@mosabua mosabua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If this version is truly more stable and works I am fine with the downgrade but it needs to pass CI and we need evidence from people using it in practice that this works. For example @jkylling or @raunaqmorarka might be able to test it a bit better.

Also why do we need all these additional exclusions .. it the upstream dependency declaration a lot more messed up than in 312?

@Pluies
Copy link
Contributor

Pluies commented Jun 11, 2024

fwiw we at Dune used to run 2.9.3 here, with extra fixes to work around issues that got fixed in alluxio master later. We're (literally just now) moving to Trino 448's official caching code relying on alluxio 312, so we won't have experience running 2.9.4 in prod.

@Pluies
Copy link
Contributor

Pluies commented Jun 11, 2024

That said I agree with the comments above; if the 2.x.x is the stable branch then I don't see any issue using it. Hopefully we should have enough coverage in CI to ensure that once everything is green, the caching code is fine 👍

@jja725 jja725 force-pushed the update-alluxio-version branch 4 times, most recently from d8b94ef to 507a339 Compare June 11, 2024 20:52
@jja725 jja725 closed this Jun 11, 2024
@jja725 jja725 reopened this Jun 11, 2024
@jja725 jja725 closed this Jun 11, 2024
@jja725 jja725 reopened this Jun 11, 2024
@jja725 jja725 force-pushed the update-alluxio-version branch 2 times, most recently from 9fdf16c to edf3a91 Compare June 11, 2024 23:50
@jja725 jja725 force-pushed the update-alluxio-version branch from edf3a91 to 12d9ad7 Compare June 14, 2024 18:31
@wendigo wendigo changed the title Modify alluxio version to stable 2.9.4 Modify alluxio version to stable 2.9.5 Jun 14, 2024
@wendigo wendigo merged commit 734135e into trinodb:master Jun 14, 2024
94 of 95 checks passed
@wendigo
Copy link
Contributor

wendigo commented Jun 14, 2024

Thanks @jja725

@github-actions github-actions bot added this to the 450 milestone Jun 14, 2024
@jja725
Copy link
Member Author

jja725 commented Jun 14, 2024

@wendigo thanks for the quick merge!

@colebow colebow added the no-release-notes This pull request does not require release notes entry label Jun 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-signed no-release-notes This pull request does not require release notes entry
Development

Successfully merging this pull request may close these issues.

5 participants