Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix reading from Delta in a transaction #11792

Merged
merged 3 commits into from
Apr 6, 2022

Conversation

findepi
Copy link
Member

@findepi findepi commented Apr 5, 2022

Delta connector supports write in autocommit mode only, but it should
allow multiple reads in a transaction (e.g. reading from Delta and
writing to Hive connector).

"test_tx_insert",
"(a bigint)")) {
String tableName = table.getName();
inTransaction(session -> assertUpdate(session, "INSERT INTO " + tableName + " VALUES 42", 1));
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

just to make sure, this would work without your change(removing that 'verify') right?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for Detla, the test would break at the skipTestUnless(hasBehavior(SUPPORTS_MULTI_STATEMENT_WRITES)); because Delta doesn't support this. Only Hive does ATM, AFAIR.

findepi added 2 commits April 5, 2022 12:21
Delta connector supports write in autocommit mode only, but it should
allow multiple reads in a transaction (e.g. reading from Delta and
writing to Hive connector).

The commit removes the check from `DeltaLakeConnector` since appropriate
check is being done in `InMemoryTransactionManager`.
@findepi findepi force-pushed the findepi/test-tx-ops branch from b97012b to b6f35af Compare April 5, 2022 10:21
@sopel39 sopel39 removed their request for review April 5, 2022 13:07
@findepi
Copy link
Member Author

findepi commented Apr 5, 2022

CI #10932

@findepi
Copy link
Member Author

findepi commented Apr 6, 2022

CI #11825

@findepi findepi merged commit 527f49d into trinodb:master Apr 6, 2022
@findepi findepi mentioned this pull request Apr 6, 2022
@findepi findepi deleted the findepi/test-tx-ops branch April 6, 2022 09:33
@github-actions github-actions bot added this to the 376 milestone Apr 6, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Development

Successfully merging this pull request may close these issues.

4 participants