Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trino cannot select data by using AWS Glue #22240

Closed
ahululu opened this issue Jun 3, 2024 · 3 comments
Closed

Trino cannot select data by using AWS Glue #22240

ahululu opened this issue Jun 3, 2024 · 3 comments

Comments

@ahululu
Copy link

ahululu commented Jun 3, 2024

my helm values:

additionalConfigProperties:
  - "retry-policy=TASK"
  - "exchange.compression-enabled=true"
  - "query.low-memory-killer.delay=0s"
  - "query.remote-task.max-error-duration=1m"
  - "query.hash-partition-count=50"
additionalExchangeManagerProperties:
  - "exchange.s3.region=ap-southeast-1"
  - "exchange.s3.iam-role=arn:aws:iam::xxxx:role/XXXRole"
additionalCatalogs:
  hive: |-
    connector.name=hive
    hive.metastore=glue
    hive.metastore.glue.catalogid=xxxxxx
    hive.metastore.glue.region=ap-southeast-1
    hive.metastore.glue.endpoint-url=https://glue.ap-southeast-1.amazonaws.com
    hive.metastore.glue.default-warehouse-dir=s3://xxx-glue/
    hive.metastore.glue.iam-role=arn:aws:iam::xxx:role/xxxRole
    hive.s3.iam-role=arn:aws:iam::xxxx:role/XXXXRole
    hive.security=allow-all
    hive.hive-views.enabled=true
  iceberg: |-
    connector.name=iceberg
    iceberg.catalog.type=glue
    iceberg.file-format=PARQUET
    iceberg.unique-table-location=true
    iceberg.register-table-procedure.enabled=true
    hive.metastore.glue.region=ap-southeast-1
    hive.metastore.glue.default-warehouse-dir=s3://xxx-glue/
    hive.s3.path-style-access=true
    hive.metastore.glue.iam-role=arn:aws:iam::xxxxx:role/XXXXRole
    hive.s3.iam-role=arn:aws:iam::xxxxxx:role/XXXXRole

Local PC trino cli Results:

trino --server https://xx.xx.com --catalog hive --user admin
trino> show schemas;

Query 20240603_080924_00000_sc3pb, FAILED, 1 node
Splits: 5 total, 0 done (NaN%)
3:11 [0 rows, 0B] [0 rows/s, 0B/s]

Query 20240603_080924_00000_sc3pb failed: Error listing schemas for catalog hive: java.lang.IllegalArgumentException: Unsupported request: software.amazon.awssdk.services.glue.model.GetDatabasesRequest$BuilderImpl@2385066d
@ebyhr
Copy link
Member

ebyhr commented Jun 3, 2024

What Tirno version are you using? I think you hit #22048

@ahululu
Copy link
Author

ahululu commented Jun 3, 2024

What Tirno version are you using? I think you hit #22048

448

@ebyhr
Copy link
Member

ebyhr commented Jun 3, 2024

The issue is already fixed in 449. Please upgrade your cluster.

@ebyhr ebyhr closed this as completed Jun 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants