You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem or challenge?
Once the #9133 is merged, it should be fairly straightforward to implement a similar functionality for other supported types of remote location (S3 and GCS)
We would like to run queries like:
select*from's3://my_bucket/my_data/foo.parquet';
select*from'gcp://<location of data in gcp>'
Describe the solution you'd like
Code can be added here to register a relevant object store for a url, which can be obtained calling get_object_storearrow-datafusion/datafusion-cli/src/exec.rs (after making it pub(crate).
get_object_store requires options parameter which can be used to store the authentication information but for select there is no option parameter so an empty HashMap can be used which means the relevant auth details will be taken from the environmental variables
Describe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem or challenge?
Once the #9133 is merged, it should be fairly straightforward to implement a similar functionality for other supported types of remote location (S3 and GCS)
We would like to run queries like:
Describe the solution you'd like
Code can be added here to register a relevant object store for a url, which can be obtained calling
get_object_store
arrow-datafusion/datafusion-cli/src/exec.rs (after making itpub(crate)
.get_object_store
requiresoptions
parameter which can be used to store the authentication information but forselect
there is nooption
parameter so an empty HashMap can be used which means the relevant auth details will be taken from the environmental variablesDescribe alternatives you've considered
No response
Additional context
No response
The text was updated successfully, but these errors were encountered: