You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
There are 2 ways of accessing NASA datasets (not using back-end services) :
On-prem datasets: if a dataset is hosted by a DAAC, the only way to get the data is using auth HTTPS requests with EDL credentials.
Cloud datasets:
direct access: we are in us-west-2 and can use S3:// links (s3fs or boto3) with temporary DAAC credentials
HTTPS access: we are not in us-west-2, we need to use signed HTTPS requests (same as on prem)
Since both are covered by fsspec, we only need to do a little research and see if the fsspec HTTPS adapter will work as is given the proper EDL credentials or we need inject our SessionWithHeaderRedirection class.
For S3 we need to find our if we can do parallel gets (in case the user wants to actually download the data)
Finally change the name of the Accessor class to Store
The text was updated successfully, but these errors were encountered:
There are 2 ways of accessing NASA datasets (not using back-end services) :
us-west-2
and can useS3://
links (s3fs or boto3) with temporary DAAC credentialsus-west-2
, we need to use signed HTTPS requests (same as on prem)Since both are covered by fsspec, we only need to do a little research and see if the
fsspec
HTTPS adapter will work as is given the proper EDL credentials or we need inject ourSessionWithHeaderRedirection
class.For S3 we need to find our if we can do parallel gets (in case the user wants to actually download the data)
Finally change the name of the
Accessor
class to StoreThe text was updated successfully, but these errors were encountered: