-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use s3 product dataset mapping #151
Use s3 product dataset mapping #151
Conversation
Common and Custom errors | ||
========================== | ||
|
||
Custom errors | ||
------------- |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I started doing this so I'll finish it here but the most important of this pull requests is the fact that we are using the mapping from the s3 metadata instead of a local file
- The dataset id is incorrect and not present in the catalog. | ||
- The dataset has been retired. | ||
|
||
Please verifiy that the dataset id is can be found in |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
some typo I understand, no? without the 'is' makes more sense
""" | ||
Exception raised when other options are passed with create_template. | ||
|
||
Please note that create_template should be passed with no other optiond |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
typo
|
||
|
||
class CredentialCannotBeNone(Exception): | ||
""" | ||
Exception raised when a credential are not set. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
plural or singular? credentials are not set or credential is not set (no?)
|
||
.. _pypi: https://pypi.org/project/copernicusmarine/ | ||
.. _conda-forge: https://anaconda.org/conda-forge/copernicusmarine | ||
.. _dockerhub: https://hub.docker.com/r/copernicusmarine/copernicusmarine | ||
.. _copernicusmarine-register: https://data.marine.copernicus.eu/register | ||
.. _Anaconda: https://www.anaconda.com/products/individual |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
what is all of this? I understand the correction is because I messed it up, but what does it do?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Just a way to put all the links at the same place but it's just some synthax from restructuredText
MARINE_DATA_STORE_ROOT_METADATA_URL = ( | ||
"https://s3.waw3-1.cloudferro.com/mdl-metadata" | ||
) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this is the new link no? to update it, the action is somewhere else I understand, right?
product_id = connection.get_json_file(dataset_product_mapping_url).get( | ||
dataset_id |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I understand that this has been check that it works, right? do yo feel it is more or less the time we anticipated?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Super fast
Use the s3 product dataset mapping and add errors in the doc and in the copernicus package
Use the s3 product dataset mapping and add errors in the doc and in the copernicus package
Finishing the task on stop using cache
Also started to document the custom errors of the toolbox