Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Favor ARCO datasets where possible #103

Open
brian-rose opened this issue Jul 5, 2023 · 0 comments
Open

Favor ARCO datasets where possible #103

brian-rose opened this issue Jul 5, 2023 · 0 comments

Comments

@brian-rose
Copy link
Owner

I tried to create a lot of content in this book that pulls from publicly available data, mostly via THREDDS servers. This has worked ok but does suffer from occasional outages. One example is climlab/climlab#177

Besides outages of THREDDS servers (including our own UAlbany-hosted server at http://thredds.atmos.albany.edu:8080/thredds/catalog.html), a bigger problem for interactive classroom use is the fact that THREDDS doesn't scale well to multiple simultaneous users.

A better alternative is cloud-native datasets served via public cloud storage buckets, or "Analysis-Ready, Cloud Optimized" (ARCO) data. A nice example of using ARCO-formatted ERA5 data is this Project Pythia Cookbook

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant