-
Notifications
You must be signed in to change notification settings - Fork 94
Transitioning from the US COVID19 Forecast Hub
Johannes Bracher edited this page Mar 1, 2021
·
6 revisions
This overview shall help you get started quickly if you are already familiar with the procedures for the US COVID-19 Forecast Hub. In case you notice an aspect that is missing please let us know by opening an issue.
What stays the same:
- The basic folder structure with a model-specific subfolder in
data-processed
(naming conventionteam-model
). - The forecast file format with point forecasts and 23 forecast quantiles.
- Case and death forecasts will be collected.
- The use of epi weeks running from Sunday to Saturday.
- The metadata format.
- The submission via GitHub pull requests (you just need to fork the covid19-forecast-hub-europe repository).
- All evaluation criteria which will be applied to your forecasts (weighted interval score, absolute error, interval coverage rates).
- The authoritative truth data source is JHU.
- The weekly submission deadline on Monday at 6pm ET (midnight CET).
What changes:
-
Only incidence forecasts will be covered (i.e.
k wk ahead inc death
andk wk ahead inc case
). Cumulative targets will not be covered. - No hospitalization/ICU forecasts will be accepted.
- An (optional) additional column called
scenario_id
can be included. If included, this needs to be set to"forecast"
in all rows for short-term forecasts. Other scenarios (e.g., on vaccination strategies) may be added in the future. - At least in the beginning only national level forecasts will be accepted.
- Location codes are based on the ISO 3166-1 alpha-2 standard. You can find the mapping of country names to ISO codes here.
- Preparing to submit
- Forecasting
- Submitting
- Other
- Forecast evaluation and ensemble building
- Editing the website
- Creation of an equally weighted ensemble forecast
- Merging weekly submissions