Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data schema plan #1

Open
staticfloat opened this issue Oct 19, 2020 · 0 comments
Open

Data schema plan #1

staticfloat opened this issue Oct 19, 2020 · 0 comments

Comments

@staticfloat
Copy link
Member

We need to come up with a data schema for passes to dump into a database.

Right now, I'm thinking each data analysis gets its own database, with its own schema. Each analysis pass will be responsible for outputting a CSV-like output, (e.g. "downloads per day, per UUID, per julia version") and a database engine (such as MySQL) will serve queries upon those databases to the world. We'll run the analysis once per day on the last month of data, and as we add new analyses/fix bugs, we'll update that entire time window with the better results, while historical results will just be frozen in time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant