Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE REQUEST] Add generation date to puzzle page #58

Closed
cakiki opened this issue Oct 6, 2024 · 6 comments · Fixed by #61
Closed

[FEATURE REQUEST] Add generation date to puzzle page #58

cakiki opened this issue Oct 6, 2024 · 6 comments · Fixed by #61

Comments

@cakiki
Copy link
Contributor

cakiki commented Oct 6, 2024

It would be useful to add the date the data was last updated since the puzzles file is cumulative.

@cakiki
Copy link
Contributor Author

cakiki commented Oct 6, 2024

Happy to send a PR, but I'm not sure when exactly the update was run. Oct 5?

@Dboingue
Copy link

I don't know if that is what I think it might mean, but I also think that there is some vagueness about what the thing called puzzle database might contain, as it has not date attributed, and any rated thing should be about a traceable pool depedent variable.

And the theme, the ones that are not autotagged or that might change the theme probabilities per human half pool experience and the data about each puzzle ID player pair expeirence (how confident perhaps its rating might be, its volatiliity to speak glicko).

So it seems like a bunch of floating variables for anyone wanting to do population data analysis. It looks like another self-centered tool for individuals. A missed opportunity. But I might be missing a bunch of good reasons. I wish to be informed then.

So I approve this minimalist issue request. A date on that page. if not on the database....

@ornicar
Copy link
Collaborator

ornicar commented Oct 13, 2024

It would be useful to add the date the data was last updated since the puzzles file is cumulative.

I don't understand why it's useful, and what you mean by cumulative?

The puzzle DB is recomputed fully and replaced at the beginning of each month, and sometimes during a month for various reasons.

The static website is computed by https://github.com/lichess-org/database/blob/master/web/index.js

@cakiki
Copy link
Contributor Author

cakiki commented Oct 13, 2024

By cumulative I meant that the file is overwritten with every update.

It could be useful for people to know whether and when to update their local file, and for me for example to know when to update the Hugging Face version. (Though for the latter I guess there must be an easier way to figure that out)

@Dboingue
Copy link

Dboingue commented Oct 14, 2024

The puzzle DB is recomputed fully and replaced at the beginning of each month, and sometimes during a month for various reasons.

Is there a trace of that somewhere. The history of that file? you linked. It would be nive to make a note of that on the puzzle database page. And perhaps a changelog. Does that mean also that the votation data is being updated. At each update, it becomes a partial snapshot of all the included variables (as the page gives a schema for?).

And are the previous databases (and their date stamp) available anywhere?

I am glad to hear that. For the first time. That the puzzle database is under continuous revision. But it would be nice to have that historical data nonetheless. I can,t explain ahead of the research it might allow.. sorry. This is not a closed question, with a finite problem well posed and a a known algorithm that I could give to justify having access to more characterized datasets.

Between here and lichess feedback there is not really a place where there can be such discussion. It is either be a web tech aware coder here. or a single individual user case helfdesk there. I find that the link to the code above is perhps assuming soe skills of navigation to find the history of the changes. A bit like your opening repository was a great idea (even if the datasets are not of same nature and mostly compressed. The puzzle lichess system is not just a bunch of puzzles to solve. There is a whole added interlligible thematic strcuture, and and a specturm of skill associated that can make more insight from a dumb singel average skillset rating. This might help the lichess educatoin mission bone.

@ornicar
Copy link
Collaborator

ornicar commented Oct 14, 2024

The static website is computed by https://github.com/lichess-org/database/blob/master/web/index.js so the export date can be added there.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants