Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

dask rounding different between different runs #136

Closed
jangorecki opened this issue Feb 23, 2020 · 0 comments
Closed

dask rounding different between different runs #136

jangorecki opened this issue Feb 23, 2020 · 0 comments
Labels
dask
Milestone
2.0.0

Comments

@jangorecki
Copy link
Contributor

for same question dask happens to round number different,
see 506570021.499 vs 506570021.5 below

      task solution           data                question                         unq_chk unqn_chk
1: groupby     dask G1_1e7_1e1_0_0        sum v1:v3 by id6 30001016;29998058;506570021.499        2
2: groupby     dask G1_1e7_1e1_0_0        sum v1:v3 by id6   30001016;29998058;506570021.5        2
3: groupby     dask G1_1e7_1e2_0_0 sum v3 count by id1:id6          506570021.499;10000000        2
4: groupby     dask G1_1e7_1e2_0_0 sum v3 count by id1:id6            506570021.5;10000000        2
jangorecki added a commit that referenced this issue Feb 23, 2020
@jangorecki
address dask rounding issue #136
24c6586
@jangorecki jangorecki mentioned this issue Feb 23, 2020
Closed
@jangorecki jangorecki added this to the 2.0.0 milestone May 13, 2020
jangorecki added a commit that referenced this issue May 14, 2020
@jangorecki
chk validation allows tolerance within single solution, closes #95, #136
7eacaa1
jangorecki added a commit to jangorecki/db-benchmark that referenced this issue Aug 4, 2023
@jangorecki
DT q8 q9 uses algo=fast again as roundoff is way less than tolerance
3c114e5 
chksum matches exactly, last val diff 1e6 q8 is 0.00000000000004001796

previously discussed in h2oai's h2oai#95 and h2oai#136 and addressed in 7eacaa1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
dask
Projects
None yet
Milestone
2.0.0
Development

No branches or pull requests
1 participant
@jangorecki