Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ps bump polars to v0.36 #798

Conversation

lkarthee
Copy link
Member

@lkarthee lkarthee commented Jan 4, 2024

#797

Continuing the work of @philss

@lkarthee lkarthee marked this pull request as draft January 4, 2024 06:27
@lkarthee
Copy link
Member Author

lkarthee commented Jan 4, 2024

I am not sure if i have to merge to ps-bump-polars-to-v0.36 or main. Anyways marked the PR as draft.

@lkarthee
Copy link
Member Author

lkarthee commented Jan 4, 2024

7 test cases are failing :

  • 5 describe test cases
  • 2 join test cases

I have fixed test cases for nan comparison as Polars made a breaking change and we can't do much as we are just wrapping.

Same with quantile function, they have made breaking changes with quantile function. They went with round even for reducing bias.

Implemented window median function.

I will hopefully complete implementing describe function in a couple of days.

Join has breaking change, "outer_coalse" is for compatibility of existing behaviour and "outer" is little different now. We will just port to same behaviour ? Also the inspect node PR is causing PolarError ?

@philss

@philss
Copy link
Member

philss commented Jan 4, 2024

@lkarthee thank you for your work here!

I think we can point to main if we plan to fix everything here. But if you think other people can take what is failing, then point to my branch and we merge what you did.

Join has breaking change, "outer_coalse" is for compatibility of existing behaviour and "outer" is little different now. We will just port to same behaviour ?

Let's port to the new behaviour, as José said in the issue :)

Also the inspect node PR is causing PolarError ?

I didn't get it. What inspect?

@lkarthee
Copy link
Member Author

lkarthee commented Jan 4, 2024

I didn't get it. What inspect?

Jose clarified it is not. I will look more into Polars join func. I was thinking #784 was causing failure in outer join case.

@lkarthee lkarthee changed the base branch from main to ps-bump-polars-to-v0.36 January 4, 2024 17:02
@lkarthee lkarthee marked this pull request as ready for review January 4, 2024 17:02
@lkarthee
Copy link
Member Author

lkarthee commented Jan 4, 2024

@philss philss mentioned this pull request Jan 4, 2024
5 tasks
@philss
Copy link
Member

philss commented Jan 4, 2024

@lkarthee sweet! I'm going to merge you work to that branch, so please open new PRs if you start to work on anything new.

@philss philss merged commit 8930677 into elixir-explorer:ps-bump-polars-to-v0.36 Jan 4, 2024
2 of 4 checks passed
philss added a commit that referenced this pull request Jan 8, 2024
* WIP: bump polars to v0.36 --skip-ci

* Ps bump polars to v0.36 (#798)

* change counts to count

* fix nan comparision

* fix window_median & quantile

* Fix outer join with Polars v0.36 (#802)

* Bump to v0.36.0 - implement describe function (#803)

* fix describe

* review changes

* implement describe in elixir

* Update lib/explorer/data_frame.ex

---------

Co-authored-by: lkarthee <[email protected]>
Co-authored-by: José Valim <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants