Dev/switch org api #541
Dev/switch org api #541
Conversation
…nto dev/switch_org_api
In the last passing test, scikit-learn is version 1.3.2
setup.py
Outdated
| @@ -42,7 +42,7 @@ def unique_flatten_dict(d): | |||
| } | |||
|
|
|||
| base_extras_heavy = { | |||
| 'umap-learn': ['umap-learn', 'dirty-cat==0.2.0', 'scikit-learn==1.2.2'], | |||
| 'umap-learn': ['umap-learn', 'dirty-cat==0.2.0', 'scikit-learn==1.3.2'], | |||
There was a problem hiding this comment.
Please do not edit dependencies without a specific clear reason
There was a problem hiding this comment.
(pydata GPU dependencies are fragile and require substantial testing for changes )
There was a problem hiding this comment.
@lmeyerov , checked with my colleague, he pinned this dependencies because there is an exception thrown with latest scikit-learn
TypeError: _iter() missing 3 required positional arguments: 'column_as_labels', 'skip_drop', and 'skip_empty_columns'
pinning to version 1.3.2 can prevent this error.
The error is coming from dirty_cat SuperVectorizer that was using scikit-learn. But SuperVectorizer is depreciated and replaced with TableVectorizer
There was a problem hiding this comment.
It's already pinned, not latest
There was a problem hiding this comment.
We should remove from this PR either way, if worthwhile, it should go in its own PR
There was a problem hiding this comment.
ok, I'll remove it.
it will cause the test script failure, therefore, we pin it.
There was a problem hiding this comment.
if we don't pin, test script will fail
There was a problem hiding this comment.
If it is about tests, we can patch test (non-prod) deps?
Working through a prod dep here would take more work to chase down, eg, GPU RAPIDS alignment
There was a problem hiding this comment.
From discussion:
- we can revert to original of scikit > 1.0...
- ... and in
testaicfg, do a<,>to skip the problematic recent scikits (I forgot exact syntax):- see:
Line 30 in e74123e
- see:
setup.py
Outdated
| @@ -27,7 +27,8 @@ def unique_flatten_dict(d): | |||
| 'docs': ['sphinx==3.4.3', 'docutils==0.16', 'sphinx_autodoc_typehints==1.11.1', 'sphinx-rtd-theme==0.5.1', 'Jinja2<3.1'], | |||
| 'test': ['flake8>=5.0', 'mock', 'mypy', 'pytest'] + stubs, | |||
| 'testai': [ | |||
| 'numba>=0.57.1' # https://github.com/numba/numba/issues/8615 | |||
| 'numba>=0.57.1', # https://github.com/numba/numba/issues/8615 | |||
| 'scikit-learn<=1.3.2' | |||
There was a problem hiding this comment.
Also > the known bad version?
There was a problem hiding this comment.
scikit-learn<=1.3.2,>1.4.0 give:
ERROR: No matching distribution found for scikit-learn<=1.3.2,>1.4.0
I use not equal instead
|
#548 is landing, should solve CI fail where are we on this? |
Changes to work with nexus' dev/switch_org_api.
Reviewed by Koa in progress.