Old maximum grpcio version is blocking other dependencies

[christophbergemann]

skypilot requires grpcio<=1.43.0, which is quite old. This is causing unresolvable version conflicts in some cases. While my example (below) may be quite a particular use case, I think this is going to be a more general problem.

My example is using

pymilvus>=2.2.8
skypilot>=0.2.5

leading to

The conflict is caused by:
    pymilvus 2.2.8 depends on grpcio<=1.53.0 and >=1.49.1
    skypilot 0.2.5 depends on grpcio<=1.43.0 and >=1.32.0

To fix this you could try to:
1. loosen the range of package versions you've specified
2. remove package versions to allow pip attempt to solve the dependency conflict

[concretevitamin]

Thanks for the report @christophbergemann! What's your Python version & OS?

@Michaelvll: wondering if we can do https://github.com/ray-project/ray/blob/72e5f6be51808a77fe15a87b206d8214fc91abda/python/requirements.txt#L25-L30.

[christophbergemann]

Running on Windows 11 with Python 3.10.
Edit: Also reproducible on Gentoo Linux with Python 3.11 (although that's no surprise)

[Michaelvll]

Good point! It seems the problem has been solved by the upstream ray>=2.1. Since we currently using ray==2.0.1, we are blocked by the #1734.
https://github.com/ray-project/ray/blob/ray-2.0.1/python/setup.py
https://github.com/ray-project/ray/blob/ray-2.1.0/python/setup.py

[concretevitamin]

This has now been relaxed in 0.3:

skypilot/sky/setup_files/setup.py

Lines 97 to 101 in 3deccb2

	"grpcio >= 1.32.0, <= 1.49.1; python_version < '3.10' and sys_platform == 'darwin'", # noqa:E501
	"grpcio >= 1.42.0, <= 1.49.1; python_version >= '3.10' and sys_platform == 'darwin'", # noqa:E501
	# Original issue: https://github.com/ray-project/ray/issues/33833
	"grpcio >= 1.32.0, <= 1.51.3; python_version < '3.10' and sys_platform != 'darwin'", # noqa:E501
	"grpcio >= 1.42.0, <= 1.51.3; python_version >= '3.10' and sys_platform != 'darwin'", # noqa:E501

Please feel free to reopen this if it doesn't fix the issue for you.