Support for Python libraries like numpy

[JaroslavTulach]

Pull Request Description

Fixes #7388 by describing steps to create Enso project that can use numpy library.

Checklist

Please ensure that the following checklist has been satisfied before submitting the PR:

• The documentation has been updated: Read the documentation!
• All code follows the
  Scala,
  Java,
• All code has been tested:
  • Unit tests have been written where possible.

[hubertp]

I'm having some issues with running the example

[radeusgd]

This is unlikely to be in scope of this PR, but do we have plans on allowing most common Python libraries in the Enso Cloud?

In the cloud version, I don't think the user has access to create the virtual environment in the polyglot directory, so we may need to provide some kind of this capability for the users. Maybe we could preinstall some most common libs, like numpy?

(For longer term, I guess ideally we should expose some kind of UI to allow the user to install any custom library available in pip, but for starters pre-installing the basics could work well)

[somebody1234]

it might also be possible to do some static analysis, to extract all the import statements from the python code.

depending on where the code is coming from though, i think version conflicts might be an issue though. for example, if copy-pasting code and having it Just Work is an intended usecase, if someone pastes code from a really old numpy version they might be using some deprecated functions

[JaroslavTulach]

Maybe we could preinstall some most common libs, like numpy?

That will probably happen in the future.

expose some kind of UI to allow the user to install any custom library available in pip

Maybe.

The goal of this PR is to allow James, Sylwia & other colleagues to install and use numpy & co. without recompiling the engine. The simpler API the better - that's the reason why the API is just an existence of polyglot/python/bin/graalpy file. That's also the reason why the instructions to create that file are so "hardcore" and require direct use of GraalVM.

[JaroslavTulach]

Here is the output of the integration test that installs numpy and uses it.

[JaroslavTulach]

it might also be possible to do some static analysis, to extract all the import statements from the python code.
depending on where the code is coming from though, i think version conflicts might be an issue though.

The Enso solution to versioning is based on editions. The Python equivalent of that is virtual environment. Hence I opted for using it and required it to be part of the project for the sake of simplicity.

it might also be possible to do some static analysis, to extract all the import statements from the python code.

In my opinion this is an interactive task and thus a task for the IDE. Component browser could offer functions from Python libraries and then handle the version resolution, installation via pip & necessary imports. I have no idea how the UI should look like, but I believe good UI will deliver way better results than letting user type and then try static analysis.

Btw. I imagine following personas:

• skilled analyst using pandas daily - they should have no problem using pip from command line and resolving version conflicts
• analyst knowing nothing about Python - they would not benefit from static analysis anyway - they need IDE help

The goal of this PR is to ... colleagues to install and use numpy & co. without recompiling the engine.

In any case your idea aims far beyond the goal of this simple PR. However the topic of using numpy and pandas & co. easily will come back, so continue to think about these issues!