Add nix package information, extend dockerfile generator to nix

[mkoeppe]

This extends #29053, where it is done for debian/fedora/conda/arch.

https://hub.docker.com/r/nixos/nix/

https://wiki.sagemath.org/Distribution#Nix

To test:

  tox -e docker-nixos-minimal
  tox -e docker-nixos-standard

Depends on #30044

CC: @timokau @dimpase @kliem

Component: build

Author: Matthias Koeppe

Branch/Commit: d4b2af2

Reviewer: Jonathan Kliem

Issue created by migration from https://trac.sagemath.org/ticket/29130

[mkoeppe]

Branch: u/mkoeppe/add_nix_package_information__extend_dockerfile_generator_to_nix

[mkoeppe]

Author: Matthias Koeppe

[mkoeppe]

Commit: a3d21ce

[mkoeppe]

comment:4

This defines docker-nixos-minimal.

For docker-nixos-standard, need to add many package equivalences to build/pkgs/*/distros/nix.txt

---

New commits:

a3d21ce

Add Dockerfile generator, basic package information for nix

[timokau]

comment:5

Regarding the package equivalents: All packages sage needs should be listed at the start of one of those files:

• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/env-locations.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sagedoc.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sagelib.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sage-env.nix

One caveat is that if you want to use system python packages, you either need to add them to PYTHONPATH manually or install them as a single python environment. That means instead of installing
python3, numpy, scipy
separately, you'd install the "package" (or environment) python3.withPackages (ps: with ps; [numpy scipy]).

I'm happy to help by explaining things, though I won't take the lead on this for now since sage-the-distribution isn't high priority for me right now (I have my hands full keeping the nix package running).

[mkoeppe]

comment:6

Replying to @timokau:

Regarding the package equivalents: All packages sage needs should be listed at the start of one of those files:

• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/env-locations.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sagedoc.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sagelib.nix
• https://github.com/NixOS/nixpkgs/blob/master/pkgs/applications/science/math/sage/sage-env.nix

Thanks.

One caveat is that if you want to use system python packages, ...

For now, we are not taking care of any Python packages.

[mkoeppe]

comment:7

pushing these forward to 9.2

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

b88ec28

Add Dockerfile generator, basic package information for nix

[sagetrac-git]

Changed commit from a3d21ce to b88ec28

[mkoeppe]

comment:9

Rebased on 9.2.beta1

[mkoeppe]

comment:10

Starting points for people who want to help with this:

• ​https://doc.sagemath.org/html/en/developer/portability_testing.html
• ​https://researchseminars.org/talk/SageDays109/7/

[sagetrac-git]

Changed commit from b88ec28 to cf4ff83

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. This was a forced push. Last 10 new commits:

49bdc21	tox.ini: Add voidlinux
e01c37d	build/pkgs/void-bootstrap.txt: New
0faf817	build/bin/write-dockerfile.sh [voidlinux]: Fix typo
bc5c2db	Merge branch 't/30064/fix_tox_docker_builds_broken_by__29884' into t/30044/tox_ini__test_on_voidlinux
8043c9c	build/pkgs/void-bootstrap.txt: Add gettext-devel
f2fe15b	Merge tag '9.2.beta5' into t/30044/tox_ini__test_on_voidlinux
83c240e	Add more voidlinux packages
9f4a232	Add voidlinux package for giac
d43730c	remove glib2 (typo?)
cf4ff83	Merge branch 't/30044/tox_ini__test_on_voidlinux' into t/29130/add_nix_package_information__extend_dockerfile_generator_to_nix

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

bfb52be

build/bin/write-dockerfile.sh [nix]: Fixup

[sagetrac-git]

Changed commit from cf4ff83 to bfb52be

[mkoeppe]

Dependencies: #30044

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

15cd368

build/pkgs/*/distros/nix.txt: Add from sagelib.nix

[sagetrac-git]

Changed commit from bfb52be to 15cd368

[sagetrac-git]

Changed commit from 15cd368 to 7c9bf82

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

7c9bf82

build/pkgs/*/distros/nix.txt: Add from sage-env.nix

[sagetrac-git]

Changed commit from 7c9bf82 to 0a639c4

[sagetrac-git]

Branch pushed to git repo; I updated commit sha1. New commits:

0a639c4

build/pkgs/r/distros/nix.txt: rWrapper does not exist, use R

[mkoeppe]

comment:20

Let's get this in please

[kliem]

comment:21

I'm running a few tests here: https://github.com/kliem/sage/pull/24/checks

[kliem]

comment:22

python3 isn't picked up, which isn't very surprising by the above comment. I guess this can be done in a future ticket.

It is not recognized that gcc contains a fortran compiler. But that is maybe also a future ticket.

libgd fails to install, which is somewhat unfortunate as we could simply add the package freetype to the system, couldn't we?

[kliem]

comment:23

This is pretty much good to go. I think only the last point should be handled here, shouldn't it?

[kliem]

Reviewer: Jonathan Kliem

[kliem]

Changed commit from 0a639c4 to d4b2af2

[kliem]

comment:24

I added freetype. If you agree, this is a positive review.

---

New commits:

b10493c	Merge branch 'u/mkoeppe/add_nix_package_information__extend_dockerfile_generator_to_nix' of git://trac.sagemath.org/sage into test_29130
d4b2af2	reviewer commit

[kliem]

Changed branch from u/mkoeppe/add_nix_package_information__extend_dockerfile_generator_to_nix to u/gh-kliem/add_nix_package_information__extend_dockerfile_generator_to_nix

[mkoeppe]

comment:25

Thank you!

[vbraun]

Changed branch from u/gh-kliem/add_nix_package_information__extend_dockerfile_generator_to_nix to d4b2af2