DietPi-Software | Docker Compose #3078

Gill-Bates · 2019-08-25T14:08:11Z

Dietpi offers docker inside dietpi-software catalog. But Docker-compose is missing. IMHO should be added.

MichaIng · 2019-08-26T14:30:19Z

@Gill-Bates
Many thanks for your request.

Simple binary install, talking care the dependencies manually: https://docs.docker.com/compose/install/
Debian package install: https://packages.debian.org/buster/docker-compose

ModischFabrications · 2019-10-07T18:30:10Z

I had the same expectation that DietPi-Docker installed docker-compose with it and arrived here while researching the problem. It might be sensible to add it to the docker installation or at least add a prompt for "optional extras: ...".

sudo apt install docker-compose worked flawless for anyone with the same problem.

Joulinar · 2020-12-27T10:47:22Z

@MichaIng
I was thinking to look into the implementation of docker-compose. Easiest way is to go with the apt package. However it's 2.5 years old docker-compose version (1.21.0-3). Probably better to have it installed via pip version (1.27.4)?? Even if it will take longer to compile. What do you think?

MichaIng · 2020-12-27T15:11:04Z

I think since we pull docker-ce from official upstream sources as well, we should go with the up-to-date PyPI (pip) composer. There seems to be a pre-compiled wheel available for "any" architecture: https://pypi.org/project/docker-compose/#files
Let's see how long the pip install really takes.

Joulinar · 2020-12-27T15:34:21Z

I will do a comparison between RPi1,3,4 and VM Stretch/Buster this evening

Joulinar · 2020-12-27T21:12:20Z

Below my test result

Buster

RPi B (armv6l)
RPi 3 Model B+ (armv7l)
RPi 4 Model B (aarch64)
Virtual Machine 1 (x86_64)

Stretch

Virtual Machine 2 (x86_64)

DietPi version

v6.34.3

Software installed

ID 130 - Python 3 pip

Additional dependencies
On RPi 1/3

make gcc libffi-dev libssl-dev

On RPi 4

make gcc

VM 1/2

none

Install command

pip3 install docker-compose

Timing

time command was used to calculate installation
VM 1: 1m6.168s
VM 2: 1m14.006s
RPi4: 4m35.200s
RPi3: 28m43.226s
RPi1: 160m24.768s (yes 160 minutes)

On RPi1/3, most of the time is spend on Building wheel for pynacl (PEP 517)

MichaIng · 2020-12-28T00:24:56Z

Puhh, yes I remember pynacl being a major time consumer in other cases as well. The question is if many users will run a multi-container application on RPi 1/Zero anyway 🤔. I cannot imagine this being a good idea 😄.

Strange that you didn't need libffi-dev + libssl-dev on RPi 4. Was it probably the 64-bit image so that arm64 vs armhf makes the difference here, i.e. there are pre-compiled pynacl wheels for arm64 but not for armhf?

Joulinar · 2020-12-28T00:30:19Z

I was surprised as well that I don't need libffi-dev libssl-dev on the RPi4B 64bit. Will do another test tomorrow as it was not that painful like RPi1/3

Looks like there is no pre-compiled pynacl wheels for arm64 https://pypi.org/project/PyNaCl/#files

MichaIng · 2020-12-28T00:54:39Z

This is not the only repository. non-64-bit RPis pull from piwheels.org as well, and very strange is that there are in fact PyNaCl wheels for ARMv7 and ARMv6 available for Python 3: https://www.piwheels.org/project/pynacl/
I never saw this wheel being pulled, it seems to be not detected correctly. Would be a huge time saver if it was, a task for tomorrow: https://github.com/piwheels/piwheels

I do not remember where arm64/ARMv8 wheels are additionally pulled from.

Joulinar · 2020-12-28T18:17:19Z

OK I was able to reduce runtime on my RPi3B+ from 28 minutes down to 30 seconds 😄

The trick is to specify piwheels.org as source
pip3 install docker-compose -i https://www.piwheels.org/simple

RPi OS 64bit is not supported as it is still BETA https://blog.piwheels.org/raspberry-pi-os-64-bit-aarch64/

Logfile attached. Click to expand!

root@DietPi3:~# time pip3 install docker-compose -i https://www.piwheels.org/simple
Looking in indexes: https://www.piwheels.org/simple
Collecting docker-compose
  Downloading https://www.piwheels.org/simple/docker-compose/docker_compose-1.27.4-py2.py3-none-any.whl (110 kB)
     |████████████████████████████████| 110 kB 381 kB/s
Collecting cached-property<2,>=1.2.0
  Downloading https://www.piwheels.org/simple/cached-property/cached_property-1.5.2-py2.py3-none-any.whl (7.6 kB)
Collecting distro<2,>=1.5.0
  Downloading https://www.piwheels.org/simple/distro/distro-1.5.0-py2.py3-none-any.whl (18 kB)
Collecting docker[ssh]<5,>=4.3.1
  Downloading https://www.piwheels.org/simple/docker/docker-4.4.1-py2.py3-none-any.whl (146 kB)
     |████████████████████████████████| 146 kB 749 kB/s
Collecting dockerpty<1,>=0.4.1
  Downloading https://www.piwheels.org/simple/dockerpty/dockerpty-0.4.1-py3-none-any.whl (16 kB)
Collecting docopt<1,>=0.6.1
  Downloading https://www.piwheels.org/simple/docopt/docopt-0.6.2-py2.py3-none-any.whl (13 kB)
Collecting jsonschema<4,>=2.5.1
  Downloading https://www.piwheels.org/simple/jsonschema/jsonschema-3.2.0-py2.py3-none-any.whl (56 kB)
     |████████████████████████████████| 56 kB 450 kB/s
Requirement already satisfied: setuptools in /usr/local/lib/python3.7/dist-packages (from jsonschema<4,>=2.5.1->docker-compose) (51.1.0)
Collecting attrs>=17.4.0
  Downloading https://www.piwheels.org/simple/attrs/attrs-20.3.0-py2.py3-none-any.whl (49 kB)
     |████████████████████████████████| 49 kB 345 kB/s
Collecting paramiko>=2.4.2
  Downloading https://www.piwheels.org/simple/paramiko/paramiko-2.7.2-py2.py3-none-any.whl (206 kB)
     |████████████████████████████████| 206 kB 932 kB/s
Collecting bcrypt>=3.1.3
  Downloading https://www.piwheels.org/simple/bcrypt/bcrypt-3.2.0-cp37-cp37m-linux_armv7l.whl (57 kB)
     |████████████████████████████████| 57 kB 466 kB/s
Collecting cffi>=1.1
  Downloading https://www.piwheels.org/simple/cffi/cffi-1.14.4-cp37-cp37m-linux_armv7l.whl (346 kB)
     |████████████████████████████████| 346 kB 506 kB/s
Collecting cryptography>=2.5
  Downloading https://www.piwheels.org/simple/cryptography/cryptography-3.3.1-cp37-cp37m-linux_armv7l.whl (782 kB)
     |████████████████████████████████| 782 kB 1.0 MB/s
Collecting pynacl>=1.0.1
  Downloading https://www.piwheels.org/simple/pynacl/PyNaCl-1.4.0-cp37-cp37m-linux_armv7l.whl (605 kB)
     |████████████████████████████████| 605 kB 902 kB/s
Collecting pyrsistent>=0.14.0
  Downloading https://www.piwheels.org/simple/pyrsistent/pyrsistent-0.16.0-cp37-cp37m-linux_armv7l.whl (100 kB)
     |████████████████████████████████| 100 kB 1.8 MB/s
Collecting python-dotenv<1,>=0.13.0
  Downloading https://www.piwheels.org/simple/python-dotenv/python_dotenv-0.15.0-py2.py3-none-any.whl (18 kB)
Collecting PyYAML<6,>=3.10
  Downloading https://www.piwheels.org/simple/pyyaml/PyYAML-5.3.1-cp37-cp37m-linux_armv7l.whl (44 kB)
     |████████████████████████████████| 44 kB 781 kB/s
Collecting requests<3,>=2.20.0
  Downloading https://www.piwheels.org/simple/requests/requests-2.25.1-py2.py3-none-any.whl (61 kB)
     |████████████████████████████████| 61 kB 1.4 MB/s
Collecting certifi>=2017.4.17
  Downloading https://www.piwheels.org/simple/certifi/certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
     |████████████████████████████████| 147 kB 868 kB/s
Collecting chardet<5,>=3.0.2
  Downloading https://www.piwheels.org/simple/chardet/chardet-4.0.0-py2.py3-none-any.whl (178 kB)
     |████████████████████████████████| 178 kB 857 kB/s
Collecting idna<3,>=2.5
  Downloading https://www.piwheels.org/simple/idna/idna-2.10-py2.py3-none-any.whl (58 kB)
     |████████████████████████████████| 58 kB 1.4 MB/s
Collecting six>=1.4.0
  Downloading https://www.piwheels.org/simple/six/six-1.15.0-py2.py3-none-any.whl (10 kB)
Collecting texttable<2,>=0.9.0
  Downloading https://www.piwheels.org/simple/texttable/texttable-1.6.3-py2.py3-none-any.whl (10 kB)
Collecting urllib3<1.27,>=1.21.1
  Downloading https://www.piwheels.org/simple/urllib3/urllib3-1.26.2-py2.py3-none-any.whl (136 kB)
     |████████████████████████████████| 136 kB 1.1 MB/s
Collecting websocket-client<1,>=0.32.0
  Downloading https://www.piwheels.org/simple/websocket-client/websocket_client-0.57.0-py2.py3-none-any.whl (200 kB)
     |████████████████████████████████| 200 kB 3.4 MB/s
Collecting importlib-metadata
  Downloading https://www.piwheels.org/simple/importlib-metadata/importlib_metadata-3.3.0-py3-none-any.whl (10 kB)
Collecting typing-extensions>=3.6.4
  Downloading https://www.piwheels.org/simple/typing-extensions/typing_extensions-3.7.4.3-py3-none-any.whl (22 kB)
Collecting zipp>=0.5
  Downloading https://www.piwheels.org/simple/zipp/zipp-3.4.0-py3-none-any.whl (5.2 kB)
Collecting pycparser
  Downloading https://www.piwheels.org/simple/pycparser/pycparser-2.20-py2.py3-none-any.whl (112 kB)
     |████████████████████████████████| 112 kB 3.1 MB/s
Installing collected packages: pycparser, urllib3, six, idna, chardet, cffi, certifi, zipp, websocket-client, typing-extensions, requests, pynacl, cryptography, bcrypt, pyrsistent, paramiko, importlib-metadata, docker, attrs, texttable, PyYAML, python-dotenv, jsonschema, docopt, dockerpty, distro, cached-property, docker-compose
Successfully installed PyYAML-5.3.1 attrs-20.3.0 bcrypt-3.2.0 cached-property-1.5.2 certifi-2020.12.5 cffi-1.14.4 chardet-4.0.0 cryptography-3.3.1 distro-1.5.0 docker-4.4.1 docker-compose-1.27.4 dockerpty-0.4.1 docopt-0.6.2 idna-2.10 importlib-metadata-3.3.0 jsonschema-3.2.0 paramiko-2.7.2 pycparser-2.20 pynacl-1.4.0 pyrsistent-0.16.0 python-dotenv-0.15.0 requests-2.25.1 six-1.15.0 texttable-1.6.3 typing-extensions-3.7.4.3 urllib3-1.26.2 websocket-client-0.57.0 zipp-3.4.0

real    0m30.268s
user    0m17.245s
sys     0m1.202s
root@DietPi3:~#

Question is, if we still need to install build dependencys make gcc libffi-dev libssl-dev

MichaIng · 2020-12-28T18:22:43Z

Awesome. I wonder why it is not selected automatically as source, AFAIK it was, at least I remember certain bugs with the piwheels.org repo when Python 3 wheels were pulled by pip2 (resolved now). Looks like we should apply that source then for all ARMv6+ARMv7 boards, maybe there is a pip config for that. Who knows how much time was already waste to install dependencies and build wheels for modules which were pre-build on piwheels.org for a long time 😄.

Question is, if we still need to install build dependencys

Your log does not show a single source build but all were pre-built wheels, hence no build tools required 👍.

Joulinar · 2020-12-28T18:26:09Z

You should have a file at /etc/pip.conf containing:

[global]
extra-index-url=https://www.piwheels.org/simple

If` that's there, pip should use piwheels. If not, create the file and add those lines to it.
Note that pip version 9 or above is required.

https://www.piwheels.org/faq.html

Using option -i allow pip to fall back to PyPI if the requested package (or one of its dependencies) is not available on piwheels

Joulinar · 2020-12-28T19:08:30Z

Did one more test on my RPi B (without make dependency). Installation time is down to 2m35.960s from 160m24.768s bevor. Even faster than the RPi4B now 🤣

MichaIng · 2020-12-28T19:27:12Z

I'm still wondering why piwheels was already used as source in the past, like here: #3346
This reminds me of the fact that piwheels.org supports Python 3 only, hence we need to make sure that pip2 does not use it when creating that config file. Is far as I understood piwheels.org has not some check integrated to not ship a Python 3 wheel for a Python 2 instance, so it should be skipped automatically, but better to test it.

Joulinar · 2020-12-28T19:30:36Z

why not staying with option -i? Means, no need to create config files and we are in control to use pip3. Otherwise we could run into issues for user who have Python2 still installed and try doing pip install.

MichaIng · 2020-12-28T19:37:30Z

On the other hand we suggest pip calls to update software as well, and telling user to use that option on ARMv6 and ARMv7, else not, makes is a bid complicated. If there is already such a repository, it makes sense to use it by default for all pip calls where possible. If something is not available in this repo, PyPI is still used, if I understand correctly, so it should be safe. Just pip2 needs to be tested. Will run some tests.

`pip3` on x86_64 (because I had the VM running 😄)

Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting pip
  Downloading pip-20.3.3-py2.py3-none-any.whl (1.5 MB)
Collecting setuptools
  Downloading setuptools-51.1.0-py3-none-any.whl (2.0 MB)
Collecting wheel
  Downloading wheel-0.36.2-py2.py3-none-any.whl (35 kB)
Installing collected packages: pip, setuptools, wheel
Successfully installed pip-20.3.3 setuptools-51.1.0 wheel-0.36.2

PyPI is still the major index.

`pip2` on x86_64

2020-12-28 20:42:10 root@VM-Buster:/var/www/html# pip2 install -U pip setuptools wheel
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Cache entry deserialization failed, entry ignored
Cache entry deserialization failed, entry ignored
Collecting pip
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/54/eb/4a3642e971f404d69d4f6fa3885559d67562801b99d7592487f1ecc4e017/pip-20.3.3-py2.py3-none-any.whl (1.5MB)
    100% |████████████████████████████████| 1.5MB 240kB/s
Collecting setuptools
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/e1/b7/182161210a13158cd3ccc41ee19aadef54496b74f2817cc147006ec932b4/setuptools-44.1.1-py2.py3-none-any.whl (583kB)
    100% |████████████████████████████████| 583kB 582kB/s
Collecting wheel
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Cache entry deserialization failed, entry ignored
  Downloading https://files.pythonhosted.org/packages/65/63/39d04c74222770ed1589c0eaba06c05891801219272420b40311cd60c880/wheel-0.36.2-py2.py3-none-any.whl
Installing collected packages: pip, setuptools, wheel
  Found existing installation: pip 18.1
    Not uninstalling pip at /usr/lib/python2.7/dist-packages, outside environment /usr
    Can't uninstall 'pip'. No files were found to uninstall.
Successfully installed pip-20.3.3 setuptools-44.1.1 wheel-0.36.2

The cache deserialization warnings are due to Python 3 modules in pip cache, AFAIK, not due to piwheels.org.

Joulinar · 2020-12-28T19:44:57Z

so we need to find a software not being available on piwheels to test fallback to PyPI

MichaIng · 2020-12-28T19:49:32Z

You see the fallback already, pythonhosted.org is the hosting for PyPI. But I'll test it on RPi now, non-available package might behave different than non-matching architecture.

MichaIng · 2020-12-28T20:42:19Z

Just installed OctoPrint on RPi without a single source build:

root@Building-ARMv6-Buster:~# pip install octoprint
Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple
Collecting octoprint
  Downloading https://www.piwheels.org/simple/octoprint/OctoPrint-1.5.2-py2.py3-none-any.whl (3.8 MB)
     |████████████████████████████████| 3.8 MB 258 kB/s
Collecting rsa==4.0
  Downloading https://www.piwheels.org/simple/rsa/rsa-4.0-py2.py3-none-any.whl (38 kB)
Collecting sarge==0.1.5post0
  Downloading https://www.piwheels.org/simple/sarge/sarge-0.1.5.post0-py3-none-any.whl (19 kB)
Collecting tornado==5.1.1
  Downloading https://www.piwheels.org/simple/tornado/tornado-5.1.1-cp37-cp37m-linux_armv7l.whl (463 kB)
     |████████████████████████████████| 463 kB 1.0 MB/s
Collecting watchdog==0.10.4
  Downloading https://www.piwheels.org/simple/watchdog/watchdog-0.10.4-py3-none-any.whl (76 kB)
     |████████████████████████████████| 76 kB 1.4 MB/s
Collecting blinker<2,>=1.4
  Downloading https://www.piwheels.org/simple/blinker/blinker-1.4-py3-none-any.whl (14 kB)
Collecting cachelib<1,>=0.1
  Downloading https://www.piwheels.org/simple/cachelib/cachelib-0.1.1-py3-none-any.whl (13 kB)
Collecting Click<8,>=7.1.2
  Downloading https://www.piwheels.org/simple/click/click-7.1.2-py2.py3-none-any.whl (84 kB)
     |████████████████████████████████| 84 kB 1.0 MB/s
Collecting emoji<1,>=0.5.4
  Downloading https://www.piwheels.org/simple/emoji/emoji-0.6.0-py3-none-any.whl (50 kB)
     |████████████████████████████████| 50 kB 1.8 MB/s
Collecting feedparser<7,>=6.0.2
  Downloading https://www.piwheels.org/simple/feedparser/feedparser-6.0.2-py3-none-any.whl (80 kB)
     |████████████████████████████████| 80 kB 2.3 MB/s
Collecting filetype<2,>=1.0.7
  Downloading https://www.piwheels.org/simple/filetype/filetype-1.0.7-py2.py3-none-any.whl (15 kB)
Collecting flask<2,>=1.1.2
  Downloading https://www.piwheels.org/simple/flask/Flask-1.1.2-py2.py3-none-any.whl (94 kB)
     |████████████████████████████████| 94 kB 1.1 MB/s
Collecting Flask-Assets<3,>=2.0
  Downloading https://www.piwheels.org/simple/flask-assets/Flask_Assets-2.0-py3-none-any.whl (8.5 kB)
Collecting Flask-Babel<2,>=1.0
  Downloading https://www.piwheels.org/simple/flask-babel/Flask_Babel-1.0.0-py3-none-any.whl (9.5 kB)
Collecting Babel>=2.3
  Downloading https://www.piwheels.org/simple/babel/Babel-2.9.0-py2.py3-none-any.whl (8.8 MB)
     |████████████████████████████████| 8.8 MB 3.9 MB/s
Collecting Flask-Login<0.6,>=0.5
  Downloading https://www.piwheels.org/simple/flask-login/Flask_Login-0.5.0-py2.py3-none-any.whl (16 kB)
Collecting frozendict<2,>=1.2
  Downloading https://www.piwheels.org/simple/frozendict/frozendict-1.2-py3-none-any.whl (3.6 kB)
Collecting future<1,>=0.18.2
  Downloading https://www.piwheels.org/simple/future/future-0.18.2-py3-none-any.whl (491 kB)
     |████████████████████████████████| 491 kB 1.1 MB/s
Collecting itsdangerous<2,>=1.1.0
  Downloading https://www.piwheels.org/simple/itsdangerous/itsdangerous-1.1.0-py2.py3-none-any.whl (16 kB)
Collecting Jinja2<3,>=2.11.2
  Downloading https://www.piwheels.org/simple/jinja2/Jinja2-2.11.2-py2.py3-none-any.whl (127 kB)
     |████████████████████████████████| 127 kB 2.6 MB/s
Collecting markdown<3.2,>=3.1
  Downloading https://www.piwheels.org/simple/markdown/Markdown-3.1.1-py2.py3-none-any.whl (87 kB)
     |████████████████████████████████| 87 kB 1.8 MB/s
Requirement already satisfied: setuptools>=36 in /usr/local/lib/python3.7/dist-packages (from markdown<3.2,>=3.1->octoprint) (51.0.0)
Collecting markupsafe<2.0,>=1.1
  Downloading https://www.piwheels.org/simple/markupsafe/MarkupSafe-1.1.1-cp37-cp37m-linux_armv7l.whl (33 kB)
Collecting netaddr<1,>=0.7.19
  Downloading https://www.piwheels.org/simple/netaddr/netaddr-0.8.0-py3-none-any.whl (1.9 MB)
     |████████████████████████████████| 1.9 MB 3.5 MB/s
Collecting netifaces<1,>=0.10.9
  Downloading https://www.piwheels.org/simple/netifaces/netifaces-0.10.9-cp37-cp37m-linux_armv7l.whl (38 kB)
Collecting OctoPrint-FileCheck>=2020.08.07
  Downloading https://www.piwheels.org/simple/octoprint-filecheck/OctoPrint_FileCheck-2020.8.7-py2.py3-none-any.whl (19 kB)
Collecting OctoPrint-FirmwareCheck>=2020.09.23
  Downloading https://www.piwheels.org/simple/octoprint-firmwarecheck/OctoPrint_FirmwareCheck-2020.9.23-py2.py3-none-any.whl (27 kB)
Collecting pathtools>=0.1.1
  Downloading https://www.piwheels.org/simple/pathtools/pathtools-0.1.2-py3-none-any.whl (8.6 kB)
Collecting pkginfo<2,>=1.5.0.1
  Downloading https://www.piwheels.org/simple/pkginfo/pkginfo-1.6.1-py2.py3-none-any.whl (25 kB)
Collecting psutil<6,>=5.7
  Downloading https://www.piwheels.org/simple/psutil/psutil-5.8.0-cp37-cp37m-linux_armv7l.whl (296 kB)
     |████████████████████████████████| 296 kB 3.7 MB/s
Collecting pyasn1>=0.1.3
  Downloading https://www.piwheels.org/simple/pyasn1/pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
     |████████████████████████████████| 77 kB 637 kB/s
Collecting pylru<2,>=1.2
  Downloading https://www.piwheels.org/simple/pylru/pylru-1.2.0-py3-none-any.whl (15 kB)
Collecting pyserial<4,>=3.4
  Downloading https://www.piwheels.org/simple/pyserial/pyserial-3.5-py2.py3-none-any.whl (90 kB)
     |████████████████████████████████| 90 kB 2.1 MB/s
Collecting pytz
  Downloading https://www.piwheels.org/simple/pytz/pytz-2020.5-py2.py3-none-any.whl (510 kB)
     |████████████████████████████████| 510 kB 2.6 MB/s
Collecting PyYAML<6,>=5.3.1
  Downloading https://www.piwheels.org/simple/pyyaml/PyYAML-5.3.1-cp37-cp37m-linux_armv7l.whl (44 kB)
     |████████████████████████████████| 44 kB 989 kB/s
Collecting regex!=2018.11.6
  Downloading https://www.piwheels.org/simple/regex/regex-2020.11.13-cp37-cp37m-linux_armv7l.whl (627 kB)
     |████████████████████████████████| 627 kB 3.2 MB/s
Collecting requests<3,>=2.23.0
  Downloading https://www.piwheels.org/simple/requests/requests-2.25.1-py2.py3-none-any.whl (61 kB)
     |████████████████████████████████| 61 kB 2.1 MB/s
Collecting certifi>=2017.4.17
  Downloading https://www.piwheels.org/simple/certifi/certifi-2020.12.5-py2.py3-none-any.whl (147 kB)
     |████████████████████████████████| 147 kB 775 kB/s
Collecting chardet<5,>=3.0.2
  Downloading https://www.piwheels.org/simple/chardet/chardet-4.0.0-py2.py3-none-any.whl (178 kB)
     |████████████████████████████████| 178 kB 4.0 MB/s
Collecting idna<3,>=2.5
  Downloading https://www.piwheels.org/simple/idna/idna-2.10-py2.py3-none-any.whl (58 kB)
     |████████████████████████████████| 58 kB 1.6 MB/s
Collecting semantic-version<3,>=2.8.5
  Downloading https://www.piwheels.org/simple/semantic-version/semantic_version-2.8.5-py2.py3-none-any.whl (19 kB)
Collecting sentry-sdk<1,>=0.15.1
  Downloading https://www.piwheels.org/simple/sentry-sdk/sentry_sdk-0.19.5-py2.py3-none-any.whl (128 kB)
     |████████████████████████████████| 128 kB 1.3 MB/s
Collecting unidecode<0.05,>=0.04.14
  Downloading https://www.piwheels.org/simple/unidecode/Unidecode-0.04.21-py2.py3-none-any.whl (228 kB)
     |████████████████████████████████| 228 kB 783 kB/s
Collecting urllib3<1.27,>=1.21.1
  Downloading https://www.piwheels.org/simple/urllib3/urllib3-1.26.2-py2.py3-none-any.whl (136 kB)
     |████████████████████████████████| 136 kB 3.9 MB/s
Collecting webassets>=2.0
  Downloading https://www.piwheels.org/simple/webassets/webassets-2.0-py3-none-any.whl (142 kB)
     |████████████████████████████████| 142 kB 3.3 MB/s
Collecting websocket-client<1,>=0.57
  Downloading https://www.piwheels.org/simple/websocket-client/websocket_client-0.57.0-py2.py3-none-any.whl (200 kB)
     |████████████████████████████████| 200 kB 2.5 MB/s
Collecting werkzeug<2,>=1.0.1
  Downloading https://www.piwheels.org/simple/werkzeug/Werkzeug-1.0.1-py2.py3-none-any.whl (298 kB)
     |████████████████████████████████| 298 kB 1.1 MB/s
Collecting wrapt<2,>=1.12.1
  Downloading https://www.piwheels.org/simple/wrapt/wrapt-1.12.1-cp37-cp37m-linux_armv7l.whl (68 kB)
     |████████████████████████████████| 68 kB 802 kB/s
Collecting zeroconf<0.25,>=0.24
  Downloading https://www.piwheels.org/simple/zeroconf/zeroconf-0.24.5-py3-none-any.whl (65 kB)
     |████████████████████████████████| 65 kB 1.3 MB/s
Collecting ifaddr
  Downloading https://www.piwheels.org/simple/ifaddr/ifaddr-0.1.7-py2.py3-none-any.whl (10 kB)
Collecting sgmllib3k
  Downloading https://www.piwheels.org/simple/sgmllib3k/sgmllib3k-1.0.0-py3-none-any.whl (7.1 kB)
Collecting six
  Downloading https://www.piwheels.org/simple/six/six-1.15.0-py2.py3-none-any.whl (10 kB)
Installing collected packages: markupsafe, werkzeug, pytz, Jinja2, itsdangerous, Click, webassets, urllib3, six, sgmllib3k, pyasn1, pathtools, ifaddr, idna, flask, chardet, certifi, Babel, zeroconf, wrapt, websocket-client, watchdog, unidecode, tornado, sentry-sdk, semantic-version, sarge, rsa, requests, regex, PyYAML, pyserial, pylru, psutil, pkginfo, OctoPrint-FirmwareCheck, OctoPrint-FileCheck, netifaces, netaddr, markdown, future, frozendict, Flask-Login, Flask-Babel, Flask-Assets, filetype, feedparser, emoji, cachelib, blinker, octoprint
Successfully installed Babel-2.9.0 Click-7.1.2 Flask-Assets-2.0 Flask-Babel-1.0.0 Flask-Login-0.5.0 Jinja2-2.11.2 OctoPrint-FileCheck-2020.8.7 OctoPrint-FirmwareCheck-2020.9.23 PyYAML-5.3.1 blinker-1.4 cachelib-0.1.1 certifi-2020.12.5 chardet-4.0.0 emoji-0.6.0 feedparser-6.0.2 filetype-1.0.7 flask-1.1.2 frozendict-1.2 future-0.18.2 idna-2.10 ifaddr-0.1.7 itsdangerous-1.1.0 markdown-3.1.1 markupsafe-1.1.1 netaddr-0.8.0 netifaces-0.10.9 octoprint-1.5.2 pathtools-0.1.2 pkginfo-1.6.1 psutil-5.8.0 pyasn1-0.4.8 pylru-1.2.0 pyserial-3.5 pytz-2020.5 regex-2020.11.13 requests-2.25.1 rsa-4.0 sarge-0.1.5.post0 semantic-version-2.8.5 sentry-sdk-0.19.5 sgmllib3k-1.0.0 six-1.15.0 tornado-5.1.1 unidecode-0.4.21 urllib3-1.26.2 watchdog-0.10.4 webassets-2.0 websocket-client-0.57.0 werkzeug-1.0.1 wrapt-1.12.1 zeroconf-0.24.5

The same with pip2 correctly pulls everything from pythonhosted.org, including sources in some cases, doing time-consuming compiling 😄.

I'd say it's safe to apply this on all ARMv6 + ARMv7 when installing Python 3 pip, then we can as well go through some software installs and likely are able to remove build dependencies in most cases. Would be awesome if there was some resource for arm64 wheels, but so far couldn't find any.

Joulinar · 2020-12-28T20:49:45Z

Yes it could save a lot of time for our users doing this change. I guess arm64 will follow is soon as RPi OS 64bit will reach stable status.

did you setup /etc/pip.conf for the Octoprint test?

MichaIng · 2020-12-28T21:02:26Z

Yes, OctoPrint was just the first that came to my mind which pulls a lot of dependencies for testing.

Joulinar · 2020-12-28T21:23:01Z

how did you config file looks like?

MichaIng · 2020-12-28T21:29:02Z

Just your suggestion (=the one suggested by piwheels.org): #3078 (comment)

Joulinar · 2020-12-28T21:30:37Z

ok I thought it could prevent still using pypi.org.

MichaIng · 2020-12-28T21:39:23Z

As the settings name says, it's an "extra" index, no override 😃.

wisehackermonkey · 2020-12-29T00:50:03Z

bump would love to see this added!

wisehackermonkey · 2020-12-29T01:06:03Z

I'm running dietpi on rpi 3,
the

pip3 install docker-compose -i https://www.piwheels.org/simple
didnt work for me. (sadface emoji)
pip2 install took too long and i gave up.
Ended up going with apt install instead. :/
What did work for me was

apt update
apt install docker-compose

Joulinar · 2020-12-29T01:09:02Z

And what is the issue using pip3 install docker-compose -i https://www.piwheels.org/simple? Can you share the error message? Are you running 64 or 32bit OS?

wisehackermonkey · 2020-12-30T01:51:43Z

And what is the issue using pip3 install docker-compose -i https://www.piwheels.org/simple? Can you share the error message? Are you running 64 or 32bit OS?

sorry for being vauge

 uname -a
Linux dietpi3 5.4.72-v8+ #1356 SMP PREEMPT Thu Oct 22 13:58:52 BST 2020 aarch64 GNU/Linux
Dietpi rpi 3, 32bit.

I think i needed to apt update inorder for it to work.

Joulinar · 2020-12-30T01:55:52Z

looks like 64Bit as your kernel is aarch64. On a 64bit system pip3 install docker-compose -i https://www.piwheels.org/simple will not work as currently piwheels did not support Raspberry OS 64bit BETA.

There you have 2 options

wait for pip3 finish compiling up-to-date docker compose (around 30 minutes)
use apt to install 2.5 years old docker compose

wisehackermonkey · 2021-01-03T23:43:12Z

thanks! @Joulinar

Thanks for the support!

For future people googling same issue

here's the steps i ended up using in the end

Link

Install Docker on Raspberry Pi: Installing Docker and Docker Compose on the Raspberry Pi in 5 Simple Steps - DEV

# install python3 dependencies
sudo apt-get install -y libffi-dev libssl-dev
sudo apt-get install -y python3 python3-pip python3-setuptools

#check if python3 installed
python3 -V

# actuall install docker compose
pip3 install docker-compose -i https://www.piwheels.org/simple


docker-compose -v

Dietpi version:

"DietPi v6.34.3"

Hardware:

Raspberry Pi 3 Model B

Joulinar · 2021-01-03T23:48:25Z

Basically Python could have been installed using dietpi-software
libffi-dev libssl-dev should not be required as using -i https://www.piwheels.org/simple will pull already compiled modules.

wisehackermonkey · 2021-02-22T01:23:06Z

so would this work?

# install python3 dependencies
dietpi-software libffi-dev libssl-dev

#check if python3 installed
python3 -V

# actuall install docker compose
pip3 install docker-compose 

docker-compose -v

Joulinar · 2021-02-22T09:39:39Z

no that's not how it is working

it depends if you are running 32 or 64bit OS version as this would make a difference in packages needed 😉
As an alternative, you could try out our new BETA 7.0. This would include Docker-Compose and would allow installation via dietpi-software

wisehackermonkey · 2021-02-25T05:46:37Z

two things:

1) How do i get my hands on `BETA 7.0`?

2) side note:

oh yeah now that i think about it this is wrong dietpi-software libffi-dev libssl-dev

I think it done by package numbers internally?
like:

dietpi-software 73
Note this is a arbitray number for example only

link.
https://github.com/MichaIng/DietPi/blob/master/dietpi/dietpi-software

Joulinar · 2021-02-25T07:21:51Z

Beta can be applied as follow. https://github.com/MichaIng/DietPi/blob/master/BRANCH_SYSTEM.md

MichaIng added the Software request 💿 label Aug 26, 2019

MichaIng changed the title ~~Docker Compose is missing in the Software Cataloge~~ DietPi-Software | Docker Compose Aug 26, 2019

Joulinar mentioned this issue Dec 29, 2020

DietPi-Software | Docker-Compose #4020

Merged

2 tasks

Joulinar linked a pull request Dec 29, 2020 that will close this issue

DietPi-Software | Docker-Compose #4020

Merged

2 tasks

Joulinar mentioned this issue Jan 9, 2021

DietPi-LetsEncrypt | Support multiple domains #1622

Closed

MichaIng added the Solution available 🥂 Definite solution has been done label Jan 25, 2021

MichaIng added this to the v6.35 milestone Jan 25, 2021

MichaIng added the Testing/testers required 🔽 label Jan 25, 2021

MichaIng removed the Testing/testers required 🔽 label Feb 28, 2021

MichaIng closed this as completed Feb 28, 2021

DietPi-Software | Docker Compose #3078

DietPi-Software | Docker Compose #3078

Comments

Gill-Bates commented Aug 25, 2019

MichaIng commented Aug 26, 2019

ModischFabrications commented Oct 7, 2019

Joulinar commented Dec 27, 2020

MichaIng commented Dec 27, 2020

Joulinar commented Dec 27, 2020

Joulinar commented Dec 27, 2020 • edited Loading

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020 • edited Loading

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020 • edited Loading

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020

Joulinar commented Dec 28, 2020 • edited Loading

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020

MichaIng commented Dec 28, 2020 • edited Loading

pip3 on x86_64 (because I had the VM running 😄)

pip2 on x86_64

Joulinar commented Dec 28, 2020

MichaIng commented Dec 28, 2020

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020 • edited Loading

MichaIng commented Dec 28, 2020 • edited Loading

Joulinar commented Dec 28, 2020

MichaIng commented Dec 28, 2020

Joulinar commented Dec 28, 2020

MichaIng commented Dec 28, 2020

wisehackermonkey commented Dec 29, 2020

wisehackermonkey commented Dec 29, 2020

Joulinar commented Dec 29, 2020 • edited Loading

wisehackermonkey commented Dec 30, 2020

Joulinar commented Dec 30, 2020

wisehackermonkey commented Jan 3, 2021 • edited Loading

Thanks for the support!

For future people googling same issue

here's the steps i ended up using in the end

Link

Install Docker on Raspberry Pi: Installing Docker and Docker Compose on the Raspberry Pi in 5 Simple Steps - DEV

Joulinar commented Jan 3, 2021

wisehackermonkey commented Feb 22, 2021

so would this work?

Joulinar commented Feb 22, 2021

wisehackermonkey commented Feb 25, 2021

two things:

1) How do i get my hands on BETA 7.0?

2) side note:

Joulinar commented Feb 25, 2021

Joulinar commented Dec 27, 2020 •

edited

Loading

Joulinar commented Dec 28, 2020 •

edited

Loading

Joulinar commented Dec 28, 2020 •

edited

Loading

Joulinar commented Dec 28, 2020 •

edited

Loading

MichaIng commented Dec 28, 2020 •

edited

Loading

`pip3` on x86_64 (because I had the VM running 😄)

`pip2` on x86_64

Joulinar commented Dec 28, 2020 •

edited

Loading

MichaIng commented Dec 28, 2020 •

edited

Loading

Joulinar commented Dec 29, 2020 •

edited

Loading

wisehackermonkey commented Jan 3, 2021 •

edited

Loading

1) How do i get my hands on `BETA 7.0`?