Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Starting containers via docker-compose fails to mount resolv.conf #11358

Closed
WhyNotHugo opened this issue Aug 30, 2021 · 10 comments · Fixed by #11360
Closed

Starting containers via docker-compose fails to mount resolv.conf #11358

WhyNotHugo opened this issue Aug 30, 2021 · 10 comments · Fixed by #11360
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.

Comments

@WhyNotHugo
Copy link

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description

Steps to reproduce the issue:

$ cat docker-compose.yaml
services:
  nginx:
    image: nginx

Describe the results you received:

$ docker-compose up
Starting tmp_nginx_1 ... error

ERROR: for tmp_nginx_1  error preparing container a6327cb19404a12a4ad73904f0a10a8ec01fa639fe676efdabb4ff31b59cbaf1 for attach: failed to mount resolv.conf for rootless cni: no such file or directory

ERROR: for nginx  error preparing container a6327cb19404a12a4ad73904f0a10a8ec01fa639fe676efdabb4ff31b59cbaf1 for attach: failed to mount resolv.conf for rootless cni: no such file or directory
ERROR: Encountered errors while bringing up the project.

Describe the results you expected:

Should not have crashed and started the container.

Additional information you deem important (e.g. issue happens only occasionally):

#10855 seems somewhat related, but that's actually fixed in 3.3.0, and I'm seeing this issue on 3.3.0.

I've tried rm -rf .config/cni .local/share/containers/ to make sure there's nothing stale/broken there. Still the same issue.

Output of podman version:

Version:      3.3.0
API Version:  3.3.0
Go Version:   go1.17
Git Commit:   98f252a3a1a8f1ee00f9f96c6ba00500954b5093-dirty
Built:        Sat Aug 21 13:48:18 2021
OS/Arch:      linux/amd64

Output of podman info --debug:

host:
  arch: amd64
  buildahVersion: 1.22.3
  cgroupControllers: []
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: /usr/bin/conmon is owned by conmon 1:2.0.29-1
    path: /usr/bin/conmon
    version: 'conmon version 2.0.29, commit: 7e6de6678f6ed8a18661e1d5721b81ccee293b9b'
  cpus: 8
  distribution:
    distribution: arch
    version: unknown
  eventLogger: journald
  hostname: victory
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65537
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65537
  kernel: 5.13.12-arch1-1
  linkmode: dynamic
  memFree: 380837888
  memTotal: 16462667776
  ociRuntime:
    name: crun
    package: /usr/bin/crun is owned by crun 1.0-1
    path: /usr/bin/crun
    version: |-
      crun version 1.0
      commit: 139dc6971e2f1d931af520188763e984d6cdfbf8
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +YAJL
  os: linux
  remoteSocket:
    exists: true
    path: /run/user/1000/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    seccompProfilePath: /etc/containers/seccomp.json
    selinuxEnabled: false
  serviceIsRemote: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: /usr/bin/slirp4netns is owned by slirp4netns 1.1.12-1
    version: |-
      slirp4netns version 1.1.12
      commit: 7a104a101aa3278a2152351a082a6df71f57c9a3
      libslirp: 4.6.1
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.5.1
  swapFree: 28387639296
  swapTotal: 34343288832
  uptime: 93h 19m 19.62s (Approximately 3.88 days)
registries:
  search:
  - docker.io
store:
  configFile: /home/hugo/.config/containers/storage.conf
  containerStore:
    number: 1
    paused: 0
    running: 0
    stopped: 1
  graphDriverName: overlay
  graphOptions: {}
  graphRoot: /home/hugo/.local/share/containers/storage
  graphStatus:
    Backing Filesystem: extfs
    Native Overlay Diff: "true"
    Supports d_type: "true"
    Using metacopy: "false"
  imageStore:
    number: 2
  runRoot: /run/user/1000/containers
  volumePath: /home/hugo/.local/share/containers/storage/volumes
version:
  APIVersion: 3.3.0
  Built: 1629546498
  BuiltTime: Sat Aug 21 13:48:18 2021
  GitCommit: 98f252a3a1a8f1ee00f9f96c6ba00500954b5093-dirty
  GoVersion: go1.17
  OsArch: linux/amd64
  Version: 3.3.0

Package info (e.g. output of rpm -q podman or apt list podman):

Name            : podman
Version         : 3.3.0-1
Description     : Tool and library for running OCI-based containers in pods
Architecture    : x86_64
URL             : https://github.com/containers/podman
Licenses        : Apache
Groups          : None
Provides        : None
Depends On      : cni-plugins  conmon  containers-common  device-mapper  iptables  libseccomp  crun  slirp4netns  libsystemd  fuse-overlayfs
                  libgpgme.so=11-64
Optional Deps   : podman-docker: for Docker-compatible CLI
                  btrfs-progs: support btrfs backend devices [installed]
                  catatonit: --init flag support
                  crun: support for unified cgroupsv2 [installed]
Required By     : toolbox  whynothugo-desktop
Optional For    : None
Conflicts With  : None
Replaces        : None
Installed Size  : 71.69 MiB
Packager        : Morten Linderud <[email protected]>
Build Date      : 2021-08-21T13:48:18 CEST
Install Date    : 2021-08-23T11:44:17 CEST
Install Reason  : Installed as a dependency for another package
Install Script  : No
Validated By    : Signature

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide? (https://github.com/containers/podman/blob/master/troubleshooting.md)

Checked the guide: Yes
Latest stable version: Yes
Latest master: No

Additional environment details (AWS, VirtualBox, physical, etc.):
@openshift-ci openshift-ci bot added the kind/bug Categorizes issue or PR as related to a bug. label Aug 30, 2021
@Luap99
Copy link
Member

Luap99 commented Aug 30, 2021

Can you run rm -rf $XDG_RUNTIME_DIR/rootless-cni and rm $XDG_RUNTIME_DIR/rootless-cni-ns if you have no containers running or just reboot and try again.

@mheon
Copy link
Member

mheon commented Aug 30, 2021

Also, out of curiousity, can you provide ls -al /etc/resolv.conf - possible there's some new systemd-resolved configuration that we don't support quite yet that's breaking things.

@WhyNotHugo
Copy link
Author

I've deleted $XDG_RUNTIME_DIR/rootless-cni. $XDG_RUNTIME_DIR/rootless-cni-ns did not exist.

$ ls -al /etc/resolv.conf
lrwxrwxrwx 1 root root 37 Aug 24 15:40 /etc/resolv.conf -> /run/systemd/resolve/stub-resolv.conf

~
$ cat /etc/resolv.conf
# This is /run/systemd/resolve/stub-resolv.conf managed by man:systemd-resolved(8).
# Do not edit.
#
# This file might be symlinked as /etc/resolv.conf. If you're looking at
# /etc/resolv.conf and seeing this text, you have followed the symlink.
#
# This is a dynamic resolv.conf file for connecting local clients to the
# internal DNS stub resolver of systemd-resolved. This file lists all
# configured search domains.
#
# Run "resolvectl status" to see details about the uplink DNS servers
# currently in use.
#
# Third party programs should typically not access this file directly, but only
# through the symlink at /etc/resolv.conf. To manage man:resolv.conf(5) in a
# different way, replace this symlink by a static file or a different symlink.
#
# See man:systemd-resolved.service(8) for details about the supported modes of
# operation for /etc/resolv.conf.

nameserver 127.0.0.53
options edns0 trust-ad
search lan

@Luap99
Copy link
Member

Luap99 commented Aug 30, 2021

@WhyNotHugo Sorry wrong path it should be rm $XDG_RUNTIME_DIR/netns/rootless-cni-ns. Removing this should make it work again.

@WhyNotHugo
Copy link
Author

I tried rebooting and that hasn't fixed it.

Deleting netns/rootless-cni-ns did not work, nor did deleting netns/ itself.

@Luap99
Copy link
Member

Luap99 commented Aug 30, 2021

OK please start the server with --log-level debug run your docker-compose file and provide the server output.

@WhyNotHugo
Copy link
Author

WhyNotHugo commented Aug 30, 2021 •
edited
Loading

Whoops, the previous comment [now deleted] was a compose file with two containers, here's the correct log:

Aug 30 16:40:20 victory systemd[976]: podman.service: Found left-over process 1696 (slirp4netns) in control group while starting unit. Ignoring.
Aug 30 16:40:20 victory systemd[976]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 30 16:40:20 victory systemd[976]: podman.service: Found left-over process 4904 (slirp4netns) in control group while starting unit. Ignoring.
Aug 30 16:40:20 victory systemd[976]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 30 16:40:20 victory systemd[976]: podman.service: Found left-over process 5298 (slirp4netns) in control group while starting unit. Ignoring.
Aug 30 16:40:20 victory systemd[976]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 30 16:40:20 victory systemd[976]: podman.service: Found left-over process 6971 (slirp4netns) in control group while starting unit. Ignoring.
Aug 30 16:40:20 victory systemd[976]: This usually indicates unclean termination of a previous run, or service implementation deficiencies.
Aug 30 16:40:20 victory systemd[976]: Starting Podman API Service...
Aug 30 16:40:20 victory systemd[976]: Started Podman API Service.
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="/usr/bin/podman filtering at log level debug"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Called service.PersistentPreRunE(/usr/bin/podman --log-level debug system service)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that overlay is supported"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Merged system config \"/usr/share/containers/containers.conf\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Merged system config \"/etc/containers/containers.conf\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that overlay is supported"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using conmon: \"/usr/bin/conmon\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Initializing boltdb state at /home/hugo/.local/share/containers/storage/libpod/bolt_state.db"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using graph driver overlay"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using graph root /home/hugo/.local/share/containers/storage"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using run root /run/user/1000/containers"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using static dir /home/hugo/.local/share/containers/storage/libpod"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using tmp dir /run/user/1000/libpod/tmp"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using volume path /home/hugo/.local/share/containers/storage/volumes"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that overlay is supported"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Set libpod namespace to \"\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="[graphdriver] trying provided driver \"overlay\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that overlay is supported"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that metacopy is not being used"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="cached value indicated that native-diff is usable"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="backingFs=extfs, projectQuotaSupported=false, useNativeDiff=true, usingMetacopy=false"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Initializing event backend journald"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="configured OCI runtime kata initialization failed: no valid executable found for OCI runtime kata: invalid argument"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="configured OCI runtime runsc initialization failed: no valid executable found for OCI runtime runsc: invalid argument"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Using OCI runtime \"/usr/bin/crun\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="Found CNI network podman (type=bridge) at /home/hugo/.config/cni/net.d/87-podman.conflist"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="Found CNI network tmp_default (type=bridge) at /home/hugo/.config/cni/net.d/tmp_default.conflist"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Default CNI network name podman is unchangeable"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="Setting parallel job count to 25"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="using systemd socket activation to determine API endpoint"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="using API endpoint: ''"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="registered SIGHUP watcher for config"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="waiting for SIGHUP to reload configuration"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="CORS Headers were not set"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="API server listening on \"/run/user/1000/podman/podman.sock\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc00052f2c8:new 0m+0h/0t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc00052f2c8:active 0m+0h/1t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- GET /version BEGIN"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- Header: Accept=[*/*]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- Header: Connection=[keep-alive]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Loading registries configuration \"/etc/containers/registries.conf\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="Loading registries configuration \"/etc/containers/registries.conf.d/registries.conf\""
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(f6a0ecea-542f-4901-b06e-ae1521ca0dce) -- GET /version END"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc00052f2c8:idle 1m+0h/1t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc000010080:new 1m+0h/1t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc000010080:active 1m+0h/2t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- GET /v1.40/networks/tmp_default BEGIN"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- Header: Accept=[*/*]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- Header: Connection=[keep-alive]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(61e4140f-c793-4bed-b653-2517b7bcfbde) -- GET /v1.40/networks/tmp_default END"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc000010080:idle 2m+0h/2t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc000130c60:new 2m+0h/2t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="IdleTracker 0xc000130c60:active 2m+0h/3t connection(s)"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=info msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- GET /v1.40/info BEGIN"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- Header: Accept=[*/*]"
Aug 30 16:40:20 victory podman[35740]: time="2021-08-30T16:40:20+02:00" level=debug msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(bcca34f5-1b10-41ac-b8bb-ab68286ea1e9) -- GET /v1.40/info END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130c60:idle 3m+0h/3t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000010080:active 3m+0h/3t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- GET /v1.40/networks/tmp_default BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(0ca9eca8-ca05-4733-b9da-2653d69e2983) -- GET /v1.40/networks/tmp_default END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000010080:idle 3m+0h/3t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:new 3m+0h/3t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:active 3m+0h/4t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- GET /v1.40/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(e467ecb5-d80d-4dae-8b89-59e5c57ff672) -- GET /v1.40/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:idle 4m+0h/4t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:active 4m+0h/4t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- GET /v1.40/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2524dcee-a589-4c5d-b211-4f1ebd9206f1) -- GET /v1.40/containers/json?limit=-1&all=0&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:idle 4m+0h/4t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052fe58:new 4m+0h/4t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052fe58:active 4m+0h/5t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f16be613-d222-4413-bdcf-6c1b54d5a438) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052fe58:idle 5m+0h/5t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:new 5m+0h/5t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:active 5m+0h/6t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(125e6f9c-46c9-49b8-ad59-6e2ccef9c908) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:idle 6m+0h/6t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130038:new 6m+0h/6t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130038:active 6m+0h/7t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- GET /v1.40/containers/47d3d06c9c695a6725ee23d55a4f4d266ecc5c22b58967e2ae8636248938dd99/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(4329233c-a27f-4ecf-8449-2ef467a56a4a) -- GET /v1.40/containers/47d3d06c9c695a6725ee23d55a4f4d266ecc5c22b58967e2ae8636248938dd99/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130038:idle 7m+0h/7t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:new 7m+0h/7t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:active 7m+0h/8t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.service%3Dnginx%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(f2cdc536-02b2-473d-95f6-9b3092c2d4a0) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.service%3Dnginx%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:idle 8m+0h/8t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:active 8m+0h/8t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(cb309318-6b61-4423-a196-75b3c097bd33) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:idle 8m+0h/8t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:new 8m+0h/8t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:active 8m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- GET /v1.40/images/nginx/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Looking up image \"nginx\" in local containers storage"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"nginx\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"localhost/nginx:latest\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"docker.io/library/nginx:latest\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="parsed reference into \"[overlay@/home/hugo/.local/share/containers/storage+/run/user/1000/containers]@dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Found image \"nginx\" as \"docker.io/library/nginx:latest\" in local containers storage"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Found image \"nginx\" as \"docker.io/library/nginx:latest\" in local containers storage ([overlay@/home/hugo/.local/share/containers/storage+/run/user/1000/containers]@dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Inspecting image dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(067e266b-2b88-4e9e-b52a-4aa716cb48fc) -- GET /v1.40/images/nginx/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:idle 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:active 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.service%3Dnginx%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(6b334aa4-1ba1-4673-b2ac-da357cf770a7) -- GET /v1.40/containers/json?limit=-1&all=1&size=0&trunc_cmd=0&filters=%7B%22label%22%3A+%5B%22com.docker.compose.project%3Dtmp%22%2C+%22com.docker.compose.service%3Dnginx%22%2C+%22com.docker.compose.oneoff%3DFalse%22%5D%7D END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:idle 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:active 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- GET /v1.40/images/nginx/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Looking up image \"nginx\" in local containers storage"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"nginx\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"localhost/nginx:latest\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Trying \"docker.io/library/nginx:latest\" ..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="parsed reference into \"[overlay@/home/hugo/.local/share/containers/storage+/run/user/1000/containers]@dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Found image \"nginx\" as \"docker.io/library/nginx:latest\" in local containers storage"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Found image \"nginx\" as \"docker.io/library/nginx:latest\" in local containers storage ([overlay@/home/hugo/.local/share/containers/storage+/run/user/1000/containers]@dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Inspecting image dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="exporting opaque data as blob \"sha256:dd34e67e3371dc2d1328790c3157ee42dfcae74afffd86b297459ed87a98c0fb\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d39b17de-8996-4c42-9db2-2901f290bc44) -- GET /v1.40/images/nginx/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:idle 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:active 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(2699840a-1286-4564-af27-db066758811d) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:idle 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130310:new 9m+0h/9t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130310:active 9m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- POST /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/attach?logs=0&stdout=1&stderr=1&stream=1 BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: Content-Length=[0]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: Connection=[Upgrade]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- Header: Upgrade=[tcp]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="[graphdriver] trying provided driver \"overlay\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="cached value indicated that overlay is supported"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="cached value indicated that metacopy is not being used"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="backingFs=extfs, projectQuotaSupported=false, useNativeDiff=true, usingMetacopy=false"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="overlay: mount_data=,lowerdir=/home/hugo/.local/share/containers/storage/overlay/l/6GAG3UXHQRTHMN6JVYOF5FT2VN:/home/hugo/.local/share/containers/storage/overlay/l/IFL6EHBGQQQBQFDXCPJ73TCBDA:/home/hugo/.local/share/containers/storage/overlay/l/74LMKRN74SOZKJOMKQZU2HW2ZB:/home/hugo/.local/share/containers/storage/overlay/l/LK72MPN7W54LGIJQBJ37IQPTPU:/home/hugo/.local/share/containers/storage/overlay/l/CJ5EZQXNNSDQ2ENSLHZZD2XVF3:/home/hugo/.local/share/containers/storage/overlay/l/DFFGV47IVGVFDDTGWLPB56ZQYC,upperdir=/home/hugo/.local/share/containers/storage/overlay/3cfab70208c4b191bf48309d484d7ce6fe244c1677d1eacd6031730d17765e12/diff,workdir=/home/hugo/.local/share/containers/storage/overlay/3cfab70208c4b191bf48309d484d7ce6fe244c1677d1eacd6031730d17765e12/work,userxattr"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Made network namespace at /run/user/1000/netns/cni-993d7d57-6f43-cb55-1e93-e99e5767ea4c for container a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="The path of /etc/resolv.conf in the mount ns is \"/etc/run/systemd/resolve/stub-resolv.conf\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="mounted container \"a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154\" at \"/home/hugo/.local/share/containers/storage/overlay/3cfab70208c4b191bf48309d484d7ce6fe244c1677d1eacd6031730d17765e12/merged\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Created root filesystem for container a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154 at /home/hugo/.local/share/containers/storage/overlay/3cfab70208c4b191bf48309d484d7ce6fe244c1677d1eacd6031730d17765e12/merged"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="unmounted container \"a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154\""
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Network is already cleaned up, skipping..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Cleaning up container a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Network is already cleaned up, skipping..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="Container a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154 storage is already unmounted, skipping..."
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="Request Failed(Conflict): error preparing container a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154 for attach: failed to mount resolv.conf for rootless cni: no such file or directory"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(d76b69e2-b068-4d05-9d2b-d84323103be0) -- POST /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/attach?logs=0&stdout=1&stderr=1&stream=1 END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130310:idle 10m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:active 10m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=info msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json BEGIN"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- Header: Accept-Encoding=[gzip, deflate]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- Header: Accept=[*/*]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- Header: Connection=[keep-alive]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- Header: User-Agent=[docker-compose/1.29.2 docker-py/5.0.0 Linux/5.13.13-arch1-1]"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="APIHandler(636ab155-879a-4cf4-94ed-e19fdf147660) -- GET /v1.40/containers/a1815c50f14e9aac345d1b6b531b8d093d4f896047e0ed2697e30eac2cd38154/json END"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:idle 10m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130310:closed 10m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130c60:closed 9m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052f2c8:closed 8m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000010080:closed 7m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052e660:closed 6m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc00052fe58:closed 5m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130030:closed 4m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130078:closed 3m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc000130038:closed 2m+0h/10t connection(s)"
Aug 30 16:40:21 victory podman[35740]: time="2021-08-30T16:40:21+02:00" level=debug msg="IdleTracker 0xc0004f0378:closed 1m+0h/10t connection(s)"

@Luap99
Copy link
Member

Luap99 commented Aug 30, 2021

OK I see the error now. I hate symlinks with bind mounts together.

@WhyNotHugo
Copy link
Author

I'm glad you're seeing it, because I'm not :P

Luap99 added a commit to Luap99/libpod that referenced this issue Aug 30, 2021
@Luap99
rootless cni: resolve absolute symlinks correctly
06f94dd 
When /etc/resolv.conf is a symlink to an absolute path use it and not
join it the the previous path.

[NO TESTS NEEDED] This depends on the host layout.

Fixes containers#11358

Signed-off-by: Paul Holzinger <[email protected]>
@Luap99 Luap99 mentioned this issue Aug 30, 2021
Merged
@Luap99
Copy link
Member

Luap99 commented Aug 30, 2021

PR #11360 to fix
This is the important line from your log: The path of /etc/resolv.conf in the mount ns is \"/etc/run/systemd/resolve/stub-resolv.conf\", /etc/run is obviously the wrong path.

mheon pushed a commit to mheon/libpod that referenced this issue Aug 30, 2021
@Luap99 @mheon
rootless cni: resolve absolute symlinks correctly
0103a04 
When /etc/resolv.conf is a symlink to an absolute path use it and not
join it the the previous path.

[NO TESTS NEEDED] This depends on the host layout.

Fixes containers#11358

Signed-off-by: Paul Holzinger <[email protected]>
mheon pushed a commit that referenced this issue Aug 30, 2021
@Luap99 @mheon
rootless cni: resolve absolute symlinks correctly
9dce713 
When /etc/resolv.conf is a symlink to an absolute path use it and not
join it the the previous path.

[NO TESTS NEEDED] This depends on the host layout.

Fixes #11358

Signed-off-by: Paul Holzinger <[email protected]>
@PedroRegisPOAR PedroRegisPOAR mentioned this issue Sep 16, 2021
Open
@github-actions github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 21, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Sep 21, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

rootless cni: resolve absolute symlinks correctly Luap99/libpod
3 participants
@WhyNotHugo @mheon @Luap99