Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

podman stats is broken after some time. #9979

Closed
lemniskett opened this issue Apr 9, 2021 · 2 comments · Fixed by #9982
Closed

podman stats is broken after some time. #9979

lemniskett opened this issue Apr 9, 2021 · 2 comments · Fixed by #9982
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.

Comments

@lemniskett
Copy link

lemniskett commented Apr 9, 2021

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description

podman stats is broken after some time, with error :

Error: unable to obtain cgroup stats: strconv.ParseUint: parsing "26228283908": value out of range

this doesn't happen when I start containers recently.
Steps to reproduce the issue:

  1. Run containers

  2. Check with podman stats

  3. It works

  4. Wait a few hours

  5. Check with podman stats

  6. It doesn't work

Describe the results you received:

Error :

Error: unable to obtain cgroup stats: strconv.ParseUint: parsing "26718118422": value out of range

Describe the results you expected:
podman stats show stats of containers

Additional information you deem important (e.g. issue happens only occasionally):
This issue seems to be only in ARMv7 OS. this doesn't happen when I reinstall with Aarch64 OS.

Output of podman version:

Version:      3.1.0
API Version:  3.1.0
Go Version:   go1.16.2
Git Commit:   9f09fb62cba8f44c18eda84db3e72aab3ae76046-dirty
Built:        Wed Mar 31 22:33:31 2021
OS/Arch:      linux/arm

Output of podman info --debug:

host:
  arch: arm
  buildahVersion: 1.20.0
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: /usr/bin/conmon is owned by conmon 1:2.0.27-1
    path: /usr/bin/conmon
    version: 'conmon version 2.0.27, commit: 65fad4bfcb250df0435ea668017e643e7f462155'
  cpus: 4
  distribution:
    distribution: archarm
    version: unknown
  eventLogger: journald
  hostname: mokoupi
  idMappings:
    gidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
    uidmap:
    - container_id: 0
      host_id: 1000
      size: 1
    - container_id: 1
      host_id: 100000
      size: 65536
  kernel: 5.10.27-1-ARCH
  linkmode: dynamic
  memFree: 298610688
  memTotal: 1015156736
  ociRuntime:
    name: crun
    package: /usr/bin/crun is owned by crun 0.19-1
    path: /usr/bin/crun
    version: |-
      crun version 0.19
      commit: e67a75672412975916dac6b87f8346f870e4b99a
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +YAJL
  os: linux
  remoteSocket:
    path: /run/user/1000/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: true
    seccompEnabled: true
    selinuxEnabled: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: /usr/bin/slirp4netns is owned by slirp4netns 1.1.9-1
    version: |-
      slirp4netns version 1.1.9
      commit: 4e37ea557562e0d7a64dc636eff156f64927335e
      libslirp: 4.4.0
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.5.1
  swapFree: 2537881600
  swapTotal: 2537881600
  uptime: 7h 29m 40.62s (Approximately 0.29 days)
registries: {}
store:
  configFile: /data/home/.config/containers/storage.conf
  containerStore:
    number: 5
    paused: 0
    running: 4
    stopped: 1
  graphDriverName: btrfs
  graphOptions: {}
  graphRoot: /containers
  graphStatus:
    Build Version: 'Btrfs v5.11.1 '
    Library Version: "102"
  imageStore:
    number: 49
  runRoot: /run/user/1000/containers
  volumePath: /containers/volumes
version:
  APIVersion: 3.1.0
  Built: 1617204811
  BuiltTime: Wed Mar 31 22:33:31 2021
  GitCommit: 9f09fb62cba8f44c18eda84db3e72aab3ae76046-dirty
  GoVersion: go1.16.2
  OsArch: linux/arm
  Version: 3.1.0

Package info (e.g. output of rpm -q podman or apt list podman):

Name            : podman
Version         : 3.1.0-1
Description     : Tool and library for running OCI-based containers in pods
Architecture    : armv7h
URL             : https://github.com/containers/libpod
Licenses        : Apache
Groups          : None
Provides        : None
Depends On      : cni-plugins  conmon  containers-common  device-mapper  iptables  libseccomp  runc  slirp4netns  libsystemd
                  fuse-overlayfs  libgpgme.so=11-32
Optional Deps   : podman-docker: for Docker-compatible CLI
                  btrfs-progs: support btrfs backend devices [installed]
                  catatonit: --init flag support
                  crun: support for unified cgroupsv2 [installed]
Required By     : None
Optional For    : None
Conflicts With  : None
Replaces        : None
Installed Size  : 55.44 MiB
Packager        : Arch Linux ARM Build System <[email protected]>
Build Date      : Wed 31 Mar 2021 10:33:31 PM WIB
Install Date    : Thu 08 Apr 2021 11:03:11 AM WIB
Install Reason  : Explicitly installed
Install Script  : No
Validated By    : Signature

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide?

Yes

Additional environment details (AWS, VirtualBox, physical, etc.):

Raspberry Pi 3B+ Arch Linux ARMv7

@openshift-ci-robot openshift-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Apr 9, 2021
giuseppe added a commit to giuseppe/libpod that referenced this issue Apr 9, 2021
[NO TESTS NEEDED]

force bitsSize==64 so that the string is always parsed to a uint64
instead of using the native int size, that could be not big enough on
32 bits arches.

Closes: containers#9979

Signed-off-by: Giuseppe Scrivano <[email protected]>
@giuseppe
Copy link
Member

giuseppe commented Apr 9, 2021

Thanks for the report. PR here: #9982

@lemniskett
Copy link
Author

That was quick, kudos. 👍

mheon pushed a commit to mheon/libpod that referenced this issue Apr 16, 2021
[NO TESTS NEEDED]

force bitsSize==64 so that the string is always parsed to a uint64
instead of using the native int size, that could be not big enough on
32 bits arches.

Closes: containers#9979

Signed-off-by: Giuseppe Scrivano <[email protected]>
jmguzik pushed a commit to jmguzik/podman that referenced this issue Apr 26, 2021
[NO TESTS NEEDED]

force bitsSize==64 so that the string is always parsed to a uint64
instead of using the native int size, that could be not big enough on
32 bits arches.

Closes: containers#9979

Signed-off-by: Giuseppe Scrivano <[email protected]>
@github-actions github-actions bot added the locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments. label Sep 22, 2023
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Sep 22, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
kind/bug Categorizes issue or PR as related to a bug. locked - please file new issue/PR Assist humans wanting to comment on an old issue or PR with locked comments.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants