Healthcheck always shows "starting" when disabled with --no-healthcheck

[ryester19]

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)
/kind bug

Description
When running a container with the --no-healthcheck option, the healthcheck is still present and always shows "starting" when viewing container status using "podman container ls"

Steps to reproduce the issue:

1. Create container with --no-healthcheck option

2. Execute "podman container ls"

Describe the results you received:
The container always shows "(starting)" underneath its status

Describe the results you expected:
Since the healthcheck was disabled, "(starting)" shouldn't be showing at all. The status should display like the rest of the containers that don't have a healthcheck specified in their Dockerfile

Additional information you deem important (e.g. issue happens only occasionally):

Output of podman version:

Client:       Podman Engine
Version:      4.0.1
API Version:  4.0.1
Go Version:   go1.17.8
Git Commit:   c8b9a2e3ec3630e9172499e15205c11b823c8107
Built:        Sun Mar 13 07:44:23 2022
OS/Arch:      linux/amd64

Output of podman info --debug:

host:
  arch: amd64
  buildahVersion: 1.24.1
  cgroupControllers:
  - cpuset
  - cpu
  - io
  - memory
  - hugetlb
  - pids
  - rdma
  - misc
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: /usr/bin/conmon is owned by conmon 1:2.1.0-1
    path: /usr/bin/conmon
    version: 'conmon version 2.1.0, commit: bdb4f6e56cd193d40b75ffc9725d4b74a18cb33c'
  cpus: 4
  distribution:
    distribution: arch
    version: unknown
  eventLogger: journald
  hostname: ryester27
  idMappings:
    gidmap: null
    uidmap: null
  kernel: 5.16.15-arch1-1
  linkmode: dynamic
  logDriver: journald
  memFree: 2627780608
  memTotal: 4074893312
  networkBackend: netavark
  ociRuntime:
    name: crun
    package: /usr/bin/crun is owned by crun 1.4.3-1
    path: /usr/bin/crun
    version: |-
      crun version 1.4.3
      commit: 61c9600d1335127eba65632731e2d72bc3f0b9e8
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL
  os: linux
  remoteSocket:
    path: /run/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: false
    seccompEnabled: true
    seccompProfilePath: /etc/containers/seccomp.json
    selinuxEnabled: false
  serviceIsRemote: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: /usr/bin/slirp4netns is owned by slirp4netns 1.1.12-1
    version: |-
      slirp4netns version 1.1.12
      commit: 7a104a101aa3278a2152351a082a6df71f57c9a3
      libslirp: 4.6.1
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.5.3
  swapFree: 0
  swapTotal: 0
  uptime: 10h 6m 55.33s (Approximately 0.42 days)
plugins:
  log:
  - k8s-file
  - none
  - passthrough
  - journald
  network:
  - bridge
  - macvlan
  volume:
  - local
registries:
  search:
  - docker.io
store:
  configFile: /etc/containers/storage.conf
  containerStore:
    number: 3
    paused: 0
    running: 3
    stopped: 0
  graphDriverName: overlay
  graphOptions:
    overlay.mountopt: nodev
  graphRoot: /var/lib/containers/storage
  graphStatus:
    Backing Filesystem: btrfs
    Native Overlay Diff: "false"
    Supports d_type: "true"
    Using metacopy: "true"
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 3
  runRoot: /run/containers/storage
  volumePath: /var/lib/containers/storage/volumes
version:
  APIVersion: 4.0.1
  Built: 1647171863
  BuiltTime: Sun Mar 13 07:44:23 2022
  GitCommit: c8b9a2e3ec3630e9172499e15205c11b823c8107
  GoVersion: go1.17.8
  OsArch: linux/amd64
  Version: 4.0.1

Package info (e.g. output of rpm -q podman or apt list podman):

Name            : podman
Version         : 4.0.1-2
Description     : Tool and library for running OCI-based containers in pods
Architecture    : x86_64
URL             : https://github.com/containers/podman
Licenses        : Apache
Groups          : None
Provides        : None
Depends On      : conmon  containers-common  crun  iptables  libdevmapper.so=1.02-64  libgpgme.so=11-64  libseccomp.so=2-64  slirp4netns
Optional Deps   : apparmor: for AppArmor support
                  btrfs-progs: support btrfs backend devices [installed]
                  catatonit: --init flag support
                  netavark: for a new container-network-stack implementation [installed]
                  podman-compose: for docker-compose compatibility
                  podman-docker: for Docker-compatible CLI
Required By     : None
Optional For    : None
Conflicts With  : None
Replaces        : None
Installed Size  : 79.67 MiB
Packager        : David Runge <[email protected]>
Build Date      : Sun 13 Mar 2022 07:44:23 AM EDT
Install Date    : Thu 17 Mar 2022 11:26:26 AM EDT
Install Reason  : Explicitly installed
Install Script  : No
Validated By    : Signature

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide? (https://github.com/containers/podman/blob/main/troubleshooting.md)

Yes

Additional environment details (AWS, VirtualBox, physical, etc.):

[mheon]

Can you include a podman inspect of a container showing this symptom?

[ryester19]

Can you include a podman inspect of a container showing this symptom?

[
     {
          "Id": "fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962",
          "Created": "2022-03-21T11:02:05.995621881-04:00",
          "Path": "./gotify-app",
          "Args": [
               "./gotify-app"
          ],
          "State": {
               "OciVersion": "1.0.2-dev",
               "Status": "running",
               "Running": true,
               "Paused": false,
               "Restarting": false,
               "OOMKilled": false,
               "Dead": false,
               "Pid": 16329,
               "ConmonPid": 16326,
               "ExitCode": 0,
               "Error": "",
               "StartedAt": "2022-03-21T11:02:06.19257553-04:00",
               "FinishedAt": "0001-01-01T00:00:00Z",
               "Health": {
                    "Status": "starting",
                    "FailingStreak": 0,
                    "Log": null
               },
               "CgroupPath": "/machine.slice/libpod-fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962.scope",
               "CheckpointedAt": "0001-01-01T00:00:00Z",
               "RestoredAt": "0001-01-01T00:00:00Z"
          },
          "Image": "8f205770067448164920785e83a45386e561d37d933b28261828762a08a504f5",
          "ImageName": "docker.io/gotify/server:latest",
          "Rootfs": "",
          "Pod": "",
          "ResolvConfPath": "/run/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/resolv.conf",
          "HostnamePath": "/run/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/hostname",
          "HostsPath": "/run/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/hosts",
          "StaticDir": "/var/lib/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata",
          "OCIConfigPath": "/var/lib/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/config.json",
          "OCIRuntime": "crun",
          "ConmonPidFile": "/run/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/conmon.pid",
          "PidFile": "/run/containers/storage/overlay-containers/fe9af285a13c8d5e0613ebaee0ec87a572b8317766330b7c67b97eb964d6c962/userdata/pidfile",
          "Name": "gotify",
          "RestartCount": 0,
          "Driver": "overlay",
          "MountLabel": "",
          "ProcessLabel": "",
          "AppArmorProfile": "",
          "EffectiveCaps": [
               "CAP_CHOWN",
               "CAP_DAC_OVERRIDE",
               "CAP_FOWNER",
               "CAP_FSETID",
               "CAP_KILL",
               "CAP_NET_BIND_SERVICE",
               "CAP_SETFCAP",
               "CAP_SETGID",
               "CAP_SETPCAP",
               "CAP_SETUID",
               "CAP_SYS_CHROOT"
          ],
          "BoundingCaps": [
               "CAP_CHOWN",
               "CAP_DAC_OVERRIDE",
               "CAP_FOWNER",
               "CAP_FSETID",
               "CAP_KILL",
               "CAP_NET_BIND_SERVICE",
               "CAP_SETFCAP",
               "CAP_SETGID",
               "CAP_SETPCAP",
               "CAP_SETUID",
               "CAP_SYS_CHROOT"
          ],
          "ExecIDs": [],
          "GraphDriver": {
               "Name": "overlay",
               "Data": {
                    "LowerDir": "/var/lib/containers/storage/overlay/740922b15e9c4816cc9c69374bb4399a900fc268161c0453284b1b822d36bec2/diff:/var/lib/containers/storage/overlay/e0600e895177f8c108aa70f250ba8079ef9b797447e56d39385203a63add212b/diff:/var/lib/containers/storage/overlay/13d0d18349389184d14ebf82d91dbcc2c57be2cd9ff22c302f2b0636beab92d8/diff:/var/lib/containers/storage/overlay/9a1c2b9b8312a20cecfa41f171ab1a8626ff93b8279d27c87436151ca16c0465/diff",
                    "MergedDir": "/var/lib/containers/storage/overlay/f5fa854e8338b98139d4a0ff8c88654c4e6428ffd24bb8e67563906043dfbeab/merged",
                    "UpperDir": "/var/lib/containers/storage/overlay/f5fa854e8338b98139d4a0ff8c88654c4e6428ffd24bb8e67563906043dfbeab/diff",
                    "WorkDir": "/var/lib/containers/storage/overlay/f5fa854e8338b98139d4a0ff8c88654c4e6428ffd24bb8e67563906043dfbeab/work"
               }
          },
          "Mounts": [
               {
                    "Type": "volume",
                    "Name": "gotify_data",
                    "Source": "/var/lib/containers/storage/volumes/gotify_data/_data",
                    "Destination": "/app/data",
                    "Driver": "local",
                    "Mode": "",
                    "Options": [
                         "nosuid",
                         "nodev",
                         "rbind"
                    ],
                    "RW": true,
                    "Propagation": "rprivate"
               }
          ],
          "Dependencies": [],
          "NetworkSettings": {
               "EndpointID": "",
               "Gateway": "",
               "IPAddress": "",
               "IPPrefixLen": 0,
               "IPv6Gateway": "",
               "GlobalIPv6Address": "",
               "GlobalIPv6PrefixLen": 0,
               "MacAddress": "",
               "Bridge": "",
               "SandboxID": "",
               "HairpinMode": false,
               "LinkLocalIPv6Address": "",
               "LinkLocalIPv6PrefixLen": 0,
               "Ports": {
                    "80/tcp": null
               },
               "SandboxKey": "/run/netns/netns-a61dd282-efbb-7596-97c5-a4531196167d",
               "Networks": {
                    "services": {
                         "EndpointID": "",
                         "Gateway": "10.89.0.1",
                         "IPAddress": "10.89.0.7",
                         "IPPrefixLen": 24,
                         "IPv6Gateway": "",
                         "GlobalIPv6Address": "",
                         "GlobalIPv6PrefixLen": 0,
                         "MacAddress": "6e:13:d1:c6:96:1a",
                         "NetworkID": "services",
                         "DriverOpts": null,
                         "IPAMConfig": null,
                         "Links": null,
                         "Aliases": [
                              "fe9af285a13c"
                         ]
                    }
               }
          },
          "Namespace": "",
          "IsInfra": false,
          "Config": {
               "Hostname": "fe9af285a13c",
               "Domainname": "",
               "User": "",
               "AttachStdin": false,
               "AttachStdout": false,
               "AttachStderr": false,
               "Tty": false,
               "OpenStdin": false,
               "StdinOnce": false,
               "Env": [
                    "GOTIFY_SERVER_PORT=80",
                    "GOTIFY_DATABASE_DIALECT=postgres",
                    "PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin",
                    "TERM=xterm",
                    "container=podman",
                    "HOME=/root",
                    "HOSTNAME=fe9af285a13c",
                    "GOTIFY_DATABASE_CONNECTION=host=postgres port=5432 user=gotify dbname=gotify password=*** sslmode=disable\n"
               ],
               "Cmd": null,
               "Image": "docker.io/gotify/server:latest",
               "Volumes": null,
               "WorkingDir": "/app",
               "Entrypoint": "./gotify-app",
               "OnBuild": null,
               "Labels": null,
               "Annotations": {
                    "io.container.manager": "libpod",
                    "io.kubernetes.cri-o.Created": "2022-03-21T11:02:05.995621881-04:00",
                    "io.kubernetes.cri-o.TTY": "false",
                    "io.podman.annotations.autoremove": "FALSE",
                    "io.podman.annotations.init": "FALSE",
                    "io.podman.annotations.privileged": "FALSE",
                    "io.podman.annotations.publish-all": "FALSE",
                    "org.opencontainers.image.stopSignal": "15"
               },
               "StopSignal": 15,
               "Healthcheck": {
                    "Test": [
                         "NONE"
                    ]
               },
               "CreateCommand": [
                    "podman",
                    "run",
                    "-d",
                    "--name=gotify",
                    "--net=services",
                    "--ip=10.89.0.7",
                    "--no-healthcheck",
                    "-e",
                    "GOTIFY_DATABASE_DIALECT=postgres",
                    "--secret=gotify_connection,type=env,target=GOTIFY_DATABASE_CONNECTION",
                    "-v",
                    "gotify_data:/app/data",
                    "gotify/server"
               ],
               "Umask": "0022",
               "Timeout": 0,
               "StopTimeout": 10,
               "Passwd": true
          },
          "HostConfig": {
               "Binds": [
                    "gotify_data:/app/data:rw,rprivate,nosuid,nodev,rbind"
               ],
               "CgroupManager": "systemd",
               "CgroupMode": "private",
               "ContainerIDFile": "",
               "LogConfig": {
                    "Type": "journald",
                    "Config": null,
                    "Path": "",
                    "Tag": "",
                    "Size": "0B"
               },
               "NetworkMode": "bridge",
               "PortBindings": {
                    "80/tcp": null
               },
               "RestartPolicy": {
                    "Name": "",
                    "MaximumRetryCount": 0
               },
               "AutoRemove": false,
               "VolumeDriver": "",
               "VolumesFrom": null,
               "CapAdd": [],
               "CapDrop": [
                    "CAP_AUDIT_WRITE",
                    "CAP_MKNOD",
                    "CAP_NET_RAW"
               ],
               "Dns": [],
               "DnsOptions": [],
               "DnsSearch": [],
               "ExtraHosts": [],
               "GroupAdd": [],
               "IpcMode": "private",
               "Cgroup": "",
               "Cgroups": "default",
               "Links": null,
               "OomScoreAdj": 0,
               "PidMode": "private",
               "Privileged": false,
               "PublishAllPorts": false,
               "ReadonlyRootfs": false,
               "SecurityOpt": [],
               "Tmpfs": {},
               "UTSMode": "private",
               "UsernsMode": "",
               "ShmSize": 65536000,
               "Runtime": "oci",
               "ConsoleSize": [
                    0,
                    0
               ],
               "Isolation": "",
               "CpuShares": 0,
               "Memory": 0,
               "NanoCpus": 0,
               "CgroupParent": "",
               "BlkioWeight": 0,
               "BlkioWeightDevice": null,
               "BlkioDeviceReadBps": null,
               "BlkioDeviceWriteBps": null,
               "BlkioDeviceReadIOps": null,
               "BlkioDeviceWriteIOps": null,
               "CpuPeriod": 0,
               "CpuQuota": 0,
               "CpuRealtimePeriod": 0,
               "CpuRealtimeRuntime": 0,
               "CpusetCpus": "",
               "CpusetMems": "",
               "Devices": [],
               "DiskQuota": 0,
               "KernelMemory": 0,
               "MemoryReservation": 0,
               "MemorySwap": 0,
               "MemorySwappiness": 0,
               "OomKillDisable": false,
               "PidsLimit": 2048,
               "Ulimits": [
                    {
                         "Name": "RLIMIT_NOFILE",
                         "Soft": 1048576,
                         "Hard": 1048576
                    },
                    {
                         "Name": "RLIMIT_NPROC",
                         "Soft": 4194304,
                         "Hard": 4194304
                    }
               ],
               "CpuCount": 0,
               "CpuPercent": 0,
               "IOMaximumIOps": 0,
               "IOMaximumBandwidth": 0,
               "CgroupConf": null
          }
     }
]

[mheon]

@baude PTAL

[flouthoc]

Above PR should close this issue.