[F36 CI] Error: netavark: no static ips provided

[cevich]

/kind bug

Description

While running the e2e (integration) tests on Fedora 36, the podman run with ipam none driver test is failing across the entire matrix.
Representitive annotated log.

Steps to reproduce the issue:

1. Execute e2e tests in Update to F36 CI VM Images + Testing netavark/aardvark-dns #13376

Describe the results you received:

         [It] podman run with ipam none driver
           /var/tmp/go/src/github.com[/containers/podman/test/e2e/run_networking_test.go:1123](https://github.com/containers/podman/blob/ea446282dccda601e1ba7616304415862aae8082/test/e2e/run_networking_test.go#L1123)
         # podman [options] network create --ipam-driver=none ipam6e1dacca6d6bdc6013424c92d0fbb04125ead06da101868f541b9aaaaafbfd4f
         ipam6e1dacca6d6bdc6013424c92d0fbb04125ead06da101868f541b9aaaaafbfd4f
         # podman [options] run --network ipam6e1dacca6d6bdc6013424c92d0fbb04125ead06da101868f541b9aaaaafbfd4f quay.io/libpod/alpine:latest ip addr show eth0
         Error: netavark: no static ips provided
         # podman [options] network rm -f ipam6e1dacca6d6bdc6013424c92d0fbb04125ead06da101868f541b9aaaaafbfd4f
         ipam6e1dacca6d6bdc6013424c92d0fbb04125ead06da101868f541b9aaaaafbfd4f
         [AfterEach] Podman run networking
           /var/tmp/go/src/github.com[/containers/podman/test/e2e/run_networking_test.go:38](https://github.com/containers/podman/blob/ea446282dccda601e1ba7616304415862aae8082/test/e2e/run_networking_test.go#L38)
         # podman [options] stop -a --time 0
         # podman [options] pod stop -a -t 0
         # podman [options] pod rm -fa
         # podman [options] rm -fa
         
         • Failure [3.084 seconds]
         Podman run networking
         /var/tmp/go/src/github.com[/containers/podman/test/e2e/run_networking_test.go:20](https://github.com/containers/podman/blob/ea446282dccda601e1ba7616304415862aae8082/test/e2e/run_networking_test.go#L20)
           podman run with ipam none driver [It]
           /var/tmp/go/src/github.com[/containers/podman/test/e2e/run_networking_test.go:1123](https://github.com/containers/podman/blob/ea446282dccda601e1ba7616304415862aae8082/test/e2e/run_networking_test.go#L1123)
         
           Expected
               <int>: 126
           to match exit code:
               <int>: 0

Describe the results you expected:

All tests should pass

Additional information you deem important (e.g. issue happens only occasionally):

Output of podman version:

version:
  APIVersion: 4.0.0-dev
  Built: 1649782980
  BuiltTime: Tue Apr 12 12:03:00 2022
  GitCommit: ea446282dccda601e1ba7616304415862aae8082
  GoVersion: go1.18
  Os: linux
  OsArch: linux/amd64
  Version: 4.0.0-dev

Output of podman info --debug:

host:
  arch: amd64
  buildahVersion: 1.26.0-dev
  cgroupControllers:
  - cpuset
  - cpu
  - io
  - memory
  - hugetlb
  - pids
  - misc
  cgroupManager: systemd
  cgroupVersion: v2
  conmon:
    package: conmon-2.1.0-2.fc36.x86_64
    path: /usr/bin/conmon
    version: 'conmon version 2.1.0, commit: '
  cpus: 2
  distribution:
    distribution: fedora
    variant: cloud
    version: "36"
  eventLogger: journald
  hostname: cirrus-task-6394012331409408
  idMappings:
    gidmap: null
    uidmap: null
  kernel: 5.17.2-300.fc36.x86_64
  linkmode: dynamic
  logDriver: journald
  memFree: 1597206528
  memTotal: 4109574144
  networkBackend: netavark
  ociRuntime:
    name: crun
    package: crun-1.4.4-1.fc36.x86_64
    path: /usr/bin/crun
    version: |-
      crun version 1.4.4
      commit: 6521fcc5806f20f6187eb933f9f45130c86da230
      spec: 1.0.0
      +SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL
  os: linux
  remoteSocket:
    path: /run/podman/podman.sock
  security:
    apparmorEnabled: false
    capabilities: CAP_CHOWN,CAP_DAC_OVERRIDE,CAP_FOWNER,CAP_FSETID,CAP_KILL,CAP_NET_BIND_SERVICE,CAP_SETFCAP,CAP_SETGID,CAP_SETPCAP,CAP_SETUID,CAP_SYS_CHROOT
    rootless: false
    seccompEnabled: true
    seccompProfilePath: /usr/share/containers/seccomp.json
    selinuxEnabled: true
  serviceIsRemote: false
  slirp4netns:
    executable: /usr/bin/slirp4netns
    package: slirp4netns-1.2.0-0.2.beta.0.fc36.x86_64
    version: |-
      slirp4netns version 1.2.0-beta.0
      commit: 477db14a24ff1a3de3a705e51ca2c4c1fe3dda64
      libslirp: 4.6.1
      SLIRP_CONFIG_VERSION_MAX: 3
      libseccomp: 2.5.3
  swapFree: 4097044480
  swapTotal: 4109365248
  uptime: 34m 25.6s
plugins:
  log:
  - k8s-file
  - none
  - passthrough
  - journald
  network:
  - bridge
  - macvlan
  volume:
  - local
registries:
  docker.io:
    Blocked: false
    Insecure: false
    Location: mirror.gcr.io
    MirrorByDigestOnly: false
    Mirrors: null
    Prefix: docker.io
    PullFromMirror: ""
  docker.io/library:
    Blocked: false
    Insecure: false
    Location: quay.io/libpod
    MirrorByDigestOnly: false
    Mirrors: null
    Prefix: docker.io/library
    PullFromMirror: ""
  localhost:5000:
    Blocked: false
    Insecure: true
    Location: localhost:5000
    MirrorByDigestOnly: false
    Mirrors: null
    Prefix: localhost:5000
    PullFromMirror: ""
  search:
  - docker.io
  - quay.io
  - registry.fedoraproject.org
store:
  configFile: /usr/share/containers/storage.conf
  containerStore:
    number: 0
    paused: 0
    running: 0
    stopped: 0
  graphDriverName: overlay
  graphOptions:
    overlay.mountopt: nodev,metacopy=on
  graphRoot: /var/lib/containers/storage
  graphStatus:
    Backing Filesystem: btrfs
    Native Overlay Diff: "false"
    Supports d_type: "true"
    Using metacopy: "true"
  imageCopyTmpDir: /var/tmp
  imageStore:
    number: 0
  runRoot: /run/containers/storage
  volumePath: /var/lib/containers/storage/volumes
version:
  APIVersion: 4.0.0-dev
  Built: 1649782980
  BuiltTime: Tue Apr 12 12:03:00 2022
  GitCommit: ea446282dccda601e1ba7616304415862aae8082
  GoVersion: go1.18
  Os: linux
  OsArch: linux/amd64
  Version: 4.0.0-dev

Package info (e.g. output of rpm -q podman or apt list podman):

Fedora release 36 (Thirty Six)
Kernel:  5.17.2-300.fc36.x86_64
Cgroups:  cgroup2fs
conmon-2.1.0-2.fc36-x86_64
containers-common-1-53.fc36-noarch
container-selinux-2.181.0-2.fc36-noarch
criu-3.16.1-7.fc36-x86_64
crun-1.4.4-1.fc36-x86_64
golang-1.18-1.fc36-x86_64
libseccomp-2.5.3-2.fc36-x86_64
netavark-1.0.2-1.fc36-x86_64
package aardvark is not installed
package containernetworking-plugins is not installed
podman-4.0.3-1.fc36-x86_64
runc-1.1.1-1.fc36-x86_64
skopeo-1.7.0-1.fc36-x86_64
slirp4netns-1.2.0-0.2.beta.0.fc36-x86_64

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide? (https://github.com/containers/podman/blob/main/troubleshooting.md)

Yes

Additional environment details (AWS, VirtualBox, physical, etc.):

[Luap99]

You need a newer (I guess unreleased) netavark for that

[Luap99]

just skip it for now

[cevich]

just skip it for now

Yep, already done (referencing this issue). Glad to hear it's fixed, so when we get updated VM images later, I'll need to check. Any idea what the minimum version will be (when released) that I should look out for?

[Luap99]

The next version, so either 1.0.3 or 1.1.0 not sure what we decide.

[Luap99]

@baude @mheon I think we should also cut new netavark/aardvark version for podman 4.1-rc1

[mheon]

SGTM

[rhatdan]

I agree, we need to cut new versions of those plus skopeo and Buildah.

[github-actions]

A friendly reminder that this issue had no activity for 30 days.