flake: podman exec /no/such/command (sometimes) returns rc=1 (should be 127)

[edsantiago]

Flake see in #7383, fedora 31:

# podman exec 2b05948af6c1ddf86c2f6f0d14e304101e09a6353e5286950ce6a1cd6e7113f4 /no/such/command
executable file not found in $PATH: No such file or directory
[ rc=1 (** EXPECTED 127 **) ]

I was not able to reproduce on rawhide, but this will (very infrequently) reproduce it on f31:

# podman run -d --name foo alpine sleep 600
ee2b34761690b347077ae32eb3f353e9220d25ebff35779127fea0d167c88e0d

# while :;do podman exec foo true;podman exec foo /etc 2>/dev/null; podman exec foo /no/such/command 2>/dev/null; rc=$?;if [ $rc -ne 127 ]; then echo "$(date) FOO! rc=$rc";fi;done
Thu 20 Aug 2020 10:57:52 AM EDT FOO! rc=1
Thu 20 Aug 2020 11:00:10 AM EDT FOO! rc=1
Thu 20 Aug 2020 11:02:15 AM EDT FOO! rc=1

podman-2:2.0.4-1.fc31 but the link above is to CI.

I don't know if the true or /etc are necessary. This is infrequent (see timestamps above) so I'm having to engage in cargo-culting.

Smells like a race condition. I don't know if it's podman or conmon or something else.

[rhatdan]

Is this still an issue, I tried the test and it never failed until the master container exited?

[edsantiago]

Still failing on f31 with podman-2:2.0.6-1.fc31.x86_64:

Mon 14 Sep 2020 08:58:12 AM EDT FOO! rc=1
Mon 14 Sep 2020 08:58:34 AM EDT FOO! rc=1
Mon 14 Sep 2020 09:00:51 AM EDT FOO! rc=1
Mon 14 Sep 2020 09:03:23 AM EDT FOO! rc=1

Cannot reproduce in f32, even given 25 minutes. I have not seen this in CI since the initial report. I'm not going to be the one to close this, but I'll understand and accept if someone else does.

[edsantiago]

Oh dear, I spoke too soon. Failure in #7452, prior-fedora (which I have to assume is f31), RCLI=false. log.

# # podman exec 631eafcf9120d015036c31b877f54b399bb5a20fe98f860c1cd362ade3d7c7e5 /etc
# open executable: Operation not permitted
# [ rc=1 (** EXPECTED 126 **) ]

[rhatdan]

Fixed in latest release on newer OS.