no such file error on removing a podman machine never started

[benoitf]

Is this a BUG REPORT or FEATURE REQUEST? (leave only one on its own line)

/kind bug

Description

Create a podman machine and then remove it without starting it

Steps to reproduce the issue:

1. podman machine init my-test

2. podman machine rm my-test

Describe the results you received:

The following files will be deleted:

/Users/benoitf/.ssh/my-test
/Users/benoitf/.ssh/my-test.pub
/Users/benoitf/.config/containers/podman/machine/qemu/my-test.ign
/Users/benoitf/.local/share/containers/podman/machine/qemu/my-test_fedora-coreos-35.20220305.dev.0-qemu.x86_64.qcow2
/Users/benoitf/.local/share/containers/podman/machine/my-test/podman.sock
/Users/benoitf/.config/containers/podman/machine/qemu/my-test.json


Are you sure you want to continue? [y/N] y
ERRO[0002] remove /Users/benoitf/.local/share/containers/podman/machine/my-test/podman.sock: no such file or directory

Describe the results you expected:
No error ERRO[0002] remove /Users/benoitf/.local/share/containers/podman/machine/my-test/podman.sock: no such file or directory

Additional information you deem important (e.g. issue happens only occasionally):

Output of podman version:

main branch / 81b9646ceba05b2780d8c8210d60df4eaf6a3bdf 

Output of podman info --debug:

(paste your output here)

Package info (e.g. output of rpm -q podman or apt list podman):

(paste your output here)

Have you tested with the latest version of Podman and have you checked the Podman Troubleshooting Guide? (https://github.com/containers/podman/blob/main/troubleshooting.md)

Yes/No

Additional environment details (AWS, VirtualBox, physical, etc.):