push doesn't work

[Asgoret]

Can't push image to Harbor registry.
Image name: harbor.io/okd/coreos/configmap-reload:v0.0.1
Commands:
_- podman push harbor.io/okd/coreos/configmap-reload:v0.0.1 harbor.io/okd

• podman push harbor.io/okd/coreos/configmap-reload:v0.0.1
• podman push harbor.io/okd/coreos/configmap-reload:v0.0.1 docker://harbor.io/okd
• podman push harbor.io/okd/coreos/configmap-reload:v0.0.1 docker://harbor.io_
  Output:
  Getting image source signatures Copying blob sha256:91bd48b9e0b007ce035cccf10d1dc7e482695cf492c94808875fa84e71a85482 4.56 MB / 4.56 MB [========================================================] 2s Copying blob sha256:5f70bf18a086007016e948b04aed3b82103a36bea41755b6cddfaf10ace3c6ef 1024 B / 1024 B [==========================================================] 1s Writing manifest to image destination Storing signatures

Version:       0.11.1.1
Go Version:    go1.10.2
OS/Arch:       linux/amd64

[vrothberg]

@Asgoret, thanks for reporting the issue! The version reports 0.11.1.1 which is fairly outdated given Podman 1.0 has been released recently. Can you try reproducing with 1.0?

[Asgoret]

@vrothberg i think it's same issue like this: #1792
Strange...i install podman today from centos repo...ok, i'll try to update

UPD: still 0.11.1.1 in from CentOS repo
UPD#2: list or repo

CentOS-7 - Base 
CentOS OpenShift Origin
Extra Packages for Enterprise Linux 7 - x86_64
CentOS-7 - Extras
CentOS-7 - Updates

[TomSweeneyRedHat]

Also @Asgoret when you retest, please add the debug option podman --debug push harbor.io/okd/coreos/configmap-reload:v0.0.1 harbor.io/okd

[Asgoret]

Also @Asgoret when you retest, please add the debug option podman --debug push harbor.io/okd/coreos/configmap-reload:v0.0.1 harbor.io/okd

Em...

podman push harbor.io/okd/configmap-reload:v0.0.1 harbor.io/okd --debug
podman push --debug harbor.io/okd/configmap-reload:v0.0.1 harbor.io/okd
podman --debug push harbor.io/okd/configmap-reload:v0.0.1 harbor.io/okd

Output:

flag provided but not defined: -debug
See 'podman push --help'.

[vrothberg]

The flag is --log-level=debug. All this is mentioned in the issue template (that I strongly encourage to use).

[Asgoret]

The flag is --log-level=debug. All this is mentioned in the issue template (that I strongly encourage to use).

DEBU[0000] [graphdriver] trying provided driver "overlay"
DEBU[0000] overlay: override_kernelcheck=true
DEBU[0000] overlay test mount with multiple lowers succeeded
DEBU[0000] backingFs=extfs, projectQuotaSupported=false, useNativeDiff=true
INFO[0000] Found CNI network openshift-sdn (type=openshift-sdn) at /etc/cni/net.d/80-openshift-network.conf
INFO[0000] Found CNI network podman (type=bridge) at /etc/cni/net.d/87-podman-bridge.conflist
INFO[0000] Found CNI network openshift-sdn (type=openshift-sdn) at /etc/cni/net.d/openshift-sdn.conf
DEBU[0000] Initializing boltdb state at /var/lib/containers/storage/libpod/bolt_state.db
DEBU[0000] Set libpod namespace to ""
DEBU[0000] parsed reference into "[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.override_kernel_check=true]harbor.io/okd/configmap-reload:v0.0.1"
DEBU[0000] parsed reference into "[overlay@/var/lib/containers/storage+/var/run/containers/storage:overlay.override_kernel_check=true]@3129a2ca29d75226dc5657a4629cdd5f38accda7f5b75bc5d5a76f5b4e0e5870"
DEBU[0000] Using registries.d directory /etc/containers/registries.d for sigstore configuration
DEBU[0000]  Using "default-docker" configuration
DEBU[0000]   Using file:///var/lib/atomic/sigstore
DEBU[0000] Looking for TLS certificates and private keys in /etc/docker/certs.d/harbor.io
DEBU[0000] IsRunningImageAllowed for image containers-storage:[overlay@/var/lib/containers/storage]@3129a2ca29d75226dc5657a4629cdd5f38accda7f5b75bc5d5a76f5b4e0e5870
DEBU[0000]  Using default policy section
DEBU[0000]  Requirement 0: allowed
DEBU[0000] Overall: allowed
Getting image source signatures
DEBU[0000] Manifest has MIME type application/vnd.docker.distribution.manifest.v1+prettyjws, ordered candidate list [application/vnd.docker.distribution.manifest.v1+prettyjws, application/vnd.docker.distribution.manifest.v2+json, application/vnd.oci.image.manifest.v1+json, application/vnd.docker.distribution.manifest.v1+json]
DEBU[0000] ... will first try using the original manifest unmodified
DEBU[0000] Checking /v2/okd/blobs/sha256:91bd48b9e0b007ce035cccf10d1dc7e482695cf492c94808875fa84e71a85482
DEBU[0000] GET https://harbor.io/v2/
DEBU[0000] Ping https://harbor.io/v2/ status 401
DEBU[0000] GET https://harbor.io/service/token?account=user&scope=repository%3Aokd%3Apull%2Cpush&service=harbor-registry
ERRO[0000] Error copying image to the remote destination: Error checking for blob sha256:91bd48b9e0b007ce035cccf10d1dc7e482695cf492c94808875fa84e71a85482 at destination: unexpected http code: 500 (Internal Server Error), URL: https://harbor.io/service/token?account=user&scope=repository%!A(MISSING)okd%!A(MISSING)pull%!C(MISSING)push&service=harbor-registry

It's very odd because i can download my images, but can't see them in GUI Harbor.

[vrothberg]

@mtrmac, do you have a suspicion? What strikes me a bit are the (MISSING) strings in the logs.

[TomSweeneyRedHat]

Thanks @vrothberg, someday I'll get the Buildah/Podman debug options straight.

[Asgoret]

@mtrmac, do you have a suspicion? What strikes me a bit are the (MISSING) strings in the logs.

Same issue #1792, but we install harbor week ago. So, it's newer then last comment in #1792

[mtrmac]

Same issue #1792, but we install harbor week ago. So, it's newer then last comment in #1792

#1792 only says that the code has been committed into the Harbor master branch; I haven’t checked at all whether there has been a release since, or what its version number is.

[mtrmac]

@mtrmac, do you have a suspicion? What strikes me a bit are the (MISSING) strings in the logs.

That’s https://github.com/containers/libpod/blob/ec969875fa13e90f4ce696e9d24b86a02f79f54a/cmd/podman/main.go#L214 treating an ordinary string (with untrusted contents!) as a format string. I vaguely remember fixing that some time ago?!

[mtrmac]

#1792 only says that the code has been committed into the Harbor master branch; I haven’t checked at all whether there has been a release since, or what its version number is.

The commit is goharbor/harbor#6689 , and it is not yet included in the latest 1.7.1 release.

[Asgoret]

#1792 only says that the code has been committed into the Harbor master branch; I haven’t checked at all whether there has been a release since, or what its version number is.

The commit is goharbor/harbor#6689 , and it is not yet included in the latest 1.7.1 release.

Already. Thanks)

[Asgoret]

FYI @mtrmac