Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Job post-gateway-api-push-images started failing on 09-11 #1545

Closed
aojea opened this issue Nov 17, 2022 · 18 comments · Fixed by #1553
Closed

Job post-gateway-api-push-images started failing on 09-11 #1545

aojea opened this issue Nov 17, 2022 · 18 comments · Fixed by #1553
Assignees
Labels
kind/bug Categorizes issue or PR as related to a bug.
Milestone

Comments

@aojea
Copy link
Contributor

aojea commented Nov 17, 2022

What happened:

image

https://testgrid.k8s.io/sig-network-gateway-api#post-gateway-api-push-images

hack/build-and-push.sh
unknown flag: --build-arg
See 'docker --help'.
Usage:  docker [OPTIONS] COMMAND

There were several changes in this area 7a13241

@aojea aojea added the kind/bug Categorizes issue or PR as related to a bug. label Nov 17, 2022
@aojea
Copy link
Contributor Author

aojea commented Nov 17, 2022

@wilsonwu you restored those flags recently b48859c

@aojea
Copy link
Contributor Author

aojea commented Nov 17, 2022

/cc @robscott @shaneutt

@wilsonwu
Copy link
Contributor

wilsonwu commented Nov 17, 2022

@wilsonwu you restored those flags recently b48859c

#1542 try to fix in this PR.

The latest problem:

Status: Downloaded newer image for gcr.io/k8s-staging-test-infra/gcb-docker-gcloud:v20211118-2f2d816b90
gcr.io/k8s-staging-test-infra/gcb-docker-gcloud:v20211118-2f2d816b90
hack/build-and-push.sh
unknown shorthand flag: 'f' in -f
See 'docker --help'.
Usage:  docker [OPTIONS] COMMAND

@aojea
Copy link
Contributor Author

aojea commented Nov 17, 2022

wow, that was fast , thanks

/assign @wilsonwu

I'll assign to to you then

@shaneutt shaneutt added this to the v0.6.0 milestone Nov 17, 2022
@wilsonwu
Copy link
Contributor

wilsonwu commented Nov 18, 2022

After #1542 PR merged, still has problem, need help @shaneutt

gcr.io/k8s-staging-test-infra/gcb-docker-gcloud:v20211118-2f2d816b90
hack/build-and-push.sh
unknown shorthand flag: 't' in -t
See 'docker --help'.
Usage:  docker [OPTIONS] COMMAND
A self-sufficient runtime for containers

I tried this docker container can support buildx command.

Timeline of this feature:
#1462 #1522 #1542

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 18, 2022

I can help on this if you are willing to : ) @wilsonwu

@wilsonwu
Copy link
Contributor

I can help on this if you are willing to : ) @wilsonwu

Yes please, I checked that the gcb-docker-gcloud image could support buildx: https://github.com/kubernetes/test-infra/tree/master/images/gcb-docker-gcloud.

And it works in my local env, please help to fix it.

@wilsonwu
Copy link
Contributor

Can you share how you test this image locally @wilsonwu ?

I just tested the make command and script in my local env(not in container), and also checked the job image could support docker buildx command.

BTW: I am tring to use dind to test the script but not success now, still tring...

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 18, 2022

Yep, I tested the gcr.io/k8s-staging-test-infra/gcb-docker-gcloud:v20211118-2f2d816b90, and yes, docker buildx is supported.

#1549 added verify and log for docker buildx, I think this can provide more context on the docker buildx issue.

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 18, 2022

https://prow.k8s.io/view/gs/kubernetes-jenkins/logs/post-gateway-api-push-images/1593583940357066752
Looks like we can not find docker buildx in our CI workflows.

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 18, 2022

This is weird, some options I think:

  1. Try to upgrade the gcb-docker-gcloud image to the latest.
  2. Try to change the build image.

I will take some time later this day to look into this issue.

@shaneutt
Copy link
Member

Sounds good, thanks for the help @Xunzhuo!

@wilsonwu
Copy link
Contributor

wilsonwu commented Nov 18, 2022

I suggest to change a build image.

And I am looking for a good build image from popular repos.

@wilsonwu
Copy link
Contributor

I suggest to change a build image.

And I am looking for a good build image from popular repos.

I found the istio build tools image is good as build image: gcr.io/istio-testing/build-tools

@robscott
Copy link
Member

#1552 didn't work. Looks like we should try to use something like what ingress-nginx is doing: https://github.com/kubernetes/ingress-nginx/blob/main/hack/init-buildx.sh.

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 21, 2022

Nope, something is different now, at least, docker supports docker buildx now.

image

@Xunzhuo
Copy link
Member

Xunzhuo commented Nov 21, 2022

We passed image verify now, before #1552:
image

For now, I think we just need some setups for muli-arch buildx context : )

cc @robscott @wilsonwu

@wilsonwu
Copy link
Contributor

Good job, I added: docker buildx create --use, I think it can be solved.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
5 participants