Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI][Release] Verification jobs are failing due to curl failure #41007

Closed
raulcd opened this issue Apr 4, 2024 · 2 comments
Closed

[CI][Release] Verification jobs are failing due to curl failure #41007

raulcd opened this issue Apr 4, 2024 · 2 comments
Assignees
@raulcd
Labels
Component: Continuous Integration Component: Release Type: bug
Milestone
16.0.0

Comments

@raulcd
Copy link
Member

raulcd commented Apr 4, 2024

Describe the bug, including details regarding any error messages, version, and platform.

Almost all verification jobs have failed with:

 Verifying official Arrow release candidate 1{VERIFY_VERSION}-rc1{VERIFY_RC}
/tmp/arrow-1{VERIFY_VERSION}.3Hi7b /
gpg: directory '/root/.gnupg' created
gpg: keybox '/root/.gnupg/pubring.kbx' created
gpg: key 97D7E8647AE7E47B: 2 signatures not checked due to missing keys
gpg: /root/.gnupg/trustdb.gpg: trustdb created
gpg: key 97D7E8647AE7E47B: public key "Julien Le Dem <[email protected]>" imported
gpg: key 02DABFDF1679D194: public key "Julien Le Dem <[email protected]>" imported
gpg: key 29D94E228CAAD602: public key "Uwe L. Korn <[email protected]>" imported
gpg: key F105883A1735623D: public key "William Wesley McKinney (CODE SIGNING KEY) <[email protected]>" imported
gpg: key 91D18FCF079F8007: 38 signatures not checked due to missing keys
gpg: key 91D18FCF079F8007: public key "Kouhei Sutou <[email protected]>" imported
gpg: key 9F453D0CC3E4F6BA: public key "Charles Phillip Cloud <[email protected]>" imported
gpg: key 769BDC2129C2658C: public key "keybase.io/pitrou <[email protected]>" imported
gpg: key 25BCCA5220D84079: public key "Krisztian Szucs (apache) <[email protected]>" imported
gpg: key 755E743692EA1D85: public key "Micah Kornfield (Apache Arrow Code Signing Key) <[email protected]>" imported
gpg: key 0801999AF78748E8: public key "Jorge C. Leitao <[email protected]>" imported
gpg: key 45127976E1E825D4: public key "Andrew A Lamb (https://github.com/alamb) <[email protected]>" imported
gpg: key CA1AB41406F9DBAD: public key "Qingping Hou (CODE SIGNING KEY) <[email protected]>" imported
gpg: key 000488D7717D3FB2: public key "Neville Dipale <[email protected]>" imported
gpg: key 0B8A854E87467E2C: public key "Andy Grove <[email protected]>" imported
gpg: key 9CBA4EF977CA20B8: public key "David Li (CODE SIGNING KEY) <[email protected]>" imported
gpg: key 03F0D5EA3790810C: public key "Raphael Jaen Taylor-Davies <[email protected]>" imported
gpg: key 275C532289DD0F4A: public key "Ra�l Cumplido Dom�nguez (CODE SIGNING KEY) <[email protected]>" imported
gpg: key E05F29F0CD2679CC: public key "Ben Baumgold (CODE SIGNING KEY) <[email protected]>" imported
gpg: Total number processed: 18
gpg:               imported: 18
gpg: no ultimately trusted keys found
curl: (22) The requested URL returned error: 404 Not Found

verify-rc-source-cpp-linux-almalinux-8-amd64
verify-rc-source-cpp-linux-conda-latest-amd64
verify-rc-source-cpp-linux-ubuntu-20.04-amd64
verify-rc-source-cpp-linux-ubuntu-22.04-amd64
verify-rc-source-csharp-linux-almalinux-8-amd64
verify-rc-source-csharp-linux-conda-latest-amd64
verify-rc-source-csharp-linux-ubuntu-20.04-amd64
verify-rc-source-csharp-linux-ubuntu-22.04-amd64
verify-rc-source-go-linux-almalinux-8-amd64
verify-rc-source-go-linux-conda-latest-amd64
verify-rc-source-go-linux-ubuntu-20.04-amd64
verify-rc-source-go-linux-ubuntu-22.04-amd64
verify-rc-source-integration-linux-almalinux-8-amd64
verify-rc-source-integration-linux-conda-latest-amd64
verify-rc-source-integration-linux-ubuntu-20.04-amd64
verify-rc-source-integration-linux-ubuntu-22.04-amd64
verify-rc-source-java-linux-almalinux-8-amd64
verify-rc-source-java-linux-conda-latest-amd64
verify-rc-source-java-linux-ubuntu-20.04-amd64
verify-rc-source-java-linux-ubuntu-22.04-amd64
verify-rc-source-js-linux-almalinux-8-amd64
verify-rc-source-js-linux-conda-latest-amd64
verify-rc-source-js-linux-ubuntu-20.04-amd64
verify-rc-source-js-linux-ubuntu-22.04-amd64
verify-rc-source-python-linux-almalinux-8-amd64
verify-rc-source-python-linux-conda-latest-amd64
verify-rc-source-python-linux-ubuntu-20.04-amd64
verify-rc-source-python-linux-ubuntu-22.04-amd64
verify-rc-source-ruby-linux-almalinux-8-amd64
verify-rc-source-ruby-linux-conda-latest-amd64
verify-rc-source-ruby-linux-ubuntu-20.04-amd64
verify-rc-source-ruby-linux-ubuntu-22.04-amd64

Component(s)

Continuous Integration, Release
@raulcd raulcd mentioned this issue Apr 4, 2024
Merged
@kou
Copy link
Member

kou commented Apr 4, 2024

It seems that ${VERIFY_VERSION} and ${VERIFY_RC} aren't expanded as we expect.
It may be related to #40949 .

raulcd added a commit to raulcd/arrow that referenced this issue Apr 5, 2024
@raulcd
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
eb3c17b 
…bles from docker compose when using docker cli on archery docker
@github-actions github-actions bot mentioned this issue Apr 5, 2024
Merged
kou pushed a commit that referenced this issue Apr 5, 2024
@raulcd
GH-41007: [CI][Archery] Correctly interpolate environment variables f…
17e51cc 
…rom docker compose when using docker cli on archery docker (#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: #41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
@kou kou added this to the 16.0.0 milestone Apr 5, 2024
@kou
Copy link
Member

kou commented Apr 5, 2024

Issue resolved by pull request 41026
#41026

@kou kou closed this as completed Apr 5, 2024
tolleybot pushed a commit to tmct/arrow that referenced this issue May 2, 2024
@raulcd @tolleybot
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
0c476cc 
…bles from docker compose when using docker cli on archery docker (apache#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: apache#41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
tolleybot pushed a commit to tmct/arrow that referenced this issue May 4, 2024
@raulcd @tolleybot
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
e0b920a 
…bles from docker compose when using docker cli on archery docker (apache#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: apache#41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
rok pushed a commit to tmct/arrow that referenced this issue May 8, 2024
@raulcd @rok
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
747caa9 
…bles from docker compose when using docker cli on archery docker (apache#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: apache#41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
rok pushed a commit to tmct/arrow that referenced this issue May 8, 2024
@raulcd @rok
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
78f9462 
…bles from docker compose when using docker cli on archery docker (apache#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: apache#41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
vibhatha pushed a commit to vibhatha/arrow that referenced this issue May 25, 2024
@raulcd @vibhatha
apacheGH-41007: [CI][Archery] Correctly interpolate environment varia…
acc7c24 
…bles from docker compose when using docker cli on archery docker (apache#41026)

### Rationale for this change

Currently our verification jobs are failing due to environment variables not being correctly interpolated. docker compose expects a double `$$` sign on the command as explained here:
https://docs.docker.com/compose/compose-file/12-interpolation/
When we use `ARCHERY_USE_DOCKER_CLI=1` we are using `docker run` instead of `docker compose run`. The behaviour of the command changes and we have to update change the environment variable.

### What changes are included in this PR?

Use correct docker compose binary when using `docker cli` and remove double $$.

### Are these changes tested?

Via archery

### Are there any user-facing changes?

No
* GitHub Issue: apache#41007

Authored-by: Raúl Cumplido <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@raulcd raulcd

Labels
Component: Continuous Integration Component: Release Type: bug
Projects
None yet
Milestone
16.0.0
Development

No branches or pull requests
2 participants
@kou @raulcd