0.20 does no longer build with manylinux2014

[theCapypara]

Bug Description

Since the release of 0.20 Pyo3 does no longer link on manylinux2014, which is the default Linux distribution wheel image used by cibuildwheel.

Steps to Reproduce

1. Setup a basic Pyo3 project using setuptools-rust
2. Install and run cibuildwheel:

export CIBW_BUILD="py311-*"  # doesn't really matter, same behavior with all supported versions
export CIBW_BEFORE_ALL="curl https://sh.rustup.rs -sSf | sh -s -- --default-toolchain stable -y"
export CIBW_ENVIRONMENT='PATH="$PATH:$HOME/.cargo/bin"'
python -m cibuildwheel

Backtrace

Compiling skytemple_rust v1.6.0 (/project)
             Running `/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/bin/rustc --crate-name skytemple_rust --edition=2021 src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type cdylib --emit=dep-info,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="anyhow"' --cfg 'feature="arr_macro"' --cfg 'feature="compression"' --cfg 'feature="default"' --cfg 'feature="dse"' --cfg 'feature="dungeon_graphics"' --cfg 'feature="encoding-index-singlebyte"' --cfg 'feature="image"' --cfg 'feature="item_p"' --cfg 'feature="kao"' --cfg 'feature="map_bg"' --cfg 'feature="mappa_bin"' --cfg 'feature="md"' --cfg 'feature="misc_graphics"' --cfg 'feature="packed_struct"' --cfg 'feature="pmd_wan"' --cfg 'feature="pyo3"' --cfg 'feature="pyo3-log"' --cfg 'feature="python"' --cfg 'feature="script_var_table"' --cfg 'feature="sir0"' --cfg 'feature="strings"' --cfg 'feature="time"' --cfg 'feature="waza_p"' --cfg 'feature="with_pmd_wan"' -C metadata=e33dd3c5213f7c48 --out-dir /project/target/release/deps -L dependency=/project/target/release/deps --extern anyhow=/project/target/release/deps/libanyhow-94b7395c89edd8b1.rlib --extern arr_macro=/project/target/release/deps/libarr_macro-8a16d9d2ddf85841.rlib --extern bytes=/project/target/release/deps/libbytes-9a1325a1f4560732.rlib --extern encoding=/project/target/release/deps/libencoding-021704d0cf986302.rlib --extern encoding_index_singlebyte=/project/target/release/deps/libencoding_index_singlebyte-c108d7e32282be13.rlib --extern gettextrs=/project/target/release/deps/libgettextrs-03f28ca50cd2b6a6.rlib --extern itertools=/project/target/release/deps/libitertools-77028708f925604c.rlib --extern log=/project/target/release/deps/liblog-e9c072abf79b5d2b.rlib --extern num_derive=/project/target/release/deps/libnum_derive-8fa4eb13c70f4e54.so --extern num_traits=/project/target/release/deps/libnum_traits-ecb00a6ee62d1516.rlib --extern packed_struct=/project/target/release/deps/libpacked_struct-5e7e32ebc33092fb.rlib --extern paste=/project/target/release/deps/libpaste-8e37acef59c1aa94.so --extern pmd_wan=/project/target/release/deps/libpmd_wan-9a5fb6e26df889ff.rlib --extern pyo3=/project/target/release/deps/libpyo3-edc66cf8d5d3bcac.rlib --extern pyo3_log=/project/target/release/deps/libpyo3_log-da6bec721c8d5185.rlib --extern skytemple_rust_macros=/project/target/release/deps/libskytemple_rust_macros-77f49a73acc3f6a8.so --extern skytemple_rust_macros_no_py=/project/target/release/deps/libskytemple_rust_macros_no_py-d73f7d095658bc07.so --extern thiserror=/project/target/release/deps/libthiserror-6f42e1b9eadb17bc.rlib --extern time=/project/target/release/deps/libtime-496cc1feacc23e1f.rlib -L native=/project/target/release/build/gettext-sys-c483b24a732ce2a0/out/lib -L native=/opt/_internal/cpython-3.10.13/lib`
        error: linking with `cc` failed: exit status: 1
          |
          = note: LC_ALL="C" PATH="/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/bin:/tmp/pip-build-env-aw5fd0mx/overlay/bin:/tmp/pip-build-env-aw5fd0mx/normal/bin:/opt/python/cp310-cp310/bin:/opt/rh/devtoolset-10/root/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/.cargo/bin" VSLANG="1033" "cc" "-Wl,--version-script=/tmp/rustcFBGAoa/list" "-Wl,--no-undefined-version" "-m64" "/tmp/rustcFBGAoa/symbols.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.00.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.01.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.02.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.03.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.04.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.05.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.06.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.07.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.08.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.09.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.10.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.11.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.12.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.13.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.14.rcgu.o" "/project/target/release/deps/skytemple_rust.skytemple_rust.2913c33335cd0ec1-cgu.15.rcgu.o" "/project/target/release/deps/skytemple_rust.r7xkbkwmzal651n.rcgu.o" "-Wl,--as-needed" "-L" "/project/target/release/deps" "-L" "/project/target/release/build/gettext-sys-c483b24a732ce2a0/out/lib" "-L" "/opt/_internal/cpython-3.10.13/lib" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-Wl,-Bstatic" "/project/target/release/deps/libpyo3_log-da6bec721c8d5185.rlib" "/project/target/release/deps/libpyo3-cdff9ee64581a5a1.rlib" "/project/target/release/deps/libparking_lot-996c0039e6c796bf.rlib" "/project/target/release/deps/libparking_lot_core-f80dfc28b2a98d1b.rlib" "/project/target/release/deps/libinstant-91c18ec113f4d344.rlib" "/project/target/release/deps/libarc_swap-273e7fc12a78760e.rlib" "/project/target/release/deps/libpmd_wan-9a5fb6e26df889ff.rlib" "/project/target/release/deps/libpmd_sir0-5d173da8b7dd84c4.rlib" "/project/target/release/deps/libio_partition-b0d156e4918529ac.rlib" "/project/target/release/deps/libimage-139d6533f1e0845b.rlib" "/project/target/release/deps/libbytemuck-4f546af5036fae28.rlib" "/project/target/release/deps/libcolor_quant-efe437492daa23c0.rlib" "/project/target/release/deps/libnum_rational-07092ef5d997d462.rlib" "/project/target/release/deps/libnum_integer-c36e89b057eeaf49.rlib" "/project/target/release/deps/libbyteorder-d4dc81402f587e5e.rlib" "/project/target/release/deps/libbinwrite-c7f49c37e45fbcad.rlib" "/project/target/release/deps/libpaste-dd03fb696fe0c348.rlib" "/project/target/release/deps/libbinread-8764825e26f1c2e2.rlib" "/project/target/release/deps/libthiserror-6f42e1b9eadb17bc.rlib" "/project/target/release/deps/libanyhow-94b7395c89edd8b1.rlib" "/project/target/release/deps/libarr_macro-8a16d9d2ddf85841.rlib" "/project/target/release/deps/libproc_macro_nested-e4b1e52378a13464.rlib" "/project/target/release/deps/libitertools-77028708f925604c.rlib" "/project/target/release/deps/libeither-b86b04317cb0dd22.rlib" "/project/target/release/deps/libtime-496cc1feacc23e1f.rlib" "/project/target/release/deps/libtime_core-3974b9bfd6bcb3b7.rlib" "/project/target/release/deps/libderanged-242a356cd6cd0810.rlib" "/project/target/release/deps/libnum_traits-ecb00a6ee62d1516.rlib" "/project/target/release/deps/liblog-e9c072abf79b5d2b.rlib" "/project/target/release/deps/libpacked_struct-5e7e32ebc33092fb.rlib" "/project/target/release/deps/libbitvec-0b8c4193bdb9ece0.rlib" "/project/target/release/deps/libwyz-74412a8aa5534b87.rlib" "/project/target/release/deps/libtap-d63c521426b4b08e.rlib" "/project/target/release/deps/libradium-f3f9c2f450bec65d.rlib" "/project/target/release/deps/libfunty-fa8684eb7221f148.rlib" "/project/target/release/deps/libpyo3-edc66cf8d5d3bcac.rlib" "/project/target/release/deps/libmemoffset-5f7b838a078e3d38.rlib" "/project/target/release/deps/libparking_lot-4532b3055db523bd.rlib" "/project/target/release/deps/libparking_lot_core-c2e7a3b50de7cbc9.rlib" "/project/target/release/deps/libcfg_if-17709ab0e2f45da0.rlib" "/project/target/release/deps/libsmallvec-90fd28adb3d2105c.rlib" "/project/target/release/deps/liblock_api-f29cabbe3276c4bb.rlib" "/project/target/release/deps/libscopeguard-96448b6b16196307.rlib" "/project/target/release/deps/libpyo3_ffi-e7a109759577491c.rlib" "/project/target/release/deps/liblibc-9bb75f9a49b4aeff.rlib" "/project/target/release/deps/libunindent-ca95041c326aa7d8.rlib" "/project/target/release/deps/libbytes-9a1325a1f4560732.rlib" "/project/target/release/deps/libgettextrs-03f28ca50cd2b6a6.rlib" "/project/target/release/deps/libgettext_sys-79df3c390b0d85b7.rlib" "/project/target/release/deps/liblocale_config-3f26adac06a86ff0.rlib" "/project/target/release/deps/libregex-ed5c37db53d54e9f.rlib" "/project/target/release/deps/libregex_automata-4207b6dbb05427c9.rlib" "/project/target/release/deps/libaho_corasick-049d7560c66faccb.rlib" "/project/target/release/deps/libmemchr-c27e2fa70f1dc850.rlib" "/project/target/release/deps/libregex_syntax-faad2b254c01b21f.rlib" "/project/target/release/deps/liblazy_static-b3eac7b1efe0daf0.rlib" "/project/target/release/deps/libencoding-021704d0cf986302.rlib" "/project/target/release/deps/libencoding_index_tradchinese-520fdfc09e56973a.rlib" "/project/target/release/deps/libencoding_index_simpchinese-10ef10194a7e6d6d.rlib" "/project/target/release/deps/libencoding_index_japanese-0616e7ddd6f3fd5f.rlib" "/project/target/release/deps/libencoding_index_korean-5f301f27b0c31eda.rlib" "/project/target/release/deps/libencoding_index_singlebyte-c108d7e32282be13.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd-6498d8891e016dca.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libpanic_unwind-3debdee1a9058d84.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libobject-8339c5bd5cbc92bf.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libmemchr-160ebcebb54c11ba.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libaddr2line-95c75789f1b65e37.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libgimli-7e8094f2d6258832.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_demangle-bac9783ef1b45db0.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libstd_detect-a1cd87df2f2d8e76.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libhashbrown-7fd06d468d7dba16.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_alloc-5ac19487656e05bf.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libminiz_oxide-c7c35d32cf825c11.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libadler-c523f1571362e70b.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libunwind-85f17c92b770a911.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcfg_if-598d3ba148dadcea.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liblibc-a58ec2dab545caa4.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/liballoc-f9dda8cca149f0fc.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/librustc_std_workspace_core-7ba4c315dd7a3503.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcore-5ac2993e19124966.rlib" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib/libcompiler_builtins-df2fb7f50dec519a.rlib" "-Wl,-Bdynamic" "-lpython3.10" "-lgcc_s" "-lutil" "-lrt" "-lpthread" "-lm" "-ldl" "-lc" "-Wl,--eh-frame-hdr" "-Wl,-z,noexecstack" "-L" "/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib" "-o" "/project/target/release/deps/libskytemple_rust.so" "-Wl,--gc-sections" "-shared" "-Wl,-z,relro,-z,now" "-Wl,-O1" "-nodefaultlibs"
          = note: /opt/rh/devtoolset-10/root/usr/libexec/gcc/x86_64-redhat-linux/10/ld: cannot find -lpython3.10
                  collect2: error: ld returned 1 exit status
        
        
        error: could not compile `skytemple_rust` (lib) due to previous error
        
        Caused by:
          process didn't exit successfully: `/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/bin/rustc --crate-name skytemple_rust --edition=2021 src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --crate-type cdylib --emit=dep-info,link -C opt-level=3 -C embed-bitcode=no --cfg 'feature="anyhow"' --cfg 'feature="arr_macro"' --cfg 'feature="compression"' --cfg 'feature="default"' --cfg 'feature="dse"' --cfg 'feature="dungeon_graphics"' --cfg 'feature="encoding-index-singlebyte"' --cfg 'feature="image"' --cfg 'feature="item_p"' --cfg 'feature="kao"' --cfg 'feature="map_bg"' --cfg 'feature="mappa_bin"' --cfg 'feature="md"' --cfg 'feature="misc_graphics"' --cfg 'feature="packed_struct"' --cfg 'feature="pmd_wan"' --cfg 'feature="pyo3"' --cfg 'feature="pyo3-log"' --cfg 'feature="python"' --cfg 'feature="script_var_table"' --cfg 'feature="sir0"' --cfg 'feature="strings"' --cfg 'feature="time"' --cfg 'feature="waza_p"' --cfg 'feature="with_pmd_wan"' -C metadata=e33dd3c5213f7c48 --out-dir /project/target/release/deps -L dependency=/project/target/release/deps --extern anyhow=/project/target/release/deps/libanyhow-94b7395c89edd8b1.rlib --extern arr_macro=/project/target/release/deps/libarr_macro-8a16d9d2ddf85841.rlib --extern bytes=/project/target/release/deps/libbytes-9a1325a1f4560732.rlib --extern encoding=/project/target/release/deps/libencoding-021704d0cf986302.rlib --extern encoding_index_singlebyte=/project/target/release/deps/libencoding_index_singlebyte-c108d7e32282be13.rlib --extern gettextrs=/project/target/release/deps/libgettextrs-03f28ca50cd2b6a6.rlib --extern itertools=/project/target/release/deps/libitertools-77028708f925604c.rlib --extern log=/project/target/release/deps/liblog-e9c072abf79b5d2b.rlib --extern num_derive=/project/target/release/deps/libnum_derive-8fa4eb13c70f4e54.so --extern num_traits=/project/target/release/deps/libnum_traits-ecb00a6ee62d1516.rlib --extern packed_struct=/project/target/release/deps/libpacked_struct-5e7e32ebc33092fb.rlib --extern paste=/project/target/release/deps/libpaste-8e37acef59c1aa94.so --extern pmd_wan=/project/target/release/deps/libpmd_wan-9a5fb6e26df889ff.rlib --extern pyo3=/project/target/release/deps/libpyo3-edc66cf8d5d3bcac.rlib --extern pyo3_log=/project/target/release/deps/libpyo3_log-da6bec721c8d5185.rlib --extern skytemple_rust_macros=/project/target/release/deps/libskytemple_rust_macros-77f49a73acc3f6a8.so --extern skytemple_rust_macros_no_py=/project/target/release/deps/libskytemple_rust_macros_no_py-d73f7d095658bc07.so --extern thiserror=/project/target/release/deps/libthiserror-6f42e1b9eadb17bc.rlib --extern time=/project/target/release/deps/libtime-496cc1feacc23e1f.rlib -L native=/project/target/release/build/gettext-sys-c483b24a732ce2a0/out/lib -L native=/opt/_internal/cpython-3.10.13/lib` (exit status: 1)
        error: `cargo rustc --lib --message-format=json-render-diagnostics --manifest-path Cargo.toml --release -v --features pyo3/extension-module --crate-type cdylib --` failed with code 101
        [end of output]
    
    note: This error originates from a subprocess, and is likely not a problem with pip.
    ERROR: Failed building wheel for skytemple-rust
  ERROR: Failed to build one or more wheels
  Failed to build skytemple-rust
  Error: Command ['python', '-m', 'pip', 'wheel', PurePosixPath('/project'), '--wheel-dir=/tmp/cibuildwheel/built_wheel', '--no-deps'] failed with code 1. 

(source: https://github.com/SkyTemple/skytemple-rust/actions/runs/6513175923/job/17692267221)

Your operating system and version

CentOS 7 (manylinux2014)

Your Python version (python --version)

3.7-3.12

Your Rust version (rustc --version)

1.73.0

Your PyO3 version

0.20.0

How did you install python? Did you use a virtualenv?

see above

Additional Info

No response

[richli]

I have the same problem on manylinux_2_28, and I'm not using cibuildwheel

[davidhewitt]

Hmm. @richli do you also use setuptools-rust? Did you both upgrade from PyO3 0.19.2?

This sounds a lot like #3340. Are you able to check if there are multiple versions of PyO3 crates in your Cargo.lock?

[richli]

I'm using maturin and I upgraded from Py03 0.19.2. And yes, I see now that PyO3 0.14 also exists in my dependency tree due to the version bounds of pyo3-log. Presumably this PR would fix things, then: vorner/pyo3-log#32

[davidhewitt]

Quite possibly, yes. You could try build against that git branch (or alternatively wait for that to be merged and released).

[theCapypara]

Can confirm, I'm also using pyo3-log and have these in my Cargo.lock:

[[package]]
name = "pyo3"
version = "0.14.5"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "35100f9347670a566a67aa623369293703322bb9db77d99d7df7313b575ae0c8"
dependencies = [
 "cfg-if",
 "libc",
 "parking_lot 0.11.2",
 "pyo3-build-config 0.14.5",
]

[[package]]
name = "pyo3"
version = "0.20.0"
source = "registry+https://github.com/rust-lang/crates.io-index"
checksum = "04e8453b658fe480c3e70c8ed4e3d3ec33eb74988bd186561b0cc66b85c3bc4b"
dependencies = [
 "cfg-if",
 "indoc",
 "libc",
 "memoffset",
 "parking_lot 0.12.1",
 "pyo3-build-config 0.20.0",
 "pyo3-ffi",
 "pyo3-macros",
 "unindent",
]

[theCapypara]

I'll close this then, as it's not actually a bug in pyo3, but will reopen should this somehow still persist after pyo3-log has been updated.

[richli]

Yup, once I added this to my Cargo.toml file (and regenerated Cargo.lock), it now builds successfully. Thanks!

[patch.crates-io]
pyo3-log = { git = "https://github.com/a1phyr/pyo3-log.git", branch = "pyo3_0.20" }

[davidhewitt]

Great! I wonder if pyo3-log should increase its PyO3 lower bound from 0.14. In 0.15 we added links = "python" to the Cargo.toml, which should prevent multiple PyO3 versions from coexisting, but I guess 0.14 fell outside of this range. I'll open an issue there.