Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build wheels in multiple platforms with QEMU #160

Merged
merged 2 commits into from
Apr 12, 2024
Merged

Build wheels in multiple platforms with QEMU #160

merged 2 commits into from
Apr 12, 2024

Conversation

kpark-hrp
Copy link
Contributor

@kpark-hrp kpark-hrp commented Apr 11, 2024 •
edited
Loading

This will build Linux wheels in multiple platforms using QEMU.

Example from cibuildwheel

fixes #159

@kpark-hrp
Copy link
Contributor Author

@oschwald Can you take a look at this PR? And after this PR is merged, can you do a release for updated/new wheels?

@oschwald
Copy link
Member

@kpark-hrp it still hasn't finished building. I think the 30+ minute builds will be an issue. Maybe we could just limit this to auto aarch64 for now and wait to see if anyone specifically requests the other platforms. s390x was discontinued in 2004, for instance.

@kpark-hrp
Copy link
Contributor Author

kpark-hrp commented Apr 11, 2024 •
edited
Loading

@oschwald Make sense. Pushed a commit to trim it down to auto aarch64. Let's see how long this one takes

@kpark-hrp
Copy link
Contributor Author

@oschwald Still took a while, but brought it down to 17 minutes from 35 minutes. And it looks good to me.

39 wheels produced in 18 minutes:
  maxminddb-2.6.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       87 kB
  maxminddb-2.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         86 kB
  maxminddb-2.6.0-cp310-cp310-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          85 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_aarch64.whl                                                              91 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_i686.whl                                                                 89 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_x86_64.whl                                                               90 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       87 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         86 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          85 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_aarch64.whl                                                              92 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_i686.whl                                                                 90 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_x86_64.whl                                                               91 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       88 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         88 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          86 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_aarch64.whl                                                              93 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_i686.whl                                                                 91 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_x86_64.whl                                                               92 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                         88 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                           87 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl            86 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_aarch64.whl                                                                92 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_i686.whl                                                                   90 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_x86_64.whl                                                                 91 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                         87 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                           86 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl            84 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_aarch64.whl                                                                91 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_i686.whl                                                                   89 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_x86_64.whl                                                                 90 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                37 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                  37 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl   38 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                  37 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                    37 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl     38 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                  37 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                    37 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl     38 kB

@oschwald
Copy link
Member

17 minutes isn't ideal, but it also isn't that bad. Thanks !

@oschwald oschwald merged commit 0ceb187 into maxmind:main Apr 12, 2024
35 checks passed
@kpark-hrp kpark-hrp deleted the kpark/qemu-build-aarch64 branch April 12, 2024 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@oschwald oschwald oschwald approved these changes

Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Linux aarch64/arm64 whl releases
2 participants
@kpark-hrp @oschwald