Tests segfault with GDAL 3.10.0

[imincik]

rio-tiler tests are failing with GDAL 3.10.0

• with Python 3.11

tests/test_io_stac.py ..Fatal Python error: Segmentation fault                                                                                                              │
│                                                                                                                                                                            │
│Thread 0x00007ffecf5fe6c0 (most recent call first):                                                                                                                         │
│  File "/nix/store/361mh11gcg987p53zs7cmz89wj6xihyr-python3.11-rasterio-1.4.2/lib/python3.11/site-packages/rasterio/__init__.py", line 355 in open                          │
│  File "/nix/store/361mh11gcg987p53zs7cmz89wj6xihyr-python3.11-rasterio-1.4.2/lib/python3.11/site-packages/rasterio/env.py", line 463 in wrapper                            │
│  File "/build/source/tests/test_io_stac.py", line 52 in mock_rasterio_open                                                                                                 │
│  File "/build/source/rio_tiler/io/rasterio.py", line 97 in __attrs_post_init__                                                                                             │
│  File "<attrs generated init rio_tiler.io.rasterio.Reader>", line 14 in __init__                                                                                           │
│  File "/build/source/rio_tiler/io/base.py", line 599 in _reader                                                                                                            │
│  File "/nix/store/igyzv5c2v672mhmx1ha1i7062y6rggqs-python3-3.11.10/lib/python3.11/concurrent/futures/thread.py", line 58 in run                                            │
│  File "/nix/store/igyzv5c2v672mhmx1ha1i7062y6rggqs-python3-3.11.10/lib/python3.11/concurrent/futures/thread.py", line 83 in _worker                                        │
│  File "/nix/store/igyzv5c2v672mhmx1ha1i7062y6rggqs-python3-3.11.10/lib/python3.11/threading.py", line 982 in run                                                           │
│  File "/nix/store/igyzv5c2v672mhmx1ha1i7062y6rggqs-python3-3.11.10/lib/python3.11/threading.py", line 1045 in _bootstrap_inner                                             │
│  File "/nix/store/igyzv5c2v672mhmx1ha1i7062y6rggqs-python3-3.11.10/lib/python3.11/threading.py", line 1002 in _bootstrap                          

• with Python 3.12

tests/test_io_MultiBand.py .Fatal Python error: Segmentation fault                                                                                                          │
│                                                                                                                                                                            │
│Thread 0x00007ffff7f8f740 (most recent call first):                                                                                                                         │
│  File "/build/source/rio_tiler/models.py", line 398 in create_from_list                                                                                                    │
│  File "/build/source/rio_tiler/tasks.py", line 68 in multi_arrays                                                                                                          │
│  File "/build/source/rio_tiler/io/base.py", line 1280 in part                                                                                                              │
│  File "/build/source/tests/test_io_MultiBand.py", line 207 in test_MultiBandReader_default_bands             

[vincentsarago]

thanks for the repor,

I think we will also have an issue with https://github.com/cogeotiff/rio-tiler/blob/main/rio_tiler/utils.py#L720-L751 OSGeo/gdal#10861

Sadly I cannot spend time on this right now but will be happy to review PR 🙏

[imincik]

Thank you for response @vincentsarago

[vincentsarago]

finally installed 3.10 on my laptop

Segfault seems to happens when we use multithreads to distribute rasterio.open (on multi STAC assets, or files for mosaic)