[CI][Python] Pyarrow cannot be imported on CI job AMD64 MacOS 10.15 Python 3

[asfimport]

The AMD64 MacOS 10.15 Python 3  job has started to fail on master with the following error:

 + pytest -r s -v --pyargs pyarrow
============================= test session starts ==============================
platform darwin -- Python 3.9.13, pytest-7.1.2, pluggy-1.0.0 -- /usr/local/opt/python@3.9/bin/python3.9
cachedir: .pytest_cache
hypothesis profile 'default' -> database=DirectoryBasedExampleDatabase('/Users/runner/work/arrow/arrow/.hypothesis/examples')
rootdir: /Users/runner/work/arrow/arrow
plugins: hypothesis-6.52.1, lazy-fixture-0.6.3
collecting ... collected 0 items / 1 error
==================================== ERRORS ====================================
________________________ ERROR collecting test session _________________________
/usr/local/Cellar/python@3.9/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/importlib/__init__.py:127: in import_module
    return _bootstrap._gcd_import(name[level:], package, level)
<frozen importlib._bootstrap>:1030: in _gcd_import
    ???
<frozen importlib._bootstrap>:1007: in _find_and_load
    ???
<frozen importlib._bootstrap>:972: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:228: in _call_with_frames_removed
    ???
<frozen importlib._bootstrap>:1030: in _gcd_import
    ???
<frozen importlib._bootstrap>:1007: in _find_and_load
    ???
<frozen importlib._bootstrap>:986: in _find_and_load_unlocked
    ???
<frozen importlib._bootstrap>:680: in _load_unlocked
    ???
<frozen importlib._bootstrap_external>:850: in exec_module
    ???
<frozen importlib._bootstrap>:228: in _call_with_frames_removed
    ???
/usr/local/lib/python3.9/site-packages/pyarrow/__init__.py:65: in <module>
    import pyarrow.lib as _lib
E   ImportError: dlopen(/usr/local/lib/python3.9/site-packages/pyarrow/lib.cpython-39-darwin.so, 2): Symbol not found: __ZN6google8protobuf8internal16InternalMetadataD1Ev
E     Referenced from: /usr/local/lib/libarrow.900.dylib
E     Expected in: flat namespace
E    in /usr/local/lib/libarrow.900.dylib
!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
=============================== 1 error in 5.18s ===============================
Error: Process completed with exit code 2. 

See an example of build on arrow/master branch: https://github.com/apache/arrow/runs/7385879183?check_suite_focus=true

Reporter: Raúl Cumplido / @raulcd
Assignee: Antoine Pitrou / @pitrou

Related issues:

• [C++] "arrow/engine/api.h" exposes internal headers (relates to)

PRs and other links:

• GitHub Pull Request #13634

_{Note: This issue was originally created as ARROW-17104. Please see the migration documentation for further details.}

[asfimport]

Antoine Pitrou / @pitrou:
I think this is exactly the same issue as ARROW-16520, except that until now it only occurred with conda.

[asfimport]

Antoine Pitrou / @pitrou:
And ultimately it is caused by the upstream issue protocolbuffers/protobuf#9947
cc @emkornfield

[asfimport]

Raúl Cumplido / @raulcd:
Just to add some more info, the homebrew formulas for protobuf were updated 3 days ago, which is when the issue started being reproduced on our CI: Homebrew/homebrew-core#105712

And the upstream issue mentioned on the previous comment is linked on the PR

[asfimport]

Raúl Cumplido / @raulcd:
This is not critical anymore as the MAC OS build has been fixed with the upstream homebrew package update for protobuf. I am not closing it as we might want to pick some of the changes from the initial PR.

[asfimport]

Raúl Cumplido / @raulcd:
This was solved with a protobuf fix upstream. It was not closed at that time as the original PR contained other fixes that we wanted to add but those either have been already included or should be included on the linked Jira ticket.