[BEAM-13264] Allow pyarrow up to 6.x

[TheNeuralBit]

ValidatesRunner compliance status (on master branch)

Lang	ULR	Dataflow	Flink	Samza	Spark	Twister2
Go	---					---
Java
Python	---					---
XLang						---

Examples testing status on various runners

Lang	ULR	Dataflow	Flink	Samza	Spark	Twister2
Go	---	---	---	---	---	---	---
Java	---		---	---	---	---	---
Python	---	---	---	---	---	---	---
XLang	---	---	---	---	---	---	---

Post-Commit SDK/Transform Integration Tests Status (on master branch)

Go	Java	Python

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website	Whitespace	Typescript
Non-portable
Portable	---			---	---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

[codecov]

Codecov Report

Merging #15995 (44e4a24) into master (5c4f99b) will increase coverage by 0.00%.
The diff coverage is 89.28%.

@@           Coverage Diff           @@
##           master   #15995   +/-   ##
=======================================
  Coverage   83.61%   83.61%           
=======================================
  Files         445      445           
  Lines       61363    61371    +8     
=======================================
+ Hits        51310    51317    +7     
- Misses      10053    10054    +1     

Impacted Files	Coverage Δ
sdks/python/apache_beam/examples/avro_bitcoin.py	0.00% <0.00%> (ø)
sdks/python/apache_beam/io/gcp/bigquery.py	62.72% <0.00%> (ø)
...ython/apache_beam/io/gcp/bigquery_read_internal.py	53.92% <0.00%> (ø)
...on/apache_beam/runners/dataflow/dataflow_runner.py	82.34% <ø> (ø)
...ks/python/apache_beam/runners/worker/operations.py	70.01% <ø> (ø)
sdks/python/apache_beam/io/avroio.py	97.95% <75.00%> (ø)
sdks/python/apache_beam/coders/coder_impl.py	93.98% <87.50%> (ø)
sdks/python/apache_beam/coders/coders.py	88.63% <89.47%> (ø)
sdks/python/apache_beam/io/textio.py	96.78% <91.66%> (ø)
sdks/python/apache_beam/dataframe/frames.py	94.92% <95.74%> (ø)
... and 25 more

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update bfc71b0...44e4a24. Read the comment docs.

[tvalentyn]

If you'd like to update pyarrow in beam's containers, you could try fetch changes from master and run gradlew :sdks:python:container:generatePythonRequirementsAll.

[tvalentyn]

You need all versions of Python thought to run the command successfully, and if you are on linux, you may need to downgrade virtualenv to 16.1 until we merge #15819

[tvalentyn]

If you'd like to update pyarrow in beam's containers, you could try fetch changes from master and run gradlew :sdks:python:container:generatePythonRequirementsAll.

You don't have to do it, since i'll have to do it shortly for the release anyway.

[TheNeuralBit]

I can give it a shot in a separate PR to trial run the process

…

On Tue, Nov 16, 2021, 12:09 PM tvalentyn ***@***.***> wrote: If you'd like to update pyarrow in beam's containers, you could try fetch changes from master and run gradlew :sdks:python:container:generatePythonRequirementsAll. You don't have to do it, since i'll have to do it shortly for the release anyway. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub <#15995 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAFEZ35KHW22OQOOI53C6T3UMK3APANCNFSM5IE6JFDA> . Triage notifications on the go with GitHub Mobile for iOS <https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675> or Android <https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub>.