2018-09-04 (GCS 1.6.9, BQ 0.10.10)
Changelog
Cloud Storage connector:
-
Change default values for GCS batch/directory operations properties to improve performance:
fs.gs.copy.max.requests.per.batch (default: 1 -> 15) fs.gs.copy.batch.threads (default: 50 -> 15) fs.gs.max.requests.per.batch (default: 25 -> 15) fs.gs.batch.threads (default: 25 -> 15)
-
Update all dependencies to latest versions.
BigQuery connector:
- POM updates for GCS connector 1.6.9.
- Poll BQ jobs in their correct locations.
- Update all dependencies to latest versions.