Closes #8502: Parallel NDJSON file reading #21594

Job	Run time
Check cargo fmt	38s
cargo test (mac)	20m 53s
build with wasm-pack	1m 53s
cargo check	5m 4s
Verify MSRV	6m 18s
Verify Vendored Code	45s
cargo test (win64)	3h 11m 36s
cargo test (amd64)	8m 46s
cargo test datafusion-cli (amd64)	2m 50s
cargo examples (amd64)	6m 14s
cargo test doc (amd64)	9m 18s
clippy	4m 3s
cargo test hash collisions (amd64)	8m 30s
cargo doc	3m 10s
Run sqllogictest with Postgres runner	3m 19s
cargo test pyarrow (amd64)	2m 14s
verify benchmark results (amd64)	9m 36s
check Cargo.toml formatting	1m 20s
check configs.md is up-to-date	2m 7s
	4h 48m 34s

Provide feedback