-
Notifications
You must be signed in to change notification settings - Fork 19
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Sync readers should return a RecordBatchReader
#596
Comments
RecordBatchReader
RecordBatchReader
It's not clear to me how to bridge the gap betwen push based and pull based iterators. Geozero processors create push-based streams, while an iterator is a pull-based interface. |
With #933, we'll have Parquet, CSV, FlatGeobuf, and IPC files that return a It would be nice to expose Shapefile as a record batch reader too, but I'm not sure how much work that would be |
This PR updates the FlatGeobuf reader (the sync version only for now) to expose data as an iterator. This means that applications like Python can access data larger than memory, and process it in batches. - [x] This was blocked on Flatgeobuf exposing the `Seekable` and `NotSeekable` marker structs, but that happened in flatgeobuf/flatgeobuf#402 Closes #932 For #594, for #596
No description provided.
The text was updated successfully, but these errors were encountered: