Arrow-rs now generate schema & batches with json values of json file

[jmfiaschi]

I just see that the arrow-rs can generate schema from json file/buffer/Vec<Result>. With the schema, it is possible to use a decoder to create batches .

Maybe It should be good to join the effort ?

[chmp]

Thanks for the head's up. I think the scope is a little bit different, but you're right. There is definitely some overlap. I will head over to the arrow repo and make folks aware. Maybe there is some interest to collab.

At the moment, I working on deserialization and gravitate to base everything around a pull parser for a JSON-like intermediate format. So there is even more overlap. I paln to also implement serialization via this intermediate representation and then see whether there is interest.

[chmp]

See discussion here: apache/arrow-rs#1383 (comment)