Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat(deps): Add arrow-buffer, schema, data, array 39 #10

Closed
wants to merge 92 commits into from
Closed

feat(deps): Add arrow-buffer, schema, data, array 39 #10

wants to merge 92 commits into from

Conversation

therealhieu
Copy link

No description provided.

ritchie46 and others added 30 commits March 28, 2023 10:47
@ritchie46
fix: fix all on empty boolean array
d4f3906
@ritchie46
both kernels
0063967
@ritchie46
Fixed error in memory usage of sliced binary/list/utf8arrays (jorgeca…
492d130 
…rleitao#1293)
@datapythonista @ritchie46
Fixed link from the API to the guide (jorgecarleitao#1290)
2847357
@ritchie46
Improved ZipValidity iterators (jorgecarleitao#1284)
035bcef
@Xuanwo @ritchie46
Bumped arrow-format to 0.8 (jorgecarleitao#1298)
84203dd
@FANNG1 @ritchie46
Fixed descending ordering when specify nulls first (jorgecarleitao#1286)
f0a31b6
@benesch @ritchie46
Upgraded ahash to v0.8 (jorgecarleitao#1297)
e7b2829
@Xuanwo @ritchie46
Fix deprecated warning from chrono (jorgecarleitao#1299)
f6d62e6
@Samrose-Ahmed @ritchie46
Add avro record names when converting arrow schema to avro (jorgecarl…
caab011 
…eitao#1279)

add avro record names when converting arrow schema to avro
@jondo2010 @ritchie46
Added support for Extension types in ffi (jorgecarleitao#1300)
9796928
@ritchie46
Added reserve to pushable containers in parquet extend_from_decoder (…
c81556c 
…jorgecarleitao#1301)
@sundy-li @ritchie46
Added data_pagesize_limit to write parquet pages (jorgecarleitao#1303)
9ebb562
@ritchie46
Improved performance of checking offsets ~-64-73% (jorgecarleitao#1305
3b3fa63 
)

* perf: auto-vectorized try_check_offsets

* err on empty offsets
@ritchie46
Bumped parquet2 dependency (jorgecarleitao#1304)
33d856f
@cyr @ritchie46
Removed flushing during arrow IPC writing to improve performance when…
c7878f8 
… using a buffered writer (jorgecarleitao#1318)
@ritchie46
Fixed failing to accept dictionary full of nulls (jorgecarleitao#1312)
69606a4
@universalmind303 @ritchie46
Bumped json-deserializer version (jorgecarleitao#1321)
8ea8991
@jorgecarleitao @ritchie46
Added Offsets and OffsetsBuffer (jorgecarleitao#1316)
e68f2c0
@ritchie46
Improved performance of check_indexes (jorgecarleitao#1313)
13014c3
@sundy-li @ritchie46
add bytes_estimate for binary push in parquet deserialize (jorgecarle…
b086679 
…itao#1308)
@ritchie46
fix invalid parquet read (jorgecarleitao#1330)
5365f4a
@ritchie46
Fixed writing nested/sliced arrays to parquet (jorgecarleitao#1326)
cbf28db
@jorgecarleitao @ritchie46
Removed from_data from all arrays (jorgecarleitao#1328)
f210723 
Removed from_data
@sundy-li @ritchie46
pub deserialize_schema (jorgecarleitao#1335)
06d7dfa
@jorgecarleitao @ritchie46
Fixed clippy (jorgecarleitao#1336)
4e4c0c4
@jorgecarleitao @ritchie46
Improved UnionArray (jorgecarleitao#1331)
06ae1b6
@jorgecarleitao @ritchie46
Bumped version
c3cb0b0
@yerke @ritchie46
Update README.md to fix capitalization and spelling (jorgecarleitao#1338
cabd34d 
)
@RinChanNOWWW @ritchie46
Make some functions public. (jorgecarleitao#1339)
fbe2160
hzuo and others added 29 commits April 5, 2023 16:54
@hzuo @ritchie46
Fixe ahash dependency for wasm (jorgecarleitao#1407)
b6cf662
@ritchie46
Added cast for FixedSizeBinary to (Large)Binary (jorgecarleitao#1403)
fc83e06
@WindSoilder @ritchie46
Updated base64 to 0.21 (jorgecarleitao#1408)
b93d806 
* dependency update: update base64 to 0.21

* fmt code
@ritchie46
Fixed statistics writing flag and correct null_count in dictionaries (j…
9f48859 
…orgecarleitao#1414)
@ozgrakkurt @ritchie46
Added convenience accessor array.get (jorgecarleitao#1416)
f87e9d2
@ozgrakkurt @ritchie46
Re-exported the bloom_filter module from parquet2 crate (jorgecar…
9296f39 
…leitao#1420)
@b41sh @ritchie46
Added support for MapArray read and write to parquet (jorgecarleitao#…
ea0cc67 
…1419)
@TCeason @ritchie46
Added support for decimal256 read/write in parquet (jorgecarleitao#1412)
8018a7f
@ritchie46
Added support for JSON serialization of dictionary (jorgecarleitao#1424)
f1e9423
@b41sh @ritchie46
Added MapScalar (jorgecarleitao#1428)
a1b9bf1
@SimonSchneider @ritchie46
Changed encoded float::Inf as null in json (jorgecarleitao#1427)
c55377c
@haixuanTao @ritchie46
Added set_len method to Buffer (jorgecarleitao#1374)
5ba1a3a 
Adding `set_len` enables to change the length value of the buffer.

This is required if `get_mut` changes the length of the buffer.
@christophe-petitjean @ritchie46
Fixed issue with Time32/Time64 datatype in csv reader (jorgecarleitao…
ea68a88 
…#1425)
@b41sh @ritchie46
Made num_values public (jorgecarleitao#1431)
9f9067a
@ritchie46
Made len/len_proxy consistent with Offsets (jorgecarleitao#1434)
dbd0228
@ritchie46
Added memmap &[u8] as BooleanArray (jorgecarleitao#1436)
20b6d07 
* feat: memmap bits slice as BooleanArray

* swap cmp
@Arty-Maly @ritchie46
Added impl_mutable_array_mut_validity macro for mutable arrays (jorge…
3df5d96 
…carleitao#1435)
@tustvold @ritchie46
Added buffer interoperability with arrow-rs (jorgecarleitao#1429) (jo…
d1502b7 
…rgecarleitao#1437)
@ritchie46
Changed async ipc writer to accept schema by value (jorgecarleitao#1439)
775c112
@ritchie46
Updated multiversion and support wider registers (jorgecarleitao#1440)
bb22728
@ritchie46
Updated dependencies (jorgecarleitao#1441)
69b99bc
@tustvold @ritchie46
Added interoperability with arrow-schema (jorgecarleitao#1442)
b9f83db
@jorgecarleitao @ritchie46
Bumped version
ffa6d44
@ritchie46
use patched parquet2 version
d0174d3
feat(deps): bump arrow-rs 39
e145ec8
@therealhieu
Merge pull request #1 from therealhieu/feat/upgrade-deps
fa8852f 
feat(deps): bump arrow-rs 39
Merge remote-tracking branch 'ritchie/arrow2/polars_2023-04-05' into …
5f168ec 
…ritchie-arrow2
Merge remote-tracking branch 'ritchie/arrow2/polars_2023-04-05' into …
4abbe28 
…ritchie-arrow2
Merge remote-tracking branch 'ritchie/arrow2/polars_2023-05-09' into …
0988348 
…ritchie-arrow2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.