Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closes #1324 - load_all() use file_format #1329

Merged
merged 2 commits into from
Apr 27, 2022

Conversation

Ethan-DeBandi99
Copy link
Contributor

Closes #1324

  • Updates ak.load() and ak.load_all() to make use of the file_format parameter that has been added for save methhods.
  • Adds testing for ak.load() and ak.load_all() functionality with file_format parameter to tests/io_test.py.

The code here is configured to work around some of the inconsistencies raised in #1328. Because Parquet files always have .parquet extension, but HDF5 has more flexibility the code is configured to add the extension for parquet and continue using os.path.splitext() for HDF5 files.

…the file_format parameter. Configured so that hdf5 continues to function the same as it did. IF parquet is set, updates the file extension to .parquet. Added testing. THis needs Bears-R-Us#1309 to be merged to be functional.
Copy link
Collaborator

@reuster986 reuster986 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good overall! Just one request to remove a print statement.

arkouda/pdarrayIO.py Outdated Show resolved Hide resolved
@mhmerrill mhmerrill merged commit e1d5ba8 into Bears-R-Us:master Apr 27, 2022
@Ethan-DeBandi99 Ethan-DeBandi99 deleted the 1324_load_file_format branch April 29, 2022 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

load_all() use file_format
3 participants