-
Notifications
You must be signed in to change notification settings - Fork 370
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Don't print all data in huge columns #3343
Comments
This is unrelated to DataFrames.jl. Can you please open an issue in Julia GitHub repo? Here is a reproducer for your reference (note that DataFrames.jl works OK, it is Base Julia printing that is not nice):
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
I have a
DataFrame
(saydf
) with a column (sayM
) containing largeSparseMatrixCSC
objects of different shapes. If I dois starts printing out all of that data. This can take hours to complete and takes up all processor cores. Keyboard interrupt does not seem to stop this and I'm forced to kill the Julia process, which can lead to losing work. Of course, knowing that the data is huge, I should avoid doing
df,M
but it's unfortunate to break the entire process like that.Suggestion: Throw a "Buffer Exception" or something like that, which gets thrown (by default) if printing to console exceeds some number of bytes (or lines). Alternatively, estimate how much would be printed out and skip most of the data (representing it by dots), like the default Julia printing routines.
The text was updated successfully, but these errors were encountered: