Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

heap corruption in read_csv on 32-bit big-endian architectures #20785

Closed
ginggs opened this issue Apr 22, 2018 · 1 comment · Fixed by #20786
Closed

heap corruption in read_csv on 32-bit big-endian architectures #20785

ginggs opened this issue Apr 22, 2018 · 1 comment · Fixed by #20786
Labels
32bit 32-bit systems Compat pandas objects compatability with Numpy or Python functions IO CSV read_csv, to_csv
Milestone

Comments

@ginggs
Copy link
Contributor

ginggs commented Apr 22, 2018

While building pandas 0.22.0 for 32-bit big-endian architectures, the test suite crashes in TestMultiLevel::test_unstack_odd_failure with various errors:

realloc(): invalid next size
malloc(): smallbin double linked list corrupted
Segmentation fault
corrupted double-linked list

This happened to be the first test that calls read_csv, and I could reproduce this in the REPL by simply doing:

import pandas as pd
df = pd.read_csv('data.csv')

I narrowed it down to 8d7d3fb and found #17063 describing a similar problem introduced by the same commit affecting other 32-bit architectures.

@jreback
Copy link
Contributor

jreback commented Apr 22, 2018

you could submit a patch, but we have 0 support for big endian (no testing) and very little for 32-but arch (limited testing)

@jreback jreback closed this as completed Apr 22, 2018
@jreback jreback added IO CSV read_csv, to_csv Compat pandas objects compatability with Numpy or Python functions 32bit 32-bit systems labels Apr 22, 2018
@jreback jreback added this to the 0.23.0 milestone Apr 22, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
32bit 32-bit systems Compat pandas objects compatability with Numpy or Python functions IO CSV read_csv, to_csv
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants