Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set DelimitedFiles.readdlm use_mmap default to false for all OSes #40415

Merged
merged 6 commits into from
Apr 19, 2021

Conversation

quildtide
Copy link
Contributor

Increased resilience to edge cases where Sys.isunix() == true but the Filesystem behaves Windows-like instead of Unix-like.

Current behavior in these edge cases can cause ugly bugs, and I believe it is best to sacrifice default performance in favor of default portability.

@vtjnash has also demonstrated that the current default also leads to worse performance on Unix-like systems for very small delimited files, so the change in defaults also leads to improved performance in at least some situations.

Specific examples of edge cases where the current default is dangerous:

Increased resilience to edge cases where OS is reported Unix-like but Filesystem is abnormal
@quildtide quildtide marked this pull request as draft April 9, 2021 04:56
@quildtide quildtide marked this pull request as ready for review April 9, 2021 07:00
@JeffBezanson JeffBezanson added the needs news A NEWS entry is required for this change label Apr 12, 2021
@vtjnash vtjnash removed the needs news A NEWS entry is required for this change label Apr 19, 2021
@vtjnash vtjnash merged commit d67f986 into JuliaLang:master Apr 19, 2021
ElOceanografo pushed a commit to ElOceanografo/julia that referenced this pull request May 4, 2021
…liaLang#40415)

Increased resilience to edge cases where OS is reported Unix-like but Filesystem is abnormal

Fixes JuliaLang#8891
Fixes JuliaLang#40352
antoine-levitt pushed a commit to antoine-levitt/julia that referenced this pull request May 9, 2021
…liaLang#40415)

Increased resilience to edge cases where OS is reported Unix-like but Filesystem is abnormal

Fixes JuliaLang#8891
Fixes JuliaLang#40352
johanmon pushed a commit to johanmon/julia that referenced this pull request Jul 5, 2021
…liaLang#40415)

Increased resilience to edge cases where OS is reported Unix-like but Filesystem is abnormal

Fixes JuliaLang#8891
Fixes JuliaLang#40352
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants