Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test_sort_1k_mem failed with too many open file error when I run locally #10674

Closed
jayzhan211 opened this issue May 26, 2024 · 1 comment · Fixed by #12961
Closed

test_sort_1k_mem failed with too many open file error when I run locally #10674

jayzhan211 opened this issue May 26, 2024 · 1 comment · Fixed by #12961
Labels
bug Something isn't working

Comments

@jayzhan211
Copy link
Contributor

Describe the bug

It has been annoyed me a while
I get this error when run locally, and the failure is not shown in CI

failures:

---- fuzz_cases::sort_fuzz::test_sort_1k_mem stdout ----
thread 'fuzz_cases::sort_fuzz::test_sort_1k_mem' panicked at datafusion/core/tests/fuzz_cases/sort_fuzz.rs:148:63:
called `Result::unwrap()` on an `Err` value: Execution("Failed to create partition file at \"/var/folders/73/gkp858j550z_tt8bx1m8k67w0000gn/T/.tmpXo6QCe/.tmpv6tET2\": Os { code: 24, kind: Uncategorized, message: \"Too many open files\" }")
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace


failures:
    fuzz_cases::sort_fuzz::test_sort_1k_mem

test result: FAILED. 23 passed; 1 failed; 0 ignored; 0 measured; 0 filtered out; finished in 11.56s

To Reproduce

cargo test --lib --tests --bins --features avro,json

Expected behavior

I expect to run the test pass locally. what setting should I use?

Additional context

No response

@jayzhan211 jayzhan211 added the bug Something isn't working label May 26, 2024
@mustafasrepo
Copy link
Contributor

On macos I use command ulimit -S -n 2048 in the terminal to increase open file limit (Not aware of any cargo only solution).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants