-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Minor: allow to build RuntimeEnv from RuntimeConfig #12151
Conversation
let runtime_config = RuntimeConfig::new() | ||
.with_memory_pool(Arc::new(GreedyMemoryPool::new(pool_size))); | ||
let runtime = Arc::new(RuntimeEnv::new(runtime_config).unwrap()); | ||
let runtime_env = RuntimeConfig::new() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
not sure why it is env, config is more appropriate imho
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's because a newly introduced method build
returns env. Please check the rest of this expression in diff below.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
let runtime = Arc::new(RuntimeEnv::new(runtime_config).unwrap()); | ||
let runtime_env = RuntimeConfig::new() | ||
.with_memory_pool(Arc::new(GreedyMemoryPool::new(pool_size))).build(); | ||
let runtime = Arc::new(runtime_env.unwrap()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
we should avoid calling .unwrap()
although its not related to the PR
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sure. Even for tests, if we have complex chains of unwraps, we can use expect
with a more detailed failure explanation.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(note this is a test so I think it is ok to call unwrap() here)
Thanks @theirix for you contribution, I started the pipeline |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @theirix and @comphead -- I think this looks good to me
@theirix -- any chance you can update other uses of RuntimeEnv::new()
in the codebase to use the new pattern. There appear to be a few more:
https://github.com/search?q=repo%3Aapache%2Fdatafusion%20RuntimeEnv%3A%3Anew&type=code
let runtime = Arc::new(RuntimeEnv::new(runtime_config).unwrap()); | ||
let runtime_env = RuntimeConfig::new() | ||
.with_memory_pool(Arc::new(GreedyMemoryPool::new(pool_size))).build(); | ||
let runtime = Arc::new(runtime_env.unwrap()); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
(note this is a test so I think it is ok to call unwrap() here)
let runtime_config = RuntimeConfig::new() | ||
.with_memory_pool(Arc::new(GreedyMemoryPool::new(pool_size))); | ||
let runtime = Arc::new(RuntimeEnv::new(runtime_config).unwrap()); | ||
let runtime_env = RuntimeConfig::new() |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you! I think tests would benefit from this change, and I see @devanbenz is up to improving tests. |
Which issue does this PR close?
Closes #12137
Rationale for this change
Allow to create
RuntimeEnv
directly from the config instance.What changes are included in this PR?
Are these changes tested?
To test this change, I've changed one existing test sort_fuzz to use a new API.
Are there any user-facing changes?
No