Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Apply the cuFile error work around to data_sink as well #15335

Merged
merged 7 commits into from
Apr 1, 2024
Merged

Apply the cuFile error work around to data_sink as well #15335

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
0763508
move ctx init to a global to cover all cases
vuule Mar 19, 2024
098e3be
Merge branch 'branch-24.04' of https://github.com/rapidsai/cudf into …
vuule Mar 19, 2024
69f3af7
too early; go back to in line calls
vuule Mar 19, 2024
773a7b1
Merge branch 'branch-24.06' into bug-cuda-ctx-always-global-init
vuule Mar 21, 2024
3ef4d32
periods.
vuule Mar 25, 2024
bcc53b1
Merge branch 'branch-24.06' into bug-cuda-ctx-always-global-init
vuule Mar 25, 2024
34c8b26
Merge branch 'branch-24.06' into bug-cuda-ctx-always-global-init
vuule Apr 1, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 0 additions & 5 deletions cpp/src/io/utilities/datasource.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,11 +44,6 @@ class file_source : public datasource {
explicit file_source(char const* filepath) : _file(filepath, O_RDONLY)
{
if (detail::cufile_integration::is_kvikio_enabled()) {
// Workaround for https://github.com/rapidsai/cudf/issues/14140, where cuFileDriverOpen errors
// out if no CUDA calls have been made before it. This is a no-op if the CUDA context is
// already initialized
cudaFree(0);

_kvikio_file = kvikio::FileHandle(filepath);
CUDF_LOG_INFO("Reading a file using kvikIO, with compatibility mode {}.",
_kvikio_file.is_compat_mode_on() ? "on" : "off");
Expand Down
15 changes: 15 additions & 0 deletions cpp/src/io/utilities/file_io_utilities.cpp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,21 @@ namespace cudf {
namespace io {
namespace detail {

namespace {
class force_init_cuda_context {
public:
force_init_cuda_context()
{
// Workaround for https://github.com/rapidsai/cudf/issues/14140, where cuFileDriverOpen errors
// out if no CUDA calls have been made before it. This is a no-op if the CUDA context is already
// initialized
cudaFree(0);
}
};

force_init_cuda_context force_init_cuda_context_instance;
vuule marked this conversation as resolved.
Show resolved Hide resolved
} // namespace

[[noreturn]] void throw_on_file_open_failure(std::string const& filepath, bool is_create)
{
// save errno because it may be overwritten by subsequent calls
Expand Down
Loading