Code

Remote IO: http support#464

Code

Merged

rapids-bot[bot] merged 73 commits intorapidsai:branch-24.12rapidsai/kvikio:branch-24.12from madsbk:remote-iomadsbk/kvikio:remote-ioCopy head branch name to clipboardOct 8, 2024

+1,305-2

Commits

Commits on Sep 30, 2024

• Impl. basic remote handle

  madsbk

  committed
  a01dc53

• RemoteHandle::read()

  madsbk

  committed
  a6467d5

• ci: rangehttpserver

  madsbk

  committed
  127b782

• libcurl>=7.75.0 # Need <https://curl.se/libcurl/c/CURLOPT_AWS_SIGV4.html>

  madsbk

  committed
  089397f

• cmake

  madsbk

  committed
  5f1fca0

• fix ci rangehttpserver

  madsbk

  committed
  eaacacf

• cleanup

  madsbk

  committed
  59595a8

• get_file_size(): check -1

  madsbk

  committed
  f803220

• Read(): check file size

  madsbk

  committed
  dd06044

• LibCurl get/set: use lock

  madsbk

  committed
  06dcb35

• test_no_range_support

  madsbk

  committed
  7501600

• bump libcurl>=7.87.0

  madsbk

  committed
  7e6315e

• ci: more libcurl>=7.87.0

  madsbk

  committed
  4f9ab63

• cmake: CURL 7.87.0

  madsbk

  committed
  a20774c

• ci_debug

  madsbk

  committed
  43421ed

• CURLOPT_FOLLOWLOCATION

  madsbk

  committed
  7df0e9f

• overflow_error

  madsbk

  committed
  40b4be3

• RemoteEndpoint

  madsbk

  committed
  943e30b

• cpp_RemoteEndpoint

  madsbk

  committed
  e8f6b12

• from_http_url

  madsbk

  committed
  5f73677

• Update cpp/include/kvikio/remote_handle.hpp

  Show description for 5dbe2e5
  

  madsbk

  and

  wence-

  committed
  5dbe2e5

• setopt(): use CURLoption

  madsbk

  committed
  f9873c0

• comment: need CURL_WRITEFUNC_ERROR

  madsbk

  committed
  4896452

• LibCurl: use vector

  madsbk

  committed
  e53b761

• UniqueHandlePtr

  madsbk

  committed
  4ba4eb4

• get_handle() / retain_handle()

  madsbk

  committed
  bf716be

• clean up

  madsbk

  committed
  83774e3

• doc

  madsbk

  committed
  e884d3c

• utils: LocalHttpServer

  madsbk

  committed
  6637089

• http benchmark

  madsbk

  committed
  a0098e9

• test_http_io

  madsbk

  committed
  0e6dc7a

• example

  madsbk

  committed
  f0b2f9f

• cleanup

  madsbk

  committed
  8e7e2cf

• cmake: rapids_cpm_find CURL

  madsbk

  committed
  fa67219

• cleanup

  madsbk

  committed
  9906a14

• doc

  madsbk

  committed
  d38121b

• cleanup

  madsbk

  committed
  bdc1e22

• Merge branch 'branch-24.10' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  51057f6

• clean up

  madsbk

  committed
  383fa4c

• docs

  madsbk

  committed
  0055373

Commits on Oct 1, 2024

• doc

  madsbk

  committed
  628e525

• fix virtual dtor

  madsbk

  committed
  8726f87

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  3222c92

• fix benckmark

  madsbk

  committed
  c94121d

• clean up

  madsbk

  committed
  0c764ba

• libcurl.hpp

  madsbk

  committed
  91d953b

• rename: RemoteFile.open_http

  madsbk

  committed
  94e47ee

• doc

  madsbk

  committed
  fcb9358

• cleanup

  madsbk

  committed
  e8018d1

• PushAndPopContext outside callback_device_memory()

  madsbk

  committed
  bb737b9

Commits on Oct 2, 2024

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  f3f46f8

• more nvtx

  madsbk

  committed
  b8a9c0a

Commits on Oct 3, 2024

• Apply suggestions from code review

  Show description for 9cffe1c
  

  3 peopleauthored
  9cffe1c

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  792f43f

• std::function<decltype(curl_easy_cleanup)>

  madsbk

  committed
  1257a9f

• getinfo: take output pointer

  madsbk

  committed
  1006b24

• STATUS

  madsbk

  committed
  9ba9752

• close

  madsbk

  committed
  128e3dd

• test_http_io: check is_remote_file_available

  madsbk

  committed
  0df1726

• std::ptrdiff_t

  madsbk

  committed
  96af5ac

• Apply suggestions from code review

  Show description for feccdd9
  

  madsbk

  and

  bdice

  authored
  feccdd9

• Merge branch 'remote-io' of github.com:madsbk/kvikio into remote-io

  madsbk

  committed
  119c025

• use conda's rangehttpserver

  madsbk

  committed
  7dcc8f3

• doc

  madsbk

  committed
  60f7331

• CallbackContext ctor

  madsbk

  committed
  13e0b7a

• host: libcurl==7.87.0

  madsbk

  committed
  474e694

• run: remove libcurl>=7.87.0

  madsbk

  committed
  9022b18

• curl-7_87_0

  madsbk

  committed
  8bbb33b

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  46b9300

• kvikio/meta.yaml: libcurl==7.87.0

  madsbk

  committed
  1176b67

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  4ed88a2

Commits on Oct 7, 2024

• Merge branch 'branch-24.12' of https://github.com/rapidsai/kvikio into remote-io

  madsbk

  committed
  cc7b291

• cmake clean up

  madsbk

  committed
  58e3054