Code

Adds Nested Json benchmark#11466

Code

Merged

rapids-bot[bot] merged 88 commits intorapidsai:branch-22.10rapidsai/cudf:branch-22.10from karthikeyann:fea-json_benchmarkkarthikeyann/cudf:fea-json_benchmarkCopy head branch name to clipboardSep 1, 2022

+85

Commits

Commits on Jul 13, 2022

• squashed with bracket/brace test

  elstehle

  committed
  0557d41

  Copy full SHA for 0557d41

• clean up & addressing review comments

  elstehle

  committed
  355d1e4

  Copy full SHA for 355d1e4

• refactored lookup tables

  elstehle

  committed
  39a6b65

  Copy full SHA for 39a6b65

• put lookup tables into their own cudf file

  elstehle

  committed
  239f138

  Copy full SHA for 239f138

• Change interface for FST to not need temp storage

  elstehle

  committed
  39cff80

  Copy full SHA for 39cff80

• removing unused var post-cleanup

  elstehle

  committed
  e24a133

  Copy full SHA for e24a133

• unified usage of pragma unrolls

  elstehle

  committed
  caf6195

  Copy full SHA for caf6195

• Adding hostdevice macros to in-reg array

  elstehle

  committed
  ea79a81

  Copy full SHA for ea79a81

• making const vars const

  elstehle

  committed
  17dcbfd

  Copy full SHA for 17dcbfd

• refactor lut sanity check

  elstehle

  committed
  6fdd24a

  Copy full SHA for 6fdd24a

• fixes sg-count & uses rmm stream in fst tests

  elstehle

  committed
  eccf970

  Copy full SHA for eccf970

• minor doxygen fix

  elstehle

  committed
  9fe8e4b

  Copy full SHA for 9fe8e4b

• adopts suggested fst test changes

  elstehle

  committed
  694a365

  Copy full SHA for 694a365

• adopts device-side test data gen

  elstehle

  committed
  f656f49

  Copy full SHA for f656f49

• adopts c++17 namespaces declarations

  elstehle

  committed
  485a1c6

  Copy full SHA for 485a1c6

• removes state vector-wrapper in favor of vanilla array

  elstehle

  committed
  5f1c4b5

  Copy full SHA for 5f1c4b5

• some west-const remainders & unifies StateIndexT

  elstehle

  committed
  e6f8def

  Copy full SHA for e6f8def

• adds check for state transition narrowing conversion

  elstehle

  committed
  a798852

  Copy full SHA for a798852

• fixes logical stack test includes

  elstehle

  committed
  eb24962

  Copy full SHA for eb24962

Commits on Jul 14, 2022

• replaces enum with typed constexpr

  elstehle

  committed
  f52e614

  Copy full SHA for f52e614

• adds excplitis error checking

  elstehle

  committed
  3038058

  Copy full SHA for 3038058

• addresses style review comments & fixes a todo

  elstehle

  committed
  d351e5c

  Copy full SHA for d351e5c

• replaces gtest asserts with expects

  elstehle

  committed
  3f47952

  Copy full SHA for 3f47952

• fixes style in dispatch dfa

  elstehle

  committed
  cba1619

  Copy full SHA for cba1619

Commits on Jul 15, 2022

• replaces vanilla loop with iota

  elstehle

  committed
  bea2a02

  Copy full SHA for bea2a02

Commits on Jul 16, 2022

• rephrases documentation on in-reg array

  elstehle

  committed
  8a184e9

  Copy full SHA for 8a184e9

• Merge remote-tracking branch 'upstream/branch-22.08' into feature/finite-state-transducer-trimmed

  elstehle

  committed
  78dd893

  Copy full SHA for 78dd893

Commits on Jul 19, 2022

• Merge remote-tracking branch 'upstream/branch-22.08' into feature/finite-state-transducer-trimmed

  elstehle

  committed
  7a19f64

  Copy full SHA for 7a19f64

Commits on Jul 20, 2022

• improves style in fst test

  elstehle

  committed
  4783aae

  Copy full SHA for 4783aae

• adds comments in in_reg array

  elstehle

  committed
  6203709

  Copy full SHA for 6203709

• adds comments to lookup tables

  elstehle

  committed
  ad5817a

  Copy full SHA for ad5817a

• fixes formatting

  elstehle

  committed
  dc55653

  Copy full SHA for dc55653

• exchanges loops in favor of copy and fills

  elstehle

  committed
  378be9f

  Copy full SHA for 378be9f

• clarifies documentation in agent dfa

  elstehle

  committed
  4ba5472

  Copy full SHA for 4ba5472

• disambiguates transition and translation tables

  elstehle

  committed
  7980978

  Copy full SHA for 7980978

Commits on Jul 21, 2022

• minor style fix

  elstehle

  committed
  2bce061

  Copy full SHA for 2bce061

• if constexprs and doxy on DFA helper

  elstehle

  committed
  b37f716

  Copy full SHA for b37f716

• minor documentation fix

  elstehle

  committed
  d42869a

  Copy full SHA for d42869a

• replaces loop for comparing vectors with generic macro

  elstehle

  committed
  6c889f7

  Copy full SHA for 6c889f7

• uses new vector comparison for logical stack test

  elstehle

  committed
  8a54c72

  Copy full SHA for 8a54c72

Commits on Jul 22, 2022

• Added utility to debug print & instrumented code to use it

  elstehle

  committed
  cc1e135

  Copy full SHA for cc1e135

• switched to using rmm also inside algorithm

  elstehle

  committed
  7dba177

  Copy full SHA for 7dba177

• renaming key-value store op to stack_op

  elstehle

  committed
  ff7144a

  Copy full SHA for ff7144a

• device_span

  elstehle

  committed
  61a76b7

  Copy full SHA for 61a76b7

• minor style changes addressing review comments

  elstehle

  committed
  c28e327

  Copy full SHA for c28e327

• squashed with bracket/brace test

  elstehle

  committed
  a2f27ae

  Copy full SHA for a2f27ae

• refactored lookup tables

  elstehle

  committed
  fe4762d

  Copy full SHA for fe4762d

• put lookup tables into their own cudf file

  elstehle

  committed
  a064bdd

  Copy full SHA for a064bdd

• fixes sg-count & uses rmm stream in fst tests

  elstehle

  committed
  2c729c0

  Copy full SHA for 2c729c0

• rebase on latest FST

  elstehle

  committed
  dbefb6c

  Copy full SHA for dbefb6c

• fixes breaking changes from dependent-FST-PR

  elstehle

  committed
  d54f3e5

  Copy full SHA for d54f3e5

• fixes for breaking downstream interface changes

  elstehle

  committed
  5fc3399

  Copy full SHA for 5fc3399

• wraps if with stream params into detail ns

  elstehle

  committed
  6f65947

  Copy full SHA for 6f65947

• renames enums & moving from device_span to ptr params

  elstehle

  committed
  6ffc7f3

  Copy full SHA for 6ffc7f3

• fixes rebase conflicts

  elstehle

  committed
  0a7821e

  Copy full SHA for 0a7821e

• fixes escape sequence inside strings and field names and adds test for it

  elstehle

  committed
  7396335

  Copy full SHA for 7396335

• adds comments on pda transition table states

  elstehle

  committed
  6252208

  Copy full SHA for 6252208

• adopts new verification macro in test

  elstehle

  committed
  191d71d

  Copy full SHA for 191d71d

• Merge branch 'branch-22.08' of https://github.com/rapidsai/cudf into feature/json-tokenizer

  karthikeyann

  committed
  4e99962

  Copy full SHA for 4e99962

• removes superfluous semicolons

  elstehle

  committed
  3b9a1ed

  Copy full SHA for 3b9a1ed

Commits on Jul 23, 2022

• rearranges token order in enum and adds documentation

  elstehle

  committed
  632be35

  Copy full SHA for 632be35

• uses namespace alias and switch to rmm stream in test

  elstehle

  committed
  3237772

  Copy full SHA for 3237772

Commits on Jul 24, 2022

• drops the gpu namespace

  elstehle

  committed
  d2832b9

  Copy full SHA for d2832b9

• renames header file extension from h to hpp

  elstehle

  committed
  618ed3f

  Copy full SHA for 618ed3f

Commits on Jul 27, 2022

• squashed with minimal example

  elstehle

  committed
  19b37b7

  Copy full SHA for 19b37b7

• add parse_json_to_columns -> cudf::column

  karthikeyann

  committed
  f015594

  Copy full SHA for f015594

• + wraps dbg print in macro

  Show description for 389e8e8
  elstehle

  committed
  389e8e8

  Copy full SHA for 389e8e8

• disables debug print by default

  elstehle

  committed
  42f7c4a

  Copy full SHA for 42f7c4a

• Merge remote-tracking branch 'origin/feature/json-to-columnar' into feature/json-to-columnar

  elstehle

  committed
  3e9db89

  Copy full SHA for 3e9db89

Commits on Jul 28, 2022

• changeing interface of get_json_columns to also take device_span

  elstehle

  committed
  ecf68fc

  Copy full SHA for ecf68fc

• parsing to table_with_metadata

  elstehle

  committed
  93cbe1a

  Copy full SHA for 93cbe1a

• removes debug print examples

  elstehle

  committed
  a1d8901

  Copy full SHA for a1d8901

• renames lists child col name to elements

  elstehle

  committed
  b9296d6

  Copy full SHA for b9296d6

• adds validity

  elstehle

  committed
  5eddcc7

  Copy full SHA for 5eddcc7

• fixes style

  elstehle

  committed
  cfcd7a1

  Copy full SHA for cfcd7a1

• minor cleanup

  karthikeyann

  committed
  4c2ea7b

  Copy full SHA for 4c2ea7b

• use device_uvector at few places

  karthikeyann

  committed
  8fc3adc

  Copy full SHA for 8fc3adc

Commits on Jul 30, 2022

• fixes metadata to match parquets metadata

  elstehle

  committed
  c1b9213

  Copy full SHA for c1b9213

Commits on Aug 1, 2022

• Merge branch 'branch-22.08' of https://github.com/rapidsai/cudf into feature/json-to-columnar

  karthikeyann

  committed
  e5b1ba6

  Copy full SHA for e5b1ba6

• use make_device_uvector_async

  karthikeyann

  committed
  fd02437

  Copy full SHA for fd02437

• Apply suggestions from code review (nvdbaranec)

  Show description for f5810f8
  

  karthikeyann

  and

  nvdbaranec

  authored
  f5810f8

  Copy full SHA for f5810f8

• added mr

  karthikeyann

  committed
  342d3c3

  Copy full SHA for 342d3c3

Commits on Aug 2, 2022

• add utf fail, pass test cases

  karthikeyann

  committed
  f6a531a

  Copy full SHA for f6a531a

Commits on Aug 4, 2022

• Merge branch 'branch-22.10' of https://github.com/rapidsai/cudf into feature/json-to-columnar

  karthikeyann

  committed
  2f22899

  Copy full SHA for 2f22899

• add NESTED_JSON_NVBENCH

  karthikeyann

  committed
  a141110

  Copy full SHA for a141110

Commits on Aug 23, 2022

• Merge branch 'branch-22.10' of github.com:rapidsai/cudf into fea-json_benchmark

  karthikeyann

  committed
  188b140

  Copy full SHA for 188b140

• remove merge missed files

  karthikeyann

  committed
  ba3483f

  Copy full SHA for ba3483f

• address review comments

  karthikeyann

  committed
  cad1060

  Copy full SHA for cad1060