Code

Support for JSON#107

Code

Merged

mikeknep merged 62 commits intomaingretelai/trainer:mainfrom jsongretelai/trainer:jsonCopy head branch name to clipboardMay 16, 2023

+1,756-208

Commits

Commits on May 16, 2023

• Add unflatten dep

  mikeknep

  committed
  a3620f0

  Copy full SHA for a3620f0

• copy/paste Sami's JSON code

  mikeknep

  committed
  1dc2f4c

  Copy full SHA for 1dc2f4c

• Style formatting on Sami's code

  mikeknep

  committed
  169b4ab

  Copy full SHA for 169b4ab

• Adjust JSON code to fit into relational package

  mikeknep

  committed
  a729477

  Copy full SHA for a729477

• Update RelationalData plus some tests

  mikeknep

  committed
  fd025a7

  Copy full SHA for fd025a7

• Restore output tables shapes at conclusion of transforms run

  mikeknep

  committed
  edbccf8

  Copy full SHA for edbccf8

• wip: scope

  mikeknep

  committed
  596a50f

  Copy full SHA for 596a50f

• json: expose root table name as property

  mikeknep

  committed
  b82e60e

  Copy full SHA for b82e60e

• core: set root table name on table metadata

  mikeknep

  committed
  5cd093c

  Copy full SHA for 5cd093c

• json: invented metadata stores root and original table names

  mikeknep

  committed
  180d702

  Copy full SHA for 180d702

• core: only invented tables exist in the graph

  mikeknep

  committed
  1a4159e

  Copy full SHA for 1a4159e

• Add db fixture that contains JSON

  mikeknep

  committed
  e6d4127

  Copy full SHA for e6d4127

• Add Evaluatable scope

  mikeknep

  committed
  c45cbb1

  Copy full SHA for c45cbb1

• json (111): only add PKID column for invented CHILD tables

  mikeknep

  committed
  8df636e

  Copy full SHA for 8df636e

• tests (111): update tests so that PKID only expected on invented CHILD tables

  mikeknep

  committed
  e414e48

  Copy full SHA for e414e48

• core: introduce invented scope + change debug summary format

  mikeknep

  committed
  570d76f

  Copy full SHA for 570d76f

• multitable: scope evaluations to appropriate tables

  mikeknep

  committed
  b80e3e7

  Copy full SHA for b80e3e7

• json: handle source table with empty/None PK

  mikeknep

  committed
  32bd2c1

  Copy full SHA for 32bd2c1

• core: get_public_name, + when asking for foreign keys defer json source to invented root

  mikeknep

  committed
  9e908ac

  Copy full SHA for 9e908ac

• Scope to public tables in report

  mikeknep

  committed
  71924bd

  Copy full SHA for 71924bd

• Use new public_name method in mt evaluations

  mikeknep

  committed
  3744ef7

  Copy full SHA for 3744ef7

• Reshape the synthetic output at the end

  mikeknep

  committed
  787aa48

  Copy full SHA for 787aa48

• Extract json tests to their own test file

  mikeknep

  committed
  244b8ca

  Copy full SHA for 244b8ca

• We don't need to store name on the table metadata

  mikeknep

  committed
  7597c9d

  Copy full SHA for 7597c9d

• Set some scopes

  mikeknep

  committed
  2fbb0fc

  Copy full SHA for 2fbb0fc

• Add test for inveted children foreign keys

  mikeknep

  committed
  3a10d80

  Copy full SHA for 3a10d80

• Extract bball rel_data to fixture

  mikeknep

  committed
  4a42838

  Copy full SHA for 4a42838

• Add tests documenting JSON PKs

  mikeknep

  committed
  6dcfcaf

  Copy full SHA for 6dcfcaf

• Support removing FKs from tables with JSON

  mikeknep

  committed
  49ce92d

  Copy full SHA for 49ce92d

• Move invented tables static suffix to autouse fixture

  mikeknep

  committed
  912d32b

  Copy full SHA for 912d32b

• Add list value to bball jsonl fixture

  mikeknep

  committed
  fe214de

  Copy full SHA for fe214de

• Support (re)setting PK on table with JSON data

  mikeknep

  committed
  842af43

  Copy full SHA for 842af43

• Extract method

  mikeknep

  committed
  78c59f8

  Copy full SHA for 78c59f8

• Ensure FKs are retained after resetting PK

  mikeknep

  committed
  b0d7621

  Copy full SHA for b0d7621

• Extract method to remove reljson

  mikeknep

  committed
  6bb8dcd

  Copy full SHA for 6bb8dcd

• Support updating existing JSON-containing data

  mikeknep

  committed
  977c423

  Copy full SHA for 977c423

• Support update table data with/out JSON

  mikeknep

  committed
  14a5b25

  Copy full SHA for 14a5b25

• Fix bug with index/PK column

  mikeknep

  committed
  60c40ce

  Copy full SHA for 60c40ce

• Support asking for FKs with user-supplied table names

  mikeknep

  committed
  f6d9b16

  Copy full SHA for f6d9b16

• Tweak table relationships in report

  mikeknep

  committed
  72cda43

  Copy full SHA for 72cda43

• Refactor RelJson initial parsing to classmethod

  mikeknep

  committed
  b3727c1

  Copy full SHA for b3727c1

• Reduce surface area

  mikeknep

  committed
  c551210

  Copy full SHA for c551210

• Use simpler attr for property

  mikeknep

  committed
  f303699

  Copy full SHA for f303699

• Return add commands from ingest so we can carry less on the instance

  mikeknep

  committed
  5ec9626

  Copy full SHA for 5ec9626

• RelJson data in backup/restore

  mikeknep

  committed
  23ae6f7

  Copy full SHA for 23ae6f7

• Remove RelationalData to/from filesystem methods

  mikeknep

  committed
  fef2442

  Copy full SHA for fef2442

• Expect dict, not internal type, in backup

  mikeknep

  committed
  7a075a8

  Copy full SHA for 7a075a8

• RelJson understands numpy arrays as lists

  mikeknep

  committed
  f4cba98

  Copy full SHA for f4cba98

• Handle case of restoring without all tables (e.g. model failed)

  mikeknep

  committed
  23d823b

  Copy full SHA for 23d823b

• Add type hints to json module

  mikeknep

  committed
  442a393

  Copy full SHA for 442a393

• Add some more JSON tests

  mikeknep

  committed
  92dacd9

  Copy full SHA for 92dacd9

• Refactor json to leverage RelData where possible

  mikeknep

  committed
  42b70e6

  Copy full SHA for 42b70e6

• Go back to table_name_mappings as a list to preserve order

  mikeknep

  committed
  8c2008d

  Copy full SHA for 8c2008d

• Typo fix

  Show description for 542836e
  

  mikeknep

  and

  pimlock

  committed
  542836e

  Copy full SHA for 542836e

• TIghten try/except range

  mikeknep

  committed
  70134bb

  Copy full SHA for 70134bb

• Revert "Go back to table_name_mappings as a list to preserve order"

  Show description for 26a1136
  mikeknep

  committed
  26a1136

  Copy full SHA for 26a1136

• lint

  mikeknep

  committed
  b99a8e2

  Copy full SHA for b99a8e2

• Remove unused import

  mikeknep

  committed
  40297f1

  Copy full SHA for 40297f1

• Add some logging to RelationalJson

  mikeknep

  committed
  79a899a

  Copy full SHA for 79a899a

• Add function to set relational log level

  mikeknep

  committed
  db54376

  Copy full SHA for db54376

• Add docstrings for Scope enum and its variants

  mikeknep

  committed
  41c5852

  Copy full SHA for 41c5852

• Update method names after rebasing

  mikeknep

  committed
  5aeb8a5

  Copy full SHA for 5aeb8a5