Code

Id restructure#19

Code

Merged

seankim658 merged 32 commits intomainclinical-biomarkers/biomarker-backend-api:mainfrom id_restructureclinical-biomarkers/biomarker-backend-api:id_restructureCopy head branch name to clipboardMar 25, 2024

+1,436-668

Commits

Commits on Mar 18, 2024

• moving id assignment process files

  seankim658

  committed
  8ef9d2e

  Copy full SHA for 8ef9d2e

• updating id structure/handling process

  seankim658

  committed
  5c83bf8

  Copy full SHA for 5c83bf8

• update docs

  seankim658

  committed
  15b7e82

  Copy full SHA for 15b7e82

• typo fix

  seankim658

  committed
  9a46fdc

  Copy full SHA for 9a46fdc

Commits on Mar 19, 2024

• add new collections

  seankim658

  committed
  6d4a57e

  Copy full SHA for 6d4a57e

• typo/formatting fix

  seankim658

  committed
  55245cd

  Copy full SHA for 55245cd

• id backend layer

  seankim658

  committed
  06df473

  Copy full SHA for 06df473

• control flow changes

  seankim658

  committed
  6fc63b7

  Copy full SHA for 6fc63b7

• add no collision logic

  seankim658

  committed
  65e16c1

  Copy full SHA for 65e16c1

• refactor public facing id assign script

  seankim658

  committed
  165e6cd

  Copy full SHA for 165e6cd

Commits on Mar 21, 2024

• move id assign process docs

  seankim658

  committed
  a6d1175

  Copy full SHA for a6d1175

• update links

  seankim658

  committed
  adb3d17

  Copy full SHA for adb3d17

• add dump id collection

  seankim658

  committed
  63a749c

  Copy full SHA for 63a749c

• add dump id collection logic

  seankim658

  committed
  ff5dfea

  Copy full SHA for ff5dfea

• add connection string builder and id collection dump

  seankim658

  committed
  d0f6dca

  Copy full SHA for d0f6dca

• reworked collision logic and load id collection in prod logic

  seankim658

  committed
  332d388

  Copy full SHA for 332d388

Commits on Mar 22, 2024

• fixed relative imports in helpers module

  seankim658

  committed
  712b7e2

  Copy full SHA for 712b7e2

• moved logger setup to capture potential mongo handle failure

  seankim658

  committed
  e74da48

  Copy full SHA for e74da48

• deep diff to json for serialization

  seankim658

  committed
  46428c2

  Copy full SHA for 46428c2

• fixed output formatting f string formatting

  seankim658

  committed
  8aef6db

  Copy full SHA for 8aef6db

• added file sorting to increase reproduceability and consistency

  seankim658

  committed
  f83ecaa

  Copy full SHA for f83ecaa

Commits on Mar 23, 2024

• fix deepdiff serialization formatting

  seankim658

  committed
  a94dd4d

  Copy full SHA for a94dd4d

• fix mongodb connection string

  seankim658

  committed
  87924ab

  Copy full SHA for 87924ab

• add debug information for dumping id collection to disk

  seankim658

  committed
  ec4b04d

  Copy full SHA for ec4b04d

• add debug information for loading id collection to prod database

  seankim658

  committed
  c6cd38f

  Copy full SHA for c6cd38f

Commits on Mar 24, 2024

• ignore load map in glob loops

  seankim658

  committed
  fec635d

  Copy full SHA for fec635d

• fix config file pathing

  seankim658

  committed
  7f191ea

  Copy full SHA for 7f191ea

• ignore load map during load map configuration

  seankim658

  committed
  f8c0308

  Copy full SHA for f8c0308

• change data collection index to biomarker_id field instead of canonical

  seankim658

  committed
  c4ad64b

  Copy full SHA for c4ad64b

• refactored error handling

  seankim658

  committed
  301240b

  Copy full SHA for 301240b

• fix logging when there are id collisions within the same data load version

  seankim658

  committed
  687872f

  Copy full SHA for 687872f

Commits on Mar 25, 2024

• fix documentation for load_map.json file

  seankim658

  committed
  19bbd21

  Copy full SHA for 19bbd21