Code

nssp patching code#2000

Code

Open

minhkhul wants to merge 46 commits intomaincmu-delphi/covidcast-indicators:mainfrom nssp_patchingcmu-delphi/covidcast-indicators:nssp_patchingCopy head branch name to clipboard

+585-27

Commits

Commits on Jul 23, 2024

• nssp patching code

  minhkhul

  committed
  c78ae21

  Copy full SHA for c78ae21

• lint

  minhkhul

  committed
  7694c0a

  Copy full SHA for 7694c0a

Commits on Jul 24, 2024

• add test

  minhkhul

  committed
  a3ed4c2

  Copy full SHA for a3ed4c2

• add test

  minhkhul

  committed
  1628d34

  Copy full SHA for 1628d34

• Add patching how-to to readme

  minhkhul

  committed
  2536b94

  Copy full SHA for 2536b94

Commits on Jul 25, 2024

• adjust current_issue_dir name for weekly data instead of daily.

  minhkhul

  committed
  e4d45e5

  Copy full SHA for e4d45e5

• lint

  minhkhul

  committed
  db906fc

  Copy full SHA for db906fc

• adjust test for more cases

  minhkhul

  committed
  8f0bb32

  Copy full SHA for 8f0bb32

Commits on Aug 6, 2024

• add custom_run flag

  minhkhul

  committed
  7f151f5

  Copy full SHA for 7f151f5

• handle custom flag on but bad config

  minhkhul

  committed
  c093349

  Copy full SHA for c093349

• make patch config check readable

  minhkhul

  committed
  a967416

  Copy full SHA for a967416

• make good_patch_config check comprehensive

  minhkhul

  committed
  c020da6

  Copy full SHA for c020da6

Commits on Aug 7, 2024

• rewrite good_patch_config for clarity

  minhkhul

  committed
  9a6130b

  Copy full SHA for 9a6130b

• add unit tests for good_patch_config check

  minhkhul

  committed
  b8a2177

  Copy full SHA for b8a2177

• add test_pull unit test for patching case + cleanup format

  minhkhul

  committed
  a7d9443

  Copy full SHA for a7d9443

Commits on Aug 8, 2024

• split test cases + move to pytest

  minhkhul

  committed
  e29e07e

  Copy full SHA for e29e07e

Commits on Aug 9, 2024

• add test for multi-week patching

  minhkhul

  committed
  0a4bfb6

  Copy full SHA for 0a4bfb6

Commits on Aug 15, 2024

• rename tests for clarity + restructure test_patch tests to clarify purpose

  minhkhul

  committed
  6c0abad

  Copy full SHA for 6c0abad

• make expected issue dates explicit in test_patch_confirm_dir_structure_created

  minhkhul

  committed
  7078dd0

  Copy full SHA for 7078dd0

• add log to distinguish grabbing records from socrata vs locally stored csv in pull_nssp_data

  minhkhul

  committed
  d435bf0

  Copy full SHA for d435bf0

Commits on Aug 28, 2024

• Update nssp/README.md

  Show description for 8734daa
  

  minhkhul

  and

  nmdefries

  authored
  8734daa

  Copy full SHA for 8734daa

• Update nssp/README.md

  Show description for 5a6f8b6
  

  minhkhul

  and

  nmdefries

  authored
  5a6f8b6

  Copy full SHA for 5a6f8b6

Commits on Aug 29, 2024

• Add auto-download source backup data + update docs + test

  minhkhul

  committed
  4356494

  Copy full SHA for 4356494

Commits on Aug 30, 2024

• adjust custom_run flag to leave room for non-patch custom runs

  minhkhul

  committed
  ca427a4

  Copy full SHA for ca427a4

• move pull logic from run.py into pull.py

  minhkhul

  committed
  f58b068

  Copy full SHA for f58b068

• logger to static

  minhkhul

  committed
  5e93175

  Copy full SHA for 5e93175

• adjust unit tests

  minhkhul

  committed
  2d8670d

  Copy full SHA for 2d8670d

Commits on Aug 31, 2024

• more unit test adjustment

  minhkhul

  committed
  f0335f6

  Copy full SHA for f0335f6

Commits on Sep 3, 2024

• move get_source_data to pull.py + make get_source_data run when source_dir not exist/empty + adjust tests accordingly

  minhkhul

  committed
  7e06f94

  Copy full SHA for 7e06f94

• auto-remove source_dir content after finish patch run

  minhkhul

  committed
  e678ce6

  Copy full SHA for e678ce6

• lint happy

  minhkhul

  committed
  bc1d7a7

  Copy full SHA for bc1d7a7

Commits on Sep 10, 2024

• Update pull.py

  minhkhul

  authored
  84cba84

  Copy full SHA for 84cba84

• Update pull.py - remove stat debug

  minhkhul

  authored
  742737b

  Copy full SHA for 742737b

• add progress log for source file download

  minhkhul

  committed
  e13d3db

  Copy full SHA for e13d3db

• lint

  minhkhul

  authored
  9cec6ff

  Copy full SHA for 9cec6ff

• lint

  minhkhul

  committed
  5450d8b

  Copy full SHA for 5450d8b

Commits on Dec 19, 2024

• Merge remote-tracking branch 'origin/main' into nssp_patching

  minhkhul

  committed
  0a8da1e

  Copy full SHA for 0a8da1e

Commits on Jan 3, 2025

• rewrite get_source_data to get source data from prod backup_dir + add secondary source pull

  minhkhul

  committed
  ab4b542

  Copy full SHA for ab4b542

Commits on Jan 5, 2025

• various bug fixes

  minhkhul

  committed
  14b4e6f

  Copy full SHA for 14b4e6f

Commits on Jan 6, 2025

• remove source data from local after patch run

  minhkhul

  committed
  d9e1f74

  Copy full SHA for d9e1f74

• fix tests in test_pull

  minhkhul

  committed
  ca5294b

  Copy full SHA for ca5294b

Commits on Jan 7, 2025

• Add new + fix current patch tests + fix duplicated data

  minhkhul

  committed
  49c4f67

  Copy full SHA for 49c4f67

• use set comprehension in get_patch_dates

  minhkhul

  committed
  fb3fbf2

  Copy full SHA for fb3fbf2

Commits on Jan 8, 2025

• lint

  minhkhul

  committed
  1f5a4dc

  Copy full SHA for 1f5a4dc

• make user param optional when no source data download needed

  minhkhul

  committed
  32f550e

  Copy full SHA for 32f550e

• linter

  minhkhul

  committed
  2214f87

  Copy full SHA for 2214f87