Code

Add writing and updating JSON database#7

Code

Merged

hotenov merged 56 commits intopre-releasehotenov/LEP-downloader:pre-releasefrom version-3hotenov/LEP-downloader:version-3Copy head branch name to clipboardOct 20, 2021

+10,389-168

Commits

Commits on Aug 4, 2021

• chore: 🙈 Return ignoring 'dist' folder after deleting old files

  hotenov

  committed
  741e6ed

Commits on Aug 11, 2021

• chore: Add blank files for future code structure

  hotenov

  committed
  8da9247

Commits on Aug 15, 2021

• chore: ➕ Add requests, beautifulsoup4, lxml for parsing HTML

  Show description for 3aa7c68
  hotenov

  committed
  3aa7c68

Commits on Sep 1, 2021

• chore: ➕ Add 'requests-file' to dev deps for future unit-tests

  hotenov

  committed
  df183a7

Commits on Sep 12, 2021

• chore: ➕ Add requests-mock 1.9.3 to dev dependencies

  hotenov

  committed
  a5ea064

Commits on Sep 13, 2021

• feat(parser): ✨ Add function to parse archive page

  Show description for 2632ddf
  hotenov

  committed
  2632ddf

• test(parser): ✅ Add test for checking mocked response of archive page

  Show description for 046d2fd
  hotenov

  committed
  046d2fd

Commits on Sep 17, 2021

• chore: Add test HTML files for several episodes

  Show description for 82c6595
  hotenov

  committed
  82c6595

• refactor(parser): 🚧 Update two functions for parsing all links and getting text link by href

  hotenov

  committed
  2779b33

• chore: 🔧 Add mapping dict for 4 links and their text

  hotenov

  committed
  35880be

• test: 🚧 Add PoC test for mocking several episode pages

  hotenov

  committed
  bb6cc74

Commits on Sep 20, 2021

• chore: 🔧 Update mypy settings in pyproject.toml

  Show description for 1fc6157
  hotenov

  committed
  1fc6157

• chore: 🔧 Rename Tuple with irrelevant links

  hotenov

  committed
  06a9fdc

• chore: ♻️ Improve typings and function names

  Show description for 9a804b7
  hotenov

  committed
  9a804b7

• test(parser): ✅ Add several general tests for parsing functions

  hotenov

  committed
  15b4c02

• ci: 🔧 Add installing of 'requests_mock' into 'tests' Nox session

  hotenov

  committed
  18c091f

• ci: 🔧 Exclude HTML files from 'pre-commit' hooks

  hotenov

  committed
  a1acae0

• style: 🎨 Commit changes which were modified by 'pre-commit' hooks

  hotenov

  committed
  9b02dea

• style: 🎨 Fix flake8 errors

  hotenov

  committed
  1fafe55

• chore: ➕ Add flake8 plugins to dev deps

  Show description for b32e2ed
  hotenov

  committed
  b32e2ed

• chore: 🔧 Change flake8 config: max-line-length = 120 and ignore long lines (B950)

  hotenov

  committed
  f727871

• ci: 🔧 Add installation of 'requests_mock' into 'typeguard' Nox session

  hotenov

  committed
  6207855

• chore: ➖ Remove unused 'requests-file' from dev-deps

  hotenov

  committed
  375a777

Commits on Sep 22, 2021

• fix(parser): Make links texts safe for windows path

  hotenov

  committed
  65b5ff9

• test(parser): ✅ Update test with getting link text by href

  hotenov

  committed
  6fd5b85

Commits on Sep 25, 2021

• chore: ➕ Add 'rope' package in dev deps for refactoring in VS Code

  hotenov

  committed
  add8793

• feat(parser): ✨ Parse episode page (date and episode number)

  Show description for 10a5126
  hotenov

  committed
  10a5126

Commits on Sep 26, 2021

• refactor(parser): ♻️ Add returning of URL final location during getting response

  Show description for 99942e2
  hotenov

  committed
  99942e2

• test(parser): ✅ Add tests to check final location after redirects

  Show description for 7e55d60
  hotenov

  committed
  7e55d60

• feat(parser): ✨ Add index generating for post URL

  Show description for eae8379
  hotenov

  committed
  eae8379

• test(parser): ✅ Add two tests to check index generation

  hotenov

  committed
  e1b6617

Commits on Sep 27, 2021

• feat: Add 'admin_note' attribute to LepEpisode class

  hotenov

  committed
  3d31f30

• feat(parser): Add logic for bad response of parsing page

  hotenov

  committed
  ad7ec11

• test(parser): ✅ Update tests taking into account response status for parsing page

  Show description for 0f61349
  hotenov

  committed
  0f61349

• style(parser): 🏷️ Fix 'mypy' and 'pre-commit' errors

  hotenov

  committed
  70f3a3b

Commits on Sep 28, 2021

• feat(parser): ✨ Add 'parsing_utc' attribute for LepEpisode class

  Show description for 76def0f
  hotenov

  committed
  76def0f

• test(parser): ✅ Update test to check parsing all links from list

  Show description for 2eaaf24
  hotenov

  committed
  2eaaf24

Commits on Sep 29, 2021

• feat(parser): ✨ Add function to parsing links to episode audio (parts)

  Show description for 271f646
  hotenov

  committed
  271f646

• test(parser): ✅ Add minimum sufficient tests (to satisfy Coverage)

  hotenov

  committed
  f487755

• refactor(parser): ♻️ Unify parsing part of archive page (tag <article> only)

  Show description for 5ad3fe7
  hotenov

  committed
  5ad3fe7

• style: 🎨 Fix 'pre-commit' errors for imports order

  hotenov

  committed
  07e3202

• refactor: ♻️ Change default value for 'audios' attribute to None

  Show description for 0a5e435
  hotenov

  committed
  0a5e435

Commits on Oct 1, 2021

• perf(parser): ⚡ Change algorithm to extract episode links and their texts

  Show description for 64c8602
  hotenov

  committed
  64c8602

• test(parser): ✅ Update tests according to new archive parsing algorythm

  Show description for 80e4ea9
  hotenov

  committed
  80e4ea9

Commits on Oct 6, 2021

• test(parser): ✅ Add two tests to check parsing mp3 links for certain cases

  Show description for 2769f42
  hotenov

  committed
  2769f42

• style: ✏️ Fix wrong writing of 'non-episode' word

  hotenov

  committed
  48e3674

Commits on Oct 7, 2021

• feat(parser): ✨ Add function for descending sorting of parsed episodes

  Show description for 9b32d97
  hotenov

  committed
  9b32d97

• test(parser): ✅ Add test to check episodes sorting

  Show description for bb27150
  hotenov

  committed
  bb27150

• fix(parser): 🐛 Change secondary key sorting to 'index'

  Show description for aea5b00
  hotenov

  committed
  aea5b00

Commits on Oct 19, 2021

• chore: 🔧 Add JSON_DB_URL configuration parameter

  hotenov

  committed
  3d65b69

• feat: 🏷️ Add 'LepJsonEncoder' class for json dump operations

  hotenov

  committed
  1f45c2b

• feat(parser): ✨ Add rough implementation of 'main' method with parsing actions (including writing JSON file)

  hotenov

  committed
  6863731

• test(parser): ✅ Add tests for writing and updating JSON database

  Show description for 580fe6b
  hotenov

  committed
  580fe6b

• style: 🎨 Fix imports by pre-commit

  Show description for b7d092d
  hotenov

  committed
  b7d092d

Commits on Oct 20, 2021

• Merge branch 'pre-release' into version-3

  hotenov

  committed
  a49c741

• Merge branch 'version-3' of github.com:hotenov/LEP-downloader into version-3

  hotenov

  committed
  79bec07