Code

Scrape imslp api#24

Code

Open

mbrandt00 wants to merge 61 commits intomainmbrandt00/PracticeLogger:mainfrom scrape-imslp-apimbrandt00/PracticeLogger:scrape-imslp-apiCopy head branch name to clipboard

+8,276-1,732

Commits

Commits on Nov 15, 2024

• exploratory scraping

  mbrandt00

  committed
  642758d

Commits on Nov 16, 2024

• Add pytest, static test file

  mbrandt00

  committed
  1316b84

• Add parse_key_signature with test

  mbrandt00

  committed
  2fce02f

• update ruff config

  mbrandt00

  committed
  7233bf2

• Implement parse key signature into movements_parsing with test

  mbrandt00

  committed
  ab954e7

• rename static piece

  mbrandt00

  committed
  467a0a9

• regex to split up sub piece number and title

  mbrandt00

  committed
  ff66901

• Add URL to movements list for highest download

  mbrandt00

  committed
  d6c5ab7

Commits on Nov 17, 2024

• Add movement test, clean up parse_movement function

  mbrandt00

  committed
  956ce2d

• Convert utils to module with private helper methods

  mbrandt00

  committed
  cc84004

• WIP collection iteration with selenium

  mbrandt00

  committed
  ed1908f

• lint and cleanup

  mbrandt00

  committed
  d7401c7

• Add pagination on collections with test

  mbrandt00

  committed
  586ebd3

• Simplify imports to use namespaced module

  mbrandt00

  committed
  b937950

• config changes

  mbrandt00

  committed
  30dbc7c

Commits on Nov 18, 2024

• Move common logic to helpers

  mbrandt00

  committed
  963b2b3

• WIP parse_metadata fn for imslp parsing

  mbrandt00

  committed
  fa4b73f

Commits on Nov 19, 2024

• Parse opus type number

  mbrandt00

  committed
  240e42f

• create typed dictionary, parse more attributes

  Show description for 3ee2984
  mbrandt00

  committed
  3ee2984

• Add instrumentation, composition_year (int) composition_year (str), test

  mbrandt00

  committed
  75ca6c9

Commits on Nov 20, 2024

• fix typo

  mbrandt00

  committed
  ab58fe0

• Add nickname and instrumentation parsing

  mbrandt00

  committed
  6002c1c

• add instrumentation and piece style

  mbrandt00

  committed
  f495624

Commits on Nov 23, 2024

• wip

  mbrandt00

  committed
  135101e

• Add catalogue_number_secondary

  mbrandt00

  committed
  36a6a4d

Commits on Nov 24, 2024

• use data class in movements in initialization

  mbrandt00

  committed
  19654bf

• Fix lint warnings

  mbrandt00

  committed
  cd6bbb9

• handle edge case where movement string has two sets of parens

  mbrandt00

  committed
  f7725b0

• parse piece movement count and type from top header

  mbrandt00

  committed
  481dcde

• lint

  mbrandt00

  committed
  aeba9e5

• Add visualization tools, handle sub piece type parsing bug

  mbrandt00

  committed
  1917415

Commits on Nov 25, 2024

• parse nicknames in movements, key signatures without parens

  mbrandt00

  committed
  16df9c4

Commits on Nov 27, 2024

• Make parse_movements accept url instead of bs4 tag

  mbrandt00

  committed
  72acb4d

• Remove html testing static files in favor of url

  mbrandt00

  committed
  9c03e78

• handle more edge cases in parse movement

  mbrandt00

  committed
  5fb7cad

• Handle more edge cases

  mbrandt00

  committed
  7040ae4

Commits on Nov 30, 2024

• more edge cases

  mbrandt00

  committed
  2c1a034

• WIP write to db

  mbrandt00

  committed
  823b9bb

• More safeguards

  mbrandt00

  committed
  6ac793b

• Make parsing catalogue type more robust, match sql enums

  mbrandt00

  committed
  228b9bf

• More normalization

  mbrandt00

  committed
  adb7705

• fix sub piece type parsing edge case

  mbrandt00

  committed
  899598a

• add unnaccent extension

  mbrandt00

  committed
  b28f2b0

• more edge cases

  mbrandt00

  committed
  26638cd

• Index nicknames when there are '/' correctly

  mbrandt00

  committed
  07912b9

Commits on Dec 1, 2024

• Add imslp schema, search on imslp pieces in graphql

  mbrandt00

  committed
  473ccf4

• Add key signature and opus number/type to search

  mbrandt00

  committed
  39c07d0

Commits on Dec 2, 2024

• Remove apple music dependency! Remove parsing functions, add imslp search to graphql schema, delete unused code

  mbrandt00

  committed
  00b22ca

Commits on Dec 8, 2024

• wip converting piece edit to use gql

  mbrandt00

  committed
  a1f5431

• Add selection set initializers to codegen config for previews

  mbrandt00

  committed
  5f7d414

• Add more fields to PieceDetails fragments, display in PieceEdit view, display extensions

  mbrandt00

  committed
  f4f8337

• Handle more edge cases

  mbrandt00

  committed
  f16aa1f

• Add constraint on imslp.pieces for uniqueness on imslp_url

  mbrandt00

  committed
  3ca5d65

Commits on Dec 10, 2024

• remove tempo markings from movements name

  mbrandt00

  committed
  c3a36dc

• fix on conflict handler

  mbrandt00

  committed
  39c34bb

Commits on Dec 12, 2024

• Handle edge case

  mbrandt00

  committed
  42072fa

• Move method for fetching from imslp to util script

  mbrandt00

  committed
  72bad46

• Format files

  mbrandt00

  committed
  22198eb

• Add functions to fetch and write to pg

  mbrandt00

  committed
  c894eff

Commits on Dec 16, 2024

• Update catalogue type enums

  mbrandt00

  committed
  4b33954

• Update piece edit view

  mbrandt00

  committed
  0e373b3