M5.2

[juliangruber]

Previous milestone:

• M5.1 #213

Next milestone:

• M5.3 #235

High-level goals

• Robust Spark on DDO
• First round of spot checks on SPs to validate Spark scores
• 2 checker subnets deployed to the network (Spark and one other)
• Create Checker leaderboard
• Support PLDG cohort 2 and get contributors this way
• Release Checker litepaper
• Finish rebrand items
• Partition Spark data by allocators

Carried over

• Create Meridian Apple Dev account #159
• Spark v1.5: limited support for DDO deals #218
• Deal Observer: initial implementation (deal activation events) #172
• Periodically add new deals to spark-api's database of eligible deals spark-deal-observer#26
• Arweave subnet PoC arweave#1
• Complete FIL-RetroPGF-2 process (verify test DRIPS transaction, etc.) #229

Tasks

• Release Checker litepaper @patrickwoodhead
• Finish rebrand items @juliangruber @patrickwoodhead
  • Rebrand to Checker Node core#676 @juliangruber
  • Rebrand to Checker App desktop#2048 @juliangruber

2 checker subnets deployed to the network

• Create polished Audius subnet PoC #224 ❗NEEDS CLARIFICATION

Create Checker leaderboard

• Product work
  • Start document for what we're about to build
  • How to compare storage DePINs
  • What does retrievability mean across DePINs?
  • Sketch leaderboard
  • What is a good 2nd DePIN to add?
  • Can we create the front-end in-house?
• Gather metrics for 2nd DePIN
• Rank 2 DePINs

Support PLDG cohort 2 and get contributors this way

• Support PLDG cohort #225 ❗** NEEDS CLARIFICATION**

Robust Spark on DDO

• Spark DDO support for Curio #231 @bajtos
• Deal Observer research: how to handle deal expiration/extension/slashing #171 @bajtos
• Architecture design for Spark v2 running allongside Spark v1 #227
• Harden the initial deal-observer implementation spark-deal-observer#58 @NikolasHaimerl
• Document requirements for SPs who want their DDO deals to be tested by Spark #232 @NikolasHaimerl

Spark data quality improvements

• First round of spot checks on SPs to validate Spark scores #226 @pyropy
• Count of desktop app users over time #207 @pyropy

Partition Spark data by allocators

• RSR per client #193 @NikolasHaimerl
• RSR per allocator #216

Candidates

• Refactor round tracker to not block service startup spark-api#311
• Test HEAD requests before GET spark#104
• Include minority retrieval results in the output of evaluate-measurements.js script spark-evaluate#458
• Gather more granular timing info spark-evaluate#460
• Glif API access-token security #222
• Optimise Filecoin RPC API usage #212
• Document Spark TTFB calculation #223 @pyropy
• Handle SPs changing their PeerID spark-deal-observer#48
• Plan FDS Canada
• Plan Prague colo
• Build Walrus checker PoC
• Rebrand Filecoin Station Core to Checker Network Core

Stretch goals from M5.1

• Chart for per-SP Spark Retrieval Result Codes breakdown #188
• Station Public Dashboard - optimise "Leaderboard - FIL Earned" #178
• Enforce a valid access token in requests spark-stats-request-metrics#7

Tech debt repayment (candidates)

• HTML linter spark-dashboard#24
• Setup TS type checking in all spark repositories #80
• Linter: detect unused dependencies #221
• Migrate from standard to neostandard + Prettier/dprint #166
• Fix dependabot not deploying on #main spark-stats#158
• Upgrade to Node.js 22 LTS #210
• Validate reported start_at and first_byte_at values during preprocess step spark-evaluate#447 @pyropy
• Self-healing spark-evaluate#3
• Remove obsolete mocha types spark-deal-observer#38 @NikolasHaimerl
• Remove use of T.Object for TypeBox spark-deal-observer#43 @NikolasHaimerl
• Enable strict TypeScript checks spark-deal-observer#51 @NikolasHaimerl --> chore: enable strict type checking spark-deal-observer#80
• Upgrade Checker Desktop to React v19 desktop#1997
• Handle reverted events spark-deal-observer#22 @NikolasHaimerl
• Handle Limit on archive retrievals spark-deal-observer#57 @NikolasHaimerl
• Piece Indexer Missing CIDs spark-deal-observer#30 @NikolasHaimerl --> feat: check for missing payload spark-deal-observer#77