Skip to content

StasJS/17landsPublicDataNormaliser

Repository files navigation

This repo contains tools to normalise 17land's public datasets.

Under the Releases tab, there are normalised JSON versions of the 17lands public datasets for various formats.

Motivation

While a sparse dataframe might be more familiar/convenient for heavy data analysis using something like pandas in the hands of a data science professional, I personally found a hierarchical object-based model more intuitive. The transformed data also serialises much more efficiently, reducing file sizes 5-10x.

What's in this repo?

demonstrates how one might perform analysis using the JSON data, via C# and LINQ queries.

automates the process of

  • pulling down 17lands data
  • parsing and transforming
  • serialising to JSON
  • zipping

It assumes 7Zip is installed (on Windows).

A C# program to parse unzipped 17lands CSV data and transform it into hierarchical JSON data.