This is a Meltano project for tap-theme-parks
to sync data to target-jsonl
or target-postgres
.
For more information about some of the plugins in this project, check out these GitHub repos and their READMEs:
- tap-theme-parks
- dbt-tap-theme-parks (Only applicable if using `target-postgres``, find out more below)
Have Python and Meltano installed.
- Clone this repo, and open it in your terminal
meltano install
meltano run tap-theme-parks target-jsonl
Now you will see some .json
files in the output/
directory containing theme park data!
If you want to persist you data a different target, you will need to have an instance of that target and provide the credentials for this project to connect to it. See step 2 below.
Its as easy a browsing the MeltanoHub, finding the loader you want to use and then:
meltano add loader <chosen-loader>
- Provide your settings for the loader
meltano run tap-theme-parks <chosen-loader>
If you target-postgres
, again by having a postgres database and the credentials to connect to it, you can then use the dbt project included in this project.
The dbt-tap-theme-parks project takes data from the raw tables created by tap-theme-parks and build easy to use and query dimension and fact tables. It also includes a snapshot to keep track of the most recent live data that you sync.
There is a Meltano job already in this project to run with postgres and dbt:
meltano run tap-theme-parks-to-target-postgres