Skip to content

Commit

Permalink
Created test and download scripts for autoscript
Browse files Browse the repository at this point in the history
  • Loading branch information
HarishC727 committed Nov 25, 2024
1 parent 95d1c33 commit fa8afef
Show file tree
Hide file tree
Showing 53 changed files with 4,501 additions and 222,125 deletions.
18 changes: 17 additions & 1 deletion scripts/oecd/regional_demography/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -72,16 +72,32 @@ In each subdirectory, the StatVarObservation template MCF files are saved as `OE

### Script

The script file `preprocess_csv.py` in each subdirectory is used to generate cleaned CSV and template MCF files.
The script file `preprocess_csv.py` in each subdirectory is used to download, process and generate cleaned CSV and template MCF files.

## Generating Artifacts

To generate the cleaned csv and template MCF files, run

- To download the input file of the particular file run-
```bash
python3 preprocess_csv.py --mode=download
```

- To process the input file of the particular file run-
```bash
python3 preprocess_csv.py --mode=process
```

- To download and process the input file of the particular file run-
```bash
python3 preprocess_csv.py
```

- To run the test scripts
```bash
python3 -m unittest process_csv_test.py
```

For population, following the Raw Data section, first copy its raw data to population direction.
Then run the same preprocess_csv command, it will generate artifacts as well as cleaned CSV.

Expand Down
Loading

0 comments on commit fa8afef

Please sign in to comment.