Ingest Migration - OpenData Datasets

[fvankrieken]

All 19 datasets in the opendata weekly pull should be migrated. This includes

• dcp_edesignation_csv
• doitt_buildingfootprints
• doitt_buildingfootprints_historical
• dot_projects_intersections
• dot_projects_streets
• dpr_capital_projects (script source, but is part of this recurring job)
• dpr_forever_wild
• dpr_greenthumb
• dpr_park_access_zone
• dpr_parksproperties
• dpr_schoolyard_to_playgrounds
• dsny_frequencies
• dsny_garages
• fdny_firehouses
• lpc_historic_districts
• lpc_historic_district_areas
• lpc_landmarks
• lpc_scenic_landmarks
• nypd_policeprecincts

[sf-dcp]

nypd_policeprecincts

________________________________________________________________________________
Tables
    Left: nypd_policeprecincts_library
    Right: nypd_policeprecincts_ingest
________________________________________________________________________________
Row count
    Left: 77
    Right: 77
________________________________________________________________________________
Column comparison
    Both
        data_library_version
        ogc_fid
        precinct
        shape_area
        shape_leng
        wkb_geometry
    Left only: None
    Right only: None
    Type differences
        Precinct
            Left: character varying
            Right: text
        Shape area
            Left: character varying
            Right: text
        Shape leng
            Left: character varying
            Right: text
________________________________________________________________________________
Data comparison
    Compared columns
        precinct
        shape_area
        shape_leng
        wkb_geometry
    Left only
        Empty DataFrame
        Columns: [shape_area, shape_leng, wkb_geometry, precinct]
        Index: []
    Right only
        Empty DataFrame
        Columns: [shape_area, shape_leng, wkb_geometry, precinct]
        Index: []

[fvankrieken]

So dpr_capitalprojects, two notes

• there is an in progress ingest template in dcpy/lifecycle/ingest/dev_templates that has the json parsing (hopefully?) done
• this really is unrelated to socrata, so while doing it with this group, let's remove it from the gha. I added it here a21cee2 for some reason, but this doesn't seem appropriate. I think I was just mistaken and added the wrong dataset to the job