Skip to content
This repository has been archived by the owner on Jun 15, 2021. It is now read-only.

RDC Individual Frames, Indexes, & Lake Gallery Mosaics

brez edited this page Sep 7, 2018 · 22 revisions

Directory Tree

tnris-ls4/
       |---><band>/
                 |---><county>/
                             |---><agency>_<yyyy>/
                                              |--->frames/
                                              |         |--->scanned/
                                              |         |           |---><mm>-<dd>-<yy>_<roll>-<frame #>.tif
                                              |         |--->georef/
                                              |         |           |---><mm>-<dd>-<yy>_<roll>-<frame #>.tif
                                              |--->index/
                                              |         |--->scanned/
                                              |         |           |---><originator>_<yyyy>_<sheet #>.tif
                                              |         |--->georef/
                                              |         |           |---><originator>_<yyyy>_<sheet #>_<tile #>.tif
                                              |--->mosaic/
                                                        |--->georef/
                                                        |           |--->mosaic<tile #>.tif

tnris-ls4/
       |---><band>/
                 |---><multi-county agency>/
                             |---><mission code>/
                                              |--->frames/
                                              |         |--->scanned/
                                              |         |           |---><mm>-<dd>-<yy>_<roll>-<frame #>.tif
                                              |         |--->georef/
                                              |         |           |---><mm>-<dd>-<yy>_<roll>-<frame #>.tif
                                              |--->mosaic/
                                                        |--->georef/
                                                        |           |--->mosaic<tile #>.tif

tnris-ls4/
       |---><band>/
                 |--->StratMap/
                             |---><area label>_<yyyy>_<size>in/
                                              |--->mosaic/
                                                        |--->georef/
                                                        |           |---><stratmap name using dashes for separator>_<quad id>_<yyyymmdd>.tif

Band Options:

  • bw

  • nc

Examples:

s3://tnris-ls4/bw/Bexar/txdot_1956/index/georef/05-09-56_04-53.tif
s3://tnris-ls4/nc/USDA/123456/frames/scanned/05-09-56_04-53.tif

Individual Frames

  1. scan frame as .tif as normal. save to the normal folder structure (Q drive?) in the normal organized location.

  2. open the .tif in ArcMap and georeference as per normal instructions (saving separate world file as per normal procedures). typically, georeferencing with the most locale projection is most accurate.

  3. then, with the georeferenced .tif in arcmap, export with the rules:

    * `256` populated for handling the NoData field.
    * WGS84 Web Mercator (`EPSG 3857`) Projection
    
    These rules create and save a .tif with the proper projection, header information, and transparency for 
    cells of no data. <em>Note: this process does create another world file (.tfw) but this can be ignored - we 
    won't be using it</em>
  4. Upload original, non-georeferenced scan to the correct “…/frames/scanned/” directory tree location.

  5. Upload exported, georeferenced .tif from #3 to the correct “…/frames/georef/” directory tree location. Only the .tif needs to be uploaded; ignore the .ovr and all other associated files which are created in the process.

    Note: since mulitple copies of a frame can exist as varying DPIs, the filename can include an "_<dpi #>dpi" suffix after the frame # but before the file format. Example: "<mm>-<dd>-<yy>_<roll>-<frame #>_<dpi #>dpi.tif"

Lake Gallery Mosaics

SUPER IMPORTANT: uploaded mosaics must be split with each split tile raster named "mosaic<tile #>.tif" or the process WILL NOT WORK
  1. Pull all the individual georeferenced frames into mosaic’n software (probably ERDAS).

  2. Perform the mosaic’n functionality and export IMG.

  3. Open the IMG export in ArcMap and perform Individual Frames #3 GeoTiff export with the same rules.

  4. Open/Add the GeoTiff to the ArcMap session. You can remove the IMG also.

  5. In ArcMap alongside the GeoTiff, bring in the ‘USGS_Quad16th’ shapefile from the ‘USGS Quadrangle Indicies’ download from tnris.org.

    * Download here: https://tnris-datadownload.s3.amazonaws.com/d/usgs-indices/state/tx/usgs-indices_tx.zip
  6. Select the quad 16th polygons which overlap the extent of the mosaic. Right click, and add to map as new Selection Layer.

  7. Open the SplitRaster tool. Set the following inputs:

    * Output Base: mosaic
    * Output Folder: <any empty directory where all the new cut/split up rasters can be dumped>
    * Split Method: POLYGON_FEATURES
    * Split Polygon Layer: <choose the selection layer created in step #6>
    * Format: TIFF
    * Resample: Nearest
    * Under Other settings dropdown section at the bottom, set NoDataValue: 256
  8. The tool may take some time. The output folder will be filled with GeoTiffs for each USGS Quad 16th polygon. Each will be incrementally named: “mosaic<tile #>.tif” with an example being “mosaic12.tif” starting with number 0

  9. When finished, upload all the exported georeferenced mosaic<tile #>.tif files from #7 & #8 to ‘the correct “…/mosaic/georef” directory tree location. Only the .tif needs to be uploaded; ignore the .ovr and all other associated files which are created in the process.

    Note: Mosaics can get really large. They must be split in this method to properly run

Indexes

SUPER IMPORTANT: uploaded indexes must be split with each split tile raster named “<originator>_<yyyy>_<sheet #>_<tile #>.tif” or the process WILL NOT WORK

  1. Perform steps Individual Frames #1-3 as if the index is an individual frame.

  2. Upload original, non-georeferenced scan to the correct “…/index/scanned/” directory tree location. This original should be named “<originator>_<yyyy>_<sheet #>.tif” since (as an original) it is not chopped up for serving.

  3. In ArcMap alongside the GeoTiff, bring in the ‘USGS_Quad16th’ shapefile from the ‘USGS Quadrangle Indicies’ download from tnris.org.

    * Download here: https://tnris-datadownload.s3.amazonaws.com/d/usgs-indices/state/tx/usgs-indices_tx.zip
  4. Select the quad 16th polygons which overlap the extent of the index. Right click, and add to map as new Selection Layer.

  5. Open the SplitRaster tool. Set the following inputs:

    * Output Base: <originator>_<yyyy>_<sheet #>_ (Example: "USDA_1975_1_" without the quotes)
    * Output Folder: <any empty directory where all the new cut/split up rasters can be dumped>
    * Split Method: POLYGON_FEATURES
    * Split Polygon Layer: <choose the selection layer created in step #4>
    * Format: TIFF
    * Resample: Nearest
    * Under Other settings dropdown section at the bottom, set NoDataValue: 256
  6. The tool may take some time. The output folder will be filled with GeoTiffs for each USGS Quad 16th polygon. Each will be incrementally named: “<originator>_<yyyy>_<sheet #>_<tile #>.tif” with an example being “USDA_1975_1_12.tif” starting with number 0

  7. When finished, upload all the exported georeferenced <originator>_<yyyy>_<sheet #>_<tile #>.tif files from #5 & #6 to ‘the correct “…/index/georef” directory tree location. Only the .tif needs to be uploaded; ignore the .ovr and all other associated files which are created in the process.

    Note: Indexes can get really large. They must be split in this method to properly run
    
    Note 2: since mulitple copies of an index can exist as varying DPIs, the filename can include an "_<dpi #>dpi_" after the sheet # but before the tile number. Example: "<originator>_<yyyy>_<sheet #>_<dpi #>dpi_<tile #>.tif"

Output Mapfile

Process output will be a WMS Service for each collection. The link will be:

http://mapserver.tnris.org/wms/?map=/mapfiles/<collection mapfile name>.map

Collection Mapfile Naming Convention (all lowercase with natural spaces supplemented with underscores):

<county name>_<agency name>_<yyyy>_<type>.map

– or –

<multi-county agency>_<mission code>_<type>.map

where type is ‘frames’, ‘index’, or ‘mosaic’

To list all mapfiles (available services):

https://tnris.org/mapserver/