🌏 Note: This branch contains the Australia-specific implementation of DEA Coastlines. For a more flexible implementation adapted to globally available USGS Collection 2 Level 2 Landsat data, we recommend adapting the Digital Earth Africa Coastlines implementation instead.
License: The code in this repository is licensed under the Apache License, Version 2.0. Digital Earth Australia data is licensed under the Creative Commons by Attribution 4.0 license.
Contact: For assistance with any of the Python code or Jupyter Notebooks in this repository, please post a Github issue. For questions or more information about this workflow, email [email protected].
To cite:
Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734
Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712
Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., Sixsmith, J. (2019). Sub-pixel waterline extraction: characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11 (24):2984. Available: https://doi.org/10.3390/rs11242984
Digital Earth Australia Coastlines is a continental dataset that includes annual shorelines and rates of coastal change along the entire Australian coastline from 1988 to the present.
The product combines satellite data from Geoscience Australia's Digital Earth Australia program with tidal modelling to map the typical location of the coastline at mean sea level for each year. The product enables trends of coastal erosion and growth to be examined annually at both a local and continental scale, and for patterns of coastal change to be mapped historically and updated regularly as data continues to be acquired. This allows current rates of coastal change to be compared with that observed in previous years or decades.
The ability to map shoreline positions for each year provides valuable insights into whether changes to our coastline are the result of particular events or actions, or a process of more gradual change over time. This information can enable scientists, managers and policy makers to assess impacts from the range of drivers impacting our coastlines and potentially assist planning and forecasting for future scenarios.
- Monitoring and mapping rates of coastal erosion along the Australian coastline
- Prioritise and evaluate the impacts of local and regional coastal management based on historical coastline change
- Modelling how coastlines respond to drivers of change, including extreme weather events, sea level rise or human development
- Supporting geomorphological studies of how and why coastlines have changed across time
- Digital Earth Australia Coastlines - Applications
The code in this repository is built on the Digital Earth Australia implementation of the Open Data Cube software for accessing, managing, and analyzing large quantities of Earth observation (EO) data. The code currently runs on the Digital Earth Australia Sandbox infrastructure.
Clone the dea-coastlines repository and checkout the develop branch:
git clone https://github.com/GeoscienceAustralia/dea-coastlines.git
git checkout --track origin/develop
DEA Coastlines uses the FES2014 tidal model to account for the influence of tide on shoreline positions. To install this tidal model, follow the Setting up tidal models for DEA Coastlines guide on the Wiki.
Code in this repository is included in the coastlines Python package which contains three main modules. These are intended to be run in the following order:
-
coastlines.raster: This module conducts raster generation for DEA Coastlines. This analysis is processed on individual study area tiles to minimise peak memory usage.- Load stack of all available Landsat 5, 7 and 8 satellite imagery for a location using ODC Virtual Products
- Convert each satellite image into a remote sensing water index (e.g. MNDWI)
- For each satellite image, model ocean tides into a tidal modelling grid based on exact time of image acquisition
- Interpolate tide heights into spatial extent of image stack
- Mask out high and low tide pixels by removing all observations acquired outside of 50 percent of the observed tidal range centered over mean sea level
- Combine tidally-masked data into annual median composites representing the most representative position of the shoreline at approximately mean sea level each year
-
coastlines.vector: This module conducts vector subpixel coastline extraction and rates of change statistics calculation. This analysis is processed on individual study area tiles to minimise peak memory usage.- Apply morphological extraction algorithms to mask annual median composite rasters to a valid coastal region
- Extract shoreline vectors using subpixel waterline extraction (Bishop-Taylor et al. 2019b)
- Compute rates of coastal change at every 30 m along the coastline using linear regression
-
coastlines.continental: This module combines tiled layers into seamless continental-scale vector files:- Combines multiple output shoreline and rates of change statistics point vectors into single continental datasets
- Aggregates this data to produce moving window coastal change hotspot datasets that summarise coastal change at regional and continental scale.
An interactive walk-through of each step of the tiled raster and vector DEA Coastlines workflow and the continental layer generation is provided in the following Jupyter Notebooks. These notebooks can be run on the DEA Sandbox to assist in prototyping or troubleshooting:
- DEA Coastlines raster generation
- DEA Coastlines vector generation
- DEA Coastlines continental hotspots
These three modules have a command-line interface that can be used to automate each stage of the analysis. An example of using these tools is provided in the following Jupyter Notebook:
For help using these command line tools, run:
python -m coastlines.raster --help
python -m coastlines.vector --help
python -m coastlines.continental --help
Files generated by DEA Coastlines are exported to the data directory.
Temporary raster and vector outputs produced by coastlines.raster and coastlines.vector for each study area grid cell are exported to:
data/interim/raster/{unique_analysis_name}/{unique_analysis_name}_{study_area_name}
data/interim/vector/{unique_analysis_name}/{unique_analysis_name}_{study_area_name}
Once all study area grid cells have been processed, these are combined into a continental-scale output GeoPackage vector file and zipped ESRI Shapefiles using coastlines.continental. These final outputs are exported to:
data/processed/{unique_analysis_name}/coastlines_{continental_version}.gpkg
data/processed/{unique_analysis_name}/coastlines_{continental_version}.shp.zip
To download DEA Coastlines data for the entire Australian coastline, visit the "Access" tab of the Geoscience Australia DEA Coastlines product description and follow the instructions under "Access notes". Data is available in two formats:
- GeoPackage (recommended): suitable for QGIS; includes built-in symbology for easier interpretation
- ESRI Shapefiles: suitable for ArcMap and QGIS
To explore DEA Coastlines on an interactive map, visit the Digital Earth Australia Maps platform.
DEA Coastlines data can be loaded directly in a Python script or Jupyter Notebook using the DEA Coastlines Web Feature Service (WFS) and geopandas:
import geopandas as gpd
# Specify bounding box
ymax, xmin = -33.65, 115.28
ymin, xmax = -33.66, 115.30
# Set up WFS requests for annual shorelines & rates of change points
deacl_annualshorelines_wfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \
f'service=WFS&version=1.1.0&request=GetFeature' \
f'&typeName=dea:shorelines_annual&maxFeatures=1000' \
f'&bbox={ymin},{xmin},{ymax},{xmax},' \
f'urn:ogc:def:crs:EPSG:4326'
deacl_ratesofchange_wfs = f'https://geoserver.dea.ga.gov.au/geoserver/wfs?' \
f'service=WFS&version=1.1.0&request=GetFeature' \
f'&typeName=dea:rates_of_change&maxFeatures=1000' \
f'&bbox={ymin},{xmin},{ymax},{xmax},' \
f'urn:ogc:def:crs:EPSG:4326'
# Load DEA Coastlines data from WFS using geopandas
deacl_annualshorelines_gdf = gpd.read_file(deacl_annualshorelines_wfs)
deacl_ratesofchange_gdf = gpd.read_file(deacl_ratesofchange_wfs)
# Ensure CRSs are set correctly
deacl_annualshorelines_gdf.crs = 'EPSG:3577'
deacl_ratesofchange_gdf.crs = 'EPSG:3577'
# Optional: Keep only rates of change points with "good" certainty
# (i.e. no poor quality flags)
deacl_ratesofchange_gdf = deacl_ratesofchange_gdf.query("certainty == 'good'")
DEA Coastlines data can be loaded directly into R using the DEA Coastlines Web Feature Service (WFS) and sf:
library(magrittr)
library(glue)
library(sf)
# Specify bounding box
xmin = 115.28
xmax = 115.30
ymin = -33.66
ymax = -33.65
# Read in DEA Coastlines annual shoreline data, using `glue` to insert our bounding
# box into the string, and `sf` to load the spatial data from the Web Feature Service
# and set the Coordinate Reference System to Australian Albers (EPSG:3577)
deacl_annualshorelines = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:shorelines_annual&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>%
glue::glue() %>%
sf::read_sf() %>%
sf::st_set_crs(3577)
# Read in DEA Coastlines rates of change points
deacl_ratesofchange = "https://geoserver.dea.ga.gov.au/geoserver/wfs?service=WFS&version=1.1.0&request=GetFeature&typeName=dea:rates_of_change&maxFeatures=1000&bbox={ymin},{xmin},{ymax},{xmax},urn:ogc:def:crs:EPSG:4326" %>%
glue::glue() %>%
sf::read_sf() %>%
sf::st_set_crs(3577)
An Introduction to DEA Coastlines Jupyter notebook providing additional useful tools for loading and analysing DEA Coastlines data can be found on the DEA Notebooks repository. This notebook is available on the interactive DEA Sandbox learning and analysis environment for easy access via a web browser.
Tidal modelling is provided by the FES2014 global tidal model, implemented using the pyTMD Python package. FES2014 was produced by NOVELTIS, LEGOS, CLS Space Oceanography Division and CNES. It is distributed by AVISO, with support from CNES (http://www.aviso.altimetry.fr/).
Bishop-Taylor, R., Nanson, R., Sagar, S., Lymburner, L. (2021). Mapping Australia's dynamic coastline at mean sea level using three decades of Landsat imagery. Remote Sensing of Environment, 267, 112734. Available: https://doi.org/10.1016/j.rse.2021.112734
Bishop-Taylor, R., Sagar, S., Lymburner, L., & Beaman, R. J. (2019a). Between the tides: Modelling the elevation of Australia's exposed intertidal zone at continental scale. Estuarine, Coastal and Shelf Science, 223, 115-128. Available: https://doi.org/10.1016/j.ecss.2019.03.006
Bishop-Taylor, R., Sagar, S., Lymburner, L., Alam, I., & Sixsmith, J. (2019b). Sub-pixel waterline extraction: Characterising accuracy and sensitivity to indices and spectra. Remote Sensing, 11(24), 2984. Available: https://doi.org/10.3390/rs11242984
Nanson, R., Bishop-Taylor, R., Sagar, S., Lymburner, L., (2022). Geomorphic insights into Australia's coastal change using a national dataset derived from the multi-decadal Landsat archive. Estuarine, Coastal and Shelf Science, 265, p.107712. Available: https://doi.org/10.1016/j.ecss.2021.107712