Skip to content

ssloxford/auto-phy-fingerprint

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

48 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Automatic PHY-layer Fingerprinting

This project implements an end-to-end system for automatic fingerprinting of transmitters at the physical layer, incorporating capture, demodulation, model training, fingerprinting, fingerprint tracking and visualisation.

The project underpins work to study the usefulness of machine-learning techniques in device fingerprinting. Fingerprint derivation is typically a costly, manual task and can vary noticeably between technologies and scenarios. There is also an inherent tension between deriving fingerprinting methods which are robust and generalisable vs. taking full advantage of specifics in a given scenario to enhance performance. The goal of this work is to reduce the need for human analysis in deriving fingerprints.

The system is built on a modular framework to permit simple variation at each stage.

At present the framework is validated with two concrete examples, developed for this project:

  • 1090 MHz ADS-B traffic, received over-the-air
  • RS-485 Serial traffic, received via cabling

Architecture

The system comprises several components:

Component Description
Signal Capture Retrieval of a raw signal. Compatible with either software radio frameworks (e.g., GNURadio) or other digital capture (e.g., storage oscilloscopes).
Demodulation Interface to 3rd party demodulation code for message validation and data extraction.
Identifier Masking A pre-processing stage to remove in-message identifiers, which lead to trivial solutions
Fingerprint Extraction and Comparison A Siamese network model used to derive comparisons between received messages across observed transmitters.
Message Verification Long-term tracking of message fingerprint comparisons and identity verification

In addition to the main pipeline, some additional components are implemented to help study the data:

Component Description
Storage Storage components receive bursts and write them to files for offline processing (e.g. model training). At present there are two storage components: one writing bursts to an HDF5 file, one writing decoded messages to an SQLite3 database.
Visualisation Visualisations to show live performance. A message verification visualisation is implemented for the ADS-B case, in which messages and their verification status are displayed, alongside a map of their claimed positions.
Supporting (Weather) A supporting component retrieves and stores data on local weather conditions.

Data transfer between stages is principally through ZMQ message queues in a PUB/SUB pattern. Each part of the pipeline outputs received bursts, along with appropriate metadata, and forwards them to all subscribers. Alternatively, data can be written to files at each stage, for offline processing. However the streaming model is preferred, both for architectural convenience when splitting across containers/hosts and to support long-running, live uses in which stopping and outputting a file is cumbersome. As such, the file-based method is considered deprecated.

Installation

Dependencies

On host:

Included within containers:

Process

  1. Clone and build base GNURadio images

    1. git clone https://github.com/ssloxford/docker-gnuradio
    2. cd docker-gnuradio
    3. ./build_all.sh
  2. git clone --recursive https://github.com/ssloxford/auto-phy-fingerprint

  3. Create directory auto-phy-fingerprint-mountdir

  4. If using GPU resources, add a suitable deploy.resources section to docker-compose.yml

  5. docker-compose up -d

  6. Check for files appearing in auto-phy-fingerprint-mountdir and accessibility of the visualisation service on port 5006

Case Studies

Two case studies exist at present: one for ADS-B and one for RS-485. Please see each link for details.

Acknowledgements

This project is supported by InnovateUK under the HICLASS project.

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages