This repository is the official implementation of:
Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson's Disease Motor Severity
Mandy Lu, Kathleen Poston, Adolf Pfefferbaum, Edith V. Sullivan, Li Fei-Fei, Kilian M. Pohl, Juan Carlos Niebles, Ehsan Adeli
MICCAI 2020
3D input poses of four subjects with increasing PD motor severity (top) and saliency of classifier (bottom).
The oral presentation of this work at MICCAI can be viewed here.
To install requirements, run:
pip install -r requirements.txt
with Python 3 (3.7 used).
The Stanford Medicine Gait Dataset is not publically available, but the CASIA Gait Database is available upon request. Any similar video dataset with human movement can be used as input.
To obtain the input poses for the classifier, clone and follow the instructions in the VIBE repo. The script extract_joints <path_to_data> <output_path>
takes a folder of videos, runs VIBE on them, and produces outputs joints in the correct format for the classifier. The output files we use are the vibe_output.pkl
files generated by VIBE. An example joint file generated by VIBE from the CASIA dataset is in data/sample
with an image from the source video. The initial paper detailed a longer data preprocessing sequence which has been condensed in VIBE, so the simpler version is provided.
data_preprocessing.ipynb
provides step-by-step instructions for preprocessing joint data.
To train the model(s) in the paper, run this command:
python train.py --model_dir <params_and_output_path> --seed <random_seed>
or use
python train.py
for the default mode. The model_dir
should contain a params.json file formatted as in jobs/default/params.json
.
If you use this code in your research, please cite our paper.
@inproceedings{lu2020vision,
title={Vision-based Estimation of MDS-UPDRS Gait Scores for Assessing Parkinson’s Disease Motor Severity},
author={Lu, Mandy and Poston, Kathleen and Pfefferbaum, Adolf and Sullivan, Edith V and Fei-Fei, Li and Pohl, Kilian M and Niebles, Juan Carlos and Adeli, Ehsan},
booktitle={International Conference on Medical Image Computing and Computer-Assisted Intervention},
pages={637--647},
year={2020},
organization={Springer}
}
These resources were used or cited within the code:
Mandy Lu, [email protected]