video-dataset

Quick Start

Download HD-VILA-100M Dataset

• https://github.com/microsoft/XPretrain/tree/main/hd-vila-100m

Extract URLs and Save as CSV

cd preprocess
python extract_url.py

Get Videos and Metadata with video2dataset

video2dataset \\
--url_list="results/all_urls.csv"  \\
--url_col="url" \\
--output_folder="dataset"

• https://github.com/iejMac/video2dataset

Change Videos to 1fps

cd preprocess
./change_fps.sh
./copy_json.sh

Split Videos & Subtitles and Save them as StreamingDataset

Option1

cd preprocess
python video_to_mds.py

Option2

cd preprocess
python video_to_mds_pre_split.py