Fix skip_dir logic when reverse traversing folder structure

Fix skip_dir logic when reverse traversing folder structure #790