Skip to content

Latest commit

 

History

History
43 lines (32 loc) · 2.7 KB

README.md

File metadata and controls

43 lines (32 loc) · 2.7 KB
Raw

GenerativeFaceCompletion

Matcaffe implementation of our CVPR17 paper on face completion.

In each panel from left to right: original face, masked input, completion result.

Setup

  • We use the caffe-for-cudnn-v2.5.48. Please refer Caffe for more installation details.
  • Basically, you need to first modify the MATLAB_DIR in Makefile.config and then run the following commands for a successful compilation:
make all -j4
make matcaffe

Training

  • Follow the DCGAN to prepare the data (CelebA). The only differece is that the face we cropped is of size 128x128. Please modify Line 10 in their crop_celebA.lua file. We use the standard train&test split of the CelebA dataset.

  • Modify the training data path in ./matlab/FaceCompletion_training/GFC_caffeinit.m file.

  • Download our face parsing model Model_parsing and put it under ./matlab/FaceCompletion_training/model/ folder.

  • We provide an initial model that is only trained with the reconstruction loss, as a good start point for the subsequent GAN training. Please download it and put it under ./matlab/FaceCompletion_training/model/ folder.

  • Run ./matlab/FaceCompletion_training/demo_GFC_training.m for training.

Testing

  • Download our face completion model Model_G and put it under ./matlab/FaceCompletion_testing/model/ folder.
  • Run ./matlab/FaceCompletion_testing/demo_face128.m for completion. TestImages are from the CelebA test dataset.

Citation

@inproceedings{GFC-CVPR-2017,
    author = {Li, Yijun and Liu, Sifei and Yang, Jimei and Yang, Ming-Hsuan},
    title = {Generative Face Completion},
    booktitle = {IEEE Conference on Computer Vision and Pattern Recognition},
    year = {2017}
}

Acknowledgement

  • Gratitude goes to Sifei Liu for the great help on code.
  • The upsample layer (unpooling according to the pooling mask) is borrowed from the SegNet.