Skip to content

Latest commit

 

History

History
68 lines (49 loc) · 3.35 KB

README.md

File metadata and controls

68 lines (49 loc) · 3.35 KB

Vid2Vid demo with a camera

Video

This example, based on this MPJEG server, runs video-to-video with a live webcam feed or screen capture on a web browser.

Tested with VSCode with remote GPU server. The Live Server extension would help to open the local Chorme page.

Usage

install Node.js 18+

curl -o- https://raw.githubusercontent.com/nvm-sh/nvm/v0.39.1/install.sh | bash
# Restart terminal
nvm install 18

Download lora weights for better stylization

pip install gdown
pip install --upgrade gdown
cd demo_w_camera
gdown https://drive.google.com/drive/folders/1D7g-dnCQnjjogTPX-B3fttgdrp9nKeKw -O lora_weights --folder
Trigger words LORA weights Source
'pixelart' , 'pixel art' , 'Pixel art' , 'PixArFK' Google drive Civitai
'lowpoly', 'low poly', 'Low poly' Google drive Civitai
'Claymation', 'claymation' Google drive Civitai
'crayons', 'Crayons', 'crayons doodle', 'Crayons doodle' Google drive Civitai
'sketch', 'Sketch', 'pencil drawing', 'Pencil drawing' Google drive Civitai
'oil painting', 'Oil painting' Google drive Civitai

Install

You need Node.js 18+ and Python 3.10 to run this example. Please make sure you've installed all dependencies according to the installation instructions.

cd frontend
npm i
npm run build
cd ..
pip install -r requirements.txt
python main.py

or

chmod +x start.sh
./start.sh

then open http://0.0.0.0:7860 in your browser. (*If http://0.0.0.0:7860 does not work well, try http://localhost:7860)

Common Bugs

Camera Not Enabled Issue

  • Error Message: Cannot read properties of undefined (reading 'enumerateDevices').
  • Related GitHub Issue: No webcam detected

Potential Workaround:
This issue occurs when the camera is not allowed for the web browser. Add http://localhost:7860,http://0.0.0.0:7860 to chorme setting.