By uploading the picture, the mouth shape is generated according to the submitted audio file and the video is synthesized to make the picture speak.
This is the open-source version of AI Talking Photo from 302.AI. You can log in directly to 302.AI to use the online version with zero code and zero configuration. Alternatively, you can modify this project according to your needs, input 302.AI's API KEY, and deploy it yourself.
You can input a text content that you want the photo to speak on the generation page, and you can choose a speech model and different speech packages to convert the text into an audio file; You can also choose to upload audio files directly on the upload page.
You can generate a portrait photo by entering a description of the photo on the generation page, or upload a clear frontal portrait directly on the upload page.
After clicking on the synthesized audio, it will start generating and finally obtain a video of a photo opening and "speaking" the audio.
Supports uploading, generating, and recording audio and photos as input
- Supports aspect ratio adjustment
- Supports cropping
Save your creation history so that nothing is forgotten, and you can download it anytime and anywhere.
Share with one click to major social platforms.
Support the dark mode to protect your eyes.
- δΈε½θͺγ€γ³γΏγΌγγ§γΌγΉ
- θ±θͺγ€γ³γΏγΌγγ§γΌγΉ
- ζ₯ζ¬θͺγ€γ³γΏγΌγγ§γΌγΉ
- Add instant photo capture
- Add audio recording
- Next.js 14
- Tailwind CSS
- Shadcn UI
- Clone the project:
git clone https://github.com/302ai/302_lipsync - Install dependencies:
pnpm install - Configure environment variables: Refer to .env.example
- Run the project:
pnpm run dev - Build and deploy:
docker build -t lipsync . && docker run -p 3000:3000 lipsync
302.AI is an enterprise-oriented AI application platform that offers pay-as-you-go services, ready-to-use solutions, and an open-source ecosystem.β¨
- π§ Comprehensive AI capabilities: Incorporates the latest in language, image, audio, and video models from leading AI brands.
- π Advanced application development: We build genuine AI products, not just simple chatbots.
- π° No monthly fees: All features are pay-per-use, fully accessible, ensuring low entry barriers with high potential.
- π Powerful admin dashboard: Designed for teams and SMEs - managed by one, used by many.
- π API access for all AI features: All tools are open-source and customizable (in progress).
- π‘ Powerful development team: Launching 2-3 new applications weekly with daily product updates. Interested developers are welcome to contact us.