Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONNX Feature already worked. This is a result run on GPU with onnxruntime. I'll preview and plan to new feature updated is TensorRT and C++ Inference code in the next week 🔥🔥🔥 #142

Open
aihacker111 opened this issue Jul 14, 2024 · 12 comments
Labels

Comments

@aihacker111
Copy link

aihacker111 commented Jul 14, 2024

So during the My Journey to optimize this model run by ONNX GPU and CPU , we got the result like this:

Screenshot 2024-07-14 at 15 05 00
  • This demo is run on P100 16gb in Kaggle Kernel

  • This optimiztion will reduce the time speed for run all process of Live-Portrait to 1s/1 frame with 354 frame in total 4 minute 30s

  • Also support running on Google Colab

Please following my source for run demo: https://github.com/aihacker111/Efficient-Live-Portrait
This source already support for run on CPU and Apple silicon , and CUDA

TensorRT models

I'm already converted to TensorRT and in progress building C++ code for inference and demo. Wait the great TensorRT in the next week
🔥🔥🔥🔥🔥
Have fun with result:

368220873_826368889022136_4472311944594836999_n--368220873_826368889022136_4472311944594836999_n_concat.mp4
368220873_826368889022136_4472311944594836999_n--368220873_826368889022136_4472311944594836999_n.mp4
@FurkanGozukara
Copy link

Very nice work congrats

@aihacker111 aihacker111 changed the title ONNX Feature already worked. This is a result run on GPU with onnxruntime. Preview and plan to Updated TensorRT and C++ Inference code in the next week 🔥🔥🔥 ONNX Feature already worked. This is a result run on GPU with onnxruntime. I'll preview and plan to new feature updated is TensorRT and C++ Inference code in the next week 🔥🔥🔥 Jul 14, 2024
@zzzweakman
Copy link
Collaborator

zzzweakman commented Jul 14, 2024

Thank you very much for your efforts in making LivePortrait a better project! We will follow up on your thread next week. @aihacker111

@noname0121
Copy link

rụng trứng mất thôi ✌️

@PointerSoftware
Copy link

@aihacker111 Where can I find the Colab notebook? I want to run this on Google Colab.

@aihacker111
Copy link
Author

@PointerSoftware I'll create notebook for that in this afternoon

@PointerSoftware
Copy link

@PointerSoftware I'll create notebook for that in this afternoon

Eagerly waiting for that!, Please remember to create a notebook that supports Gradio, so anyone can use the project with a graphical interface.

@cleardusk cleardusk added the ONNX label Jul 16, 2024
@tutuaio
Copy link

tutuaio commented Jul 17, 2024

期待

@ChunChenLin
Copy link

ChunChenLin commented Aug 2, 2024

@aihacker111 Thanks for your great work!! I would like to know where can I find the C++ inference code. :))

@aihacker111
Copy link
Author

@ChunChenLin I'm currently still not implement C++ code , maybe in the next week :)

@ChunChenLin
Copy link

@ChunChenLin I'm currently still not implement C++ code , maybe in the next week :)

@aihacker111 Sure, thanks! Looking forward to it. Thanks again for your great work. :))

@ChunChenLin
Copy link

@aihacker111 Hey, how's everything :) Just wanna know is the C++ inference code available or coming soon? :))

@hongminpark
Copy link

@aihacker111 Hi! Thanks for your hard work.
I also would like to know if there's any possibility of C++ inference code :)
looking forward it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

9 participants