Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

a streaming pipeline #44

Open
boji123 opened this issue Jun 12, 2023 · 6 comments
Open

a streaming pipeline #44

boji123 opened this issue Jun 12, 2023 · 6 comments

Comments

@boji123
Copy link

boji123 commented Jun 12, 2023 •
edited
Loading

Hello guys, I wrote a streaming inference pipeline in Python for this project, including torch jit script, int8 dynamic quantization, and streaming interface for the audio encoder and decoder (style vector is pre-generated and worked as an embedding input while inference).
If interested, please comment, and I will make a MR.
@henrycjh
Copy link

looking forward to it！

1 similar comment
@Jeremy8080
Copy link

looking forward to it！

@pitbullcty
Copy link

Reallly looking forward to it!

@cacard
Copy link

cacard commented Mar 15, 2024

yes, please make a MR.

@cacard
Copy link

cacard commented Mar 15, 2024

I also have a question, this means the framework support realtime generate?

@SeuGuoTong
Copy link

looking forward to it, too！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
6 participants
@cacard @boji123 @Jeremy8080 @pitbullcty @henrycjh @SeuGuoTong