Skip to content
This repository has been archived by the owner on Jul 1, 2024. It is now read-only.

Will diffq make model faster? #13

Open
tz301 opened this issue Jun 9, 2023 · 0 comments
Open

Will diffq make model faster? #13

tz301 opened this issue Jun 9, 2023 · 0 comments
Labels
question Further information is requested

Comments

@tz301
Copy link

tz301 commented Jun 9, 2023

❓ Questions

I try diffq, size of model file get smaller. But during inference, the gpu memory cost and inference speed keep almost the same. Is this usual?
@tz301 tz301 added the question Further information is requested label Jun 9, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@tz301