Skip to content
This repository has been archived by the owner on Jun 24, 2024. It is now read-only.

Support new quantization formats for quantizer #209

Closed
philpax opened this issue May 10, 2023 · 0 comments
Closed

Support new quantization formats for quantizer #209

philpax opened this issue May 10, 2023 · 0 comments
Labels
issue:enhancement New feature or request
Milestone
0.2

Comments

@philpax
Copy link
Collaborator

philpax commented May 10, 2023

At present, the quantizer only supports q4_0 and q4_1 output. We should support all the formats that GGML supports for quantization at the time this issue is written.

(Note: the formats can change or be removed, so always check what the currently supported formats are)
@philpax philpax added the issue:enhancement New feature or request label May 10, 2023
@philpax philpax added this to the 0.2 milestone May 18, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
issue:enhancement New feature or request
Projects
None yet
Milestone
0.2
Development

No branches or pull requests
1 participant
@philpax