Skip to content

Latest commit

 

History

History
11 lines (7 loc) · 208 Bytes

README.md

File metadata and controls

11 lines (7 loc) · 208 Bytes

Microllm

just the bare basics to run inference on local hardware.

currently working:

  • read_gguf.py

Refactor made it faster and more compact

TODO: fix token generation to generate sensible tokens...