Files to watch at the moment are compute_uncertainty_measures and speculative decoding related code.
-
Notifications
You must be signed in to change notification settings - Fork 0
This repo accompanies a study of uncertainty benchmarking on state of the art llm decoding methods and novel fast inference techniques. We start with multi token prediction, speculative decoding as well as CoT decoding and evaluate llm uncertainty with these added methods compared to the baseline model using semantic entropy as our metric..
userdarius/llm-reasoning-uncertainty
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This repo accompanies a study of uncertainty benchmarking on state of the art llm decoding methods and novel fast inference techniques. We start with multi token prediction, speculative decoding as well as CoT decoding and evaluate llm uncertainty with these added methods compared to the baseline model using semantic entropy as our metric..
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published