Skip to content

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

License

Notifications You must be signed in to change notification settings

eclouder/MoE-LLM

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

MoE-LLM

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

About

Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages