Skip to content

just another bench scripts for llm inference bench among different frameworks & GPUs

Notifications You must be signed in to change notification settings

AlexHe99/auto_llm_bench

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 

Repository files navigation

auto_llm_bench

just another bench scripts for llm inference bench among different frameworks & GPUs

About

just another bench scripts for llm inference bench among different frameworks & GPUs

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Shell 78.5%
  • Python 21.5%