Skip to content

We implemented quantization methods for visual transformers and analyzed tradeoffs between model performance and accuracy. (Visage Technologies internship)

License

Notifications You must be signed in to change notification settings

corazza/vision-transformer-quantization

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Computationally Efficient Visual Transformers (Visage Technologies internship)

We implemented quantization methods for visual transformers and analyzed tradeoffs between model performance and accuracy (Visage Technologies internship)

To reproduce results, consult the scripts/ directory. The general workflow is:

  1. Finetune the models (start_finetune.sh small finetune-small etc.)
  2. Run the experiments (start_experiments.sh)

About

We implemented quantization methods for visual transformers and analyzed tradeoffs between model performance and accuracy. (Visage Technologies internship)

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.5%
  • Other 0.5%