Research

Robstness-verfication-for-Transformer, 关于Transformer鲁棒性研究.

Research Keyword

• Transformer Robustness
• Vision Transformer
• Data Augmentation
• Adversarial Attack
• Inductvie bias

Description

• In term of Data, verifiction transformer's robustness, where clean data set and adversarial example(white box and black box).

Experiment

Verification Data size and Data Augmenation perfomance.

• Experiment 1 : Data size affect Transformer robustness?
• Experiment 2 : Data size fixed, Data Augmentation can raise robustness?

Verification Data Augmentation each other

• Experiment 3 : Data Augmentation compare with each other
• Experiment 4 : Image transform Data Augmentation compare with Adversarial Example Training method

Ensemble Adversarial Example and Image Transform Augmentation

• Experiment 5 : Ensemble Augmentation vs Adversarial Example Training

Conclusion

Reference

• Adversarial Attack
• Vision Transformer
• Data Augmentation