0.8.1

make sure <eos> is appended

0.8.0

add layerscale, from the recent training deeper vision transformers p…

0.7.3

0.7.3

0.7.2

0.7.2

0.7.1

0.7.1

0.7.0

back to layer norm

0.6.0

stick with rmsnorm instead of scalenorm

0.5.1

add asserts to generate_image fn

0.5.0

use scalenorm in light of new results shared by a google researcher

0.3.5

yet another attempt to fix sparse conv attention