- First, unsupervised approach which takes an input sentence and predicts itself in a contrastive objective with only standard dropout used as noise
- Supervised approach using NLI datasets, entailment pairs are ”positive” examples while contradiction pairs are “hard negatives”.
- State of the art on STS tasks
