Popular Neural Network Architectures

Two stage funnel architecture
- candidate generation + ranking
Two-tower architecture
Wide and deep learning
Deep cross network
Multi-task learning
Transformers
Encoder, Decoder, Encoder-decoder
Knowledge Distillation (student-teacher network)
Contrastive Learning
NLP
- BERT, T5, GPT
Computer Vision
- Object detectors (single stage, two-stage)
- Vision Transformer