Skip to content

deeppavlov/deep-nlp-seminars

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

64 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

deep-nlp-seminars

ATTENTION: Please, do not share your task solutions on GitHub or anywhere else!

Also, please do not add your name to your homework, since we try to keep review process anonymous.

Seminars plan:

  1. Intro to NLP, intro to word embeddings
  2. Word embeddings: Word2Vec, GloVe, fastText
  3. Language modeling, softmax crossentropy loss, one layer neural networks
  4. Neural networks and backpropagation, optimization
  5. Practical tips, gradient checking, overfitting, regularization, activation functions
  6. Reccurent neural networks
  7. GRU and LSTM, intro to machine translation
  8. CNN for text classification
  9. Machine translation, attention mechanism
  10. Dynamic memory networks, Deep Contextualized Word Representations, future of NLP