CS492 ML for NLP Fall 2019

Teaching Staff

Important Notes about Registering for this Course

Course Description

This course will cover important problems and concepts in natural language processing and the machine learning models used in those problems.



  1. Jacob Eisenstein, Natural Language Processing
  2. Recent papers from ACL, EMNLP, NAACL, TACL, etc.
  3. (Optional Reference) Jurafsky an Martin, Speech and Language Processing: An Introduction to Natural Language Processing, Computational Linguistics, and Speech Recognition

Course Goals

By the end of the course, you will be able to

  1. Understand important concepts in NLP
  2. Read current research papers in NLP
  3. Implement some of the basic ML models for NLP
  4. Conduct replication studies based on a recent NLP+ML paper
  5. Communicate in written and spoken English about NLP+ML research

Schedule (Subject to Change)

Course Dates: Tuesday, Sept 3 – Thursday, Dec 19, 2019

Class Times: Tuesday and Thursday at 13:00 - 14:15

Week Dates Topics Activity
1 Tue/Thurs Sept 3/5 Introduction / Math Review Discussions
2 Tue/Thurs Sept 10/12 Word Vectors & Distributed Semantics / No Class on Sept 12 (Holiday) Discussions
3 Tue/Thurs Sept 17/19 Word Vectors word2vec (Tues/Thurs)
4 Tue/Thurs Sept 24/26 Text Classification BOW & Logistic Regression (Thurs)
5 Tue/Thurs Oct 1/3 Text Classification / No Class on Oct 3 (Holiday)  
6 Tue/Thurs Oct 8/10 Text Classification / Project Proposal Presentations Naive Bayes (Tues)
7 Tue/Thurs Oct 15/17 Language Models N-grams (Thurs)
8 Tue/Thurs Oct 22/24 Midterm Exam  
9 Tue/Thurs Oct 29/31 Sequence Models RNN (Thurs)
10 Tue/Thurs Nov 5/7 Machine Translation (Video Lecture) Korean NLP (Thurs)
11 Tue/Thurs Nov 12/14 Neural Language Models (ELMo, BERT, XLNet) Korean NLP (Tues)
12 Tue/Thurs Nov 19/21 NLP Applications (QA, Dialogue, Information Extraction, etc) (Tues) / Project Paper Presentations (Thurs) Presentation Evaluation
13 Tue/Thurs Nov 26/28 Project Paper Presentations / No Class on Nov 28 (Undergrad Admissions) Presentation Evaluation
14 Tue/Thurs Dec 3/5 Project Paper Presentations Presentation Evaluation
15 Tue/Thurs Dec 10/12 Project Poster Presentations (Thurs only) Presentation Evaluation
16 Tue/Thurs Dec 17/19 Project Report Due None

Team Projects

You will form teams of three, and as a team, pick one paper from ACL, EMNLP, NAACL, or TACL, published in 2016 to 2019, and replicate it. You will be required to change at least one thing – dataset, model, or research question. More details will be given out during the first week of class.


Your grade will be a combination of the following:

Paper List for Team Projects (Can be revised during the first two weeks)

Document Classification

Language Modeling & Transfer Learning

Word, Sentence, and Document Embedding

Machine Translation / Multilinguality

Conversation Modeling / Response Generation

Question & Answering / Summarization

Computational Social Science

Language Generation