| Week | Date | Topic | Readings | Note |
|---|---|---|---|---|
| W1 | 1/13 | Course Overview | ||
| 1/15 | Linear models, Deep Neural Networks | |||
| W2 | 1/20 | Martin Luther King, Jr. Day (No Class) | ||
| 1/22 | Word Representations |
Word2Vec GloVe |
||
| W3 | 1/27 | Language Modeling | Assignment 1 Released | |
| 1/29 | Text Classification, Convolutional Neural Network |
TextCNN |
||
| W4 | 2/3 | Recurrent Neural Networks, Long Short-Term Memory | ||
| 2/5 | Sequential Tagging, Sequence-to-Sequence Generation | |||
| W5 | 2/10 | Attention, Transformers |
Attention Transformers |
|
| 2/12 | Positional Encoding, Tokenization |
RoPE |
||
| W6 | 2/17 | Contextualized Representations, Pre-Training |
ELMo BERT BART |
Assignment 1 Due / Quiz 1 |
| 2/19 | Prefix Tuning, Adapter, Mixture of Experts | |||
| W7 | 2/24 | Large Language Models, In-Context Learning |
ICL CoT |
Assignment 2 Released |
| 2/26 | Human Preference Alignment |
RLHF DPO |
||
| W8 | 3/3 | Text Similarity, Retrieval-Augmented Generation |
SimCSE RAG |
Project Proposal Due |
| 3/5 | Project Highlight | |||
| W9 | 3/10 | Spring Break (No Class) | ||
| 3/12 | Spring Break (No Class) | |||
| W10 | 3/17 | Multilingual NLP | Assignment 2 Due / Quiz 2 | |
| 3/19 | Vision-Language Models |
CLIP BLIP LLaVA |
||
| W11 | 3/24 | Invited Talk | Assignment 3 Released | |
| 3/26 | Adversarial Attack and Defense |
BERT-ATTACK Jailbreaking |
||
| W12 | 3/31 | Social Bias Detection and Mitigation | ||
| 4/2 | AI-Generated Text Detection |
DetectGPT Watermark |
||
| W13 | 4/7 | Invited Talk | ||
| 4/9 | Hallucinations and Misinformation Control |
Snowball Effect SelfCheckGPT |
||
| W14 | 4/14 | Positional Bias and Spurious Correlation | Assignment 3 Due / Quiz 3 | |
| 4/16 | Project Presentation | |||
| W15 | 4/21 | Project Presentation | ||
| 4/23 | Project Presentation | |||
| W16 | 4/28 | (No Class) | ||
| 4/30 | Reading Day (No Class) | Project Report Due |