CSCE 638 - Natural Language Processing: Foundation and Techniques

Course Information

Lectures

Instructor

Grading

Assignments

Late Policy

Schedule

Week Date Topic Readings Note
W11/13 Course Overview
1/15 Text Classification
W21/20 Martin Luther King, Jr. Day (No Class)
1/22 Word Representations Word2Vec
GloVe
W31/27 Language Modeling Assignment 1 Released
1/29 Text Classification, Convolutional Neural Network TextCNN
W42/3 Recurrent Neural Networks, Long Short-Term Memory
2/5 Sequential Tagging, Sequence-to-Sequence Generation
W52/10 Attention, Transformers Attention
Transformers
2/12 Positional Encoding, Tokenization RoPE
W62/17 Contextualized Representations, Pre-Training ELMo
BERT
BART
Assignment 1 Due / Quiz 1
2/19 Prefix Tuning, Adapter, Mixture of Experts
W72/24 Large Language Models, In-Context Learning ICL
CoT
Assignment 2 Released
2/26 Human Preference Alignment RLHF
DPO
W83/3 Text Similarity, Retrieval-Augmented Generation SimCSE
RAG
Project Proposal Due
3/5 Project Highlight
W93/10 Spring Break (No Class)
3/12 Spring Break (No Class)
W103/17 Multilingual NLP Assignment 2 Due / Quiz 2
3/19 Vision-Language Models CLIP
BLIP
LLaVA
W113/24 Invited Talk Assignment 3 Released
3/26 Adversarial Attack and Defense BERT-ATTACK
Jailbreaking
W123/31 Social Bias Detection and Mitigation
4/2 AI-Generated Text Detection DetectGPT
Watermark
W134/7 Invited Talk
4/9 Hallucinations and Misinformation Control Snowball Effect
SelfCheckGPT
W144/14 Positional Bias and Spurious Correlation Assignment 3 Due / Quiz 3
4/16 Project Presentation
W154/21 Project Presentation
4/23 Project Presentation
W164/28 (No Class)
4/30 Reading Day (No Class) Project Report Due