Course Description

Generative models are a class of machine learning algorithms that define probability distributions over complex, high-dimensional objects such as images, sequences, and graphs. Recent advances in deep neural networks and optimization algorithms have significantly enhanced the capabilities of these models and renewed research interest in them. This course explores the foundational probabilistic principles of deep generative models, their learning algorithms, and popular model families, which include variational autoencoders, generative adversarial networks, autoregressive models, and normalizing flows. The course also covers applications in domains such as computer vision, natural language processing, and biomedicine, and draws connections to the field of reinforcement learning.

Time & Location

Lecture: Tuesday, Thursday 10:00 AM - 11:30 AM
Cornell Tech Location: Bloomberg Center 91 Cornell Ithaca Location: Bill and Melinda Gates Hall G13

Instructor and Office Hours

Instructor: Volodymyr Kuleshov
Email: vk379 [at] cornell [dot] edu
Office Hours: Tuesday, Thursday 11:30 AM - 12:30 PM, Bloomberg 366
Ithaca students will be able to join via Google Hangouts (link)

Grade Breakdown

  • Three Homeworks: 15% each
  • Presentation: 15%
  • Course Project: 40%
    • Proposal: 5%
    • Progress Report: 10%
    • Final Report: 25%

Course Discussions

We use Piazza for course communication.

Assignment Details

See here for more details concerning assignments.

Project and Presentation Details

See here for more details concerning the course project.

FAQ

What are the pre-requisites?
Is there a textbook for this course?
We offer our own self-contained notes for this course. While there is no required textbook, we recommend "Deep Learning" by Ian Goodfellow, Yoshua Bengio, Aaron Courville. The online version available for free here.

Acknowledgments. The class is based on materials from Stanford CS236, taught by Aditya Grover and Stefano Ermon. HTML taken from various CS courses given at Stanford: cs236, cs231n, cs231a, and cs229.