Syllabus

For all "Materials and Assignments", follow the deadlines listed on this page, not on Coursera! Assignments are usually due every Tuesday 11:30 a.m. PST at the beginning of lecture time.

Announcements

  • The course website for Fall offering of 2024 is still in the process of updating. Please keep in mind that changes will be made up until 9/23 so please refer to the website for the most up-to-date information on the first day of the quarter.
  • Please join Ed during the first week. This is where the majority of course announcements will be found.
  • Video cameras located in the back of the room will capture the instructor presentations in this course. For your convenience, you can access these recordings by logging into the course Canvas site. These recordings might be reused in other Stanford courses, viewed by other Stanford students, faculty, or staff, or used for other education and research purposes. Note that while the cameras are positioned with the intention of recording only the instructor, occasionally a part of your image or voice might be incidentally captured. If you have questions, please contact a member of the teaching team.
  • Since the exam will be in-person, SCPD/CGOE students will need to nominate exam monitors for both exams and coordinate the exam process with the SCPD exams team. Please refer to this link for more information on the process. For any additional questions, please reach out to the SCPD exams team at scpd-exams@stanford.edu.
  • If you would like to audit the course, please fill out the following request form.

Syllabus

  • Modules are equivalent to “Weeks” in the Coursera courses. For example, C1M1 refers to C1 Week 1.
  • Note that the in-class lecture topics are subject to change as the quarter progresses.
Event Date In-class lecture Online modules to complete Materials and Assignments
Lecture 1 9/24 Topics: (slides)
  • Class introduction
  • Examples of deep learning projects
  • Course details
 No online modules. If you are enrolled in CS230, you will receive an email to join Course 1 ("Neural Networks and Deep Learning") on Coursera with your Stanford email. No assignments.
Neural Networks and Deep Learning (Course 1)
Lecture 2 10/01 Topics: Deep Learning Intuition (slides) Completed modules:
  • C1M1: Introduction to deep learning (slides)
  • C1M2: Neural Network Basics (slides)
Optional Video
  • Batch Normalization videos from C2M3 will be useful for the in-class lecture.
 Quizzes (due at the beginning of lecture time):
  • Introduction to deep learning
  • Neural Networks Basics
Programming Assignments (due at the beginning of lecture time)
  • Python Basics with Numpy (Optional)
  • Logistic Regression with a neural network mindset
Lecture 3 10/08 Topics: Adversarial examples - GANs (slides)
  • Attacking neural networks with Adversarial Examples and Generative Adversarial Networks
Optional Readings: Explaining and Harnessing Adversarial Examples, Generative Adversarial Nets, Conditional GAN, Super-Resolution GAN, CycleGAN 		Completed modules: Quizzes (due at the beginning of lecture time):
  • Shallow Neural Networks
  • Key concepts on Deep Neural Networks
Programming Assignments (due at the beginning of lecture time):
  • Planar data classification with a hidden layer
  • Building your Deep Neural Network: step by step
  • Deep Neural Network - Application
Project Meeting #1 10/08 Tuesday 11:59 PM Instructions Meet with any TA between 9/24 and 10/08 to discuss your proposal.
Project Proposal Due 10/08 Tuesday 11:59 PM Instructions
Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Course 2)
Lecture 4 10/15 Topics: Full-cycle of a Deep Learning Project (no slides) Completed modules:
  • C2M1: Practical aspects of deep learning (slides)
  • C2M2: Optimization algorithms (slides)
 Quizzes (due at the beginning of lecture time):
  • Practical aspects of deep learning
  • Optimization Algorithms
Programming Assignments (due at the beginning of lecture time):
  • Initialization
  • Regularization
  • Gradient Checking
  • Optimization
Structuring Machine Learning Projects (Course 3)
Lecture 5 10/22 Topics: AI and Healthcare. Guest Speaker: Pranav Rajpurkar. (guest slides) (main slides) Completed modules:
  • C2M3: Hyperparameter Tuning, Batch Normalization (slides)
  • C3M1: ML Strategy (1) (slides)
  • C3M2: ML Strategy (2) (slides)
 Quizzes (due at the beginning of lecture time):
  • Hyperparameter tuning, Batch Normalization, Programming Frameworks
  • Bird recognition in the city of Peacetopia (case study)
  • Autonomous driving (case study)
Programming Assignments (due at the beginning of lecture time):
  • Tensorflow
Convolutional Neural Networks (Course 4)
Lecture 6 10/29 Topics: Deep Learning Strategy (no slides)

Optional Reading: A guide to convolution arithmetic for deep learning, Is the deconvolution layer the same as a convolutional layer?, Visualizing and Understanding Convolutional Networks, Deep Inside Convolutional Networks: Visualizing Image Classification Models and Saliency Maps, Understanding Neural Networks Through Deep Visualization, Learning Deep Features for Discriminative Localization 		Completed modules:
  • C4M1: Foundations of Convolutional Neural Network (slides)
  • C4M2: Deep Convolutional Models (slides)
 Quizzes (due at the beginning of lecture time):
  • The basics of ConvNets
  • Deep convolutional models
Programming Assignments (due at the beginning of lecture time):
  • Convolutional Model: step by step
  • Convolutional Model: application
  • Keras Tutorial: This assignment is optional.
  • Residual Networks
Lecture 7 11/05 Democracy day: NO CLASS Completed modules:
  • C4M3: ConvNets Applications (1) (slides)
  • C4M4: ConvNets Applications (2) (slides)
 Quizzes (due at the beginning of lecture time):
  • Detection Algorithms
  • Special Applications: Face Recognition & Neural Style Transfer
Programming Assignments (due at the beginning of lecture time):
  • Car Detection with YOLO
  • Art Generation with Neural Style Transfer
  • Face Recognition
Midterm Review TBD Past midterms:
Midterm 11/06
Lecture 8 11/12 Topics:
  • Career Advice
  • Reading Research Papers
Optional Reading 		Completed modules:
  • C5M1: Recurrent Neural Networks (slides)
 Quizzes (due at the beginning of lecture time):
  • Recurrent Neural Networks
Programming Assignments (due at the beginning of lecture time):
  • Building a Recurrent Neural Network - Step by Step
  • Dinosaur Land -- Character-level Language Modeling
  • Jazz improvisation with LSTM
Project Meeting #2 11/15 Friday 11:59 PM Instructions Meet with your assigned TA between 10/08 and 11/15 to discuss your milestone report.
Project Milestone Due 11/15 Friday 11:59 PM Instructions
Sequence Models (Course 5)
Lecture 9 11/19 Topics: (slides)
  • Deep Reinforcement Learning

Optional Reading: 		Completed modules:
  • C5M2: Natural Language Processing and Word Embeddings (slides)
  • C5M3: Sequence-to-Sequence Models (slides)
 Quizzes (due at the beginning of lecture time):
  • Natural Language Processing and Word Embeddings
  • Sequence Models and Attention Mechanism
Programming Assignments (due at the beginning of lecture time):
  • Operations on Word Vectors - Debiasing
  • Emojify!
  • Neural Machine Translation with Attention
  • Trigger Word Detection
Lecture 10 12/03 Topics: (slides)
  • Class wrap-up
  • What's next?
 Optional:
  • If you’re interested in testing your ML/DL skills or preparing for job interviews in AI, you can take the Workera assessment
Project Meeting #3 12/03 Tuesday 11:59 PM Instructions Meet with your assigned TA between 11/15 and 12/03 (before class) to discuss your final project report.
Project Final Report & Video Due 12/03 Tuesday 11:59 PM Instructions Please read over the final project guidelines here for information on the rubric and late submissions.
Project Poster Session 12/13 Friday 11:30 AM - 3:00 PM Location: AOERC Basketball courts