Module 2 Overview

Theme

Backpropagation and automatic differentiation

Essential Question

How does the chain rule enable efficient learning in deep networks?

Module Components

• Book prose: computational graphs and backpropagation

• Assignment: gradient tracing exercise

• Slides: forward and backward passes

• Narration: asynchronous slide narration

• Instructor notes: teaching notes

• Notebook: manual vs autograd gradient check