ECE 595ML Lecture 5.2: Gradient Descent - Stochastic Gradient Descent

By Stanley H. Chan

Electrical and Computer Engineering, Purdue University, West Lafayette, IN

View Presentation

Additional materials available (4)

Category

Online Presentations

Published on

Cite this work

Researchers should cite this work as follows:

  • Stanley H. Chan (2020), "ECE 595ML Lecture 5.2: Gradient Descent - Stochastic Gradient Descent," https://nanohub.org/resources/32216.

    BibTex | EndNote

Time

Location

WTHR 200, Purdue University, West Lafayette, IN

ECE 595ML Lecture 5.2: Gradient Descent - Stochastic Gradient Descent
  • Lecture 5.2: Stochastic Gradient Descent 1. Lecture 5.2: Stochastic Gradie… 0
    00:00/00:00
  • Outline 2. Outline 11.044377711044378
    00:00/00:00
  • Stochastic Gradient Descent 3. Stochastic Gradient Descent 17.117117117117118
    00:00/00:00
  • Full Gradient VS Partial Gradien 4. Full Gradient VS Partial Gradi… 130.69736403069737
    00:00/00:00
  • SGD Algorithm 5. SGD Algorithm 346.21287954621289
    00:00/00:00
  • Interpreting SGD 6. Interpreting SGD 414.38104771438105
    00:00/00:00
  • Perspectives of SGD 7. Perspectives of SGD 582.81614948281617
    00:00/00:00
  • GD compared to SGD 8. GD compared to SGD 616.75008341675016
    00:00/00:00
  • Smoothing the Landscape 9. Smoothing the Landscape 670.27027027027032
    00:00/00:00
  • Smoothing the Landscape 10. Smoothing the Landscape 723.55689022355693
    00:00/00:00
  • Smoothing the Landscape 11. Smoothing the Landscape 732.932932932933
    00:00/00:00
  • Reading List 12. Reading List 844.71137804471141
    00:00/00:00
Pop Out