Week 4: Assignment 4
Consider the movement on the 3D error surface for Vannila Gradient Descent Algorithm. Select all the options that are TRUE.
a. Smaller the gradient, slower the movement
b. Larger the gradient, faster the movement
c. Gentle the slope, smaller the gradient
d. Steeper the slope, smaller the gradient
Answer:
Pick out the drawback in Vannila gradient descent algorithm.
a. Very slow movement on gentle slopes
b. Increased oscillations before converging
c. escapes minima because of long strides
d. Very slow movement on steep slopes
Answer:
Comment on the update at the tth update in the Momentum-based Gradient Descent.
a. weighted average of gradient
b. Polynomial weighted average
c. Exponential weighted average of gradient
d. Average of recent three gradients
Answer: