There are two ways to compute the gradient: A slow, approximate but easy way (numerical gradient), and a fast, exact but more error-prone way that requires calculus (analytic gradient). We will now present both.

analytic gradient： 这里是指用subgradient近似后，不用再求导了。详见原文。

cs231n-4---optimization