Optimization Techniques M. Fatih Amasyalı. Steepest Descent Exact step size x_new = x_old - eps * df; Eps is calculated as: – z(eps)=x – eps*df – Find.