To estimate the value of the derivative of a sufficiently differentiable function , there are three methods using finite difference approximations for derivative

where is the step size away from

  • Forward difference:
  • Backwards difference:
  • Central difference:

Order of estimation error

As

Second derivative approximations

Taylor series interpretation