A function involving the divided differences of the psi function and the polygamma functions is proved to be completely monotonic. As an application of this result, the monotonicity and convexity of a function originated from establishing the best upper and lower bounds in Kershaw’s inequality is deduced.