Let $h>0$. Consider the finite difference formula $$ \frac{f(x+h)-f(x-h)}{2h} \approx f'(x) $$ which is called central difference. It is well known that for a sufficiently smooth function $f(x)$,
$$ \Bigg|\frac{f(x+h)-f(x-h)}{2h}-f'(x)\Bigg| = \mathcal{O}(h^2) $$
I have the following question: If
$$ \lim_{h\to 0} \frac{f(x+h)-f(x-h)}{2h} $$ exists. Then $$ f'(x) $$ exists?. In other words, is the following implication true? $$ \lim_{h\to 0}\frac{f(x+h)-f(x-h)}{2h} \ \text{exists} \implies f'(x) \ \text{exists} $$
I think that it's not necessarily true, but I haven't found a counterexample. Thanks in advance.