This is a quick question, and perhaps a quick answer.
What keeps us from defining the derivative, formally, as:
$$f'(x)=\lim_{h\to 0}\frac{f(x+h)-f(x-h)}{2h}$$?
Graphically this would mean that we could calculate the tangent to a graph by approaching the desired point from both sides at equal rates, rather than from one side.
As a side effect, functions could be differentiated at removable discontinuities, as well as "sharp ends". For example, the derivative of $|x|$ at $0$ would unambiguously be $0$. Or, the derivative of $\frac{x^2-3x+2}{x-1}$ at $1$ would be defined unambiguously as $-1$.
I didn't ever think about this until today. And since I thought about this, I can't let this go. And it bothers me: why do we define derivative as a tangent approaching from one side, while the point of interest is fixed? It seems more natural to approach from both sides at once, now that I played with this idea in my head.
So, why isn't the derivative defined like this? As a bonus question, if this definition was widely used, what would be the effects on other aspects of calculus? Or would there be none, besides the absorption of local discontinuities?