The chain rule "derivation" is invalid, because it assumes $f^{-1}$ is differentiable, which is begging the question (circular reasoning).
Here is a valid proof:
Conditions:
i) Function $f$ defined and continuous on a neighborhood of point $x$.
ii) Inverse function $f^{-1}$ defined and continuous on a neighborhood of $y = f(x)$.
iii) $f$ differentiable at point $x$, and $f'(x) \not = 0$.
By the differentiability theorem:
$$f(x + h) - f(x) = h(f'(x) + g(h))$$
where $g(h)$ goes to zero as $h$ goes to zero.
Define $k := h(f'(x) + g(h))$
By limit theorem $k$ also goes to zero as $h$ does.
Since $f'(x)$ is non-zero, you can restrict $|h|$ so that that $|g(h)|$ is less than $|f'(x)|$ (and thus $k$ is non-zero), and add a further restriction so that $f^{-1}$ is defined and continuous on the interval $[y-k, y + k]$.
Now you can show that the derivative exists:
$$\frac{1}{f'(x)} = \lim_{h\to 0} \frac{h}{f(x+h) - f(x)} = \lim_{h\to 0} \frac{f^{-1}(f(x + h)) - f^{-1}(f(x))}{f(x+h)-f(x)} = \lim_{k\to 0} \frac{f^{-1}(y+k) - f^{-1}(y)}{k}.$$
Note: If a function is continuous and strictly increasing or strictly decreasing on a neighborhood of $x$, the inverse function theorem says that $f^{-1}$ is then also strictly increasing/decreasing on a neighborhood of $y$. Thus the inverse function is defined and continuous on a neighborhood of $y$.