This is a self-answered question. I post it here since it wasn't obvious to me. (although I have seen similar questions-is it an exact duplicate?).
Let $h:\mathbb{R}\to\mathbb{R}$ be $C^k$ and suppose that $h(0)=0$. Define $$ F(x) = \begin{cases} \frac{h(x)}{x} & \text{if $x\neq 0$} \\ h'(0) & \text{if $x=0$}\end{cases} $$
Then $F$ is $C^{k-1}$ and $F^{(m)}(0)=\frac{h^{(m+1)}(0)}{m+1}$ for every $m \le k-1$.
Is there a way to deduce the equality $F^{(m)}(0)=\frac{h^{(m+1)}(0)}{m+1}$ without a long calculation via L'Hôpital's rule? Perhaps using approximation by Taylor's polynomials?
I tried to that, but naive attempt didn't make it. (By inspecting the Taylor's polynomials, it is immediate that if $F \in C^{k-1}$, then $F^{(m)}(0)=\frac{h^{(m+1)}(0)}{m+1}$ holds, but this does not imply the $C^{k-1}$ differentiability to begin with).
Added:
This result is sharp. Indeed $h(x)=x^{k+1}\text{sgn}(x)$ is $C^k$, but $F(x)=x^{k}\text{sgn}(x)$ is only $C^{k-1}$, and is not differentiable $k$ times at zero.