In short: Is there a way to rigorously define the total derivative (of $F$ at $x$) as a function $dF_x$ which is (1) linear and (2) a usual topological limit of some function $\mu:X\to Y$, where $X$ and $Y$ are topological spaces?
Motivation: Let $F:\mathbb R^n\to\mathbb R^m$. The total derivative of $F$ at $x\in\mathbb R^n$ is defined as the linear map $dF_x:\mathbb R^n\to\mathbb R^m$ such that
$$\lim_{v\to0}\frac{\|F(x+v)-F(x)-(dF_x)v\|}{\|v\|}=0,$$
if such a linear map exists. This definition makes sense, but it is a bit indirect. The idea is that $F$ looks more and more like $dF_x$ near $x$, so it seems that the more natural definition should be something like $\lim_{v\to0} F(x+v)-F(x)=(dF_x)v$. The following points are suggestive:
- Normally when $\lim_{x\to c}\|f(x)-L\|=0$, this can be formulated as $\lim_{x\to c}f(x)=L$.
- The division by $\|v\|$ in the above definition is highly reminiscent of the operator norm.
I don't think there is any trouble extending the notion of operator norm to general continuous functions (although it may be infinite), via $\|F\|_\text{op}=\sup_{0\neq v\in\operatorname{dom}(F)}\frac{\|F(v)\|}{\|v\|}.$ Then, defining $\hat F_x(v)=F(x+v)-F(x)$ , we might be able to manipulate the first definition into something like
$$\lim_{v\to0}\hat F_x(v)=dF_x,$$
where it is understood that the limit is with respect to the operator norm. Or rather, as we look at $F$ restricted to smaller neighborhoods of $x$, the operator norm of $\hat F_x-dF_x$ restricted to this neighborhood approaches $0$. $F$ would approach many functions in this sense (including itself, for example), but the derivative would be the only linear function it approaches in this sense.
However, when I try making this rigorous, I run into some challenges. Topologically, the limit of a function $F$ near $x$ must be a value in the range of $F$, not a function with the same domain and range of $F$; so this formulation will require speaking of the limit of some function besides $F$, probably mapping into function spaces or spaces of germs of functions near $x$. This is where my knowledge gets more limited and I hit a wall.
Update: Here's my current progress. Let $C^0_x=\{f\in C^0(U,\mathbb R^m)\,|\,U\text{ is a neighborhood of }x\}$. Define function addition/subtraction on $C^0_x$ as usual function addition/subtraction restricted to the intersection of both functions' domains. Topologize this space using the metric $d(f,g)=\sup_{t\in\operatorname{dom}(f-g)\setminus\{x\}}\frac{\|f(t)-g(t)\|}{\|t-x\|}$. This metric can take infinite values, but this seems ok according to this. Finally, let $\mu_{x,F}:(0,\infty)\to C^0_x$ be defined by $\mu_{x,F}(\delta)=F\big|_{B_\delta(x)}$. Then, perhaps, we can define $dF_x$ (if it exists) as the unique linear map defined on all of $\mathbb R^n$ such that
$$\lim_{\delta\to0}\mu_{x,F}(\delta)=F(x)+dF_x.$$
Does this work? Is there a more elegant or standard way to do this?