There is a formulation of calculus in terms of the field of hyperreal numbers which provides a formalization of this type of reasoning. This text by H. Jerome Keisler discusses the concept in chapter 2, which is about derivatives.
As discussed on the linked wiki page, the hyperreal numbers are an extension of the real numbers which include nonzero infinitesimal numbers. A hyperreal number $\Delta x$ is called infinitesimal when $0\le\Delta x<r$ for any given real number $r$. Taking the hyperreals to be countably infinite sequences of real numbers as in the ultrapower construction of the hyperreals, we see that $\left(\frac{1}{n}\right)_{n\in\mathbb{N}}=\left(1,\frac{1}{2},\frac{1}{3},\dots\right)$ is not $0=(0,0,0,\dots)$ since the two sequences differ in a cofinite number of entries. We also see that $\left(\frac{1}{n}\right)_{n\in\mathbb{N}}<r=(r,r,r,\dots)$ for any $r\in\mathbb{R}$, since we have that $\frac{1}{n}<r$ for a cofinite number of $n\in\mathbb{N}$, so we have exhibited an infinitesimal number.
The advantage of this system is that the hyperreals, including infinitesimals, obey the usual rules of arithmetic. Thus, for example, we can compute the "infinitesimal secant" from $x$ to $x+\Delta x$ for $f(x)=x^2$ and a nonzero infinitesimal $\Delta x$ (like our number $\left(\frac{1}{n}\right)_{n\in\mathbb{N}}$) by computing $$\frac{(x+\Delta x)^2-x^2}{\Delta x}=\frac{x^2+2x\Delta x+(\Delta x)^2-x^2}{\Delta x}=\frac{2x\Delta x+(\Delta x)^2}{\Delta x}=2x+\Delta x.$$
We then define a standard part function $\operatorname{st}(x)$ which takes a hyperreal number and returns the unique real number $r$, if it exists, such that $x-r$ is infinitesimal. We then see that $\operatorname{st}(2x+\Delta x)=2x$ and go on to define the derivative as $$f'(x)=\operatorname{st}\left(\frac{f(x+\Delta x)-f(x)}{\Delta x}\right)$$ for any nonzero infinitesimal $\Delta x$.
In more generality, any time we are working with differentials, such as $dt$ in your example, we can always treat $dt$ as a nonzero infinitesimal and perform arithmetic as usual as long as we remember that we have to be able to take the standard part correctly at the end of our computation.