The Mazur swindle, as it was explained to me, involves leaving the PL or smooth category and resorting to wild knots -- continuous injections up to ambient isotopy -- to make sense of an infinite connect sum. As Noah Schweber explains, you can shrink each connect summand down and then place a limit point at the corner, and this gives a continuous injection of a closed interval.
There is a way to deal with infinite connect sums without resorting to wild knots per se. This is an approach that is a modification of long knots, which are embeddings of $\mathbb{R}$ into $\mathbb{R}^3$ such that outside of a bounded subset of $\mathbb{R}^3$, the embedding is the standard embedding of $\mathbb{R}$ as the $x$-axis in $\mathbb{R}^3$. The idea of a long knot is that it is a stereographic projection of a knot in $S^3$, where the projection point lies along the knot itself. Long knots are like a knot tied into the center of an extremely long piece of string, and the connect sum of two long knots is from tying those knots into different parts of the string. Connect sums are witnessed by spheres that transversely intersect the long knot in exactly two points.
Let's say a longer knot is a proper embedding of $\mathbb{R}$ into $\mathbb{R}^3$ (proper in the topology sense, where, in this case, bounded subsets of $\mathbb{R}^3$ contain a bounded subset of $\mathbb{R}$). These objects still have tameness properties that let usual combinatorial arguments work properly. (But they don't, in general, have well-defined connect sums! You can, however, connect sum a long knot with a longer knot to obtain a longer knot.)
We can make sense of $K_1\mathop{\#}K_2\mathop{\#}\cdots$ by tying $K_1$ into the interval $(0,1)$ of the string, tying $K_2$ into the interval $(1,2)$, and so on.

This can be thought of as a limit of the sequence of long knots $(K_1\mathop{\#} K_2)^{\mathop{\#}n}$ as $n\to\infty$, taking care to make sure that for each bounded region of $\mathbb{R}^3$ there is some $N$ such that for all $n\geq N$ the partial connect sum has converged within that region, and in the above construction we made sure of this. It is kind of fun thinking about the limit as being a solution to $L=K_1\mathop{\#} K_2\mathop{\#}L$, with $L$ a longer knot. (There is another limit of this sequence, which is where the connect summands extends in both directions. I'm not sure if this is isotopic!)
If $K_1$ or $K_2$ is non-trivial, then this longer knot ends up not being equivalent to a long knot (exercise :-)). So, the infinite connect sum does not converge as a long knot, but it does make sense as a longer knot. Maybe this is like the study of divergent series.
There exist spheres that witness the decompositions of this longer knot as $(K_1\mathop{\#}K_2)\mathop{\#}(K_1\mathop{\#}K_2)\mathop{\#}\cdots$ and $K_1\mathop{\#}(K_2\mathop{\#}K_1)\mathop{\#}(K_2\mathop{\#}K_1)\cdots$.

That $K_1\mathop{\#}K_2$ is the unknot is equivalent to saying that, by performing an isotopy only within the spheres, we can put the longer knot into a form where the interior of each sphere is a trivial arc.

Now we have that a longer knot with just $K_1$ tied into it is equivalent to the trivial longer knot. A priori this might be possible in the world of longer knots, but we can show this implies $K_1$ is trivial. If they were equivalent, then there would be an ambient isotopy that carries the $K_1$ longer knot to the trivial longer knot. Take a sphere that intersects the knot in two points, containing the $K_1$.

Now, apply the ambient isotopy to this sphere, carrying it to somewhere along the trivial longer knot. It might look complicated, but after another isotopy we can put it into a standard form.

We can modify the this composition of isotopies so that it actually keeps the sphere fixed the entire time! This implies the interior of the sphere experiences an isotopy carrying $K_1$ to the trivial arc, implying that $K_1$ as a knot is the unknot.
In a way, the point of the sphere is to keep the infinity at bay, since it lets us only have to think about a bounded portion of the longer knot.
(I should say that longer knots are equivalent to the theory of wild knots in $S^3$ with only a single "wild point." The complement of every open ball at the wild point should look like a piece of a tame knot. The second diagram on this page shows an example of a wild knot that is a two-component longer link.)