Detlef Laugwitz wrote a monumental biography of Riemann. The book was translated into English by Shenitzer. Laugwitz discusses Riemann's fundamental essay
Uber die Hypothesen, welche der Geometrie zu Grunde liegen (On the Hypotheses which lie at the Foundations of Geometry)
of 1854 on the foundations of what has since become Riemannian geometry. Laugwitz writes: "In the lecture, Riemann pushed to extremes his tendency to use as few formulas as possible." Unfortunately Laugwitz does not elaborate, but the unique formula contained in Riemann's essay is the formula $$\frac{1}{ 1+\frac{\alpha}{ 4}\sum x^2}\sqrt{\sum dx^2}$$ expressing the length element of a metric of constant (sectional) curvature $\alpha$.
What is puzzling here is Riemann's notation. This is of course before dual spaces and tensor calculus. What meaning did Riemann attach to $dx$? It is hard to say it was infinitesimal because Riemann is known for giving a rigorous treatment to the, well, Riemann integral.
I see now that there is also a book by Monastyrsky Riemann, topology, and physics that might be relevant.
Does anyone have a reference that would comment on this?
Note 1. Spivak's Differential geometry, third edition, volume 2, chapter 4 contains an English translation of Riemann's essay. Here on page 155 Riemann speaks of the line as being made up of the $dx$, describes $dx$ as "the increments", and speaks of infinitesimal displacements. On page 156 he speaks of infinitely small quantities $x_1dx_2-x_2dx_1$, etc., as well as of infinitely small triangles.