The standard way to define an improper integral of the form $\int_a^\infty f(t)dt$ is as follows. We first define the Riemann integral $\int_a^xf(t)dt$ for each $x>a$ in the standard way, i.e. using partitions of the interval $[a,x]$ and limits of Riemann sums and all that. Then we define $\int_a^\infty f(t)dt$ as $\lim_{x\rightarrow\infty}\int_a^xf(t)dt$.
But my question is, why can’t we define improper integrals in an analogous fashion to how we define Riemann integrals on closed intervals? That is, why can’t we take partitions of the interval $[a,\infty)$, take Riemann sums which would be infinite series, and then take the limit of those Riemann sums either under the refinement partial order or as the mesh of the partition goes to $0$?
Is the issue that the Riemann sum of a given partition of $[a,\infty)$ may not be a convergent series?