This is arguably a matter of convention and definition, but - a priori - no.
Short Version:
If a sequence $\newcommand{\N}{\mathbb{N}}
\newcommand{\R}{\mathbb{R}}
\newcommand{\seq}[1]{\left( #1_n \right)_{n \in \N}}
(a_n)_{n \in \N}$ grows without bound (i.e. $a_n \to \pm \infty$), we say that
$$\lim_{n \to \infty} a_n = \pm \infty$$
not as a statement that the limit exists or that the sequence converges, but as an encoding of how it diverges. It diverges, but in a special way that we can encode in familiar notation easily, but diverges nonetheless.
Long Version:
This is a matter of definition insofar as "what does it mean to converge?"
We consider a metric space $(X,d)$. ($X$ is just some set, and $d$ is a function which takes in two inputs, and outputs the distance between them. This may not match the distance you and I are familiar with in Euclidean space.)
A metric function must satisfy four axioms: for any $x,y,z \in X$,
- $d(x,y) \in \R_{\ge 0}$
- $d(x,y) = 0$ if and only if $x=y$
- Symmetry: $d(x,y) = d(y,x)$
- Triangle Inequality: $d(x,z) \le d(x,y) + d(y,z)$
In such a space, a sequence $\seq x$ in $X$ is said to converge to $x \in X$ if
$$(\forall \varepsilon > 0)(\exists N \in \N)(\forall n \ge N) \Big( d(x_n,x) < \varepsilon \Big)$$
or, less formally,
$$\lim_{n \to \infty} d(x_n,x) = 0$$
The key point here is that the limit is in the space itself.
So, if we want to speak about convergence to $\infty$ in $\R$, we really need to speak about the extended reals, $\overline{\R} := \R \cup \{+\infty,-\infty\}$.
But now you should see why, if $d(x,y) := |x-y|$ is the usual distance in $\R$, if you extend it to the usual arithmetic with $\infty$, that $(\overline{\R},d)$ is actually not a metric space, so the notion of convergence there (and thus "convergence to infinity") is not really sensible. (It's as simple as realizing, for instance, that $d(x,\infty) = \infty \not \in \R_{\ge 0}$ for any $x \in \R$. Hence $d$ is not a metric.)
(Some more discussion here.)
Addressing a Potential Follow-Up:
A reasonable conclusion to go to from here would be "okay, well, can we speak about convergence to infinity under a different metric?" (Though I suppose you could loosen the restrictions on finite distances, e.g. like here.)
Any given set can be given some sort of distance function, albeit it may be limited to a trivial one, such as
$$d(x,y) := \begin{cases}
1 & x \ne y \\
0 & x = y
\end{cases}$$
A metric for $\overline{\R}$, per Ross Milikan's answer here would be
$$d(x,y) := |f(x)-f(y)|$$
where
$$f : \overline{\R} \to \left[ - \frac \pi 2, \frac \pi 2 \right] \text{ has } f(x) := \begin{cases}
\pi/2 & x = +\infty \\
-\pi/2 & x = -\infty \\
\arctan(x) & x \in \R
\end{cases}$$
What About Limit Points?
You also brought up the idea of "would $\infty$ be a limit point?"
To recall: for a topological space (e.g. metric space) $X$, a point $x \in X$ is a limit point of a subset $S \subseteq X$ if, given any open neighborhood $U_x$ of $x$, we have $U_x \setminus \{x\} \cap S \ne \emptyset$.
The key point to think about here is that we need to speak about an overarching set/subset/superset structure. In particular, each in the chain must, essentially, inherit the topological structure from those above it.
Hence, $\infty$ needs to be a point in something, so it seems natural to start regarding $\R$ as a subset of $\overline{\R}$.
However we run into the same snag as before, in that $\overline{\R}$ is not a metric under the usual distance function for $\R$.
Now, of course, we have seen the existence of a metric for $\overline{\R}$. If we restrict that to $\R$, that too will be a metric, so we can speak of convergence in the general sense I opened with.
So, in the resulting topology, would $\infty$ be a limit point of $\R$?
It is enough to look at open balls in metric spaces, so take $B_r(\infty)$ for $r>0$. (A ball, in $\overline{\R}$, centered at $\infty$ with radius $r$.) Formally,
$$B_r(\infty) = \left\{x \in \overline{\R} \, \middle| \, d(x,\infty) < r \right\}$$
Of course,
$$d(x,\infty) = \left| \frac \pi 2 - \arctan(x) \right|$$
for $x \in \R$, and $d(-\infty,\infty) = \pi$. Then if $r > \pi$, $B_r(\infty) = \overline{\R}$. For lesser $r$, you will get some interval $(a,\infty]$ (all reals from some $a \in \R$ onward, and including $\infty$) -- this is easy to see from the limiting behavior of $\arctan(x)$, and I leave formal justification to you.
Either way, in this limited sense, sure, $\infty$ is a limit point of $\R$. Just under a different metric so that $\overline{\R}$ can even be spoke of as a metric space.
Your Two Sequences:
Something you'll learn about is the formal definitions for infinite limits. I've bombarded you with enough as is, and other posts have addressed this point in particular.
However something you'll learn is that, if a sequence converges to some limit, every subsequence must do so too. This is why your first sequence does not converge and why we would not even say $a_n \to \infty$, since every other term is $1$. The sequence as a whole is not going to infinity, it keeps bouncing back down. The other sequence, overall, is bouncy but still trends upward.
You can chase these around with formal definitions if you want.
Summary:
- Under the Euclidean metric, we only say a sequence "goes to infinity" to give a little detail as to how it diverges. (That is, sequences $a_n$ where $a_n \to \infty$ are just a special subset of divergent sequences.)
- Such a sequence can be said not to converge, formally, because the Euclidean metric does not extend to $\overline{\R}$.
- We can introduce a metric on $\overline{\R}$, however. In that sense, we can speak of $\infty$ as a limit point of $\R$.