There are several definition of $\limsup_{n\to\infty} x_n$. It should not be very difficult to take the definition you are used to and get from this the corresponding definition for $t\to0^+$.
One of the definitions of limit superior of a sequence is
$$\limsup_{n\to\infty} x_n = \lim_{n\to\infty} \sup_{k\ge n} x_k.$$
In your situation you would get the corresponding definition in the form
$$\limsup_{t\to0^+} f(t) = \lim_{t\to0^+} \sup_{s\in(0,t]} f(s).$$
Similarly as for sequences, you can get other equivalent definitions of limit superior for $t\to0^+$.
All these various notions of limit superior can be understood as special case of limit superior of a net.
However, the notion of net is only taught later in more advanced courses. (You will typically encounter it in a course on general topology.) See, for example here, here or here.
For you special case you can notice that $\lim\limits_{t\to0^+} 2t\sin\frac1t =0$. Therefore
$$\limsup\limits_{t\to0^+} \left(2t\sin\frac1t + \cos\frac1t\right) =
\lim\limits_{t\to0^+} 2t\sin\frac1t + \limsup\limits_{t\to0^+} \cos\frac1t =
\limsup\limits_{t\to0^+} \cos\frac1t = 1.$$
(We have used property analogous to the property shown here fore sequences: How to prove $\limsup (x_{n}+y_{n})=\lim x_{n}+\limsup y_{n}$?)
To see that $\limsup\limits_{t\to0^+} \cos\frac1t = 1$ we could simply observe that:
- We have $\cos\frac1t\le1$, therefore also $\limsup\limits_{t\to0^+} \cos\frac1t \le 1$.
- We can find a sequence $t_n$ such that $t_n\to0^+$ and $\cos\frac1{t_n}=1$. (Simply take $t_n$'s such that $\frac1{t_n}=2\pi n$, i.e., $t_n=\frac1{2\pi n}$.) Therefore $\limsup\limits_{t\to0^+} \cos\frac1t \ge 1$.