In fact, vectors are a far more abstract concept. A vector is an element of the set of a vector space, which again is a set with some operators that have some specific properties. It shows, that the set of n-tuple of real numbers with addition and scalar multiplication has those properties. And, more important, that all finit-dimensional vector spaces are isomorph to this space (you could say, that "they're the same").
You are actually adressing a more physical interpretation problem. You can interprete these n-tuples either as points or as directions (which I assume you mean when you're talking about "vectors"). Actually it isn't a real problem, because you can switch between the interpretations whenever you want. Let me give you an example.
Conside space curves: $c: [a,b] \rightarrow \mathbb{R}^3$ and the corresponding tangential vectors $T: [a,b] \rightarrow \mathbb{R}^3, t \mapsto \frac{c'(t)}{|c'(t)|}$. Both are functions from a real intervall to the 3dim-space. But in the first case, you interpret the vectors as points in the space, and the range is what you would think of a curve. However, the tangential vector is interpreted as the direction of the curve in every point. Usually you "glue" this vector to the corresponding point of the curve, but you can also let them be vectors in 0; then you get only a circle arc.
However, there are situation where you need both, an anchor point and a directions. In those cases you just consider two vectors: The first one describes the anchor point, the second one the direction. If you are interested in this topic, see tangential bundles.