The idea of the "field with one element" is not because we're interested in fields, but because we're interested in arithmetic geometry — the merger between number theory and algebraic geometry. Maybe there are other motivations too.
In both number theory and in algebraic geometry, fields — and the mathematical methods used in working with fields — are used extensively to describe various objects and features of the subject.
The finite fields are of particular interest for this. For example, the primes $2, 3, 5, 7, \ldots$ of the integers correspond to the finite fields $\mathbf{F}_2, \mathbf{F}_3, \mathbf{F}_5, \mathbf{F}_7, \ldots $.
One of the major obstacles in arithmetic geometry is that there is a big gaping hole in the theory, one you might expect to have something described by a field. And the really intriguing thing is that when mathematicians explore this hole, they find a lot of the features they expected to see.
Various numerology1 arguments suggest if there were a field describing this hole, it would be a finite field of one element. To be clear, the zero ring does not have the features that mathematicians need.
These arguments have led to a whimsical description of this field of study as trying to work with a hypothetical object called $\mathbf{F}_1$. It's maybe more accurate to say that $\mathbf{F}_1$ refers to a hypothetical instance of a yet unknown2 generalization of the notion of field.
1: I mean this in the whimsical sense that mathematicians use — e.g. doing suspect (and often nonsensical when taken literally) calculations to get an idea where to look for something more rigorous
2: I am not an expert so I don't know the state of the art here. But my knowledge is simply that there are various candidate constructions that have some nice features, but none yet reproduce everything mathematicians are looking for