At first, when learning a mathematical concept, there is likely to be a bit of a disconnect between your intuition and the definition. Pursuing questions like this helps a lot. Here you have answers that provide a wiggly function for a counterexample and a closer look at the proof for a continuous derivative.
Here is another viewpoint. When you think of $f'(a)>0$ you commonly imagine all the difference quotients
$$\frac{f(y)-f(x)}{y-x} $$
as positive for intervals $[x,y]$ close to $a$. But the example here should remind you that $f'(a)>0$ only pays attention to the intervals $[x,y]$ that straddle $a$, i.e., intervals
with $x \leq a \leq y$. Not all intervals close.
The Italian mathematician Guiseppe Peano had a different response to this situation. He felt that the ordinary derivative didn't convey the right intuitive idea. Why shouldn't a positive "derivative" imply increasing close to the point? He introduced what he called a strict derivative (nowadays called a strong derivative
or unstraddled derivative by most people). Define $f^\sharp(a)$ to
be the limit
$$ f^\sharp(a) = \lim_{x,y\to a, x\not=y} \frac{f(y)-f(x)}{y-x} $$
where now all intervals $[x,y]$ are being considered. For this stronger derivative the answer to your question is positive: if $f^\sharp(a)>0$ then, indeed, $f$ is increasing in some neighborhood of the point $a$. So you are right, but you were depending on the wrong derivative to supply your conclusion.
The original reference is
Giuseppe Peano, Sur la definition de la derivee, Mathesis Recueil
Mathematique (2) 2 (1892), 12-14.
Peano hoped that the strict derivative would be useful in teaching calculus, but that hasn't worked out. You can, however, find many papers that study this derivative. It is a good introduction to the idea that there are numerous useful ways of defining a derivative other than the traditional calculus one.