I need a "big picture" of how those things relate to each other and probably a list of fundamental theorems that glue them up together.
My current (quite limited) understanding:
1) The fact that function $f(x)$ has a derivative at point $P$ does mean that it behaves nearly like a straight line infinitely close to the $P$ and thus might be approximated with such a straight line with infinitely small error (which becomes exactly 0 on at least two points $P, P_{neighbor}$ since both are shared by given line and original $f(x)$).
2) As such, $f(x)$ has to be continuous (not necessarily uniformly continuous) at the $P$, otherwise as long as $P_{neighbor} \rightarrow P$, $f(x)$ kind of "jumps" rather then being smooth and thus can not be estimated with a straight line to an infinitely small tolerance (but still could be approximated with a line, which obviously won't be precise and practically valuable, but still theoretically possible).
3) As such the fact that $f(x)$ is indeed continuous at $P$ guarantees that it could be "goodly" approximated with a straight line?
Am I right or wrong?
UPDATE:
I think the given answer beneath helped me to discover one mistake I wasn't able to see before. Let me try to formulate a new statement and you, guys, please correct me in case I am still mistaking things.
There are 2 different ways to approximate any (or only continuous?) $f(x)$:
1) when you pick up any 2 points belong to $f(x)$ and graph what is called a "secant line"; thus $[P_1, P_2]$ interval emerges where your linear estimation could be as precise as one wish (as long as $P_2$ approaches $P_1$).
2) But when things come down to the limit of such an constantly decreasing distance between both points, $P_2$ vanish and merges with $P_1$ such that only single point exits. Since this very moment, given line ceases to be a secant and becomes an "tangent line", which guaranteed to share at least single $P_1$ point with original $f(x)$ (and thus the error there must be precisely zero). Such an approach approximates $f(x)$ around $P_1$: to be more concrete, on some $[P_1 - \delta, P_1 + \delta]$. So whenever $$x \in [P_1 - \delta, P_1 + \delta]$$ there exists $\epsilon \gt 0$ such that: $$|L(x) - f(x)| \lt \epsilon$$
4) Now my question: $[P_1 - \delta, P_1 + \delta]$ actually ships two points, which makes me come back to the initial point: there is a secant line, crossing two points belonging for original $f(x)$.