Part of the problem, lies in the way you were exposed to addition, subtraction, multiplication and division.
When you were first taught to add, you were told that you can add integers:
$$1+1 = 2$$
Then, you were told that you could subtract integers:
$$2-1=1$$
You were told to think of subtraction as 'the opposite of addition'. You were then introduced to this fancy concept of negative numbers, and told that
$$2 + (-1) = 1$$
But I bet they never told you why this works. The reason why this works, is because $-1$ is the additive inverse of $1$. Simply put, $1 + (-1) = 0$. (Of course, we then have to define the additive identity, but since they never did that either ....)
Next, you were told that you could multiply integers:
$$2 \times 2 = 4$$
You were also told to think of multiplication as repeated addition. I'm sure you've drawn pictures of 4 groups of 5 objects and counted, to show that $4 \times 5 = 20$. Next, you were told that you could divide integers:
$ 4 \div 2 = 2$
You were told to think of division as 'the opposite of multiplication'. That since $ 2 \times 2 = 4$, hence $4 \div 2 = 2$.
You were most probably warned (with more than a slap on the wrist I hope) to never 'divide by 0'. I bet they never told you why not. The reason why, is because $0$ has no multiplicative inverse. There is no number $x$, that allows us to say $ 0 \times x = 1$. If there was, then we can say that $ a \div 0 = a \times x$, and evaluate that.
What else did they not tell you? Probably a whole lot. For example, what is $ \sqrt{2} \times \pi$ through repeated addition? How am I supposed to draw those sets out and count? Also, fractions are defined by division. Why does that mean that we can add and subtract fractions? What is a real number, and why must it exist? I know what $1.4 = \frac {7}{5}$ is, but what is $\sqrt{2}$?
Furthermore, we can actually divide by 0 in special situations. For example, when we attach $\infty$ to the real line, we could say that $\frac {1}{0} = \infty$. However, that does come with its own set of problems, and you must learn addition and subtraction all over again. For example, what is $\infty - \infty$? It could be anything.