I know that there are certain rules that allow to introduce new symbols to a language, which can be found here: https://en.wikipedia.org/wiki/Extension_by_definitions or How could we formalize the introduction of new notation?. Now, reading this gives the impression that there are strict rules for introducing new notation. However, in books and papers that are written in other areas than logic, I think that notation is rather introduced "arbitrarily" rather than following these rules. I wonder, why this is "ok" to do, despite violating these "strict" rules.
Before encountering these articles, I thought that one is free in introducing new notation in the sense that one can pick any symbol to denote any object without respecting any rules whatsoever. Hence, given two sets $X,Y$ and a function $f:X \to Y$, as well as $x \in X$, I could, if I want, denote the object $f(x)$ as $a$, $\phi, \lambda^42131290$ or whatever, really. Another example could be: Suppose the natural number setting, then the peano axioms ensure that there exists an element, which will be denoted $0$. Also for all $n \in \mathbf{N}$ there exists an object $s(n) \in \mathbf{N}$. We denote $s(0)$ as $1$, but could technically also call it $2$, $a$, $+$ or whatever, really. Also $s(n)$ could just be called $k$ by suppressing the dependency on $n$, I suppose. Why are those not allowed?
In set theory, one also chooses notation in brackets $\{...\}$. Technically speaking, one should be able to choose anything, really, shouldn't one? Again, why is this restriced? I am aware that this notation is well established, but it is technically not necessary to choose exactly this notation, is it?
My questions can be summarized as: $(1)$ Can I call objects whatever I like?
$(2)$ Why are there restrictions to notation in formal logic and why can they be violated in (other areas) of maths?
$(3)$ Why are the rules chosen the way they are? I suppose they are this way to prevent mistakes. What can "go wrong" if one violates these?
$(4)$ In some stackexchange question that I can't find anymore, I have read that $:=$ is not a symbol that is allowed in logic. Why is that? One only renames objects, what can possibly go wrong?
Note: I already tried to touch on those points on another post I made, however the answers did not really mention answers to those questions, which is why I made this a question on its own.