According to Rudin's principles of mathematical analysis 2.24 (a):
If a set $A$ and $B$ are open sets then $A /cup B$ is open. Therefore we have 4 possible scenarios letting $A=E$ and $B=E'$ where $E'$ is the set of limit points of $E$:
1.) $E$ and $E'$ are closed. Therefore $\overline{E}=E$ by theorem 2.27 (a)
2.) $E$ is closed and $E'$ is open.
3.) $E$ is open and $E'$ is closed (okay since $E'$ is closed.
4.) $E$ and $E'$ are open. Which is a contradiction of theorem 2.24 (a).
In the case of 2.) by definition, if $E$ is closed, then every limit point of $E$ is in $E$. That is, $E' \subset E$. Since every point of $E'$ is in $E$ (a closed set) then $E'$ must be closed. (Unsure about whether this is sufficient)
This is my attempt so far to prove that $E'$ is closed using axioms. If there is something I am missing or anything that needs to be modified I would appreciate it.
EDIT: using theorem 2.27 (b) if $E$ is closed then $E = \overline{E}$. Thus for 2.) if we take the set of limit points of the equality, we obtain $E' = (\overline{E})'$ then I must show that $E'= (E \cup E')' = \overline{E'}$.