A group is $p$-closed if it has only one Sylow $p$-subgroup.
Theorem: Let $G$ be a group of order 24 that is not 3-closed. Then either $G\cong S_4$ or $G/Z(G)\cong A_4$.
Proof. $G$ acts on $$ \Omega:=\operatorname{Syl}_3 G$$ by conjugation. Since $G$ is not 3-closed Sylow's Theorem gives $|\Omega|=4$. Thus, there exists a homomorphism $\varphi:G\to S_4$ such that $$\operatorname{Ker}\varphi =\bigcap_{S\in\Omega} N_G(S)=: N.$$ $G/N$ is a subgroup of $S_4$ and $|N|$ a divisor of $\frac{24}{4}=6$. If $|N|\in\{3,6\}$, then $N$ and thus also $G$ is 3-closed, a contradiction. The case $N=1$ yields $G\cong S_4$, and the case $|N|=2$ implies $N=Z(G)$ and $G/N\cong A_4$. $\square$
I don't understand the case $|N|=2$. Obviously $Z(G)\leq N_G(S)$ for every $S\in Syl_3 G$ and so $Z(G)\leq N$. Is it that $Z(G)=2$? And why is $G/N$ isomorphic to $A_4$? This seems even more difficult to prove!