For trivial action, the relationship between $H^2(G, N)$ and the abelianization of $G$ is given by the universal coefficient theorem, which says that there is a split exact sequence
$$0 \to \text{Ext}^1(H_1(G), N) \to H^2(G, N) \to \text{Hom}(H_2(G), N) \to 0.$$
Here $H_1(G)$ is the abelianization. $H_2(G)$ is a group called the Schur multiplier, which can be computed using Hopf's formula, and it is generally nontrivial, so it's possible for the second term to be nontrivial even if the first term vanishes.
Explicitly, take $G = A_5$. Since the abelianization of this group is trivial, the first term vanishes, and we have
$$H^2(A_5, N) \cong \text{Hom}(H_2(A_5), N).$$
Now we need to know $H_2(A_5)$. Fortunately this was computed by our ancestors long ago: it turns out to be $\mathbb{Z}_2$. So if we take $N = \mathbb{Z}_2$ we get a nontrivial cohomology group.
If you're familiar with the relationship between $H^2(G, N)$ and central extensions of $G$ by $N$, you can also exhibit a nontrivial element of $H^2(A_5, \mathbb{Z}_2)$ by exhibiting a nontrivial $\mathbb{Z}_2$ central extension of $A_5$. There is a unique such extension called the binary icosahedral group $\widetilde{A}_5$, and it's the universal central extension of $A_5$.
Not getting group cohomology is a typical experience, I think. I expect that for many people it's a long sequence of unmotivated definitions and computations. The real meaning behind the subject is in homotopy theory and higher category theory but this requires time, experience, and the right background to appreciate.