Here is how you can answer a question like this in general, though I have not worked out the computation in this particular case. A polynomial is divisible by $a^2-6$ iff it vanishes when you plug in $a=\pm\sqrt{6}$. So your question really is: if $a=\pm\sqrt{6}$, does the coefficient of $x^{6n+4}$ in $f(x)=\frac{1-x^2}{1-ax+2x^2}$ vanish for each $n$?
To answer this, let's answer a much more general question. Suppose you have a power series $f(x)=\sum c_n x^n$ (convergent in some neighborhood of $x=0$) and you want to know whether all the coeffients $c_n$ vanish when $n\equiv k$ mod $m$, for some fixed $k$ and $m$. Let us write $f_j(x)=\sum c_{mn+j}x^{mn+j}$ for $j=0,1,\dots,m-1$; we want to know whether $f_k(x)$ is identically $0$. To answer this, let $\zeta$ be a primitive $m$th root of $1$, and consider the functions $g_j(x)=f(\zeta^jx)$, for $j=0,1,\dots,m-1$. Note that $g_j(x)=\sum_{\ell=0}^{m-1} \zeta^{j\ell} f_\ell(x)$. I claim that $mf_k(x)=\sum_{j=0}^{m-1}\zeta^{-kj}g_j(x)$. Indeed, we have $$\sum_{j=0}^{m-1}\zeta^{-kj}g_j(x)=\sum_j\sum_\ell \zeta^{-kj}\zeta^{j\ell}f_\ell(x)=\sum_\ell \left(\sum_{j=0}^{m-1} (\zeta^{\ell-k})^j\right) f_\ell(x).$$
Now $\zeta^{\ell-k}$ is an $m$th root of $1$, so the sum $\sum_{j=0}^{m-1} (\zeta^{\ell-k})^j$ vanishes unless $\zeta^{\ell-k}=1$, i.e. unless $\ell=k$, in which case the sum is $m$. So we get $\sum_{j=0}^{m-1}\zeta^{-kj}g_j(x)=mf_k(x)$.
Thus we can conclude that $f_k(x)=0$ iff $\sum_{j=0}^{m-1}\zeta^{-kj}g_j(x)=\sum_{j=0}^{m-1}\zeta^{-kj}f(\zeta^jx)=0$. This sum is one we can (in principle) compute directly from a formula for $f$. For instance, in your case, with $m=6$, $k=4$, and $f(x)=\frac{1-x^2}{1-ax+2x^2}$, you get the following sum:
$$\frac{1-x^2}{1-ax+2x^2}+\zeta^2\frac{1-\zeta^2x^2}{1-a\zeta x+2\zeta^2x^2}+\zeta^4\frac{1-\zeta^4x^2}{1-a\zeta^2x+2\zeta^4x^2}+\frac{1-x^2}{1+ax+2x^2}+\zeta^2\frac{1-\zeta^2x^2}{1-a\zeta^4x+2\zeta^2x^2}+\zeta^4\frac{1-\zeta^4x^2}{1-a\zeta^5x+2\zeta^4x^2}.$$
Here $\zeta$ is a primitive $6$th root of $1$. While this is long and nasty, in principle it shouldn't be too hard to expand it all out and see if it vanishes identically if $a=\pm\sqrt{6}$.