For simplicity, let us stick to finite extensions of $\mathbf Q$. To put your question in context, recall the inverse Galois problem : is every finite group $G$ realizable as the Galois group of a normal extension of $\mathbf Q$ ? The most general positive result is the famous theorem of Shafarevitch (1954) : yes if $G$ is solvable. But this result is in the opposite direction w.r.t. your question, because a solvable extension is obtained by "piling up" abelian extensions, in more mathematical terms, in solving successive embedding problems with abelian kernels.
In the direction of your question (no abelian subextension), the most natural approach would be to try to realize non abelian simple groups (the complete list of these is known) as Galois groups over $\mathbf Q$. For example, among the classical families such as $PSL_n (q)$ or $PSU_n (q)$, the realization is possible when $q=p^f$ is small w.r.t. $n$. But for instance the problem remains open for $PSL_2 (5^f)$ if $f>2$, $PSL_2 (3^f)$ if $f>3$, $PSL_3 (3^f)$ if $f>2$, $PSL_4 (2^f)$ if $f>1$. On the other hand, one knows how to realize all the simple sporadic groups except the Mathieu group $M_{23}$.
One larger and deeper approach would be to study the absolute Galois group of $\mathbf Q$ using topological/geometric methods (coverings of the projective line $\mathbf P^1$, Hurwitz spaces, Grothendieck's "dessins d'enfants",...). An accessible account is Pierre Debes' report, "Autour du problème inverse de Galois", Bicentenaire de la naissance d'Evariste Galois, IHP-SMF, October 2011.