I think I might have a solution to this but since I know very little actual field theory there might be flaws.
It hinges on the following "fact" that I can more or less prove: if $K/k$ is a finite extension and $\sigma$ is an automorphism of $k$, then it extends to an automorphism of $K$. Indeed, suppose $x_1,\dots,x_n$ generate the extension, then define extensions step by step $k\subset k(x_1)\subset\cdots\subset k(x_1,\dots,x_n)=K$ by saying something like the extension $k_i\subset k_i(x_{i+1})=k_{i+1}$ is simple and if $\sigma_i$ is already defined, just extend it by only changing the coefficients in $k_i$ for polynomial expressions in $x_{i+1}$.
this is the step I am not so sure about... If this cannot be done, the following will not suffice.
In any case, if $L$ is a field and $H$ a finite group of field automorphisms then the extension $L/L^H$ is Galois and has $Gal(L/L^H)=H$ and $[L:L^H]=|H|$.
Set $G=Gal(K/F)$ and consider a $2$-Sylow $H$. Then the extension $K/K^H$ is Galois of degree a power of $2$ and Galois group $H$. We would be done were $K^H$ equal to $F$.
Suppose by contradiction $L=K^H/F$ is a proper extension. Then it contains $x=$ the square root of $2$. Thus all automorphisms in $H$ stabilize it. If $\sigma$ is any automorphism in $G$, then it sends $x$ to itself or to its opposite. If the order of $\sigma$ is $2^a(2b+1)$, then $\sigma^{2b+1}$ belongs to some $2$-Sylow subgroup of $G$, and must thus stabilize $x$ (this would need some elaboration, but I believe it works, take some other $2$-Sylow, and by degree considerations it cannot fix only $F$ so it fixes $x$ aswell). Thus ($\sigma^{2b+1}$ and thus) $\sigma$ actually sends $x$ to itself. This means that every automorphism in $G$ stabilizes the square root of $2$, i.e. $x$.
But we have the extension $F\subset F(x)\subset K$ and an automorphism of $F\subset F(x)$ sending $x$ to its opposite $-x$ and by the first paragraph we get at least one element in $G$ that doesn't stabilize $x$ which is a contradiction. So $x\notin K^H$, and $F=K^H$ and we are done showing the extension is Galois.
We then have $G=Gal(K\F)=Gal(K/K^H)=H$ is a $2$-group.
Edit There is a flaw in the proof of the "fact" : if we want to extend an automorphism $\sigma$ of a field $L$ to an automorphism of some simple algebraic extension $L(y)$, we need to send the adjoined element $y$ to a root in $L$ of $Q=P^{\sigma}$ where $P$ is the minimal polynomial of $y$ and $Q$ is $P$ except all coefficients are replaced by their image under $\sigma$...
All we really need to make the previous proof work is to show that there is some automorphism of $K$ in $G$ that sends $x$ to its opposite.