Let $Q$ and $N$ be two groups. If there are two homomorphisms $\alpha,\beta : Q \rightarrow \operatorname{Aut}(N)$ then we can construct the semidirect products $G_a = N \rtimes_{\alpha} Q $ and $G_b = N \rtimes_{\beta} Q $.
I'm interested to know for which $\alpha$ and $\beta$ these two groups are isomorphic.
We can assume that both groups have the same underlying set $K = N \times Q$. Let $\psi$ be an automorphism in $\operatorname{Aut}(N)$, and let's write $n^{\psi}$ for $\psi(n)$ where $n \in N$. Let's extend $\psi$ to the whole of $K$ by $\psi(n,q) = (n^{\psi},q)$.
Note that in both groups we can write $n$ for $(n,1)$ and $q$ for $(1,q)$. We will see what it gives when we express the product $qn$ in both groups.
Let us denote by $\circ_a$ and $\circ_b$ the group operations in $G_a$ and $G_b$ respectively. In $G_a$ we have $q \circ_a n = (1,q) \circ_a (n,1) = (n^{\alpha(q)},q)$, by definition of semidirect product.
For $\psi$ to be a homomorphism we have to have $\psi(q \circ_a n ) = q \circ_b \psi(n)$. This equation reduces to $\psi(n^{\alpha(q)}) = n^{\psi \beta(q)}$ or $n^{\alpha(q)} = n^{\psi \beta(q) \psi {-1}}$.
We can conclude that if $\exists \psi \in \operatorname{Aut}(N)$ such that $\alpha(q) = \psi \beta(q) \psi^{-1} \forall q \in Q$ then the two semidirect products are isomorphic.
This does not mean that if $\alpha(q)$ and $\beta(q)$ belong to different automorphism classes they give rise to non isomorphic semidirect products. Examples of this are given here, where cases are given where $\alpha(q)$ is trivial and $\beta(h)$ is not and here where similar and additional conditions are discussed (without proof) for finite groups.