Here's a proof, which is really an expansion of my comment above.
Let $A=\langle a\rangle$ be a cyclic group of order $n$, with $n$ odd. Let $K=\operatorname{Aut}(A)$, and consider the holomorph $G=A\rtimes K$. Because $n$ is odd, $Z(G)$ is trivial: because the inversion map is in $K$, we see that $C_G(a)=A$, and no element of $A$ is central. Also, since $K$ is abelian, we see $A=[G,G]$.
Now let $\phi$ be an automorphism of $G$. Then $\phi(A)=A$, and so there exists $k\in K$ such that $\phi(a)=a^k$. Now $H=\phi(K)$ is a self-centralizing subgroup of $G$ that is a complement to $A$. Because it's a complement, for every $g\in K$, there's a unique element of the form $a^?g\in H$. In particular, consider $\iota\in K$, the inversion map. If $a^r\iota\in H$, then setting $m=-r(n+1)/2$, it is easy to check that $\iota\in a^mHa^{-m}$. By looking at $[\iota,ga^s]$, we see that $C_G(\iota)=K$, and so $a^mHa^{-m}=K$. Thus $\phi$ acts on $G$ exactly like conjugation by $ka^m$, so $\phi$ is inner. Combined with the triviality of $Z(G)$, we see $G$ is complete.
Edit: I might have glossed over one too many details in the end above. Let $\psi\in\operatorname{Aut}(G)$ be conjugation by $ka^m$, and let $\alpha=\phi\psi^{-1}$. Then we've shown $\alpha$ fixes $A$ pointwise, and $K$ setwise. But then for any $g\in K$, we have
\begin{align}
a^g &= \alpha(a^g)\\
&= a^{\alpha(g)}
\end{align}
and thus $g$ and $\alpha(g)$ are two automorphisms of $A$ with the same action, meaning $\alpha(g)=g$. Thus $\alpha$ fixes $K$ pointwise, and since $G=AK$, $\alpha$ is the identity map.
`for i in [1..100] do
G:=CyclicGroup(2*i+1); H:=Holomorph(G); K:=AutomorphismGroup(H); if IsIsomorphic(PermutationGroup(K),H) then; else print i; end if; end for;`
– AnalysisStudent0414 Jul 26 '18 at 13:55