Unfortunately, the two definitions are not equivalent if the groups are infinite. Specifically, the first definition is the standard definition of normalizer, and the second definition is "wrong".
As Matthew details in his answer, the second condition gives us $hA\subseteq Ah$. Furthermore, we know that the function $Ah \rightarrow hA$ defined by conjugation by $h$ is injective, and thus its image has the same cardinality as the domain. From the above two facts we can conclude that $hA$ and $Ah$ have the same cardinality.
If $A$ is finite that indeed implies that $hA=Ah$ since one is contained in the other and they have the same finite cardinality.
If $A$ is infinite, however, the above argument breaks down. Indeed, as shown here, it is possible that $hA\subsetneq Ah$. Moreover, as shown here, the second condition does not even necessarily define a group!