This might be a terribly simple question, but I cannot convince myself whether the answer is yes or no. Maybe I am missing something simple. I am not well-versed in the area of elementary set theory so excuse the simplicity of the question. Note within a world where $\mathsf{GCH}$ is true we clearly have a yes; but with $\mathsf{GCH}$ false the answer is no longer obvious to me.
Exclude the triviality of finite sets. If $|X|<|Y|$ then $|X|<|Y\setminus X|$ so say $|X|=\kappa$, then $|Y|=\kappa+\lambda$ with $\kappa<\lambda$. But then proving $2^{\kappa}<2^{\lambda}$ is equivalent to the initial problem.
Am I being silly or is it consistent with $\mathsf{ZFC}$ that this implication is false?