It's easy to show that if the divisor has a modular multiplicative inverse under m then dividing by it would be possible. I'd simply multiply both sides of the antecedent below by $b$ and let $x=yb$ be the witness.
$$there\:is\:a\:unique\:y\:such\: that\: ay=1\:\left(mod\:m\right)\rightarrow there\:is\:a\:unique\:x\:such\: that\: ax=b\:\left(mod\:m\right) where\:b\in \left\{0,1,\:...,\:m-1\right\} $$However, it doesn't seem as easy when I try to go the other way. Any suggestions?