If we go back to the definition of function inverses, we recall that for a function $f(x)$, we say that $f^{-1}(x)$ is the inverse of $f(x)$ iff $f^{-1}(f(x)) = x$.
So if we consider the function:
$$\operatorname{plus 5}(x) = x + 5$$
then it is obvious that it has an inverse:
$$\operatorname{minus 5}(x) = x - 5$$
Hopefully, it is obvious that: $\operatorname{minus 5}(\operatorname{plus 5}(x)) = x$.
If we now consider the function:
$$\operatorname{5th power}(x) = 5^x$$
I hope you agree that it has exactly one inverse, namely:
$$\log5(x) = \log_5 x$$
and that: $\log5(\operatorname{5th power}(x)) = x$.
On the other hand, if we consider the function:
$$\operatorname{5th power}(x) = x^5$$
then it, too, has a single inverse; namely:
$$\operatorname{5th root}(x) = x^{1/5}$$
and that: $\operatorname{5th root}(\operatorname{5th power}(x)) = x$.
Now, if you wish to consider both parameters at the same time, we can talk about:
$$\operatorname{plus}(x, y) = x + y$$
but this function doesn't have an inverse, because it must be injective. That is, $\operatorname{plus}(2, 4) = 6$ and $\operatorname{plus}(1, 5) = 6$, so what is $\operatorname{plus}^{-1}(6)$?
So saying that "subtraction is the inverse of addition" is a bit sloppy, as you can see. To even speak of inverses, you have to formulate addition and subtraction in a manner that makes them invertible. The same is true of exponentiation. And once you do this, it becomes clear that there is only one inverse for exponentiation, which is the logarithm. The inverse for raising a value to a fixed power is to again raise it to another fixed power.
More importantly, while the expression "$x^5$" contains an exponent and can be considered an example of "exponentiation", we don't actually call this an exponential function. We call it a "polynomial". That's why recovering $x$ from a polynomial doesn't require a special new function. Whereas, when $x$ is in the exponent, you do have a bona fide "exponential function", and you require a logarithm to recover $x$.