To expand a bit on what I said in the comments it seems the closest thing to a Pauli $X$ or $\text{NOT}$ operation for qutrits is the so-called $\text{TShift}$ gate.
This gate has the following action on the computational basis states...
$$
\begin{align}
\text{TShift}|0 \rangle &= |1\rangle \\
\text{TShift}|1 \rangle &= |2\rangle \\
\text{TShift}|2 \rangle &= |0\rangle \\
\end{align}
$$
Recall that the basis states for a qutrit system are defined as the following unit vectors
\begin{equation}
|0\rangle = \begin{pmatrix} 1 \\ 0 \\ 0 \end{pmatrix}\,, \quad |1\rangle = \begin{pmatrix} 0 \\ 1 \\ 0 \end{pmatrix}\,, \quad
|2\rangle = \begin{pmatrix} 0 \\ 0 \\ 1 \end{pmatrix}
\end{equation}
A qutrit is defined as a linear combination of these basis states
\begin{equation}
|\psi\rangle = \alpha |0\rangle + \beta|1\rangle = \gamma |2\rangle\,, \quad |\alpha|^2 +|\beta|^2 + |\gamma|^2 = 1
\end{equation}
You can see from the above that the $(3 \times 3)$ unitary matrix for this operation is the following
$$
\begin{equation}
\text{TShift} =
\begin{pmatrix}
0 & 0 & 1 \\
1 & 0 & 0 \\
0 & 1 & 0
\end{pmatrix}.
\end{equation}
$$
This was new to me as well actually. Hope this helps.