What are the reasons that cryptography-related constructions -- such as featured in excellent explainers on elliptic curves on RareSkills and Practical Cryptography for Developers, and all the explainers on zero-knowledge proofs that I've found -- treat finite fields of size $p$ where $p$ is a prime, rather than the more general case of a non-prime finite field of size $p^n$, where $p$ is a prime and $n\geq 1$ is any number?
(Every finite field has order $p^n$ for some prime $p$ and $n\geq 1$ as per a nice argument on https://math.stackexchange.com/a/3067156/449733)
I understand that a prime finite field may be simple and sufficient, but non-prime finite fields seem not even to be considered or mentioned as a possibility, at least on the resources I've seen.
Are there practical reasons that ECC or zero-knowledge constructions should avoid these?
Thank you.