The theory behind PCA involves variance as an important concept. That's not necessarily true for other methods. Note that different methods also have different "figures of merit" for the quality of the outcome. There are many different methods, and you might want to (a) understand what outcomes and quality-metrics are associated with the methods of interest, and (b) develop familiarity with how other people have used and interpreted these quality-metrics. I've made some big mistakes by not understanding properly the interpretive conventions about certain metrics (e.g., stress in multi-dimensional scaling). The community has more wisdom than any one of us - use the community (and contribute back to the community)!