By Cayley's theorem every abstract group is isomorphic to some permutation group. Since the permutation group viewpoint has the advantage of considering the actions of the group on different sets, and therefore, of finding structure not just in the underlying set of the group, but in the behaviour of its elements, why do we not always consider the permutation representations of a group?
In other words, is there an advantage to looking at "groups" proper rather than groups of permutations? Is the answer different for finite and infinite groups?
(Edit) In the comments, it was pointed out that the details introduced by considering a particular permutation/linear representation may be a hinderance when, for example, the focus is on combinatorial properties of groups given as their group presentation. What are other examples of situations in group theory when the abstract view of the group is preferred?