Several examples of finite loops (quasigroups with left and right identity) of small order with some additional properties can be found here.
Another source showing several examples of finite loops Cayley tables.
A third example of very group-like loop which is not a group, answer to a related Math.SE question.
Again, in the absence of associativity, inverses may be defined in a more general way: this is the case of inverse property loops. The smallest example of such loop which is not a group has order $7$. This latter is, to me, a brilliant example of what may happen if we omit some of the group axioms (associativity, in the case of loops).