The orientation of an orbit is uniquely defined (bar the 180 degree ambiguity between prograde and retrograde orbits) by the orientation of the angular momentum vector. A random distribution means there is an equal chance of the angular momentum vector pointing to any unit area on a sphere.
The area on the surface of a sphere that is swept out by a circular strip at inclination $i$ and opening angle $di$ is $2\pi \sin i \ di$. The angle $i$ can be thought of as an orbital inclination angle if it is defined as measured down from the "pole" towards the "equator" or reference plane. Since randomly oriented orbits will have angular momentum vectors that populate the surface area of a sphere uniformly, then
$$P(i)\ di \propto \sin i\ di\ .$$
The mean (absolute) value of $i$ is then straightforwardly given by
$$\bar{i} =\frac{\int i\sin i\ di}{\int \sin i\ di}\, $$
where the integrals are performed from $0$ to $\pi/2$ (for prograde orbits). This yields
$$\bar{i} = \left[\sin i- \theta\cos i\right]^{\pi/2}_{0} = 1\ .$$
i.e. The average inclination angle is 1 radian or 57 degrees.
Obviously you could equivalently define an "inclination" in terms of the angle of the angle between the orbital plane (the plane with which the angular momentum vector is perpendicular) and the reference plane, in which case the mean "inclination" is 33 degrees.
Edit: Other interesting factoids - the median inclination is 60 degrees (see Connor's answer); the mean $\sin i$ is $\pi/4$ (corresponding to an angle of 51.8 degrees), while both the mean and median $\cos i$ are 0.5, corresponding to an angle of 60 degrees because $P(\cos i)$ is uniform for randomly oriented orbits.