I'm aware of no such risk. A SWR of 3:1 on 7MHz is just as bad as a VSWR of 3:1 on 144MHz. There are other things that change with frequency that might contribute to this misconception, however:
VHF radios typically do not operate at such high power as HF radios. Ultimately, high SWR damages the radio when the final stage is made to operate outside its voltage or current limits. A bigger transmitter means more power to make higher voltages and currents when SWR is high.
Also, low frequency antennas have a narrower bandwidth. If we take a simple antenna such as a dipole and scale it up in every dimension to decrease the frequency, the fractional bandwidth remains the same, but since the center frequency is lower, the bandwidth, in terms of the difference between upper and lower frequencies with an acceptable SWR, is less. Thus on low bands it's harder to keep a low SWR across the band.