The scrotal ligament is actually the remnant of gubernaculum in a fetus. This ligament secures the testis to the most inferior portion of the scrotum, tethering it in place and limiting the degree to which the testis can move within the scrotum.
References
Scrotal ligament Wikipedia(Text) CC BY-SA