The most southerly geographical features of various types are listed here.
Islands
Berkner Island is further South than any of these, but doesn't reach sea level and is fully ice covered and may be considered an under-sea mountain.
References
List of southernmost items Wikipedia(Text) CC BY-SA