The U.S. state of Mississippi's at-large congressional district existed from December 10, 1817, when it was admitted to the Union until 1847, when representatives were elected in districts.
Mississippi briefly elected an at-large representative from 1853-1855, in addition to having the rest of the delegation elected from districts.
References
Mississippi's at-large congressional district Wikipedia(Text) CC BY-SA