The Sri Lanka national cricket team toured Zimbabwe in April and May 2004 to play 2 Test matches and 5 Limited Overs Internationals. The next time Zimbabwe played Sri Lanka in a Test match was in October 2016.
Test series summary
References
Sri Lankan cricket team in Zimbabwe in 2004 Wikipedia(Text) CC BY-SA