Caffrey is a surname. Notable people with the surname include:
Andrew Augustine Caffrey, United States federal judge
Bob Caffrey (born 1962), American baseball player
Colm Caffrey, Irish radio broadcaster
David Caffrey, Irish film director
Ernie Caffrey (born 1936), Irish politician
James J. Caffrey, American Securities and Exchange Committee chairman
Joe Caffrey, English actor
John Caffrey (1891–1953), Irish recipient of the Victoria Cross
John Caffrey, Gaelic footballer
Mary Caffrey Low (1850–1926), women's education advocate
Neal Caffrey (born 1977), White Collar television show character
Paul Caffrey, Gaelic football manager
Peter Caffrey (1949–2008), Irish actor
Sean Caffrey (1940–2013), Northern Irish actor
Stephen Caffrey (born 1975), Irish footballer
Stephen Caffrey (born 1959), American actor
Thomas Caffrey (1917–2010), Irish chocolatier