Boger played quarterback at Morehouse College in Atlanta, Georgia as a four-year starter and graduated in 1977. Realizing that he did not have the football skills to make it on a professional level, he decided to get into officiating, allowing him to stay close to the game. He started working high school and recreational league games before moving up to small colleges. He spent 11 years in the Southern Intercollegiate Athletic Conference and five seasons in the Mid-Eastern Athletic Conference from 1996 to 2000.
Boger has a son, Tra Boger, signed with the Green Bay Packers in the 2006 offseason, but was subsequently released. He currently plays defensive back in the Canadian Football League.
Boger resides in Conyers, Georgia. Outside of officiating, he worked as an underwriter for Allstate Insurance in Atlanta.
Boger has also served as a referee in Conference USA, Arena Football League, and NFL Europe (where he officiated in World Bowl XIV).
Boger was promoted to referee in 2006.
Boger served as referee for a game between the Dallas Cowboys and Tennessee Titans during the 2006 season. In the third quarter of the game, Titans' defensive lineman Albert Haynesworth was ejected for stomping on the head of Cowboys offensive lineman Andre Gurode. Haynesworth received a five-game suspension as a result of the incident, the longest suspension for an on-field incident in NFL history.
Boger also served as referee in 2006 in a Monday Night game where the Chicago Bears defeated the Arizona Cardinals in one of the greatest comebacks in league history.
During a 2011 game between the Cincinnati Bengals and St. Louis Rams, Boger was announcing a holding penalty against Rams' offensive tackle Harvey Dahl, when his open microphone picked up Dahl proclaiming "That's not fucking holding!" The obscenity was not only broadcast to the crowd at the Edward Jones Dome, but to the television audience watching on CBS as well. Dahl was penalized for unsportsmanlike conduct for his profane rant.
Boger was chosen to be the referee of Super Bowl XLVII, held at the Mercedes-Benz Superdome in New Orleans on February 3, 2013, only the second African-American to do so behind Mike Carey five years earlier. This caused several other NFL officials to question the leagues' officiating department's grading process, claiming that all of Boger's downgrades during the season were reversed. He was also the alternate referee of Super Bowl XLV, which was held on February 6, 2011 in Arlington, Texas.
Boger's 2017 NFL officiating crew consists of umpire Rich Hall, down judge Ed Camp, line judge Mike Carr, field judge Eugene Hall, side judge Walt Coleman IV (son of active NFL referee Walt Coleman), and back judge Tony Steratore.