Born in Camden, London, Wordsworth is a product of the Colchester United youth system, and was handed a professional contract at the end of the 2006–07 season. He made his senior when appearing as a substitute in a League Cup defeat at Shrewsbury Town on 14 August 2007. His league debut came seven months later as a late substitute in a 1–1 home draw against Cardiff. He made his first senior start three days later in a home defeat by Hull.
Wordsworth signed a three-year contract extension in August 2008 after finishing as top-scorer during pre-season and a recent run in the first team. Wordsworth scored his first goal for the club in a 4–3 away defeat to Cheltenham Town on 11 October 2008, and his second goal doubled United's lead to make the score 2–0. He scored his third goal of the season in a 3–3 away draw against local rivals Southend United on 1 November 2008. Colchester manager Paul Lambert praised Wordsworth's goal saying it was a "terrific header, terrific cross in the first place".
A free-kick specialist, Wordsworth put Colchester ahead in a 2–1 defeat away to Millwall on 31 October 2009 when he scored from a free-kick. He scored a header against Brighton in a 2–1 win on 11 December 2009 to take Colchester third in League One. Wordsworth again scored against Essex rivals Southend in a 2–1 away win, scoring the winner when he curled in a 20-yard free kick on 26 December 2009, before scoring again three days later at home to Southampton in a 2–1 win. He scored a double against Southend United on 8 February 2010 in a 2–0 home victory to ensure he had scored in the last three meetings between the two sides and he scored four days later in a 2–2 away draw with Stockport County. He scored in a 3–3 home draw with Brentford on 23 March 2010. Wordsworth scored another double in a comprehensive 3–0 win over Swindon Town on 10 April 2010. He scored a goal from 18-yards in a 1–1 draw against Tranmere Rovers on 24 April 2010. Wordsworth finished with 11 league goals for the 2009–10 season, even with Colchester winning just once in the final 13 games of the season.
Wordsworth opened his 2010–11 season with two goals in a 2–2 opening day away draw with Exeter City, with goals in the 10th and 11th minute, the second a free-kick. He then scored in a 3–1 home win over Tranmere on 25 September 2010. He scored on New Years Day 2011 in a 3–3 home draw against Charlton Athletic. This was to be his last goal of the season. Wordsworth signed a new two-and-a-half-year deal with the club, having scored five goals in 18 appearances in the 2010–11 season and reaching double goalscoring figures in the previous season.
Wordsworth scored the first goal of the 2011–12 League One season with a goal from inside the six-yard box in the 11th minute of a 4–2 away win over Preston on the opening day of the season. He scored twice as Colchester trounced Oldham 4–1 for their first home win of the season on 27 August 2011. Wordsworth scored from close range in a 1–1 home draw with Leyton Orient on 10 September 2011. Three days later, Wordsworth scored an injury-time free-kick against Brentford for ten-man Colchester in another 1–1 draw. He then scored a winning penalty against Walsall in a 1–0 victory on 24 September 2011. He scored another free-kick against Notts County in a 4–2 win on 29 October 2011. He again scored the only goal in an away win over Hartlepool United on 17 December 2011 and then scored a goal in Colchester's 2–0 win over Exeter on 31 December. He scored a late header to rescue one point against Oldham in a 1–1 away draw on 28 February 2012 and scored a 5th minute curling effort against table-topping Charlton in a 2–0 win one week later. He fired in a long range shot in a 3–1 away defeat to Walsall on 27 March 2012. In the final game of the 2011–12 season, Wordsworth scored a 90th minute consolation goal from 18-yards to bring his goal tally for the season to 13 against Notts County in a 4–1 loss.
Wordsworth scored his first goal of the 2012–13 campaign with an 87th minute equalising penalty against Crawley Town on 18 September to lift Colchester from the bottom of the League One table. Captaining the team, he scored his second goal of the campaign in a 2–0 away defeat of Leyton Orient on 23 October, drilling home a Gavin Massey pass. His third came as the opening goal in a 2–0 victory against Bury on 17 November 2012.
Wordsworth joined Ipswich Town on 30 January 2013 for £100,000 on a two-and-a-half-year deal, with the option of an additional year. On his full debut for the club, Wordsworth cracked three vertebrae in a collision with Blackpool goalkeeper Matt Gilks and was forced to spend the weekend in hospital. He scored his first goal for the club in the defeat to Hull on 13 April 2013, his first game back after that injury. He was released by the club at the end of the 2014–15 season.
On 22 August 2014, Wordsworth completed a season-long loan move to Rotherham.
In July 2015 Wordsworth signed a two-year contract at Southend United. In his first campaign, Wordsworth struggled with injuries and made just 23 appearances in all competitions, scoring four goals in the process. After an operation at the end of the 2015/16 season, he came back just after the start of the 2016/17 campaign and enjoyed a fine run of form, scoring on both of his first two starts after six months on the sidelines.As of match played 16 September 2017