Cromer Town were founded in 1884 as Cromer F.C. playing their home matches at Beef Meadow in Cromer, until 1921. They moved in 1922 when a trust was set up in memory of the people of Cromer who gave their lives in World War I. This trust was a piece of land known as Cabbell Park, to be used by the people of Cromer for the purpose of playing football and other sports.

During its early years Cromer enjoyed considerable success, indeed in its first year they were losing finalists in the Norfolk Junior Cup, a trophy they went on to win in 1903. They were then elected into the Norfolk & Suffolk League. In 1908/09 Cromer won the Sterry Cup (League championship) for the first time. A number of successes were to follow in the Norfolk Senior Cup, lifting the trophy in 1913, 1914 and 1921. In the early years Cromer competed in the FA Cup and in the 1911/12 season they reached the fourth qualifying round, only to lose by the odd goal.

In the 1960s the Anglian Combination Football League was created, a merger between the Norfolk & Suffolk League and the East Anglian League. Since the merger Cromer have played in the Combination with a fair degree of success.

In the late 1990s, MADRA United (previously Overstrand) were looking for a new home and Cromer F.C. were finding things a little difficult, so MADRA moved to Cabbell Park, originally under the name of Cromer United until it was changed back to Cromer Town in 2002.

In the past five years the first team had tremendous success under the management of Terry Beane. The side won the Sterry Cup on two occasions (2003/04 and 2005/06) and in the other three seasons they were runners up. In the same time the Mummery Cup was also won twice (2002/03 and 2005/06) and the Don Frost Cup also twice (2003 and 2004). In the Norfolk Senior Cup they were beaten at the quarter final stage in these five years. Following the double winning success in 2005/06 Terry Beane resigned as manager, in Oct 2006, and Chris Wigger took control.

For many years the reserves were represented in Reserve Division Two/Division Five of the Anglian Combination, but following a fantastic 2004/05 season they were promoted to Division Four. In this league winning campaign they were unbeaten in all their league games and only lost two games all season. One of the defeats came at Carrow Road in the Norfolk Junior Cup final against second division Dersingham (lost 5-1). Any other recent successes have come in the Cromer Lifeboat Cup.

The 2007/08 season saw the first eleven finish runners up in the league, the reserves also came second in their league (Division Four) thus securing promotion to Division Three. In their first season in Division Three they finished in a very respectable third place. Ahead of the 2008/09 campaign Cromer Town introduced an Under 18 side to the club which will compete, midweek, in the Ridgeons Youth League.

Season 2010/11 saw the five year wait for a trophy come to an end when the Crabs romped to the Sterry Cup title, finishing 14 points clear and winning the league with several games left. In the second half of the season saw manager Chris Wigger add former Norwich City player Cedric Anselin to the coaching staff. The reserves, under the management of John Coates and assisted by Nick Nelson saw a lot of under 18 players take their place in the side on a Saturday as the club looked to progress the younger players through the club. They had a good run in the C. S. Morley Cup but were unfortunately defeated in the quarter finals. Some excellent results towards the end of the season saw them comfortably avoid relegation and finish mid table. The Under 18’s continued to improve and despite finishing second bottom performances were not always warranting of that position.
Season 2011/2012 was approached with eager anticipation for the club, manager Chris Wigger had assembled another excellent squad of players, and eventually in the last game of the season they successfully retained the Sterry Cup, a feat not achieved by many clubs over the years. The reserves also had a wonderful season as the younger players found their feet, just missing out on promotion to Division 2, eventually finishing in 3rd place.