The club originally joined the South Tyne Senior League and were runners-up in their first season, but the league was disbanded forcing the club to join a new league; the Division One of the Tyneside Amateur League for the 1988–89 season.

They won the league's Challenge Shield in 1990–91, and after finishing as runners-up in 1990–91, and the club moved up to Division Two of the Wearside League. In their first season in Division Two the club were runners-up, missing out on the title on goal difference, and was subsequently promoted to Division One.

After finishing as runners-up in Division One in 1995–96 the club was promoted to Division Two of the Northern League as champions as Jarrow Roofing continued to have tremendous success.

Jarrow Roofing's first season in Division Two of the Northern League saw them finish third, earning a second successive promotion to Division One. In 2004–05 they reached the semi-finals of the FA Vase (the competition they face the Eagles in this weekend), eventually losing 2–0 on aggregate to Didcot Town. The club finished bottom of Division One in 2007–08, resulting in relegation to Division One.

However, a third-place finish in Division Two in 2009–10 saw them promoted back to Division One, but the clubs time in Division One was short lived when Jarrow Roofing was unfortunately relegated again at the end of the 2011–12 season.

In 2013–14 the club won the league's Ernest Armstrong Memorial Cup, with a third-place finish in Division Two also securing promotion back to Division One where it plays its trade to this day.