In the mid 1960's, football in Rhymney was revived with the formation of High Cross F.C. named after a housing estate at the top end of town, and the club used the Pen-y-Waun Inn as its base. The club joined the West Gwent Football League based in Tredegar, but due to the small number of clubs in the league, they were granted permission to join the Rhymney Valley Football League based in Bargoed so that a full seasons fixtures was available. As the club grew in stature, several good seasons followed, and together with several cup competition successes, laid the foundation for a thriving football team in the town.
As more players joined the club from all areas of the town, and further afield, it was decided in the summer of 1975 to change the name of the club to the name of the town. As a result Rhymney Football Club was born.

Rhymney Football Club continued to play in both West Gwent Football League and Rhymney Valley Football League for two further seasons. With the demise of the West Gwent Football League, Rhymney were given the choice of remaining in the Rhymney Valley League or joining the North Gwent Football League based in Ebbw Vale. In view of the small number of teams in the Rhymney Valley League, Rhymney opted to join the North Gwent Football League to ensure a full seasons programme of games. Rhymney remained an important member of the Premier Division of the North Gwent, until gaining promotion to the Gwent County League. Rhymney's ability to attract local players has resulted in the club adding a second team into the North Gwent League.

Rhymney AFC has gained numerous honours over the years, winning the league title in 2003-2004 and achieving runners up posistion on several occations. Their cup record is envied by many of the other teams in the league, havin reached countless cup finals, and two cup finals in some seasons, with a high success record. The club has been successfull in winning Institute Bowl, Tom Perkins Cup and William Firth Cup trophies, in the Gwent Leagues, in addition to Rhymney Valley Football League trophies. Since the formation of Rhymney's second team they also have had success in reaching their first cup final in season 2004-2005.

Rhymney has also had individual players represent the league in Gwent County F.A. competitions and in one season had six players chosen for the league representative squad.

Over the reccent decades Rhymney AFC has enhanced its reputation as a strong, well established, and respected football club, that prides itself on playing good attractive football, in true sportsmanlike manner.