The club was formed in the late 60's when the Cost Office Cavaliers played in a tournament in the Isle of Man. They became Furness Cavaliers, joined the Barrow Sunday League and by the mid 70's were very successful.