In a frantic opening Larkhall took the lead when their debutant Sam Boulton headed home unmarked from a corner.
Straight from the restart Blaine Waugh burst down the right to set up Jack Watts to equalise.
Shortly afterwards a cross from the left was met by George Box sliding in at the far post but the shot went just wide before Waugh blazed a long range effort well over.
Larkhall retook the lead just after the quarter hour mark when Cleeve debutant under-hit his back-pass to Lewis Clayton allowing Shea Bennington-Mannings to latch on and round the stranded Clayton for an easy finish.
Cleeve equalised in the 37th minute when Box saw a couple of efforts blocked with the second rebounding to Jeremiah who blasted in from the far post to make up for his earlier error.
Both sides had chances to take the lead before half time with Owen Taylor seeing his effort for the visitors well saved before Box saw his header go just over the bar.
Larkhall nearly re-took the lead early in the second half but a free kick in a dangerous position was headed wide before Kia Newman and Sam Blackie both saw shots well saved.
Box again was close to converting from a cross across the box but was unable to connect.
Just after the hour mark Cleeve took the lead for the first time with Jeremiah taking aim from outside the box and his shot, with the aid of a heavy deflection, nestled into the bottom corner.
Larkhall nearly equalised straight away with Max Williams put through one om one but Clayton did well in goal to deny him.
Cleeve then managed to control the match although Larkhall still looked dangerous on the counter but the Mitres sealed the win with the best goal of the game as a Joe Selman cross was flicked over the ‘keeper’s head on the turn by Watts.