The Whites found themselves behind at half-time in an evenly contested game.
The Whites continued to show that they have got "something about them" as they never lost belief and produced another top display to overcome their hosts.
Jack Wilkinson got both goals, the first in the 58th minute and the winner followed in the 65th.
The lads were missing Callum Foster who had been called into the First Team.
Management Daz Dye and Darren Stamp must be very proud so far for what the lads are producing.
Team line up v Horncastle Town
1 Oliie Sinclair
2 Ollie Bean
3 Carl Newbury
4 Clayton Wilkinson
5 Josh Barkle captain
6 Josh Toynbee
7 Andy Jansen
8 Callum Chapman
9 Jack Wilkinson
10 Marlon Grundy
11 Kane Hutchison-Wilkes
subs
14 Ewan Clay
15 Joe Silson
16 Charlie Scales
17 Christoff Pissi