Former 'Side winger Aundre Spencer bagged the winner for Enfield in second-half added time, to earn the three points for the visitors.
The result leaves Michael Walther's men in 15th place in the table.
'Side are next in action on Saturday when they face Wadham Lodge away. Kick-off for that match is at 3pm.