The Nailers climbed off the bottom of the Evo-Stik League First Division South courtesy of Tuesday night's 3-0 victory over Lincoln United.
Duffield believes his side are in a false position – they have drawn six of their nine league fixtures so far – and wants to see his players recreate the kind of form that took them to the brink of the play-offs last term.
"We set out to win every game but the amount of draws we've had has been ridiculous," he said.
"I think we are in a false position but we are where we are because of the goals we've conceded and the chances we haven't taken.
"It doesn't really matter what happens in between."
Belper will travel to Chasetown tomorrow with renewed confidence and belief following the Lincoln result.
"We looked like we'd lost a bit of confidence in last Saturday's 1-1 draw with Carlton but Tuesday night was much better," said Duffield.
"We hit the woodwork twice in the first half, which makes it eight times in four games.
"We looked edgy but we kept going and got our rewards in the end but after we scored the first goal, you could see some of the confidence coming back.
"There were more players playing to their maximum than there have been for a while.
"It's hard to do that when things aren't going for you. I know because I've been in that position myself.
"Against Lincoln, we played some good football and the players were very brave. I'm delighted for them, because they have worked extremely hard and they deserved what they got.
"The main message now is that we need to kick on from here and make it a really positive end to the week. We can't sit back and think we are over that hill. We need to do the same again.
"I'm hoping that everybody believes that what we are saying to them is the right thing to do."
Two new strikers have come in – Shaun Tuton from Matlock Town and Canadian front man Jared Stephens from Sheffield FC – while Ashley Longstaff has left the club after a falling out with the manager.
"To be fair, Ashley has done well for us, especially last season but hasn't quite struck the same form this time and things eventually came to a head," said Duffield.
"I'm not going into details but, as a result, he has left the club for disciplinary reasons."
Tuton and Mark Ward led the line in midweek, with Stephens and Andrew Siribour coming off the bench.
"All four forwards who featured on Tuesday were different class," said Duffield.
"If they match that work rate and desire, they won't be far away.
"Shaun Tuton (pictured) was a breath of fresh air. If he keeps that up, the goals will come."
This is Derbyshire