Harry Redknapp's Spurs will feel slightly aggrieved not to have gone back to the capital with at least a point, but the manager will take heart from the performances of his frontline, in particular Modric and the sublime Aaron Lennon.
They, along with David Bentley and Roman Pavlyuchenko, gave the lately solid Newcastle backline a good workout in the first half.
However, it was defender Dawson who almost came closest to opening the scoring when his looping header had to be pushed over by Given.
Winner came at perfect time - Kinnear
For the last 11 years, Newcastle have been used to having their Irish keeper bailing them out of trouble so when his pinpoint punt led to N'Zogbia's goal, it most certainly was one for the famous football scrapbook.
N'Zogbia still had to use his nous and strength to fend off the challenge of Benoit Assou-Ekotto then find the composure to slot the ball past the Spurs stopper.
The Magpies found their stride after the goal but there was one weak link in the team on the day - Ameobi.
The striker, who replaced the injured Obafemi Martins in the starting line-up, had already given the ball away on a handful of occasions before, what happened to be his final act, he was easily dispossessed by Dawson.
The defender's clearance ended up falling to the feet of Modric, who appeared to stay onside and in acres of space before running in on goal and firing past Given.
Ameobi was substituted for Viduka straight after the restart.
Spurs undone by 'sucker punch'- Redknapp
Kinnear's battlers survived until half-time with Given made to punch down Pavlyuchenko's firm 20-yard drive.
The second half of the match did not come to the boil until the last 20 minutes.
First Michael Owen blazed over for Newcastle from eight yards and at the other end substitute Frazier Campbell, who came on for Pavlyuchenko, just failed to connect with Lennon's cracking ball across the six-yard area.
Both teams were pressing for the win, but it with less than a minute remaining it was Newcastle who had the last cheer.
Duff, who had just been on for a few minutes, pounced on a loose clearance before finding Viduka on the edge of the area.
The Australian played the ball back to his team-mate with a sweet flick who in turn converted the ball past Gomes with one touch.
This page is best viewed in an up-to-date web browser with style sheets (CSS) enabled. While you will be able to view the content of this page in your current browser, you will not be able to get the full visual experience. Please consider upgrading your browser software or enabling style sheets (CSS) if you are able to do so.