The Belgium defender fired his first league goal for Spurs following his £12million move from Ajax when he showed composure to sweep a free-kick from Kyle Walker past Gerhard Tremmel.
It was the reward Tottenham deserved after controlling a disappointing encounter at White Hart Lane that failed to match expectations.
West Brom failed to join Spurs on 29 points after being held to a dire goalless draw by West Ham at The Hawthorns.
The Baggies twice came close to snatching the win but Scotland midfielder James Morrison was denied by the woodwork on each occasion.
Meanwhile on Saturday, Manchester United maintained their six-point lead at the top of the Barclays Premier League with a 3-1 win over Sunderland at Old Trafford.
United had seen their advantage at the summit cut after champions Manchester City won by the same scoreline at Newcastle in the lunchtime kick-off.
But Sir Alex Ferguson's side produced a convincing response with Robin van Persie and Tom Cleverley netting inside the opening 20 minutes.
Van Persie then brilliantly set up Wayne Rooney on the hour to seal a fifth consecutive league win. Substitute Fraizer Campbell grabbed a consolation for the Black Cats on 72 minutes.
City had earlier bounced back to winning ways after last weekend's derby defeat.
Sergio Aguero and Javi Garcia netted before half-time and, while Demba Ba continued his scoring streak after 51 minutes, Yaya Toure made the points safe for the visitors late on.
QPR hauled themselves off the foot of the table with a belated first win of the season - 2-1 over Fulham.
Adel Taarabt's quickfire double in the second half finally secured victory after 17 games and lifted Harry Redknapp's side above Reading, who host Arsenal on Monday night.
Mladen Petric pulled a goal back two minutes from time but it served only to make QPR sweat for a win that the home fans celebrated at the final whistle.
Aston Villa produced the shock of the day as they thumped Liverpool 3-1 at Anfield.
Christian Benteke struck twice, either side of an Andreas Weimann goal, to inflict a first home loss on the Reds in six.
Steven Gerrard curled in a late goal but by then a majority of the home fans had left.
Kenwyne Jones scored his first league goal in more than a year as Stoke battled back to draw 1-1 at home to Everton.
Ryan Shawcross gifted the Toffees a first-half lead when he headed over his own goalkeeper but Jones levelled when he outjumped Phil Jagielka to head in on 52 minutes.
In-form Everton midfielder Marouane Fellaini could find himself in hot water after he appeared to headbutt Shawcross during the second half, with referee Mark Halsey missing the incident.
Wes Hoolahan marked his new Norwich contract with the match-winner in a 2-1 success over Wigan.
The Canaries announced just before kick-off that Hoolahan had penned a new deal until 2015 and the Republic of Ireland midfielder took centre stage.
He robbed a defender to set up Anthony Pilkington's opener and, after Shaun Maloney equalised, Hoolahan secured a third successive league win in the 64th minute.
Saturday's Premier League Results
Newcastle 1-3 Man City
Liverpool 1-3 Aston Villa
Man United 3-1 Sunderland
Norwich 2-1 Wigan
QPR 2-1 Fulham
Stoke 1-1 Everton
Sunday's Premier League Fixtures
Tottenham 2-1 Swansea
West Brom 0-0 West Ham
Monday's Premier League Fixtures
Reading vs Arsenal