The French defender played an important part in Tuesday night's 1-0 victory against West Brom, where Jermain Defoe helped close the gap on second-place Manchester United to three points.
The victory was Spurs' sixth in seven Barclays Premier League matches at White Hart Lane, where goals have been hard to come of late.
The north Londoners have only managed to score once in each of their past three games, which Kaboul believes heightens the need for defensive solidity.
"Last year we lost or drew these kind of games, which is why we finished fifth at the end of the season rather than fourth or third, so this season we don't want to make the same mistakes," Kaboul said.
"I suppose we are a massive team in England now.
"We're playing against high-quality teams who can play football, but when they come here they just drop back, they just defend.
"We have to be patient and pass the ball properly and find solutions. I know it's very hard but that's the situation and the most important thing is to win.
"In these games you have to be patient and you have to score - that's it - and you cannot concede a goal, which is what happened to Manchester City at Sunderland.
"When you attack you have to defend well too, and that's what we did against West Brom.
"It's a good result for us, we just have to keep this run going. It wasn't the best game ever but you have to win those matches, take three points and look forward to the next one.
"That's the only way we will achieve something at the end of the season."
To do that Tottenham will be hoping injuries to William Gallas and Sandro are not as bad as first thought.
The pair went off on Tuesday night with suspected calf tears and the club are awaiting news on the severity of the damage.
Tuesday night's opponents have injury problems of their own, which were compounded when Jerome Thomas limped off in north London.
West Brom put up a valiant fight against Spurs and came close to grabbing an equaliser on several occasions during the closing stages, leaving midfielder George Thorne pleased by the performance, if not the result.
"The players definitely feel hard done by," he said. "We did the same at Manchester City.
"When you're pushing title contenders right to the limit and they are winning by one goal, not creating many clear-cut chances, you're definitely going to feel a little bit hard done by.
"We definitely felt we could have got a point. We had a few chances at the end but, as I said, to do that against title contenders and a team as good as Tottenham you can only take positives from it."
Thorne put in an assured performance at White Hart Lane on what was his full Barclays Premier League debut.
The 18-year-old did not look out of place against Spurs and earned praise from manager Roy Hodgson after the game.
"It is always nice to hear positive comments from your manager," Thorne said when told of the comments.
"It is a case that all us youngsters have to be on our toes with the injuries at the moment.
"I'll be ready again if he needs me. I have been playing with these players in day in, day out for a long time now so I know the level I need to be at.
"It was my first start so there was obviously a bit of nerves and anxiousness, naturally. After a couple of touches I felt that I was getting into my stride and into the game."