The match against Everton was originally scheduled to be played on the first day of the season but was postponed due to rioting in London.
Back then, Spurs had no clue that they will be in the title chase halfway through the season but the fixture is key now for them to go level on points with Manchester United in the table.
The importance is not lost on Kaboul, who insists that his side cannot afford to drop points at this stage.
He told reporters: "The Everton game next Wednesday is massively important for us.
"That should have been the first game of the season for us and we only play it now. We need to take the three points again. We have no choice."
"We have taken more confidence," the centre-back continued, "We are a massive team in England now so we have to assume that and play as well as we can every week."
With the match being played in the middle of the hectic festive schedule, Kaboul admits that the players do feel the fatigue creeping in.
"Of course, the regulars get a bit tired," added the 25-year-old, "This period of the season is cruel.
"Every team gets tired, that is normal. We are human. We need to rest properly, eat properly and do the best we can off the pitch to be in perfect form for the games."
Spurs host Cheltenham Town in the FA Cup on Saturday before their rearranged clash with Everton on Wednesday. They will then play Wolves on Saturday in the Premier League.