The Scots endured a dreadful start to the qualifying campaign, which saw them struggle to win a game, as their hopes of booking a place at Brazil next summer were quickly dashed.
However, results and performances have picked up under Gordon Strachan and a first group win in Croatia in June, couple with an impressive friendly display against England at Wembley last month, has boosted the feel-good factor.
Hutton wants to keep the momentum going and show the Tartan Army they can be optimistic about the future of the national team.
The right-back said: "Belgium will be expected to come here and win but if they were to look at our performances recently, they know they will get a tough test.
"It's a massive game for us. We just want to prove to everybody that we can go and compete with the big teams, like we have done in the last two games.
"We want to prove to everybody that we are a good team and that we can go on and build from this.
"We've got a lot of young players in the squad and we will be looking to the future and knitting together as a team.
"I think there are a lot of positives towards the back end of the campaign that we can take out of it. We want to move forward as a team and build for the future."
Hutton is also keen to make amends for the last meeting between the two nations - a 2-0 defeat in Brussels last October.
He said: "There is a lot of excitement and we have been working very hard all week.
"We didn't have the best game against them the last time and we want to put that right this time.
"The last two performances have been really up there. Throughout the campaign, it has been tough for us.
"A new manager has come in, we have worked hard, and it seems to have paid off in the last two games.
"There are a lot of positives we can take going into the home game against Belgium."
Hutton had loan spells at Nottingham Forest and Real Mallorca last term and has not featured for Aston Villa this season.
But, having played the full 90 minutes at Wembley last month, he insists he is ready to be pitched in against the Belgians.
He said: "I've been keeping myself fit and I've been working hard.
"I've been doing the double sessions and working rally hard. If called upon, I'm fit and ready to play."
With 33 caps, Hutton is one of the more experienced campaigners but has no fears about lack of experience elsewhere in the squad.
He said: "A lot of the other boys might not have played as many games but they have been in and around the squad so they know what to expect and what to do if called on to play.
"It's come around fast that I'm one of the ones who has been the most capped. It's kind of strange - it's gone by in the blink of an eye.
"But I think the rest of the boys are all ready."