Veh led the Swabians to the title in 2007, but was dismissed soon after as they were unable to repeat that success.
However, he says he was still doing a better job than any of his successors and laments how the expectations at one of Germany's leading clubs have dropped so dramatically.
"I took Stuttgart into the Champions League and then when we suddenly played in the UEFA Cup, many people were very disappointed, even insulted," he said at a press conference.
"In the past three years, Stuttgart have come 12th twice, and suddenly nobody is disturbed by it. Things have moved on."
That is not the way things should be in Swabia, Veh added, claiming they have a side far superior to his, who find themselves level on points after five matches.
"Stuttgart have a really good squad. They are a team who should be playing in the Europa League," said Veh, whose side picked up an impressive 3-0 win over Bordeaux in the Europa League on Thursday night whereas Stuttgart were knocked out of the competition in the play-off round.
"We in Frankfurt used to be a long way off Stuttgart, but that's no longer the case.
"Yet Stuttgart pay far greater wages, higher than most clubs in the Bundesliga, which is why they really should always be challenging at the top."
New Stuttgart coach Thomas Schneider has turned around their fortunes, though, with two consecutive wins lifting the gloom after a winless start to the season.
"I'm looking forward to meeting Armin again, but on Sunday, he's unfortunately going to have to accept that he goes away with nothing," said Stuttgart captain Christian Gentner.
Schneider has no reason to make changes to his side which have won two games in a row but Veh will gauge the tiredness of his players after Thursday's game before deciding which players to send into action.