The players were criticised for not scoring more in Friday's 3-0 win over minnows the Faroe Islands but Tuesday's opponents are expected to be less defensive, something which should suit Klose.
He has scored five goals in four victories against their neighbours and is now just four short of Gerd Muller's national record of 68.
Klose did not score against the Faroes and he is keen to move on, telling reporters: "During a game like that, there is a switch in your head which you press many times, without success.
"Against Austria we will have more room but we will have to show our best football to get by down there."
After Friday's win coach Joachim Low called on his players to be more clinical in front of goal and he expects them to get more of a chance in Vienna.
"This is another game against another backdrop," he said.
"There won't be 10 players standing around the penalty area as against the Faroe Islands.
"What I have seen of Austria is that they play far more structured than two years ago.
"They have players with self-esteem, who regularly play in the Bundesliga and other leagues and among the driving forces are (Stuttgart's) Martin Harnik and (Werder Bremen's) Marko Arnautovic."
There are nine players in the Austria squad who play in the Bundesliga, with Harnik having been born in Hamburg.
He scored 17 goals for Stuttgart last season but knows many things will have to go in Austria's favour in order to beat Germany.
"There is no secret formula. We have to have a very good day and they have a somewhat poorer one," he told Kurier.
"The Germans are beatable but it is by no means easy."
Coach Marcel Koller has been in charge for almost a year and his methods appear to be bringing the best out of the squad and they are unbeaten in their last four friendlies.
"We have a good core together and now also in quality in depth," added Harnik.
"I believe that the individual players have performed very well and that we now have a coach who brings together the strengths."