With just two wins all season, and lying 14 points adrift of safety in the Bundesliga, the Bavarians have already accepted their fate of immediate relegation to the second tier.
However, Kramer, who became the club's third coach of the season when he replaced interim coach Ludwig Preis this week, wants to restore some pride, starting with tomorrow's trip to Werder Bremen.
"After the match, we want to be able to look in the mirror and be able to say that we did all we could," he said.
"We want to present something over these remaining games that the fans, the club and everybody around can identify with.
"The lads have got to give it all they have got. We want to make things uncomfortable for Bremen."
Kramer was appointed with a view to bringing the club back into the top flight next season, which is why the remaining matches are also important for his future planning.
"I want to use every training session we have got to paint a picture of the team," he said at a press conference.
Kramer is without the injured goalkeeper Wolfgang Hesl, who joins Johannes Geis, Zoltan Stieber, Sebastian Tyrala and Djiby Fall on the sidelines.
Bremen coach Thomas Schaaf admits he does not know what to expect from Kramer's Furth side tomorrow.
"Everybody has written them off so now they can play without any pressure," he said.
"We don't know if they are looking for the points or just planning on making a new beginning."
Schaaf has Sebastian Prodl and Sokratis Papastathopoulos back from suspension, but Clemens Fritz is still injured.