Levan Kobiashvili gave Jos Luhukay's men the lead in the fifth minute before Arthur Boka levelled on the stroke of half-time.
Sandro Wagner clinched a 2-1 victory for the capital club in the 87th minute before picking up a red card, the only blot on the day for Hertha in Baden-Wurttemberg.
The visitors took the lead when captain Kobiashvili beat Sven Ulreich after Adrian Ramos had touched Marcel Ndjeng's cross on to him, with the Stuttgart defence all at sea.
For a side who had lost all five games they had played in 2014, conceding their quickest goal in a game all season only added to their insecurity.
Rani Khedira's mistake nearly let in Hertha for a second as the home fans transmitted their fears and frustration to the players.
Stuttgart responded well, though, with Daniel Schwaab's shot cleared away by Peter Pekarik.
And the hosts found an equaliser on the stroke of half time when Boka unleashed a powerful shot from outside the area and the ball flew past goalkeeper Thomas Kraft in a flash.
The game opened up in the second half and Stuttgart had Gotoku Sakai to thank for clearing the danger as Hertha broke with four men against two.
Another break was curtailed by Boka as Hertha showed more confidence in the search for a winner.
Stuttgart seemed happy enough to take a point and end their losing streak that way, but that risky tactic backfired when, with three minutes to go, Wagner headed Tolga Cigerci's free-kick into the right-hand corner to silent the Mercedes-Benz Arena.
Wagner was shown a second yellow card as the game went into stoppage time, but there was no time for Stuttgart to respond as they slumped to another defeat.