The Canaries were just five minutes away from recording a famous victory over the high-flying Gunners courtesy of a close-range header from Michael Turner, before a controversial penalty handed the hosts a lifeline, which they seized with two further goals to turn the match on its head.
The defeat leaves Chris Hughton's men still looking anxiously over their shoulders, only four points above the drop-zone and in need of probably another two wins to make sure of another crack at the top-flight again next season.
However, with key games coming up against Reading and then at Stoke before the visit of Aston Villa and former manager Paul Lambert, there is still enough time to put things beyond doubt.
Norway international Tettey said: "What can you say? We are really shocked with the decisions from the referees, but we just have to take it and move on.
"We were passing the ball and we had great control. They didn't create anything before Podolski hit the bar. Otherwise we had the energy to hold on to the 1-0.
"We just have to take the disappointment with us and turn it into something positive, at home against Reading.
"There is no getting one point or losing in that game. We need three points - that is a massive game for us."
Norwich had beaten Arsenal at Carrow Road back in October, which kick-started an undefeated run of 10 matches.
However, wins have proved hard to come by in 2013 with just one, albeit also picking up seven draws.
Hughton, however, remains confident his squad - which next season is set to include Dutch forward Ricky van Wolfswinkel, signed in an £8million deal from cash-strapped Sporting Lisbon - have what it takes to get over the line.
"It is how we respond and I am absolutely certain that we will get a good response," said Hughton, charged with keeping the Norfolk club in the top flight when taking over from Lambert in the summer.
"The margins are so small and we have found it difficult, but we have been in most games.
"We went 10 games unbeaten. Are we playing dramatically different to then? No.
"We find it a bit more difficult to score goals now, but we have five games left and we need to make sure that we get the good things out of the games and get the points we need.
"I have always thought we need 40 points because there are teams around us very capable of winning games."