The Scot quit the Norfolk club to take over at Aston Villa last summer after taking the Canaries from League One to the Barclays Premier League in just two seasons.
He returned to Norwich for the third time on Saturday and maintained his record of winning there with Villa as Libor Kozak scored the only goal of a 1-0 victory on Saturday.
Lambert had to endure jeers from a large section of the home supporters for much of the game but said afterwards that they would treat him differently if he told them the full story behind his fallout with the Norwich hierarchy.
"It's difficult because they don't know the full story," the 44-year-old said when asked how he felt about being booed.
"It's best leaving it at that. I can understand their frustration. Some of them would've wanted me to go anyway so that makes no difference. Certain things happened.
"I had three great years here. It doesn't seem like that. That's just the way it's happened. That's the way a lot of people will portray it. I know what happened and that's football.
"You pick yourself up and you go again. My job is for Aston Villa. The Aston Villa fans are brilliant with me. They have been since I arrived.
"My job is to try to make this club as successful as I can."
Lambert's replacement in the Carrow Road dugout was Chris Hughton and the current Norwich boss was not immune from the vocal home support, with his decision to substitute Nathan Redmond being met with jeering and unrest at the final whistle.
But Hughton, who has seen his side score just once in their last four league matches, received support from Lambert.
"I've got my own job to get on with but Chris has done a fabulous job here," he added.
"No matter what way you look at it he's done a great job. You never like hearing people boo managers. It's a difficult job and he's a really nice guy."
Things could have gone differently for the home side if Robert Snodgrass had converted a sixth-minute penalty which was well saved by Brad Guzan.
The Villa goalkeeper was instrumental in keeping Norwich at bay and securing his side's first clean sheet since December 8 and, even though the United States international said he was not interested in how many clean sheets he collects, he could not recall the last one.
When asked if he knew when Villa had last successfully shut out a Premier League opponent he said: "To be honest with you probably not.
"Last year obviously was a battle for us and the most important thing was staying up. I'm not going to lie to you and say it's not nice to keep a clean sheet but that's not the most important thing.
"The most important thing is we get three points and win the game. In terms of that putting in a good performance is also important. When you do those things, put a good performance in and everyone's together good things happen.
"Today we were able to keep a clean sheet and most importantly get three points."