The 25-year-old was a second-half substitute on Saturday as the Hammers slipped to a 3-1 defeat at home to his former club Newcastle, with Yohan Cabaye on target twice for the Magpies.
Carroll, who has only recently returned to the side after being sidelined since the start of the season with a foot injury, missed a good opportunity to bring West Ham back into the game.
He still harbours hopes of making a late charge into Roy Hodgson's England squad for this summer's World Cup in Brazil, but team-mate Matt Taylor said everyone connected to his club and country should see how things progress.
"Having Andy back is a huge lift. He's a huge player for us and a huge presence in the squad. You can see that on the pitch as well," Taylor said.
"It's great for him to be back in the fold and hopefully in the next couple of games he'll be raring to go again.
"He's our record signing and is very good at occupying two or three players at a time when the ball is played to him.
"He'll be disappointed that he missed that chance, but it wasn't an easy one.
"He's been beating himself up in the changing room about it, but it wasn't as easy as people are making out.
"He hasn't played football for a long time and we need to remember that. The next one will come in and hopefully he'll put it away."