A section of Udinese supporters booed Francesco Guidolin's side during Sunday's 1-1 home draw against Atalanta.
Udinese have won just one of their last five games at the Stadio Friuli and supporters are disenchanted with their team's season so far.
Pozzo believes certain fans have unrealistic expectations of their team.
"The draw against Atalanta is a good result for us considering the team didn't play well and Atalanta defended deeply," Pozzo told Udinese Channel. "If we play at home the fans boo the team and they are harsh.
"In order to make those fans happy we would need a team that is fighting for the scudetto.
"But we cannot forget that we are provincial side and that the fans' support is crucial.
"The fans should be our 12th man.
"I don't like the fact that these fans are not helping the team.
"I have heard boos that are undeserving."
Udinese are 12th in the standings, eight points clear of the drop zone, and travel to Sardinia to face Cagliari next.