Rossi, who is currently out with a knee injury, has been recently linked with a move to a club with better prospects with his agent Pastorello fuelling speculation last week by stating that a summer transfer may be on the offing.
However, the Italy international denied that he is looking for a move away from the club despite his agent's words, he would not move away from his 'second family' in Villarreal.
Rossi spoke to El Periodico Mediterraneo: "[My agent Federico Pastorello] speaks a great deal and I'm angry with him for those statements, which do not reflect the truth."
"Now we have clarified things and I have told him that at Villarreal I cannot be touched, because for me, this club is like a second family.
"[Leaving] is not something I am thinking about. I understand people read newspapers and believe what is published, but sometimes things are not true and that makes me angry."
Rossi is tied to Villarreal until his contract runs out in 2016.