Reports on Tuesday suggested that the Serbia defender had no intention of quitting west London following comments to the media by Vlado Borozan.
However, Ivanovic insists that Borozan does not represent him in any capacity.
The 28-year-old refused to rule out a move away from Chelsea, but insists any discussions regarding his future will take place in private and after he returns from holiday.
"I've seen in the press that an agent called Vlada Borozan has been saying things on my behalf, I would just like to put on record that he is not my agent and does not have the right to tell the press anything on my behalf," Ivanovic told Sky Sports in a statement.
"With regards to speculation about my future, we will see what happens. But whatever happens, it will be between myself, Chelsea and my actual representatives.
"As it stands today, I am a proud Chelsea player.
"I have four years remaining on my contract, have just won the Champions League, just captained my country on international duty, and am now ready for a holiday with my family to recharge my batteries and get ready for next season."
Meanwhile, Yossi Benayoun suggested a decision about his own Chelsea future was imminent.
The Israel midfielder, who spent almost all of last season on loan at Arsenal, posted on Twitter: "I hope I will have some news about my future soon."