Pacquiao underwent surgery to his injured right shoulder on May 6, an injury which he suffered in early April and one that is believed to have severely hampered him during his loss against Floyd Mayweather Jr.
According to philboxing.com, Arum was annoyed calling Pacquiao "totally irresponsible".
"Manny promised me he was leaving for the U.S. this weekend (July 18) which he's not," Arum said.
"He went through a serious operation. He's a professional athlete. I don't know what to say. To me it's totally irresponsible," he added.
The boxing promoter, who has handled the Filipino’s fights for over a decade, added that unless Pacquiao has a medical and is cleared to fight he will not negotiate further fights.
Pacquiao is expected to be in the ring again in 2016 if his shoulder is 100 percent healed.