The 26-year-old former WBO world light-heavyweight champion has suffered a back injury which has ruled him out of a fight against Ammann for the vacant Commonwealth cruiserweight title.
Cleverly lost his light-heavyweight title in Cardiff back in August and had originally planned to step up to cruiserweight before the turn of the year.
But those plans have now been shelved after Cleverly suffered a back injury, although he does expect to be back in the ring early in 2014.
"It is a bitter blow as training had been going so well and I was looking forward to making my debut at cruiserweight," he said.
"For it to only happen a week before the fight is even more devastating. I just want to get this year out of the way and enter 2014 with a clean slate and get my career back on track."
Cleverly's withdrawal will also come as a blow to promoter Frank Warren as he looks to build successful cards at the Copper Box Arena following his exclusivity deal with the 2012 Olympic venue.
Dereck Chisora will still headline the show as he prepares to take on Ondrej Pala of the Czech Republic after his previous two opponents withdrew from the bout.