Championship club Sheffield Wednesday provided the shock of the day as they thrashed Arsenal 3-0 in the fourth round of the League Cup.
Ross Wallace opened the scoring for the hosts before Lucas Joao doubled their advantage five minutes before half time.
Sam Hutchison provided the finishing touch to a superb performance from Wednesday in the 51st minute to cap a disappointing evening for the Premier Division side.
Loic Remy scored in the 91st minute to keep Chelsea in their clash with Stoke and force extra time, and eventually penalties, after Jonathan Walters opened the scoring for the Potters.
However, it was all for nothing after Eden Hazard had his penalty saved by Jack Butland to send the Blues crashing out of the League Cup and continue their terrible start to the season.
Everton needed penalties to go through against Norwich after Sebastien Bassong's 51st minute opener for the Canaries was cancelled out by Leon Osman's equaliser in the 68th minute.
Wes Hoolahan and Nathan Redmond missed spot kicks for Norwich to hand Everton a hard-fought win.
The final match of the evening also went the distance as neither Hull City or Leicester City were able to score for the first 90 minutes.
Riyad Mahrez scored the opening goal for the Foxes in the 100th minute but Abel Hernández equalised for Hull less than five minutes later to force the game to penalties.
Mahrez missed the opening spot kick of the shootout and it proved to be decisive after all the other takers netted to hand the Tigers a 5-4 win and complete a day of surprises.