The Toffees lost 2-1 to Chelsea at Wembley almost three years ago but the disappointment of that reverse is still felt by Neville.
Hopes of another shot at winning the trophy they last lifted in 1995 have been raised in recent weeks with Everton due to play Blackpool in the fifth round at Goodison Park on Saturday.
And the memory of being a losing finalist is what spurs on Neville towards securing a Wembley return.
"Wembley is not a place for losers, it is a place for winners," said the 35-year-old, who won the FA Cup three times with Manchester United but played in only two finals - both at the old Twin Towers.
"There is no worse a feeling than losing a game at Wembley so that still rankles with me.
"That is motivation and hopefully I can go back to Wembley - let's hope it is this year.
"It is my favourite competition out of them all and if you get to the fifth round you are nearly at that stage of getting to Wembley for the semi-finals.
"The carrot is there for us, we just have to take the chance."
Surprisingly for two clubs with such long histories Everton and Blackpool have never met in the FA Cup, and their two matches in the Premier League before the Seasiders' relegation last season were their first encounters since a two-legged League Cup clash in 1981.
Blackpool have not beaten the Toffees since 1966, in the old first division, but Neville will take nothing for granted.
"I watched them against Sheffield Wednesday in the replay (of the last round) and they looked every bit as good as they did in the Premier League," the former England international told FATV.
"And it looks like they have got over the hangover of their relegation and it wouldn't surprise me if they bounced straight back up.
"We are the team expected to win but they will come and attack us."
Neville believes the FA Cup has been something of a catalyst for the team as since their third round tie in early January their fortunes appear to have changed for the better.
"When we got drawn against Tamworth we weren't playing well at the time and to be honest it scared the living daylights out of me," he added.
"I thought 'banana skin'. FA Cup third round and we had been beaten Shrewsbury and Oldham in the past.
"I thought 'Please not this time, not to a non-league team'. We got though that but didn't play particularly well and Tamworth gave us a really good game.
"In the next round I was pleased we got a home draw against a Premier League side so at least it wasn't David versus Goliath.
"Fulham took the lead but that game (which they won 2-1) was the turning point in our season because it gave us the confidence and belief because we had not been playing well at home.
"We started to show a few signs of getting back to form that night."