Remy's brace at Cardiff City Stadium took his tally to five goals in his last three games and he has made an instant impact since moving to St James' Park from QPR on a season-long loan.
Pardew had attempted to bring in Remy in January, but the France international eventually joined QPR's failed bid to avoid relegation to the Championship.
Rs' boss Harry Redknapp said earlier this week he would be happy to see Remy join the Magpies permanently at the end of the season and does not expect the forward to return to Loftus Road.
His current form may mean Pardew finds he has competition for his signature, but he made his appreciation of the player clear.
"I wish he had joined in January," he said.
"I still remember the night clearly when we thought we had done the deal.
"We had a nice glass of wine, gave ourselves a nice, hearty, warm handshake and the next day he wasn't there.
"But sometimes in life you have to wait. If you wait long enough it comes around.
"We are really pleased to have him, I thought he was excellent. Not just his two goals, but his work-rate and everything he did was competent.
"He is a player on our books and we are pleased to have him, but at the moment he is a QPR player.
"It was interesting to read Harry Redknapp's comments that he probably won't be going back, but we will have to see."
For his part, Remy insists he is not thinking about whether he will remain with the club beyond the end of his loan, but admitted he had appreciated Newcastle reviving their interest in him during the summer.
"For the moment the question is not in my head," he said.
"We have time and I will go game by game. It is a good question but right now I am not focused on that.
"I don't regret not joining in January. I decided to join QPR in January, but it was a choice (to join Newcastle) after QPR went down.
"I was happy to see Newcastle come back to me so now it is down to me to do the best I can for the club because they came back for me."
Cardiff's defeat came in the wake of reports of a dispute between Bluebirds' players and owner Vincent Tan over end-of-season bonus payments.
Manager Malky Mackay confirmed the matter had been resolved, although he did not state whether Tan has been banned from the dressing room on match days as a result.
The issue put Mackay in an unenviable position, but the Scot claims he played no part in solving the disagreement.
"They (the players) deal with the football club and the chief executive (Simon Lim). That's something that can't really come under my brief.
"It did not have an effect on our performance. It's certainly not an excuse our guys are giving."