But he played down talks of a revenge factor ahead of the NFL clash on Sunday.
"I mean, listen, I've been waiting for the moment to go back there," Brees said on Thursday.
"I'm trying to make this just like any other game. It's hard to do that, obviously, because it's meaningful.
"I'm not gonna sit here and tell you that this one may not mean a little bit more. But my preparation remains the same."
Brees felt the contract offered to him by the Chargers 10 years ago was not respectable.
"I realised that, they expect me to come back and be a backup. And that's not who I am. I'm going to go be a starting quarterback and win a championship somewhere. And if it's not there, it's not there," Brees said about his mindset.
"And it probably didn't set in until I signed with the Saints, and it was, 'All right, this is happening.' I didn't think it would happen, but it's happening. And move on."
The Chargers had just drafted Philip Rivers, and Brees knew what was happening.
His shoulder injury made the team cautious, and it made the Miami Dolphins cautious in free agency. That is why Brees signed with the Saints, and it has been a perfect match.
"Everything happens for a reason. I belong here," Brees said about New Orleans. "Listen, [the Chargers have] had a lot of success too. So I think that everything has happened the way it's supposed to happen."