I need to rewatch the episode, but I also felt like his recognition of him went deeper than “oh yeah, you’re that guy we saw in the street before with Mae”. Same thing with Yord. I could be way off here, but I felt like both of them had some kind of actual history with him. And maybe they didn’t realize it until he was up close and personal, because he was much older / different.