Basically, I have this really annoying little fucker in my life who everytime he spots me interacting with people, says this. I’ve interacted with him very few times, so he basically doesn’t even know me.
While I am a little introverted, no one likes this bs.
Just tell them to leave you alone…
If they don’t, then be blunter about it and say it in front of whoever you’re talking to. Make it abundantly clear that you just don’t want to talk to that specific person.