Some people are frauds of the worst kind. They pretend, use, manipulate those who are emotionally weak. And it’s OK to call them that : frauds.
It’s not a reflection on you, it’s just that they are emotional predators. And it’s important to stay away from such people for your own personal wellbeing. Many people shy away from calling a spade a spade, for whatever reason. They would rather change their behaviour or their thresholds for behavioural integrity, just so that the behaviour of the fraud is justified. This can be one of most self damaging actions one can do.
Sometimes one can’t help it. But what can one do is to completely cut physical contact, no matter how difficult. Out of sight, sometimes is out of mind. For abused people, it becomes more crucial to watch out for such people. Especially, because they are emotionally unstrung and can be easily manipulated.