Trust your feelings of discomfort. You know what feels right and what feels off. If something feels off, don't lean towards it anymore. Don't make an announcement about it unless it's something that engulfs your life and you're sure you need out. If it's a friendship or casual relationship, just gradually distance yourself. As humans, we are perceptive beings, we know when a relationship isn't uplifting. Quite frankly, life is much too short to exhaust energy on cumbersome vibes. Do keep in mind that you are deserving of surrounding yourself with positively genuine energy. Use your best judgement and diplomatically distance yourself from unfavorable vibes.
