Back in school, I had a group of friends solely out of fear for being alone. Sophomore year, I realized I didn't like them, and cut ties. That was when I started really fucking up.
Personally, I got some kind of weird, sad happiness if somebody took pity on me in that sense. Made me feel wanted, excited, hopeful, etc. And then I realized, "Waitaminute, I do not like these folks at all, we have nothing in common, they bore me (maybe I bore them), this won't be worth the effort of talking to people at all" and came up with a reason to leave their company. These little encounters with ordinary people usually lasted only a day or two, and completely ended Junior year, when I sort of stopped going. Eventually, everyone realized that I've no cares in the world and just want to take it easy.
It just takes time.