" Do you feel like attachments lead to feelings of expectations or do you expect things from people that you get attached to? "
This part of your question seems to nail the answer, at least for me. I have trouble getting close to people because I am afraid that they will require me to commit myself to their emotional agenda, when I would rather not do that. I would gladly be a friend to the person, but sometimes people do not accept a friend who will not give a show of emotion in support of them, even if that friend would show support in deeds and opinions. I shy away from obviously emotionally needy people, because their affect and demeanor give me the feeling that they wish to cause me emotional turmoil or upset me by involving me in emotional tangles that I feel can be solved logically (but which they need some sort of emotional catharsis to get through.) It is a fundamental difference in approach to personal problems and quandaries.
Personally I don't expect things from people I have acquaintance with. If I have a real attachment (family, marriage, vows of solidarity, etc.), then I understand I have made a commitment and am attached by my own actions and words. It is the people who take a casual friendship to be a license to wrest deep secrets or push a person to do something that the person feels uncomfortable doing that I try to avoid. I try to do this without being obvious to the person, since that might be construed as insulting.
One example is an outgoing, social person might say hello by embracing me and getting really close to me, not knowing that I am the opposite of the touchy-feely type and I value my personal space. The person doesn't know better, but it makes me uncomfortable and more likely to steer clear at the next meeting. It isn't "pushing them away" I guess, but more "social weeding by outward signs." This happens at all levels of a friendship; it is a rare person who can be told that something he or she does makes me uncomfortable without becoming defensive.