I talked to a couple of other autistic people I know, and while each person had their individual reasons for not liking it, it all seemed to come under the umbrella of a direct look being considered an intimacy that one didn't share with just anyone. It will be interesting to see if that holds true as I speak with others.