I think we all know we shouldn't stare in their eyes r they will attack - how true this is I do not know, maybe it's just true of the big cat family.
Thats why quite often a cat will go towards the people who dont like them!!! They avoid eye contact with the cat, so they see them as less of a threat.
I try and slow blink at mine all the time.
Evie does nothing, Dexter slow blinks back, and Denzel will too, then often come over for cuddles