Pinkbear, I'm not sure I agree. From what bramble has said, he just sounds a little wary. Personally, I believe only cats who are vicious and absolutely untameable belong as farm cats.
Bramble, you may be stressing too much about this. Just leave him alone, go about your daily business and let him learn that you aren't a threat to him. Approaching him or blowing strange bursting things may actually scare him.
Although he may not see his sister being fussed, he can hear her. Cats have much better senses than us. Sometimes just talking very quietly to yourself or the female cat will help him to calm as he hears your voice but sees no threat (leave him alone while you're chatting to yourself or the other cat). Don't worry, we all do it, and the guys in white coats haven't turned up yet!
Maybe try whispering, either just randomly or reading from a book. Read to the air, not at him. The sound seems to hypnotise them. For ideas check out the whisper vids on youtube.
By the way, what's CH? Is it some kind of cerebral palsy? Poor baby.