We had a cat who went blind and deaf through old age (she was 22 when pts), and we had other cats. She didn't bother them and they stayed away from her. If they got too close she would dab them, but then she was always a feisty lady.
I guess she had always lived with our other cats so a bit different to this boy. You could always call the rescue and see what they think I am sure they will be able to tell you if it is a good idea or not. At least then you can stop thinking about him.
Good luck, I know with me some cats I am drawn to and in the end I usually end up with them.