DEfinately do not shut them out unless they have access back into the house some other way.
Just a word of warning that was passed to me by CP when I got my cats, if you have double glazed windows that are the push open type on a hinge that open from top to bottom rather than from the side, be very careful cos cats have been seriously hurt using these windows as access points cos they can slam shut and are often very heavy.