I cannot function properly anymore in the house but if it is not going to work for the cats I dont think I can move. I am so worried for them
I moved to a house in the same road with 6 cats, and I did have one who kept returning to the old house, but he hadnt been with me long (turned up as a stray) before I moved. He did eventually stop going back there. None of the others ever tried to return to the old house though.
Certainly I would keep them in for as long as possible to give them a chance to really feel comfortable in the new place. Plug in some Feliway diffusers and when the time comes to let them out, do it just before a normal food time, stay with them in the garden and like Si mentioned, call them back in for their food, and just gradually increase the time they stay out.