It could be that Harvey feels threatened by Bane being in the safe room.
Can you give us more information about how you're currently doing the ite swapping and scent swapping, and what times you have the boys together and where?
You could try placing the litter box on the bed on top of a protective cover (I know it sounds gross, but if Harvey is "defending" his space, then it may help to break him of the habit).
The good thing is Bane will eat within sight and sound of Harvey. That's fine for now. Getting them closer and closer may just take time. It's really natural for us to want these things to happen quickly, and sometimes we're fortunate and they do, but we have to allow things to happen in the cats' own time, otherwise we risk putting the process backwards rather than forwards. Still fixable, just often means starting again from scratch, by keeping them apart and then gradually re-introducing etc.
Have you tried shared playtime with them, and if so, what were the results? Any interest from Bane?