I have several quality rifles, but putting quality glass on all of them will kill my bank balance (and in turn, my marriage

For example, I took the scope of my 6brx today and put it on my 284. I had to put on an extra 7 minutes of elevation and 3 minutes of wind to zero it from the brx zero. Can I expect when I swap it back over to take of the same 7 minutes of elevation and 3 minutes of wind and be somewhere near the 5 ring?
It sounds like it should work in theory - I was wondering if any e has done this successfully in practice.
I can only shoot one rifle at a time can I get away with one scope?
Alex