Sounds to me your being railroaded mate. I've been in the same situation myself, and ended up making an arrangement whereby the agent could take people through the house for two hours on the weekend only.