Yes the halter should always be taken off when the horse is in the stall. They would put up a terrible fight, and spook something terrible, perhaps even breakng their back, neck or legs if it happened to get stuck on something.