I do believe he will stop once she is gone. I'm assuming she is not fixed either, and perhaps she may be in heat? Males sometimes go a little crazy even just being around a female and will display behavior like that. It's just... nature's way!