I haven't found a way to stop it yet, I had to take ours off the toliet paper holder as well .... I'm sure I have a photo someone where of my little man sitting beside the mess in the bathroom...

He used to do it all the time