I know what you mean. When I was younger, I used to love roller coasters. Now, at a pathetic age of only 16, I'm terrified of going on one. *sigh* That's probably where the high school graduation field trip will be in two years.
*sigh*

What matters most is that you and your horse enjoy what you're doing. I hate people that force animals to perform what they don't want to. I visited a stables once where their main riding ring was located right on the main road. Every time a truck or motorcycle passed by, the horse would spook. All the instructors and riders would smack the horse with the whip or shank the nose with the chain to "punish" it. I asked the instructor, "Why are you punishing the horse if all it did was spook?" She said, "They're lesson horses and if they're going to work with humans, they have to learn to behave under all and any circumstances. We need to be able to trust them to be 100% safe. Plus, the horses live here. They should be used to the cars by now." I was so mad. Where's the logic and reasoning behind that?!?