I think I broke (or fractured if it's possible) my nose a couple times when I was young. Didn't go to a doctor and my nose is fine. The only problem I have is if I get bumped even slightly it hurts like you-know-what. And I have a small bump on the bridge but nothing too noticeable.
I'd say just ice it to help with the swelling. But it sounds like you're going to the doctor. Which I probably would too if it happened to me now as an adult. My mom never took us to the doctor unless it was serious or life threatening.

I hope you're feeling better soon. I know how nose pain is.