I say do what makes you feel more complete. I do have to say life is a continuing education(at least here in our house) I have kept learning as I home schooled both my kids. My son and I are working on his GED and I think anyone who completes it knows more than a high school grad(now teachers don't get mad)I am a hs grad and half the stuff Ben is needing to know I haven't a clue on. It is possible to go to school and not learn any thing , one district in Washington has a ploicy that after 5 years of HS they graduate you.
Back to the question, if you do decide on higher ed. community colleges are a great way to start in to higher Ed completeing one 2 year program gets you in to most of universtys GED or not. Good luck and follow your heart.