Should I be guilty for letting myself try and be happy for a little while, while my family isn't?
Simply put - no! You need to live your life. If you don't do this because you feel you need to take care of your family, you will start to resent them for holding you back, and that can only cause more problems down the line for you and your family.

Go. You can always come back.