OMG, are you actually considering it?
I don't even know you that well and I'd NEVER say that to you or anyone else here on PT. But that just may be because I'm too nice sometimes.
That would be devasting if you had to rehome any of them. I think you just need to find a solution for Buddy (and I know you already know that). Whether it's taking him to the no-kill shelter you mentioned before, or finding him a home.
I'm sorry you are having a rough time right now. But it will get better (and a little positive thinking helps too).