I think if he is proven unfit *outside* the facts of this case, then sure, he should lose them. But this case- which he is innocent of until proven guilty- can't affect custody. In my layman opinion.

If the legals weren't involved and it was about our opinions... sure. take them as fast as possible while they still have a chance at a normal life. But the law must apply, so c'est la vie.