I think "neglected" is the wrong word. Everyone gets busy from time to time and we don't get to play with our animals as much as we would like. Your baby will get bigger before you know it and she will be playing with those bunnies too. If I were you I'd try to make as much time as possible for them until your baby gets a little older. If you still feel like you are neglecting them, then maybe think about a bunny rescue, or try to re-home them yourself.