Not all birds are the same - some don't need fruit at all. Zebra finches don't need fruit, while a Blue Streaked Lory, for example, doesn't need seed at all - just fruit and nectar.

Only one site I saw said her zebra finches liked banana sometime. Everyone, though, says that you need to make sure they're getting plenty of calcium if they're going to be breeding.