How cute! That's how we got our family budgie. My step dad was outside of the house and saw the bird outside. He got a little seed and put it in his hand and the bird just hopped into his hand. We've had him ever since, and he is incredibly tame!

I think you should keep him.