You can use an eyedropper instead of a bottle, but you'd need to get to the store for kitten replacement milk (can't use cow's milk) You can use goat milk, I don't suppose you have any of that on hand?

I really never bottle fed babies so I can't be much more help.

Best of luck