Actually, we bought just such a shelf at a pet store, we got it for a pattern to see if my grandfather could make more.

Its particle board covered with removeable carpet, so can be washed. It has two legs below that screw into the shelf, and go to the wall for support. It attaches to the window sill by velcro.