Usually mixed breed horses are less expensive, I assume you just want a backyard horse not a purebred show horse. Here is a site that may help answer some of your questions
www.equinesite.com
It is based in the New England area but it may be helpful for you to see the prices of horses for sale in the classified or to ask horse questions in their horse chat area (Equichat) I hope it helps.