Like you said, "stealing" isn't likely to be a very good solution not to mention longterm. If the lady found out she would be very mad, and much less likely to work out a solution. What about being friendly to her, perhaps even helping her out by taking 2 or 3 dogs for walks everyday, making sure that they all get fed and have enough to eat? Or maybe talk to the local shelter, and describe to them what is happening, and try to prevent her from taking more animals. Maybe they don't know what her home atmosphere is like!