My golden loved to eat soil as a pup. He also loved and still loves to to eat everything else. This weekend, he decided to try sand (yuck). It is part of learning. If you don't want your pup to eat soil, you need to treat the situation like any other undesirable behavior, with appropriate discipline and distraction from the "forbidden" behavior. If this soil is fertilized, you definately need to stop the behavior, for the puppy's safety. If your puppy is just digging and burying his nose, not really eating mass quanities of dirt, you may want to designate an area for him/her to do this. My dog outgrew the soil eating obsession. He still loves to dig, but only were he's allowed.

Sorry, I don't have an instant solution. I'm sure someone else will respond with some better solutions. Have fun with your new pup. They grow up so fast!