My kids couldn't tolerate my drinking milk either, took me a long time and lots of colicky nights to figure that one out, boy did I crave milk when I knew I couldn't have it.