I would probably wear a pair of dress pants with a casual blouse.