Use is present tense. Used is past. So in your question, if I WAS skinnier, then I would "use" used. Technically the proper form of the statement would be "I once was skinny"

BTW, I can never say I was ever skinny.