I can't vote since you specified it HAS to be a yes/no answer.

It would depend entirely on what the guy looks like, and the location. A fat, pale, hairy guy at the beach is about as unappealing to me as a gorgeous, well built guy at a family zoo.

There are some guys that can carry off the shirtless look and some that can't. Either way there are places where it's appropriate and places it isn't.

So I can't answer a specific yes/no to that question.