haha... usually they are shocked and surprised to see some other people (nationality-wise) speak their language. At least for me I will be shocked if you speak cantonese to me.
Good job in trying though, I know it can get scary.