Maybe give it time and see. I really believe you will normally find something your SO does that's annoying, but you learn to live with it. I'm sure I do things my BF finds annoying too. I love to be with him so the annoying stuff isn't really that bad. I agree with just taking it slow and having fun. If it doesn't go anywhere, then you will find the right guy later on