Well, I hate to insert this stereotype, but he probably might think you're harmless because you're gay. Just hit him a couple of times and he'll keep his mouth shut.