There are plainly people that abuse this and are offended because they want to. Maybe they just don't like you or have an unresolved problem with themselves. Being upset doesn't net you anything, but the a important thing is that you aren't allowed to shut people up in the name of an abstract unprivileged group and we see that too often when people want to police speech.