Your conclusion "that amounts to racial discrimination" demonstrates why you were asked to consider resigning and why you still don't understand it. What you're experiencing is not racial discrimination; it's a consequence of your interactions with people, which for all we can tell from the outside looking in, could be a result of your own behavior. Behavior, not race.
White reactionaries will eat this up, though.