Suppose I have some problem when someone takes an action 'X' on me which I find highly offensive and which makes me feel bad but it may/may not effect other individuals if used on them. A friend of mine has a bad habit of claiming that 'X' is not something to get mad at and he says that action 'X' does not have any effect on him and also he considers individuals who find 'X' offensive to be stupid.
The idea which I want to convey to him is:
Different people like/dislike different things.
But I need a colloquial saying (metaphorical maybe) or natural expression to use while having a conversation with him.
Do any popular saying exist that would get this idea across? If you have any self-made expression, I would deeply appreciate it if you could share it.