It's not everybody's/my/... cup of tea.
not (one's) cup of tea:
Not something one prefers, desires, enjoys, or cares about.
Thank you for the invitation, but long-distance cycling just isn't really my cup of tea.
When I found out that reading wasn't his cup of tea, I knew that there wasn't much of a relationship in store between us.
Farlex Dictionary of Idioms. © 2015 Farlex, Inc, all rights reserved.
not one's cup of tea
Fig. not one's choice or preference. (Used to describe an activity you
do not enjoy. Can sound somewhat affected.)
You three visit the museum without me. Looking at fussy old paintings is not my cup of tea.
Going to church, Mary said, was not her cup of tea.
McGraw-Hill Dictionary of American Idioms and Phrasal Verbs. © 2002 by The McGraw-Hill Companies, Inc.
The more general statement not everybody's cup of tea is also idiomatic; it appears as a title in this article in the Economist (on voting reform in the UK). As one might expect, there is more of a 'British English' flavour. But as this thread shows, it is not uncommon in the United States.