I don't know for sure if what you are saying is true or not because I haven't seen it with my own eyes. For all I know, maybe those players who do not like insanely tough difficulty just keep quiet and don't play those games instead of voicing their 1 or 0 star opinions. But if they silently avoid it and just don't speak their mind then what difference does it make? It is still rejection just said in another form.
If a game requires far above average skill to play then by definition only a small percentage of the population will have the aptitude to play the game. And of those who have the aptitude only a small fraction will have the time to master the game. The masses will simply get locked out and have nothing to play. How on earth can they be happy like that? I just can't see it happening.
