not really, you can't.
many people rate games they never played with either a single word or zero word review with just a score.
they do that to hype up a game of their favorite company or shit on a game because it's popular to shit on it.
and then there are reviews like these:
and I literally found these just now looking for 30 seconds
Congratulations, you found a handful of really dumb reviews within thousands of opinions.
The few dumb reviews where people apparently misclicked the rating are not relevant. I'd wager most people do manage to find the right button...
Stop looking at single user reviews as if they had objective value - that's not what makes the user score relevant.
What makes the score relevant is the sheer mass of either positive or negative opinions.
There is no case of a game loved by users that's shit at what it tries to do - and no case of a game hated by users that's actually amazing at it.
And that's pretty much all that score will tell you, which is IMO already enough to have a good estimate if a game might be a good purchase for you (assuming you like that style of game).
Also, I'm fairly sure you are projecting with the "many people rate games they never played" part.
Take Steam, for example. You cannot even rate the game if you don't own it - yet Steam scores and metacritic user scores are almost always extremely close to one another (with Steam scores tending to be a bit higher?).