Well, talk about "hidden potential" is a bit of a misnomer. Is there enjoyable aspects to mediocre games? Yes. Like I said, I enjoyed racing with my brother, but in comparison to all the other racing games I played, this doesn't rank high in aesthetics and mechanics.
It doesn't mean you don't have to like it, and honestly, we give you trouble for it because how excitable you get about it.
My two favorite racing games are LEGO Racers and Combat Cars, both of which are not very critically acclaimed and certainly aren't serious racing games, but I know what I like about them and that's that. I'm not posting 20 videos on the Combat Cars soundtrack (which is super sweet, if I dare say) and I don't get frustrated if people aren't with me on it. If someone likes it with me, fantastic! If not, oh well.
If you just be a little more chill about the games, you'll find people a lot of more accepting of preference of games. For the rest of us, it seems like you can't deal with us not sharing the same likes as you. And it's kind of funny when you get put out.