hot  /  reviews  /  videos  /  cblogs  /  qposts

The simple math of review scores

4:00 PM on 01.15.2010 // Chad Concelmo

Editor's Note: We're not just a (rad) news site -- we also publish opinions/editorials from our community & employees like this one, though be aware that it may not jive with the opinions of Destructoid as a whole, or how our moms raised us. Want to post your own article in response? Publish it now on our community blogs.

A couple months ago, I would have never considered writing a feature about how review scores work. First off, I rarely review games for this site, and, secondly -- and most importantly -- I have no interest in getting involved in the never-ending, exhaustingly fruitless argument over why certain games are scored a certain way.

But over the holiday break, something changed. As I started reading the comments on some of Destructoid’s more recent reviews -- specifically Assassin’s Creed II and VVVVVV -- I felt the need to throw in my two cents.

You see, there is one particular issue that is bothering me that I think a lot people genuinely may not understand. Of course, this has nothing to do with people’s opinions on how a videogame is scored. If you love a game and it gets a low score, it makes sense to respectfully disagree with the review. This feature is not about telling anyone that they are wrong for feeling the way they do.

No, this feature involves comparing one review to another -- a misconception that is starting to infect the comments of almost every review that is posted on this site.

Hit the jump for a simple solution to solve everyone’s review score woes. Let’s all hold hands and read together.

Honestly, I can keep this rather short:

Review scores are not meant to be compared to each other.

Simple as that.

If a game on this Web site gets a 9.0 and another gets a 7.0, it doesn’t mean the game that gets a 9.0 is altogether better than the game that was scored a 7.0.

Before rushing to the comments and letting me know what I am saying makes no sense, let’s go over how a numerical score is calculated in a review to begin with.

Each review and its respective numerical score (between 1 and 10) is based on the quality of that particular game. If a game gets a 5.0, it is completely average. More specifically (and this is super important!), giving a game a 5.0 means that the game being reviewed could, technically, be about five points better if certain things were improved. In more mathematical terms, this means the game is living up to 50% of its potential.

Think about a game you really love or hate. Now, mathematically, think about how much better that game could be. If it couldn’t be better in any obvious way, well, that game should get a 10 (or, at the very least, close to one). If the game you are thinking of could be significantly improved, think about how much and score it accordingly. Could it be three points better? Six points? In relation to what it is setting out to accomplish, how much of the game is successful? 30%? 85%? 100%? Boom. There’s your score.

But let’s move on from that -- we could debate what a “5.0” really means for days. That’s not what this article is really about.

The point of this article is to not dissect review scores; it’s to dissuade everyone to not compare them with each other. It may sound simple and obvious, but it is unbelievably important.

With a lot of reviews, people look at a numerical score and surprisingly refuse to think about what that score actually means. It’s just “OMG [GAME A] GOT AN 8.0 AND [GAME B] GOT A 9.0! DESTRUCTOID THINKS [GAME B] IS BETTER! FAIL!”

Let’s use the “5.0” example once more. If a game gets this average review, the score only applies to that game. Meaning: if the inevitable Assassin’s Creed III gets a 5.0, it means that particular game could easily improve things to make it five points better (be it graphics, gameplay, etc.).

Conversely, if another game -- an indie game, for example -- gets a high 9.0, that doesn’t necessarily mean it is a better game than Assassin’s Creed III. It doesn’t mean that at all, actually! All it means is the indie game is so good it could only make enough improvements to score it one point higher.

In no way does it mean the indie game is exactly four points better than Assassin’s Creed III (whatever that would even mean).

Review scores are meant to reflect the quality of a particular game. They are not meant to be compared to each other in any way. If a game gets a 7.0, that game got a 7.0. If another game gets a 2.0, that game was scored a 2.0. In a normal review world, a game that gets a 6.0 could or could not be “better” than a game that gets an 8.0. Unless the reviewer specifically states, “[Game A] is better than [Game B],” there is no way to tell which game is better based on the review scores alone. Again, each review exists in its own individual world and should be read and understood accordingly.

Personally, if I were to review Dead Rising for the Xbox 360, I would probably give it around a 6.0, due to some serious problems I had with the game’s controls and certain design choices. The game could have easily been four points better if Capcom changed some key things about it. Easily four points better. On the other hand, I would (and did!) give Planet Puzzle League for the Nintendo DS a 9.5, as it is near-perfect in the kind of game it sets out to be. It could have only been, at the most, a half a point higher with some small, merely cosmetic (*cough* friend code *cough*), changes.

But ... if someone were to ask me what game I like better, I would easily choose Dead Rising. I love that game, despite some of the problems I have with it.

Let’s use a popular ongoing series as another great example of all this.

The Madden series.

Every year a new game in the Madden series comes out that is almost identical to the one before it. Say in 1995, Madden ’95 was ranked a 9.0 for being one of the greatest football videogames ever made.

Obviously over the years the Madden games have improved in various ways -- more features, better graphics, improved simulation. Between 1995 and now -- if reviews were meant to be compared -- how could you do better than a 9.0 year after year after year? Answer: You can’t!

That’s why each game is judged on its own quality, with no intentions that its review will be compared to another. If one Madden gets a 9.0 and another gets a 7.5, that doesn’t mean the 9.0 iteration is better. It only means that the 9.0 game lives up to 90% of its potential, as opposed to its colleague’s 75%.

If a chef prepared a plate of brussel sprouts that 9 out of 10 brussel sprout experts adored and another plate of chocolate cupcakes that only 5 out of 10 dessert experts loved, you can bet your ass I will still be asking for more of those average chocolate cupcakes, while ignoring the plate of almost perfectly prepared vegetables. Why? BECAUSE A 5.0 CUPCAKE WILL ALWAYS BE BETTER THAN A 9.0 BRUSSEL SPROUT!

Okay, I admit that was the worst analogy of all time, but hopefully you get an idea of the point I am trying to get across: Review scores should never, ever be compared.

In no way am I calling anyone out for not agreeing with the reviews we do here. Like I mentioned before, everyone is entitled to their opinion, and we respect and adore the Destructoid community more than you will ever know.

Just remember this little insignificant feature the next time you want to scream “Destructoid thinks this game is better than that game! Confirmed!”

What you are saying really doesn’t make any sense.

<3



Chad Concelmo,
 Follow Blog + disclosure

This blog submitted to our editor via our Community Blogs, and then it made it to the home page! You can follow community members and vote up their blogs - support each other so we can promote a more diverse and deep content mix on our home page.



 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our moderators, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding *.disqus.com to your whitelists.

 Quickposts
Status updates from C-bloggers

Nerdcotic Network avatarNerdcotic Network
check out this awesome video made by the Nerdcotic Network. https://www.youtube.com/watch?v=J3KgJfBt0uE
Nerdcotic Network avatarNerdcotic Network
Hay check out this awesome video made by the Nerdcotic Network on youtube. https://www.youtube.com/watch?v=QemwbuspOJg
The Travisionist avatarThe Travisionist
[img]http://cdn.destructoid.com//ul/308609-RR1.jpg[/img] Dayum. Billy Mays is back and lookin' good.
StriderHoang avatarStriderHoang
Pivot smash my way to victory
Osc44 avatarOsc44
You ever dream of flying through the clouds, but couldn't so you just watch TV? Me neither.
Zack Furniss avatarZack Furniss
Oh GOOD, The Flock is awful. I was hoping to break my high review score streak. (this is a joke)
Zack Furniss avatarZack Furniss
So many PAX things to write. So many.
Shinta avatarShinta
Bwahahahaha .... my helicopter now arrives in the middle of a fight blaring "Take on Me" on the loudspeakers. Metal Gear 5, 10/10. [youtube]https://youtu.be/djV11Xbc914[/youtube]
OverlordZetta avatarOverlordZetta
Oh neat, Hollow Knight got through the Colosseum of Fools stretch goal while no one was looking. Shame they couldn't get to three characters but the game still looks awesome.
techsupport avatartechsupport
S Rank is so satisfying. Too bad I rarely earn it!
Bardley avatarBardley
My MGSV: The Phantom Pain playthrough has quickly devolved into a journey to fill out Big Boss' 80's synth pop collection. And I couldn't be happier.
Dinosir avatarDinosir
You know what I love? Game tgat force you to connect to their servers even though you only want to play single player. Then the servers are down an the game tries for like 5 minutes, not even giving you a way to cancel the process, you just have to wait
Pixie The Fairy avatarPixie The Fairy
In today's Spelunky daily challenge, I was nibbled by a bat that pushed me into a Tiki trap that landed me dead on Kali's alter. Kali was pleased with the bat's sacrifice.
Shinta avatarShinta
It's pretty good guys ... [youtube]https://youtu.be/_98VZT9s7M0[/youtube]
Shinta avatarShinta
FFXV is supposedly 10x as big as The Witcher 3. Wow ... [img]http://i.imgur.com/9tfSuxQ.png[/img] http://www.dualshockers.com/2015/09/01/final-fantasy-xv-map-size-potentially-revealed-its-roughly-an-enormous-780-square-miles/
RadicalYoseph avatarRadicalYoseph
The ending of "Return to Crookback Bog" in TW3 I got was so depressing. Wow. I think I need a break...
Shinta avatarShinta
I'm sitting here play Metal Gear V, absolutely loving it. But in the back of my mind ... all I can think about is Mario Maker. I'm really excited for that game!
Patrick Hancock avatarPatrick Hancock
Sold a digital item on Steam, that came with a physical item, for more than the cost of the physical item. This is the second time I've done this. ¯\_(ツ)_/¯
GoofierBrute avatarGoofierBrute
Everyone right now is playing Metal Gear Solid V: The Phantom Pain. And here I am, waiting for Super Mario Maker to come out. And also Star Fox Zero.
Mike Martin avatarMike Martin
Patrick Hancock hates babies. Rick and Morty.... I wish I could view thee second season. I need to play MGSV. I spray farted earlier.
more quickposts


Contest!


Seriously

Invert site colors

  Dark Theme
  Light Theme


Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo



Back to Top


We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -