The 1-10 Scale
When you come down to it, the 1-10 scale is the most frequently used in video game journalism. The almost as popular 1-100 scale could easily be reduced to a 1-10 decimal system without any real difference.
But how effectively do game reviewers really use the 1-10 scale? Generally speaking, a 1-10 scale should be represented as such:
1 – Shit
Could not possibly be worse.
2 – Awful
Maybe the idea was kind of clever, or you may have fun accidentally, but everything else is horrendous.
3 – Bad
Some aspects are terrible, others are either so-so or kind of fun.
4 – Poor
An admirable effort, but essentially mediocre.
5 – So-So
Fifty-fifty. Half of the time the game is fun, half of the time it isn’t, for whatever reason. This game is absolutely average in every single way -- neither good nor bad.
6 – Not bad
Decent, but you wouldn’t recommend it to friends.
7 – Good
Replayable, fun, but nothing innovative or amazing. The game potentially has large flaws that, while they don’t make the game bad, prevent it from being as good as it could be.
8 – Great
Very fun -- its essential gameplay aspects are cool and interesting, but may not be implemented in the best way.
9 – Fantastic
Negligible flaws. Otherwise very, very good.
10 – Perfect
Could not possibly be better.
Now, I’m willing to bet dollars to donuts that you disagree almost entirely with the criteria for that ranking system. But while you can substitute your own subtitles for each of the scores, I think we can generally agree on what the bold points represent: on a 1-10 grading scale, a 1 is absolutely horrible, and a 10 means that you’ve just played a video game that could not be made better in any way.
Logically, there is no way that a 1, being the lowest possible point on the scale, could represent anything other than a game with no redeemable values, or that a 10, the highest point on the scale, could represent anything other than pure perfection.
However, this is not the grading scale we use when judging video games. I would argue that our scale looks much more like this:
10 – Fantastic
9 – Great
8 – Very good
7 – So-so
6 – Bad
5 through 1 – Awful
Don’t believe that this is the de facto video game grading scale? Consider the reviews of Gears of War, a game which was frequently given a perfect 10/10, and The Legend of Zelda: Twilight Princess, which I personally gave a 4/10.
The “Perfect” Game
While most reviewers tend to shy away from giving any game a perfect ten (9.8’s are far more numerous than 10’s), it has to be said that the “perfect 10” rating does not stand for perfection at all. Take Dan Hsu’s review of Gears of War (keep in mind that I hold the highest opinion of him, considering he's one of the only video game journalists to show any balls in the last few years):
“You can always find reasons not to give a game a review score of 10. Control issues (Gears of War has that). A.I. problems (that, too). Bad dialogue or storytelling (yes on both). Linear levels, online lag, limited modes (yup, yup, and yup).”
Then he gave it a 10 -- a perfect score. He defended his rating by stating that the good overwhelmed the bad by far. That the player was kept in a constant state of awe by the setpieces and the satisfying kills. In some respects, it’s hard to disagree with him: Gears of War is undeniably fun, and the good most definitely outweighs the bad.
But it does not make the game perfect.
And yet, many other reviewers gave Gears of War almost equally high scores despite acknowledging the game’s many faults. Out of 132 reviews, 12 of them said Gears of War was a perfect, 10/10 game.
Whatever your opinion is concerning Gears of War, I think we could all agree that it is not perfect by any stretch of the imagination. One may consider a 10/10 score for Gears completely justified, assuming you don’t consider 10/10 to mean “perfect,” but rather “really fantastic.”
But why should 10/10 mean anything but "perfect"? You cannot get any higher on a grading scale than 10/10, meaning there should be no room for improvement. Many magazines such as EGM classify a 9-10 rating as "excellent", but that doesn't insinuate that a 10/10 should indicate anything other than a flawless video game.
“We should reserve 4's for the X-Squads, Orphens, Godai's, and Big Mutha Trucka Racings of the world.”
The above quote, by The Brain, was taken from the comments of Destructoid’s review of Zelda: Twilight Princess. The Brain’s comment was one of the most civil ones I received in opposition to my grading of Link’s Wii adventure.
I gave it a 4 because I felt that the gameplay was repetitive, the story, unoriginal, and the Wiimote functionality, broken. I stand by my review, and I make no apologies for it. Many readers said that they would no longer visit Destructoid because of my review. Others said that I should no longer be allowed to review video games, or even contribute to the site.
But is a score of 4/10 really that harsh? In a functioning 1-10 scale, a 4/10 is the equivalent of “poor.” Not bad, or awful, or shit -- just “poor.” Slightly below average.
And yet, a 4/10 in the gaming world might as well be a 1/10. After we posted the Zelda review, readers either accused me of deliberately lowering my rating just to incite controversy, or of being anti-Nintendo, or of just plain being an idiot.
Yes, a large part of the community outburst could be attributed to the fact that Zelda was a Nintendo title, and therefore attracted the most irate fanboys on the Earth. Gamespot received similar hate mail when they awarded it an 8.8 out of 10 -- still “great”, by Gamespot’s standards. But my rationale for rating the game as low as I did is not nearly as important as the community’s reaction to it.
As a community, we seem to have collectively decided that the regular 1-10 system does not apply to video games, and that, instead, everything rated below a 6 is irredeemable crap. Many of the comments concerning Twilight Princess said that I should have awarded it a 6 or 7 instead of a 4, even given my arguments that the game was sub-par. The majority of these comments were written not because readers thought I was outright wrong, but because they thought 4/10 was simply too harsh a number based on my complaints. As mentioned above, however, 4/10 is not very harsh at all; we have simply decided, as a community, that even if we think a game is sub-average it is still worthy of a better-than-average numerical score.
Scores under 5 shock us, when they really shouldn’t. Most games that come out on a monthly basis are either bad, or simply mediocre, but we still grade then with 6’s and 7’s -- grades we ought to reserve for honestly good, enjoyable games. We should be seeing a lot more 4/10’s than we currently are.
The Magically Inflating Score
The important question is, why do we relegate sub-five scores to bargain bin crap, or lousy movie tie-ins that have no redeeming value? Why do games that are clearly below average often get scores of 6? Reviewers (and I am personally guilty of this in my grades of Lost Planet and WarioWare: Smooth Moves) will often times point out many things that a game does wrong, essentially deeming it below-average, and then inexplicably award it a 6/10 or a 7/10. 6/10 scores, by their very definition, should be awarded to games that are above average. To games that are more good than bad. A 5/10 or a 6/10 is logically not a grade to be ashamed of if it belongs to an above-average game, but these scores are usually awarded to horrendously sub-average fare.
On Gamerankings.com, the all-time worst reviewed game on the site is Charlie’s Angels, for the Nintendo Gamecube. Its average score? 24/100 -- reduced, 2.4/10.
Isn’t that a little weird? That a game ranking site, which includes games dating back to the Super Nintendo era, has not a single game with an average score of less than 2.4 out of 10? We’re talking about more than a decade of games, and not one game is scored lower than a 2.4.
2.4/10 is a low score, yes. But for a game like Charlie’s Angels, which has absolutely NO redeemable values to speak of (other than the fact that it doesn’t give you cancer or something), it’s far too high. Why not a 2/10, or a 1/10? Why do reviews like IGN’s accuse it of being "simply, bad, in just about every way," and then give it the generous score of 4/10? Shouldn't a game that is bad in every way get a 1/10 or a 2/10?
The problem is not the reviewer's individual sense of judgement, but what we as a community have decided to be the criteria for our review system. Simply because a video game is a video game, it warrants a higher score than it really deserves.
Why is this the case? Tune in next week to see a dissection of the possible causes. For now, though, hit the comments and lemme know what you think: am I full of shit?
I think the problem is, critics will usually just slap a score of around 7-8 on most games that aren't exceptional. Apparently there are a lot of average video games, fewer really good games, and even fewer totally shitty games - at least, that's how it appears from the way games are typically scored.
yeah, cause we all know that ultimately twilight princess is simply mediocre.
at best.
lol. i mean you know that's what it'll boil down to, your review of zelda. But i do agree on most of you points...it just that glaring 4 is blinding as piss; hard to focus.
Since I didn't finish the article, I'll talk out of my ass for a second.
Most reviewers acknowledge that a 10 does not represent a perfect game, because there's no such thing. One game mag, forget which one, even went so far as to add an unattainable 11 to their rating scale, just to illustrate their point. Now, I know what you're thinking, "Why not just make 10 louder?"
Gears of War is a masterpiece, maybe even a killer app, that every 360 owner should have in their collection. That is what makes a 10.
With the exception of the oft-baffling 10, I agree that video games are rated far too favorably. For the last 10 years, I've rarely found myself considering anything less than an 8 average even playable. If I'm not going to recommend a game to friends it's not a good game, in my opinion.
You gave Twilight Princess a 4?????
Generally when I read a review, I look at what they say rather than the score they give it.
Wow, you're completely right. Game reviewers need to grow a set and back up their words with appropriate numbers. I doubt it will ever happen though. You know there's some payola going on.
Good job, brother. Can't wait for the next part!
Yes I will give you that Twilight Prince could be considered repetitive if you played Ocarina of Time...but couldn't you say the same thing about the 3028308 Madden games and the 2037480328 Rainbow Six/Splinter Cell games?
What scores have you given Madden Titles and Splinter Cells and Rainbow Sixes?
Agree with just about everything you said in that article. Look forward to part 2.
I hope this doesn't turn into another page for people just to whine about Zelda.
@LaBomba: "it just that glaring 4 is blinding as piss; hard to focus."
That's exactly the problem he's describing. A 4 shouldn't be blinding as piss. I'm guilty of doing this too...
Part of the problem is that after the gaming community has come to expect this skewed system, reviewers have to buy into it to communicate effectively.
Rev's is a perfect example -- his review totally justifies a score of "sub-par" but it seems like nobody actually read the words he wrote. Because he didn't use the skewed system that other people use, his point was lost on most readers.
Excellent read. I was going to suggest that they just lower the scale to 1-5, but that would just result in shitloads of decimals being thrown out and games getting rated as threes and fours. Because honestly, the scale is much simpler that way and you don't have to nitpick.
1 - Terrible
2 - Poor
3 - Average
4 - Above Average
5 - Excellent
The word perfect gets thrown around too much. Some publications even refer to their highest possible scores as "perfect" while at the same time pointing out flaws in the game. It's as you said, there is no such thing as a perfect game because somewhere someone will find something that they don't particularly like about a given title. In all respects, numbers should probably be done away with completely and reviewers should just go with a simple, two choice grading system: recommend, and don't recommend.
EGM is about the only print magazine I see using that ratings scale effectively, and it's pretty much the only source I use for game reviews. I've seen EGM pass out a justified 1 or 2 average on a game, and most other reviewers give the same game a 4 or 5.
I like the idea about 4/10, we don't see that enough.
Your right everything is a 6.75-7.50.
maybe we should get tougher on scores?
And maybe next time, a review of the most anticipated Zelda game EVER should perhaps be conducted by a Zelda fan.
cant wait for the next part.
Games should be rated on one of two things.
1. Is it fun?
2. Is it worth the price point?
That's it. That's all that should matter. When I tell someone about a game, that's what happens. There's no numbers involved, no mention on if it's a system pusher, just pure fun or not fun.
I stopped reading reviews years ago. Not only have I been wasting less time playing videogames ever since, but I've only been playing games I'm interested in without worrying about what some asocial fatty thinks about it. It's awesome, let me tell you. I'm playing less, spending less, and having a better time with the games I end up buying.
I was watching the news last night and they brought up something similar. Women's clothing sizes. The clothes have been getting bigger and the numbers staying the same. Meaning that a 4 of 1980 is all of the sudden a 0 today. Or something like that.
The same is true of grades. I got A's in most of my classes; however, so did everyone else. There were people in my graduating class who got 4.5 GPAs out of a 4.0 scale. WTF????
As a society, we've become to PC to tell someone they suck, even if they really do suck (or are overweight). All we do is raise the bar artificially or change the scale as Rev A. mentioned for games. 5/10 is the new 1/10. It doesn't make sense and it screws with the scale. There should be a reset button so everybody can start over the way the scale should be.
I agree with Toneman, I usually read whats so great or not so great...
We all know you're still getting reemed for the 4/10 score on Z:TP... that's why there's 3 paragraphs explaining yourself. Im not judging Im just saying...
Ars Technica shifted to a Buy, Rent, Pass system. It's better cause you actually read more of the review to figure out why. Although, lately, they've been putting qualifiers after everything (Buy but only if this...). Old habits die hard.
The problem as I see it is a 1-10 scale is related to grades from school. I see a score of 5 I see a non passing grade. 5.5 (in a 1-10 grading system)is a true average (product for our discussion), however in life we are trained to see 70% as average or a "C" grade the 5.5 or 55%(as it would be percieved is an "F". The preception of scale has been modified due to the way we are brought up.
Perception must be realigned before a "true" scale of gaming fun can be achieved.
Kryptinite
I like your idea...I guess in "is it worth it" you would put the special features or what not....
Well think of it like this its going to a grading scale if you got a 50% you fail. plus they cant say it like you can your just too blunt. plus it can be like that any more since games are bigger then they uste to be.
i read reviews, evaluate the pros and cons, then I choose what to get.
i don't make choices because THEY say so.
and a 4 for Zelda was STILL the dumbest shit ever.
sounds like someone needed attention.....
I believe in a 0-π rating scale. 0 is awful, π/4 is not worth your money, π/2 is a decent game but not worth your money, 3π/4 is a lot of fun, great replay value with no flaws that take away from the playability of the game, and the best score of π is a perfect game, a la mode.
Seeing as how it would be pretty difficult to give gamers ice cream with their purchase, π shouldn't be given out to often
"I've rarely found myself considering anything less than an 8 average even playable."
Same here. I feel that a lot of games are graded too highly. I generally subtract 0.5 for the average score to balance things out. It really depends on the context of the written review.
I usually dont like a number attached to a game because all to often I see written reviews and scores that dont add up. Personally I feel scores should be done away with. Unlike most people I read many reviews to determine if a games final score is justified.
That was a great read.
Keep on preaching Reverend.
Oh... and also cocks
Well, I will be blunt, the 4 for TP shocked me. It takes alot to shock me, there aren't many games that I like. I would have personally given TP about a 6. Hell, it was the first Zelda I have played since SNES. The Wii is the first console I have owned from Nintendo since the NES. I have been a major sony fanboy for years. Until the PS3 and sony decided to rip the consumers.
However, I will agree, too many games get good reviews that they don't deserve. Ahem, Red Steel is one, it recieved 6's and 7's across the board. All the levels are soo redundant, the sword play is mediocre at best, the AI is just horrendous. It was probably a 3 on a good day when you are snowed in and thats the ONLY game you have to play.
I don't find God of War to be as great as boasted, an 8 is generous. It was a nice game, but nothing that I personally would get to immersed in.
It's all about personal tastes. I'm going insane attempting to gather the cash to get myself a 360. I can't really judge any games on the 360, as I have never played on the 360, hell, the original xbox for that matter.
ignoring "tehArtist"
anyone else agree with Kryptinite...maybe we could use this scale?
I think the problem is that in this American culture, we are raised in schools to think that anything less than 60% is failing, which could be where the 10,9,8,7,6,5-1 scale comes from. So if I played a game like Batman: Dark Tomorrow (The Worst Game I've Ever Played) I would feel comfortable giving it a 4 or 5 because in my mind, that denotes failure. I agree with what you're saying though. Maybe a word scale like "Excellent" - "Irredeemable Trash" would be more accurate.
I still disagree with your Zelda TP score, but I totally agree with what you're saying about the current rating system. I think the system you've defined is ideal, but not implemented at this point. I think part of the problem is that our (American) standards for "average" aren't truly average at all; perhaps we expect too little, so we're too pleasantly surprised when something doesn't turn out to be complete shit.
This is a very interesting topic, Rev - I look forward to Part 2.
I definitely don't play as many games as I would like to. I don't have the time, so when it's time for me to get a new game I'm pretty selective. I don't want to spend $50 on something that I'm not going to enjoy. If a game has an average rating of 7 or below chances are I'm not picking it up. I don't want to play a "good" or "great" game. I want to play something that's absolutely fantastic that I'll love. So I hover towards the 8's, 9's and when they occur, the 10's. Even then though, when I play the 8's sometimes I'll think "Yeah, it was good...but it really didn't deserve that score". If the game reviews really went by what number meant I would probably pick up more 6's and 7's. But when something gets that score it might as well be a 5 or below.
Something I think what the industry needs to do is set a standard for review scores. A lot of industries (such as movies) have a scoring system that everyone grades on. Im not saying we have to grade God of War II in stars but something about game scoring needs an overhaul.
I read the alt text too.
People probably think about it like a grade.
You take a test. You could get a score anywhere from 0-100, but anything below 65 is an F.
I see nothing wrong with this mindset. Regardless of how bad a game is, it could almost always get worse.
"Gears of War is a masterpiece, maybe even a killer app, that every 360 owner should have in their collection. That is what makes a 10."
im sorry but gears of way is no masterpeice, the only thing for me that lived up to the hype, was the graphics and being able to play the single player with someone else, after that, i saw alot of terrible things that made me sell the game back to gamestop, if anything, it deserved a 5, almost the entire 11 hours i played the game, its been "ehhhhhhhhhh"
war* >_>
same points made more than once. other than that - nice piece. do the editors edit?
I personally would prefer to see all scores removed. In place put a much simpler system:
BUY IT
RENT IT
DONT BOTHER
It would be a function of the cost of the game, and if everyone subscribed, metascores would be a better indicator of how worthwhile a game is.
Destructoid's reviews are the most biased, one-sided, 2-dimensional pieces of crap on the internet.
Honestly, if he's ranking Zelda TP at a 4, he's doing so on the grounds he states because he wants the controversy. And he can back up his claims all day with his review.
"And that's why I gave it a 4" is his easy out for any criticism against his review. I liked the story. The controls worked just fine for me. And gameplay mechanics are what make a game they way they are. If you feel it's repetitive, then maybe the game is a little too long for your tastes.
I agree with everyone who said they think of the rating system as an academic grading system. I think it should be this way because it's specific and familiar. Just as you're probably not going to want to read someone's paper that got a C or D - you probably arent going to want to play that video game. And (at least in college) its almost impossible to get a perfect 100%, especially if you've got an idealistic professor.
I agree that the ratings are inflated just like a lot of grades are today, and often wonder if people get paid to give games certain scores (just like teachers get paid more if their students do well). There should be more games that get 10% and less that get 70% definitely for sure.
No comment on the Zelda review.
I agree wholeheartedly with this piece. Its sad that its hard to differentiate a "good" game from a "great" game from an "excellent" game based on review scores. Anything in that realm seems to get roughly the same score when review scores are collated - prolly around an "8".
(On a totally unrelated note, Lost Planet deserves at least a 7. Its the first console shooter to play like a console shooter instead of a piss-poor rip of a PC FPS. Analog sticks are not mice, and console FPSs like to pretend they are - auto-aim for the lose.
I see the point RevA was trying to make by giving Zelda a 4/10, that the rating system is botched. Had he skewed his number into the rating system most agree with the game probably would have recieved a score of 6.5-7.5. At least that is what I would equate a 4 to in terms of the american grading system.
I actually think that the best scale for video games would be a monatray scale. You know, since games actually cost a butt-load more than any other media, in terms of cash and time a review telling you how much they'd pay for the game in REAL MONIES ZOMG would actually be kinda useful. It leaves room for the hyperbolic scores that people sometimes feel compelled to give, and doesn't suffer from the problem of having the "perfect score".
On the other hand I think a 1-10 scale is fine. Not too sure about adding in .1 because then it's essentially a percentile scale, which are dump in my opinion. 8 is different from a 9, but and 8.8 from a 9.2? Not so much, and so kinda pointless unless you're feeling uber pedantic.
Really though whoever said to focus on the text of a review was bang on the money. Pun unintended I swear.
Yes, dvddesign. You've created an impenetrable argument. Despite my paragraphs upon paragraphs explaining why I gave Zelda a 4, I'm doing it because I want controversy.Just because you said so, which therefore means you cannot possibly be disproven.
Citing actual gameplay flaws MUST seem like an easy out when there's no way for you to back up your claim that I'm mugging for attention, is there?
Feel free to simulate putting your fingers in your ears and repeating "I can't hear you" ad infinitum.
I love reading Rev's articles, and in this case he's spot on once again.
Let's see how many more people can point out the grade-in-school to game-review connection...
I feel like I'm alert and pro-active enough to anticipate the reviews for any games coming out these days. I play the demo, watch the movies, read the articles, and mostly make up my mind about a game before I see a single review. I read reviews these days mainly to see if I agree with the reviewer or not, but I rarely am surprised by what they say or really put a lot of stock into their opinion.
Hey rev, what did you give the latest madden? How about VF5? I see rehashes galore, so Id like to see what you think about them?
What about the Buy it/Rent it/Dont bother system?
"If you feel it's repetitive, then maybe the game is a little too long for your tastes."
How do you account for personal taste? How can somebody accurately convey something like how "fun" or "good" something is with a set of numbers? When you take something as abstract and objective and "fun" and try to apply a quantifiable scale to it, it's no surprise that there are problems and inconsistencies.
mandlebaum123:
To be totally honest, I don't play rehashes unless they try something drastically new, or if I really didn't like an earlier iteration of the series. A sequel that does nothing new will usually get a sub-average score from me, as was the case with MGS3 and Twilight Princess. I know we all have to resepect a game on its own merits, but I find it personally impossible to play all the games in a series that gets progressively more complex, and then not get disappointed when the final entry is almost exactly like the one preceding it.
And personally, I think the buy it/rent it/don't bother system is fantastic. It wasn't originally in part two of this article, but it definitely will be now that you've mentioned it.
On the TP review I disagree, but on the article, I agree fully.
Highly Enjoyable, keep it up Ant