games  anime  |  toys
Destructoid is gaming news, community, videos, and sometimes love. Take the tour or jump in with Facebook:

 



 thumbs down

It has frequently been argued that video games tend to be reviewed much more favorably than other forms of art, like film. This type of thing is usually argued by the same people who complain about the state of video game journalism, and who call most gamers immature morons.

The problem is that, at least in this case, those people are right.

Video games are reviewed much too positively, and the gamers are suffering as a result. Horrendous games are getting rated 6/10, decent ones are getting 8/10, and the much-desired perfect 10/10 is getting passed around more frequently than a bong at Phish concert. 

Are video game reviews really that positive? Is that a bad thing? Why are video game reviews the way they are?

This two part article will tackle all of these questions: the first one today, and the last two later on in the week. Hit the jump to see part one.

The 1-10 Scale

When you come down to it, the 1-10 scale is the most frequently used in video game journalism. The almost as popular 1-100 scale could easily be reduced to a 1-10 decimal system without any real difference.

But how effectively do game reviewers really use the 1-10 scale? Generally speaking, a 1-10 scale should be represented as such:

1 – Shit

Could not possibly be worse.

2 – Awful

Maybe the idea was kind of clever, or you may have fun accidentally, but everything else is horrendous.

3 – Bad

Some aspects are terrible, others are either so-so or kind of fun.

4 – Poor

An admirable effort, but essentially mediocre.

5 – So-So

Fifty-fifty. Half of the time the game is fun, half of the time it isn’t, for whatever reason. This game is absolutely average in every single way -- neither good nor bad.

6 – Not bad

Decent, but you wouldn’t recommend it to friends. 

7 – Good

Replayable, fun, but nothing innovative or amazing. The game potentially has large flaws that, while they don’t make the game bad, prevent it from being as good as it could be.

8 – Great

Very fun -- its essential gameplay aspects are cool and interesting, but may not be implemented in the best way.

9 – Fantastic

Negligible flaws. Otherwise very, very good.

10 – Perfect

Could not possibly be better.

Now, I’m willing to bet dollars to donuts that you disagree almost entirely with the criteria for that ranking system. But while you can substitute your own subtitles for each of the scores, I think we can generally agree on what the bold points represent: on a 1-10 grading scale, a 1 is absolutely horrible, and a 10 means that you’ve just played a video game that could not be made better in any way.

Logically, there is no way that a 1, being the lowest possible point on the scale, could represent anything other than a game with no redeemable values, or that a 10, the highest point on the scale, could represent anything other than pure perfection.

However, this is not the grading scale we use when judging video games. I would argue that our scale looks much more like this:

10 – Fantastic

9 – Great

8 – Very good

7 – So-so

6 – Bad

5 through 1 – Awful

Don’t believe that this is the de facto video game grading scale? Consider the reviews of Gears of War, a game which was frequently given a perfect 10/10, and The Legend of Zelda: Twilight Princess, which I personally gave a 4/10.

gears of war

The “Perfect” Game

While most reviewers tend to shy away from giving any game a perfect ten (9.8’s are far more numerous than 10’s), it has to be said that the “perfect 10” rating does not stand for perfection at all. Take Dan Hsu’s review of Gears of War (keep in mind that I hold the highest opinion of him, considering he's one of the only video game journalists to show any balls in the last few years):

“You can always find reasons not to give a game a review score of 10. Control issues (Gears of War has that). A.I. problems (that, too). Bad dialogue or storytelling (yes on both). Linear levels, online lag, limited modes (yup, yup, and yup).”

Then he gave it a 10 -- a perfect score. He defended his rating by stating that the good overwhelmed the bad by far. That the player was kept in a constant state of awe by the setpieces and the satisfying kills. In some respects, it’s hard to disagree with him: Gears of War is undeniably fun, and the good most definitely outweighs the bad.

But it does not make the game perfect.

And yet, many other reviewers gave Gears of War almost equally high scores despite acknowledging the game’s many faults. Out of 132 reviews, 12 of them said Gears of War was a perfect, 10/10 game.

Whatever your opinion is concerning Gears of War, I think we could all agree that it is not perfect by any stretch of the imagination. One may consider a 10/10 score for Gears completely justified, assuming you don’t consider 10/10 to mean “perfect,” but rather “really fantastic.”

But why should 10/10 mean anything but "perfect"? You cannot get any higher on a grading scale than 10/10, meaning there should be no room for improvement. Many magazines such as EGM classify a 9-10 rating as "excellent", but that doesn't insinuate that a 10/10 should indicate anything other than a flawless video game.

zelda

“We should reserve 4's for the X-Squads, Orphens, Godai's, and Big Mutha Trucka Racings of the world.”

The above quote, by The Brain, was taken from the comments of Destructoid’s review of Zelda: Twilight Princess. The Brain’s comment was one of the most civil ones I received in opposition to my grading of Link’s Wii adventure.

I gave it a 4 because I felt that the gameplay was repetitive, the story, unoriginal, and the Wiimote functionality, broken. I stand by my review, and I make no apologies for it. Many readers said that they would no longer visit Destructoid because of my review. Others said that I should no longer be allowed to review video games, or even contribute to the site.

But is a score of 4/10 really that harsh? In a functioning 1-10 scale, a 4/10 is the equivalent of “poor.” Not bad, or awful, or shit -- just “poor.” Slightly below average.

And yet, a 4/10 in the gaming world might as well be a 1/10. After we posted the Zelda review, readers either accused me of deliberately lowering my rating just to incite controversy, or of being anti-Nintendo, or of just plain being an idiot.

Yes, a large part of the community outburst could be attributed to the fact that Zelda was a Nintendo title, and therefore attracted the most irate fanboys on the Earth. Gamespot received similar hate mail when they awarded it an 8.8 out of 10 -- still “great”, by Gamespot’s standards. But my rationale for rating the game as low as I did is not nearly as important as the community’s reaction to it.

As a community, we seem to have collectively decided that the regular 1-10 system does not apply to video games, and that, instead, everything rated below a 6 is irredeemable crap. Many of the comments concerning Twilight Princess said that I should have awarded it a 6 or 7 instead of a 4, even given my arguments that the game was sub-par. The majority of these comments were written not because readers thought I was outright wrong, but because they thought 4/10 was simply too harsh a number based on my complaints. As mentioned above, however, 4/10 is not very harsh at all; we have simply decided, as a community, that even if we think a game is sub-average it is still worthy of a better-than-average numerical score.

Scores under 5 shock us, when they really shouldn’t. Most games that come out on a monthly basis are either bad, or simply mediocre, but we still grade then with 6’s and 7’s -- grades we ought to reserve for honestly good, enjoyable games. We should be seeing a lot more 4/10’s than we currently are.

 

angels

The Magically Inflating Score

The important question is, why do we relegate sub-five scores to bargain bin crap, or lousy movie tie-ins that have no redeeming value? Why do games that are clearly below average often get scores of 6? Reviewers (and I am personally guilty of this in my grades of Lost Planet and WarioWare: Smooth Moves) will often times point out many things that a game does wrong, essentially deeming it below-average, and then inexplicably award it a 6/10 or a 7/10. 6/10 scores, by their very definition, should be awarded to games that are above average. To games that are more good than bad. A 5/10 or a 6/10 is logically not a grade to be ashamed of if it belongs to an above-average game, but these scores are usually awarded to horrendously sub-average fare.

On Gamerankings.com, the all-time worst reviewed game on the site is Charlie’s Angels, for the Nintendo Gamecube. Its average score? 24/100 -- reduced, 2.4/10.

Isn’t that a little weird? That a game ranking site, which includes games dating back to the Super Nintendo era, has not a single game with an average score of less than 2.4 out of 10? We’re talking about more than a decade of games, and not one game is scored lower than a 2.4.

2.4/10 is a low score, yes. But for a game like Charlie’s Angels, which has absolutely NO redeemable values to speak of (other than the fact that it doesn’t give you cancer or something), it’s far too high. Why not a 2/10, or a 1/10? Why do reviews like IGN’s accuse it of being "simply, bad, in just about every way," and then give it the generous score of 4/10? Shouldn't a game that is bad in every way get a 1/10 or a 2/10?

The problem is not the reviewer's individual sense of judgement, but what we as a community have decided to be the criteria for our review system. Simply because a video game is a video game, it warrants a higher score than it really deserves.

Why is this the case? Tune in next week to see a dissection of the possible causes. For now, though, hit the comments and lemme know what you think: am I full of shit? 


Continue: More Industry Bullshit stories





prev 50 comments
next 50 comments

174 comments | showing # 51 to 100

GodLen's Avatar - Comment posted on 03/12/2007 14:25
GodLen
I agree with you fully.

/bow
mandlebaum123's Avatar - Comment posted on 03/12/2007 14:25
mandlebaum123
Cool Rev, I look forward to it.
bmdubya's Avatar - Comment posted on 03/12/2007 14:27
bmdubya
I read reviews to see what people thought, but I usually try to play a demo before I decide to make a purchase.
phinehas's Avatar - Comment posted on 03/12/2007 14:30
phinehas
Dude, if you get a 40% on your chemistry test, that is far below average and definitely not desired.

5/10 does not equal "average" - Average, just like in school, if you will, is somewhere between 70-75% or so. That's why I think that most grading scales have it right.

You judged Twilight Princess according to your own scale, which is fine, but you should probably have let people know that before you did it.
arkracer's Avatar - Comment posted on 03/12/2007 14:31
arkracer
Solution.

No more damn number ratings.

They're stupid and require you to think less, making you less intelligent.
cnote81's Avatar - Comment posted on 03/12/2007 14:33
cnote81
Destructoid should not use a numeric score at all. I would use the barnyard animal scale.
Cow
Horse
Chicken
Rooster
Pig
Sheep
Dog
Cat
Goat
Duck
and so on.
Don't explain the scale or what each one means just give a written review and at the end give it (for example) a Sheep. This should eliminate any confusion over the matter.
bhive01's Avatar - Comment posted on 03/12/2007 14:37
bhive01
I actually like the no numbering or explaining the scale idea... kinda fun.
BluDesign's Avatar - Comment posted on 03/12/2007 14:39
BluDesign
Rev: I've only got to point at the number of comments made, by individuals (since this is my second post on this thread) that you touch a nerve by posting a 4 for a game that so many other people enjoyed where you didn't.

What else do you point at if not the controversy? It gives you a forum to dispense your opinion and have it be heard.

Oh noes! Opinions!

Your comment back to Mandlebaum highlights why you are not a qualified person to review a game like TP. If it's got a # stuck on the end or uses a colon in the title, chances are you aren't interested. So, what, other than to point out that the game is a sequel, are you bringing to the table in your review?

I don't think a reviewer needs to spoon-feed me my opinions on a game, for sure, but I'll at least align myself with someone who knows what to expect from a game and can tell me if a title can live up to the standards that such a game carries.

@ Orcist,

There were plenty of people heaping praise on GTA:SA, and San Andreas ran a little too long and got a little too meandering for it's own good. San Andreas, for all it's misguided ambitions, will never be as good as Vice City in terms of gameplay and focus. You have a goal and it's achieveable in Vice City. San Andreas just meanders because they can. It's like the ultimate tech demo.

See? It's all one's perogative on what fun is.

Also the inconsistency with numbers is easily disproven, as you'll see a majority or average appear on games. That's what a site like GameRankings is good for, since if you've found the one guy in 100 who thinks REZ is a shitty game 'cause the graphics are "lamorz", then you know you've got someone who doesn't get it, and probably isn't in sync with the target audience.

You'd never ask me to review a football game. Or any shooter for that matter, since a good deal of them are horribly repetitive.

In any case, I know with a game like Zelda what to expect. I know there's gonna be a Link, there's gonna be an adventure, most likely a guide, maps, dungeons, and a pretty rigidly defined set of weapons at my disposal. If I'm disappointed from anything, it'll be because the story doesn't mesh in the overall scheme of things, or the controls are broken. (which weren't on my Wii).

Simply because they made another Zelda game doesn't knock a score on my merits.
Sean Fischer's Avatar - Comment posted on 03/12/2007 14:53
Sean Fischer
I've had some years of experience as Editor-in-Chief of http://www.allrpg.com, and I can say that balancing the scores of reviews isn't as trivial a matter as most people would expect, and this is especially true of smaller sites. There are two main problems that arise when trying to maintain standards for scores of games, one of which may or may not effect larger sites, but one which I would assume would effect most blogs. The two reasons are these; people tend to play games they like, and Public Relations.

When dealing with a small site, or a blog, it's often the case that there is a significant investment by the reviewer in any single review, whether that be in the cost of the game itself, or the time spent playing the game to review it. The dilemma arises from the fact that if one is purchasing a game and also planning to review games, one is not typically going to go out of their way to purchase a game that they're not looking forward to, especially if the cost of the game is coming out of their pocket. So what tends to happen is that you have reviewers who are purchasing games they are already looking forward to. I'm personally guilty of this--I'm a huge fan of the Xenosaga series, and I have reviewed the games.

The other aspect is that even if games are freely available to you as a reviewer you have a limited amount of time in which to accomplish all of the gaming you wish to accomplish. This is where blogs really fall into the equation. Some videogame blogs pay their writers or provide them with the games free of charge. The problem is that as a writer you have to pick and choose those games you wish to play. Sometimes they're chosen for you by the circumstances and press surrounding a game. For instance, there are those games that have so much media hype that they require a review on a blog. For cases where this is not true, it is the tendancy of a writer to play a game which is appealing to them.

Herein lies the problem. What is created is a community of reviewers in which the majority of the reviews that are written are done so by people who are either fans of a series, waiting in eager anticipation of a game, or have an understanding in advance that the game will be a good game. In isolated cases this isn't necessarily negative, especially in the situation in which a game is generally understood in advance to be one of those titles that will be stellar. The problem comes more with the games on the fringe. I'll go back to the Xenosaga example. I love the series, and I love it because of how it's executed. Now it's clear that because of this the review that I write may be at contrast with what those around me feel. Since I only review games I can afford or have the time and will to play, and I only purchase games I have an inkling will be good, it tends to inflate my overall review score. When you have a community of writers all doing the same thing it tends to inflate the overall score of reviews in the entire community.

The second problem is one of Public Relations. There have been times where a game has been reviewed on websites in which I contribute that received a low score, and we were subsequently contacted by publisher with a statement of their surprise. The conflict here comes from the fact that no one wants to alienate their contacts. By currying favor with PR outlets you're let in on more exclusive stores, more swag, plugs, and a plethora of perks. Maintaining journalistic integrity in such situations is difficult, especially when your community is small or when you personally rely on those contacts for a majority of your journalistic work. It's a careful balancing act that journalists have always had to deal with.

There is a third point that I touched on in discussion the two prior points and it is also just as important. It is the issue of pre-existing expectations. Hype is not just something that effects those purchasing games, but it also effects the reviewer. Expectations can color a reviewers judgment by causing them to overlook flaws completely because they are so enamored with the aspects of the game that were hyped and were executed well. The problem here is that overlooking those flaws in a review is being, in a way, deceitful to your audience. A good reviewer should take all flaws into account when composing the review, and at least make them known, rather than glossing over them in favor of the shiny aspects. This is in the end probably the largest problem out there when it comes to reviewing games, especially when coupled with the confrontation of Public Relations.

So, now we know at least some of the reasons why. What can be done about it? For one, having a clearly delineated point system for the reviews needs to be established for the institution in question. The point system should not, as is pointed out, consist of the "average" score being in the 6 to 8 range. But there is an aspect to reviewing that is more important that just the score itself, and that is the justifications within the heart of the review. The score given to a review should reflect the material of the review itself. All too often reviewers will decide on a score ahead of time, and then write a review around it, or at times not even considering it. The content of a review should consist of reasoning on the aspects of the game--it's system, graphics, music, and all of the other components that make it up. The review shouldn't just present these facets to the reader, it should present their context and implementation, and more in a more overarching sense, whether or not they functioned properly within the game. It is these justifications of the facets of the game, as well as reasoning on the cohesion of the game as a whole, that should determine exactly how a game is scored, and unfortunately this is rarely the case.

By focusing on developing these aspects of writing a review, a writer can greatly improve the quality of their reviews. But there are also other avenues for an anaylsis of games to take place, and that is in the sense of critical analysis in a more formal sense. This is something that could not only be used for an audience seeking information about a game, but also to developers working on a game through its development cycle. If anyone is interested, I have some pieces about the place of critical analysis in games written up, but I think that strays from the topic at hand.

The long and short is that Reverend Anthony is correct, there is an inherent problem in the manner in which games are reviewed currently, and I look forward to hearing his further insights on the topic.
Mxyzptlk's Avatar - Comment posted on 03/12/2007 14:54
Mxyzptlk
MGS3 did nothing new? How about the outdoor enviroments, camo system, using first aid techniques to heal various injuries, or hunting and eating various fauna to keep your stamina up? Not to mention the game being set in a different time era and playing as the future Big Boss. I'm not even a big fan of Metal Gear Solid, I typically hate stealth games. I played MGS3 for a few hours before realizing it just wasn't my thing. I really didn't like how a lot of the things were implemented, especially first aid. But I at least recognize that title changed up a lot of different things in the series. It evolved the basic play by adding features to it. If it was simply MGS1 or 2 with new graphics, you would have a point.

Mario 3/Super Mario world didn't dramatically change from the original. You still run and jump from the beginning to the end of each level, collecting power-ups and hopping on enemies. So are they not worth bothering with?

I think a lot of the shit you got from the Zelda review was not only due to the 4 score, but because people disagreed with your viewpoints about the game itself. I haven't played it yet, so I can't speak from experience. But people I know who have gone through it seemed to have none of the issues you did, whether they loved the game or just thought it was okay. It's fine to stick by your score because you didn't like the game (unlike 1up.com, who seems have to magically increased their controversial SSX Blur score from 5.5 to 6.8). Just don't try to suggest everyone who disagrees is a Nintendo fanboy. A lot of people enjoyed the game and didn't have any of the control/content issues you did.

The 1-10 score system definitely varies depending on the site/publication. Some consider a 7 average, while others consider 5 average. The major problem is too many people just get hung up on that score number instead of reading the actual text of the article. Some sites have tried to get rid of review scores, only to have their readers throw a fit. It's a system the gaming press is unfortunately stuck with. People just need to realize that that 1-10 scale is not universal, and that a review is one person's opinion. Even movies or literary reviews have the same problem. Some people hated the Lord of the Rings films. Others might think Anne Raynd is an overrated windbag. That's why when I look for impressions on anything, I check multiple sources to get an overview. I believe way back when Destructoid reviews were being first talked about, I suggested not going with a traditional 1-10 rating system. I still think that would be a good idea for this site. Recommend, Rent first, Don't recommend. That would work fine and hopefully cause less drama. The words are what's important in a review, not the number at the end.
Sean Fischer's Avatar - Comment posted on 03/12/2007 14:55
Sean Fischer
I apologize for the length of that post. I didn't realize I was rambling that much.
demonelite's Avatar - Comment posted on 03/12/2007 15:02
demonelite
I agree with cnote81.
deiga-the-semivaliant's Avatar - Comment posted on 03/12/2007 15:11
deiga-the-semivaliant
I've always liked the multi review approach that some magazines do... unfortunately in most cases the two reviews say essentially the exact same thing. (COUGH Gameinformer COUGH)

If I ran a magazine of the gaming sort, I would try to assign two different editors to review the game... one who loved it and one who hated it. It would allow for the pros and cons to be listed indiscriminately without one interfering with the other. And it would give the reader a good idea of the type of person who would enjoy the subjected game.

I enjoyed the article Rev, looking forward to the next one.
Kia's Avatar - Comment posted on 03/12/2007 15:14
Kia
As others have said, we're trained to see a review scale the same as we see a grading scale in school. There's nothing wrong with that.

I'd also like to say I stopped reading when I saw you gave Zelda a 4, but I did finish the article. Regardless--and I'm anything but a Zelda fangirl--that game deserved MUCH higher than a 4, on any scale, and seeing your lame excuse for giving it pretty much made me discredit this entire article, and probably anything you'll write out in the future.

Then again, the last time I commented on one of your posts it was to say how much the reviews sucked too. Maybe you should get out of video games or something. You remind me of that pretentious literary critic Harold Bloom for god's sake.
mandlebaum123's Avatar - Comment posted on 03/12/2007 15:15
mandlebaum123
myzxwhoweveryouspellit:

That 6.8 is the average including the users, not the reviewers score. Thats still a bullshit 5.5
RevivedDemon's Avatar - Comment posted on 03/12/2007 15:16
RevivedDemon
Jesus Christ. With all these epic-sized comments nobody is going to look at mine. But anyways Reverend, I completely disagree with your definition of the word average. I do agree that a 4 is for below average games, but comeon what games do you consider the "average" game?? Halo, MGS, Gears of War? These games are not average by any means, seeing as how they are exceptional games that do NOT make up the majority of any system's library. Now calling a game average would be saying it is about on par with the MAJORITY of games that are released at the time. For example, the PS2's library does not consist of all MGS quality titles although there are many. Still, the majority of games available for the system are crappy old rehashes of sports games, movie license games, and the occasional odd low budget game that no one's ever heard of. Anyways my point is Zelda is not below average imo. If you say it is below average that is like comparing to Kim Possible and saying it's worse, because yes there are a LOT of games that are that bad.
Mxyzptlk's Avatar - Comment posted on 03/12/2007 15:22
Mxyzptlk
@ mandlebaum123:

I stand corrected, thanks for pointing that out!
Anthony Burch's Avatar - Comment posted on 03/12/2007 15:27
Anthony Burch
dvd:
Read closer. I said I dislike sequels if they don't do anything NEW. I loved MGS2 despite its horrendous flaws, I liked Wind Waker for its new visual style and different exploration modes, and Ocarina of Time is one of my favorite games of all time.

Twilight Princess, on the other hand, was nothing more than Ocarina of Time with a second playable character and busted-ass Wii controls. Defend the Wii controls all you like, but if they were worth a crap then the sword swings would have been relative to your movement, instead of each random swing equalling exactly one press of the B button on a standard Gamecube controller.

With the exception of the projectile weapons, which even the worst of Wii titles include with the same degree of competency (Red Steel), the Wii gestures only substituted for simple button presses instead of creating a new gameplay style.

I know exactly what to expect in a Zelda game as well, but I also expect a degree of progress. While it's fine that you seem happy with essential rehashes of the same game, I was looking forward to some new aspects to the series other than horse combat and wolf transformations. The Zelda games changed from the NES to the SNES, from the SNES to the N64, and from the N64 to the Gamecube (the changes were admittedly minor, but very effective), but not from the Gamecube to the Wii.

Call me crazy, but I'm not dedicated enough to the franchise to accept a lack of innovation and sub-par controls and still find it an above-average game.

Sean Fischer:
Don't apologize, that was awesome. Do you mind if I use some of that in part two (after citing you, of course)?

mxyzptlk:
Having played through MGS3 twice, I can confidently say that the camo and first aid systems are almost completely tacked on. I actually wrote a review of it before I joined Dtoid, which can be found here: http://dt1.destructoid.com/forum/viewtopic.php?t=435

As for calling all those who disagree with me Nintendo fanboys, I hope I haven't been misunderstood. I can understand it when people disagree with my individual points, but I've gotten almost none of that. When people disagreed with my review they either attributed their disagreement to vague non-reasons like "you don't know what to expect from a Zelda game" or, in dvddesign's case, "you're doing it for the attention." I honestly YEARN to be civilly disagreed with by someone who can back up their claims, but when that doesn't happen I feel I have little choice but to attribute it to fanboyism.

And I know that you, I, and many of the readers/editors on this staff would prefer a non-numerical ratings system, but Summa has basically banned the idea under the assumption that most people do indeed want numerical scores. If you really want the review system changed, I'd suggest actually emailing him, or starting a petition, or a forum thread. We're small enough that the community voice really matters, if you speak loud enough.

RevivedDemon:
I'm guilty of using the word "average" to describe a 5/10 score at many points in the article, which, in hindsight, was a mistake when I essentially meant so-so. I think to build a ratings scale and have it hinge in relation to the "average" game is faulty, for the reasons you pointed out. It's impossible to determine what an "average" game is. I think we agree, but my frequent and mistaken use of "average" when I meant "so-so" caused confusion.
Fenris's Avatar - Comment posted on 03/12/2007 15:29
Fenris
Kia,

I think there is something wrong with that system being related to games. The main issue is scale. There is a long way down (70-0) and only a little up (71 to 100) on that scale. A new way of rating games is needed. Granted rating games has quite a bit of subjectivity to it and personal preference will always get in the way.

But they key to games should alway be does the fun (if there is any) overcome the negative. If so then we should be at a certain level of the scale, 5.5 for instance, below would be if the negative overcomes the fun and the over/under should be determind by the extent of the fun or misery. This way we don't hve to worry about the dreaded perfect game, it just comes down to which games are the most fun to play.
awa64's Avatar - Comment posted on 03/12/2007 15:29
awa64
The /10 system really is like a school system. A 10 is a 100%--but even in school, if the grader is being forgiven, you can get there with a mistake or two or something you could've done better, so long as they're feeling generous or they like you. 9 is an A, 8 is a B, 7 is a C, 6 is a D, and anything below 6 is an F.

That's why X-Play's /5 system works so well. 1 is irredeemable trash, 2 is subpar, 3 is average, 4 is above average, and 5 is outstanding. Lowering the specificity makes for a far more forgiving scale--a 5/5 doesn't have to be the epitomy of perfection, and 3/5 is more than an acceptable score for a game where a 5/10 typically isn't viewed as such.

That's not to say that giving Twilight Princess a 3/5 isn't unjust and being done solely to serve up controversy...
Anthony Burch's Avatar - Comment posted on 03/12/2007 15:30
Anthony Burch
Kia:
I know you're a feminist, and I think that's adorable, but this is grown-up time and I'm the man.
Sean Fischer's Avatar - Comment posted on 03/12/2007 15:32
Sean Fischer
There are some other aspects I didn't comment on in my previous post because I thought I was rambling too much, but since I figure most of you are just skipping it because it's too long, I've decided I'll just rant about them as well.

Another of the factors that contributes to the inflation of review scores is the expectations of your target audience. No one wants to hear about how the game they are all expecting, or maybe have even played and loved, has these gigantic gaping flaws. It's the equivalent of telling someone that their baby really isn't the cutest thing in the world, but that it's actually pretty ugly looking. It's just something that's difficult to do. Sometimes reviewers just can't bite the bullet and they cave to the expectations of their audience. With games it compounds itself, because most gamers are proud of the fact that they are gamers, and they're proud of the types of games that they love. Every time someone posts a low score on a game the audience will say, "Oh, you just don't like that genre" or "Oh, you're overlooking all these things." Sometimes reviewers won't be able to do what they should be doing and ignore that sort of nonsense.

But there is a far larger problem with audience expectations than this one. It is when reviews or any sort of news is are catered toward their audience. Probably the best example I can give of this in the current gaming environment is the next-gen console debate. As things stand right now, people love the Wii. That's not bad. That's good. The problem is that it's become established that everyone loves the Wii, and there is such a backlash against those who speak against it that the wise commercial decision is to post as much love as you possibly can. This also serves as a function to gain an audience. By tailoring articles to one direction or another you captivate the audiences with similar outlooks. From a commercial standpoint this is great. But in certain contexts it raises some questions about journalistic integrity. If your Xbox fan site reviews all Xbox games high because that's what Xbox fans want to hear, you're not really doing the community a service at all. Also, another dangerous precedent can be created--if your audience has a negative feeling toward something, often writers will tailor their work in that direction, which usually causes a complete neglect for the actual tangible positive aspects. A lot of the time they get completely overlooked because it's easier to write about the bad. I'm thinking that the PS3 is a prime example of this.

Some would say that controversy is a contributing factor to the discrepancies we see in reviews. Here is where I draw the line. Any writer worth reading should be immune to controversy on what he writes. A writer should never let controversy based on their opinions dictate what they do or say in the future. That's not to say that there isn't room for a reversal of opinion, or clarification on topics that are misunderstood, but they should not be because of the backlash of the audience. So while some people point to it as an aspect detrimental to reviews, I disagree. Controversy breeds discussion, and discussion is what communities are built on.

Tonight  You's Avatar - Comment posted on 03/12/2007 15:36
Tonight You
The problem is, the 1-10 rating system is based on the school grading system. 10 is "really excellent" (not "perfect" because perfection is by definition impossible), 7 is average, 6 is poor, 5 is failure.

The 1-5 rating system that they use on X-Play (and for restaurant reviews) is more suited to game ratings. In the X-Play system, 5 is great, 4 is good, 3 is average/below average, 2 is bad, 1 is horrible.
Sean Fischer's Avatar - Comment posted on 03/12/2007 15:37
Sean Fischer
Also, Reverend Anthony, knock yourself out. Glad to contribute experience wherever I go. If you're interested in some of the stuff I've written about critical analysis (I mean in a more literary sense), let me know.
Snaileb 's Avatar - Comment posted on 03/12/2007 15:38
Snaileb
Rev - 1
Kia - 0



Ownage.
deiga-the-semivaliant's Avatar - Comment posted on 03/12/2007 15:41
deiga-the-semivaliant
School grades for games suck.

I love it how a game can be six different shades representing "this is a bad game".
cnote81's Avatar - Comment posted on 03/12/2007 15:42
cnote81
I give this thread a rooster
bhive01's Avatar - Comment posted on 03/12/2007 15:46
bhive01
I know Rev doesn't want to turn this into a Zelda: TP thread, but when you talk about how things differed between Ocarina and Windwaker as being acceptable and then Windwaker and TP as not I fail to keep up. Even if you change that comparison to Ocarina/TP there are still stark differences.

I've only played TP for about 15 hours, but the wolf parts are absolutely different. The twilight world is similar to the shift observed in the series (Light/dark world LTTP, Time Ocarina, Seasons, ages...), but it's also different because you have to play as the wolf. Horseback fighting. These are new elements that mix up the series enough for this zelda fan.

I do agree that the controls are a bit "off" though. I try to do the shield push and Link often does the twirl. But, I like the parts that use the pointer to aim. It's intuitive, and it works.

It's all opinion though. Summa if you're listening, don't give us a number.

Buy, rent, or burn.
Anthony Burch's Avatar - Comment posted on 03/12/2007 15:52
Anthony Burch
The wolf parts really didn't feel that different to me, to be completely honest. Part of that might have been the fact that you still had to slash with the Wiimote to attack (I can understand the gesture for a sword, but what's the rationale for using it to simulate a wolf biting?), but to me it really just felt like they darkened the graphics and switched the geometry of the game world a bit.

I'll admit that Wind Waker had very, very few changes made to the overall formula, but what is important to me is that they WORKED. I can unequivocally say that I loved the new visual style and the sailing aspects because they were efficiently implemented. I can't say that with TP's Wii controls.
Auto Glocktopus's Avatar - Comment posted on 03/12/2007 15:55
Auto Glocktopus
Reverend, I've got a few questions. How do you think people should react to your reviews if you cant figure out the Wii's controls when so many people can? Do you plan on doing more Wii reviews in the future? If so, why? I agree with some of your points on the zelda review about it being a rehash - I mean, there's not much new that you hadn't seen in Ocarina or A Link to the Past in terms of toys or gameplay, and the "save the princess" story - but should you be reviewing Wii games if you cant figure out controls that millions of people can manipulate easily?

I like your articles, and your reviews are interesting no matter if I agree with you. I dont think people should boycott your page because they disagree with 1 review - thats just stupid, self-righteous, and mastubatory. Cool topic.
bhive01's Avatar - Comment posted on 03/12/2007 15:59
bhive01
Fair enough. I look forward to pt. II.
Anthony Burch's Avatar - Comment posted on 03/12/2007 16:03
Anthony Burch
I don't follow: I understood the controls, and I could figure them out, certainly, but I still feel that they do not work. As I said to dvddesign earlier:

"...if they were worth a crap then the sword swings would have been relative to your movement, instead of each random swing equalling exactly one press of the B button on a standard Gamecube controller. [I think substituting a simple button press for a gesture makes the swordfighting slower and less accurate.]

With the exception of the projectile weapons, which even the worst of Wii titles include with the same degree of competency (Red Steel), the Wii gestures only substituted for simple button presses instead of creating a new gameplay style.
Anthony Burch's Avatar - Comment posted on 03/12/2007 16:04
Anthony Burch
Er, the above was directed at Auto Glocktopus.

And yeah, I plan on doing more Wii reviews, probably for Cooking Mama and The Godfather when they come out.
Maclintok's Avatar - Comment posted on 03/12/2007 16:09
Maclintok
Game review scores are generally arbitrary and open to enough interpretation to render them meaningless. Game REVIEWS on the other hand, can be immensely helpful with making informed buying decisions. Paired with a healthy sampling of other reviews and maybe a demo, and you begin to see how useless a numerical rating is.

IMO, rating scales discourage people from reading the reviews to the point where it functionally takes precedence over anything the writer has to say about the game. A group of games rated 7/10 can be very different in quality. Yet you'd never know what those differences are unless you read a couple reviews and learn some of the nuances and reasoning behind the score.

There should be less emphasis on numerical ratings. Unfortunately it something that "the people" want, so the game journalists stick to it.
Gameboi's Avatar - Comment posted on 03/12/2007 16:25
Gameboi
I like to keep it a bit simple. A perfect game is one of those gems that pretty much anybody who picks it up falls head over heels for it, and doesn't want to put it down.

Doesn't lead to a nice, long article, but it get's the job done.
Blazingluke's Avatar - Comment posted on 03/12/2007 16:32
Blazingluke
"Nobody ever reads the alt text except for two people. So, Grant and Justin, I just want you to know I've had sex with all your female relatives, and at least one of the males."

???

And you've made some great points in this article!
mandlebaum123's Avatar - Comment posted on 03/12/2007 16:34
mandlebaum123
I guess my question is rev, how does you explanation of the controls show how they are broken? Broken to me would be if they stood for button presses, but didnt register.

And aiming in zelda is much easier than aiming in red steel.
Dexter345's Avatar - Comment posted on 03/12/2007 16:35
Dexter345
I agree with just about everything you said, and it's why I prefer the five point grading scale. Even ten points is too many. With five it's: one - awful, two - poor, three - average, four - good, and five - excellent.

You may have noticed I didn't say five was perfect, which is the one part of your opinion I do not agree with. A ten out of ten (or a five out of five) should not be reserved for perfect games, because by any standards, there is no such thing. If I have enough fun with a game to call it one of my favorite games ever, I feel like it deserves a five out of five, but I'm not tricking myself into thinking it's a perfect game by any means.

But what if the game were improved on? What score would that game get? Easy. It'd also get a five out of five. Yeah, one game would be better than the other, and they would get the same scores, but in the end, all that matters as far as the number goes is what it tells you: this game is really good and you should play it.
bhive01's Avatar - Comment posted on 03/12/2007 16:39
bhive01
I've discovered alt text~! ZOMG it's the funnies!
Anthony Burch's Avatar - Comment posted on 03/12/2007 16:45
Anthony Burch
mandlebaum:
I feel they're broken because with a sword swipe, your slashing gesture will never be as fast or as accurately timed as a button press. So if you want to quickly attack, you have to flail your wrist back and forth like a ninny, and even then there's an unhealthy delay between your swipe and Link's. If I could just press a button, then I'd consistently swing exactly when I wanted to, and as fast as I wanted to.

Dexter:
I think a 1-10 scale (especially if decimals are involved) must require 1 to be absolute worst and 10 to be absolute perfection, if only because the scale is relatively large. And while by definition no game is perfect, it seems perfectly possible that an individual reviewer could convince him or herself that this is the case (if Shadow of the Colossus had slightly tighter controls and camera, I'd give it a 10/10).

But I agree that if you move down to a five point grading system, then 5/5 can no longer mean perfect. A five point scale is much fairer in many respects.
cronotrigger913's Avatar - Comment posted on 03/12/2007 16:46
cronotrigger913
I say ban all number grades. The text is the most important thing in a review. There are so many things that can change a number that it practically makes them harmful for the game.
Eschatos's Avatar - Comment posted on 03/12/2007 16:59
Eschatos
Consider something like school systems, where having a 5 or 6 out of 10 is simply awful. School teaches us that 9 out of 10 is good, and 10 out of 10 is great, but not perfect. I'm in high school, and most tests have at least one extra credit problem. Therefore, shouldn't the perfect games be awarded a higher than 10/10 score? Maybe 10.5 out of 10? Super exceptional games, like Gears of War, clearly deserve 10's, not because they're perfect, but because everyone who likes the genre it's part of will love it. On the other hand, when a perfect game finally does come out, we can give it a 10.5 out of 10, and I'll be happy. Till then, I'm fine with the ratings systems we already use.
ChrisFurniss's Avatar - Comment posted on 03/12/2007 17:02
ChrisFurniss
At weeklygeekshow.com we don't use numbers. We talk about different parts of the game and whether or not we think the game is worth your cash. When it comes down to it, numbers mean crap. What you need to look at is the reviewer's tastes.
Fleet3000's Avatar - Comment posted on 03/12/2007 17:10
Fleet3000
just because i agree with your argument doesn't mean that i agree with your scoring.

but your argument does have a valid point, even though there are some flaws.

i give this article an 8/10. =P
BluDesign's Avatar - Comment posted on 03/12/2007 17:17
BluDesign
The developers have said they can't do 1:1 with the Wii-mote.

Your review almost completely glosses over the fact that this is a port, with adapted controls.

The game had already been in development for like 3-4 years at that point, tacking on the Wii controls was a nice gesture in my opinion. One that was implemented fairly well given the time frame they set for announcing that it would be a Wii controlled title.

So, if we've been given ports so far, so be it. The fact that it's a port. Fine. It's a port, and the controls aren't to your liking.

I want you reviewing Metroid Prime 3. No exceptions. Seeing as how this is a solely Wii developed game, there's bound to be some direct comparisons to Echoes and Prime given that it looks identical.

And to give us some common ground, when they get around to releasing what you're looking for, that one Wii game that exemplifies to you "new gameplay" and innovative gaming, please call me out on it. I want a basis for comparison from you.
Joe_Dull's Avatar - Comment posted on 03/12/2007 17:24
Joe_Dull
Rev Anthony - just read your LOZ:TP review. You're the first reviewer I've seen that mentions the goddamn tinkling fairy pointer! That little f***er forced me to play sitting hunched over to avoid aiming the Wiimote at the TV screen.
Khanstant's Avatar - Comment posted on 03/12/2007 17:25
Khanstant
I agree that reviewers score terribly, but I disagree with the TP score. As far as I'm concerned 5 is an average game. And I felt the TP controls were great, never was shooting a bow easier in a game especially. If I had been the same age I was when I had played OoT I'm sure I would've thought this Zelda was the greatest thing ever. But I'm sure you're stuck on your review.

At the end of the day, I have to ignore numbers and read the review. No, reviews. I'll read a few mid-range scores on GameFAQs as the 1s and 10s are fanboys/fanhaters, and I'll see what I think about the game. 1000 dipshits can say Gears of War is a beautiful masterpiece of a game, but I didn't have fun and I honestly believed it looked shitty.
inepted's Avatar - Comment posted on 03/12/2007 17:43
inepted
A lot of people have already stated most of my opinion, but I'll add one more thing. I'd rather be surprised to find a low rated game fun, then be disappointed and out 50 dollars on a high rated one.
chronolink's Avatar - Comment posted on 03/12/2007 17:49
chronolink
The real problem I think is that we still rate games the same way TVs and all other technological things are rated. Yes, videogames are very dependent on technology, but still games are mostly games, entertainment first, then technology. When a game is given a 10/10 is like when a movie is rated 4 stars. It doesn't mean 'perfect' or anything close, it means that the reviewer had an absolute blast with the game, and he believes so will you. So give us a 5 point scale and put reviewers with opposite tastes on games and we should be good to go.
Jecrell's Avatar - Comment posted on 03/12/2007 18:00
Jecrell
@Reverend Anthony:

Keep up the good work, and I'm glad that you stand by your rating, but at the same time it's probably not even a rating system you would endorse. 1-10 scales are, as have been described in this comments thread and in your editorial, fucking total shit.

Buy it
Rent it
Don't bother

Seriously, that's all we want to know out of a reviewer's opinion. Either that, or where to pick up the game for free if that's possible. But that's never been the case! =P
prev 50 comments next 50 comments

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!

 
New on Destructoid.TV play all videos

Loading
Loading Destructoid Videos


    Win this!
    Dive in! meetup+play for a chance to win a PC

    Dtoid Twitter    Got news?   tips@destructoid.com

    Reviews & Previews
    Assassin's Creed 2 review
    Crossfire Remote Pistol review
    Resident Evil: The Darkside Chronicles review
    Left 4 Dead 2 review
    Call of Duty: Modern Warfare Reflex review
    more reviews
    Driver
    Avatar
    GT Racing Motor Academy
    Bad Company 2 beta dishes out meaningful experiences
    Legend of Zelda Spirit Tracks
    more previews


    - The Dtoid Army is 51055 strong -

    Showing Cblogs with 3+ faps   show all

    Call for entries: do the wrong thing

    New to Dtoid? Read the survival guide




     Originals
    Chad Concelmo: The tragic history of the videogame turkey





















    More Destructoid Originals




     Popular now more






















    Team Destructoid   tips@destructoid.com
    Nick Chester
    Editor-in-Chief
    Niero
    Founder, publisher
    Jim Sterling
    Reviews Editor
    Hamza Aziz
    Community Manager
    Dale North
    News Editor
    Rey Gutierrez
    Video editor & director
    Anthony Burch
    Features Editor
    Colette Bennett
    Tom Fronczak Brad Nicholson
    Ashley Davis Ben Perlee
    Conrad
    Zimmerman
    Chad Concelmo
    Jonathan Holmes Jonathan Ross
    Brad Rice Jordan Devore
    Will Maddock Matthew Razak
    Dyson Joseph Leray
    Topher Cantler Samit Sarkar
         
      Dexter
    Adam Dork
    Daniel Lingen
    Hollie Bennett
    Joe Burling
    Mikey
    Stella Wong

    Josh Tolentino




     

     
      get involved

    register or login
    post a blog
    post a forum
    enter a contest
    contribute a news tip
    suggest a feature
    be a guest editor
    support

    new member's guide
    login assistance
    tech support
    report abuse
    email our editors
    read our dev blog
    nuclear crisis?
    keep in touch

    RSS feed
    Twitter
    Facebook
    Myspace
    Flickr
    Game nights
    Meetup+play online
    seriously

    about Destructoid
    advertising
    terms of use
    privacy policy
    jobs at MM
    buy our crap
    our network

    Tomopop
    Japanator
    Despingation?




    Destructoid is an independently-run publication forged by our love of video games and the gaming community's need of accountable enthusiast press
    living the dream since March 16, 2006