Quantcast
Destructoid - nopk's Community Blog




About Me
Video games.
Gamer Profile
3DS friend code:
Steam:
Battle:
PSN:
Mii:
Gamertag:
Following (21)
007
Backspace529
blehman
ceark
Colette Bennett
Cybertronninoid
DtoidOrlando
Jetsetlemming
Jim Sterling
mix
raucci
s0lesurviv0r
Skribble
Tiff
tsunamikitsune
UMF Skibum
Upgrayedd
VWGTI
WDot
Y0j1mb0
youkilledmyguy
Dissecting Gaming- Why the Numerical Review System Doesn’t Work
nopk | 9:36 AM on 03.01.2008 17 comments


Humanity is responsible for a few terrible and horrendous things visible in the course of history- the Holocaust, Attila the Hun, France, all of the World Wars, the Internet, Oprah, and something that dwarfs them all in comparison- the retarded numerical system for reviewing games.

I will tread lightly because I know that official Destructoid reviews still use them, although I believe they do out of habit.

I love comparisons and juxtapositions, so let’s compare game reviewing to car reviewing. Almost none of the car review sites (or the ones that matter) use the numerical system for reviewing cars because you simply can’t. It’s impossible to quantify a whole car in a single digit because the car itself cannot be quantified. It’s a ballet of engineering and design- much like gaming. Each variable and shape complimenting each other to form something that is as beautiful as it is useful. You could give the new 2008 BMW M3 a 9.0 because it performs extremely well and looks good, but what about the fact that the gearbox is simply atrocious? What about the looks- the reviewer may like the curves, but beauty is in the eye of the beholder; most people don’t like the aesthetics of BMWs at all. And the gearbox? Although the reviewer may not like it, some people like their cars to punch them in the genitalia when they switch gears, because it feels sporty. Autoweek’s reviewer might think the new BMW M3 is great, but I bet the queen of England would hate the way it pummels her labia when she switches into second.


A judge can give an Olympic diver a numerical score because they’re a judge.
Tell me then- are gaming journalists judges, or reviewers?


Games are items of interactivity, balance, and art. Can we start treating them as such? Because every person’s experience with a game will be completely different from someone else’s, literally and figuratively; we need to account for that and start taking a look at our point of view when reviewing a game. Instead of trying to decide how good the sound or graphics were, and what the replayability value was; think about what struck you as good or bad. Was the game worth your $60? What made it worth it? What made it not even worth the two dollars in tax you paid for it? What would bring you back to play the game again?

When we journalists can start asking ourselves these questions, as opposed to fighting with our better halves on how to determine numerical values for each portion of the game; we’ll find ourselves much more receptive to what the reader wants, instead of the editor. Due to the unique and shitty way the gaming industry works, a lot of the time game developers will get the shit end of the stick due to a single number. Because some high school dropout at IGN gives a review of 6.0 instead of the “This is a niche game.” it deserved- a team who spent a lot of time and money making a great game will not get the funding they wanted to make their sequel.

Although sites like Destructoid don’t focus on the number system, but instead, write their reviews and then tack on a number just for good measure; it still irks me when I see the numbers pop up at the end of articles. I see it like this- when you go to a museum, and your friend asks you how it was, do you say to them “9.0”? No, you tell them to drop what they’re doing and go to the fucking thing. When someone asks you how SAW 16½ was, you don’t tell them “1.0”, you tell them to avoid it like a case of syphilis. The same goes for EA’s Skate- instead of a “7.5”, you tell them to go rent and enjoy it.
People want to know what to expect, and whether they should rent it, buy it, or don’t buy it. So let’s start focusing on that, and drop the numerical system we use for putting a set value on a video game.



Hi Guys, Ryan Clements of IGN.com here. When I heard Nopk was reviewing the reviewers, I thought I would step in and Review the Review of the Reviewers.

First of all, Nopk is a complete idiot when it comes to grammar. What the hell does he think –‘s are for? He uses them as often as I cash checks from Nintendo. Zing! I kid I kid, Nintendo doesn’t write checks. They send me cash money. Yowza!!!

Anyways, back to the review. So this article is totally an insight about why my way of reviewing games based on numbers is a bad idea, which frankly, itself is a bad idea because numbers rock. Think about it, if it wasn’t for numbers and maths, we wouldn’t have the space shuttle, Hulk Hogan, or the little plastic packages we put GoGurt in- which by the way, are super awesome. By that logic, don’t you all think we should review awesome games with awesome numbers, and bad games with bad numbers? Here! I’ll do it right now.

This article gets a 1.0. It sucks and it took too long to read. Actually, are there numbers smaller than one? If only I had finished high school.



Is this post awesome? Vote it up!

0



Post a comment! You can also post a photo below:

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

16 comments | showing # 1 to 16
prev next

power-glove's Avatar - Comment posted on 03/01/2008 09:43
power-glove
So what do think of the 1up Network's move to the letter grading system? Smart move or Bad idea.
Also, without the internet there would not be a Destructoid, so it can't be all bad.
nopk's Avatar - Comment posted on 03/01/2008 09:52
nopk
@power-glove
I have a rule against commenting on my own articles, for a few reasons. One of them being starting arguments, but I want to agree with you on your 1up thing.

I like 1UP's initial move away from the numerical system, and although they don't have it quite right yet, I like that they're trying. It is essentially the exact same thing as 1-10 though- if the letters represented "Buy it, Don't buy it, or Rent it." I'd be for it, but they're not. They're still needlessly quantifying games.
Neonie's Avatar - Comment posted on 03/01/2008 10:01
Neonie
@Nopk

Commenting on your own articles, if it's to respond to someone's comment, is a good thing. As it actually let's the people who read your blog see that you care about what they say. At least in my opinion, I try to comment back as many (non-flame) comments as I can on my blog because I hate having people not get a response to what they said. Not to mention it shows that you are responsive to your readers, which mabey I'm just weird, but I see that as a good thing.
notdryad's Avatar - Comment posted on 03/01/2008 10:04
notdryad
Too bad it won't change the fact that 1UP still has Dan Hsu. If that guy could talk once without patting himself on the back for being such a pinnacle of journalistic integrity I'd probably shit so hard that it'd rip through my underwear.
xper's Avatar - Comment posted on 03/01/2008 10:24
xper
1: great write up!

2: "I have a rule against commenting on my own articles, for a few reasons. One of them being starting arguments" - what??

3: Dan Hsu has done more for gaming journalism than anyone else in the business. if someone deserves to pat themselves on the back for it, it's him.

4: i like assigning a value to something, even art/entertainment. but having the general 1-10 system that is common today is hurting the industry. having a letter scale (f-a) or a 1-5 scale is much better, imo. as soon as you give a person the option to be wishy-washy, they will. that's why the the +/- thing 1up has on their letter scale makes their system no more legit than the old 1-10 scale.

having just a rent it/buy it system isn't enough for me. i won't know if the game made that reviewer feel it was great or good, or mediocre or bad, even if i read the entire review. there's much more to scores than a lot of people let on. it's just that it's implemented in such a corrupt and dishonest way nowadays.
RivaOni's Avatar - Comment posted on 03/01/2008 10:27
RivaOni
I have to say, I do agree that a numerical value isn't all that good when it comes to games, what differentiates between a 8 and a 9 for example? and thats before we even get into the argument of the "point something system that the likes of IGN use.

Myself I've always been a fan of /5 if a numerical value is forced, that way you pretty much have Shite, Crap, Average, Good, Fucking Brilliant and its easy to differentiate between a game thats good and a game thats great.
xper's Avatar - Comment posted on 03/01/2008 10:31
xper
sorry for double posting, just gotta say this

the biggest problem right now, with professional enthusiasm for games, is that the rating system and reviewing techniques are used as a means to rate a product rather than an experience.

it's like "how many ounces of gaming does this contain" instead of "what kind of impact did this experience have on me personally, and what objective statements can i evaluate into having a certain impact on my experience"

instead of reviewing products, we should be reviewing art/experiences.
notdryad's Avatar - Comment posted on 03/01/2008 10:47
notdryad
I think you missed my point.

Yes, he has done a lot of good for journalistic integrity for the industry; it just gets a little tiring with how often he loves to pat himself on the back for it. It wouldn't be so bad if Dan had a bite of modesty pie once in a while.
Jetsetlemming's Avatar - Comment posted on 03/01/2008 11:22
Jetsetlemming
Best game reviews online that aren't done in person by people you know that know you; Ars Technica. They do a basic writeup focused on the reviewer's experience while playing the game, rather than a cold breakdown of individual elements, and end not with a review score, but simply a statement of "Buy it" "Rent it", or "Pass".
xper's Avatar - Comment posted on 03/01/2008 11:28
xper
no i didn't miss your point. i understand that you are annoyed by his "un-modesty" about himself. i am not annoyed. you are. no point to be missed.
MaxVest's Avatar - Comment posted on 03/01/2008 12:12
MaxVest
If you disagree with a review, you disagree with it. Does it matter if you disagree with a numerical representation of someone's opinion, or their long-winded rationalization of their opinion?

The reason cars don't get numerical scores is because most people don't buy a few cars per month. It's a big purchase, so most people are going to do more in-depth research, and they'll certainly drive a car before they buy it.

But games are consumable entertainment. Why not rate them numerically? I'm certainly not going to read every game review by every publication. Most of them aren't very good anyway, and I haven't found a "go-to" publication that gets it right every time. Honestly, what's the worst thing about numbers? People bitching about them? Then don't read the comments. A game that I've overlooked that posts good numbers will catch my interest; a high-profile game that gets mixed reviews is a signal for me to wait. What's so terrible about being able to quickly find out these things without having to wade through bloviated reviews by mediocre writers desperately trying to convince themselves they're journalists?
MaxVest's Avatar - Comment posted on 03/01/2008 12:28
MaxVest
Whew, that was impassioned. As you can tell, I like my numbers. It seems to me that a buy / rent / don't buy system is equivalent to a numerical rating system with 3 numbers. Either a game is a 1, 2, or 3.

Additionally, I almost never rent. There are enough good games out there that I don't tend to play games that are not good enough to own. So to me, it's a binary recommendation system: buy / do not buy. This gives me much less information about the author's opinion than ye olde 10-point scale.

Finally, to second everyone else: why not comment on your blog? Starting fights has less to do with commenting, and more to do with the types of comments you make. I think a lot of us here view cblogs as a conversation, not as a prepared statement.
nopk's Avatar - Comment posted on 03/01/2008 13:11
nopk
@MaxVest
Numerical reviews have their downsides regarding industry like I mentioned before. Publishers and developers will refrain from doing sequels and similar games just because of a few fives and sixes.

If you're looking at quickly finding the information you want, why doesn't the yea or neigh system work? If a game is getting mixed yes/noes, then you know to wait.

The beef me and other people have with the numerical system is that it doesn't match the industry. Think about it- if a game got a 9, what are you supposed to do with that information? What's the standard for a 9? Who decides that? Are you able to go into a store with that knowledge and haggle best-buy down on the price?

Also, pricing and length plays a big factor in why numerical reviews don't work. Portal averaged a 9.5 rating throughout all the big sites- but was 3 hours long. Halo was longer than that, and got the same number- but I, along with other people will attest to the fact that Portal was two times better of a game. Period. Therefor, I think Portal should of gotten a 19.

Which brings me to my last issue with numerical reviews. If you think that me saying Portal was better than Halo is a personal opinion, you're right. That's why numerical reviews don't work- you can't quantify and measure things to a standard based on personal opinion. Until we can write AI that will impartially judge and review games for us with a set of standards, the numerical review system does not work.
Namelessted's Avatar - Comment posted on 03/01/2008 13:25
Namelessted
First off, I agree that a number system isn't always the best but it is necessary. Dtoid does add a "rent it" or "buy it" tag with the rating as well if you hadn't noticed. And it is something like that that should be done. you need numbers, but you need something to go with them.

also, they do use numbers for rating cars you dumb fuck. They will have a lot of different categories, but they still use numbers. How do i know this? I watch commercials and see ads in magazines. Every car company on earth will advertise that said car got 5 stars in safety and 5 stars in steering and maneuverability or whatever.

and this is exactly why numbers are absolutely essential and completely necessary to reviewing games and anything else that a company is trying to sell. Without some sort of authoritative source telling people that a game is good, a lot of people won't buy the game. Is that good? maybe not, but it is the truth. And unless you want to try to reprogram 50 million people that have been programmed from birth to want to buy games that other people tell them are good via a number out of ten, then just accept the number system because it isn't ever going away.
Namelessted's Avatar - Comment posted on 03/01/2008 13:34
Namelessted
also, Nopk, a publisher will never refrain from making a sequel based on a couple of fives or sixes. never. If every single publication gave the game a 3 out of 10 but they sold a million copies of the game, I can guarantee you that they will make another game.
nopk's Avatar - Comment posted on 03/01/2008 13:43
nopk
@Namelessted
Firstly, if a game gets nothing but sixes, when it wasn't a six to begin with because the numerical system is bogus, do you think it's going to get millions of copies?

Ever watch Top Gear? Fifth Gear? They don't use numerical systems because it doesn't work.

Euro ENCAP and other safety organizations use the numerical star system because... THEY HAVE A BENCHMARK! There is no personal opinion when it comes to rating a car's safety. They have set standards and guidelines to follow. IGN and Gamespot don't.

And like I said, reputable car review sources will give you raw numbers and information as opposed to what they think. They will tell you break horse power, torque, engine specifications, turning radius and speeds, and other information. Reputable sources will say what they think of a car's performance, but will let you reinforce those ideas with real information.

When I see a 7.0 on IGN, all they have to go on is what the reviewer thought of it in comparison to others in the market.
prev next

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!