Quantcast
Destructoid - Count Grishnack's Community Blog




About Me
My name is Jason Cook, I am a English/journalism grad with a rabid interest in gaming and game writing. I have some reviews on Popmatters.com and would love to work for a gaming site/magazine someday soon.

I grew up on the NES, quickly advancing to Genesis, SNES, PS1, Dreamcast (RIP, brother), Xbox, PS2 and now 360 and Wii. Some favorite genres include RPGs (huge FF geek), Action and Shooters.

I also love music, sports (run-of-the-mill rabid Boston sports fan), reading and am getting into graphic novels and comics.

Currently playing:
SMT: Strange Journey

Ongoing list of games I need to buy/play:
Silent Hill
Viewtiful Joe
Okami
Fatal Frame series
Resident Evil 1 & 2
Eternal Darkness
Beyond Good and Evil
Gears of War 1 & 2
Gamer Profile
3DS friend code:
Steam:
Battle:
PSN:
Mii: jasonexplosion@yahoo.com
Gamertag: Count Gr1shnack
Following (2)
Brad Nicholson
Jim Sterling
How aggregate sites are ruining video game journalism
Count Grishnack | 10:24 AM on 02.11.2008 29 comments




Numeric (or letter) scores are a necessary evil in criticism today. Not a lot of people have the time or the desire to read 1500 word reviews of a game. “Just give me the score” is the mantra of many when reading reviews.

Out of this trend grew sites like metacritic.com and gamerankings.com, sites that take the aggregate scores from all major and some minor publications – Web based and otherwise, and create one uber-score. While these sites clearly hold value – instead of reading one, two or even three reviews, one has access to at least 20 different scores - do they do more harm than good?

I check metacritic.com a few times a day. Check how scores of my favorite titles are doing, what new titles are up and what sites X, Y, Z had to say about a new release. I know I am not alone. Whether it is film, literature, music or video games, before consumers decide to put money and time into their chosen form of entertainment, they want to know how “good” it is.



In regard to video game criticism, nothing has hurt the medium more than aggregate sites. They boil game reviews down to their most basic element and throw out the actual writing (save for a 1-2 sentence blurb).

Video games are the most affected by scores for a few reasons. The time investment in video games is only (maybe) rivaled by books. A game can take anywhere from a few hours to upwards of 40 to complete – not to mention extra features and multiple times dying. That’s a lot of time - I for one am not about to drop $59.99 on a game that gets poor reviews.

If you spend $10 to see a bad action flick with a couple of buddies on a Friday night, it is a fine way to spend an evening. But if that movie was $60, lasted for 12 hours and had no multiplayer? No thanks.

The audience for video game scores is also somewhat at fault. They are among the most savvy and opinionated entertainment consumers. This is obviously a good thing, but can also be problematic. An example is the saying, “I won’t buy a game unless it gets *score*.” We’ve all done it, and whether we actually adhere to it or not is beside the point.



A personal example of that phenomenon is the game Assassin’s Creed. I was extremely excited for this game to come out. I had been following it for a while and only got more excited the more videos leaked and previews I saw. Then it came out. To say the reviews were mixed is being kind. From “disappointing and repetitive” to “joins the guild as the best sandbox game created to date,” it became harder and harder for me to justify dropping $60 on it.

Had I only been privy to the IGN or Gamepro reviews (77 and 100, respectively) like in the past, I may have bought the game. Would I have been disappointed and short $60? I don’t know. My guess is yes. But maybe I would have loved it, flaws and all. The reality is I can’t buy every game I am excited for.

The point is the aggregate scores (more so the mixed comments but) steered me away from a game that I had actually circled on my calendar. Now before everyone says “You should have just bought it, screw reviews!” remember I am not rich - $60 is a lot of money and with so many great titles, I only want to spend on the best. It’s a difficult decision to make.

Another factor video games are affected by more is the hype machine. Games are announced months, sometimes years, in advance. This gives the consumer time to get lathered up talking about it, speculating about content and tracking screen shots and videos.

The music industry suffers from this too. MP3’s leak very early quite often and are readily available. An upcoming record from a popular group can become very hyped (Radiohead, Arcade Fire from just last year). But music is cheap (see: free) and you can actually go on a bands myspace and listen to the songs before making a decision to buy it. Sure, you can rent games - but that is, again, not free.

The sad truth is too many a game review takes the hype into account, pointing out all the things we were promised months ago and how they’re now absent. Look at a game like Fable. It was supposed to be the next greatest game ever. And when it fell short of lofty, impossible standards, it was punished. Was it a great game? Not really. But it wasn’t nearly as disappointing as many reviews would have you believe. Maybe Assassin’s Creed is the same…

The final point is the convoluted and varied scoring system video game sites use. Movies generally roll with the five-star system - it’s almost universally agreed upon. Video game scores, on the other hand, are all over the place. Letter grades, 100 point scales, ten point scales, but with decimals to the tenth – it’s ridiculous. What the hell is the difference between a 8.1 and an 8.3?



It is a huge task to ask every publication to standardize their scoring system, but that would eliminate a lot of confusion and the need for aggregate sites. Whether it’s a five star scale or a simple “rent it, buy it, skip it” system, anything universal would be better than the mess that exists now.

Score aggregate sites are here to stay. They provide a valuable service to the informed consumer. But it is very disappointing to see their efficiency stifle some of the great writing that goes on in the world of video game journalism. In a perfect world no review would have scores - it would just be what the writer wrote. Imagine that.



Attached photos:

Photo Photo Photo Photo

Is this post awesome? Vote it up!

0



Post a comment! You can also post a photo below:

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

25 comments | showing # 1 to 25
prev next

BS3 Owner's Avatar - Comment posted on 02/11/2008 10:41
BS3 Owner
This Blog = 11 / 11!
Kryptinite's Avatar - Comment posted on 02/11/2008 10:49
Kryptinite
I highly agree with this post. I might be in the minority (not only because I'm black) but because I hate number based scores. Soon as I get my setup running at home I'll be attempting to review games not on a number based system but on a Buy/Rent/Avoid system. Factors will include price/fun ratio and some other factors I haven't thought of yet.

We'll never get away from number based reviews but at least we might have alternatives to them.
DrNutt's Avatar - Comment posted on 02/11/2008 10:53
DrNutt
I'm not reading this blog unless it gets an 8.5.
Y0j1mb0's Avatar - Comment posted on 02/11/2008 10:59
Y0j1mb0
Those sites are there for the ADD of most game players and they'll continue to prosper because of it. As far as a universal model for all to use..that's not going to happen either. Gotta make our site different than everybody else's..even though their the same.lol.

The cure to these condensed review encapsulations is an easy one. READ the reviews in it's entirety then make up or make up.That's that the internets are for y'know. Or you could just wait for our reviews of those games here @ Destructoid. We are of course the final word on reviews around here.

Good read & Good Topic as well.
BS3 Owner's Avatar - Comment posted on 02/11/2008 11:03
BS3 Owner
@ DrNutt


I gave it a 11 /11! Read NOW!
Y0j1mb0's Avatar - Comment posted on 02/11/2008 11:04
Y0j1mb0
I meant READ the reviews in it's entirety then make your mind up.That's what the internets are for y'know.

@kryptinite:

Also when did Superman become a brother? What issue did that happen in?? :)
Count Grishnack's Avatar - Comment posted on 02/11/2008 11:10
Count Grishnack
I think the "need to be different" is the reason why there's stuff like 7.8 and 8.2. Sites were like "eff using a ten point scale - we're going more IN-DEPTH." When actually, it's just stupid.

I agree, being different (not using scores, or actually making people read your review) is good, but being universal may be better in the end.
Aaron Mxy Yost's Avatar - Comment posted on 02/11/2008 11:11
Aaron Mxy Yost
I give this blog 9.4 pandas humping whales.
Kryptinite's Avatar - Comment posted on 02/11/2008 11:14
Kryptinite
@Y0j1mb0

Well remember when Superman died? He was resurrected as a black dude.

So whatever issue Doomsday beat his ass.
Y0j1mb0's Avatar - Comment posted on 02/11/2008 11:18
Y0j1mb0
@Kriptinite:

lol.
maxx77's Avatar - Comment posted on 02/11/2008 11:33
maxx77
I agree with most of this, but I do like the fact that Metacritic links to the sites (when possible) so that you can read the critic's review. I find the full reviews much more informative than the score assigned. It's not important to really know what score a game was given, what's important is why the reviewer felt it deserved that score.

Sometimes a game gets a low score and it's a simple matter of the reviewer simply not being into the kind of game it is. Compare the score Rez HD got on 1up versus Dtoid. Big difference in points. The 1up reviewer loves the music and the kind of game that it is, while the Dtoid'er just didn't get into it.

Anyway, the point I'm making is that the score doesn't tell the full story. The written review is the most important, and that usually can't be broken down into a two sentence blurb and score. For that reason, aggregate sites do fail. But at least they can be used as a portal to the written reviews.
MaxVest's Avatar - Comment posted on 02/11/2008 11:47
MaxVest
But isn't there more -- and higher quality -- video games journalism today than ever before? Has film journalism been irretrievably damaged by having to award a score at the end?

I like the numbers. And I am lazy; while I may not tend to agree with any specific critic's subjective views, I do often find the view of the majority persuasive. Why is it so bad to make the author assign a gut reaction numerical score? I play games for the gut reaction, not for the critical analysis.
Aciesethon's Avatar - Comment posted on 02/11/2008 11:50
Aciesethon
You raise good points but missed a major one.
When you skip full reviews in favour of an aggregate one, the individual reviewers who consitute the metascore do not recieve any advertising income. The idea of aggregate reviews is not really sustainable. I'll also point out that metacritic is owned by cnet, so no use turning to it if you are turned off gamespot by the gerstmann afair.

I've personally always favoured reading reviews in thier entirety as it provides much greater insight into whether I would enjoy it rather than the score which is only whether the reviewer liked it or not.
MaxVest's Avatar - Comment posted on 02/11/2008 11:58
MaxVest
Or to put it another way: regardless of how much navel-gazing a review may contain, I believe that reviewers first have an overall impression of how much they like a game, and then try to rationalize that impression. That's how humans tend to operate. So don't force me to read a bunch of free-lance rambling that I probably don't care about anyway. I want a review that serves the reader, not the writer.

And if people disagree with the score, so be it. If a reviewer pretends that she assigned the score through a rational analysis, people are going to keep arguing for the consideration of additional facts. Just be honest. I love reviews that are honest enough to say:

"An average score for me is 6. This game felt like an 8, but not good enough to be an 8.5 on my purely subjective scale of good times. Now let me tell you a little bit about the game and myself, so you can see if we share the same aesthetic..."
CaffeinePowered's Avatar - Comment posted on 02/11/2008 11:58
CaffeinePowered
Very nice post, however, couldn't you say the same thing about a night to the movies or a book at least in terms of people not necessarily reading the review but just looking up an aggregate.

If a consumer is savy I think they would read a full review rather than just look at a score. A site or publication builds a reputation for doing good reviews and consumers who want to do more back checking than a simple number will read the reviews from sites with a good reputation.
Soulhammer's Avatar - Comment posted on 02/11/2008 12:03
Soulhammer
I think the key is to take a review for what it is, one persons point of view. Like with AC, and its mixed reviews, who is to say who is right in their opinion? I think the best way to find out if a game is good or not is to play it. Do you have to shell out 60 bucks only to find out that the game sucks a fatty? No.. rent it.

I agree with your post.
Web Slinger's Avatar - Comment posted on 02/11/2008 13:04
Web Slinger
Just to touch on one of your points, with the Xbox Live marketplace, plenty of demos are available for download, free of charge, in order to try out a game before buying. Sure, it's not the full thing, but you often cannot listen to a full album on myspace.

Anyway, nice article.
Kyousuke Nanbu's Avatar - Comment posted on 02/11/2008 13:21
Kyousuke Nanbu
Don't buy anything based on reviews then, gamefly and rentals stores let you test before you buy.
Count Grishnack's Avatar - Comment posted on 02/11/2008 15:40
Count Grishnack
@MaxVest
Two games of comparable genre are released. One is rated an 8.2 and the other, a 8.4. You can only buy one. Without reading the review, which do you buy?

Also, can't gut reactions change? The IGN review of Assassin's Creed said something to the effect of if you play this game for an hour you'll think it's great. Gut reactions of a lot of RPGs can be "this sucks, it's boring."

I am not saying numbers are totally destroying video game journalism, which, yes there is much more high quality of now. I am saying aggregate scoring and pressure to attach scores to reviews is hurting it.

Another problem I didn't address was that metacritic weighs their scores (bigger publications worth more) and infers as to what some reviewers 100 point score would be. A "B+" is like an 85 and "four stars" would be a 90, or something. That's a problem.
maxx77's Avatar - Comment posted on 02/11/2008 16:19
maxx77
One thing to look out for with the aggregate sites is the timing of when you refer to them. One of the things I learned about the Ubisoft/EGM fallout is that Ubisoft had forced reviewers to sign a non-disclosure agreement preventing them from releasing scores for Assassin's Creed until the day it came out. EGM spotted several sites breaking the date and posting their scores early. They asked Ubisoft if they could do the same and were told no. It turned out that the sites that were breaking the date were posting high scores. Ubisoft was allowing anyone who liked the game to post their reviews early, while everyone else had to wait. So, if you had gone to Metacritic a few days before Assassin's Creed came out, you'd have thought it was a 90 or something.

I hate to bring up EGM/1up a lot on this site, but I listen to a lot of their podcasts. They are, incidentally, in the process of going from a 10 point decimal rating system to a grade school letter based rating system. That should mess things up for the aggregate sites a bit.
maxx77's Avatar - Comment posted on 02/11/2008 16:23
maxx77
I just looked up Assassin's Creed on Metacritic. EGM gave it one of the lowest scores, 58. Destructoid gave it the next lowest score, 55!
The Faux-Bot's Avatar - Comment posted on 02/11/2008 16:26
The Faux-Bot
Your right, its here to stay. I guess we'll never have some sort of unified system. just be glad that if your the kind of person who bothers to read reviews, then you'll save the money. I shan't shed a tear for the other chumps who don't bother to investigate.

I give this post an A. A is for AWESOME.
AfroJoel's Avatar - Comment posted on 02/12/2008 00:54
AfroJoel
Rad blog man.

And as Maxx77 pointed out, 1up will be moving to the grade school point system. Maybe they'll start a trend? I kinda hope so, as I like the idea of a universal score system.
Samit Sarkar's Avatar - Comment posted on 02/12/2008 01:09
Samit Sarkar
This is yet another great read! I find score-aggregate sites such as Rotten Tomatoes and Metacritic very useful to get an initial impression of the quality of a movie or game, but I’ll always check out a few individual reviews to get down to the nitty-gritty, so to speak. If people can’t be bothered to do that, that’s unfortunate...for them.
Timmeh's Avatar - Comment posted on 03/11/2008 07:44
Timmeh
As with probably a lot of people, I will usually check against metacritic initially, and if the game/movie/album has a dire score then I'll forget about it, if the score is, say, 60+ I'll then start to look at individual reviews on to get a better feel before I decide to stump up some cash.

The problem is that the industry has become as much as, if not more stagnant than the movie industry. If a game sells well it immediately becomes a 'franchise', graphics in many cases are becoming more important than any other aspect of a game and so on.

If there wasn't so much shit pushed out of doors constantly we would have more time to read up on new releases and decide what would appeal to us.
prev next

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!