Numeric (or letter) scores are a necessary evil in criticism today. Not a lot of people have the time or the desire to read 1500 word reviews of a game. “Just give me the score” is the mantra of many when reading reviews.
Out of this trend grew sites like metacritic.com and gamerankings.com, sites that take the aggregate scores from all major and some minor publications – Web based and otherwise, and create one uber-score. While these sites clearly hold value – instead of reading one, two or even three reviews, one has access to at least 20 different scores - do they do more harm than good?
I check metacritic.com a few times a day. Check how scores of my favorite titles are doing, what new titles are up and what sites X, Y, Z had to say about a new release. I know I am not alone. Whether it is film, literature, music or video games, before consumers decide to put money and time into their chosen form of entertainment, they want to know how “good” it is.
In regard to video game criticism, nothing has hurt the medium more than aggregate sites. They boil game reviews down to their most basic element and throw out the actual writing (save for a 1-2 sentence blurb).
Video games are the most affected by scores for a few reasons. The time investment in video games is only (maybe) rivaled by books. A game can take anywhere from a few hours to upwards of 40 to complete – not to mention extra features and multiple times dying. That’s a lot of time - I for one am not about to drop $59.99 on a game that gets poor reviews.
If you spend $10 to see a bad action flick with a couple of buddies on a Friday night, it is a fine way to spend an evening. But if that movie was $60, lasted for 12 hours and had no multiplayer? No thanks.
The audience for video game scores is also somewhat at fault. They are among the most savvy and opinionated entertainment consumers. This is obviously a good thing, but can also be problematic. An example is the saying, “I won’t buy a game unless it gets *score*.” We’ve all done it, and whether we actually adhere to it or not is beside the point.
A personal example of that phenomenon is the game Assassin’s Creed. I was extremely excited for this game to come out. I had been following it for a while and only got more excited the more videos leaked and previews I saw. Then it came out. To say the reviews were mixed is being kind. From “disappointing and repetitive” to “joins the guild as the best sandbox game created to date,” it became harder and harder for me to justify dropping $60 on it.
Had I only been privy to the IGN or Gamepro reviews (77 and 100, respectively) like in the past, I may have bought the game. Would I have been disappointed and short $60? I don’t know. My guess is yes. But maybe I would have loved it, flaws and all. The reality is I can’t buy every game I am excited for.
The point is the aggregate scores (more so the mixed comments but) steered me away from a game that I had actually circled on my calendar. Now before everyone says “You should have just bought it, screw reviews!” remember I am not rich - $60 is a lot of money and with so many great titles, I only want to spend on the best. It’s a difficult decision to make.
Another factor video games are affected by more is the hype machine. Games are announced months, sometimes years, in advance. This gives the consumer time to get lathered up talking about it, speculating about content and tracking screen shots and videos.
The music industry suffers from this too. MP3’s leak very early quite often and are readily available. An upcoming record from a popular group can become very hyped (Radiohead, Arcade Fire from just last year). But music is cheap (see: free) and you can actually go on a bands myspace and listen to the songs before making a decision to buy it. Sure, you can rent games - but that is, again, not free.
The sad truth is too many a game review takes the hype into account, pointing out all the things we were promised months ago and how they’re now absent. Look at a game like Fable. It was supposed to be the next greatest game ever. And when it fell short of lofty, impossible standards, it was punished. Was it a great game? Not really. But it wasn’t nearly as disappointing as many reviews would have you believe. Maybe Assassin’s Creed is the same…
The final point is the convoluted and varied scoring system video game sites use. Movies generally roll with the five-star system - it’s almost universally agreed upon. Video game scores, on the other hand, are all over the place. Letter grades, 100 point scales, ten point scales, but with decimals to the tenth – it’s ridiculous. What the hell is the difference between a 8.1 and an 8.3?
It is a huge task to ask every publication to standardize their scoring system, but that would eliminate a lot of confusion and the need for aggregate sites. Whether it’s a five star scale or a simple “rent it, buy it, skip it” system, anything universal would be better than the mess that exists now.
Score aggregate sites are here to stay. They provide a valuable service to the informed consumer. But it is very disappointing to see their efficiency stifle some of the great writing that goes on in the world of video game journalism. In a perfect world no review would have scores - it would just be what the writer wrote. Imagine that.
We'll never get away from number based reviews but at least we might have alternatives to them.
The cure to these condensed review encapsulations is an easy one. READ the reviews in it's entirety then make up or make up.That's that the internets are for y'know. Or you could just wait for our reviews of those games here @ Destructoid. We are of course the final word on reviews around here.
Good read & Good Topic as well.
I gave it a 11 /11! Read NOW!
@kryptinite:
Also when did Superman become a brother? What issue did that happen in?? :)
I agree, being different (not using scores, or actually making people read your review) is good, but being universal may be better in the end.
Well remember when Superman died? He was resurrected as a black dude.
So whatever issue Doomsday beat his ass.
lol.
Sometimes a game gets a low score and it's a simple matter of the reviewer simply not being into the kind of game it is. Compare the score Rez HD got on 1up versus Dtoid. Big difference in points. The 1up reviewer loves the music and the kind of game that it is, while the Dtoid'er just didn't get into it.
Anyway, the point I'm making is that the score doesn't tell the full story. The written review is the most important, and that usually can't be broken down into a two sentence blurb and score. For that reason, aggregate sites do fail. But at least they can be used as a portal to the written reviews.
I like the numbers. And I am lazy; while I may not tend to agree with any specific critic's subjective views, I do often find the view of the majority persuasive. Why is it so bad to make the author assign a gut reaction numerical score? I play games for the gut reaction, not for the critical analysis.
When you skip full reviews in favour of an aggregate one, the individual reviewers who consitute the metascore do not recieve any advertising income. The idea of aggregate reviews is not really sustainable. I'll also point out that metacritic is owned by cnet, so no use turning to it if you are turned off gamespot by the gerstmann afair.
I've personally always favoured reading reviews in thier entirety as it provides much greater insight into whether I would enjoy it rather than the score which is only whether the reviewer liked it or not.
And if people disagree with the score, so be it. If a reviewer pretends that she assigned the score through a rational analysis, people are going to keep arguing for the consideration of additional facts. Just be honest. I love reviews that are honest enough to say:
"An average score for me is 6. This game felt like an 8, but not good enough to be an 8.5 on my purely subjective scale of good times. Now let me tell you a little bit about the game and myself, so you can see if we share the same aesthetic..."
If a consumer is savy I think they would read a full review rather than just look at a score. A site or publication builds a reputation for doing good reviews and consumers who want to do more back checking than a simple number will read the reviews from sites with a good reputation.
I agree with your post.
Anyway, nice article.
Two games of comparable genre are released. One is rated an 8.2 and the other, a 8.4. You can only buy one. Without reading the review, which do you buy?
Also, can't gut reactions change? The IGN review of Assassin's Creed said something to the effect of if you play this game for an hour you'll think it's great. Gut reactions of a lot of RPGs can be "this sucks, it's boring."
I am not saying numbers are totally destroying video game journalism, which, yes there is much more high quality of now. I am saying aggregate scoring and pressure to attach scores to reviews is hurting it.
Another problem I didn't address was that metacritic weighs their scores (bigger publications worth more) and infers as to what some reviewers 100 point score would be. A "B+" is like an 85 and "four stars" would be a 90, or something. That's a problem.
I hate to bring up EGM/1up a lot on this site, but I listen to a lot of their podcasts. They are, incidentally, in the process of going from a 10 point decimal rating system to a grade school letter based rating system. That should mess things up for the aggregate sites a bit.
I give this post an A. A is for AWESOME.
And as Maxx77 pointed out, 1up will be moving to the grade school point system. Maybe they'll start a trend? I kinda hope so, as I like the idea of a universal score system.
The problem is that the industry has become as much as, if not more stagnant than the movie industry. If a game sells well it immediately becomes a 'franchise', graphics in many cases are becoming more important than any other aspect of a game and so on.
If there wasn't so much shit pushed out of doors constantly we would have more time to read up on new releases and decide what would appeal to us.