I like
Crispy Gamer. I really do. I think it's staffed by some of the most talented writers in the business and in a Metacritic-driven world of reviewing wasn't afraid (at least not until recently) to fry a game in spite of popular opinion. They don't use any scoring system that could be counted on a score aggregator (just 3 ratings?!), and have some really good columns.
I didn't agree with some of their reviews, but that's fine. I'm not dumb enough to think that reviews of popular games MUST have a counter-opinion to be valid, but a diversity of perspective is always welcome, especially within the enthusiast press. Crispy Gamer's "Game Trust" records were proof enough that they weren't just flamebaiting or trawling for attention. And if they were, it hasn't worked, since I honestly have not seen anyone who reads Crispy Gamer outside of myself and the personal blogs what you might call the games journalism "elite". Not, of course, to say that I am one of them (I sure as hell aspire to be), but rather that the site seems rather "fringe" (perhaps due to the rating system?).
But I digress. I'll get into it now, with these last disclaimers:
I'm writing this piece on January 19th. The piece in question was posted on CG on January 6th. To those who've followed it, this'll seem like a "me-too" post, and for the most part it is. I mostly agree with what I've said and am going to say, and as such I believe I'm not just dogpiling on CG because it's the cool thing to do.
Anyway, the skinny:
Scott Jones, senior writer at Crispy Game, posted a tell-all editorial entitled
"Critic in Exile: Is It OK to Finally Admit That I Didn't Really Like Fallout 3 All That Much?".
Jones in essence confesses that he (and others unnamed) voted for
Fallout 3 as game of the year
in spite of his personal dislike for the game. Over the next few pages he describes why, exactly, he didn't like the game, much in the same way
Anthony Burch voiced his own dislike of
Prince of Persia. That's fine, no biggie, right? Sure, but the most important part of this is that
he voted it for GotY even when he had solid reasons not to. What in the nine hells could have possessed him to do such things?!
He mentioned in the first few sentences that he (and those unnamed others) had all included the
Fallout 3 in their top-ten lists or handed it a GotY vote in spite of their inability to tolerate more than a few hours of the game. Mind you, I think that's a fair amount of time to make a basic judgment, especially given the kind of exposure they get to a big title up to and including the actual writing. Sites like Gamespot and even Destructoid have seen much more of a given game than any end consumer pre-release, by virtue of hands-on previews, trade shows, and even
a constant stream of screenshots.
But this is extremely disingenuous on Jones' part. Sure as hell, he should have known better. It's been said that trust is the currency of the internet, and that's ironically what Crispy Gamer calls its stable of contributors, "The Game Trust". Trust is why we read critics and reviews in the first place! If we can't trust that your opinion of a game (and your vote) is honest, how is your credibility any more valid than that of, say,
[Eidos?!
This is worse than "Gerstmann-gate", because at least in that fiasco most of the information we have is the product of speculation. None of us besides Jeff Gerstmann himself knows all the details, and it's likely we'll never
really know. But here Scott Jones has just 'fessed up to some almost disgustingly unethical behavior! Of all people, critics should know they need to be
honest. What's worse, part of his reasoning includes
fear of backlash (hence the title "Critic in Exile")!
BACKLASH?! Good lord. If he didn't like it, he shouldn't have voted for it, it's as simple as that.
Or is it? A user on the comment roll (easily the longest string of comments on any of CG's posts today), "RyanKuo", volunteered an interesting defense:
"My favorite (music) critic, Simon Reynolds, wrote this about end-of-year lists the other day:
“…for a certain kind of person there’s always going to be a fatal confusion of Favourite and Important, matters-to-me and Matters, pleasure and ‘truth’ … You can see various impulses battling it out–the gigantism of all-inclusiveness versus whittle-it-down brevity … The shorter the list (the thinking goes) the less likely it’ll succumb to worthiness, tokenism, dutiful eclecticism that doles out praise across the genrescape, and other liabilities of the profession.”
It arguably takes a more sophisticated critic to realize that these two concepts (favorite vs. important) exist side-by-side, let alone are often at odds with each other. That you cultivate a personal taste, with its own rules, alongside the supposedly objective critical one, which is built up by readers and some righteous critics to be some seamless, deterministic slide towards the Truth.
Getting caught up in “worthiness, tokenism, dutiful eclecticism” is part of all criticism — as a RESULT of striving for objectivity — and it speaks volumes about games journalism that this is an alien concept, gets immediately mis-read as simple peer pressure."
That's definitely worth considering. As Jim Sterling himself
mentioned, critics aren't immune to hype. They are as vulnerable as we are when it comes to getting excited about something, particularly since they're easily as enthusiastic we are about video games, perhaps moreso.
And there IS a difference between taste and fact, especially when it comes to creative works as complex as video games. You might agree that
Persona 3 does a lot for jRPGs, but just absolutely
hate the anime art style, perhaps because, I don't know, an anime raped your dog. Should you let that affect your score? Should you still rate a game highly if you
admire it, but not
like it? Even Yahtzee mentioned it with
Mirror's Edge. He thought it was crap, but that the fact it existed at all was a good sign. Perhaps that's the way to do it. Leave your "A for Effort"'s on your blog, and vice-versa.
Another thing to consider is a possible difference between "critics" and "reviewers". Reviewers need to take in all possible preferences and aspects of a given game, and as such need to be "objective" (as if it were actually possible), but it's a critic's
entire job to voice a
personal opinion. Should there even
be a difference between a critic and a reviewer? Movies don't make that distinction. Then again, movies are way different than games. N'gai Croal
opined on the matter after Keith Stuart lambasted reviewers for not giving
Mirror's Edge innovations more credit.
Then again, that' stuff for a symposium. The real killer that absolutely kills the defense of Jones' action was that in the article itself, Scott Jones was considering voting for less universally-liked games like
The Force Unleashed or
Mirror's Edge, but went with
Fallout 3 for fear of tarnishing his reputation. That's pretty ironic, considering that with this he's tarnished his rep even more with this, than if he'd voted for the Star Wars game.
(# 0) on 01/19/2009 13:50
Giant Bomb (.com) did a podcast solely for hashing out their game of the year, and it was kind of a fascinating process. They cam across a point where, even though some of them had other favorites, where they decided the vote would be between GTAIV and MGS4. Their tact toward GOTY became a thing not just of favorite gameplay moments, but a summation of effort, care and artistry as a total package.
Games and Movies have to have very different processes, I think. Where as a movie is in itself a passive consumed item that has a dollar worth of about $8 to consume, a new game costs $40 and upward. And further, has a number of interactive factors that just do not come into play with movie consumption. Criticism is something that should be strived for in games (Destructoid and Kotaku go into very well with tier features, as well as Gamers With Jobs), but the history of video game review, from print to IGN, has been at its core about a consumer product review. Its kind of like a tool for creating enjoyment through play (games) versus an item that present something for enjoyment (movies).
All told, I don't think this compares much to "gerstmann-gate" - because there isn't a company payoff (ad dollars and suits) involved in augmenting the score. This is just the industry starting to come to terms with its consumer-review based history.
(# 1) on 01/19/2009 13:56
I think it would be really interesting if Destructoid and other websites implemented some thoghts on wheather they personally like the said game, and what the game does and doesn't do to push gaming forward. Jim, are you listening?
(# 2) on 01/19/2009 14:30
[i]
All told, I don't think this compares much to "gerstmann-gate" - because there isn't a company payoff (ad dollars and suits) involved in augmenting the score. This is just the industry starting to come to terms with its consumer-review based history.[/i]
Perhaps that's the question, really. Should reviews just stay as product guides? Is there a place for personality-based critiques (as say, with movie reviewers and art critics) in an environment built on buying recommendations?
I say hell no. If we're ever to consider games as art, we'll need artsy-fartsy reviews and critics to go with them. The challenge will be in finding a proper balance between buying guide and art essay. If you ask me, the first step would be to start scrapping scores.
(# 3) on 01/19/2009 14:32
Of course, the problem here is that everyone has their own idea for GOTY and unfortunately that means there could be as many as one vote for different games per person--a total deadlock. But I also feel that it is impertinent to rate a game so highly even if you didn't see it so well. It undermines the entire point of actually reviewing a game, or we'd end up just having a game being rated by its popularity or hype.
Okay, so I know that happens anyway. >_>;
(# 4) on 01/19/2009 14:34
Videogames are much more like sports than movies are, in that if you like a certain type of sport, you don't necessarily have any interest or understanding in another type of sport. With movies, if you like the medium, you'll find some use for every genre in that medium. On the other hand, with videogames you could easily spend your entire gaming career playing nothing but one type of game, and never feel any interest in other genres.
I've been playing games for about 38 years, and I still have absolutely no interest in sports games. As such, I would never vote for a sports game as my GOTY, or even review a sports game for this site, because I have absloutelty no interest or understanding of the genre.
That's what it sounds like this Scott Jones fella did, he tried to speak to a genre of game he has no interest in. That's the only valid explanation as to why he would feel that the game was well crafted enough to endorse for GOTY, even though he just didn't enjoy it.
(# 5) on 01/19/2009 15:03
If you consider that argument, it tends to render all kinds of criticism invalid. With that attitude, the only valid judgment of any game becomes "If you like this sort of thing, you'll like this."
Game reviews shouldn't be passed on only to people "who like that sort of thing". Sure, you have to consider personal preference, but your opinion is worthless if all you can do is preach to the choir.
And this fiasco extends beyond mere genre preference. Jones essentially lied about his opinion. He didn't like Fallout 3, but voted for it anyway "in recognition" of its ambition and lofty goals, and out of fear that people might think less of him for liking "lesser" titles.
This is exactly what Jim was talking about when he wondered about hype affecting review scores. Ambitious projects with lofty goals CAN STILL FAIL.
(# 6) on 01/19/2009 15:08
[i]"Sometimes you might detest a genre you're asked to review, so unfairly give a low score because you literally don't know any better. In that case, you could blame the editor, because your opinion on that would be worth no more than my mother's, but you don't blame the marketing department for your own weaknesses.
You have now undermined the faith of the reader in your integrity and in this website. Your mistake was not to admit now how you feel, but in failing to do so in the first place, when it was the only thing you were ever being asked to do."[/i]
(# 7) on 01/19/2009 15:09
I think game reviewers should stick to expressing their preferences as opposed to pursuing some objective ideal. The medium just doesn't have any sort of coherent standard of excellence that can be invoked, and is ruled by such divisive groups that none seems likely to emerge in the near future. Reviews should be in-depth recommendations, with readers left to sift through the multitude of reviewers currently cluttering the internet to find one or many who generally match their own taste. Because that's what the real conflict here is, whether taste has any role in game journalism, and I don't see how it can be avoided.
In short: I agree. Your portrayal just strikes me as a bit harsh.
(# 8) on 01/19/2009 15:32
(# 9) on 01/19/2009 16:01
I do think that honesty and backing up your arguments are the most important things for reviewing anything, but if a guy makes a mistake, is he able to overcome it and make amends, or is one incident enough to ruin him?
(# 10) on 01/19/2009 18:24
Sure, in as far as he did the right thing by 'fessing up, but if you read the article, there's not even a hint of remorse, or even acknowledgment that what he did was wrong.
Was it truly wrong? In this case, YES. He gave a variety of reasons as to why he though FO3 wasn't so much fun, and made a compelling case.
Will this "Crispy-gate" end Scott Jones? No. I respect him as a writer and I enjoy his reviews. I will continue to read Crispy Gamer, and frankly speaking, GotY awards are largely a farce (this incident sure as hell isn't helping). As mentioned, he did make a compelling case for why FO3 didn't deserve his praise. But why the f*ck didn't he do it in the first place?! He waffled, and in doing so, did a disservice to himself, his readers, and the site he works for. As SENIOR WRITER, I might add.
@Mentok the mindtaker
I think it would be a good thing if we ALL tried to type a little more, don't you?
(# 11) on 01/19/2009 21:29
It's interesting, given what Crispy Gamer is supposed to be about in the first place, according to this article:
http://venturebeat.com/2008/10/26/game-journalism-sucks-so-crispy-gamer-raises-money-for-an-alternative-voice/
(# 12) on 01/20/2009 00:38
By bias I don't mean "Xbox Fanboy" or "PS3 Fanboy" or any of those negative terms, I simply mean the person's personal preference. What really bothers me in terms of game reviews is the general "pretense of objectivity" where a person will claim to not be affected by anything aside from how well the game is made (CNET's "unbiased reviews" tagline is the most noteworthy offender)
People aren't objective though, everyone has their own personal tastes, and this is where the problem lies. As this editor states in his blog, he didn't like Fallout 3, but he knew it was well designed, well written, etc. Instead of writing what he believed, he accentuated the game's good points and went along with the general review scores.
People are so quick to cry foul whenever scores deviate from the norm, so perhaps that is why editors don't often dare to express their own opinions. I hope that one day we as gamers realize that everyone is going to have a different opinion, and that review scores, while helpful as a general guide, are not necessarily the end all and be all in terms of game quality.
(# 13) on 01/21/2009 11:45