games  anime  |  toys
This is a Destructoid readers's blog. For staff blogs click here. Confused? read this Create you own Dtoid blog, it's free!  |   Returning members: Login now


[ Josh Tolentino's blog ]



Ugh, this is worse than Cashwhore: Can We Trust The Game Trust?
Josh Tolentino | 1:33 PM on 01.19.2009 14 comments




I like Crispy Gamer. I really do. I think it's staffed by some of the most talented writers in the business and in a Metacritic-driven world of reviewing wasn't afraid (at least not until recently) to fry a game in spite of popular opinion. They don't use any scoring system that could be counted on a score aggregator (just 3 ratings?!), and have some really good columns.

I didn't agree with some of their reviews, but that's fine. I'm not dumb enough to think that reviews of popular games MUST have a counter-opinion to be valid, but a diversity of perspective is always welcome, especially within the enthusiast press. Crispy Gamer's "Game Trust" records were proof enough that they weren't just flamebaiting or trawling for attention. And if they were, it hasn't worked, since I honestly have not seen anyone who reads Crispy Gamer outside of myself and the personal blogs what you might call the games journalism "elite". Not, of course, to say that I am one of them (I sure as hell aspire to be), but rather that the site seems rather "fringe" (perhaps due to the rating system?).

But I digress. I'll get into it now, with these last disclaimers:

I'm writing this piece on January 19th. The piece in question was posted on CG on January 6th. To those who've followed it, this'll seem like a "me-too" post, and for the most part it is. I mostly agree with what I've said and am going to say, and as such I believe I'm not just dogpiling on CG because it's the cool thing to do.

Anyway, the skinny:

Scott Jones, senior writer at Crispy Game, posted a tell-all editorial entitled "Critic in Exile: Is It OK to Finally Admit That I Didn't Really Like Fallout 3 All That Much?".

Jones in essence confesses that he (and others unnamed) voted for Fallout 3 as game of the year in spite of his personal dislike for the game. Over the next few pages he describes why, exactly, he didn't like the game, much in the same way Anthony Burch voiced his own dislike of Prince of Persia. That's fine, no biggie, right? Sure, but the most important part of this is that he voted it for GotY even when he had solid reasons not to. What in the nine hells could have possessed him to do such things?!

He mentioned in the first few sentences that he (and those unnamed others) had all included the Fallout 3 in their top-ten lists or handed it a GotY vote in spite of their inability to tolerate more than a few hours of the game. Mind you, I think that's a fair amount of time to make a basic judgment, especially given the kind of exposure they get to a big title up to and including the actual writing. Sites like Gamespot and even Destructoid have seen much more of a given game than any end consumer pre-release, by virtue of hands-on previews, trade shows, and even a constant stream of screenshots.

But this is extremely disingenuous on Jones' part. Sure as hell, he should have known better. It's been said that trust is the currency of the internet, and that's ironically what Crispy Gamer calls its stable of contributors, "The Game Trust". Trust is why we read critics and reviews in the first place! If we can't trust that your opinion of a game (and your vote) is honest, how is your credibility any more valid than that of, say, [Eidos?!

This is worse than "Gerstmann-gate", because at least in that fiasco most of the information we have is the product of speculation. None of us besides Jeff Gerstmann himself knows all the details, and it's likely we'll never really know. But here Scott Jones has just 'fessed up to some almost disgustingly unethical behavior! Of all people, critics should know they need to be honest. What's worse, part of his reasoning includes fear of backlash (hence the title "Critic in Exile")! BACKLASH?! Good lord. If he didn't like it, he shouldn't have voted for it, it's as simple as that.



Or is it? A user on the comment roll (easily the longest string of comments on any of CG's posts today), "RyanKuo", volunteered an interesting defense:

"My favorite (music) critic, Simon Reynolds, wrote this about end-of-year lists the other day:

“…for a certain kind of person there’s always going to be a fatal confusion of Favourite and Important, matters-to-me and Matters, pleasure and ‘truth’ … You can see various impulses battling it out–the gigantism of all-inclusiveness versus whittle-it-down brevity … The shorter the list (the thinking goes) the less likely it’ll succumb to worthiness, tokenism, dutiful eclecticism that doles out praise across the genrescape, and other liabilities of the profession.”

It arguably takes a more sophisticated critic to realize that these two concepts (favorite vs. important) exist side-by-side, let alone are often at odds with each other. That you cultivate a personal taste, with its own rules, alongside the supposedly objective critical one, which is built up by readers and some righteous critics to be some seamless, deterministic slide towards the Truth.

Getting caught up in “worthiness, tokenism, dutiful eclecticism” is part of all criticism — as a RESULT of striving for objectivity — and it speaks volumes about games journalism that this is an alien concept, gets immediately mis-read as simple peer pressure."

That's definitely worth considering. As Jim Sterling himself mentioned, critics aren't immune to hype. They are as vulnerable as we are when it comes to getting excited about something, particularly since they're easily as enthusiastic we are about video games, perhaps moreso.

And there IS a difference between taste and fact, especially when it comes to creative works as complex as video games. You might agree that Persona 3 does a lot for jRPGs, but just absolutely hate the anime art style, perhaps because, I don't know, an anime raped your dog. Should you let that affect your score? Should you still rate a game highly if you admire it, but not like it? Even Yahtzee mentioned it with Mirror's Edge. He thought it was crap, but that the fact it existed at all was a good sign. Perhaps that's the way to do it. Leave your "A for Effort"'s on your blog, and vice-versa.

Another thing to consider is a possible difference between "critics" and "reviewers". Reviewers need to take in all possible preferences and aspects of a given game, and as such need to be "objective" (as if it were actually possible), but it's a critic's entire job to voice a personal opinion. Should there even be a difference between a critic and a reviewer? Movies don't make that distinction. Then again, movies are way different than games. N'gai Croal opined on the matter after Keith Stuart lambasted reviewers for not giving Mirror's Edge innovations more credit.

Then again, that' stuff for a symposium. The real killer that absolutely kills the defense of Jones' action was that in the article itself, Scott Jones was considering voting for less universally-liked games like The Force Unleashed or Mirror's Edge, but went with Fallout 3 for fear of tarnishing his reputation. That's pretty ironic, considering that with this he's tarnished his rep even more with this, than if he'd voted for the Star Wars game.



Attached photos:

Photo Photo

  related blogs:
 

Is this post awesome? Vote it up!

0


Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

14 comments | showing # 1 to 14

prev next

Tubatic's Destructoid Blog
Depending on what you Game of the Year process is, I think its completely possible and reasonable, as a reviewer, to vote a game as GOTY that you don't think it your favorite. You touched on that in your article when you noted the distinction between the two.

Giant Bomb (.com) did a podcast solely for hashing out their game of the year, and it was kind of a fascinating process. They cam across a point where, even though some of them had other favorites, where they decided the vote would be between GTAIV and MGS4. Their tact toward GOTY became a thing not just of favorite gameplay moments, but a summation of effort, care and artistry as a total package.

Games and Movies have to have very different processes, I think. Where as a movie is in itself a passive consumed item that has a dollar worth of about $8 to consume, a new game costs $40 and upward. And further, has a number of interactive factors that just do not come into play with movie consumption. Criticism is something that should be strived for in games (Destructoid and Kotaku go into very well with tier features, as well as Gamers With Jobs), but the history of video game review, from print to IGN, has been at its core about a consumer product review. Its kind of like a tool for creating enjoyment through play (games) versus an item that present something for enjoyment (movies).

All told, I don't think this compares much to "gerstmann-gate" - because there isn't a company payoff (ad dollars and suits) involved in augmenting the score. This is just the industry starting to come to terms with its consumer-review based history.
garison's Destructoid Blog
Great thoughts, Unangbangway. You are officially one of my favourite C bloggers on Destructoid, keep up the great work!

I think it would be really interesting if Destructoid and other websites implemented some thoghts on wheather they personally like the said game, and what the game does and doesn't do to push gaming forward. Jim, are you listening?
Josh Tolentino's Destructoid Blog
@Tubatic

[i]
All told, I don't think this compares much to "gerstmann-gate" - because there isn't a company payoff (ad dollars and suits) involved in augmenting the score. This is just the industry starting to come to terms with its consumer-review based history.[/i]

Perhaps that's the question, really. Should reviews just stay as product guides? Is there a place for personality-based critiques (as say, with movie reviewers and art critics) in an environment built on buying recommendations?

I say hell no. If we're ever to consider games as art, we'll need artsy-fartsy reviews and critics to go with them. The challenge will be in finding a proper balance between buying guide and art essay. If you ask me, the first step would be to start scrapping scores.
Doomsday Forte's Destructoid Blog
Thinking in-depth about this, it doesn't make a lot of sense to say some game is GOTY material when you actually hated it. The problem is that reviewers, critics, et al are supposed to rate things as they see them, not cater to the people reading the reviews/etc. I mean...the whole point of being critical is to put a game or whatever up against your own standards. If you're just going to say the game was great even though you disagreed, then why are you even reviewing?

Of course, the problem here is that everyone has their own idea for GOTY and unfortunately that means there could be as many as one vote for different games per person--a total deadlock. But I also feel that it is impertinent to rate a game so highly even if you didn't see it so well. It undermines the entire point of actually reviewing a game, or we'd end up just having a game being rated by its popularity or hype.

Okay, so I know that happens anyway. >_>;
Jonathan Holmes's Destructoid Blog
I think the major problem here is that game reviewers/critics/journalists can't be expected to like all kinds of games. We are expected to, and it doesn't work. That's the reason why so many good Wii games get crappy reivews; the reviewers in question just don't like those sorts of games, but instead of admitting it and passing the review to someone who does like that genre of game, they just give the thing a 4 and move on.

Videogames are much more like sports than movies are, in that if you like a certain type of sport, you don't necessarily have any interest or understanding in another type of sport. With movies, if you like the medium, you'll find some use for every genre in that medium. On the other hand, with videogames you could easily spend your entire gaming career playing nothing but one type of game, and never feel any interest in other genres.

I've been playing games for about 38 years, and I still have absolutely no interest in sports games. As such, I would never vote for a sports game as my GOTY, or even review a sports game for this site, because I have absloutelty no interest or understanding of the genre.

That's what it sounds like this Scott Jones fella did, he tried to speak to a genre of game he has no interest in. That's the only valid explanation as to why he would feel that the game was well crafted enough to endorse for GOTY, even though he just didn't enjoy it.
Josh Tolentino's Destructoid Blog
..instead of admitting it and passing the review to someone who does like that genre of game, they just give the thing a 4 and move on...That's the only valid explanation as to why he would feel that the game was well crafted enough to endorse for GOTY, even though he just didn't enjoy it.

If you consider that argument, it tends to render all kinds of criticism invalid. With that attitude, the only valid judgment of any game becomes "If you like this sort of thing, you'll like this."

Game reviews shouldn't be passed on only to people "who like that sort of thing". Sure, you have to consider personal preference, but your opinion is worthless if all you can do is preach to the choir.

And this fiasco extends beyond mere genre preference. Jones essentially lied about his opinion. He didn't like Fallout 3, but voted for it anyway "in recognition" of its ambition and lofty goals, and out of fear that people might think less of him for liking "lesser" titles.

This is exactly what Jim was talking about when he wondered about hype affecting review scores. Ambitious projects with lofty goals CAN STILL FAIL.
Josh Tolentino's Destructoid Blog
Apologies for the double comment, but I noticed a statement from a commenter on the CG article that bears quoting:

[i]"Sometimes you might detest a genre you're asked to review, so unfairly give a low score because you literally don't know any better. In that case, you could blame the editor, because your opinion on that would be worth no more than my mother's, but you don't blame the marketing department for your own weaknesses.

You have now undermined the faith of the reader in your integrity and in this website. Your mistake was not to admit now how you feel, but in failing to do so in the first place, when it was the only thing you were ever being asked to do."[/i]
Dogen's Destructoid Blog
While disappointing, I don't think this should really be construed as an ethical conflict. Ethical wrongdoing, to me, smacks of bribery and deliberate misrepresentation of one's opinion. This just sounds like wish-washiness.

I think game reviewers should stick to expressing their preferences as opposed to pursuing some objective ideal. The medium just doesn't have any sort of coherent standard of excellence that can be invoked, and is ruled by such divisive groups that none seems likely to emerge in the near future. Reviews should be in-depth recommendations, with readers left to sift through the multitude of reviewers currently cluttering the internet to find one or many who generally match their own taste. Because that's what the real conflict here is, whether taste has any role in game journalism, and I don't see how it can be avoided.

In short: I agree. Your portrayal just strikes me as a bit harsh.
Mentok the Mindtaker's Destructoid Blog
You people type allot.
whiteskwirl's Destructoid Blog
Surely the guy deserves some credit for admitting all this, right? He could have just kept silent and no one would have known anything about it. It seems like he is trying to atone for his mistake,and we all make those.

I do think that honesty and backing up your arguments are the most important things for reviewing anything, but if a guy makes a mistake, is he able to overcome it and make amends, or is one incident enough to ruin him?
Josh Tolentino's Destructoid Blog
@Whiteskwirl

Sure, in as far as he did the right thing by 'fessing up, but if you read the article, there's not even a hint of remorse, or even acknowledgment that what he did was wrong.

Was it truly wrong? In this case, YES. He gave a variety of reasons as to why he though FO3 wasn't so much fun, and made a compelling case.

Will this "Crispy-gate" end Scott Jones? No. I respect him as a writer and I enjoy his reviews. I will continue to read Crispy Gamer, and frankly speaking, GotY awards are largely a farce (this incident sure as hell isn't helping). As mentioned, he did make a compelling case for why FO3 didn't deserve his praise. But why the f*ck didn't he do it in the first place?! He waffled, and in doing so, did a disservice to himself, his readers, and the site he works for. As SENIOR WRITER, I might add.

@Mentok the mindtaker

I think it would be a good thing if we ALL tried to type a little more, don't you?
whiteskwirl's Destructoid Blog
Well, I've read the article in question, and you're right, he's not apologetic at all. He doesn't seem to realize how he's compromised his own integrity. Plenty of people in the comments section did, however.

It's interesting, given what Crispy Gamer is supposed to be about in the first place, according to this article:

http://venturebeat.com/2008/10/26/game-journalism-sucks-so-crispy-gamer-raises-money-for-an-alternative-voice/
TheCleaningGuy's Destructoid Blog
I think the issue here is an issue that all those in the game journalism industry have been dealing with for some time. Personal bias.
By bias I don't mean "Xbox Fanboy" or "PS3 Fanboy" or any of those negative terms, I simply mean the person's personal preference. What really bothers me in terms of game reviews is the general "pretense of objectivity" where a person will claim to not be affected by anything aside from how well the game is made (CNET's "unbiased reviews" tagline is the most noteworthy offender)
People aren't objective though, everyone has their own personal tastes, and this is where the problem lies. As this editor states in his blog, he didn't like Fallout 3, but he knew it was well designed, well written, etc. Instead of writing what he believed, he accentuated the game's good points and went along with the general review scores.
People are so quick to cry foul whenever scores deviate from the norm, so perhaps that is why editors don't often dare to express their own opinions. I hope that one day we as gamers realize that everyone is going to have a different opinion, and that review scores, while helpful as a general guide, are not necessarily the end all and be all in terms of game quality.
ThePreacher's Destructoid Blog
Jones did not review Fallout 3 on Crispy Gamer and his vote for Fallout 3 in the Game of the Year was not a first place vote, but a third (that is not in the article, but I tallied the votes). His commentary was beyond "I hated Fallout 3, but voted for it in Game of the Year." The commentary was the conundrum of not liking a game or genre, but recognizing what it brought to the table and reconciling the two. Personally, I hated Portal, but recognize that it was an incredibly significant game and worth all the kudos it received, despite it not being my cup of tea.


prev next


Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!

 about me

I'm Josh "unangbangkay" Tolentino, and this is my cry for attention.

I also write for Japanator. Come visit, and see me gush about things not directly related to video games. Or not. But hey, diversifying interest in me is definitely something I wouldn't mind.

My Portfolio Blog: Death by Eroge!

Features:

-Resident Evil 5 isn't racist, just ignorant and unambitious
- Dude, be cool! Don't hate on Final Fantasy so much!
-Don't Blame the Genre, Blame the Game: Why JRPGs Don't Intrinsically Suck
-Thoughts on The Escapist's Piracy Issue
-Sorry Doomsayers, Japan Isn't In (much) Development Danger.
-Can Critics Be Trusted When They Don't Trust Themselves?
-The Colorless Mask: Insult or Insight?
-Your Fate is in the Cards: "The Fool's Journey" in Persona 3
-Persona 3: The Rest of The Fool's Journey
-Thoughts on Piracy: Why My Eyelid is Twitching
-Persona should be called "Pimp-sona" and its heroes are enviable pimptastic jerks
-Truth and Reconciliation: Why Persona 4's ending is super awesome
-You wanna buy some goddamn eroge. DO IT DO IT DO IT

Promoted Musings:

-Playing With Others: Playing Alone, Together
-A Time to Destroy: To Hell With Your Rules, I'm Cheating
-Feel the Hatred: The Quick Time Event
-The Start of the Affair: My Own Mute, My Own Heartstrings
-Good Idea, Bad Idea: Dynamic Difficulty Adjustment
-For Those About To Die: A Letter To The Combine Overwatch
-Other Worlds than These: I Left My Heart in Inaba
-Untapped Potential: Talk to us dirty, Mr. Developer
-The Forgotten: A Storm of Romance Under the Banner of Love

Reviews:

-Overlord 2
-Red Faction: Guerrilla
-inFAMOUS
-Dynasty Warriors Gundam 2
-Demon's Souls
-Valkyria Chronicles
-Spider-Man: Web of Shadows
-Innocent Life: A Futuristic Harvest Moon
-Rune Factory: A Fantasy Harvest Moon
-Multiwinia
-Crysis Warhead
-The Experiment


Contact Info!

Twitter: unangbangkay

Facebook


 xbox 360 gamertag
 mii friend code:
6258-3610-4242-3684

 friends' updates
Brad Nicholson's Profile Brad Nicholson
Dragon Age: Romancing Morrigan (NSFW)
BulletMagnet's Profile BulletMagnet
The Obscurer Tribune # 19
CblogRecaps's Profile CblogRecaps
Cblogs of 11/7/09 and 11/8/09 + SilverDragonisms
Chad Concelmo's Profile Chad Concelmo
The Memory Card .74: Crono's trial
Ckarasu's Profile Ckarasu
A gift to the community: Demon's Souls PS3 theme (Sexy Update with a new theme)
Clayton S Chan's Profile Clayton S Chan
How to Win a Raffle Drawing: A Public Service Announcement.
Colette Bennett's Profile Colette Bennett
Reminder: Win a new PS3 courtesy of FEARnet!
Dale North's Profile Dale North
Square Enix cuts staff by 10 percent, keeps bike guy
DtoidSanFrancisco's Profile DtoidSanFrancisco
Japantown recap!!
garison's Profile garison
I've been on Dtoid for a year and 26 days, and I want to make love to all of you
Gen Eric Gui's Profile Gen Eric Gui
Public Service Announcement: How to control your allies' actions in battle in Persona 3
Hamza CTZ Aziz's Profile Hamza CTZ Aziz
The Weekend Hotness: DJ Sterling
Jim Sterling's Profile Jim Sterling
GameStop explains why it broke MW2 street date
Jonathan Holmes's Profile Jonathan Holmes
New game from Hatsworth devs brings cookies and violence
Jordan Grim Devore's Profile Jordan Grim Devore
Rock Band 3 will teach us to play for real, apparently
king3vbo's Profile king3vbo
Why I Love Destructoid
Magnalon's Profile Magnalon
The New Kid in Town: An Aion FAQ
Mikey's Profile Mikey
The Destructoid Comic: Power up!
Necros's Profile Necros
Cheesy Double Down (fixed!)
Nick Chester's Profile Nick Chester
EA signs Strikeforce for upcoming MMA title
Niero's Profile Niero
Have a microphone? Want to participate in a Destructoid video?
pedrovay2003's Profile pedrovay2003
Borderlands: Why I believe the PS3 version is watered-down
pendelton21's Profile pendelton21
Animals Cooler Than Their Video Game Counterparts
Primo's Profile Primo
My Pixeljunk Eden Painting
RAB's Profile RAB
Capcom Japan releases new STREET FIGHTER teaser trailer! Also fap.
Samit Sarkar's Profile Samit Sarkar
Infinity Ward pulls MW2 Hamels video after Internet furor
Scrixx's Profile Scrixx
I hugged Scrixx..
Shin Oni's Profile Shin Oni
Tekken 6 made me scared to play. (Review)
SilverDragon1979's Profile SilverDragon1979
So I apparently gave Borderlands its lowest PC review score on Metacritic
SurplusGamer's Profile SurplusGamer
I can't defend what Tim Schafer said, but...
sylphx's Profile sylphx
Persona Movie Trailer Finished!
Tactix's Profile Tactix
Dtoid Community Discusses pt 19: Digital Distribution
Tehmtnlion's Profile Tehmtnlion
I used up all my quarters and couldn't play (NVGR shortblog)
The Incredible Edible Egg's Profile The Incredible Edible Egg
Late Dreamcast love!
TheCleaningGuy's Profile TheCleaningGuy
Yakuza 3 Confirmed for the West?
thefil's Profile thefil
The Modern Warfare 2 Dedicated Server Complaint is Legitimate
Topher Cantler's Profile Topher Cantler
Trailer for SSFIV's new modes, now in English
walkyourpath's Profile walkyourpath
Nothing is sacred: Come with me if you want to live
Y0j1mb0's Profile Y0j1mb0
Happy 30th Birthday SilverDragon!!


 

 
  get involved

register or login
post a blog
post a forum
enter a contest
contribute a news tip
suggest a feature
be a guest editor
support

new member's guide
login assistance
tech support
report abuse
email our editors
read our dev blog
nuclear crisis?
keep in touch

RSS feed
Twitter
Facebook
Myspace
Flickr
Game nights
Meetup+play online
seriously

about Destructoid
advertising
terms of use
privacy policy
jobs at MM
buy our crap
our network

Tomopop
Japanator
Despingation?




Destructoid is an independently-run publication forged by our love of video games and the gaming community's need of accountable enthusiast press
living the dream since March 16, 2006