games  anime  |  toys
Destructoid is gaming news, community, videos, and sometimes love. Take the tour or jump in with Facebook:

 


Destructoid interview: Metacritic's Marc Doyle speaks out about user scores photo

If you pay any attention whatsoever to gaming reviews, surely you are familiar with Metacritic, a site which presents aggregate scores for games, movies and more based on the reviews of many reliable websites. Recently they have had a bit of trouble with user scores for popular titles such as LittleBigPlanet and Resistance 2, with user scores rating far lower than the Metascore -- so much so that it seemed people were intentionally abusing the privilege of being able to contribute their own reviews.

Our own Jim Sterling has given us his take on the subject, and while it makes some excellent points, you certainly can't beat sitting down with the source. I had a chat with Metacritic's Marc Doyle today, one of the co-founders of the site, to get right down to the bottom of the havoc created by tireless fanboys and trolls. 

DESTRUCTOID: Some members of the industry have said they would like to see Metacritic drop user scores altogether and only publish an aggregate of press scores. How do you respond to those comments?

MARC DOYLE: I'm surprised to hear that actually, because the feedback I get is that the industry likes to see user comments. Of course, some people will try to manipulate the system, which has happened previously on a a few instances, such as over the first The Lord of The Rings film. Being entertainment junkies ourselves, we have always wanted to allow people to vote early, but the recent events have caused us to remove the option.

DESTRUCTOID: Why do you think the issue with unreasonably low user scores is occurring more on Metacritic than on other sites?  

MARC DOYLE: It's certainly due to the ease of our sign-up process. Our three co-founders were all lawyers before creating Metacritic, and people's privacy was a definite concern in our vision of the site. We wanted to make the process very simple for people to be able to comment, which is likely also lending to these low user scores -- if fans of one console want to rate down a version of a game on another console, they could do so with ease.

DESTRUCTOID: Unfortunately, it seems people that used the site prudently will now have to pay a price because of these people who abused the privilege.

MARC DOYLE: That's right. However, we are in the midst of planning a redesign which will feature a robust user registration system. It will work the same way other site networks do -- for instance, by signing up for CNET, you would also be able to use Metacritic using the same log in. I can't say when this redesign will go into effect, but it is definitely on the horizon.

DESTRUCTOID: Do you feel a stricter sign-up process will really fix this issue, considering that trolls are notorious for their persistence? Would Metacritic consider banning users if they continue to abuse the site even after the redesign?

MARC DOYLE: We will consider it if it is necessary. Obviously we don't want to take away a user's freedom to post reviews on the site, but a person who is intentionally trying to sabotage a game's score will certainly not be ignored. We want the site to be a pleasant experience for users, and we will do what we have to do to preserve that.

DESTRUCTOID: In your opinion, do Metacritic users pay more attention to the user reviews, the professional reviews, or a mix of both?

MARC DOYLE: Well, the Metascore is considered our primary product, and that is generated from the reviews of publications we have hand-picked to contribute to it. The intent of the founders was to allow users to post reviews to support the product along with the Metascore review, but obviously it's the Metascore itself that we place focus on. We think of the user reviews like a tally of votes, it helps us to keep track of how many other opinions are out there.

DESTRUCTOID: Have you been contacted by publishers in regards to any of the famously low user scores for major games like LittleBigPlanet and Gears of War 2?

MARC DOYLE: I haven't when it comes to user scores, no. I think the publishers know the nature of the beast, so they don't question the user scores. I get calls about a lot of the other things that go up on the site, but luckily user reviews aren't one of them.

[Destructoid would like to thank Mr. Doyle for his time.] 

 


Continue: More Interview stories





prev next

22 comments | showing # 1 to 22

TKurata's Avatar
TKurata at 11/13/2008 15:18
Metacritic can blow me, they banned me from their forums for absolutely no reason.

Completely uncalled for, I didn't post anything offensive, not even an expletive.
Mabec's Avatar
Mabec at 11/13/2008 15:24
Nice!
falinter's Avatar
falinter at 11/13/2008 15:29
I don't really think anyone should take anything seriously that the public or random jackasses have such easy access to manipulate.

I, for one, could care less what 1,000 nameless shmucks have to say in the form of a number out of 10 and a bunch of hate words towards a game box.

I'd rather hear well thought out examination of flaws and downsides to games.
mix's Avatar
mix at 11/13/2008 15:35
I was never one to base a purchase off a score that someone posted up but it's good to hear that they are makeing some changes.
Y0j1mb0's Avatar
Y0j1mb0 at 11/13/2008 16:00
Good interview.
mice elf's Avatar
mice elf at 11/13/2008 16:15
it makes sense. if you act like a dick you'll get treated like dick you are. deal with it.
brainderailment's Avatar
brainderailment at 11/13/2008 16:27
Users should be required to write a XXX character paragraph to explain their reason for the score they've given the game. That would actually make me check them out.
Ninjasnake's Avatar
Ninjasnake at 11/13/2008 17:07
I honestly couldn't care less about what others have to say about a game that I personally love. All this does to the people who rate these games so low is show just how dumb fanboys can be.
TheBigFeel's Avatar
TheBigFeel at 11/13/2008 17:40
How about a followup with Amazon regard Spore reviews? This problem certainly isn't isolated to metacritic.
Holyetheline's Avatar
Holyetheline at 11/13/2008 17:41
I never pay attention to user reviews.
Dexter345's Avatar
Dexter345 at 11/13/2008 19:00
Agreed with Holyetheline. Asking for the opinion of whoever on the Internet wants to give it is just dumb.
Joe Burling's Avatar
Joe Burling at 11/13/2008 19:18
I still like my idea of judging how good an exclusive game is by looking at how low its Metacritic user score is. The lower the score, the more it obviously threatens fanboys, making it a better game.

Marc Doyle, have you thought about making a community spotlight section that highlights the exclusive games that received much lower scores than the Metascore and then using that to show that the game must be good?

That seems the best way to use these fanboys to our advantage.
Spectreman's Avatar
Spectreman at 11/13/2008 19:57
"I get calls about a lot of the other things that go up on the site"

We can imagine. "How can put destructoid and yours harsh reviews lowing the score of my game." :-)
TrailerParkJesus's Avatar
TrailerParkJesus at 11/13/2008 20:00
At least it sounds like they're doing something. But really, it's gonna take too much effort from Metacritic to properly weed out trolls, so I don't really see them doing anything significant to correct the problem.
AgentMOO's Avatar
AgentMOO at 11/13/2008 20:24
I think Marc is on track to the more strict model of verifying email address, and maintaining a user history that helps catch people who shouldn't be on there. This is a rational way to do it - you can't seriously expect to police individual posts.
Kyousuke Nanbu's Avatar
Kyousuke Nanbu at 11/13/2008 20:50
Give power to the masses and the masses will abuse it, such a sad state of affairs.
Hoss's Avatar
Hoss at 11/14/2008 03:11
@kyousuke: is it lonely at the top oh profound one?
Jesus H Christ's Avatar
Jesus H Christ at 11/14/2008 08:00
@Hoss: No. Those of us at the top can always just look down and feel comforted by you common folk.

Oh and user reviews are worthless, etc.
xSledgewick's Avatar
xSledgewick at 11/14/2008 08:02
Why not just have the option for both or a combo? By default, of course have the industry metascore, but when signed up, than a user/combo score.
Hoss's Avatar
Hoss at 11/14/2008 15:35
@Jesus: hahah well your name sure is appropriate

i was just annoyed at the way that was worded
Altered Beets's Avatar
Altered Beets at 11/14/2008 16:32
I'm a big supporter of user reviews. It's usually obvious when they've been skewed.

Some way to review reviewers would be useful, like scores on ebay.
shit-polka's Avatar
shit-polka at 11/15/2008 23:23
I never really liked user reviews, people in general lack the ability to vote rationally, they all vote 0 or 10, even if their review blurb doesn't reflect, or sometimes even contradicts their score. I don't get it, I think people just want their vote to matter more, so they polarize. bunch of idiots.
prev next

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!

 
New on Destructoid.TV play all videos

Loading
Loading Destructoid Videos




    Win this!
    Reminder: We're giving away six copies of Magnacarta 2!



    Dtoid Twitter    Got news?   tips@destructoid.com

    Reviews & Previews
    Mahjongg Artifacts 2 review
    Dragon Age: Origins review
    Lost Winds: The Winter of the Melodias review
    Osmos review
    Space Invaders Extreme 2 review
    Half-Minute Hero review
    JU-ON: The Grudge review
    Kenka Bancho: Badass Rumble review
    Thexder Neo review
    Domino Rally review
    more reviews
    PS3's 256-player MAG
    Rooms The Main Building
    Skate 3
    Hudson's bringing back the Bonk
    James Cameron's Avatar
    Bomberman Battlefest
    Calling
    Bad Company 2's multiplayer
    Partying like it's 1959 in BioShock 2's multiplayer
    BioShock 2 through the eyes of Big Daddy
    more previews


    - The Dtoid Army is 49521 strong -

    Showing Cblogs with 3+ faps   show all

    Call for entries: do the wrong thing

    New to Dtoid? Read the survival guide




     Originals
    Jim Sterling: Ten 'classic' games that did not age well





















    More Destructoid Originals




     Popular now more
























    Destructoid's editorial lovefest is:
    Nick Chester
    Editor-in-Chief
    Jim Sterling
    Reviews Editor
    Dale North
    News Editor
    Hamza Aziz
    Community Manager
    Anthony Burch
    Features Editor
    Rey Gutierrez
    Video editor & director
    Niero
    Founder, publisher
    Letters to the editors
    tips@destructoid.com
    Associate Editors
    Ashley Davis Jonathan Holmes
    Brad Nicholson Jonathan Ross
    Brad Rice Jordan Devore
    Chad Concelmo Matthew Razak
    Colette Bennett Tom Fronczak
    Conrad Zimmerman Topher Cantler
    Dyson Samit Sarkar
    Contributors
    Adam Dork
    Ben Perlee
    Daniel Lingen
    Joseph Leray
    Joe Burling
    Mikey
    Will Maddock
    Stella Wong





     

     
      get involved

    register or login
    post a blog
    post a forum
    enter a contest
    contribute a news tip
    suggest a feature
    be a guest editor
    support

    new member's guide
    login assistance
    tech support
    report abuse
    email our editors
    read our dev blog
    nuclear crisis?
    keep in touch

    RSS feed
    Twitter
    Facebook
    Myspace
    Flickr
    Game nights
    Meetup+play online
    seriously

    about Destructoid
    advertising
    terms of use
    privacy policy
    jobs at MM
    buy our crap
    our network

    Tomopop
    Japanator
    Despingation?




    Destructoid is an independently-run publication forged by our love of video games and the gaming community's need of accountable enthusiast press
    living the dream since March 16, 2006