games  anime  |  toys
Destructoid is gaming news, community, videos, and sometimes love. Take the tour or jump in with Facebook:

 


Destructoid interview: Metacritic's Marc Doyle speaks out about user scores photo

If you pay any attention whatsoever to gaming reviews, surely you are familiar with Metacritic, a site which presents aggregate scores for games, movies and more based on the reviews of many reliable websites. Recently they have had a bit of trouble with user scores for popular titles such as LittleBigPlanet and Resistance 2, with user scores rating far lower than the Metascore -- so much so that it seemed people were intentionally abusing the privilege of being able to contribute their own reviews.

Our own Jim Sterling has given us his take on the subject, and while it makes some excellent points, you certainly can't beat sitting down with the source. I had a chat with Metacritic's Marc Doyle today, one of the co-founders of the site, to get right down to the bottom of the havoc created by tireless fanboys and trolls. 

DESTRUCTOID: Some members of the industry have said they would like to see Metacritic drop user scores altogether and only publish an aggregate of press scores. How do you respond to those comments?

MARC DOYLE: I'm surprised to hear that actually, because the feedback I get is that the industry likes to see user comments. Of course, some people will try to manipulate the system, which has happened previously on a a few instances, such as over the first The Lord of The Rings film. Being entertainment junkies ourselves, we have always wanted to allow people to vote early, but the recent events have caused us to remove the option.

DESTRUCTOID: Why do you think the issue with unreasonably low user scores is occurring more on Metacritic than on other sites?  

MARC DOYLE: It's certainly due to the ease of our sign-up process. Our three co-founders were all lawyers before creating Metacritic, and people's privacy was a definite concern in our vision of the site. We wanted to make the process very simple for people to be able to comment, which is likely also lending to these low user scores -- if fans of one console want to rate down a version of a game on another console, they could do so with ease.

DESTRUCTOID: Unfortunately, it seems people that used the site prudently will now have to pay a price because of these people who abused the privilege.

MARC DOYLE: That's right. However, we are in the midst of planning a redesign which will feature a robust user registration system. It will work the same way other site networks do -- for instance, by signing up for CNET, you would also be able to use Metacritic using the same log in. I can't say when this redesign will go into effect, but it is definitely on the horizon.

DESTRUCTOID: Do you feel a stricter sign-up process will really fix this issue, considering that trolls are notorious for their persistence? Would Metacritic consider banning users if they continue to abuse the site even after the redesign?

MARC DOYLE: We will consider it if it is necessary. Obviously we don't want to take away a user's freedom to post reviews on the site, but a person who is intentionally trying to sabotage a game's score will certainly not be ignored. We want the site to be a pleasant experience for users, and we will do what we have to do to preserve that.

DESTRUCTOID: In your opinion, do Metacritic users pay more attention to the user reviews, the professional reviews, or a mix of both?

MARC DOYLE: Well, the Metascore is considered our primary product, and that is generated from the reviews of publications we have hand-picked to contribute to it. The intent of the founders was to allow users to post reviews to support the product along with the Metascore review, but obviously it's the Metascore itself that we place focus on. We think of the user reviews like a tally of votes, it helps us to keep track of how many other opinions are out there.

DESTRUCTOID: Have you been contacted by publishers in regards to any of the famously low user scores for major games like LittleBigPlanet and Gears of War 2?

MARC DOYLE: I haven't when it comes to user scores, no. I think the publishers know the nature of the beast, so they don't question the user scores. I get calls about a lot of the other things that go up on the site, but luckily user reviews aren't one of them.

[Destructoid would like to thank Mr. Doyle for his time.] 

 


Continue: More Interview stories





prev next

22 comments | showing # 1 to 22

TKurata's Avatar - Comment posted on 11/13/2008 15:18
TKurata
Metacritic can blow me, they banned me from their forums for absolutely no reason.

Completely uncalled for, I didn't post anything offensive, not even an expletive.
Mabec's Avatar - Comment posted on 11/13/2008 15:24
Mabec
Nice!
falinter's Avatar - Comment posted on 11/13/2008 15:29
falinter
I don't really think anyone should take anything seriously that the public or random jackasses have such easy access to manipulate.

I, for one, could care less what 1,000 nameless shmucks have to say in the form of a number out of 10 and a bunch of hate words towards a game box.

I'd rather hear well thought out examination of flaws and downsides to games.
mix's Avatar - Comment posted on 11/13/2008 15:35
mix
I was never one to base a purchase off a score that someone posted up but it's good to hear that they are makeing some changes.
Y0j1mb0's Avatar - Comment posted on 11/13/2008 16:00
Y0j1mb0
Good interview.
mice elf's Avatar - Comment posted on 11/13/2008 16:15
mice elf
it makes sense. if you act like a dick you'll get treated like dick you are. deal with it.
brainderailment's Avatar - Comment posted on 11/13/2008 16:27
brainderailment
Users should be required to write a XXX character paragraph to explain their reason for the score they've given the game. That would actually make me check them out.
Ninjasnake's Avatar - Comment posted on 11/13/2008 17:07
Ninjasnake
I honestly couldn't care less about what others have to say about a game that I personally love. All this does to the people who rate these games so low is show just how dumb fanboys can be.
TheBigFeel's Avatar - Comment posted on 11/13/2008 17:40
TheBigFeel
How about a followup with Amazon regard Spore reviews? This problem certainly isn't isolated to metacritic.
Holyetheline's Avatar - Comment posted on 11/13/2008 17:41
Holyetheline
I never pay attention to user reviews.
Dexter345's Avatar - Comment posted on 11/13/2008 19:00
Dexter345
Agreed with Holyetheline. Asking for the opinion of whoever on the Internet wants to give it is just dumb.
Joe Burling's Avatar - Comment posted on 11/13/2008 19:18
Joe Burling
I still like my idea of judging how good an exclusive game is by looking at how low its Metacritic user score is. The lower the score, the more it obviously threatens fanboys, making it a better game.

Marc Doyle, have you thought about making a community spotlight section that highlights the exclusive games that received much lower scores than the Metascore and then using that to show that the game must be good?

That seems the best way to use these fanboys to our advantage.
Spectreman's Avatar - Comment posted on 11/13/2008 19:57
Spectreman
"I get calls about a lot of the other things that go up on the site"

We can imagine. "How can put destructoid and yours harsh reviews lowing the score of my game." :-)
TrailerParkJesus's Avatar - Comment posted on 11/13/2008 20:00
TrailerParkJesus
At least it sounds like they're doing something. But really, it's gonna take too much effort from Metacritic to properly weed out trolls, so I don't really see them doing anything significant to correct the problem.
AgentMOO's Avatar - Comment posted on 11/13/2008 20:24
AgentMOO
I think Marc is on track to the more strict model of verifying email address, and maintaining a user history that helps catch people who shouldn't be on there. This is a rational way to do it - you can't seriously expect to police individual posts.
Kyousuke Nanbu's Avatar - Comment posted on 11/13/2008 20:50
Kyousuke Nanbu
Give power to the masses and the masses will abuse it, such a sad state of affairs.
Hoss's Avatar - Comment posted on 11/14/2008 03:11
Hoss
@kyousuke: is it lonely at the top oh profound one?
Jesus H Christ's Avatar - Comment posted on 11/14/2008 08:00
Jesus H Christ
@Hoss: No. Those of us at the top can always just look down and feel comforted by you common folk.

Oh and user reviews are worthless, etc.
xSledgewick's Avatar - Comment posted on 11/14/2008 08:02
xSledgewick
Why not just have the option for both or a combo? By default, of course have the industry metascore, but when signed up, than a user/combo score.
Hoss's Avatar - Comment posted on 11/14/2008 15:35
Hoss
@Jesus: hahah well your name sure is appropriate

i was just annoyed at the way that was worded
Altered Beets's Avatar - Comment posted on 11/14/2008 16:32
Altered Beets
I'm a big supporter of user reviews. It's usually obvious when they've been skewed.

Some way to review reviewers would be useful, like scores on ebay.
shit-polka's Avatar - Comment posted on 11/15/2008 23:23
shit-polka
I never really liked user reviews, people in general lack the ability to vote rationally, they all vote 0 or 10, even if their review blurb doesn't reflect, or sometimes even contradicts their score. I don't get it, I think people just want their vote to matter more, so they polarize. bunch of idiots.
prev next

Comment with Facebook





Click connect and comment instantly!

Comment with Dtoid





New? SIGN UP - it takes 5 seconds

Comments policy

Destructoid is an open discussion community. You don't need to "audition" to post a comment - just speak your mind. We respect differing opinions on the site, so have at it. Be smart, funny, insightful, clueless, or cute -- but back it up with substance. Keep your cool, keep it fun. We only ask that you act respectfully and above all: don't be a troll and ruin it for everyone else. Don't bring down gamers or we'll, you know, gently shoot you in the face and stuff you into a flaming mailbox. Each comment is your opportuntity to make this community awesomer. Is that even a word?

Avoiding the banhammer only requires common sense: spamming, trolling, racism, NSFW stuff, and other forms of sucking will not be tolerated. If anyone is griefing please report abuse. Be good. Don't suck!

 
New on Destructoid.TV play all videos

Loading
Loading Destructoid Videos


    Win this!
    Dive in! meetup+play for a chance to win a PC

    Dtoid Twitter    Got news?   tips@destructoid.com

    Reviews & Previews
    Resident Evil: The Darkside Chronicles review
    Left 4 Dead 2 review
    Call of Duty: Modern Warfare Reflex review
    Arkedo Series - 02 SWAP! review
    EyePet review
    more reviews
    Chugging along with Legend of Zelda Spirit Tracks
    Online Lessons 101 Monster Slaying in Monster Hunter Tri
    Hooking onto, under and above Just Cause 2
    PS3's 256-player MAG
    Rooms The Main Building
    more previews


    - The Dtoid Army is 50686 strong -

    Showing Cblogs with 3+ faps   show all

    Call for entries: do the wrong thing

    New to Dtoid? Read the survival guide




     Originals
    Jim Sterling: Think L4D2 is an expansion? You're a f*cking idiot





















    More Destructoid Originals




     Popular now more






















    Team Destructoid   tips@destructoid.com
    Nick Chester
    Editor-in-Chief
    Niero
    Founder, publisher
    Jim Sterling
    Reviews Editor
    Hamza Aziz
    Community Manager
    Dale North
    News Editor
    Rey Gutierrez
    Video editor & director
    Anthony Burch
    Features Editor
    Colette Bennett
    Tom Fronczak Brad Nicholson
    Ashley Davis Ben Perlee
    Conrad
    Zimmerman
    Chad Concelmo
    Jonathan Holmes Jonathan Ross
    Brad Rice Jordan Devore
    Will Maddock Matthew Razak
    Dyson Joseph Leray
    Topher Cantler Samit Sarkar
         
      Dexter
    Adam Dork
    Daniel Lingen
    Hollie Bennett
    Joe Burling
    Mikey
    Stella Wong

    Josh Tolentino




     

     
      get involved

    register or login
    post a blog
    post a forum
    enter a contest
    contribute a news tip
    suggest a feature
    be a guest editor
    support

    new member's guide
    login assistance
    tech support
    report abuse
    email our editors
    read our dev blog
    nuclear crisis?
    keep in touch

    RSS feed
    Twitter
    Facebook
    Myspace
    Flickr
    Game nights
    Meetup+play online
    seriously

    about Destructoid
    advertising
    terms of use
    privacy policy
    jobs at MM
    buy our crap
    our network

    Tomopop
    Japanator
    Despingation?




    Destructoid is an independently-run publication forged by our love of video games and the gaming community's need of accountable enthusiast press
    living the dream since March 16, 2006