Note: iOS 9 + Facebook users w/ trouble scrolling: #super sorry# we hope to fix it asap. In the meantime Chrome Mobile is a reach around
hot  /  reviews  /  videos  /  cblogs  /  qposts

Call of Duty: Black Ops II

Black Ops II on balancing and player feedback

3:45 PM on 11.15.2012 // Hamza CTZ Aziz


Balancing, balancing, balancing. Developers do as much as they can to make sure their multiplayer is designed as best as possible before shipping, but it's when the title has made it into the public's hand that really puts everything to the test. Making sure a game is balanced well is a never-ending battle with any multiplayer game.

Black Ops II is no different, and Treyarch has created a new system called Black Box that analyzes player data to really see how everything is performing. "What we said was we need to balance the emotion of using something, like your personal visceral reaction to it, with math," design director David Vonderhaar told me. "There's a lot of instrumentation in this game, there's a lot of data logging, so I know exactly what the power band of a weapon is at all times. So I can combine how something feels with how it's actually behaving. I know, I know this is going to happen: A million people are going to Tweet me and tell me that the [for example] 'PDW 57 is overpowered, Vonderhaar what are you doing?'

"What I'll do is I can go and look at the math and I'll go 'Actually, you know what dude? You're just good with it. Have fun, because the math says that it's not overpowered.' I have the averages, you're being successful. That means Pick 10 is working, and if it's overpowered I'll know it for real. Like not because someone said it was, or because I felt it was, or because you sent me an angry Tweet because you got killed by the SRM Shotgun one night 17 times so you're mad. The data will tell me the truth."

"So combining your opinion with mathematical fact is the way we can handle this and that's only possible if the game is instrumented well, and it is," David continued. "Like a whole new level of instrumentation, it's crazy cool. Data nerds would just die if they had any idea what kind of stuff we can yank with this."

Basically, Black Box is a series of databases that allows Treyarch to run various queries against it in lots of interesting ways. They can take a weapon like the SRM with the long barrel attachment, for example, and compare how many shots it's taking to put someone down on average against some other data set. That's one example of the cross checking they can perform now.

"Once you have the data you just need to figure out how you want to use it. You can create new queries and modify queries and that allows you to run all sorts of reports. I have this chart on my wall that we run all the time to just be sure how things are trending. What's really cool about it is you make a little tiny tweak [and] you get a sense of what that does to the tuning, what would happen if you did that. It lets you do some really lightweight modeling, it's pretty neat.

"I'm just going to kill people with facts [with] this game when they come over and go 'This thing is OP.' I'm going to go 'Actually it's not OP, you're wrong.' I'm not going to yell at them or anything, I'm just going to tell them the truth. I don't have to hide this stuff from people, just drop knowledge bombs on guys. It's gotta be done! What people are doing is reacting emotionally, and I'm like a really emotional guy so I get it."

David is one of the more prominent developers out there who actually uses Twitter as real-time feedback in a large way. "It's like the world's greatest instant fact checker. You can get really close to something when you work on it so it's always healthy to say, look, let me just put this out in the stratosphere and see are my assumptions about it still right and that's when you'll see me do that. The other thing is it's really great to just tell people look this is how it's going work and why. You may not agree with that but I'm going to tell you. I'm going to be transparent and tell you."

Social media also proves to be a great early warning detection system for David as well. "It's a really good way to understand what's happening before something becomes. That allows us to be on top of it. You can't tell people what they want to hear, that's the wrong way to do it. But what you can do is say 'I got it. Thank you. I'll look into it. I looked into it and this is what we're doing.' Or not, and then you'll move on from there hopefully."

And while he's open to hearing everyone's feedback, at the end of the day "you can't let Twitter design the videogame. These are just fans, and they just want to talk to somebody. Who are they going to talk to? A guy that doesn't work on the game? I'm the best guy for them to talk to, someone who can actually make decisions about the game is infinitely better than talking to somebody who has no control over what actually happens. I think it's better that way, even if it comes with this whole new level of responsibility and possibly headache. It's worth it in the end. I'm glad for it and I'm glad for them, honestly."

 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our community fisters, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding * to your whitelists.

destructoid's previous coverage:
Call of Duty: Black Ops II

  Jul 11

Vengeance comes to Black Ops II on PS3 and PC next month

Four multiplayer maps plus another zombies level

  Jun 26

Black Ops II kicks off another Double XP weekend

Treyarch is celebrating the impending release of the Vengeance DLC pack

  Jun 18

Black Ops II nails down July release for Vengeance DLC

Third DLC pack out first on Xbox 360 next month

View all:powered by:  MM.Elephant

Ads on destructoid may be purchased from:

Please contact Crave Online, thanks!

To editorialize or not to editorialize: An editorial

Tiny Dangerous Dungeons REVIEW - The Pocket Metroidvania

Cblogs of 11/24/15 + Big Ass Fort

Primal Carnage: Extinction Review (PS4)

Belated Spoiler-Free SOMA Review

Friday Night Fights: The Blackest Of Fridays

Super Destructoid Community Interviews Hyper Encore ##Reload

So I Got a 3DS

Negotiations are over. Rainbow Six Siege is a no buy from me as of now.

Cheat Codes Podcast - Ep. 72: Sexy Dog

 Add your impressions

Status updates from C-bloggers

StriderHoang avatarStriderHoang
What? Wonderful 101 on eShop is $19? NO EXCUSES.
Terry 309 avatarTerry 309
Pixie The Fairy avatarPixie The Fairy
Robin secretly controls the boobs of Nintendo characters. She stole the Xenoblade boobs and took the Fatal Frame lingerie for herself. #DammitRobin [img][/img]
Matheus Railane avatarMatheus Railane
ikiryou avatarikiryou
I was just playing Skyrim and wondered if anyone has come up with Fallout 3/New Vegas weapon mods for Skyrim? Fighting dragons with assault weapons sounds almost necessary. [img][/img]
James Internet Ego avatarJames Internet Ego
Just bought Fallout: New Vegas. Throw me the best mods there are that AREN'T Total Conversion mods. So now Who Vegas - yet.
Parismio avatarParismio
Oh this Undertale summaration flipnote is so good:
Amna Umen avatarAmna Umen
For an early Christmas present I got my girlfriend Wooly World to go with our new Wii U. I've gotten more joy out of how adorable all the character designs are than I'd like to admit.
Jiraya avatarJiraya
Hey Dtoiders ! Steam just destroyed my wallet ! Share here what you bought in this sale !
GoofierBrute avatarGoofierBrute
And so I purchased not just Hyper Dimension Neptunia, but also its sequel and Grim Fandango Remastered in the Steam Sale, and it isn't even the end of the first day. God damnit. At least refunds are thing a now.
Samsneeze avatarSamsneeze
I'm currently writing a review for a mobile game, but only because I'm enjoying the hell out it. I'm honestly enjoying it far more than Puzzles and Dragons.
Zer0t0nin avatarZer0t0nin
Damn, I think I'm Bruce Willis from Unbreakable. Just fell of a 12-foot ladder and all I got was a little scratch on my finger.
CoilWhine avatarCoilWhine
After I finish Fallout 4 I'm thinking of 100%ing Skyrim and then installing a TON of dinosaur mods on it.
voex avatarvoex
4 hours into Hotline Miami 2 and I'm finding it just as fun as the original. So far it's a good balance between frustration and satisfaction. Still have no idea what the story is about.
OverlordZetta avatarOverlordZetta
1. Start playing Ocarina of Time again. 2. Start having fun. 3. Discover fishing area. 4. Stop having fun.
AvtrSpirit avatarAvtrSpirit
A 2-d hovercraft platforming exploration game just came out today. Have fun collecting the coins! My record so far is 140.
Occams avatarOccams
Holy shit the new David Bowie video/song is just lovely.
Barry Kelly avatarBarry Kelly
So many people angry at Play-Asia right now. Totally not exactly the kind of backlash Tecmo were trying to avoid by not releasing the game here in the first place.
FlanxLycanth avatarFlanxLycanth
If you're a UK kid there's a Wii U 32 GB Wind Waker Premium Pack on Amazon for £240. It says sale... I dunno how much of a saving that is. You tell me.
Archelon avatarArchelon
Community Question: Not strictly speaking video game-related, but screw it. Team Captain America or Team Iron Man?
more quickposts



Invert site colors

  Dark Theme
  Light Theme

Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo

Back to Top

We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -