hot  /  reviews  /  videos  /  cblogs  /  qposts

Call of Duty: Black Ops II

Black Ops II on balancing and player feedback

3:45 PM on 11.15.2012 // Hamza CTZ Aziz


Balancing, balancing, balancing. Developers do as much as they can to make sure their multiplayer is designed as best as possible before shipping, but it's when the title has made it into the public's hand that really puts everything to the test. Making sure a game is balanced well is a never-ending battle with any multiplayer game.

Black Ops II is no different, and Treyarch has created a new system called Black Box that analyzes player data to really see how everything is performing. "What we said was we need to balance the emotion of using something, like your personal visceral reaction to it, with math," design director David Vonderhaar told me. "There's a lot of instrumentation in this game, there's a lot of data logging, so I know exactly what the power band of a weapon is at all times. So I can combine how something feels with how it's actually behaving. I know, I know this is going to happen: A million people are going to Tweet me and tell me that the [for example] 'PDW 57 is overpowered, Vonderhaar what are you doing?'

"What I'll do is I can go and look at the math and I'll go 'Actually, you know what dude? You're just good with it. Have fun, because the math says that it's not overpowered.' I have the averages, you're being successful. That means Pick 10 is working, and if it's overpowered I'll know it for real. Like not because someone said it was, or because I felt it was, or because you sent me an angry Tweet because you got killed by the SRM Shotgun one night 17 times so you're mad. The data will tell me the truth."

"So combining your opinion with mathematical fact is the way we can handle this and that's only possible if the game is instrumented well, and it is," David continued. "Like a whole new level of instrumentation, it's crazy cool. Data nerds would just die if they had any idea what kind of stuff we can yank with this."

Basically, Black Box is a series of databases that allows Treyarch to run various queries against it in lots of interesting ways. They can take a weapon like the SRM with the long barrel attachment, for example, and compare how many shots it's taking to put someone down on average against some other data set. That's one example of the cross checking they can perform now.

"Once you have the data you just need to figure out how you want to use it. You can create new queries and modify queries and that allows you to run all sorts of reports. I have this chart on my wall that we run all the time to just be sure how things are trending. What's really cool about it is you make a little tiny tweak [and] you get a sense of what that does to the tuning, what would happen if you did that. It lets you do some really lightweight modeling, it's pretty neat.

"I'm just going to kill people with facts [with] this game when they come over and go 'This thing is OP.' I'm going to go 'Actually it's not OP, you're wrong.' I'm not going to yell at them or anything, I'm just going to tell them the truth. I don't have to hide this stuff from people, just drop knowledge bombs on guys. It's gotta be done! What people are doing is reacting emotionally, and I'm like a really emotional guy so I get it."

David is one of the more prominent developers out there who actually uses Twitter as real-time feedback in a large way. "It's like the world's greatest instant fact checker. You can get really close to something when you work on it so it's always healthy to say, look, let me just put this out in the stratosphere and see are my assumptions about it still right and that's when you'll see me do that. The other thing is it's really great to just tell people look this is how it's going work and why. You may not agree with that but I'm going to tell you. I'm going to be transparent and tell you."

Social media also proves to be a great early warning detection system for David as well. "It's a really good way to understand what's happening before something becomes. That allows us to be on top of it. You can't tell people what they want to hear, that's the wrong way to do it. But what you can do is say 'I got it. Thank you. I'll look into it. I looked into it and this is what we're doing.' Or not, and then you'll move on from there hopefully."

And while he's open to hearing everyone's feedback, at the end of the day "you can't let Twitter design the videogame. These are just fans, and they just want to talk to somebody. Who are they going to talk to? A guy that doesn't work on the game? I'm the best guy for them to talk to, someone who can actually make decisions about the game is infinitely better than talking to somebody who has no control over what actually happens. I think it's better that way, even if it comes with this whole new level of responsibility and possibly headache. It's worth it in the end. I'm glad for it and I'm glad for them, honestly."

 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our moderators, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding * to your whitelists.

 Add your impressions

Status updates from C-bloggers

Mike Martin avatarMike Martin
I'm watching you.
FlanxLycanth avatarFlanxLycanth
SkarKrow avatarSkarKrow
Work noooooooooooooooooo D:
The Dyslexic Laywer avatarThe Dyslexic Laywer
I had such a awkward time playing Catherine because it shared the same name as my mother....
JayDGee avatarJayDGee
Broforce is coming out of early access on the 15th. I had no Idea it was an early access game.
James Internet Ego avatarJames Internet Ego
I have now played all 3 Witcher games. My verdict: Witcher 1 - alright, aged badly, lots of sex. Witcher 2 - good, very short, not much sex at all. Witcher 3 - Excellent in every way.
ikiryou avatarikiryou
I really wish MGO had been implemented with free-roam gameplay PMC (clan) setup instead of the standard matchmaking. Imagine roaming bands of PMC's opposing each other on the battlefield. How sexy would that be?
SkarKrow avatarSkarKrow
Playing Shantae & The Pirates Curse, must say I'm loving it for the most part, barring the odd WHERE AM I D: moment
JayDGee avatarJayDGee
Added a humble code to my steam account when I already had the game. Purely because the soundtrack was attached. Now I see it on 2 friends wishlists. They must never know.
SkarKrow avatarSkarKrow
Okay so what 2, 3, 4 years later I bothered to finish. Now to write up that blog on why FFXIV lost my love by never challenging me and see if it's actually interesting...
FlanxLycanth avatarFlanxLycanth
What's up with taking your phone or a magazine to the toilet? Y'all need more fibre in your diet, why should a toilet visit take more than 2 minutes? What are you people doing with your asses.
Pixie The Fairy avatarPixie The Fairy
Finished Momohime/Jinkuro's story in Muramasa last night. I always liked that ending. I didn't know there were more endings, though. On to Kisuke's story!
OrochiLeona avatarOrochiLeona
It feels like each day I get up, do the rounds of my bookmarks, and am immediately brought down by kneejerk hate: new stuff, old stuff, last nights stuff, 2moros stuff, a game, a film, TV. Critical thinking is fine, but dang, pure cynicism's winning :(
Vuster avatarVuster
Rpg Maker MV is coming soon O: I mean I am overjoyed but... I JUST GOT USE TO VX ACE!! Either way, I intend to do a form of quick summery of the features on release o:
Flegma avatarFlegma
Nintendo's(?) weekly SMM level picks: [url][/url] - scroll down a bit for the list. I wish I didn't need to type in the level ID myself, though.
Shinta avatarShinta
Metal Gear Online, Day 2. The maps in this game are amazing. Try out all 3 classes, because they're all pretty different. Really getting the hang of the game now.
Jay Escobar avatarJay Escobar
Video game voice actors are threatening to go on strike if EA, Activision, Disney, WB, and others refuse to pay them the necessary bonuses (
GoofierBrute avatarGoofierBrute
I love how Final Fantasy Record Keeper is making a big deal about being able to unlock FF XII's Vaan. I do get to unlock Ashe though, so that's cool.
gajknight avatargajknight
Just put in my pre-order for Dragon Quest Heroes: The Thing in The Thing with The Thing. Good times, hope it doesn't disappoint! Like I do. With everyone.
Terry 309 avatarTerry 309
You know you've played a good JRPG when the ending makes you sad...
more quickposts


destructoid's previous coverage:
Call of Duty: Black Ops II

  Jul 11

Vengeance comes to Black Ops II on PS3 and PC next month

Four multiplayer maps plus another zombies level

  Jun 26

Black Ops II kicks off another Double XP weekend

Treyarch is celebrating the impending release of the Vengeance DLC pack

  Jun 18

Black Ops II nails down July release for Vengeance DLC

Third DLC pack out first on Xbox 360 next month

  Apr 19

Call of Duty to host a Double Weapon XP weekend

Not Double XP proper, which is confusing

View all:powered by:  MM.Elephant

Ads on destructoid may be purchased from:

Please contact Crave Online, thanks!


Invert site colors

  Dark Theme
  Light Theme

Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo

Back to Top

We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -