hot  /  reviews  /  videos  /  cblogs  /  qposts

Call of Duty: Black Ops II

Black Ops II on balancing and player feedback

3:45 PM on 11.15.2012 // Hamza CTZ Aziz
  @CTZ

Mathematical

Balancing, balancing, balancing. Developers do as much as they can to make sure their multiplayer is designed as best as possible before shipping, but it's when the title has made it into the public's hand that really puts everything to the test. Making sure a game is balanced well is a never-ending battle with any multiplayer game.

Black Ops II is no different, and Treyarch has created a new system called Black Box that analyzes player data to really see how everything is performing. "What we said was we need to balance the emotion of using something, like your personal visceral reaction to it, with math," design director David Vonderhaar told me. "There's a lot of instrumentation in this game, there's a lot of data logging, so I know exactly what the power band of a weapon is at all times. So I can combine how something feels with how it's actually behaving. I know, I know this is going to happen: A million people are going to Tweet me and tell me that the [for example] 'PDW 57 is overpowered, Vonderhaar what are you doing?'

"What I'll do is I can go and look at the math and I'll go 'Actually, you know what dude? You're just good with it. Have fun, because the math says that it's not overpowered.' I have the averages, you're being successful. That means Pick 10 is working, and if it's overpowered I'll know it for real. Like not because someone said it was, or because I felt it was, or because you sent me an angry Tweet because you got killed by the SRM Shotgun one night 17 times so you're mad. The data will tell me the truth."

"So combining your opinion with mathematical fact is the way we can handle this and that's only possible if the game is instrumented well, and it is," David continued. "Like a whole new level of instrumentation, it's crazy cool. Data nerds would just die if they had any idea what kind of stuff we can yank with this."

Basically, Black Box is a series of databases that allows Treyarch to run various queries against it in lots of interesting ways. They can take a weapon like the SRM with the long barrel attachment, for example, and compare how many shots it's taking to put someone down on average against some other data set. That's one example of the cross checking they can perform now.

"Once you have the data you just need to figure out how you want to use it. You can create new queries and modify queries and that allows you to run all sorts of reports. I have this chart on my wall that we run all the time to just be sure how things are trending. What's really cool about it is you make a little tiny tweak [and] you get a sense of what that does to the tuning, what would happen if you did that. It lets you do some really lightweight modeling, it's pretty neat.

"I'm just going to kill people with facts [with] this game when they come over and go 'This thing is OP.' I'm going to go 'Actually it's not OP, you're wrong.' I'm not going to yell at them or anything, I'm just going to tell them the truth. I don't have to hide this stuff from people, just drop knowledge bombs on guys. It's gotta be done! What people are doing is reacting emotionally, and I'm like a really emotional guy so I get it."

David is one of the more prominent developers out there who actually uses Twitter as real-time feedback in a large way. "It's like the world's greatest instant fact checker. You can get really close to something when you work on it so it's always healthy to say, look, let me just put this out in the stratosphere and see are my assumptions about it still right and that's when you'll see me do that. The other thing is it's really great to just tell people look this is how it's going work and why. You may not agree with that but I'm going to tell you. I'm going to be transparent and tell you."

Social media also proves to be a great early warning detection system for David as well. "It's a really good way to understand what's happening before something becomes. That allows us to be on top of it. You can't tell people what they want to hear, that's the wrong way to do it. But what you can do is say 'I got it. Thank you. I'll look into it. I looked into it and this is what we're doing.' Or not, and then you'll move on from there hopefully."

And while he's open to hearing everyone's feedback, at the end of the day "you can't let Twitter design the videogame. These are just fans, and they just want to talk to somebody. Who are they going to talk to? A guy that doesn't work on the game? I'm the best guy for them to talk to, someone who can actually make decisions about the game is infinitely better than talking to somebody who has no control over what actually happens. I think it's better that way, even if it comes with this whole new level of responsibility and possibly headache. It's worth it in the end. I'm glad for it and I'm glad for them, honestly."




 Setup email comments

Unsavory comments? Please report harassment, spam, and hate speech to our moderators, and flag the user (we will ban users dishing bad karma). Can't see comments? Apps like Avast or browser extensions can cause it. You can fix it by adding *.disqus.com to your whitelists.

 Add your impressions

 Quickposts
Status updates from C-bloggers

ShadeOfLight avatarShadeOfLight
Replaying Tales of Symphonia for the first time in years, I only just now realized how random the plot is. Our goals are decided at Lloyd's whimsy, while we get major revelations just 'whenever'. Still a good game, but I'm proud to be #TeamBatenKaitos.
Dr Mel avatarDr Mel
Question Time! What's YOUR MGSV Helicopter music?
GoofierBrute avatarGoofierBrute
Today at work, I made a reference to the DK Rap in one of my news pieces. Any day that I get to do that is a good day.
gajknight avatargajknight
Everyone's playing MGSV...and I've just arrived in Skellige in The Witcher 3. At this rate, I'll get 'round to MGSV when the PS7 arrives.
RadicalYoseph avatarRadicalYoseph
Currently learning Little Trinketry from Valiant Hearts: The Great War on piano. [youtube]http://youtu.be/40fulS_olU8[/youtube]
Retrofraction avatarRetrofraction
MGSV is literally the Skyrim of stealth. 15 hours 3%... #Sneaker'sdelight
ThinMatrix avatarThinMatrix
The Kickstarter campaign is now live for Socuwan – the quirky indie MMORPG created by the community, for the community! https://www.kickstarter.com/projects/1465468930/socuwan-the-community-driven-indie-mmorpg
ScreamAid avatarScreamAid
Excellent video game OST's for the week (no particular order): 1) Super Stickman Golf 2 2) Lethal League 3) Crypt of the Necrodancer
DanteKinkade avatarDanteKinkade
Final season of Continuum is on tonight, featuring time traveling solders in power armor. I can't wait! https://carl9000.files.wordpress.com/2014/06/c15.jpg?w=842
Kallo avatarKallo
That moment when you look at your backlog of games...and it looks back and you and says "What the hell man? you have over 100 games on this list!". I feel guilty...
Steven Hansen avatarSteven Hansen
Idris Elba needs to be James Bond & heck to anyone who thinks otherwise
RadicalYoseph avatarRadicalYoseph
We need a Dtoid RPG that stars Mr Destructoid, Gardevoir, Macho Man Randy Savage, and MATT DAMON. The hub zone will be Nekro's dungeon.
Cynic without a Cause avatarCynic without a Cause
In the middle of discovering a bunch of Hirasawa Susumu's non-film related work. Currently listening to Planet Roll Call. Fantastic album!
Mike Wallace avatarMike Wallace
*Looks at Battle.net* League of Storm Heroes. Magic: The Hearthstone. Diablo. Starcraft. World of Warcraft. Oh, pay $10 to unlock Tychus. ...Guys, is Blizzard evil? I mean really, despicably, EA-level evil?
RadicalYoseph avatarRadicalYoseph
Do you enjoy MOBA games such as LoL, Dota 2, or HOTS? Why or why not? Leave your thoughts in the comments!
James Internet Ego avatarJames Internet Ego
The Witcher 3 is 30% off on GOG.com, if you thought it was a bit expensive at launch. You get store credit too.
Flegma avatarFlegma
Realized I've turned on my PS3 in the past month or two only to watch Mario cartoon DVDs. I really need to get around to playing something - anything - on it.
Perro avatarPerro
Listening to Studio Ghibli Collection at work https://www.youtube.com/watch?v=J_WbO_LPXDo Reminds me that my dad really liked Howl's Moving Castle. He's retired military and serious most of the time but rather enjoyed its fanciful world.
Terry 309 avatarTerry 309
Sorry for my inactivity... I've been lacking motivation and have nothing on my mind right now so i haven't blogged in a while. Still playing Grandia 2 anniversarry, getting annoyed by mount and blade warband's phantasy calradia mod and other shit...
CaseyCor avatarCaseyCor
Donkey Kong Land 3 Any% Speedruns, right now! [url]http://www.twitch.tv/caseycor[/url]
more quickposts


Contest!


destructoid's previous coverage:
Call of Duty: Black Ops II


  Jul 11

Vengeance comes to Black Ops II on PS3 and PC next month

Four multiplayer maps plus another zombies level


  Jun 26

Black Ops II kicks off another Double XP weekend

Treyarch is celebrating the impending release of the Vengeance DLC pack


  Jun 18

Black Ops II nails down July release for Vengeance DLC

Third DLC pack out first on Xbox 360 next month


  Apr 19

Call of Duty to host a Double Weapon XP weekend

Not Double XP proper, which is confusing


View all:powered by:  MM.Elephant

Ads on destructoid may be purchased from:



Please contact Crave Online, thanks!



Seriously

Invert site colors

  Dark Theme
  Light Theme


Destructoid means family.
Living the dream, since 2006

Pssst. konami code + enter

modernmethod logo



Back to Top


We follow moms on   Facebook  and   Twitter
  Light Theme      Dark Theme
Pssst. Konami Code + Enter!
You may remix stuff our site under creative commons w/@
- Destructoid means family. Living the dream, since 2006 -