dark        

Bungie explains how the big Destiny 2 data-erasing bugs happened, and how they're fixing it

0

There were two

Destiny 2 has been having a rough few weeks. It's not like Bungie didn't bounce back, but it's been rough nonetheless.

Several weeks ago, a potentially catastrophic bug wiped out a lot of data following a very casual afternoon reset-time hotfix. It caused a game-wide panic and Bungie had to take down Destiny 2 for the entire afternoon and evening to fix it. After they identified the problem, accounts were rolled back before the bug. Crisis averted.

Then last week, a potentially catastrophic bug wiped out a lot of data following a very casual afternoon reset-time hotfix. It caused a game-wide panic and Bungie had to take down Destiny 2 for the entire afternoon and evening to fix it. After they identified the problem, accounts were rolled back before the bug. Crisis averted. 

Déjà vu, right? Well, it looks like Bungie has identified the issue and is aiming to not have it happen again.

In a huge blog detailing the incidents, Bungie breaks down how inventory management works server-side, and how back in October the publisher "spun up additional servers" to help with the CPU load of the Shadowkeep expansion. What happened is as follows: "one issue was that a small percentage (less than 1 percent) of these servers would crash on start-up due to the volume of servers overwhelming one of the backing databases. Our workaround for this was to simply manually restart the crashed servers each time we detected this issue, and this appeared to address the problem without any discernible side effects for players."

Going forward in time to the hotfix deployment, the servers crashed again, and according to Bungie, the initial crash "resulted in those WorldServers not applying the previous character data corruption fix." When actually testing that hotfix their entire team was "lucky enough" to just experience the "good servers," which resulted in an "all clear" decision to pull the trigger on the hotfix.

So how are they going to make sure it doesn't happen again? Well servers are going to be given preventative maintenance of sorts, WorldServers should crash less, a "permanent fix" for the corruption issue is coming in the new update, they are working on new rollback and recovery systems, and are cleaning up their code in general (a long-listed complaint for Destiny, dating back to the original game).

Well, live and learn. Not being able to play a few nights is a small price to pay for having all of this addressed and fixed. Although if it wasn't, Bungie would have had an even bigger problem on their hands when it comes to player retention.

Destiny 2 Outage and Rollback [Bungie.net]

You are logged out. Login | Sign up

 
 

 

TwitterRedditEmailFacebook
 
Chris Carter
Chris CarterReviews Director, Co-EIC   gamer profile

Chris has been enjoying Destructoid avidly since 2008. He finally decided to take the next step, make an account, and start blogging in January of 2009. Now, he's staff! ------------------- T... more + disclosures


 


 


Also on Destructoid: Destiny 2   (321)   From our database:

  • (Update) Destiny 2 is bringing back Trials of Osiris with its new season - Chris Carter
  • Bungie explains how the big Destiny 2 data-erasing bugs happened, and how they're fixing it - Chris Carter
  • Yet another Destiny 2 hotfix bugged out player accounts and was rolled back - Chris Carter
  • Bungie is running an event in Destiny 2 that doesn't require season pass ownership - Chris Carter
  • You can claim your free Destiny 2 Twitch Prime exotics now - Chris Carter
  • Destiny 2 is back online and accounts are rolled back following a catastrophic bug - Chris Carter
  • Bungie's next big goal for Destiny 2 is to smooth out lingering performance issues - Chris Carter
  • Here's the Destiny 2 shirt that's raising money for Australia fire relief - Brett Makedonski
  • Bungie will sell Destiny 2 shirts to help fight Australia's fires - Brett Makedonski
  • More related stories
    Filed under... #Bungie #Destiny #PC #PS4 #shooters #Xbox One

    READER COMMENTS LOADING BELOW...


    LET'S KEEP THE COMMUNITY GREAT


    You're not expected to always agree, but do please keep cool and never make it personal. Report harassment, spam, and hate speech to our community team. Also, on the right side of a comment you can flag nasty comments anonymously (we ban users dishing bad karma). For everything else, contact us!



     
     
  •