9th July Rollback

From Discworld MUD Wiki
Jump to: navigation, search

A major crash occurred on this day, at 20:09 BST. It appears that to prevent some character files from being lost entirely, the entire MUD was restored from a 10-day old backup. Logs from the talker from the period in which the problem was discovered and after the rollback that followed are here: Ubercrash talkerlog

Announcements:

Note #10 posted at Thu Jul 9 Title: "BAD THINGS [TM]"


Something bad happened and basically the mud rolled back to it's last disk snapshot which happens to be the 29th June so basically we've lost the last 10 days of existence. And before anyone asks, no, there is absolutely no way to get back any of the last 10 days now so please just assume we've time warped and continue as usual

J [Sojan]

Timing

  • 2009 07 09: 20:09 BST - Mud goes down.
  • 2009 07 09: ??:?? BST - Mud comes back up, many players' accounts missing.
  • 2009 07 09: 21:52 BST - Mud down again.
  • 2009 07 09: 23:00 BST - Mud back up, rollback in evidence.

What Actually Happened

The Discworld MUD runs on a VMWare/ESX platform. Normally, snapshots of the virtual drives are written to disk every day. According to Sojan, on the 29th something happened to stop the snapshots from flushing the data, and the drive filled and corrupted itself. As a result, the disk crashed, and the latest backup we have is from the 29th.


If it it disappears again: Refugee chat room: here
Refugee forum here at: Talk:9th July Rollback (start new topic)