A couple of weeks ago, we deployed a portal website for Eccky. Before, children could play Eccky through the Hyves or Facebook platform. With the portal, children can access the game without any of these social logins. Also Facebook users, Hyves users and portal users will from now on share one world.
Preparation of the portal took quite some time, since we wanted to convert our existing database to a more friendly structure that would support multiple login interfaces for the user (Hyves, Facebook, etc.).
Database conversion itself takes time, and it should be monitored all the time. With Eccky, we don’t have the luxury of a live shadow environment where we could convert the database on the background and when it’s finished switch it to the live environment.
Below is a recap of our deployment and a fine example of Murphy’s Law.
Monday, May 30th
04:00 Enter the office and start the database conversion.
09:00 Every table except for two large tables is converted, that seems promising.
12:00 One of the large tables, the BuddyList, is still not converted. This seems suspicious.
14:00 The BuddyList is finished, however after a few tests, my suspicion seems right, the table has been corrupted during the conversion. I feel Murphy standing behind me.
16:00 To repair the BuddyList more disk space is needed, so we need to clean up old tables and old files. In the meantime we make an empty dummy table so testers can still continue to test.
Tuesday, May 31th
00:00 Start the repair of the BuddyList. This takes some time, so some of the colleagues take this opportunity to get creatively some rest.
03:00 The BuddyList is back in its old state, so testers can continue to test for a while.
04:00 Everybody goes home to return in a few hours to continue the deployment.
12:00 Back in the office, the BuddyList is still in its old state and the only thing not working in the game. Instead of trying to convert it again (and risk corrupting it again) we start building on a workaround
14:00 Following Murphy’s Law, www.eccky.com can’t be reached anymore. Our domain name server decided to stop working. We immediately switch to another domain server, but domain propagation around the world could take around 24 hours.
23:00 Everybody is going home to get some good rest for what is hopefully the last day of deployment.

Wednesday, June 1st
00:00 (@home) I am not completely happy with the workaround for the BuddyList. I try one more solution to convert the BuddyList.
02:00 (@home) The new solution seems promising.
03:30 (@home) The BuddyList has been converted, and a few tests show that the data is all there. It seems that Murphy is packing his bags.
12:00 The IP change of www.eccky.com is now visible to us in China, we can continue to test on a “live” environment, and fix last minute bugs. However, www.eccky.com is still not reachable in the Netherlands.
Thursday, June 2nd
00:00 (18:00 Dutch time) Finally, www.eccky.com is now also working in the Netherlands. It’s time to go live!
00:10 Children in the Netherlands are trying to access our game, however a bug in the login process stops several children to login.
02:00 The login bug is fixed.
04:00 Some more small bugs are fixed, the game runs, everybody can go home to have a good sleep.
This was just a small recap of the deployment. During these days the whole team worked hard to fix any last minute bugs. I thank Fenix, Tobe, Sophie, Ethan, Fair and Gabriel for their efforts and spirit. To everybody, just check out http://www.eccky.com to see the result. It is a fine start!



