Taking a Digg at best practice

March 1, 2007

DiggWent to another great presentation hosted by Unlimited Potential the other night.

Tim Ellis, the DBA from Digg, gave a free and frank presentation on how they manage to cope with the massive loads they receive.  Up to 3000 requests per second!

Tim’s approach was refreshing, and real good wake up call for corporate business.  Here’s a few takeaways I managed to glean:

  • Scale out, not up.
  • It doesn’t have to cost (at all).  Digg run on MySQL, Google run on MySQL.  So why the bloody hell do you need Oracle (or Sybase, or SQLServer, or DB2)?
  • Use lots and lots of small bits of hardware.
  • You can do it all with server side scripting languages.
  • Use the likes of Nagios and Cacti for monitoring.  They’re, erm, free.
  • Memcached is cool – use it.
  • Don’t worry too much about the usual “corporate best practice” – just be sensible and do what you need to do.   It may not be pretty, but it will work.  Sod best practice.
  • People from Kansas pronounce Wiki as “Wee-Kee”.
  • Hell Pizza and Beers remain the best post-match fodder.

Big thumbs up to Tim for sharing all his knowledge – especially since he was actually on holiday.

If only more people all shared how they manage to do these wonderful things…


One Response to “Taking a Digg at best practice”

  1. Mangee Says:

    ‘Twas a great one, wasn’t it?

    Theres more of Tims stuff at faemalia.net/mysqlUtils
    and UP will have video and slides up shortly.

    Cheers for the review.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: