A Look inside LiveJournal

Rarely does a company offer people the opportunity to see its infrastructural organization. Danga does in this rare
talk from LISA 2004.

Some takeaway lessons from the talk are:

  • Separate services across hosts
  • Scale each component separately
  • Avoid large database replication by using internal pre-indexing of data across databases
  • Let your services fit your needs (ie use both an IP and an HTTP filter for different problems)
  • Storage is key, eg their use of both NetApp, mySQL replication and internally developed storage system MogileFS
  • Cache is key, use Memcached
  • Measure and monitor all aspects of the system for availability and planning
  • This talk is from 2004. We can only speculate to how things have changed since.

Advertisements

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: