MySQL Scaleout

Some notes on MySQL and Wikipedia, sorta thrown in with the MySQL 12 days of Scale-Out.

These notes are very high level but they are very good nonetheless, the way you scale MySQL is to partition your data, Wikipedia slices by:

  • data segments
  • tasks
  • time

That is the only way to go, the approach I take is that if you can’t slice and dice your data, it will not scale.

At Feedster the data was very time dependent, old posts, new posts, etc… people want to see the new stuff and are not so keen on the old stuff, so we sliced up the posts into segments and delta segments, lower numbered segments contained older posts, higher numbered segments contained newer posts, and we could replicate those segments across servers.

Advertisements

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: