François Schiettecatte’s Blog

June 21, 2007

MySQL Scaleout

Filed under: Feedster, Scaling — François Schiettecatte @ 2:21 pm

Some notes on MySQL and Wikipedia, sorta thrown in with the MySQL 12 days of Scale-Out.

These notes are very high level but they are very good nonetheless, the way you scale MySQL is to partition your data, Wikipedia slices by:

  • data segments
  • tasks
  • time

That is the only way to go, the approach I take is that if you can’t slice and dice your data, it will not scale.

At Feedster the data was very time dependent, old posts, new posts, etc… people want to see the new stuff and are not so keen on the old stuff, so we sliced up the posts into segments and delta segments, lower numbered segments contained older posts, higher numbered segments contained newer posts, and we could replicate those segments across servers.

No Comments »

No comments yet.

RSS feed for comments on this post. TrackBack URI

Leave a comment

You must be logged in to post a comment.

Blog at WordPress.com.