Hadoop and Project Voldemort

Great article in two parts (part 1, part 2) co-authored by Elias Torres (a colleague and friend) on using Hadoop and Project Voldemort for managing very large datasets.

It was interesting to read about the deployment issues they had to deal with as I dealt with some of the same issues with the indices for the search engine at Feedster (the update cycle there was 10 minutes), and the issue with key lookup as I had to engineer that for the search engine.

Advertisements

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: