By chhandomay on Feb 27, 2009
know, social media content aggregator FriendFeed pulls together content
from over 40 Websites like YouTube, Flickr, Twitter and more. Needless
to say, the service manages a large quantity of information.
|Today Bret Taylor -- the
co-founder of FriendFeed -- has published a
of MySQL on his company blog stating, "We have optimized our
primary indexes quite a bit in this new [MySQL] system, and we are
quite pleased with the results."
The review has gotten attention from FriendFeed's strong advocates among the online/social media community. Robert Scoble already posted to Twitter about the post being included on top tech news aggregator Techmeme.
In the review, Bret described how the company looked to manage the rapid growth of content they're experiencing, with their service currently storing over 250 million entries as well as other comments and data.
Bret said that FriendFeed uses MySQL for storing all of this data, and the company was looking for ways to scale and manage indexes more quickly. Regarding background research, Bret said, "In the tests we read about and ran ourselves, none of the projects were stable or battle-tested enough for our needs... MySQL works. It doesn't corrupt data. Replication works. We understand its limitations already. We like MySQL for storage, just not RDBMS usage patterns." This lead the team to implement a "schema-less" storage system on top of MySQL rather than use a completely new storage system.
The majority of the review includes the actual high-level architecture FriendFeed employs, and follows with some graphical representation of the success they've seen. Bret said, "In particular, the latency of our system is now remarkably stable, even during peak mid-day hours."
In conclusion, Bret noted, "the system has been really easy to work with so far. We have already changed the indexes a couple of times since we deployed the system, and we have started converting some of our biggest MySQL tables to use this new scheme so we can change their structure more liberally going forward."