Week 2, Day 3
Theme: Big Data Practitioners
Continuing on from our exploration of big data we look at how this is being used at Facebook.
READ Today's task: Facebook Engineering Scaling Analytics Solutions 120Mb
45 minutes (includes 15 minutes of Q&A)
Facebook Inc., 'Facebook Engineering Scaling Analytics Solutions Tech
Talk Facebook', Alex Himel, Engineering Manager at Facebook, March, 2011.
Key takeout: The architecture and features behind Facebook’s new realtime
analytics solutions scale to handle many millions of events across millions of
sites per day. This was achieved through the methodical elimination of road-
blocks to realtime analysis. The scale is impressive but the message is a very
familiar one: Content must be engaging and the analytics must be actionable
to have any value.
Note: The audio for the first 4 minutes of the presentation is not great.
It gets better after that.
You can also access the video stream on Facebook here.
WATCH For extra credit: Facebook High Scalability 200KB
'Facebook's New Realtime Analytics System: HBase to Process 20 Billion Events
Per Day', by Todd Hoff author of the 'High Scalability' blog, March 2011.
Key takeout: The use of social plugins in Facebook has driven an explosion of
content and connections that resonate with users. Analytics has enabled the
company to make sense - and money - out of all of this data. Todd explains
how by providing a great deal of information beyond the Facebook presentation
by Alex Himel.
I recommend becoming a regular reader of the High Scalability blog. It is an
excellent source of insight.
The MBAnalytics is just one part of the Business Intelligence CORTEX - a community of Business Intelligence, Data Warehousing, Analytics and Project Management professionals in Australia, New Zealand and Asia. Membership is free and the forums are very active with over 20,000 posts offering a uniquely Australasian viewpoint.