[ms] · Est. May 2002

Music madethis place,we just kept itgoing...

One durable person. One social graph. Many communities—and every way people speak, share, listen, write, gather and remember.

01PulsePosts · shares · activity 02PeopleIdentity · relationships · history 03CommunitiesGroups · forums · events 04Music + MediaListen · discover · discuss

Forums / Computers / Electronics / Games

How Facebook keeps 100 petabytes of Hadoop data online

3 durable postsStarted 2012-06-13Latest 2012-06-15

#119445Post 1 of 32012-06-13

[URL]http://gigaom.com/cloud/how-facebook-keeps-100-petabytes-of-hadoop-data-online/[/URL]

Hadoop is freaking cool and is one of the most fun things I get to play with for my job. This article is pretty sweet.

I didn't deal with anything near 100PB, but greping through ~2TB of logfile data each month for interesting stuff is still pretty fun.

#1623719Post 2 of 32012-06-15

Re: How Facebook keeps 100 petabytes of Hadoop data online

I grep through logs every month for personal projects, it's cool to see how people are using your tools

#1623722Post 3 of 32012-06-15

Re: How Facebook keeps 100 petabytes of Hadoop data online

Hadoop is awesome. You can do some pretty amazing things easily. It's cool launching 100 servers and waiting 10 mins and they are up and having a 500TB distributed filesystem at your fingertips.