zen bones...

  • Random
  • Archive
  • RSS
  • Ask me anything

The Mighty Google

For fault tolerance, Google uses GFS or distributed disk storage. Every piece of data is replicated three times. If one machine dies, a master redistributes the data to a new server. There are around 200 clusters (some with over 5 PB of disk space on 500 machines). The Big Table is used for distributed memory. The largest cells in the Big Table are 700 TB, spread over 2000 machines. MapReduce is the solution for new programming paradigms. It cuts a trillion records into a thousand parts on a thousand machines. Each machine will then load a billion records and will run the same program over these records, and then the results are recombined.

Full article 

  • 3 years ago
  • Comments
  • Permalink
  • Share
    Tweet

Recent comments

Blog comments powered by Disqus
← Previous • Next →

zen bones...

Steve Mathew's Blog

Steve avatar

Follow @SteveMathew

OK, so why the zen bones thing?

About 20 years ago I stumbled upon a book called "Zen Flesh, Zen Bones". Being vegetarian - the "flesh" bit didn't grab me, but the short pithy Zen stories inside it, did.

Ever since then my web nick has been zenbones, my Hotmail, my Gmail address, you name it. It's kinda stuck.

Is the blog about Zen? Nope.


Latest Post

My Photos

My Articles

Tech Stuff

Design Stuff

Fun Stuff

Random Blog Post



Download my iPhone App





  • About this blog

Twitter

loading tweets…

  • RSS
  • Random
  • Archive
  • Ask me anything
  • Mobile