Thursday Dec 18, 2008

Map Reduce

Map reduce is getting a lot of publicity these days. I came across an article in Harvard Business Publishing that specifically described this as Google's secret weapon. This problem set seems to fall squarely in the realm of what people want to solve with cloud computing.

In the same vein there is a different project, Hadoop that is attacking this problem as an Open Source project. I came across another article that talks about Hadoop and how it works. We even have an OpenSolaris Project that provides a live Hadoop CD.

So fundamentally these technologies are interesting when we have problems that are inherently separable and parallelisable. An common example is indexing text files. Hadoop grew out of the Lucene project which does that sort of thing.

Anyway, I'm going to take some time and look into this because it all seems very cool.

About

Peter Buckingham

Search

Archives
« July 2014
SunMonTueWedThuFriSat
  
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
  
       
Today