“Introducing Hadoop on Azure: Joe Hummel, PhD Visiting Researcher: U. of California, Irvine Adjunct Professor: U. of Illinois, Chicago & Loyola U., Chicago Materials: http://www.joehummel.net/downloads.html Email: [email protected]hello Map-Reduce!”
hello Map-Reduce!”. “Introducing Hadoop on Azure:. Joe Hummel, PhD Visiting Researcher: U. of California, Irvine Adjunct Professor: U. of Illinois, Chicago & Loyola U., Chicago. Materials: http ://www.joehummel.net/downloads.html Email: [email protected]. A little history…. - PowerPoint PPT Presentation
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
“Introducing Hadoop on Azure:
Joe Hummel, PhD
Visiting Researcher: U. of California, IrvineAdjunct Professor: U. of Illinois, Chicago &
// function returns 1 if i is prime, 0 if not:let isPrime(i) = ...
// sums 2 numbers:let sum(x, y) = return x + y
// count the number of primes in 1..N:let countPrimes(N) = let L = [ 1 .. N ] // [ 1, 2, 3, 4, 5, 6, ... ] let T = map isPrime L // [ 0, 1, 1, 0, 1, 0, ... ] let count = reduce sum T // 42 return count
3
Hadoop:◦ Created by to drive internet search◦ Parallelism
◦ Data partitioning
◦ Fault tolerance
A little more history…
BIGData
pagehits
4
Freely-available framework for big data◦ http://hadoop.apache.org/