Hadoop in a Box
Hadoop in a Box
May 06, 2015
You can run Hadoop on pretty much any hardware out there, as it makes very few assumptions about its environment. In this talk I present the modular and highly energy-efficient storage server which is currently being developed by the OpenStoragePod project.
I explain the motivations for basing our design on large numbers of 2.5" laptop disks, and discuss why you might want to consider using OpenStoragePod as the basis for building your (next) Hadoop cluster.
I explain the motivations for basing our design on large numbers of 2.5" laptop disks, and discuss why you might want to consider using OpenStoragePod as the basis for building your (next) Hadoop cluster.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Hadoop in a Box
flickr.com/photos/brent_nashville/2228396914
flickr.com/photos/bizkit/2698782365
data
CPU
data
CPU
S.E.T.I.
data
CPU
S.E.T.I.
Avatar
data
CPU
S.E.T.I.
Avatar
mostothers
History
1956
ed-thelen.org
1980
en.wikipedia.org
2010
OpenStoragePod
Mission
Return on Byte (ROB) = value to be extracted from byte / cost of storing that byte
(Amr Awadallah, Cloudera)
Total Cost of OwnershipCapEx
OpEx
Total Cost of OwnershipCapEx
OpEx
Total Cost of OwnershipCapEx
OpEx
Total Cost of OwnershipCapEx
OpEx
OpenStoragePod
Total Cost of OwnershipCapEx
OpEx
“Petascale storage for the rest of us”
Design
3.5” 2.5”
price €80 €180
power 3.4 W
idle power 2.8 W
weight 330 g
volume 195 cm³
3.5” 2.5”
price €80 €180
power 3.4 W 1.7 W
idle power 2.8 W 0.75 W
weight 330 g 153 g
volume 195 cm³ 88 cm³
Node170 x 170 x 170 mm100 W (12V)20 TB(= 20 disks)
Pod6 nodes, 4U600 W (220V)120 TB(= 120 disks)
Rack10 pods6 KW 1.2 PB (= 1200 disks)
Container8 racks48 KW9.6 PB (= 9600 disks)
Status
Cube140 x 140 x 140 mm15 W (5V)5 TB(= 5 disks)
Q & A
openstoragepod.org
speakerrate.com/talks/3465
Related Documents
