This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
1. Hive Raspberry Pi 20131223 R&D Copyright CELLANT Corp.
All Rights Reserved. 1 http://www.cellant.jp/
2. vHadoop Advent Calendar 2013 23 l
http://qiita.com/advent-calendar/2013/hadoop vHiveserver2 Copyright
CELLANT Corp. All Rights Reserved. 2 http://www.cellant.jp/
3. v@sudabon) v R&D v l 19972004 NEC / l 20052006 BIGLOBE /
BtoB l 2012/8 vHadoop1 vHadoopHive Copyright CELLANT Corp. All
Rights Reserved. 3 http://www.cellant.jp/
4. Copyright CELLANT Corp. All Rights Reserved. 4
http://www.cellant.jp/
5. Raspberry Pi vRaspberry PiARM v v25A35B2 Copyright CELLANT
Corp. All Rights Reserved. 5 http://www.cellant.jp/
6. Raspberry Pi Model A Model B $25 $35 SoC Broadcom BCM2835
(CPU, GPU, DSP, SDRAM) CPU 700 MHz / ARM1176JZF-S (ARM11 ) GPU
Broadcom VideoCore IV, OpenGL ES 2.0 (24 GFLOPS) 1080p 30fps
H.264/MPEG-4 AVC High Prole , MPEG-2, VC-1 (SDRAM) 256MB (GPU)
512MB (GPU) USB 2.0 1 2(USB) 10/100 Mbps RJ45 8 GPIO, UART, IC,
SPI2, +3.3 V, +5 V, Copyright CELLANT Corp. All Rights Reserved. 6
http://www.cellant.jp/
7. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 7
http://www.cellant.jp/
8. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 8
http://www.cellant.jp/
9. Raspberry Pi Copyright CELLANT Corp. All Rights Reserved. 9
http://www.cellant.jp/
10. v l Raspberry Pi(Model B)2 l SD(16GB)2 l Ethernet2 l
100Mbps SW Hub1 v l HDMI l TV l USB l USB Copyright CELLANT Corp.
All Rights Reserved. 10 http://www.cellant.jp/
11. TaskTracker JobTracker Hiveserver DataNode HiveMetastore
SecondaryNameNode TaskTracker NameNode DataNode Copyright CELLANT
Corp. All Rights Reserved. 11 http://www.cellant.jp/
12. Hive v 1. 2. 3. 4. 5. 6. 7. OS(Raspberian) OS(Raspberian)
Java Hadoop / Hive / v l HiveRaspberry Pi
http://www.slideshare.net/sudabon/how-toworkhiveonraspberrypi
Copyright CELLANT Corp. All Rights Reserved. 12
http://www.cellant.jp/
13. HiveBench v l Hadoop1.2.1 l Hive0.12.0 l HiveBench101
10000uservisits 1200rankings l SequenceFile v l SELECTJOIN l 1 v l
http://www.slideshare.net/sudabon/how-toworkhiveonraspberrypi/16
Copyright CELLANT Corp. All Rights Reserved. 13
http://www.cellant.jp/
14. v v 101 MapReduce Jobs Launched: Job 0: Map: 2 Reduce: 1
Cumulative CPU: 138.59 sec HDFS Read: 2027641 HDFS Write: 11399
SUCCESS Job 1: Map: 1 Reduce: 1 Cumulative CPU: 25.65 sec HDFS
Read: 11863 HDFS Write: 10119 SUCCESS Job 2: Map: 1 Reduce: 1
Cumulative CPU: 25.39 sec HDFS Read: 10583 HDFS Write: 30 SUCCESS
Total MapReduce CPU Time Spent: 3 minutes 9 seconds 630 msec OK
64.109.226.120 0.9987925 37.0 Time taken: 991.129 seconds, Fetched:
1 row(s) Copyright CELLANT Corp. All Rights Reserved. 14
http://www.cellant.jp/
15. v Raspberry PiHadoop Hive v Raspberry Pi Hive v 512MB Hive
Copyright CELLANT Corp. All Rights Reserved. 15
http://www.cellant.jp/
16. vRaspberry Pi vHive Copyright CELLANT Corp. All Rights
Reserved. 16 http://www.cellant.jp/
17. vHadoop Advent Calendar Hive(@tagomoris) v Copyright
CELLANT Corp. All Rights Reserved. 17 http://www.cellant.jp/
18. Hive Copyright CELLANT Corp. All Rights Reserved. 18
http://www.cellant.jp/