2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...
-
Upload
maude-cummings -
Category
Documents
-
view
216 -
download
0
description
Transcript of 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang...
![Page 1: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/1.jpg)
2011 International Symposium on Intelligence Information Processing and Trusted ComputingHuanggang Normal University Hubei, ChinaGaizhen Yang
The Application of MapReduce in the Cloud Computing
Speaker : Kun-Hsiang, Chang
1
![Page 2: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/2.jpg)
• Abstract• Hadoop• MapReduce• MapReduce Programmed To Perform Task
2
Outline
![Page 3: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/3.jpg)
Analyzes the Hadoop architecture and MapReduce Working principle
How to write Mapper and Reducer classes, and how to use the object
3
Abstract
![Page 4: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/4.jpg)
NameNode
DataNode
Client
4
Hadoop-HDFS
![Page 5: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/5.jpg)
5
Hadoop-MapReduce
![Page 6: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/6.jpg)
6
MapReduce
![Page 7: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/7.jpg)
MapReduce programs can be run in three modes:
Standalone Mode
Pseudo-distributed Mode
Fully-distributed Mode
7
MapReduce
![Page 8: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/8.jpg)
Inputs division and dispatch
task configuration
task executive
Create customized Mapper and Reducer
8
MapReduce Programmed To Perform Task
![Page 9: 2011 International Symposium on Intelligence Information Processing and Trusted Computing Huanggang Normal University Hubei, China Gaizhen Yang Speaker.](https://reader036.fdocuments.net/reader036/viewer/2022062907/5a4d1b757f8b9ab0599b6f06/html5/thumbnails/9.jpg)
Speaker : Kun-Hsiang, Chang
End…
9