Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments...
24
Big Data 3/17/2019 1
Transcript of Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments...
![Page 1: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/1.jpg)
Big Data
3/17/2019
1
![Page 2: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/2.jpg)
3/17/2019
2
What is Data?
![Page 3: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/3.jpg)
What is Big Data?
3/17/2019
3
![Page 4: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/4.jpg)
Another example
3/17/2019
4
![Page 5: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/5.jpg)
How does they use our Data?
3/17/2019
5
![Page 6: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/6.jpg)
Example
3/17/2019
6
First problem is to get space 300TB on the disk
![Page 7: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/7.jpg)
Cont..
3/17/2019
7
Second Problem is processing this big data
![Page 8: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/8.jpg)
Cont..
3/17/2019
8
In single PC
![Page 9: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/9.jpg)
Cont..
3/17/2019
9
![Page 10: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/10.jpg)
Hadoop
3/17/2019
10
![Page 11: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/11.jpg)
3/17/2019
11
Vertical and Horizontal Scaling
![Page 12: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/12.jpg)
Vertical and Horizontal Scaling
3/17/2019
12
![Page 13: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/13.jpg)
Difference between Hadoop & SQL
3/17/2019
13
![Page 14: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/14.jpg)
Cont…
3/17/2019
14
![Page 15: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/15.jpg)
Cont..
3/17/2019
15
![Page 16: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/16.jpg)
3/17/2019
16
Some basic Terminology
![Page 17: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/17.jpg)
Cluster…
3/17/2019
17
![Page 18: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/18.jpg)
Block … in Hadoop 64MB
3/17/2019
18
![Page 19: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/19.jpg)
3/17/2019
19
![Page 20: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/20.jpg)
Block Size..
3/17/2019
20
![Page 21: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/21.jpg)
Example…
3/17/2019
21
![Page 22: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/22.jpg)
Split Data…
3/17/2019
22
Complete Record
![Page 23: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/23.jpg)
3/17/2019
23
Hadoop
![Page 24: Big Data - University of BabylonBig data: Huge amount of Data FB clicks, likes, comments Sensors(whether forcasting sensors, traffic sensors) Google(Rs 6) Search Engine enrique songs,](https://reader030.fdocuments.net/reader030/viewer/2022040900/5e6e9ffa021f4d514e21f898/html5/thumbnails/24.jpg)
THANK YOU
3/17/2019
24