Data visualization and big data analysis tools - itu.int · Data visualization and big data...

9
Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1

Transcript of Data visualization and big data analysis tools - itu.int · Data visualization and big data...

Page 1: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Data visualization andbig data analysis tools

Akmal B. ChaudhriGridGain Systems

1

Page 2: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

My background

Wide-range of roles

Blue Chip companies

Big Data startups

Wide-range of technologies

Database systems

Programming languages

Developer relations

University relations

10 books, many presentations

2

Page 3: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

3

Page 4: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Big Data in Asia

Malaysia Indonesia

4

Page 5: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Problem statement

Huge quantities of data are being generated today

Only 0.5% of data are analyzed(SOR: MIT Technology Review)

Enormous potential for data insights and visualization

Agriculture, Weather, Traffic, ...

What solutions are available?

5

Page 6: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Example solutions

The Apache Software Foundation

Analytics

Apache Spark, Apache Kafka, Apache Drill

Scale and Performance

Apache Ignite

Community Editions

Pentaho

6

Page 7: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Example ASF IoT software stack

7

Page 8: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache
Page 9: Data visualization and big data analysis tools - itu.int · Data visualization and big data analysis tools Akmal B. Chaudhri GridGain Systems 1. My background ... Apache Spark, Apache

Thank You!

10


Recap Need for data visualization Importance of data visualization Limitation of spreadsheet Interpretation through data visualization Interactive visualization.

Recap Need for data visualization Importance of data visualization Limitation of spreadsheet Interpretation through data visualization Interactive visualization.

Data Visualization Data Visualization. Business Analytics (BA) Overview.

Data Visualization Data Visualization. Business Analytics (BA) Overview.

Introduction Apache Spark - PRACE Research … DBGroup @ unimore Giovanni Simonini Giuseppe Fiameni Apache Spark Introduction School on Scientific Data Analytics and Visualization

Introduction Apache Spark - PRACE Research … DBGroup @ unimore Giovanni Simonini Giuseppe Fiameni Apache Spark Introduction School on Scientific Data Analytics and Visualization

Visualization (44413) Data Visualization (44613)

Visualization (44413) Data Visualization (44613)

Apache Flume™ and Apache Sqoop™ Data Ingestion to Apache ...

Apache Flume™ and Apache Sqoop™ Data Ingestion to Apache ...

CyberGIS Center for Advanced Digital and Spatial Studies Interactive Visualization of Large-scale Movement Data using Apache Spark Junjun Yin -- Postdoc.

CyberGIS Center for Advanced Digital and Spatial Studies Interactive Visualization of Large-scale Movement Data using Apache Spark Junjun Yin -- Postdoc.

Data Visualization Tools & Techniques · 2015-12-04 · Data Visualization Tools & Techniques John Brosz Research Data & Visualization Coordinator. ... – Daily example of a visualization

Data Visualization Tools & Techniques · 2015-12-04 · Data Visualization Tools & Techniques John Brosz Research Data & Visualization Coordinator. ... – Daily example of a visualization

Steven Demurjian, Ph.D. · This provides a more immersive ... Apache Spark for advanced, distributed data analytics, and a custom JavaScript web application for data visualization.

Steven Demurjian, Ph.D. · This provides a more immersive ... Apache Spark for advanced, distributed data analytics, and a custom JavaScript web application for data visualization.

using Apache Spark and Zeppelin - DeveloperMarchdevelopermarch.com/.../report/...SparkBigData_PrajodVettiyattil.pdf · Big Data Visualization using Apache Spark and Zeppelin Prajod

using Apache Spark and Zeppelin - DeveloperMarchdevelopermarch.com/.../report/...SparkBigData_PrajodVettiyattil.pdf · Big Data Visualization using Apache Spark and Zeppelin Prajod

Data Visualization & R Shiny · Data Visualization & R Shiny CEE 412/ CET 522 Transportation Data Management and Visualization WINTER 2020. Outline Data Pipeline Visualization in

Data Visualization & R Shiny · Data Visualization & R Shiny CEE 412/ CET 522 Transportation Data Management and Visualization WINTER 2020. Outline Data Pipeline Visualization in

Reaching Broader Audiences with Data Visualization · visualization, data visualization on mobile devices, inclusive data visualization, and multimodal interaction for data visualization—that,

Reaching Broader Audiences with Data Visualization · visualization, data visualization on mobile devices, inclusive data visualization, and multimodal interaction for data visualization—that,

Data Visualization with Dojo toolkit Gu Yi, He Apache Asia Roadshow 2010.

Data Visualization with Dojo toolkit Gu Yi, He Apache Asia Roadshow 2010.

Data Exploration and Visualization - Big Data | Big Data · Visualization Visualization is the conversion of data into a visual or tabular format. Visualization helps understand the

Data Exploration and Visualization - Big Data | Big Data · Visualization Visualization is the conversion of data into a visual or tabular format. Visualization helps understand the

Data Visualization Effectiveness Profile - Perceptual · PDF fileData Visualization Effectiveness Profile Stephen Few Data Visualization

Data Visualization Effectiveness Profile - Perceptual · PDF fileData Visualization Effectiveness Profile Stephen Few Data Visualization

GPUS FOR DATA SCIENCE (RAPIDS)...Execute end-to end data science and analytics pipelines on GPUs Data Preparation Model Training Visualization cuDF cuML cuGRAPH Apache Arrow A columnar,

GPUS FOR DATA SCIENCE (RAPIDS)...Execute end-to end data science and analytics pipelines on GPUs Data Preparation Model Training Visualization cuDF cuML cuGRAPH Apache Arrow A columnar,

Data Visualization

Data Visualization

Data visualization: basic principles - GitHub Pagespaldhous.github.io/ucsc/.../dataviz_principles.pdf · Data visualization: basic principles . Visualization: encoding data by visual

Data visualization: basic principles - GitHub Pagespaldhous.github.io/ucsc/.../dataviz_principles.pdf · Data visualization: basic principles . Visualization: encoding data by visual

Introduction to Data Visualization Definition of Data Visualization Terms related to Data Visualization Data Mining Data Recovery Data Redundancy Data.

Introduction to Data Visualization Definition of Data Visualization Terms related to Data Visualization Data Mining Data Recovery Data Redundancy Data.

Coupling visualization and data analysis for knowledge ... · Visualization Data Analysis Visualization Enabling Technologies Scientific Visualization Data Selection Figure 1: Overview

Coupling visualization and data analysis for knowledge ... · Visualization Data Analysis Visualization Enabling Technologies Scientific Visualization Data Selection Figure 1: Overview

Introduction Apache Spark - hpc-forge.cineca.it · Apache Spark Introduction School on Scientific Data Analytics and Visualization 20-24 June 2016 CINECA Università di Modena e Reggio

Introduction Apache Spark - hpc-forge.cineca.it · Apache Spark Introduction School on Scientific Data Analytics and Visualization 20-24 June 2016 CINECA Università di Modena e Reggio