Hadoop for ETL Professionals & ETL Developers

16
Slide ‹#› © 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com Hadoop for ETL Professionals

Transcript of Hadoop for ETL Professionals & ETL Developers

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Hadoop for ETL Professionals

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Roles and Responsibilities of ETL Professional

EXTRACTReading

data from a database

TRANSFORMConverting the

extracted data into required format

LOADWriting the data into

target database

Responsibilities of an ETL Professional

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Limitations of traditional ETL tools

Parameters Traditional ETL

Tools

Unstructured Data

Scalability

Cost

Security

Real Time Analysis

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Hadoop Advantage

Parameters Traditional ETL

Tools

Hadoop

Unstructured Data

Scalability

Cost

Security

Real Time Analysis

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Big Data Problem

Big data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications

Systems / Enterprises generate huge amount of data from Terabytes to and even Petabytes of information

It’s very difficult to manage such huge data……

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Say Hello to Hadoop

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

What Hadoop can do for YOU?

Apache Hadoop is a framework that allows the distributed processing of large data sets across clusters of commodity computers using a simple programming model

It is an Open-source Data Management technology to handle Big Data and other complex data sources

Hadoop Characteristi

cs

Flexible

Reliable

Economical

Scalable Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Why should an ETL Professional move to Hadoop?

Hadoop has become the industry standard for storing, managing & processing data

Organizations are adopting Hadoop as it reduces the scalability cost incurred by traditonal ETL tools

Big Data technologies can process information at faster rates with real-time capabilities

Hadoop gives you an opportunity to work on solving real world problems and a direct entry into analytics and decision-making

Hadoop guarantees a promising future in terms of work quality & remuneration

Organizational Level Individual Level

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Hadoop Job Trends

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Reports – 2015

Here are some of the other Reports that convey the same message:

ᗍ “It is expected that Hadoop and Big Data Analytics will grow to around $13.9 billion from 2012 to 2017.” (Markets and Markets Research Report)

ᗍ “The Data market currently with the fastest growth are Hadoop and NoSQL software and services.” (Technology Research Organization, Wikibon)

ᗍ “The Big Data market will likely hit $23.8 billion with a 31.7% rise per year.” (IDC Report)

ᗍ “Almost 90% organizations have embarked on Hadoop related projects and thus Hadoop skills are in huge demand.” (According to the Big Data Executive Survey 2013)

ᗍ “Companies hiring Hadoop professionals Analytics professionals in India obtain a 250 percent hike in their salaries.” (According to Analytics Industry Report)

Gartner had predicted, “Hadoop will be in most advanced analytics products by 2015.” By far and large, this prediction has turned out to be true. Hadoop is “The Technology” to harness Big Data

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Demand for Hadoop + ETL Professionals

Some of the best organizations prefer ETL skills with Hadoop

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Why SkillSpeed?

Course Curriculum

from Industry Experts

Instructor Led Live Virtual Sessions

Lifetime access to Course

Content via LMS

100% Placement Assistance

24x7 Support

24x7

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Course Topics

Module 1

Introduction to Big Data and Hadoop

Module 2

HDFS Internals, Hadoop

Configurations and Data Loading

Module 3

Introduction to Map Reduce

Module 4

Advanced Map Reduce Concepts

Module 5

Introduction to Pig

Module 6

Advanced Pig and Introduction to Hive

Module 7

Advanced Hive Concepts

Module 8

Extending Hive and HBase Introduction

Module 9

Advanced HBase and Oozie Introduction

Module 10

Project Set-up Discussion

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Corporate Partners

Get Started with BIG Data & Hadoop

Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com

Lines open 24/7

To know more about the course, Please contact:

IND+91-90660-20904USA 1866-607-6547 (Toll Free)

Or reach us at

[email protected]

Contact Us

Get Started with BIG Data & Hadoop