Hadoop for ETL Professionals & ETL Developers
-
Upload
skillspeed -
Category
Technology
-
view
141 -
download
1
Transcript of Hadoop for ETL Professionals & ETL Developers
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Roles and Responsibilities of ETL Professional
EXTRACTReading
data from a database
TRANSFORMConverting the
extracted data into required format
LOADWriting the data into
target database
Responsibilities of an ETL Professional
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Limitations of traditional ETL tools
Parameters Traditional ETL
Tools
Unstructured Data
Scalability
Cost
Security
Real Time Analysis
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Hadoop Advantage
Parameters Traditional ETL
Tools
Hadoop
Unstructured Data
Scalability
Cost
Security
Real Time Analysis
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Big Data Problem
Big data is the term for a collection of data sets so large and complex that it becomes difficult to process using on-hand database management tools or traditional data processing applications
Systems / Enterprises generate huge amount of data from Terabytes to and even Petabytes of information
It’s very difficult to manage such huge data……
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Say Hello to Hadoop
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
What Hadoop can do for YOU?
Apache Hadoop is a framework that allows the distributed processing of large data sets across clusters of commodity computers using a simple programming model
It is an Open-source Data Management technology to handle Big Data and other complex data sources
Hadoop Characteristi
cs
Flexible
Reliable
Economical
Scalable Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Why should an ETL Professional move to Hadoop?
Hadoop has become the industry standard for storing, managing & processing data
Organizations are adopting Hadoop as it reduces the scalability cost incurred by traditonal ETL tools
Big Data technologies can process information at faster rates with real-time capabilities
Hadoop gives you an opportunity to work on solving real world problems and a direct entry into analytics and decision-making
Hadoop guarantees a promising future in terms of work quality & remuneration
Organizational Level Individual Level
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Hadoop Job Trends
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Reports – 2015
Here are some of the other Reports that convey the same message:
ᗍ “It is expected that Hadoop and Big Data Analytics will grow to around $13.9 billion from 2012 to 2017.” (Markets and Markets Research Report)
ᗍ “The Data market currently with the fastest growth are Hadoop and NoSQL software and services.” (Technology Research Organization, Wikibon)
ᗍ “The Big Data market will likely hit $23.8 billion with a 31.7% rise per year.” (IDC Report)
ᗍ “Almost 90% organizations have embarked on Hadoop related projects and thus Hadoop skills are in huge demand.” (According to the Big Data Executive Survey 2013)
ᗍ “Companies hiring Hadoop professionals Analytics professionals in India obtain a 250 percent hike in their salaries.” (According to Analytics Industry Report)
Gartner had predicted, “Hadoop will be in most advanced analytics products by 2015.” By far and large, this prediction has turned out to be true. Hadoop is “The Technology” to harness Big Data
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Demand for Hadoop + ETL Professionals
Some of the best organizations prefer ETL skills with Hadoop
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Why SkillSpeed?
Course Curriculum
from Industry Experts
Instructor Led Live Virtual Sessions
Lifetime access to Course
Content via LMS
100% Placement Assistance
24x7 Support
24x7
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Course Topics
Module 1
Introduction to Big Data and Hadoop
Module 2
HDFS Internals, Hadoop
Configurations and Data Loading
Module 3
Introduction to Map Reduce
Module 4
Advanced Map Reduce Concepts
Module 5
Introduction to Pig
Module 6
Advanced Pig and Introduction to Hive
Module 7
Advanced Hive Concepts
Module 8
Extending Hive and HBase Introduction
Module 9
Advanced HBase and Oozie Introduction
Module 10
Project Set-up Discussion
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Corporate Partners
Get Started with BIG Data & Hadoop
Slide ‹#›© 2015 BlueCamphor Technologies (P) Ltd. www.skillspeed.com
Lines open 24/7
To know more about the course, Please contact:
IND+91-90660-20904USA 1866-607-6547 (Toll Free)
Or reach us at
Contact Us
Get Started with BIG Data & Hadoop