BIG DATA Hadoop (Development) Training In Noida Delhi NCR
3
l l l l Understanding Big data Collecting and cleaning data Traditional approach for processing and its challenges Big data vs Hadoop Big Data – the actual reason for Hadoop CURRICULUM BIG DATA Hadoop (Development) l l l l l l l l Hadoop overview Hadoop components Hadoop distributions Getting started What is HDFS What is Map Reduce Hadoop stack Hands On – Hadoop setup and basic operations An introduction to Hadoop l l l l l l HDFS explained High availability Federation Architecture File system Shell Hands On HDFS l l l l l l l l l Map Reduce flow Hello World Map Reduce API concepts Mapper Reducer Other components – combiner, partitioner, shuffle/sort Hadoop 1.x vs 2.x Hadoop streaming API Hands on with Eclipse Map Reduce l l l l l l Architecture Scheduler Resource Manager (RM) RM HA YARN commands Hands On with YARN applications YARN
Transcript of BIG DATA Hadoop (Development) Training In Noida Delhi NCR
l
l
l
l
Understanding Big data
Collecting and cleaning data
Traditional approach for processing and its challenges
Big data vs Hadoop
Big Data – the actual reason for Hadoop
CURRICULUM
BIG DATAHadoop (Development)
l
l
l
l
l
l
l
l
Hadoop overview
Hadoop components
Hadoop distributions
Getting started
What is HDFS
What is Map Reduce
Hadoop stack
Hands On – Hadoop setup and basic operations
An introduction to Hadoop
l
l
l
l
l
l
HDFS explained
High availability
Federation
Architecture
File system Shell
Hands On
HDFS
l
l
l
l
l
l
l
l
l
Map Reduce flow
Hello World
Map Reduce API concepts
Mapper
Reducer
Other components – combiner, partitioner, shuffle/sort
Hadoop 1.x vs 2.x
Hadoop streaming API
Hands on with Eclipse
Map Reduce
l
l
l
l
l
l
Architecture
Scheduler
Resource Manager (RM)
RM HA
YARN commands
Hands On with YARN applications
YARN
l
l
l
l
RDBMS interaction using Sqoop
Workflow management using Oozie
Back office jobs with Zookeeper
Hands On with actual data sets
Integrating Hadoop into the Workflow
l
l
l
Unstructured data using PIG
Structured data mining using hive
Hands On with actual data sets
Data Mining
l
l
l
l
l
l
l
l
Problem with SQL Database
Introduction to NOSQL
Hands On Exercises
Introduction to HBASE
Column Families
Delving deeper into HBASE
HBASE Architecture
HBASE Hands-On Exercises
HBASE
l
l
l
l
l
l
l
l
More about ToolRunner
Testing with MRUnit
Reducing Intermediate Data With Combiners
The configure and close methods for Map/Reduce Setup and Teardown
Writing Partitioners for Better Load Balancing
Hands-On Exercise
Directly Accessing HDFS
Using the Distributed Cache
Delving Deeper Into the Hadoop API
l
l
l
l
l
l
l
l
Debugging MapReduce Code
Using LocalJobRunner Mode for Easier Debugging
Retrieving Job Information with Counters
Logging
Splittable File Formats
Determining the Optimal Number of Reducers
Map-Only MapReduce Jobs
Hands-On Exercise
Practical Development Tips and Techniques
l
l
l
Map-Side Joins
The Secondary Sort
Reduce-Side Joins
Joining Data Sets in MapReduce
Partners :
.
E - 35, SITE - 4, Near SwarnaNagari, Adjacent J.P. Golf Course, Greater Noida (U. P.)Ph. : 0120-4345190-91-92 to 97Mb. :09899909738, 09899913475
GREATER NOIDANOIDAA-43 & A-52, Sector-16, Noida - 201301, (U.P.) INDIAPh. : 0120-4646464Mb. : 09871055180
GHAZIABAD1, Anand Industrial Estate, Near ITS College, Mohan Nagar, Ghaziabad (U.P.)Ph.: 0120-4835400...98-99Mb. : 09810831363 / 9818106660 : 08802288258 - 59-60
GURGAON1808/2, 2nd floor old DLF,Near Honda Showroom,Sec.-14, Gurgaon (Haryana)Ph. : 0124-4219095-96-97-98Mb. : 09873477222-333
SCO-32, 1st Floor, Sec.-16,Faridabad (HARYANA)Ph. : 0129-4150605-09Mb. : 09811612707
FARIDABAD
38,Jai Jawan Colony 3rd,Near Gaurav Tower,JLN Marg, Jaipur (Rajsthan) Ph. : 0141-2550077, 2550202Mb : 08824246937
JAIPURC-8, Ist floor, Opposite Aditya College, Near Airtel Office,City Centre, Gwalior (M.P.)Ph. : 0751-6058744Mb. : 09039078744
GWALIOR
www.facebook.com/ducateducation
