Setup - Hadoop Cluster Setup

download Setup - Hadoop Cluster Setup

of 15

Transcript of Setup - Hadoop Cluster Setup

  • 7/24/2019 Setup - Hadoop Cluster Setup

    1/15

    Master- Slave architecture

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    2/15

    Hadoop (2.6.0)

    /etc/hosts

    /etc/hosts

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    3/15

    /etc/sudoers/

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    4/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    5/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    6/15

    /usr/local/hadoop

    JAVA_HOME

    $HADOOP_HOME/etc/hadoop/hadoop-env.sh

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    7/15

    /usr/local/hadoop_tmp/hdfs

    /usr/local/hadoop_tmp/hdfs/namenode

    /usr/local/hadoop_tmp/

    /usr/local/hadoop_tmp/hdfs/namenode

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    8/15

    $HOME/.ssh/id_rsa.pub

    $HOME/.ssh/authorized_keys

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    9/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    5 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    10/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    15 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    11/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    15 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    12/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    15 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    13/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    15 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    14/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus

    15 1/8/2016

  • 7/24/2019 Setup - Hadoop Cluster Setup

    15/15

    to install Apache Hadoop 2.6.0 in Ubuntu (Multinode/Cluster setup) http://pingax.com/install-apache-hadoop-ubuntu-clus