Introduction to Hortonworks Data Platform

© Hortonworks Inc. 2012

Introduction to the Hortonworks Data Platform

Ari Zilka, Chief Products Officer June 20, 2012


Who is Ari

Ari Zilka Chief Products Officer •  Bi coastal •  Motorcycles •  Technology


1

•  Simplify deployment to get started quickly and easily

•  Monitor, manage any size cluster with familiar console and tools

•  Only platform to include data integration services to interact with any data source

•  Metadata services opens the platform for integration with existing applications

•  Dependable high availability architecture

Hortonworks Data Platform


Delivers enterprise grade functionality on a proven Apache Hadoop distribution to ease management,

simplify use and ease integration into the enterprise

The only 100% open source data platform for Apache Hadoop


Enabling Hadoop as Enterprise Big Data Platform

DEVELOPER Data Platform Services & Open APIs


Applications, Business Tools, Development Tools, Data Movement & Integration, Data Management Systems, Systems Management, Infrastructure

Usability, Installation & Configuration, Administration, Monitoring, Data Extract & Load,

Metadata, Indexing, Search, Security, Management, HA, DR, Replication, Multi-

tenancy, ...


Management & Monitoring Svcs

Hortonworks Management Center – View the health of cluster operations,

server utilization and performance levels – Customizable dashboards – APIs for integration into 3rd party

monitoring tools – 100% open source management &

monitoring, powered by Apache Ambari, Puppet, Nagios and Gaglia – Simple wizard-based installation,

configuration & provisioning of any size Hadoop cluster

Optimize performance for your Hadoop cluster

Simplify Installation and provisioning


Simple wizard-based installation, configuration & provisioning of any size Hadoop cluster

Simple Installation

•  Step-by-step install across multiple nodes

•  Automated compatibility and dependency checks

•  Analyzes/recommends optimal services configuration

•  Automatically configures mount points in the cluster


HMC Architecture


Demonstration

•  Hortonworks Management Center •  HCatalog & Data Integration Services •  High Availability



HCatalog

Table access Aligned metadata REST API

•  Raw Hadoop data •  Inconsistent, unknown •  Tool specific access

Apache HCatalog provides flexible metadata services across tools and external access

Metadata Services

•  Consistency of metadata and data models across tools (MapReduce, Pig, HBase and Hive)

•  Accessibility: share data as tables in and out of HDFS •  Availability: enables flexible, thin-client access via REST API

Shared table and schema management opens the platform


Data Integration Services

•  Intuitive graphical data integration tools for HDFS, Hive, HBase, HCatalog and Pig

•  Oozie scheduling allows you to manage and stage jobs

•  Connectors for any database, business application or system

•  Integrated HCatalog storage

Bridge the gap between legacy data & Hadoop

Simplify and speed development


Hadoop Cluster

Existing Infrastructure

Metadata Services

metastore

Pig

HBase

Hive applications

data stores

visualization

REST •  ddl •  dml

DML

DML

DML

HCatalog

create describe


Demonstration




HA Cluster

Full Stack High Availability

•  Failover and restart for •  NameNode •  JobTracker •  Other services to come…

•  Open API allows use of Proven HA from multiple vendors

•  Minimized changes to clients and configuration

•  Server & Operating System failure detection and VM restart

•  Smart resource management ensures sufficient resources are available to restart VMs

HA

HA

Built on Stable proven Apache Hadoop release Complementary to Hadoop 2.0 HA efforts


Demonstration




What next?

•  Expert role based training •  Course for admins, developers

and operators •  Certification program •  Custom onsite options

Download Hortonworks Data Platform hortonworks.com/download

1

2 Use the getting started guide hortonworks.com/get-started

3 Learn more… get support

•  Full lifecycle technical support

across four service levels •  Delivered by Apache Hadoop

Experts/Committers •  Forward-compatible

Hortonworks Support

hortonworks.com/training hortonworks.com/support


Hortonworks Support Subscriptions

Objective: help organizations to successfully develop and deploy solutions based upon Apache Hadoop

• Full-lifecycle technical support available – Developer support for design, development and POCs – Production support for staging and production environments

– Up to 24x7 with 1-hour response times

• Delivered by the Apache Hadoop experts – Backed by development team that has released every major

version of Apache Hadoop since 0.1

• Forward-compatibility – Hortonworks’ leadership role helps ensure bug fixes and patches

can be included in future versions of Hadoop projects


Hortonworks Training

Objective: help organizations overcome Hadoop knowledge gaps

• Expert role-based training for developers, administrators & data analysts – Heavy emphasis on hands-on labs – Extensive schedule of public training courses available

(hortonworks.com/training)

• Comprehensive certification programs

• Customized, on-site courses available


Questions & Answers

TRY download at hortonworks.com

LEARN Hortonworks University

FOLLOW twitter: @hortonworks Facebook: facebook.com/hortonworks

MORE EVENTS hortonworks.com/events

Further questions & comments: [email protected]

Introduction to Hortonworks Data Platform

Technology

Transcript of Introduction to Hortonworks Data Platform