NFLabs Profile

26
Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved. NF LABS S IMPLIFYING B IG D ATA November 2012

description

 

Transcript of NFLabs Profile

Page 1: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

NFLABS S I M P L I F Y I N G B I G D A T A !

November 2012!

Page 2: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

•  Executive Summary & Market Opportunity!

•  Product Overview !

•  Business Strategy!

•  Achievements !

•  Team!

•  Case Studies!

•  Appendix!

AGENDA!

Page 3: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

“It is a tagline to describe tools, technology, and procedures to manage and process large, complex data sets within a short period of time.”

Executive Summary & Market Opportunity!

EXECUTIVE SUMMARY: What is Big Data?

Page 4: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

3V’s of Big Data

KB! MB!GB!

TB!PB!

REAL-TIME!

NEAR REAL-TIME!

PERIODIC!

BATCH!

DATABASE!

TABLE!

CMS!

AUDIO!WEB! PHOTO!

VIDEOS!

SOCIAL!LOGS!

MOBILE!

REPORTS!

VARIETY!

VELOCITY!VOLUME!

Executive Summary & Market Opportunity!

Page 5: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Why is Big Data important?

“Everyday, we create 2.5 quintillion bytes of data—so much that 90% of the data in the world today has been created in the last two years alone.” IBM

Executive Summary & Market Opportunity!

Page 6: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Page 7: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

So what?

“It is an opportunity to find insights in new and emerging types of data and content, to make your business more agile, and to answer questions that were previously considered beyond your reach. UNTIL NOW, THERE WAS NO PRACTICAL WAY TO HARVEST THIS OPPORTUNITY.” IBM

Executive Summary & Market Opportunity!

Page 8: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Ok. So what are some big data technologies/tools?

Most big data tools are open source, but…

Executive Summary & Market Opportunity!

Page 9: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Big Data commercial landscape is large and complex

Page 10: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Because big data market is HUGE

Source:  Wikibon  2012  Korea  market  size  in  red  calculated  per  percentage  of  US  GDP.  

$5.46  Billion  Total  Addressable  Market  Opportunity  with  58%  CAGR.    ($360  Million  just  for  Korea)    

$5.1  $10.2  

$16.8  

$32.1  

$48.0  $53.4  

$0.4  

$0.7  

$1.2  

$2.3  

$3.4  

$3.7  

$0.0  

$10.0  

$20.0  

$30.0  

$40.0  

$50.0  

$60.0  

2012   2013   2014   2015   2016   2017  

US  

Korea  Big  Data  Market  Forecast  (US$  Billions)  

Executive Summary & Market Opportunity!

Page 11: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

So where do I start?

•  We are a company formed by technologists, entrepreneurs, and developers focused on simplifying big data. We believe:!

•  Big data will change the world—both at the enterprise and consumer level!•  Big data is too complex—the only way to accelerate adoption is to make it simple!•  Open source is AWESOME—some of the best code is open source, and power of

community is far stronger than power of enterprise!

•  We aim to deliver two simple things:!•  Flexibility of platform—We love Hadoop but we believe you shouldn’t be limited to the

Hadoop ecosystem. Different enterprises will have different platform needs.!

•  Simplicity of data insight—We don’t believe you need a PhD or be able to see the matrix to gain insight into data. We believe data is like Lego—Exploration + Creativity = Beautiful Creation (and Value).!

NFLABS

Executive Summary & Market Opportunity!

Page 12: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

Company Overview

•  NAME: NFLabs Inc.!

•  ESTABLISHMENT: September 8, 2011!

•  CEO: Sejun Ra!

•  OPERATIONS: Seoul, KR and San Jose, CA* (EST January

2013)!

Executive Summary & Market Opportunity!

Page 13: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

PELOTON

Product Overview!

PRODUCT OVERVIEW

(P)  PLATFORM    •  Custom  build  

your  own  big  data  plaPorm  in  minutes  

(D)  DATA    •  Explore  and  

analyze  all  data  your  data  in  real  Sme.  

(P) DEPLOY!(D) CONSUME!

(P) MONITOR!(D) EXPLORE!

(P) MANAGE!(D) ANALYZE!

Page 14: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

ARCHITECTURE

DATA SOURCE!

Agent-­‐less  

Agent-­‐based  

CONNECTOR!

OPEN  APIs  (REST,  Connectors)    

Web  Client  (Peloton  Manager)  

RDBMS!

CRM! ERP!

Machine Logs!

HDFS! HIVE DW!

DATA STORE!

DATA INSIGHT!Search! Explore! Analyze!

AnalyScs  IDE  (e.g.  R-­‐Studio)  PELO

TON

ENG

INE!

•  real-time index!•  template-based!

•  across data type!•  across data store!

•  real-time!•  no ETL!

Product Overview!

Page 15: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

DEPLOY!Ease of deployment! Click and Save. No coding or terminal necessary.!Deploy only what you need! An ever expanding package depository to deploy only needed

components—from Hadoop and sub-components to our custom built R-Spark for real-time R based analysis.!

Auto-deploy! Create triggers to auto deploy additional components!

MAIN FEATURES: DEPLOY

Product Overview!

Page 16: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

MANAGE & MONITOR!Monitor! View the state of all your deployments and their components!Manage! Remotely add, delete, or change configurations of all your

deployments!Alerts! Set alerts to inform you of errors via email or SMS!Dashboard! Setup command center dashboards using flexible widgets to

monitor and view all your services in one window.!

MAIN FEATURES: MANAGE & MONITOR

Product Overview!

Page 17: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

EXPLORE & ANALYZE!Template based analysis! Use our built in log mappers to analyze all your machine logs!Real-time search! Search or view your data in real-time as it streams to our

platform!Query and compare! Perform advanced SQL query calls directly to data in HDFS. No

need to ETL to an RDBMS.!

MAIN FEATURES: EXPLORE & ANALYZE

Product Overview!

Page 18: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

VALU

E AD

DED

M

OD

ULE

S!Continue to add analytical algorithmic templates and integrate with popular IDEs and clouds.!

PAC

KAG

E D

EPO

SITO

RY! Continue to curate and upgrade the best open

source big data packages available!

ECOSYSTEM!

SHARK!

ANALYTICS!

RETAIL  ANALYTICS  

All within one system, one command center.!

Business Strategy!

STRATEGY: Product

Page 19: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

REGISTRATION  OF  CLOUDVFS  PATENT  

REGISTRATION  OF  SMART  ROUTING  

PATENT  

ACCEPTED  TO  SPARKLABS  INCUBATOR  PROGRAM  

LAUNCH  OF  PELOTON  BETA  

Q1 2012 Q2 2012 Q3 2012 Q1 2013 ���������� ���������� ����

CLOSED  CONSULTING  PROJECT  

CLOSED  GOVERNMENT  

PROJECT  

PARTNERSHIP  SIGNED  WITH  HYOSUNG  INFORMATION  SYSTEM  (HIS)  TO  JOINTLY  

BUILD  BIG  DATA  APPLIANCE  

RENEW  SERVICE  CONTRACT  WITH  SKBB  

BIG  DATA  APPLIANCE  

LAUNCH  WITH  HYOSUNG  

LAUNCH  OF  PELOTON  v1.0  (FULLLY  PACKAGED  

SOFTWARE)  

TECHNOLOGY  PARTNERSHIPS  WITH  HORTONWORKS  AND  

CLOUDERA  

���������� Q4 2012 ����������

Achievements!

SILICON  VALLEY  OFFICE  LAUNCH  

ACHIEVEMENTS

Page 20: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved. Team!

BEST  AND  MOST  EXPERIENCED  HADOOP  DEVELOPERS  IN  KOREA  

EXPERIENCE  IN  VARIOUS  VERTICALS  (CLOUD,  NETWORK,  MOBILE,  OPEN  SOURCE)  

MULTI-­‐DECADE  EXPERIENCE  IN  SALES,  BUSINESS  DEVELOPMENT,  MANAGEMENT  

MULTI-­‐YEAR  GLOBAL  WORKING  EXPERIENCE  (EU,  US,  APAC)  

OVER  20  YEARS  OF  DISTRIBUTED  PLATFORM  EXPERIENCE  

NFLABS

TEAM

Page 21: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

COMPANY OVERVIEW!SK broadband is one of Korea’s largest telecommunication companies. Their services range from IPTV to network hosting services.!!SK broadband customers’ data needs were growing rapidly, so they needed a storage solution that would automatically scale while keeping cost investments low, both in terms of infrastructure as well as management overhead.!!SOLUTION!Peloton provides a multi-tier storage system with near real-time log processing engine. Our Hadoop based Peloton storage cluster is over 1 PB, distributed across SK’s network. The Peloton log processing engine also collects and processes over 1TB of logs every day. To add more capacity, they simply add additional commodity servers. SK currently have only 2 engineers managing the whole system.!!BEFORE NFLABS!They had a choice between a very expensive SAN solution or a monolithic NAS build out that would be a nightmare to manage and require multiple engineers.!

CURRENTLY SERVICING SK BROADBAND’S TOP ENTERPRISE CUSTOMERS!

Case Studies!

CASE STUDIES

Page 22: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

CASE STUDIES

COMPANY OVERVIEW!KT (Korea Telecom) is the largest telecommunications operator in Korea. They provide services ranging from mobile to IPTV, from hosting to cloud services.!!KT is a leader in innovation and are preparing to build a marketplace for their mobile customers. Their marketplace required high performing data processing platform that would scale automatically if needed. All this in less than 6 months at low cost.!!SOLUTION!Peloton’s Hadoop based platform with HIVE, HBASE, MapReduce, and ElasticSearch provides one of the best platforms for large scale high performance data processing. And as Peloton is cloud enabled, it can be set up with triggers to automatically deploy new Peloton instances if necessary.!!AFTER NFLABS!Instead of massively building out a costly relational database, KT was able to leverage commodity servers to handle expected data sets of over 100 TBs per day. And with the help of Peloton, their analytical systems were able to conduct both large scale batch analysis as well as near real time request based assessments.!

TO SERVICE KT’S 20 MILLION+ CUSTOMER BASE!

Case Studies!

Page 23: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

CASE STUDIES

OVERVIEW!In 2011, the Korean government had tasked KT to build the next generation content delivery network (CDN). As part of a consortium led by KT, NFLabs was tasked to build the next generation cloud storage back-end and log processing platform for this CDN.!!SOLUTION!Peloton was chosen among many solutions to be the foundation for this nationally approved cloud storage and log processing engine. Peloton provided the fault-tolerant (auto replication), decentralized (no single point of failure), elastic (scale up/down) solution the consortium was seeking.!!BEFORE NFLABS!The KT Consortium reviewed many solutions based on different DFS systems (Lustre, Glustre), and SAN/NAS alternatives, and separate log processing solutions, but could not find a fully integrated end-to-end solution like Peloton.!

NATIONALLY APPROVED TECHNOLOGY!

Case Studies!

CONSORTIUM!

Page 24: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

APPENDIX!

Page 25: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

CloudVFS  is  a  programmaSc  interface  with  support  for  most  standard  storage  connectors/controllers.  But  the  power  of  CloudVFS  is  its  naSve  programmaSc  architecture  that  allows  events  (load  balancing,  failover,  data  movement,  etc)  to  be  customized  based  on  triggers.  

Programma'c  Interface  

Load  Balancing  

ReplicaSon  

Failover  

Custom  

Support  of  most  storage  and  DB  connectors:  HDFS,  S3,  POSIX,  and  many  more  Configurable:  dynamic  load/unload  

Program  different  events:  Load  Balancing,  ReplicaSon,  Failover  and  Custom  algorithm  plugins  Configurable:  dynamic  load/unload  

Wide  Range  Support  of  connectors  

*Patent  Pending  

CLOUDVFS*: UNIVERSAL CONNECTOR

Page 26: NFLabs Profile

Private and Confidential. Please do not distributed. Copyright(c) 2012 NFLabs, Inc. All rights reserved.

BENEFITS  

COSTS  

EASE  of  U

SE  

Pure  AnalyScs  Sofware  

Cloud  Based  AnalyScs  Service  

Build-­‐your-­‐own  with  stack  

Steep  learning  curve.  UI  clugered  with  excessive  features.  IntegraSon  with  legacy  storage  may  not  work.  

Need  to  buy  separate  storage,  ETL,  data  processors,  and  all  necessary  connectors.  

Powerful  feature  set  to  conduct  complex  analyScs.  

Inconsistent  layout  and  features.  Difficult  to  transfer  data  or  connect  to  data  source.  PotenSal  privacy  issues.  

Low  iniSal  investment.  Cost  per  use  very  high.  May  need  to  pay  storage  separately.  Cost  prohibiSve  to  do  large  data  sets.  

Low  iniSal  investment.  Nothing  on  premise.  

Can  be  customized  to  user  base.    

Very  high  iniSal  investment—HW,  experSse/support,  integrators,  architects,  developers,  etc.  Very  long  Sme  to  market.  

Can  be  built  to  match  company’s  needs.  

Easily  manage,  search,  and  analyze  from  one  single  plaPorm  and  UI.  

One  purchase.  No  need  to  buy  separate  sofware  for  plaPorm  and  analyScs  (or  consultants/experSse).    

Low  TCO.  Integrates  with  legacy.  No  technical  experSse  necessary.  Store  and  analyze  data  immediately.  

Peloton  offers  the  simplest  and  fastest  way  to  start  leveraging  big  data  technologies.    

COMPARATIVE VALUE