Oracle Big Data technológiák - Ad...
-
Upload
phungtuong -
Category
Documents
-
view
219 -
download
3
Transcript of Oracle Big Data technológiák - Ad...
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data technológiák a felhőben is
Fekete Zoltán Principal sales consultant 2016. április 6.
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Brings Business Value to Big Data
Enterprise-Grade Capabilities
Discover and Predict – Fast
Govern and Secure All Data
Simplify Access to All Data
Performance Integration Availability Scalability Manageability
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
The Big Picture – Oracle Big Data Management System SO
UR
CES
DATA RESERVOIR DATA WAREHOUSE
Oracle Database
Oracle Industry Models
Oracle Advanced Analytics
Oracle Spatial & Graph
Big Data Appliance
Apache Flume
Oracle GoldenGate
Oracle Event Processing
Cloudera Hadoop
Oracle Big Data SQL
Oracle NoSQL
Oracle R Distribution, ORAA4H
Oracle Big Data Spatial and Graph
Oracle Database
In-Memory, Multitenant
Oracle Industry Models
Oracle Advanced Analytics
Oracle Spatial & Graph
Exadata
Oracle GoldenGate
Oracle Event Processing
Oracle Data Integrator
Oracle Big Data Connectors
Oracle Data Integrator
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 6
Integrating Data Reservoir and Data Warehouse
DATA RESERVOIR DATA WAREHOUSE
Oracle Loader for Hadoop
B Copy to BDA
Query in-place with Big Data
SQL
New: Oracle Table Access for
Hadoop
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Appliance: Standard és moduláris
7
Starter Rack: 6 node, össz.: 18 node
Elastic: node-onként bővíthető
Akár 18 rackig egyszerűen
összekábelezhető
Lekörözi a DIY clustereket:
Bekerülési költség kisebb
Gyorsabb bevezetés
Nagyobb teljesítmény
Skálázhatóbb
Exadata kapcsolat
Enterprise Manager framework
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Big Data Appliance X6-2 ÚJ!!!
Sun Oracle X5-2L Servers with per server: • 2 * 22 Core (2.2GHz) Intel Xeon E5-2699 v4 Processors
• 256 GB DDR4-2400 Memory, upgrade to 768 GB
• 96 TB Disk space (12 x 8 TB)
Included Software (4.4): • Oracle Linux 6.7
• Oracle Big Data SQL 3.0*
• Cloudera Distribution of Apache Hadoop 5.5.x – EDH Edition
• Cloudera Manager 5.5.x
• Oracle R Distribution
• Oracle NoSQL Database CE
8
* Oracle Big Data SQL is separately licensed
HC
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Appliance kiforrott, bizonyított, költséghatékony megoldás
“Oracle Big Data Appliance is an excellent choice for customers looking to work with the full suite of Cloudera’s leading Hadoop-based technology. It’s more cost-effective and quicker to deploy than a DIY cluster.”
⁻ Mike Olson, Cloudera founder, Chief Strategy Officer, and Chairman of the Board
9
Source: ESG White Paper
21% Cost Savings
33% Faster Time
to Value
Lower Costs
Faster to Implement
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Big Data Appliance – Core Design Principles
10
Operational Simplicity
• Consistently High Performance • Remove Bottlenecks
• Full Stack Install and Upgrades • Simplified Operations / Management
• Cluster Growth • Node Migration
• Always Highly Available • Always Secure • Latest Hardware Technologies for Hadoop and Spark
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Successful Big Data Systems Grow From Cluster Install with HA to Large Clusters to Dealing with Operational Issues
11
Day 1
• 12 node BDA for Production • Hadoop HA and Security Set-up • Ready to Load Data
RCK_1
Full install with a single command: ./mammoth –i rck_1
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Successful Big Data Systems Grow From Cluster Install with HA to Large Clusters to Dealing with Operational Issues
12
N N Example Service:
Hadoop Name Nodes
Day 1
RCK_1
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Introducing Oracle Big Data SQL 3.0
13
Massively Parallel SQL Query across Oracle, Hadoop and NoSQL
Oracle Database 12c
Offload Query to Exadata Storage Servers
Small data subset quickly returned
Hadoop & NoSQL
Offload Query to Data Nodes
SQL
data subset
SQL
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Apply Advanced Security on Hadoop & NoSQL
14
Same security policies apply to Hadoop & Relational
Oracle Database 12c
Small data subset quickly returned
Hadoop
Redacted data
subset
SQL
JSON data unconverted
in Hadoop
JSON
Customer data in Oracle
DBMS_REDACT.ADD_POLICY( object_schema => 'txadp_hive_01',
object_name => 'customer_address_ext',
column_name => 'ca_street_name',
policy_name => 'customer_address_redaction',
function_type => DBMS_REDACT.RANDOM,
expression => 'SYS_CONTEXT(''SYS_SESSION_ROLES'',
''REDACTION_TESTER'')=''TRUE'''
);
• Redaction
• Virtual Private Database
• Fine-grain Access Control
Oracle Big Data Appliance
2X Faster than
Do-It-Yourself1
Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause
the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products. For more complete information visit http://www.intel.com/performance. Tests document performance of
components on a particular test, in specific systems. Differences in hardware, software, or configuration will affect actual performance. Consult other sources of information to evaluate performance as you consider your purchase. For more complete information about performance and benchmark results, visit
http://www.intel.com/performance. 1 - Configurations were compared by using the Big Data Benchmark for BigBench.Oracle* Big Data Appliance configuration included 6 nodes comprised of: Intel® Xeon® CPU E5-2699 v3 (HT enabled) with 128 GB DDR4, 12 X 4TB HDD, Infiniband network (1 connection) observed max
throughput 24 Gb/sec, Oracle* Linux Enterprise 6, and CDH* 5.4.4 with modified configuration. DIY cluster configuration included 6 nodes comprised of: Intel® Xeon® CPU E5-2699 v3 (HT enabled) with 128 GB DDR4, 1 x 64GB SSD for OS, 12 X 4TB HDD, 10Gb network (1 connection), CentOS* 6.6, CDH* 5.3.3 with
minimal changes.
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Momentum: Customers around the World
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Cloud Service
• Starter Pack – 6 nodes, additional nodes
• 6 nodes with: 32 OCPU, 256 GB RAM, 48 TB storage per node.
• Big Data Connectors, Big Data Spatial and Graph,
• Oracle Data Integrator EE, ODI EE Advanced Big Data Option
• Dedicated instances in the Oracle Cloud, featuring 40 Gb/sec InfiniBand fabric inside Big Data Cloud Service and Database Cloud Service -- Exadata Edition.
• Simplified operations, and automated lifecycle management though a single command utility of the entire stack
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 21
NoETL Engine 100% Native Data
Transformation Data
Integrator Big Data
Preparation
GoldenGate
Data Quality
Data Service Integrator
Metadata Management
Non-invasive CDC, Realtime streaming
data delivery
Profile, Cleanse, Match, and
Remediate Data
Prepare, Secure, Enrich and Publish Unstructured Data
Catalog, Trace and View Models across
the Enterprise
Federate Data Across DBs, Services
and Applications
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 22
Big Data Preparation Cloud Service
Data Preparation Designed for data domain experts,
not programmers Focused on cleansing, enriching and
transforming unstructured business data
Operationalize data flows into ETL or BI
Key Benefits Easy to get started with browser
based application Better recommendations engine.
Machine learning with semantic technologies
Integrated into Oracle Cloud
Oracle’s Solution: Big Data Preparation Cloud Service (BDP) Prepare Data for Operational Workloads
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 23
Oracle Big Data Preparation Core Capabilities Publish
• On Demand or
Scheduled • Source / Target
Definition • Restful APIs • Event Driven
Govern and Monitor
• Dashboards • Automated Alerts
• Reusable user policies • System Controls
• Security • Stats & Metrics
Ingest
• Import & Ingest • Detect Schema • Cleanse, Normalize
& De-duplicate • Detect & Mask
Sensitive Data
Enrich
• Profile • Annotate • Data Classification • Semantic
Enrichments • Extractions
• Unified solution to prepare unstructured data
• Simple to use tooling designed for non-programmers
• Unique technology approach combines Machine Learning (ML) with Natural Language Processing (NLP) engine
• Powered by Apache Spark, Hadoop, and UIMA
• Cloud operated from the Oracle Public Cloud
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
Oracle Big Data Spatial and Graph
Property Graph for Analysis of:
• Social Media relationships
• Internet of Things interactions
• Cyber-Security
Spatial Analysis Features for:
• Location Data Enrichment
• Proximity and containment analysis
• Preparation of digital map and imagery data sets
24
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. | 25
CyberSecurity Modeling / Internet of Things
• Property graph model
• Dynamic construction of IP network
• The graph includes metadata as well as events/enriched data
• Extensible by other data source (add properties, relations)
• Search – Text search on graph DB proprieties
Copyright © 2016 Oracle and/or its affiliates. All rights reserved. |
További információ: Linkek, anyagok, videók, virtuális gép
• https://cloud.oracle.com/bigdata
• https://cloud.oracle.com/bigdatapreparation
• https://cloud.oracle.com/bigdatadiscovery
• https://cloud.oracle.com/nosqldatabase
• Oracle Big Data: https://www.oracle.com/bigdata/, Oracle Big Data Light VM letöltés
• Data Warehousing, Engineered Systems, Business Analytics
• Information Management and Big Data A Reference Architecture
Videók:
• Oracle Big Data csatorna, Oracle Big Data Discovery csatorna
• Oracle Data Integrator Getting Started Series, Oracle GoldenGate
• Oracle Advanced Analytics, Using SQL Pattern Matching with Big Data Lite VM