Oracle BI Applications and OBIEE – New Developments
Shyam Nath, IBM / BIWA SIG
Robert Davis, Oracle
May 2011
Agenda
• Reporting and Analytics Overview -Operational to Analytical
• OBIEE (10g, 11g, 11.1.1.5)
• Oracle Business Intelligence Applications
• Value proposition of Packaged BI Applications
• Sneak peak to BI Apps 7.9.6.3
• Migration considerations to 7.9.6.3
About Shyam
• OBIEE Architect with IBM GBS (Oracle Practice)
• OCP since 1998 on 4 different DB versions
• President/Founder of BIWA SIG – an IOUG SIG for BI, DW and Advanced Analytics professionals
• Regular speaker at Oracle OpenWorld (since ’03), Collaborate (since ’05), ODTUG-KScope (since ’08), BIWA Summit and RUG’s (NY/RM/SF/NO etc.)
• Bachelor’s from IIT-India, MBA and MS from Florida Atlantic University, Boca Raton, FL
About Robert
• Oracle, Director - BI Applications with a focus on Partnerships & Alliances
• First exposure to BI was with Teradata in the early 90’s
• Supporting the BI Applications for over 8 years at Siebel and now Oracle
OBIA – OTN Forum
Regular Contributor to OTN BI Apps Forumhttp://forums.oracle.com/
OBI 11.1.1.5 / 7.9.6.3 Released!
OBIEE 10g OBIEE 11.1.1.3
OBIEE 11.1.1.5
OBIEE 10g
OBIA 7.9.6.2OBIA 7.9.6.3
How I felt about it!
Supported! Certified!
7
BI Application – New Looks and Feel with 11.1.1.5!
Chart zooming
Oracle BI 11.1.1.5 ReleasedOBIEE 11g Changes and New Features
• Focuses on OBIEE 11.1.1.5.0 – BI Platform• Presented May 25, 2011, noon ET (next Wed)• Major topics:
– First patch release for OBIEE 11g– Support for Oracle BI Applications release 7.9.6.3– Full support for the Apple iPad– Full support for OLAP sources including Essbase and Oracle OLAP– New support for Oracle TimesTen, MS SQL Server Analytic Services, and
SAP BW– Reduced memory requirements for Weblogic and streamlined install– 64-bit BI Admin Tool– New visualizations in the BI Admin tool– New BI Metadata Web Service
• Includes live demo of many new features• Presented by Dan Vlamis, Vlamis Software Solutions• Oracle PMs will be available for questions
Operational v/s Analytical System
Traditional Circular Join OBIEE Star (Logical/Physical)
BI Apps –Other Extreme
Why Star Schema’s?
• ComputerWorld on Business Intelligence
BI Analysts salary range $82–$116K Data Modelers $81 – $111K, ComputerWorld Mar 2011
OBIEE v/s Packaged BI Application
CRM ANALYTICS
ERP ANALYTICS
ORACLE BI ENTERPRISE EDITION (OBIEE)
AND OTHER OPERATIONAL AND ANALYTIC SOURCES
Sales
MarketingService and Contact Center
PriceLoyalty
FinancialsProcurement and Spend
Supply Chain and Order
Management
ProjectsHuman
Resources
Case Studies - I
Family owned, 50 yrs old, $1b+ manufacturing company in Atlanta, GA•Several manufacturing plants using systems like JD Edwards, Demantra, EPM/Planning and Legacy/Main frame systems•ODS/Crystal Reports footprint•First formal DW initiative•OBIEE, ODI and BIP as tech stack•Need for Manufacturing, Plant Shop floor analytics, job profitability and Sales Analytics in first go•EPM-Workspace Integration•Highly formatted and complex BI Publisher reports•Better insights to profitability and cost to service a customer
Energy Services Company publicly traded, ~$2b in Houston, TX•New EBS R12 implementation in 4 divisions, HFM, Planning, one div replacing SAP•First formal DW initiative•OBIEE and BI Applications purchased•Need for HR, SCM/Procurement, Finance Analytics•Go-live in Phases such as HR, Fin and SCM•Other Energy industry specific applications in use•Some SQL Server/Crystal Reports•Better view of business across the enterprise
Why OBIEE v/s BI Apps?
OBIEE•Need to integrate JD Edwards data with legacy mainframe data as manufacturing plants are in transition•In 2009 time frame BI apps for JDE Edwards have no coverage for manufacturing, shop floor production data and job profitability•Cost allocation engine needed for job costing and profitability•OBIEE, ODI and BIP as tech stack, shop trying to stay as Oracle tech/apps shop•Security with EPM-Workspace needed as Essbase/Planning in use since V7•Resulted in 4 subject areas
BI Apps•New ERP implementation provides opportunities packaged analytics for rapid deployment as the starter DW•One manufacturing division replacing SAP, so challenges in replacing existing SAP - Easy Access functionality•EBS Versions sliding from R12.1.1 to R12.1.3•No coverage for Oracle Process Manufacturing, HR Advanced Benefits etc in BI Apps today•HFM being used for consolidation and Eliminations•Resulted in HR, SCM/PS and Fin analytics as starters
JD Edwards Tables
• The JD Edwards table names are quite cryptic
• This shows that that for building custom OBIEE solutions, deep ERP knowledge is required
• Need for data modeler, ETL/OBIEE architect and developers
Oracle EBS Object NamesObject Name Function of the object E.g.
_ALL Underlying table with all the values PO_DISTRIBUTIONS_ALL
_B Base of underlying table, same as _ALL RA_TERMS_B
_TL Language translation table with translation of
descriptive fields in different languages
_VL View based on translation table OKE_K_Deliverables_VL
_BASIC_V View on top of the Basic table
_DFV Descriptive Flex Field related view, it will
have the defined values as Column names
instead of generic attribute 1, ..2
_KFV Key Flex Field views contain the
concatenated fields as it would be
displayed to the user. For e.g. A field may
consist of Division, Department and
Account fields and the KFV will have the
concatenated values.
EBS Naming Conventions
• All objects accessed by EBS application have synonym in APPS schema, e.g.OKE.OKE_K_LINES has synonym APPS.OKE_K_LINES
• EBS Forms fetch data from a “user friendly” view with name ending is _V or _VL (e.g. OKE_K_Deliverables_VL).
• Views have descriptive value as opposed to the numeric id’s fields stored in the base table making it “human-readable” for reports.
• Views also implement security and restrictions to the data in various forms such as restrict values by language, org_id etc
• These variables are set by EBS (session context) when the user accesses data via the EBS application.
Some EBS Schema Names
AP - Oracle Payables
AR - Oracle Receivables
GL - Oracle General Ledger
INV - Oracle Inventory
MRP - Oracle Master Scheduling/MRP
PA - Oracle Projects
PAY - Oracle Payroll
PER - Oracle Human Resources
PJM - Oracle Project Manufacturing
WIP - Oracle Work in Process
WMS - Oracle Warehouse Management System
WSH - Oracle Shipping
WSM - Shop Floor Management
Install Process – BI Apps Route
• End user machines requires no software, browser based assess
• Windows boxes required for client software and for transferring some server software (A and B)
• Co-location of InformaticaPowerCenter Services and DAC Server – C
• Clients can be installed on multiple Windows boxes
High Level Data Flow
• Source – eBS (Raw Data)
• ETL – Extraction Transform and Load (Informatica – PowerCenter or ODI)
• OBAW - Business Analytics Warehouse
• OBIEE Metadata
• OBIEE Content – Reports and Dashboards
OBIEE – From Surface to Plumbing
Supporting Infrastructure – Informatica and DAC
Case Studies - II
Offshore Petroleum Services Company
•PeopleSoft and BI Apps
•2011 Q1 go-live with 7.9.6.2 and OBIEE 11.1.1.3, Platform update•Challenges resolved manually•For BI Apps 7.9.6.3 intake OBIEE needs to be upgraded too•Users are able to utilize enhanced visualization features of OBIEE 11g
Financial Services Company for Retirement Planning
•PeopleSoft, BI Apps and Financial Services Vertical App (OFSAA)
•HR Analytics is live •Fin Analytics to go-live on 7.9.6.2•Fin Srvc vertical BI apps uses OBIEE 10g and Essbase•Complex hierarchies DRM/Essbase•First step towards unified end user experience using OBIEE 10g
24
• OBIEE 11g uses Fusion Middleware (FMW) components extensively, including the WebLogic Server (WLS) and Oracle Process Management Network (OPMN)
• WLS improves scalability and provides unified security framework
• Enterprise Manager provides a single platform to manage all applications from a single place.
• Only WLS supported so far (no support for WebSphere etc)
OBIEE 10g vs. OBIEE 11g architecture
10g architecture 11g architecture
25
Installing BI Apps – Change from 7.9.6.2 to 7.9.6.3
• 7.9.6.2 looked for 10g(Trick the system!)
• 7.9.6.3 looks for 11g folder structure
• WLS Server Details
Lessons Learnt 7.9.6.2 with OBIEE 11.1.1.3
• Categories:– RPD and Presentation
– LDAP and Security
– Custom branding of OBIEE
27
Upgrade Decision process prior to 7.9.6.3 / 11.1.1.5 release
The OBIEE 11g Upgrade Decision Process
Use OBIEE 10g
Value rank
Consideration
Preferred platform Category
10g 11g
1 Use of action framework Architecture
2 Certification of Oracle BI applications
Certification
3 OS/Web server compatibility Certification
4 Data warehouse database certification
Certification
5 Integration with Hyperion/Essbase
Architecture
6 Tighter integration with BI publisher
Architecture
7 Consolidated maintenance Architecture
8 Scalability Architecture
9 Proven and time tested Other
10 Web browser compatibility Certification
11 Enhanced UI features Usability
12 Availability of resource pool Other
• New Custom OBIEE Implementation
• Existing custom OBIEE 10g implementations
• Upgrade custom implementations of OBIEE using Web Logic on Linux, Windows OS
• New implementation of OBIEE utilizing Oracle BI Applications – up to 7.9.6.2
• Existing OBIEE Implementations using one or more Oracle BI Applications
Upgrade Decision matrix Sliding Scale
Use OBIEE 11g New
Exis
ting
28
Oracle BI Application 7.9.6.3 – Relevant Files
OBIEE
Platform
DAC /
Informatica
29
BI Apps 7.9.6.3 - Upgrade Flow (11.1.1.5)
30
Informatica 9.0.1 HF2 is the Data Integration / ETL Platform
Informatica 8.6.x going out of support by year end
Do not install Informatica in a directory with space in the name, for e.g. do not install in D:\Program Files\INFA
OBIEE / BI Apps with “Appliance”Like DBMS System
• A very large Retailer – BI Apps on Exadata V2
• BI Apps on Teradata and Netezza??
Terdata (including V13.10 ) is supported for both OBIEE / OBIA
• Netezza is supported for OBIEE via ODBC, native connectivity expected in 11.1.1.6, no support for OBIA)
Teradata BI Apps Best Practices
• For maximizing performance in Teradata deployments, follow these:
• Collect Statistics as a Prerequisite else ETL performance impact and possibly spool space error (error # 2646)
• LEFT OUTER JOIN Issue – some queries and source qualifiers may have to be re-written
• Group By is more efficient than Distinct – when low number of distinct values
• Pruning of Mappings and Tables – improve performance by stripping extraneous fields from mappings & tables
• Loader Configurations – Tpump, Moad, FastLoad etc.
• More tips in Document e19038.pdf – sec 3.5.2
BI Apps with Exadata
• The Full Table Scan is no longer your enemy on Exadataside! FTS is very quick in Exadata but not in the regular 11g databases – source DB’s can choke!
• In certain situations the performance bottleneck at the source system database as it was not able to feed the Exadata box at it's import capacity – consider flat file extracts from sources and using DBFS
• The performance configurations like indexes might not be required in the Exadata boxes in certain situations
• Drop the distinct key indexes and change stats method in customsql.xml
BI Apps on Exadata
• On larger tables like - AP_AE_LINES_ALL, avoid PARALLEL query option, the difference in time observed was from 4 hours to 2 minutes.
• Disable or drop all indexes with distinct_keys = 1 (b-tree and bitmaps) reason being such indexes are ineffective, with one unique value. So it's highly unlikely that Optimizer would ever consider them in building any execution plans, e.g. W_AR_XACT_F_F63,
W_GL_REVN_F_F35, W_GL_REVN_F_F24
• Avoid query transformation into a union-all query and scanning all the big tables twice. Here we will need to find a workaround to avoid the union-all to scan the tables once or find a way to reduce full scanning of the tables (partitioning/index etc). e.g table W_GL_ACCOUNT_D 8 mil rows getting scanned without any valid filtering
• Partitioned tables must have stats at both table and partition level
Recap
• Looked at OBIEE v/s BI Apps
• Recent Development and Impacts
• Case Studies – your mileage may vary!
• Next part – Sneak Peak to 7.9.6.3
Robert Davis
Oracle BI Apps 7.9.6.3 &
Sneak Peak
Some Recent Development
• OBIEE 11.1.1.5 released for download on May 6, 2011
• OBI Apps 7.9.6.3 released same time!
• BI platform and BI apps are in-sync
• Last release 7.9.6.2 (09/2010) came after OBIEE 11.1.1.3 (08/2011) but was “supported” not “certified”
• Focus on exploiting 11g features and Mobile computing
…recent
• BI Apps 7.9.6.3 requires– New BI platform
11.1.1.5– New Informatica
platform 9.0.1– New DAC (not 11g yet)
but hot fixed version 10.1.3.4.1
– Teradata 13.10 support
• Provides iPad/iPhonesupport out of box
Campaign PerformanceDashboard on iPad
BI Apps on iPhone
General Direction – 7.9.6.3
• In 7.9.6.3 focus was on making the rpd, webcat and security model 11g ready.
• Oracle switched to role based security from group based• Some fixes in the rpd to satisfy the stricter consistency
checking in 11g • Leveraged some new Presentation capabilities in the
reports and dashboards (such as presentation hierarchies).
• OBIEE 11g now allows BI apps to unlock a breadth of new capabilities such as mobile/iPad, better systems management, scorecards, etc.
• Primarily a certification release
Security Changes – 7.9.6.3
• New Security Model User>Group>Role
• RPD files now have RPD-specific passwords - used to encrypt the contents.
• Groups no longer exist in the RPD as objects. Data access security is implemented based on application roles to which a user belongs.
• Application roles are managed in an external policy store, exist in the RPD, as pointers (references) to the externally managed roles.
• Users managed in an external authentication provider, no longer in RPD. User objects exist in the RPD, as pointers (references) to the externally managed users.
WebLogic Server• User Administration • Group Administration
Enterprise Manager• Role Administration
Oracle BI Applications Release Roadmap
7.9.77.9.7
OD
IIN
FA 7.9.6.27.9.6.2
11g11g
11g PS111g PS111g PS211g PS2
SAP
Apps
Unlimited
Fusion Apps
Convergence Release
•Dual ETL Support
•Applications Unlimited
•Fusion Apps
•SAP
•Select Edge / Industry7.9.6.37.9.6.3
Certification with OBIEE 11g
7.9.6.17.9.6.17.9.67.9.6
7.9.5.27.9.5.2
Available
Planned
7.9.7.17.9.7.1
Future Directions - BI Apps
• Users often want one
place / tool for Operational and Analytical reporting
•Degree of details in warehouse•Right time data –need for intra-day ETL•Highly Formatted reports
•Security model across BI and Source Systems.
Oracle BI Applications 7.9.6.311g Features
• Master Detail Linking
• Chart Sliders & Zooming
• Hierarchical Columns
• View prompts
• Cascading Prompts
Procurement and Spend Analytics
Chart zooming
Supply Chain and Order Management Analytics
Graph SlidersPlayback option
Supply Chain and Order Management Analytics
Graph Sliders
Master Detail Linking
Supply Chain and Order Management Analytics
Select 2009 Q4
Detail graph shows Trend by Month for the
selected quarter
Supply Chain and Order Management Analytics
Project AnalyticsIn-place Drill using
presentation hierarchies
In-place Drill using presentation hierarchies
Fiscal Quarter shows only 2008
values
Cascading Prompts Select Fiscal Year = 2008
Financial Analytics
Graph Sliders
Playback option
Enhanced Visualizations
Financial Analytics
Human Resources Analytics
Oracle Mobile for BI Apps
• Native mobile apps with full Dashboard functionality and all BI content types– Dashboard Drill/Navigate– Catalog navigation– Favorites– Alerts– Search– Actions
• Dashboards dynamically adjust to exploit the form-factor of the device
• Device support– iOS iPhone and iPad in 11.1.1.5– Android next– Blackberry awaited??
Oracle BI Applications on Apple ipadExample: Marketing Analytics
BI Apps Customers to 11g
Two approaches:• Upgrade to BI Applications
7.9.6.3– Certifies 11.1.1.5, out of the box support
for 11g capabilities– Recommended choice for net new
implementations and existing BI Apps customers needing 11.1.1.5 capabilities alike
• Platform-only upgrade for existing BI Apps deployments– Fully supported with OBIEE 11.1.1.5 but
not without challenges– Good option for heavily customized
deployments with strong need for 11.1.1.5 features
– Case Study of 7.9.6.2 customer
� Recap OBIEE
� Recap BI Applications
� New 7.9.6.3
� Questions
� Follow up discussions at:
http://oraclebiwasig.blogspot.com/
Summary / Questions
Thanks to IOUG, Florian Shouten, Rich Solari, Abhinav Banerjee
Top Related