SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

26
SAP FORUM İSTANBUL 2014 Basit Düşün Fark Yarat SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA Buğra Tezer / Ömür Evliya SAP Türkiye

description

SAP FORUM İstanbul 2014 SAP Birlikte sunulan Arşivleme ve SAP HANA projeleri ile büyük veri sorun olmaktan çıkıyor. Sybase IQ ile yapılan Near-Line Storage projesinde verinin optimum hale getirilmesi ve ardından gerçekleştirilen BW on HANA Migration projesi ile kazanılan avantajlar sizi yarınlara hazırlayacak.

Transcript of SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

Page 1: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

SAP FORUM İSTANBUL 2014Basit Düşün Fark YaratSYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANABuğra Tezer / Ömür EvliyaSAP Türkiye

Page 2: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 2

Agenda

What is Near-Line Storage (NLS)?� Business Challenges, RDS, Architecture, Deployment Options…

What is NLS Interface in SAP Business Warehouse (BW)?� Definition of NLS wrt BW, multi temperature data…

What is an Implementation for the SAP BW NLS Interface?� Implementation aspects, design-runtime objects, bw settings …

Page 3: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

What is Near-Line Storage (NLS)?

Page 4: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 4

SAP NetWeaver BW Near-Line Storage rapid-deployment solution

Problem: The BW system has very high volumes of data. Maintaining the BW instance becomes difficult. Reporting is not efficient because of data overload.

Solution: Adopt a data aging strategy with SAP NetWeaver BW Near-Line Storage rapid deployment solution.

Underlying SAP NetWeaver BW database

Hot current data

Limited size

Higher resource cost

SAP® Sybase ® IQ software

(near-line storage)

Cold historical data

Massive volumes

Lower resource cost

SAP NetWeaver Business Warehouse application

� Benefits: • Separation of rarely accessed data from frequently accessed data, keeping the BW volume and HANA

in- memory costs in a reasonable range • Data in near-line storage is highly compressed in cost-efficient storage with fewer backups reducing

operational costs• Perfect balance of performance and cost

Page 5: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 5

Adopt a data aging strategy with SAP NetWeaver BW Near-Line Storage

Business challenges� Massive amounts of data in the BW system

combined with high maintenance effort� Long downtimes for BW system maintenance� Difficult transition to a landscape with a well

defined data aging strategy� Reduce TCO of SAP HANA for a BW on HANA

system� Heterogeneous system landscapes including

non-SAP NLS solutions.

There is a solution

The SAP NetWeaver BW Near-Line Storage rapid-deployment solution provides a complete data-archiving solution that enables transparent access to the archived data for reporting, and query capabilities. The near-line storage technology will secure write-protected data, partitioned by age and/or time, therefore resulting in a leaner, low-cost, more easily maintainable online SAP NetWeaver Business Warehouse application.

Page 6: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 6

SAP NetWeaver BW Near-Line Storage solution architecture

• Tight integration with SAP Sybase IQ via DBSL (direct communication)

• Mass insertion into SAP Sybase IQ with IQ loader ( ~ 200 Million rows per hour )

• Partitioning• Expected data compression around 90%• Available since SAP NetWeaver BW 7.30 Sp09

Page 7: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 7

Deployment options of SAP NetWeaver BW Near-Line Storage rapid-deployment solution

Option 1

Option 2

Page 8: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 8

Option 1: Migration to SAP BW powered by SAP HANA

Page 9: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 9

Option 2: SAP BW running on any database

Page 10: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 10

Benefits for youWhat‘s the value

This rapid deployment solution provides the following benefits:• Increase in performance of the SAP Business Warehouse• Reduced total cost of ownership for the SAP HANA platform• Reduced maintenance efforts with lower downtimes

This rapid-deployment solution combines the following added benefits: • Detailed configuration guides based on best practices • Pre-configuration (scripts, business configuration sets) to accelerate the implementation • A full range of enablement and implementation content• Service offerings from SAP and partners to implement the solution in a short timeframe

Page 11: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 11

Features of the SAP BW NLS Implementation for Sybase IQ

§ Optimized NLS data transfer throughout using IQ Loader functionality

§ SAP HANA and IQ share the same columnar paradigm

§ Expected data compression around 90%

§ Ready for large data volumes

§ Suitable for ad-hoc queries with long history

§ Minimum administrative effort

Page 12: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

What is NLS Interface in SAP Business Warehouse (BW)?

Page 13: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 13

Definition of Near-line Storage (NLS) with regards to SAP BW

Page 14: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 14

Multi Temperature Data

Page 15: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 15

LSA and NLS

Different Layers could have different NLS requirements.Some examples:•Reporting Layer: As this is the layer with the data for user access the amount of data or the required history belongs to the user requirements. In Finance for example most customers will report on actual and last year at least. In this case two years will be hot data and rest would be in the archive.•Propagation and Business transformation: Layers without reporting (be aware of direct DSO reporting with HANA) don’t need to have the same history as above. In most cases half a year will be sufficient, but has an impact on the locking problem. •Corporate Memory: As this is only a back up for safety reasons the data can be directly archived (Check that housekeeping is in place and PSA data is not hold for longer that 2 weeks in general)

Page 16: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 16

Design AspectsNearline Storage (NLS) vs. BW Accelerator (BWA)

Page 17: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

What is an Implementation for the SAP BW NLS Interface?

Page 18: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 18

NLS with Sybase IQImplementation Aspects

Page 19: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 19

NLS Interface – Design and Runtime Objects

Page 20: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 20

An Example – How does it work?

1. Data partitioned by fiscal

Quarter/year

2. Partitions being moved to Near-Line Storage are

locked for update

3. Once the data is moved to Near-Line Storage, it is deleted from BW

Page 21: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 21

NLS Related MultiProvider Settings

Page 22: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 22

NLS Related Query Designer Settings

Page 23: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 23

Data Access within the APD

Page 24: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 24

Reload Data from both Online and Nearline partitions for Cubes

Page 25: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved. 25

Summary

q NLS should be a part of an Information Lifecycle Management (ILM) or Data Aging Strategy• Based on well-established SAP BW archiving concepts• Data consistency guaranteed before deleting the data from source• Data archieved in NLS can be incorporated into reporting• Saves storage costs and other system resources• High compression rate (up to 95% deending on implementation)• Increases retention period for analysis data• Included in the query statistic data collection (RSRT)

q NLS Interface Features• Supports archiving of InfoCubes and Datastore Objects• Mainly time-based archiving, yet can also be based on other characteristics• Lock of the archieved data slice in the original Infoproviders• NLS Process Steps in Process Chain Handling• Cope with changes in the meta data to the BW objects of the archived data• Deletion of NLS partitions supported

Page 26: SYBASE IQ İLE NEAR-LINE STORAGE VE SAP NETWEAVER BW ON HANA

© 2014 SAP AG or an SAP affiliate company. All rights reserved.

Teşekkürler

İletişim Bilgileri:

Buğra Tezer Ömür EvliyaD&T Team Leader BAS Team [email protected] [email protected]