SAP BW: The Real-time Data Application Platform How SAP BW uses the SAP database options

(1)

Roland Kramer - Product and Strategy - PM EDW/In-Memory

July 2014

SAP BW: The Real-time Data Application Platform

(2)

Disclaimer

This presentation outlines our general product direction and should not be relied on in making a

purchase decision. This presentation is not subject to your license agreement or any other agreement

with SAP. SAP has no obligation to pursue any course of business outlined in this presentation or to

develop or release any functionality mentioned in this presentation. This presentation and SAP's

strategy and possible future developments are subject to change and may be changed by SAP at any

time for any reason without notice. This document is provided without a warranty of any kind, either

express or implied, including but not limited to, the implied warranties of merchantability, fitness for a

particular purpose, or non-infringement. SAP assumes no responsibility for errors or omissions in this

document, except if such damages were caused by SAP intentionally or grossly negligent.

(3)

Multi Temperature Data Management for BW on HANA

(4)

SAP BW on HANA - Smarter, simpler, more efficient

How Does BW running on RDBMS differ from BW running on HANA ?

Customer value of SAP BW powered

by SAP HANA

 Excellent query performance for improved decision making

 Performance boost for Data Load processes for decreased data latency

 Accelerated In-Memory planning capabilities for faster planning scenarios

 Flexible combine EDW with HANA-native data for real-time insights and decision making

 Data persistency layers are cut off and reduced administration efforts

 Simplified data modeling and remodeling

Data intensive functions are pushed

down from BW to HANA

HANA as the Primary Database for

BW and Foundation for new

Applications

HANA Stack

RDBMS

Traditional Stack

SAP NetWeaver BW Data Modeling Planning Data Management OLAP P ro c e s s Or c h e s tr a tio n Data Schema & Data

SAP BW on HANA Data Modeling Planning Data Management OLAP P ro c e s s Or c h e s tr a tio n Push Down

(5)

SAP BW - Overview

Available with SAP BW 7.4, SP5 (Q4/2013) on HANA



Enhanced Data Modeling



Common Eclipse based Modeling

Tools



BW/HANA Smart Data Access

providing the logical EDW



Easy integration of external data

models with

Open ODS Layer



Further reduce data layers in BW via

Operational Data Provisioning



Push down further processing

logic to HANA



BW Analytic Manager



HANA Analysis Processes



BW Transformations



PAK – Pushing down more planning

semantics

BW Queries, ODATA, MDX, SQL

Open Operational DataStore Layer

Agile Datamarts

BW Workspaces

HANA Schema BW Schema

Transformations EDW Core Layer

Transformations

Architected Datamart Layer

BW Virtualization Layer

External Sources

(6)

SAP HANA optimized Transformations

Available with SAP BW 7.4, SP5 (Q4/2013) on HANA

Next level of performance in data

staging for BW on HANA



Standard Transformations are gradually

optimized to be processed directly in SAP

HANA by generating according DB

procedure



First set of Transformations optimized i.e.:

– Mappings

– Conversions (time, currency, units)

– Formulas

– Read Master Data, Read from DSO

– Expert routine for HANA SQL script. . .



Sources:

PSA, DSOs, InfoCubes, SPOs,

CompositeProvider, MultiProvider



Targets: DSO

Activation

Transformation DSO

Data

BW 7.3x on anyDB

Transformation DSO

Data Activation

BW 7.3x on HANA

DSO

Data Activation

Transformation

BW 7.4 on HANA

A p p lica tio n S e rve r D at ab ase

(7)

SAP BW Planning (aka BPC)

Available with SAP BW 7.4, SP8 (Q3/2014) on HANA

Combine the best of three worlds to

a unique planning solution

(HANA, BPC, BW-IP)

Combines the

• …successful EPM Excel add-in

• …flexible BPC admin-UI

• …powerful BW-IP / PAK planning manager

• …super-fast HANA planning engine

Selected features

• Full PAK-model compatibility

• Business process flows (BPF)

• Work-status

• Data auditing

• Easy upload scenario

• LOB authorizations

BPC NW

‘unified’

(10.1)

BPC NW

• user experience

• collaboration

• data flexibility

BW-IP

• EDW-integration

• Built-in functions

HANA

• Unprecedented

speed

(8)

CompositeProvider

Available with SAP BW 7.4, SP6 (Q1/2014) on HANA

Easier data modeling and reduction of InfoProvider

types by enhancing the CompositeProvider

Supports

 Consolidation of existing CompositeProvider, MultiProvider, TransientProvider on HANA Models, VirtualProvider on HANA Models and InfoSet into CompositeProvider

 Use CompositeProvider as single BW metadata object to

combine data from other HANA based applications on the same instance of HANA (consumption of native HANA models or tables) with data in BW

– Faster Implementations

– More flexibility – Unions and Joins

– Easier consumption of data

– HANA optimized query runtimes  Modern Eclipse based UI

 Option to include Inventory key figures  Possibility to include in planning scenarios Prototyping

involving Business User

Classical Datawarehouse Schema

Other SAP HANA Schema

BW Workspace

CompositeProvider

Combine the data of various applications

Operational or Real-time Datamart

Table Model

View

SQL MDX BICS ODATA

SAP and non SAP Applications

External Database Hadoop ERP BW

(9)

Automatic generation of HANA models

Available with SAP BW 7.4, SP5 (Q4/2013) on HANA

BW Schema

generates

HANA Schema

HANA

View Master

Data Info

Provider

HANA

View HANA View

Enhanced HANA View

Enhanced Metadata interoperability between BW and HANA

HANA Model generation



Triggered from BW InfoProvider / CompositeProvider – push

– Complements BW model import from HANA Modeler

– Analysis Authorization: Automatic sync between HANA and BW

– Object changes include HANA model impact analysis



Direct consumption of BW data via generated HANA views

– SAP Lumira, BO Explorer, SQL

Scenario



Major footprint of scenario in BW



Usage of generated view in HANA Studio to build own data

models using BW data and HANA native algorithms

(10)

SAP HANA Smart Data Access

data virtualization for on-premise and hybrid cloud environments, SAP BW 7.4, SP5 (Q4/2013) on HANA

Enhanced Business Flexibility by

providing “the logical EDW”

Data Federation in diverse EDW landscapes

• Smart data access – read access to relational and non-relational sources via ODBC

• Enables access to remote data access just like “local” table

• Supports data location agnostic development • No special syntax to access heterogeneous data

sources

• BW based Analytic Services on external data

Scenario

• Make other DWHs transparent to HANA • Non-disruptive evolution from virtual table to

persistent structure by establishing ETL without major effort

• Consolidating / rationalizing the DWH landscape • Consumption of HANA datamart scenarios from

second HANA database

HANA Smart Data Access Layer Query

BW Virtualization Layer

Composite Provider, Open ODS View

Oracle

Hadoop

SAP HANA

MSSQL

IQ/ASE

Virtual Tables HANA Tables

(11)

Extended storage in SAP BW on HANA (with SAP IQ)

Available with SAP BW 7.4, SP8 (Q3/2014) on HANA

R

TD

P

HANA

IQ

Corporate Memory

Table

IQ Table

BW



DataSources and

write-optimized DSOs can have the

property “Extended Table”



Write and read operations are

re-directed to IQ



All BW standard operations are

supported – no changes



Only minor temporary RAM

required in HANA to support

extended tables

DataSource

PSA Table

IQ Table

DataSource

wo-DSO

Corporate Memory Staging Area

(12)

Synergy PBS CBW Add-On and SAP-NLS Implementation

Available with SAP BW 7.4, SP5 (Q4/2013) and SP08 (Q3/2014) on HANA

SAP-NLS Release capabilities

7.40 7.3x

7.0x

from

7.0x

onwards

Kernel

7.2x

SAP-NLS for InfoCubes, DSOs and non Reporting Layer (Corp. Memory)

SAP-NLS Reporting Layer (

MultiProvider

)

Inventory Cubes

Smart Data Access, ET*

Nearline Adapter (ABAP and Unicode based)

DBSL for Sybase ASE/IQ Kernel based; Open SQL + Native IQ SQL via ADBC)

BW Porting

General Porting

ODBC Driver from IQ

DB Client

PBS CBW NLS Add-On

• Detailed e2e Monitoring

• Detailed Query Analysis

• Fast Copy/Snapshot option

• Utilities for Planning NLS Projects

• Add. Enhancement PSA DAP

(13)

HANA Smart Data Access for BW NLS with SAP IQ

Available with SAP BW 7.4, SP8 (Q3/2014) on HANA



Query Access to NLS part of

InfoProvider can leverage SDA (if NLS

uses SAP Sybase IQ for NLS)



Optimized Query execution plan

(Semi-JOIN), Filter push-down, …



Significantly better Query

performance for many NLS queries

• especially Queries using Hierarchies or Nav.

Attributes can run 100 times faster

SAP IQ

Facts (nearline)

HANA

BW

VIRTUAL_TABLE

Facts (online)

Master data

Analytic Query

NLS-Split

SQL API

Example from Retail:

Aggregation of articles in categories

as Nav. Attributes

HANA Smart Data Access for BW NLS with SAP IQ

Available with SAP BW 7.4, SP8 (Q3/2014) on HANA



VirtualTable can be used in

HANA CalcView

• Initial version w/ HANA SP07

• Full plan optimizations w/ HANA SP08



BW Query execution can push OLAP

calculations to HANA (Restricted

KeyFigures, Hierarchies, …)



Further improvement of NLS Query

performance due to optimized access

SAP IQ

HANA

BW

VIRTUAL_TABLE

Facts (online)

Master data

Analytic Query

NLS-Split

CalcScenario API

(15)

BW NLS data for External HANA Views

Available with SAP BW 7.4, SP8 (Q3/2014) on HANA



Generated HANA Views for

InfoProvider (new with BW7.4 SP05)



HANA Views can (optionally) include

NLS part as UNION between online

and nearline facts



NLS part is available for external

consumption, e.g. 3

rd

_{Party Frontend´s}



NLS part is always accessed

SAP IQ

HANA

VIRTUAL_TABLE

Facts (online)

Master data

CalcScenario

Generated HANA View for

BW InfoProvider

optional

(16)

SAP IQ is the preferred solution for warm and cold data archiving

capabilities for SAP BW, Business Suite, and HANA

NLS (Near Line Store) for SAP BW

• Optimized NLS data transfer throughput using IQ Loader functionality

• SAP HANA and IQ share the same columnar paradigm, and similar data compression rates • Ready for large data volumes

• Suitable for ad-hoc queries with long history • Minimum administration effort

ILM for SAP Business Suite

• Fast archive index read w/o additional secondary DB indexes • Increased search capabilities

• Faster archive I/O – fewer layers (software, network, storage hardware) • ERP archive files as well as archive indexes stored in SAP IQ

Warm archive for HANA using smart data access (SDA)

• Using SDA, HANA customers can access IQ as a federated store • Store warm data in IQ, and real time data in HANA

(17)

SAP Real-time Data Platform

optimized for all big data applications

Enterprise Information Management

Custom Apps

Open Developer API’s and Protocols

SAP Sybase

Replication Server SAP Data Services

SAP HANA Platform

SAP MDG, MDM, DQ

SAP Real-time Data Platform

SAP Sybase IQ

SAP Sybase ASE

SAP Sybase SQLA SAP Sybase ESP C o m m o n M o d el in g S y b as e P o wer D es ig n er HA DOOP NoSQL MPP Sc ale -Out

3rd_Party

BI Clients

SAP Business

Suite SAP BW

SAP Big Data

Applications SAP Analytics

SAP Mobile

SAP NetWeaver (On Premise/Cloud)

Co m m o n L a n d s c a p e M an ag em en t

(18)

How to get there …

► Post Copy Automation for BW (BW-PCA)

► Upgrade/Migration Procedure

(19)

Sybase IQ

Three things to know - Migration BW on HANA

Blog: Three things to know when migrating NetWeaver BW on HANA

BW

7.31

7.40 *

HANA

DB

BW

7.0x

any

DB

Near-Line

Storage (NLS)

BW House-

keeping tasks

DMO

smaller ROW store

footprint in HANA

smaller COLUMN store

footprint in HANA

upgrade/migration/unicode*

in one technical step

DMO 1.0 SP10 and

BW 7.40 SP06 available

since Q1/2014

(20)

SAP BW powered by HANA and Sybase IQ

Near-Line Storage (NLS) Architecture - Overview

BI Clients

SAP

HANA

_Sybase

IQ

MultiProvider Transient

Provider InfoCube/DSO Near-Line SDK

SAP Netweaver BW 7.3x

Partner OEM

BW NLS4IQ SAP Native

An SAP - owned BW NLS

implementation for Sybase IQ offers a

fully integrated solution from one

provider

Main aspects:

• Deliver an ABAP-based

implementation of the BW NLS

interfaces

• Deliver a Sybase IQ DBSL ‘light’ that

covers all the needs of the

above-mentioned NLS implementation

• Sybase IQ to deliver reliable,

high-performance execution of the DBSL

driven loads and queries

• Availability since Q2/2013

SAP owned alternative to existing NLS-Partner Solutions

(21)

Database migration option (DMO) in the SUM Framework

one-step upgrade and migration with DMO - phases during the procedure

Setup SAP HANA specifics

(client, schema …)

6 Start SAP HANA-based system

4 Migrate application data

(incl. UC data conversion)

5 Finalize upgrade

Downtime

Traditional

DB

T

im

e

Uptime

Switch

₃

database connection

1 Upgrade “Prepare”

2 Execute Upgrade

(until downtime phase)

SAP System SAP System

Note

Traditional

database

(22)

Conclusion: SAP BW? - three things to know ...

The NetWeaver BW 7.40 Released (on HANA)

Our Customers know the (Business) Value -

https://scn.sap.com/docs/DOC-48044

Three Things to now when migration BW on HANA

Blog:

Three Things to Know when Migrating SAP NetWeaver BW on SAP HANA

The Upgrade from 7.0x to 7.4 is possible directly/one step including SEM

Blog:

Good News - Easier Modeling of the SEM Add-On in Solution Manager

1

3

2

(23)

Thank you

Roland Kramer

Product and Strategy - PM EDW/In-Memory

SAP SE |Dietmar-Hopp-Allee 16 | DE-69190 Walldorf | Germany

t +49 62277 64403 | m +49 151 4260 3219 | @ [email protected]

BW ALM Page: http://scn.sap.com/docs/DOC-7856 I BW on HANA first guidance Join me online: Xing I Linkedln I SAP Connect I ondemand | Twitter