PBS CBW NLS

(1)

PBS Nearline Storage Solutions for SAP NetWeaver BW

(2)

Agenda

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

(Information Lifecycle Management)

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(3)

PBS Software GmbH

Founded in 1991 by Günther Reichling

Worldwide more than 1000 customers

More than 2500 PBS archive add ons installed

Founded in 1991 by Günther Reichling

Worldwide more than

1000 customers

More than 2500 PBS archive add ons installed

18 years' experience with supplementary solutions for data

archiving and Information Lifecycle Management with SAP

(4)

PBS Software GmbH

SAP Software Partner since 1999

Intensive cooperation with SAP since 1998 (data archiving, ILM)

Cooperation with partner companies for the Americas since 1998

Cooperation with partner companies for Europe since 2000

Cooperation with partners for the APAC region since 2001

All major PBS solutions certified by SAP AG (ICC)

SAP Software Partner since 1999

Intensive cooperation with SAP since 1998 (data archiving, ILM)

Cooperation with partner companies for the Americas since 1998

Cooperation with partner companies for Europe since 2000

(5)

(6)

PBS Solution Portfolio

PBS Analysis Tools

PBS Database Analyzer PLUS, BW Database Analyzer

PBS Analysis Tools

PBS Database Analyzer PLUS, BW Database Analyzer

PBS archive add ons for SAP ERP

(and SAP R/3)

Effective Indexing and Transparent Retrieval of SAP Appl. Data

PBS archive add ons for SAP ERP

(and SAP R/3)

Effective Indexing and Transparent Retrieval of SAP Appl. Data

PBS Solutions for SAP NetWeaver Business Warehouse

PBS CBW Nearline Storage Solutions for SAP NetWeaver BW

PBS Solutions for SAP NetWeaver Business Warehouse

PBS CBW Nearline Storage Solutions for SAP NetWeaver BW

PBS Solutions for Data Extraction

CFI DEI, Database Export Interface, CDART, ECS

PBS Solutions for Data Extraction

CFI DEI, Database Export Interface, CDART, ECS

PBS Solutions for Customer-Specific Applications

PBS archive add on CUSTOM (SAP ERP, SAP BW, etc.)

PBS Solutions for Customer-Specific Applications

PBS archive add on CUSTOM (SAP ERP, SAP BW, etc.)

PBS Solutions for SAP Industry Solutions

(SAP IS)

IS Retail, IS Utilities, IS Telecommunication (IS Oil, IS Mill)

PBS Solutions for SAP Industry Solutions

(SAP IS)

IS Retail, IS Utilities, IS Telecommunication (IS Oil, IS Mill)

PBS Solutions for Compliant Storage

PBS ContentLink (EMC Centera, NetApp Filer, IBM DR550,...)

PBS Solutions for Compliant Storage

(7)

Data Archiving and Nearline Storage

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(8)

Initial Situation

SAP BW

SAP ERP

SAP IS

POS

Legacy

Data-base

Challenge:

- Heavily growing SAP BW database

- Reduced retrieval performance

-

Growing maintenance and administration efforts

Solution: Remove data from the BW database

(9)

Motivation for BW Data Archiving

Potential savings:

Significant reduction of the BW database size/growth

Reduction of hardware and administration costs

Better performance – shorter query response times

Less effort for backup and desaster recovery

Compliant data management to cover legal requirements

Reduced effort for release upgrades

Challenges for SAP BW data archiving:

(10)

(11)

Information Lifecycle Management Aspects

Source: SAP AG

(12)

SAP NetWeaver

BW

7.0

7.0 Nearline

Nearline

Storage

Interface and

Data

Archiving

Pure ADK Archiving

Transfer to seq. files

Reload from ADK

Update from ADK

Sequential access

(slow)

Query

(sequential)

SAP ADK archive file

Nearline Storage Solution

Transfer into external

nearline storage solution

No SAP archive files

Reload via NLS

Update via NLS

Query

Nearline storage (ext. solution)

Combine ADK + Nearline

Transfer into external

nearline storage solution

Transfer into ADK files

Reload from ADK

Update via NLS

SAP ADK

Query

Nearline storage (ext. solution)

(13)

SAP Data Archiving for SAP BW 3.x

T-Code RSA1 T-Code RSA1

(14)

(15)

SAP DAP

(Data Archiving Process, from BW 7.0)

Create/change

data archiving processes

T-Code RSDAP T-Code RSDAP

(16)

(17)

SAP DAP

(Data Archiving Process, from BW 7.0)

Create/maintain

archiving requests

(18)

PBS BW Database Analyzer

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(19)

PBS BW Database Analyzer - Features

DB Capacity Analysis

Data analysis in background (batch)

Dialog evaluation – Individual analysis

Dialog evaluation – Comparison

analysis

Data transfer to InfoCube

DB Distribution Analysis

(20)

Evaluate all BW data types,

Limitation to details is possible:

–

InfoCubes

–

DataStore Objects

–

PSA Tables

Analysis options for InfoCubes/PSA:

–

Fact and dimension tables

–

Current or all versions

Periodic database analysis:

–

Monitoring of data growth

–

Detect fast growing InfoProviders

BW Database Analyzer – Capacity Analysis (I)

(21)

BW Database Analyzer – Capacity Analysis (II)

(22)

BW DB Analyzer – Distribution Analysis (I)

Configure

the analysis and

start

in the background (batch)

Evaluate InfoProviders with

reference to capacity analysis

Limit and select InfoProviders

which are to be analyzed

(23)

BW DB Analyzer – Distribution Analysis (II)

(24)

PBS Concepts for Nearline Storage and ILM

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(25)

Available PBS CBW Solutions for SAP BW

SAP BW

Release

7.x

3.x

7.x

3.5

3.5 PBS Solution

PBS CBW NLS IQ

PBS add-on CBW for IQ

PBS add-on CBW

NLS IQ

NLS ADK

ADK

(classic)

Archiving and Access Options

(26)

Integrated PBS Nearline Concept

Storage System

• SAP archive files

• PBS indexes/aggregates

PBS NLS Services

for ADK and Sybase IQ

Nearline Database

(Sybase IQ)

SAP NetWeaver

BW

Nearline Interface

SAP NetWeaver

BW

Database

(27)

PBS CBW Nearline Storage Concept

Nearline Storage Solution

PBS CBW NLS

SAP BW 3.x:

PBS archive add on CBW

InfoCubes and DSO

Access via NLS Interface (N)

Access via V, M Provider CBW NLS (ADK version)

Aggregates and indexes CBW NLS for Sybase IQ

Load to Sybase IQ, read PBS aggregates

PBS indexes NLS DB Sybase IQ

Data Extracts (GDPdU)

CBW Data Export Interface

Extracts: archive/NLS + DB

InfoCubes, DSO

Master data and texts

Transparent tables

SAP ArchiveLink-enabled Data extracts in

SAP/AIS

PSA Archiving

ADK and Sybase IQ

Write and delete

Read and reload

Update

ADK ADK

SYBASE

(28)

PBS ILM Concept for SAP NetWeaver BW

Data Extracts (Z3): InfoCubes, DataStore, Master Data

PBS CBW NLS

PSA: archive, read, reload, update

PBS CBW NLS

Query access for InfoCubes and DataStore Objects

PBS CBW NLS

Capacity analysis and distribution for InfoProvider

PBS BW Database Analyzer

ETL: BW Extractors for SAP ERP

PBS archive add ons for SAP ERP

PBS ILM Concept

for

S

AP BW

DB

BW

Nearline Storage Sybase IQ

InfoCubes DataStore PSA (PBS) Data extracts (PBS)

Nearline Storage ADK

(29)

PBS CBW NLS - Data Access, Architecture

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(30)

BW End User Query

DB + NLS Archive

(31)

BW End User Query

Query with only online access to the SAP BW database

Data of current year in the SAP BW database, data of previous year in

(32)

BW End User Query

Query monitor:

Enable SAP BW Query

for nearline access

Retrieve data from

SAP BW database

+ nearline storage

(33)

BW End User Query

Query with online access to database + nearline storage via CBW

Data of current year in the SAP BW database, data of previous year in

(34)

CBW Architecture – NLS and Sybase IQ

SAP

Nearline

Provider

SAP

Nearline

Provider

InfoCube

DataStore Object

InfoCube

DataStore Object

Read DB and Nearline

(activate in query attributes)

Read DB and Nearline

(35)

Architecture – PBS CBW NLS for Sybase IQ

CBW NLS IQ infrastructure w/o ADK components

CBW IQ – Interface for the

SYBASE IQ Analytics Server

(36)

Architecture – PBS CBW NLS for Sybase IQ

CBW NLS IQ – Components overview, technical view

SAP Gate way SAP SAP Gate way Gate way Sybase IQ DB Engine Sybase IQ DB Engine Sybase IQ DB Instance Sybase IQ DB

Sybase IQ DB InstanceInstance

RFC

JDBC

Relationships between instances (SAP BW, CBW, Sybase IQ):

n:m

(37)

Administration Cockpit and NLS Monitor

Select the InfoProviders

Generate Infrastructure Components

Additional Utilities

Monitor:

-

CBW NLS

-

Sybase IQ

(38)

Benefits of the CBW IQ Version

Effective NLS data transfer – very fast load process into IQ

(e.g. 10 million records within approx. 10 minutes)

Column-based data storage (Vector DB) – no need for

aggregation and index generation

Suitable for ad-hoc queries with archive/nearline access

Very low administration effort

Well suited for large data volumes

Very fast – also with high system and data load

(39)

CBW Architecture with NLS ADK

SAP

Nearline

Provider

SAP

Nearline

Provider

PBS

Nearline Service

for ADK

PBS

Nearline Service

for ADK

ADK files: Compression 1: 10 ADK files: Compression 1: 10

InfoCube

DataStore Object

InfoCube

DataStore Object

PBS index PBS aggregate SAP archive

SAP BW Query

ADK

Read DB and Nearline

(40)

(41)

CBW Administration Cockpit (SAP BW 7.x)

Select the InfoProvider

Modeling of CBW infrastructure

(Archive aggregates and indexes)

Generate the CBW infrastructure

Create and administrate the

aggregate and index data

(42)

Aggregate Modeling for CBW NLS ADK

Subsets of archived InfoCubes or DataStore Objects

Flat table structures (in analogy to index and archive files)

Subsets of InfoProvider characteristics and key figures

(with standard aggregation) in the aggregate structure

Modeling of aggregates from SAP templates, queries or via analysis

Compressed storage in sequential files (ADK format)

Subsets of archived InfoCubes or DataStore Objects

Flat table structures (in analogy to index and archive files)

Subsets of InfoProvider characteristics and key figures

(with standard aggregation) in the aggregate structure

Modeling of aggregates from SAP templates, queries or via analysis

Compressed storage in sequential files (ADK format)

Characteristics

Characteristics Key figuresKey figures

Controlling Area Cost Center Vendor Amount Quantity

Archive Data Archive Archive Data Data Archive Aggregate

Major characteristic Remaining char. Key figures

Controlling Area Cost Center Amount Quantity Cost Center Controlling Area Amount Quantity

A1.1 A1.1

A1.2 A1.2

(43)

Index Modeling for CBW NLS ADK

Flexible and generic indexing for InfoCubes and DSO

Each characteristic (dimension) can be indexed

Additional attributes (characteristics or key figures)

Indexes are stored as compressed flat files (ADK) outside database

Flexible and generic

indexing

for InfoCubes and DSO

Each

characteristic (dimension) can be indexed

Additional

attributes

(characteristics or key figures)

Indexes are stored as compressed flat files (ADK) outside database

Characteristics

Characteristics Key FiguresKey Figures

Cost Center Vendor G/L Account Amount Quantity

Index Key Index Attributes

Archive Data Archive Archive Data Data Archive Indexes

(44)

CBW Integration into Storage Infrastructure

SAP NetWeaver BW

online

-SAP File System

nearline

-Storage System

nearline

-SAP ArchiveLink

BW Query DB + Archive Archive Data Archive Archive Data Data PBS Index PBS Aggregates Archive Data Archive Archive Data Data PBS Index PBS Aggregates

SAP NetWeaver

BW

Database

BW

BW DatabaseDatabase Archive Data - File System

-Archive Daten Storage System

(45)

Benefits of the CBW ADK Version

ADK – well-approved archiving method

(SAP R/3, ERP)

High data compression, typically 1:10

Pure software solution – no additional HW required

Optional aggregation and indexing

Suitable for large DSO with few queries

(46)

Archiving of PSA Data, Additional Tools

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution for PSA Data, Additional Tools

(47)

Archiving of PSA Data

SAP BW: Delete PSA tables after staging into InfoProviders

Archiving requirements, e.g. to repeat staging into InfoProvider

PBS PSA Archiving (ADK-based and with Sybase IQ):

User-friendly definition of AOBJ/DAP

Flexible integration of DataSources

Enhanced archive administration

Comfortable read and reload access

SAP BW: Delete PSA tables after staging into InfoProviders

Archiving requirements, e.g. to repeat staging into InfoProvider

PBS PSA Archiving (ADK-based and with Sybase IQ):

User-friendly definition of AOBJ/DAP

Flexible integration of DataSources

Enhanced archive administration

Comfortable read and reload access

PBS PSA Archiving: - ADK archive files - Store in Sybase IQ PBS PSA Archiving: - ADK archive files - Store in Sybase IQ

(48)

Archiving of PSA Data

PSA archiving with PBS archive add on CBW or

PBS CBW NLS

(49)

Archiving of PSA Data

(50)

Archiving of PSA Data

(51)

PBS CBW Data Export Interface

Create data carrier for audits (e.g. tax audit, GDPdU-Z3)

Extract arbitrary InfoCubes, DataStore objects and master data

Select database and archive data

Arbitrary field selection via ALV

Data extraction in SAP AIS format

Supports XML description standard

Full support for Audicon IDEA and TaxAudit

(52)

PBS Conversion Tool

PBS API to enhance customer-specific programs with PBS access

PBS

API to enhance

customer-specific programs with PBS access

PBS Conversion Tool

Enhance SQL statements

with PBS archive access

(53)

PBS ContentLink – Overview

PBS ContentLink is a Web server-based

INTERFACE

solution to link SAP systems

and external storage solutions via SAP ArchiveLink.

PBS ContentLink enables write and read access for all

SAP ArchiveLink-enabled

data

(ADK files, PBS index files, PBS aggregates ...).

(54)

PCL – Integration with PBS CBW NLS

PBS CBW NLS

PBS ContentLink

(55)

Summary and Outlook

Introduction - PBS Software GmbH, Solution Portfolio

Data Archiving and Nearline Storage in SAP NW BW

PBS BW Database Analyzer – Effective DAP Preparation

PBS Concepts for Nearline Storage and ILM

PBS CBW NLS – Data Access and Architecture

PBS Archiving Solution of PSA Data, Additional Tools

(56)

PBS CBW – Summary

Generic add-on solution for

online

query access to database and

archive data (InfoCubes, DataStore objects)

ADK version: real archive aggregates and effective indexing

IQ version: minimal administration efforts + short response time

IQ + ADK: huge compression rates when storing the data

Compliant storage of nearline /archive data

Data extraction for audit needs (e.g. GDPdU)

PSA: archive, read and reload: ADK + IQ version

(57)

Thank you very much for your attention!

We would appreciate to provide

you further information.

Please click our website.

PBS Software GmbH

(58)

Copyright

No part of this presentation may be reproduced or transmitted in any form or for any purpose without the written permission of PBS Software GmbH, Bensheim, Germany.

PBS archive add ons is a registered trademark of PBS Software GmbH.

SAP, the SAP Logo, R/3, SAP ArchiveLink, SAP ERP, SAP BW, SAP NetWeaver, SAP NW BW and others are registered trademarks of SAP AG in Germany and many other countries.

EMC and Centera are registered trademarks of EMC, Hopkinton, USA.

NetApp is a registered trademark of Network Appliance, Sunnyvale, CA, USA IBM and DR550 are registered trademarks of IBM, Armonk, NY, USA