End-to-End Integration Testing of SAP-centric Solutions. ALM Solution Management Active Global Support (AGS) SAP AG

(1)

End-to-End Integration Testing of SAP-centric Solutions

ALM Solution Management

Active Global Support (AGS)

SAP AG

(2)

Disclaimer

This presentation outlines our general product direction and should not be relied on in making a purchase decision. This presentation is not subject to your license agreement or any other agreement with SAP. SAP has no

obligation to pursue any course of business outlined in this presentation or to develop or release any functionality mentioned in this presentation. This

presentation and SAP's strategy and possible future developments are

subject to change and may be changed by SAP at any time for any reason

without notice. This document is provided without a warranty of any kind,

either express or implied, including but not limited to, the implied warranties

of merchantability, fitness for a particular purpose, or non-infringement. SAP

assumes no responsibility for errors or omissions in this document, except if

such damages were caused by SAP intentionally or grossly negligent.

(3)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples

3.1. Test Option 1 3.2. Test Option 2

4. Additional Test Management Capabilties 5. Summary and further Information

Agenda

(4)

SAP Solution Manager

From Awareness to Action

SAP is aware of customer pain points. Pain points are addressed by best practices:

**SAP Standards* for E2E Solution Operations.**

SAP has compiled best practices for E2E Solution Operations based on the experience from customer engagements over three decades.

Implementation methodology for E2E Solution Operations: Run SAP.

Require- ments

Design

Deploy

Build &

Test Optimize

Operate

Application Management

Require- ments

Design

Deploy

Build &

Test Optimize

Operate

Application Management

SAP Solution Manager provides all capabilities for E2E Solution Operations.

Change Management Solution

Updates

Problem analysis

Monitoring Software

logistics

Integration Validation

Integration Testing Innovation Management Transparency on Processes & Apps

Incident Management

Improvements of processes, components and solutions

Maintenance of SAP Solutions

Root Cause Analysis

Monitoring of mission- critical processes

Deployment of solution updates

Integration Testing Innovation Management Identification of critical business processes

Incident Management

* SAP Standards for Solution Operations http://service.sap.com/supportstandards

(5)

Changing SAP Solutions

Customer pain points*

2

3 1 Tests in heterogeneous system landscapes

Change Impact Analysis

Test Data Management

E2E Integration Tests of business processes in system environments interfacing SAP with non-SAP solutions

Indentification of critical business processes affected by change events such as SAP Support Packages

No risk-based test recommendations

Test Systems with outdated test data

Productive System copy is too expensive and rework intensive

Creation of appropriate test data for manual / auto test cases

4 Test Automation

Creation of automated test cases is time consuming and expensive to maintain via skilled QA specialists

Automated test cases get damaged by change events and need time consuming repair by QA Specialist

(*) Pain point have been collected via customer survey conducted in the US and Europe

(6)

Methodology

E2E Solution Operations methodology for the ongoing management of end-to-end solutions

Run SAP methodology to implement end-to-end solution operations including SAP standards, best practices, roadmap, training, certification, services and tools for E2E solution operations

Test Process

From change events and change impact analysis

via test planning and test execution

to deployment of changes in production system

Test Capabilities

SAP Solution Manager acts as central point of access to SAP and 3rd Party test capabilities

… as well as additional capabilities like E2E Integration Validation

Business Blueprint

Test Planning Test Execution Apply Changes to Production Change Impact

Analysis SAP Solution

Update New SAP

Solution

SAP Solution Manager

Managing Changes is Critical for Business Agility

Methodology, Test Process and Test Capabilities

(7)

Test Management

Test Process embedded in Application Life-cycle Management

Business Blueprint

Test Planning

System Setup Test Execution Deploy Changes to Production

Change Impact Analysis

Business Blueprint Update

Identification of Business Processes affected by SAP Solution Updates

Recommendation of business processes for regression tests

SAP Support Packages

SAP Legal Change Packages

SAP Enhancement Packages

Customizing changes

Custom Code

Interface changes

Development of Test Cases

Test Plan setup

Compilation of Test Packages

Assigment of Testers

Setup of Test System

Creation of Test Data

Test Scope Identification

Manual tests

Automated tests

Incident Management

Performance tests

Test status and progress reporting

Test sign-off

Deployment of changes through transports from Test to

Production system

SAP Support packages, Legal Change

Packages, Enhancement Packages

Type of Change

SAP Solution Update New SAP

Solution

Implementation of new SAP Solution

Business Blueprint Design

Solution Configuration

Note: Test Project Preparation as first step including: test strategy review, definition of test objectives, test tools, test budget, timeline, roles & responsibilities

(8)

Test Management

SAP Solution Manager

All SAP test capabilities are provided and tightly integrated with SAP Solution Manager

Risk-based Test Planning

Identification of business processes affected by SAP Solution changes

Provide choices to SAP customers

Customers can use SAP capabilities and 3rd Party Test Suites in combination

All required Interfaces will be provided over time

Guiding Principles

(9)

SAP Solution Manager

Business Blueprint Option 1

Business Process Change Analyzer*

Test Workbench

HP: QTP CPWR:TestPartner

Test Management

Capability Options for SAP Customers

eCATT

Option 2

HP Quality Center HP Quality Center HP QTP

UI based Tests

eCATT:

Application Logic Tests Backend Tests

Test Planning System Setup

Test Execution

Manual and automated tests

Apply Changes to Production Change Impact

Solution

SAP TDMS

Test Scope Identification Type of Change

Business Blueprint

Business Process Change Analyzer*

SAP TAO

Automated Tests Manual Tests

Test Planning Test Scope Identification

* Availability with SAP Solution Manager 7.0 EhP1

(10)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes

3. Test Capabilities and Customer Examples 3.1. Test Option 1

3.2. Test Option 2

4. Additional Test Management Capabilties 5. Summary and further Information

Agenda

(11)

SAP Solution Manager

Business Process Change Analyzer

Change Impact Analysis Test Planning Test Execution SAP

Solution Update

Identification of business processes affected by change

Risk-based Test Recommendation

Test Case review and creation of missing test cases

Test Plan generation

Regression Tests

Manual Tests

Automated Tests

SAP Solution updates occur frequently

SAP triggered: Support Packages, Enhancement Packages

Customer triggered: Customizing changes, Custom code development

Customer Pain Point

Which business processes are affected by planned change?

Approach

(12)

SAP Solution Manager

Business Process Change Analyzer

Order to Cash Sales Order Delivery Goods Issue Billing

Preparation

Execution of mission-critical business processes by Business User

Trace Result:

Technical Bill of Material (T-BOM)

Code: Function modules, …

UI: Dynpro 1000, …

Tables: Customizing, Master Data

Change Impact Analysis

“Which critical Business Processes will be affected by planned changes?”

Planned Change

SAP Support Packs

SAP EhPs

Custom Code

Customizing changes

Order to Cash

Sales Order Æ code change Delivery

Goods Issue Æ UI change Billing

Procure to Pay

Create PO Æ customizing change Business Process Change Analyzer

Risk-based Test Scope

“Can I get a recommendation for regression tests?”

Business Process Change Analyzer

Identification of business processes impacted by software changes

Support decision making whether planned change shall be executed

Automatic test plan generation for SAP Test Workbench

(13)

SAP Solution Manager

Business Process Change Analyzer

Precise insight

Identification of critical business processes affected by planned change events

Improved handling of change events

Support for customer’s change committee to decide on SPs, EhPs or Custom triggered changes for SAP production system

Risk-based Test Planning

Recommendation for subsequent regression tests

SAP Solution Manager 7.0 EhP1

Business Process Change Analyzer

(14)

Why SAP

End-to-End functionality and excellent integration into existing SAP solution landscape

Reuse of already achieved results Benefits

Significant time savings within test preparation

Risk-based test scope

identification leading to significant reduction of test effort

Streamlined communication during test execution

Role-based approach for all test activities supported by new Work- Center

Challenges and Opportunities

Extention of the proven test management capabilities of SAP Solution Managers via utilization of functional enhancements of EHP1

Objectives

Optimization of test planning through Business Process Change Analyzers (BPCA) of SAP Solution Manager

Optimization of test execution via

deployment of test sequence functionality of Test Workbench

Increased user and process efficiciency through html-based Workcenter for Test- and incident management

Increased quality of SAP solution documentation through deployment of Solution Documentation Assistent (SoDocA)

Implementation Highlights

New Wizard for setup of basic

configuration of SAP Solution Manager within 3 hours

Tool-based test scope identification and automated test plan generation

Email notification for all status chnages of test cases

Central access and administration for all test relevant information.

SOKA-BAU and SOKA-IT

SAP Solution Manager including BPCA and Test Workbench

Quick Facts

Location: Wiesbaden, Germany

Industry: Insurance

Total assets: 4.8 bn € (2008)

Total employees: 1.200 (2009)

Website 1: soka-bau.de

Website 2: soka-it.de

SAP Solutions: SAP ERP, SAP BW, SAP EP, SAP Solution Manager

Partner: SAP Consulting

„Test efforts resulting from software changes affecting our SAP solution operations can be significantly reduced by using a risk-based test scope

identification provided by the Business Process Change Analyzer of SAP Solution Manager.“

Roland Krüger

Manager SAP Customer CoE SOKA-IT

(15)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples

3.1. Test Option 1 3.2. Test Option 2

4. Additional Test Management Capabilties 5. Summary and further Information

Agenda

(16)

Option 1

E2E Integration Testing of SAP Solutions

Options for SAP Customers

Test Planning Test System Setup

Test Execution Apply Changes to Production Change Impact

Solution

Solution Manager Test Workbench

Test planning Solution Manager

Business Blueprint Solution Manager

Test Workbench

Manual testing

Solution Manager eCATT

Solution Manager Business Process

Change Analyzer *

Application-logic Tests

Test Partner QTP

eCATT UI based Tests

Setup of business process catalog

Business requirements

Identification of processes affected by code / customizing changes

Admin of

automated tests SAP TDMS

Setup of lean test systems

QTP Test Scope Identification

Type of Change

Automated Tests

LoadRunner

Performance Tests

(17)

Test Management

SAP Solution Manager – Business Blueprint / Configuration

Goal

Documentation of Business Processes and assignment of manual and automated test cases

Scope

• Business Blueprint: hierarchical definition of business processes

• „Single source of thruth“ – 1 repository for business process information from various perspectives: assigned systems by role (DEV, TST, PRD), interfaces, integrated partner / non-SAP products, transaction codes, training material, business process details, business requirements

• Assignment of manual and automated tests to business processes

Benefits

• Central business processes repository from a business -, system landscape - and technical perspective

• Business Blueprint as central location for test cases

(18)

Test Management

SAP Solution Manager – Business Process Change Analyzer

Goal

Change Impact Analysis of software changes on mission-critical business processes

Scope

• Precise identification of business processes impacted by change events including

• SAP Support Packages

• SAP Enhancement Packages (limited functionality)

• Customizing changes

• Custom code developments

• Risk-based test scope identification

• Semi-automatic test plan generation for Test Workbench

Benefits

• Precise change impact analysis for mission-critical processes resulting from SAP Solution changes

• Reduction of test effort via risk-based test scope

identification

(19)

Test Management

SAP Solution Manager – Test Workbench

Goal

Management of functional tests from test planning via test execution to test status reporting and test sign-off

Scope

• Planning of manual and automated test cases

• Link between business processes and test cases

• Suitable environment for endusers to execute manual tests via individual test packages

• Test status reporting for test coordinators including % of completion, incidents, drilldown to tester notes, incidents,…

• Trend reports through integrated SAP BI reports

Benefits

• Very comprehensive and mature test management capability used by thousands of SAP customers

• 1-click access from test management to test systems

• Test sign-off including digital signatures

(20)

Test Management

SAP Solution Manager – eCATT

Goal

Test automation for functional tests and backend logic tests

Scope

• Test automation for SAP business processes such as Order-to-Cash

• Test automation for backend logic tests (SOA, …)

• Test Management via Test Workbench

• Central test data repository

• Test execution in distributed system landscapes

• Integration with partner test automation tools like HP QTP for html-based business processes

Benefits

• Mature capability for test automation of business processes as well as backend logic tests

• Seemless integration into Test Workbench for test

planning, execution and status reporting

(21)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples

3.1. Test Option 1 3.2. Test Option 2

4. Additional Test Management Capabilties 5. Summary and further Information

Agenda

(22)

E2E Integration Testing of SAP Solutions

Test capabilities for functional testing

Test Requirements

Test Planning Test Execution Deploy Changes to Production Change Impact

Solution

Option 2

Quality Center

Test requirements

Test planning Solution Manager

Business Blueprint

Solution Manager Business Process Change Analyzer *

Quality Center

Quality Center SAP TAO

Accelerated test component generation

SAP TDMS

Setup of lean test systems

Test Scope Identification Type of Change

Identification of business processes affected by code / customizing changes

Setup of business process hierarchy

Business requirements

Test Lab

Defect management

Business Process Tests

Quick Test Pro

LoadRunner

Performance Tests

(23)

Test Management

SAP Solution Manager – Business Blueprint / Configuration

Goal

Documentation of Business Processes and assignment of manual and automated test cases

Scope

• Business Blueprint: hierarchical definition of business processes

• „Single source of thruth“ – 1 repository for business process information from various perspectives: assigned systems by role (DEV, TST, PRD), interfaces, integrated partner / non-SAP products, transaction codes, training material, business process details, business requirements

• Assignment of manual and automated tests to business processes

Benefits

• Central business processes repository from a business -, system landscape - and technical perspective

• Business Blueprint as central location for test cases

(24)

Test Management

SAP Solution Manager – Business Process Change Analyzer

Goal

Change Impact Analysis of software changes on mission-critical business processes

Scope

• Precise identification of business processes impacted by change events including

• SAP Support Packages

• SAP Enhancement Packages (limited functionality)

• Customizing changes

• Custom code developments

• Risk-based test scope identification

• Semi-automatic test plan generation for Test Workbench

Benefits

• Precise change impact analysis for mission-critical processes resulting from SAP Solution changes

• Reduction of test effort via risk-based test scope

identification

(25)

Test Management

SAP Solution Manager Adapter for SAP Quality Center by HP*

Goal

Exchange of business processes, business requirements, test assets, incidents and test results between SAP Solution Manager and Quality Center

Scope

• Outbound interface: transfer of business processes, business requirements, test objects and incidents to Quality Center

• Inbound interface: transfer of defects and test results from Quality Center to SAP Solution Manager

Benefits

• Enablement of end-to-end integration testing based on business processes and business requirements

• Efficient collaboration between solution implementation and change management supported by SAP Solution Manager and test management realized within Quality Center

Adapter

Quality Center

*) Additional license required

(26)

Test Management

SAP Quality Center by HP*

Goal

Management of test requirements, manual / automated test cases and test result analysis

Scope

• Definition of test requirements based on business processes and assigned business requirements

• Setup of manual test cases

• Composition of test cases based on test components

• Definition of test cycles and scheduling of test execution

• Integrated defect management capabilities

• Advanced test status analysis via out-of the-box reports and dashboards

Benefits

• Comprehensive test management capabilities with high usability for end-users and power-users

• Tight integration with SAP Solution Manager and SAP TAO

(27)

SAP Solution Manager

The Adapter allows the exchange of Defects and solved Incidents SAP Quality Center by HP

SAP Solution Manager Adapter for SAP QC by HP Integration between Defect and Incident Management

1) Test execution 2) Defect creation 3) Transfer of Defects 4) Incident resolution

5) Transfer of solved incident

6) Retest 7) Transfer test status 8) Project reporting

Support Expert Tester

Infos and demos available at http://service.sap.com/solutionmanager

Adapter

(28)

Test Management

SAP Test Acceleration and Optimization (SAP TAO)*

Goal

Accelerated composition of automated test cases for business processes with optimized maintenance for lower TCO

Scope

• Automatic generation of test components for SAPGUI- based SAP business processes

• Fast composition of automated test cases using standard functionality of SAP TAO and Quality Center.

• Optimized maintenance of automated test cases for lower TCO via component-based exchange of damaged test components after SAP updates

Benefits

• Accelerated approach to create test components for SAP business processes

• Optimized way to maintain test cases leading to lower TCO

• Integrated with Quality Center and SAP Solution Manager

(29)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples

3.1. Test Option 1 3.2. Test Option 2

4. Additional Test Management Capabilties 5. Summary and further Information

Agenda

(30)

Test Management

SAP Solution Manager – Work Center “Test Management”

Status Reporting

Workcenter: Role-specific entry point for all test related activities

Test Coordinator

Quality Expert

Tester

VP of QA

Infos and demos available at http://service.sap.com/solutionmanager

(31)

Test Management

SAP Loadrunner by HP*

Goal

Load testing for identification of performance bottlenecks

Scope

• Emulates production workload on SAP landscapes

• Replaces real users with thousands of “virtual” users

• Generates accurate, measurable and repeatable load on the system from a single point of control

• Pinpoints bottlenecks in the system

Benefits

• Lower migration risks, increase performance, accelerate deployment cycles and increase overall client satisfaction

• Obtain an accurate picture of end-to-end system

performance and optimize the scalability of applications

(32)

Test Management

SAP Test Data Migration Server (SAP TDMS)*

Goal

• Provide the right test data at the right time for the right people

• Build and refresh non production systems with a reduced set of data

• Transfer production data for specific test cases based on business objects

SAP TDMS

Scope

• Setup of lean test systems with a reduced set of data

• Selective refresh of individual clients in development, test and training environments

• Data extraction based on business objects, organizational units or time slices

• Scrambling of sensitive data

Benefits

• Current test data from production system

• Scrambling of sensitive data

• Reduce storage requirements of non production landscape

Production System

Non Production

System

(33)

Test Management

SAP Solution Manager – Root Cause Analysis

Goal

Validation of technical correctness and response time of business processes after significant software changes

Scope and Approach

1. Execute End-to-End trace

2. Analyze critical technical components

3. Determine distribution of response time / error messages / inconsistencies

4. Identify coding, expensive SQL statements, ..

5. Determine and document potential improvements

6. Optimization and Verification

0 500.000 1.000.000 1.500.000 2.000.000 2.500.000

0 10 20 30 40 50 60

Sales Order Items

Response time [ms]

VA01 (01.01.) VA01 (15.01.) VA01 (17.01.) VA01 (25.01.)

(34)

Test Management

SAP Solution Manager – Quality Gate Management

Goal

Better governance of change activities through Quality Gates

Synchronized transports of all changes from Development to Production systems

Scope

• Definition of quality gates and milesstones

• Calendar overview

• Quality Gates supervised by Quality Manager and Steering Board

• Central definition of transports with grouping of transports by change topics to ensure correct behaviour in target system

Benefits

• Improved governance of change activities

• Full transparency about changes in the system landscape

• Synchronized transports leading to better quality in test and

production system landscapes

(35)

1. Customer Pain Points and SAP Approach

2. Change Impact Analysis of SW Changes on critical Business Processes 3. Test Capabilities and Customer Examples

3.1. Test Option 1 3.2. Test Option 2

4. Test Services

5. Additional Test Management Capabilties 6. Summary and further Information

Agenda

(36)

E2E Integration Testing of SAP Solutions

Customer Benefits