Test Management with SAP Solution Manager 7.1. ALM Solution Management, AGS, SAP AG

(1)

ALM Solution Management, AGS, SAP AG

(2)

Agenda

1. Overview - Test Management with SAP Solution Manager 7.1

2. Change Impact Analysis

3. Test Option 1 – SAP Solution Manager and integrated partner tools

4. Test Option 2 – SAP Solution Manager, SAP QC and SAP TAO

5. Test Option 3 – SAP Solution Manager and IBM Rational

6. Where to find more information

(3)

Overview

(4)

Change

ALM - Build SAP like a Factory

Solution Ops - Run SAP like a Factory

Business Process Monitoring and Analytics

Monitoring of Systems, Technical Scenarios and End User Experience

Build Execution Test Execution Deployment execution Build Mgmt Test Mgmt Release & Deployment Design Mgmt

IT Service Management

_{IT Portfolio and}

Project Management

Project Project Portfolio

Minor

SAP Solution Manager Integration Model

Incident

Problem

Request for Change Service Request/ Catalogue Business Requirement * IT Requirement * Major

* _{Premium ALM Addon as part of MaxAttention Service}

Single Source of Truth

(5)

Business Transformation in Major Releases

Continuous Improvement in Minor Releases and Changes

Invest Return on Investment Business Transformation [Business Case/KPIs] Build [Major Release] Run and Measure Continuous Improvement [Minor Release, Change] Business Relationship Management

2 per Year

(biannual cycle)

12-52 per Year

(6)

Test Management

Test Management Process embedded in the SAP Application Lifecycle

 Business Blueprint Update

 Identification of Business Processes affected by SAP Solution Updates

 Recommendation of business processes for regression tests

 SAP Support Packages

 SAP Legal Change Packages  SAP Enhancement Packages  Customizing changes  Custom Code  Interface changes

 Development of Test Cases

 Test Plan setup

 Compilation of Test Packages

 Assigment of Testers

 Setup of Test System

 Creation of Test Data

Test Scope Identification

 Manual tests

 Automated tests

 Integration Validation

 Incident Management

 Performance tests

 Test status and progress reporting

 Test sign-off

 Deployment of changes through transports from Test to Production system  SAP Support packages, Legal Change Packages, Enhancement Packages Type of Change  Implementation of

new SAP Solution  Business Blueprint Design

 Solution Configuration Business Blueprint

Test Planning

Test System Setup Test Execution

Change Deployment

Change Impact Analysis SAP Solution

Update New SAP

(7)

Test Management

End-to-End Testing of SAP-centric Solutions

SAP Strategy for Test Management

 SAP Solution Manager acts as central hub to manage

SAP change events and E2E Integration Testing

 Superior functionality from risk-based test planning,

manual /automated functional and performance testing

to status reporting and sign-offs

 Integration of Partner Test Suites

Customer Pain Points

1. Tests in heterogeneous system landscapes

2. Software updates affecting mission-critical

business processes

3. Test system setup and test data management

4. Effort for creation and maintenance of automated

tests

1 2

3 4

Test Scope Identification Type of Change

Business Blueprint

Test Planning

Change Deployment Change Impact Analysis

SAP Solution Update New SAP

(8)

Test Option 1

Test Option 3

SAP Connector, Quality Manager, Requirements Composer, Team Concert, ...

BPCA

Test Planning

SAP Solution Update New SAP

Solution

SAP Test Management

Products and capabilities integrated with SAP Solution Manager 7.1

Test Workbench

Test Automation Framework

HP QTP

CBTA 3rd_Party

Quality Center Business Process Testing

HP QTP SAP TAO Test Automation Test Management Test Automation Test Management Test Option 2

(9)

(10)

Business Process Change Analyzer (BPCA)

Motivation and Approach

Change Impact Analysis Test Planning Test Execution

 Identification of business processes affected by change

 Risk-based Test Recommendation

 Test Case review and creation of missing test cases

 Test Plan generation

 Regression Tests  Manual Tests  Automated Tests

SAP Solution updates occur frequently



SAP triggered: Support Packages, Enhancement Packages



Customer triggered: Customizing changes, Custom code development

Approach

Pain Point

Motivation

Which critical business processes are affected by planned changes?

SAP Solution Update

(11)

Business Process Change Analyzer (BPCA)

Preparation

Manual execution of process step

BPCA Trace Result (TBOM)

 Transactions

 ABAP Code: Function modules, …  UI: Dynpro 1000, …

 Tables: Customizing, Master Data

Change Impact Analysis

“Which critical Business Processes will be affected by planned changes?”

BPCA use cases

1) Customizing changes 2) Custom code development 3) Business Function activation 4) SP and EhP deployment

Order to Cash

Sales Order  code change Delivery

Goods Issue  UI change Billing

Procure to Pay

Create PO  customizing change BPCA Change Impact Analysis

Risk-based Test Scope Identification

“Can I get a recommendation for regression tests?”

BPCA Test Scope Optimization and Test Plan Generation

 Identification risk-based test scope based on affected process steps

 Test Scope Optimization

 Semi-automatic test plan generation

Automated CBTA, SAP TAO, WS Certify, HP QTP, ...

(12)

Identify your test scope and significantly reduce your test effort for regression tests

with BPCA of SAP Solution Manager 7.1

Change Impact Analysis

Business Process Change Analyzer (BPCA)



Change impact analysis for business processes

resulting from software change events



Use cases

 Impact analysis for Customizing and Custom Code changes

 Impact analysis for planned Business Function (EhP) activation

 Impact analysis and test scope optimization for SP / EhP



Benefits:

(13)

BPCA - Test Scope Optimization for EhP deployment

SAP example setup

Business Blueprint



8 Business Processes covering Financials, Procurement, Sales, HR



46 Process Steps with multiple T-Codes per process step

Regression Tests



73 test cases assigned



Total test execution time: 132 hours

Business Process Process Step

Financials 23 manual tests

Procurement 1 E2E test - automated 9 manual tests

Sales 2 E2E tests - automated 25 manual, 3 automated tests

Human Resources 1 E2E test - automated 8 manual tests

Change event: SAP Enhancement Package (EhP) deployment

(14)

BPCA - Test Scope Optimization for EHP Deployment

SAP Solution Manager 7.1 SP05 – Example results

# of tests Test effort Gain

Test Scope without BPCA 73 tests 132 hours n.a. Test Scope with BPCA – Test Scope Optimization – 100% test coverage 44 tests 76 hours 42 % Test Scope with BPCA – Test Scope Optimization – 99% test coverage 32 tests 52 hours 61 %

BPCA – optimization settings

1. Use of Test Scope Optimization 2. 99% test coverage

3. Process Steps with BP attribute Prio = 1 forced into test scope 4. Higher ranking for process

steps with automated tests 5. Use only automated tests if

manual and automated are available

must include area

(15)

BPCA - Test Scope Optimization for EHP Deployment

(16)

BPCA - TBOM Generation Alternatives

Static

TBOM generation approach

 Positive: background job to generate all TBOMs without manual effort

 Disadvantage: less precision compared to dynamic or semi-dynamic TBOMs

Dynamic

TBOM generation approach

1. Manual execution of business transaction by user with TBOM generation in the background

2. Initial: Work-Item for Business User in PRD system

Update: Manual Testers in TST system (Nestle solution)

3. Automatic generation via automated tests (CBTA, eCATT, SAP TAO, HP QTP, WorkSoft Certify, …)

Semi-dynamic

TBOM generation approach (SAP Solution Manager 7.1 SP10)

BPCA

TBOM

Background

Job

UPL Filter

for BPCA TBOM

generation

UPL Data in PRD

system

(Usage and Procedure Logging of ABAP objects at Kernel level)

Semi-dynamic TBOM



No manual effort through background processing



High precision

(17)

BPCA – Quality Center integration

Business Process Change Analyzer

_{SAP Quality Center by HP}

 Impact analysis of software changes  Test scope optimization

 Trigger test plan generation

 Trigger change impact analysis

 Find test cases based on impacted processes

 Generate QC test sets based on optimized test scope

 Availability of SAP part of the integration: available with SAP Solution Manager 7.1 SP05

 Availability of HP part of the integration: available with HP EI 2.7 for SAP Quality Center by HP Release 11.0 since October 2013

 Prerequisite: SAP Solution Manager Adapter for QC

Seamless integration of impact analysis in SAP Solution Manager with Test Planning in

SAP Quality Center by HP

(18)

Test Option 1

(19)

Test Management

Capabilities of test option 1 with SAP Solution Manager 7.1 SP07

Business Process Change Analyzer

(BPCA)

WoC Test Management • Manual Tests

• Automated Tests

SAP TDMS

Test Planning

eCATT

WoC Test Managment Test Workbench

BW Reporting Partner Logs and Reports

Test Status Reporting

Test script creation Test system assignment Test data assignment

Test Automation Framework

Test Case Assignment

other 3rd party test automation tools

Test Scope Optimization

Test Execution

HP QTP SAP Solution Manager 7.1

Lean test system setup

CBTA (Component based Test Automation) Business Blueprint

Test Planning

Test System Setup Test Execution and Reporting

WS Certify WoC Test Management

• Test Plan generation • Tester assignment

(20)

Test Option 1

Manual Testing

(21)

Manual Test Execution

with SAP Solution Manager 7.0

Tester Worklist

Test Script Start of Business Transaction Test Status and Test result documentation Incident

(22)

Manual Test Execution with SAP Solution Manager 7.1

Convinient access for manual Testers

1

2

3

Tester Worklist

1) Easy access for

manual testers from

Work Center Test

Management

2) Test Packages

assigned to Tester

including status

3) Test Cases of selected

Test Package

- Start of execution

- Test status

- Test Notes

- Incidents

1 2 3

(23)

Manual Test Execution with SAP Solution Manager 7.1

Convinient test case execution for manual Testers

Manual Test Case

1) Test script is displayed

to Tester

2) Start Execution 

direct launch of SAP

transaction in assigned

test system

3) Tester enters Test

Status

4) Test Note: Tester

enters actual test

results / screenshots

5) Messages: direct

creation of incidents

1 2 3 1 2 3 4 5 4 5

(24)

Test Option 1

(25)

Manual Testing

Disadvantages of manual testing compared to automated testing

 Lack of time to execute regression tests may potentially compromise Performance & Reliability

 Overcompensating scope of testing may result in more testing than may be really required and project delays

Test coverage within tight timelines

 Insufficient test coverage leads to a higher amount of defects not found before cut-over of changes from test to production landscape

 Testing accuracy due to not being able to test all variants

Defects in

Production Systems

 High costs for manual testers involved in recurring regression tests

 High costs to fix errors in production landscape

 Finding errors late in the development process could delay delivery

Costs

 Complexity increasing with added business processes and modules implemented

 Manual testing cannot keep pace with expansion of applications

(26)

Test Automation Framework in SAP Solution Manager 7.1

Test Design

 Seamless integration between SAP Solution Manager and test tools from SAP and Partners  Test Data Container

(TDC) provide test data for test script parameters  Central management of

System under Tests

Test Automation Framework

Test Execution

 Start of automated tests from Workcenter Test Management

 Ad-hoc start or scheduler for unattended execution  Integrated test execution

logs from partner tools

Test Result Analysis

 Test Manager can view test results from manual and automated tests in one environment

 Status and progress resports

 Integrated partner reports

Accelerated Repair

 Workflow between Tester and Test Engineer to trigger test case repair  Rich environment for Test

Engineer to analyze problems and perform repair activities

(27)

Test Automation Framework in SAP Solution Manager 7.1

Automated tests assigned to process steps in Business Blueprint

Test Script Business Process

HP QTP

System under Test Test Data

Test Configuration

other ISV test automation tools

Order Type Customer Product

OR C1000 P-100 OR C2000 P-200

Test Data Container

SAP customers have a choice of test automation tools integrated with SAP Solution

Manager 7.1 through the Test Automation Framework

CBTA, eCATT

 Component Based Test Automation (CBTA) is shipped with SAP Solution Manager 7.1 SP07

 Customers with SAP Enterprise Support contract can download 2 HP QTP licenses from SMP (https:/service.sap.com/testing)

(28)

Test Automation Framework in SAP Solution Manager 7.1

Steps to create automated test script using HP QTP

HP QTP

3

4 Convenient test script creation through seamless integration between SAP Solution

Manager and partner test automation tools

1

2

Non SAP

Test System

Test Script with Parameters stored in SAP Solution Manager

Automatic parameter creation for input fields of the business transaction

Test script recording during business process execution Start of HP QTP recorder

Test Configuration

Test Script Test Data System Data

SAP Solution Manager

(29)

Test Automation Framework in SAP Solution Manager 7.1

Test data planning

2 1 Test Data Container (TDC): Data Structure

Test Data Container(s) act as central repository for your test data.

Customer benefit: test data changes can be done in one central location leading to a

significant lower maintenance effort and faster availability of test data

 How: create TDC parameter for all input fields of

your business process used in test script

 Who: Test Engineer

TDC: test data planning

test data entry

test data upload

 Who: Business Analysts

 Use: Test data stored in a TDC can be consumed

(30)

Test Automation Framework in SAP Solution Manager 7.1

Test data assignment to automated tests

Test Data Assignment Wizard



Step-by-step guidance to find and assign test data

for automated regression tests



Features

 Comprehensive search functions to find suitable Test Data Container by multiple dimensions

 System-supported parameter mapping between TDC and Test Configuration

 Test data selection from TDC for use in Test Configuration



Availability: SAP Solution Manager 7.1 SP07

Business Analysts and Test Engineers have got a convenient way to assign test data to

automated regression tests

(31)

Test Configuration

Test Script

HP QTP

System under Test

Test Data Container (TDC)

Logon and automated

business process execuction

Test data selection

TDC

Test execution: handover of

Test Script + Test Data + SUT info User starts test execution

Test Automation Framework in SAP Solution Manager 7.1

Test execution

Non SAP

Tester Worklist

in Workcenter Test Management

Test results and logs

3

4

1

2

(32)

Test Automation Framework

Scheduling of unattended automated tests

Scheduling

Unattended Test Execution

Analysis

Test System Landscape (SAP ERP, SAP CRM, …)

Scheduling of unattended automated tests in local or

remote locations

Test Engineer - Location 1

Test PCs - Location 2 _{Test result analysis}

Unattended execution of automated test on Test PCs

Notification about test execution status and subsequent failure

analysis

(33)

Test Automation Framework of SAP Solution Manager 7.1

Workflow and environment for accelerated repair of damaged tests

Tester

Test Engineer

1. Requests repair activity after failed test case execution

5. Performs retests

6. Confirms successful repair

Test Case Error Message

2. Receives message in Damaged Test Case Worklist 3. Analyses and repairs the test case

Central environment for analysis and repair

4. Requests retest Retest Notification Run test case Edit test script Run change analysis View logs … Complete information about executioncontext

(34)

SAP Solution Manager 7.1 SP07 introduces CBTA as new test automation tool which provides

a convenient way to build component-based test scripts for SAPGUI and SAP CRM web-client

Approaches for test automation

Disadvantages



No re-use



Expert knowledge required during

repair activities

Test Script approach: Record and Playback

Test Script approach: modular test scripts

Advantages



Draft test script creation by Business Analysts



Re-use of test components



Fast repair of damaged test scripts

Component-based Test Automation (CBTA)

Test Composition Environment (TCE)

(35)

CBTA enables your Business Analysts to build component-based test scripts which

are highly flexible and easy to maintain

Test Automation with CBTA included in SAP Solution Manager 7.1

Component-based Test Automation (CBTA)

Functionality

 CBTA Test Creation Wizard for test script creation by Business Analysts

 CBTA test scripts are composed by reusing SAP delivered default components and customer specific screen components

 Fast repair of damaged test scripts

 Supported UI technologies: SAPGUI, SAP CRM web-client. SP10: WD-ABAP, WD-Java, and more

Availability

 Availability: with SAP Solution Manager 7.1 SP07

 License: included in SAP Enterprise Support contract

Business Analyst

Quotation Sales Order Delivery

CBTA – Test Creation Wizard

CBTA – process flow analysis

CBTA – Test Components and Test Script

Business Process

(36)

Component-based Test Automation (CBTA)

Test Automation of E2E Business Processes using SAP Solution Manager - CBTA

Component-based Test Automation (CBTA)

Business Analyst executes business transaction via CBTA

Test Composition Environment (TCE)

Business Process “Order to Cash”

Quotation Sales Order Delivery Goods Issue Billing

CBTA creates test script based on test components during execution

Attributes • Business Transaction _{• Systems under Test}

Parameters • Parameters for test data inputs _{• Dynamic handover between scripts}

Script Components

• SAP delivered test components • On the fly generated components

(37)

TCE enables your Business Analysts and Test Engineers to create and maintain your

automated regression tests in a convenient way

Creation and Maintenance of automated tests with SAP Solution

Manager 7.1

Test Composition Environment (TCE)



TCE provides all functions to create and maintain

CBTA test scripts and Test Configurations



Features

 Attributes for Test Configuration and Test Scripts

 Maintenance and composition of CBTA test scripts

 Parameter handling

 Composition of E2E process tests including parameter handover

 Test data assignment



Availability: with SAP Solution Manager 7.1 SP07

(38)

CBTA – flow to create new automated test

Business Process Test Composition Environment (TCE)

create new Test Configuration

Component Based Test Automation (CBTA)

CBTA – Test Creation Wizard CBTA – process flow analysis

CBTA – Test Components / Test Script

Quotation Sales Order Delivery

Test Composition Environment (TCE)

finalize Test Configuration

Test Data Container

Test Data Assignment Wizard

assign test data Store Test Configuration

at process step or business process

(39)

Test Configuration

Test Script

SAP CBTA, HP QTP, …

System under Test

Test Data Container (TDC)

Logon and automated

business process execuction

Test data selection

TDC

Test execution:

handover of Test Script + Test Data + SUT info User starts

test execution

Test Automation Framework in SAP Solution Manager 7.1

Test execution

Tester Worklist

in Workcenter Test Management

Test results and logs

1

2

3

5

(40)

Composition of E2E business process tests

Automated E2E business process tests



Ability to compose E2E tests using Test

Composition Environment (TCE) of SAP Solution

Manager



… in combination with test automation tools

integrated via Test Automation Framework



TCE: html-based maintenance application for

automated tests



Test automation tools: CBTA, eCATT, HP QTP,

WS Certify, …

Sales

Order Delivery Billing Goods Issue Example 1 Example 2 Example 3 HP QTP 1 HP QTP 2 HP QTP 3 HP QTP 4

Parameter handover is managed by TCE

HP QTP 1 CBTA 2 CBTA 3 eCATT 4 CBTA 1 CBTA 2 CBTA 3 CBTA 4

(41)

More Information for SAP Customers and Partners

1. How To Guide „Test Automation Framework“

2. How To Guide „HP QTP“

3. Best Practice „Regression Testing of

SAP-centric Business Processes“

4. Detailled Presentation

5. Offline Demos

6. Download and Activation Key for HP QTP

Available via SAP Service Marketplace

(42)

Test Option 1

(43)

Test Reporting with SAP Solution Manager 7.1

Types of Test Reporting

Sign-Off Test Plans Sign-Off Test Scope Sign-Off Test Execution Gap Reports

 List gaps in test scope, e.g.Business Blueprint without test cases

 Available test cases not included in test plan or test packages  Inconsistent test plans Business Blueprint Test Planning

SAP Solution Update New SAP Solution Test Planning  Check for outdated test plans  Expected test effort  Test plan coverage  … Test Execution  Test status reporting  Test progress reporting  Detected incidents and resolution status  … Test Results  Test completion status  Open / closed messages by priority  Incident resolution status  …

(44)

Test Reporting with SAP Solution Manager 7.1

Gap, Status and Progress Analysis

Test Status Reports _{Trend and Progress Reports} Test Tool Logs

Gap Analysis _{Quick Status Overview}

Test Result Report

Key benefit for Colgate: Leveraging SAP Solution Manager for all status

and results reporting, limiting investment in 3rd party tools

(45)

BENEFIT

Supports project leads and test coordinators in identifying potential delays or resource bottle necks, and analyzing message-related data.

GOAL

Obtain a graphical representation of the day-to-day evolution of test status, test progress, test effort, and related messages.

Example: Progress of Test Status and Effort

SCOPE

 Status Report

Monitoring of the status of test cases at a certain point in time.

 Progress Report

Visualization of the progress of the test case status over a certain period.

 Messages Report

Overview of the number and status of messages at a certain point in time.

 Test Effort Report

Analysis of the ratio between planned effort, actual effort, and expected total effort.

Test Reporting

(46)

Test Result Reports

Documentation of Test Coverage and Results

GOAL

Meet legal requirement regarding Test Documentation after test completion

SCOPE

Provide all test related information in one document:

 Project / Solution

 Test Plan – Person Responsible / Overall Results Status  Test Plan

 Related Messages

 System(s) under Test including full release information

 Involved Processes

 Keywords

 Tester assignment

 Test Case Description incl. attributes

 Status history per Test Case

 …

BENEFIT

(47)

Test Option 2

SAP Solution Manager, SAP Quality Center and SAP

TAO

(48)

Test Management

Products and capabilities of Test Option 2 with SAP Solution Manager 7.1

Quality Center

• Requirement

• Test Plan

• Business Process Tests

SAP TDMS

Test Option 2

Test Planning Test System Setup

Test Execution Reporting

Solution Manager Business Blueprint • Process documentation • Business requirements Solution Manager BPCA

• Change Impact Analysis • Test Scope Optimization

Adapter Quality Center • Test Lab • Sprinter • QTP • Defect •Blueprint

•Defects / test results

SAP TAO

• Optimized SAP test scripts

• Accelerated maintenance

• Load and

performance testing

LoadRunner

(49)

SAP Solution Manager

Adapter

_{SAP Quality Center by HP}

Outbound



Business Blueprint



Bus. Requirements



Test Objects



Documents



Incidents/Defects

Inbound



Test Results



Incidents / Defects

SAP Solution Manager Adapter for SAP Quality Center by HP

Exchange of business processes, business requirements, test assets, incidents and test results

between SAP Solution Manager and Quality Center

(50)

SAP Quality Center by HP

Design Time: Activities to create Test Requirements and manual Test Scripts

Select Business Blueprint

Create Test Requirements

Assign to

Create Test Scripts

Define Test Set

Consists of 3 1 2 4 5 SAP Solution Manager

SAP SolMan Adapter for QC

Transfer

SAP Quality Center by HP SAP Quality Center by HP

SAP Quality Center by HP

Assign to Tester

(51)

SAP Quality Center by HP

Run Time: Test execution of manual tests

Test Coordinator Tester

Open Test Set

Create Defect

Read Test Script

Execute test

Enter test results

1 _Email notification 2 3 4 6 5

Test System SAP SolMan – Service Desk

Configurator / Developer Auto-create Incident 7 Solve Incident 8

(52)

New Approach for manual Testing: HP Sprinter



Floating windows with test step

guidance for Tester



Smart Defects



Recording of User Actions (list) and

Story Board (screenshots)



Full integration with Quality Center for

Test Script selection and results



Data injection –

(53)

BPCA – Quality Center integration

_{SAP Quality Center by HP}

 Trigger test plan generation

 Trigger change impact analysis

 Generate QC test sets based on optimized test scope

 Availability of SAP part of the integration: available with SAP Solution Manager 7.1 SP05

 Availability of HP part of the integration: available with HP EI 2.7 for SAP Quality Center by HP Release 11.0 since October 2013

 Prerequisite: SAP Solution Manager Adapter for QC

Seamless integration of impact analysis in SAP Solution Manager with Test Planning in

SAP Quality Center by HP

(54)

Test Option 2

(55)

SAP TAO – at a Glance

Customer SAP Landscape

Integration



Automated Test Cases are composed out of test components (not single command lines) – to

accelerate the repair of damage test scripts after SAP Solution changes.



Test Components with parameters for input fields generated automatically by SAP TAO



Test Data: First iteration is automatically created and linked to input parameters

Approach

SAP Solution Manager

SAP TAO

Application Lifecycle Management

Automatic test script & test component generation

Test Management: planning, test case composition and test execution SAP Quality Center + HP QTP



Changing the testing paradigm from manual testing to “Testing by Composition”



Reducing costs and risks for testing after SAP solution updates

Mission

(56)

SAP TAO

Test Automation of Business Processes using SAP TAO

SAP TAO Process Flow Analyzer

Business Analyst executes

business transaction from SAP TAO

Test Case* composed out of

Test Components with

parameters for all input fields

Test Components for each

SAPGUI subscreen with parameters for all fields

File with Test Data for each input parameter

SAP Quality Center by HP

upload

Business Scenario “Order to Cash”

Quotation Sales Order Delivery Goods Issue Billing

(*) Note: Further test case refinement might be needed e.g. Test engineer may add more validation steps and consolidate the test case for performance improvement.

(57)

SAP TAO

Test Automation of E2E Business Processes

Variant 1

Quotation _{Sales Order V1}

C1 C2 C3

SAP TAO Test Components

Test data

Delivery Goods Issue Billing

Variant 2

C1 C2 C3

C4

Test data

SAP TAO test scripts



Test script variants can be built easily via additional Test Components, Flows and Test Data

(58)

SAP TAO

Test Execution with SAP TAO built test scripts

SAP Quality Center by HP

SAP Test System

During test execution test data

is entered into input fields of

the SAP business process

Test Script execution

Test data file

Iteration Result

# 1 Passed

# 2 Passed

# 3 Failed

(59)

SAP TAO

Options to execute SAP TAO based test scripts

Test script creation from SAP TAO

Test script execution from SAP Quality Center

Test script execution from SAP TAO

Normal execution for

regression testing

Test script execution

creates TBOM for BPCA in

SAP Solution Manager

(60)

SAP TAO

Test case executions of business process variants using Iterations

Goal: Run test cases multiple times with variants of data.

Additional data records

entered by user

SAP TAO automatically

update iterations in QC

Test scripts run multiple times

Iteration Result

#1 Passed

#2 Passed

#3 Failed

Generation of test scripts and test

data files using SAP TAO PFA

1

3 2

4

Business Analyst executes the transaction from SAP TAO

PFA generated test data file with one record

(61)

SAP TAO

Test Execution Logs and Reports

Reporting



Reports in Quality Center, e.g.

Coverage analysis



Test Status and Defects can be

transferred to SAP Solution Manager

via SAP QC Adapter to give a

consolidated view to a Project

Manager.

Test Execution Logs



HP QTP Logs



SAP TAO Logs: Information on input

parameters, screenshots, error

messages, etc.

SAP TAO Logs

HP QTP Logs

(62)

SAP TAO Test Automation of E2E Business Processes

Variant 1

C1 C2 C3

SAP TAO Test Components

Test data

Variant 2

C1 C2 C3

C4

Test data

Typical

software changes

affecting automated tests

1. Customizing changes for process step (optional field mandatory field, ...)

2. Custom Code changes for process step (additional mandatory fields, additional screens, ...)

Customer benefit: SAP TAO provides accelerated repair functionality through rapid and semi-automated exchange of central test components

Test execution fails

X

(63)

SAP TAO Change Management

Test Case Repair

Change Type 1: Customizing Change

Example: Create Sales Order transaction - PO Number input field is made mandatory

Identify impacted test scripts

Inspect screen, add screen components and/or provide parameter values

Execute the repaired test scripts Re-consolidate repaired test scripts

Identification

Validation

SAP TAO Change Analyzer

Repair

(64)

SAP TAO Change Management

Test Case Repair

Change Type 2: Custom Code Change

Example: Custom Create Sales Order transaction - New input field is introduced

Identify impacted test scripts

Inspect screen components and/or provide suitable parameter values

Execute the repaired test scripts Re-consolidate repaired test scripts

Identification

Validation

SAP TAO Change Analyzer

Repair

(65)

Functionality of SAP TAO 3.0 SP02

 Test Automation: SAP GUI, SAP CRM Web Client, ABAP Web Dynpro, Java Web Dynpro, SAP NetWeaver Portal & SAP GUI for HTML.

 Inspection: Supported for SAP GUI, SAP CRM and ABAP Web Dynpro screens (native)

 Consolidation: for all supported UI technologies

 TBOM creation: Supported for SAP GUI, SAP GUI for HTML, SAP CRM WebClient and ABAP Web Dynpro

 Enhanced and updated default component library

 Miscellaneous: Generates output parameters, supports HP ALM 11.5 & improved PFA controller

Availability

 SAP TAO 3.0 SP02: GA in Nov 2013

 Note: SAP TAO 2.0 standard maintenance ends in Dec 2013

SAP TAO 3.0 SP02 enables Business Analysts and Test Engineers to create and

maintain automated tests for SAP GUI and many web based UI technologies.

(66)

Add executable

SAP TAO 3.0 SP02

Automated test case creation for ABAP Web Dynpro applications

Adjust/Validate the test

Test script in SAP Quality Center

SAP TAO enables automation of

ABAP Web Dynpro*

by creating tests which are made of

parameterized screen components and has default value.

Process Flow Analysis

 Connect to system under test with ABAP Web

Dynpro applications

 Add ABAP Web Dynpro executable to SAP TAO

 Record ABAP Web Dynpro transactions by executing it

 Insert validation steps while recording

 Upload PFA to

create a test in SAP QC by HP

 Screen components are created

 Data file is created

 Fine tune the scripts created by SAP TAO

 Execute the scripts to validate it

(67)

SAP TAO 3.0 SP02

Automation of Shopping Cart Creation test (SAP SRM)

Connect to SUT with ABAP backend

1 Add ABAP URL or select

ABAP application

2 Start Process Flow Analysis

for the executable

3 Execute the application as

business user 4

Upload the Process Flow Analysis in SAP Quality Center by HP to create a test 5

Execute the test from SAP Quality Center by HP 6

(68)

Test Option 3

(69)

Test Management

Products and capabilities of Test Option 3 with SAP Solution Manager 7.1

Rational Quality Manager

• Test Requirements

• Test Plan

Test Option 3

Test Planning Test System Setup

Test Execution Reporting

Solution Manager Business Blueprint • Process documentation • Business requirements Solution Manager BPCA

• Change Impact Analysis • Test Scope Optimization

SAP Connector*

• Blueprint

• Defects / test results

• Impact Analysis

Rational Requirements Composer

• Business Requirements

Rational Quality Manager

• Lab Management

• Defect Tracking

Rational Team Concert

• Defect Management

Test Automation

SAP TDMS

• Setup of lean test systems

(70)

BPCA – IBM Rational integration

Rational Quality Manager

 Send test case information for test scope optimization  Generate test plan based on optimized test scope

Seamless integration of impact analysis in SAP Solution Manager with Test Planning in

IBM Rational Quality Manager

 Availability of SAP part of the integration: Available with SAP Solution Manager 7.1 SP05

 Availability of IBM part of the integration : Available with IBM Rational Connector for SAP 4.0 since June 2012

(71)

Roadmap

(72)

Customer requirements for improved planning of EHP projects

1. Transparency about change impact of EHP

deployments before physical installation

2. Reliable effort estimation for major development

adjustments and test activities

3. Tailored impact analysis for custom code and

modifications

4. Test scope optimization with significant reduced

test scope and test effort

5. Test plan for impacted business processes

including custom code and modifications

6. Simple guided tool based procedure without

(73)

SAP Solution Manager - Scope and Effort Analyzer

Approach

Customer

SAP

Solution Manager

 User enters system for planned EHP deployment

 User enters target SP / EHP

 Information send to SAP

SAP OSS

 Calculation of SAP objects (BOM) for target

Enhancement Package

 SAP sends BOM back to SAP Solution Manager

1 ₂

Customer

Project Team

 Result review

through Fact Sheet

 Assessment of analysis details  Parameter variation for result optimization 4 SAP

Solution Manager

 Usage statistics

 Taylored impact analysis for custom code / modifications

 Effort calculation

 Business Blueprint generation

 Test Scope and Effort Optimization



(74)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(75)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(76)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(77)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(78)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(79)

Scope and Effort Analyzer – Analysis Results

Lab Preview

(80)

SAP Solution Manager – Scope and Effort Analyzer

Customer benefits

 Change impact analysis without physical EHP deployment

 Simple Guided procedure in local SAP Solution Manager

 No external transfer of customer code to protect Intellectual Property

Hassle-free

analysis

Custom code

&

modifications

Test

Management

 Tailored impact analysis for custom code and modifications

 Early estimation of project effort and required adjustment activities

 Overview on used and unused code based on reliable usage statistics

 Automatic generation of preliminary business blueprint (if required)

 Test Scope Optimization with significant reduced test scope and test effort

 Additional test plan for business processes including custom code & modifications

(81)

(82)

SAP Enterprise Support

Test Management – Information Sources

Infos, Presentations, Demos

http://service.sap.com/testing

ALM Infos, Presentations, Demos

http://service.sap.com/alm

SAP AGS Whitepapers and Best Practices

 SAP Service Marketplace (SMP)  SAP Collaboration Network (SCN)  SAPexperts SAP Solution Manager