ALM Solution Management, AGS, SAP AG
September 2012
Test Automation with
© 2012 SAP AG. All rights reserved. 3
Change is critical to Business Innovation…
… and impacts your SAP-centric Solution
…these change events impact the life cycle of enterprise solutions
Ef fort Ongoing Change Events Time Discrete Change Events
Business Drivers
Compliance Drivers
Technology Drivers
Changed business
processes
M & A and reorganizations
New products, vendors
Governance
Risk management
Compliance
© 2012 SAP AG. All rights reserved. 4
Customer Pain Points
Type of Software Change
1
2
3
4
Maintenance Stream
DEV
TST
PRD
Innovation / Release Stream
DEV
TST
PRD
Customer pain points related to regression tests after software changes
Identification of Test Scope after software changes
Business Process Experts not available for recurring manual tests
© 2012 SAP AG. All rights reserved. 5
Manual Testing
Disadvantages of manual testing compared to automated testing
Lack of time to execute regression tests may potentially compromise Performance & Reliability
Overcompensating scope of testing may result in more testing than may be really required and
project delays
Test coverage
within tight
timelines
Insufficient test coverage leads to a higher amount of defects not found before cut-over of
changes from test to production landscape
Testing accuracy due to not being able to test all variants
Defects in
Production Systems
High costs for manual testers involved in recurring regression tests
High costs to fix errors in production landscape
Finding errors late in the development process could delay delivery
Costs
Complexity increasing with added business processes and modules implemented
Manual testing cannot keep pace with expansion of applications
© 2012 SAP AG. All rights reserved. 7
New SAP Offering for Test Automation
Offering
What‘s new?
SAP Solution Manager 7.1
Test Automation Framework
to manage and integrate automated test scripts like HP QTP, test
data, system under test, etc.
HP Quick Test Professional 11
HP QTP
with extended functionality for test data and test system handling for
automated tests of SAP and non-SAP applications
2 Licenses of HP QTP
2 licenses of HP QTP
for all SAP customers with SAP Enterprise
Support, PSLE or Max Attention contract
Access: https:/service.sap.com/testing
New license check starting September 2012 see SAP Note 1745282
© 2012 SAP AG. All rights reserved. 8
UI Technologies used in SAP-centric Business Processes
HP QTP supports the following Business Scenarios / UI technologies*:
Goal
Provide test automation for all typical business processes used by SAP customers including SAP
and non-SAP applications.
(*) see HP website for a comlete list of supported UI technologies
SAP vs. non-SAP Business Process
Example UI Technologies
100 % SAP
SAP CRM , SAP ERP, SAP Portal
SAPGui, Web-Dynpro ABAP, BSP, ...
SAP-centric
SAP CRM, SAP ERP + partner product for price
determination
SAPGui, Web-Dynpro ABAP, BSP, html, .Net,
JavaScript, ...
Non-SAP
Partner application or non-SAP application for HR
© 2012 SAP AG. All rights reserved. 10
Test Management
Capabilities of test option 1 with SAP Solution Manager 7.1 SP07
Business Blueprint
Business Process
Change Analyzer
(BPCA)
WoC Test Management
• Manual Tests
• Automated Tests
SAP TDMS
Test PlanningeCATT
WoC Test Managment
Test Workbench
BW Reporting
Partner Logs and Reports
* planned capability START (SAP Standard Regression Tests) Test Status Reporting
Test script creation
Test system assignment
Test data assignment
Test Automation Framework
Test Case Assignment
other 3rd party test automation tools
Test Scope Optimization
Test Execution
HP QTP
SAP Solution Manager 7.1
Test Data Provisioning
CBTA ( Component based Test Automation )
Business Blueprint
Test Planning
Test System Setup
Test Execution and Reporting
Change
Deployment
Change Impact Analysis
START*
WoC Test Management
• Test Plan generation
• Tester assignment
© 2012 SAP AG. All rights reserved. 11
Test Automation Framework in SAP Solution Manager 7.1
Test Design
Seamless integration
between SAP Solution
Manager and test tools
from SAP and Partners
Test Data Container
(TDC) provide test data
for test script parameters
Central management of
System under Tests
Test Automation Framework
Test Execution
Start of automated tests
from Workcenter Test
Management
Ad-hoc start or scheduler
for unattended execution
Integrated test execution
logs from partner tools
Test Result Analysis
Test Manager can view
test results from manual
and automated tests in
one environment
Status and progress
resports
Integrated partner reports
Accelerated Repair
Workflow between Tester
and Test Engineer to
trigger test case repair
Rich environment for Test
Engineer to analyze
problems and perform
repair activities
© 2012 SAP AG. All rights reserved. 12
Test Automation Framework in SAP Solution Manager 7.1
Automated tests assigned to process steps in Business Blueprint
Test Script
Business Process
…
HP QTP
System under Test
Test Data
Test Configuration
other ISV test
automation tools
Order Type Customer Product
OR C1000 P-100 OR C2000 P-200
Test Data Container
SAP customers have a choice of test automation tools integrated with SAP Solution
Manager 7.1 through the Test Automation Framework
CBTA, eCATT
Component Based Test Automation (CBTA) is shipped with SAP Solution Manager 7.1 SP07
© 2012 SAP AG. All rights reserved. 13
Test Automation Framework in SAP Solution Manager 7.1
Steps to create automated test script using HP QTP
HP QTP
3
4
Convenient test script creation through seamless integration between SAP Solution
Manager and partner test automation tools
1
2
Non SAP
Test System
Test Script with Parameters
stored in SAP Solution Manager
Automatic parameter creation for input
fields of the business transaction
Test script recording
during business
process execution
Start of HP QTP recorder
Test Configuration
Test Script
Test Data
System Data
© 2012 SAP AG. All rights reserved. 14
Test Configuration
Test Script
HP QTP
System under Test
Test Data Container (TDC)
Logon and automated
business process execuction
Test data selection
TDC
Test execution: handover of
Test Script + Test Data + SUT info
User starts test execution
Test Automation Framework in SAP Solution Manager 7.1
Test execution
Test Script
Test Data
System Data
Non SAP
Tester Worklist
in Workcenter Test Management
Test results and logs
3
4
1
2
© 2012 SAP AG. All rights reserved. 15
Test Automation Framework in SAP Solution Manager 7.1
Test data planning
2
1 Test Data Container (TDC): Data Structure
Test Data Container(s) act as central repository for your test data.
Customer benefit
: test data changes can be done in one central location leading to a
significant lower maintenance effort and faster availability of test data
How
: create TDC parameter for all input fields of
your business process used in test script
Who
: Test Engineer
TDC: test data planning
test data entry
test data upload
Who
: Business Analysts
Use
: Test data stored in a TDC can be consumed
© 2012 SAP AG. All rights reserved. 16
Test Automation Framework in SAP Solution Manager 7.1
Test data assignment to automated tests
Test Data Assignment Wizard
Step-by-step guidance to find and assign test data
for automated regression tests
Features
Comprehensive search functions to find suitable Test Data
Container by multiple dimensions
System-supported parameter mapping between TDC and
Test Configuration
Test data selection from TDC for use in Test Configuration
Availability: SAP Solution Manager 7.1 SP07
© 2012 SAP AG. All rights reserved. 17
Test Automation Framework
Customer Benefits
Test Coverage
More business processes can be tested in a testing cycle
Defects are caught earlier in test system before they move
to production system
Flexibility
Customers can jump-start their test automation project with
2 licenses of HP QTP
All major vendors providing test automation tools are
integrated via certifiable SAP interfaces
Costs
Save cost by engaging less manual testers
Fast Return on Investments
Accelerated Approach
Workflow and analysis functions speed of the identification
and repair of damaged test case
© 2012 SAP AG. All rights reserved. 19
SAP Service Marketplace
Place to find Information about Test Management and the HP QTP offering
Access:
https:/service.sap.com/testing (page 1)
Please follow the link to
find out more about the
© 2012 SAP AG. All rights reserved. 20
SAP Service Marketplace
Place to find Information about Test Management and the HP QTP offering
Please follow the link to
find out whether your
company is entitled
Access:
https:/service.sap.com/testing
© 2012 SAP AG. All rights reserved. 21
SAP Service Marketplace
Place to find Information about Test Management and the HP QTP offering
Access:
https:/service.sap.com/testing
Please select your country, download and
sign the contract and send back to your
© 2012 SAP AG. All rights reserved. 22
SAP Service Marketplace
Place to find Information about Test Management and the HP QTP offering
Access:
https:/service.sap.com/testing
Please setup the license
check for your 2 users
which is valid from
September 2012 as
described in SAP Note
1745282
Page 3 – bottom part
HP QTP is available for
download after your
© 2012 SAP AG. All rights reserved. 24
License Check – one-time Preparation
SAP SolMan 7.1
One-time Preparation
• SAP Solution Manager 7.1 SP06: no SAP Note required, but IMG activities
(description see SAP Note 1745282)
• SAP Solution Manager 7.1 SP01-SP05: install SAP Note 1751112
• Customizing (SPRO): register 1-2 Client (Windows) user ID as described in
the IMG activity and update the required authorizations
Client-PC
• User 1+2 install HP QTP 11 plus 4 patches on their client PC plus new patch
SAPQTP_00049 for the new license check
• Alternatively the customer can install HP QTP 11 in a virtualization
environment such as Citrix
© 2012 SAP AG. All rights reserved. 26
Test Management
Overview and Detail Presentations and Offline Demos
SAP Service Marketplace
:
http://service.sap.com/testing
Information
Overview Presentations
Detail Presentations
Offline Demos
© 2012 SAP AG. All rights reserved. 27
More Information for SAP Customers and Partners
1. How To Guide „Test Automation Framework“
2. How To Guide „HP QTP“
3. Best Practice „Regression Testing of
SAP-centric Business Processes“
4. Detailled Presentation
5. Offline Demos
6. Download and Activation Key for HP QTP
Available via SAP Service Marketplace
© 2012 SAP AG. All rights reserved. 28
Best Practices / Next Practice:
Regression Testing of SAP-centric Business Processes
Leverage the experience of other SAP customers and find
out what works best for them.
Content
Regresstion tests as integral part of the software change process
9 Recommendations for regression testing
Customer use cases from Colgate-Palmolive, Ferrero, Sara Lee,
ConAgra Foods, Soka-Bau
Best Practice available at
SDN:
http://www.sdn.sap.com/irj/sdn/alm-test-management
© 2012 SAP AG. All rights reserved. 29
Best Practices: Regression testing of SAP-centric Business Processes
9 Recommendations
Test System
Business Blueprint
Creation
of
Regression Tests
Governance
1
Lean documentation of important business processes
2
Setup of lean test systems
3
Test automation for critical business processes
4
Comprehensive test data for automated regression tests
5
Provisioning of easy to use manual tests
7
Manual test execution with guidance for business users
9
Management of the change process
Change Impact
Analysis
6
Change Impact Analysis: Risk-based test scope identification
Test Execution
8
© 2012 SAP AG. All rights reserved. 30
SAP Enterprise Support
Test Management – Information Sources
Infos, Presentations, Demos
http://service.sap.com/testing
ALM Infos, Presentations, Demos
http://service.sap.com/alm
SAP AGS Whitepaper Test Management
http://service.sap.com/supportstandards
Remote Service
Expert Guided Implementation
http://service.sap.com/alm-services
Professional Services
www.sap.com/services/testing
Testing SAP Solutions
Classroom
Training E2E220
© 2012 SAP AG. All rights reserved. This presentation and SAP„s strategy and possible future developments are subject to change and may be changed by SAP at any time for any reason without notice. This document is provided without a warranty of any kind, either express or implied, including but not limited to, the implied warranties of merchantability, fitness for a particular purpose, or non-infringement 31
No part of this publication may be reproduced or transmitted in any form or for any purpose without the express permission of SAP AG. The information contained herein may be changed without prior notice.
Some software products marketed by SAP AG and its distributors contain proprietary software components of other software vendors.
Microsoft, Windows, Excel, Outlook, and PowerPoint are registered trademarks of Microsoft Corporation.
IBM, DB2, DB2 Universal Database, System i, System i5, System p, System p5, System x, System z, System z10, System z9, z10, z9, iSeries, pSeries, xSeries, zSeries, eServer, z/VM, z/OS, i5/OS, S/390, OS/390, OS/400, AS/400, S/390 Parallel Enterprise Server, PowerVM, Power Architecture, POWER6+, POWER6, POWER5+, POWER5, POWER, OpenPower, PowerPC, BatchPipes, BladeCenter, System Storage, GPFS, HACMP, RETAIN, DB2 Connect, RACF, Redbooks, OS/2, Parallel Sysplex, MVS/ESA, AIX, Intelligent Miner, WebSphere, Netfinity, Tivoli and Informix are trademarks or registered trademarks of IBM Corporation.
Linux is the registered trademark of Linus Torvalds in the U.S. and other countries. Adobe, the Adobe logo, Acrobat, PostScript, and Reader are either trademarks or registered trademarks of Adobe Systems Incorporated in the United States and/or other countries.
Oracle and Java are registered trademarks of Oracle and/or its affiliates. UNIX, X/Open, OSF/1, and Motif are registered trademarks of the Open Group.
Citrix, ICA, Program Neighborhood, MetaFrame, WinFrame, VideoFrame, and MultiWin are trademarks or registered trademarks of Citrix Systems, Inc.
© 2012 SAP AG. All rights reserved.
HTML, XML, XHTML and W3C are trademarks or registered trademarks of W3C®, World
Wide Web Consortium, Massachusetts Institute of Technology.
SAP, R/3, SAP NetWeaver, Duet, PartnerEdge, ByDesign, SAP BusinessObjects Explorer, StreamWork, and other SAP products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of SAP AG in Germany and other countries.
Business Objects and the Business Objects logo, BusinessObjects, Crystal Reports, Crystal Decisions, Web Intelligence, Xcelsius, and other Business Objects products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Business Objects Software Ltd. Business Objects is an
SAP company.
Sybase and Adaptive Server, iAnywhere, Sybase 365, SQL Anywhere, and other Sybase products and services mentioned herein as well as their respective logos are trademarks or registered trademarks of Sybase, Inc. Sybase is an SAP company.
All other product and service names mentioned are the trademarks of their respective companies. Data contained in this document serves informational purposes only. National product specifications may vary.
The information in this document is proprietary to SAP. No part of this document may be reproduced, copied, or transmitted in any form or for any purpose without the express prior written permission of SAP AG.