ST
eP-I
N Forum’s Software Testing Conference at Hyderabad
“Software Testing v2.0 – SMARTER, LEANER, SIMPLER”
September 27-28, 2012 @ Taj Deccan, Hyderabad, INDIA
Virtualization: Testing beyond boundaries
by
Murali Meenakshi Sundaram,
Head –
Cloud & Emerging Technology Testing Practice, ITS
CSC
Copyright: STeP-IN Forum
Published with permission for restricted use during ‘HSTC 2012’ in agreement with full
copyrights from owner(s) / author(s) of material. All rights reserved. No part of this
publication may be reproduced, stored in a retrieval system or transmitted in any form
or by any means, electronic, mechanical, photocopying, recording or otherwise without
the prior consent of the owner(s) / author(s). This edition is manufactured in India and is
authorized for distribution only during ‘HSTC 2012’ as per the applicable conditions.
Practices
Experience
Knowledge
Automation
Produced By
Hosted By
9/23/2012 4:33 PM 0725-23_TBSC 2009 1 TBSC 2009
Virtualization: Testing
Beyond boundaries
Murali Meenakshi Sundaram
Distinguished Technologist, CSC
9/23/2012 4:33 PM 0725-23_TBSC 2009 2 TBSC 2009
Why Testing in Cloud ?
Drivers
CSC Advantage - Leverage CSC’s Leadership position in Cloud
Market Trends
•Multiple configurations to support various releases ( new dev / sustenance and maintenance of previous releases)
•Testing being a periodic activity and requires new environments to be set up for each project.
•Exponential combinations for testing – Mobile devices , Browsers , OS etc
•Testing is considered an important but an non-business-critical activity : wedge for Cloud adoption
•Gartner -Cloud Services will be $150 Billion by 2013
•Growing U.S. enterprise usage and strong interest in TaaS; 49% highlight plans to evaluate or adopt within next 12-24 months*
•Demand for TaaS as both complement and increasingly as substitute expected to increase over coming years as industries gain more experience and TaaS platform capabilities and services evolve
•ASQ partners offering SaaS tools
•Enterprise users of 3rd party services more likely to consider usage or adoption of TaaS as they look for ways to drive operational efficiencies with economies of scale and ability to shift from capex to opex spending
9/23/2012 4:33 PM 0725-23_TBSC 2009 3 TBSC 2009
• Utility model for Test environment and Test tools licenses • Elastic resources (Environment and Tools licenses)
• Standardization of Test Environment and configurations through industrialized service delivery
• Upfront identification of defects through continuous testing leveraging services virtualization
Business and
Operations
• BCP / DR Plans leveraging Test Environments
• Ability to isolate and operate Test artifacts to enforce independence
• Lifecycle management – Test Environment , Test data , Configuration , Release and Capacity management
Cost Control
Responsiveness
• Significant time saved through rapid provision of Test Environment and Test tools • Decouple complexity of Test Environment configuration and Test Environment
capacity leveraging cloud
• Rapid defect resolution in Test Environment leveraging snapshot features in the cloud lab
• Ability to certify for wider platforms and releases leveraging Test Environment images
Benefit : Do More with Less
9/23/2012 4:33 PM 0725-23_TBSC 2009 4 TBSC 2009
Testing of IT applications ( Custom, Enterprise, Business apps) leveraging Cloud for virtualized
, scalable ,on-demand test labs that provide self-provisioning and management of multi-platform
environments.
• Testing tools
• Test scripts
• Test standards
• The work flow
• The standard applications that are being tested (like SAP or Oracle or point solution)
• Test metrics
• The test environment (Platform, architecture and the applications them selves)
What is
Same….
What is
New….
• Platform, tools and test experts - Utility model
• Predictable End-to-end cost
• Ability to leverage a variety of tools
• Ability to leverage various batteries of testing
• Verify architectural / design level – using new generation performance tools – before going live
* Adapted from IDC definition of TaaS
9/23/2012 4:33 PM 0725-23_TBSC 2009 5 TBSC 2009
What can be leveraged in Cloud from a Testing perspective?
•Functional Testing as a Service
•Performance Testing as a Service
•Mobile Testing as a Service
•Test Automation as a Service
•Security Testing as a Service
•Test Environment (Servers / Desktops/ Configurations)on demand to support
•New Development / Enhancement
•Patches / Hot Fixes
•Migrations / Upgrades
•ASQ Tools in alternate licensing models
•Test Management Tools
•Automation tools
•Performance Testing tools
•LCQM tools
•Open Source Tools
Capability-as-a-Service (CaaS)
Software as a Service (SaaS)
Environment-as-a-Service (EaaS)
CaaS
EaaS
SaaS
Testing
9/23/2012 4:33 PM 0725-23_TBSC 2009 6 TBSC 2009Test Environment Manager
Applications Infrastructure Security Integration Services Data
Data Management
Test Management Release
Management
Configuration Management
Infrastructure Management
9/23/2012 4:33 PM 0725-23_TBSC 2009 7 TBSC 2009
COTS environments
Cloud compute / Biz Cloud options Cloud compute / Biz Cloud options
Platform-as-Service
Windows (Multilingual, Multi CPUs)
Linux (Red hat, Linux, Debian) MS-SQL. Oracle, DB2, Informix,
MySQL, Teradata Sun Solaris
Elastic servers (Tomcat, My SQL
combinations) Mobile Platform
simulators
Borland ES, Cold fusion, Tomcat, Web
logic, Web Sphere, Web Application server (SAP), ATG Dynamo, JBOSS Management Tools Sandbox Environment Management Services Service Virtualization
Test Environment Management In Cloud
Configuration management Release Management Infrastructure Management
Dash Board Integration
Environment provisioning for Large scale Web Application
Testing
Custom Environments
Client / Server Enterprise Applications – SAP, Oracle, Cadence, PTC, Sugar CRM Web Applications
9/23/2012 4:33 PM 0725-23_TBSC 2009 8 TBSC 2009
Cloud compute / Biz Cloud options Cloud compute / Biz Cloud options
Platform-as-Service
Windows (Multilingual, Multi CPUs)
Linux (Red hat, Linux, Debian) MS-SQL. Oracle, DB2, Informix,
MySQL, Teradata Sun Solaris
Elastic servers (Tomcat, My SQL
combinations) Mobile Platform
simulators
Borland ES, Cold fusion, Tomcat, Web
logic, Web Sphere, Web Application server (SAP), ATG Dynamo, JBOSS Software-as-Service Sample tools Environment Management services
Client / Server Enterprise Applications – SAP, Oracle, Cadence, PTC, Sugar CRM
Service Virtualization
Cloud Based Testing Service Offerings under TaaS Ecosystem
Web Applications
TaaS for Custom & Enterprise Applications MAST (Mobile Apps Security Testing)MAT (Mobile Application Testing) Web Application Performance Testing
9/23/2012 4:33 PM 0725-23_TBSC 2009 9 TBSC 2009
Customer
Test Requirements & Application Components TaaS in Cloud FTP / URL / VPN Cloud lab Database servers Web Server Application Servers
Application Under Test
Automated Software Quality Tools
Infrastructure Stabilization
Test Strategy & Planning Test Execution Test Summary Reports Certify Application
Customer requests Testing from
Provider Provisioning / Scheduling of Tests Provider conducts Testing
Provider publishes Test Results & Reports Collaboration Customer Sign-off Cloud Orchestration Provider Customer Provider & Customer Mobile Simulators Service virtualization Provider
How is Test Environment in Cloud consumed for Testing ?
10 © 2012 Computer Sciences Corporation
•Managing non-virtualizable
• Managing availability
•Elastic and Rapid provisioning
•Large Scale collaboration
V1 V2
V3 V4
Virtual Environment Mobile Simulators
Mobile Apps MV1 MV2 App 1 App 2 Service Virtualization Testing as a Service in Cloud Compute Virtualization SV 1 SV 2 SV 3 SV 4 SV 5 SV 6 SV 7 SV 8 • Assets • Accelerators •Dash Board •Quality Assessment tool
Tools Testing Environment
NV 1 NV 2 NV 3 NV 4
Non-Virtualizable Platforms
Customer Environment - Testing
Customer Environment - Snapshot for faster bug resolution Customer Environment - Golden Image – BCP / DR Plan
Schematic Of Client Environment In Cloud
9/23/2012 4:33 PM 0725-23_TBSC 2009 11 TBSC 2009 Standard OS Image Lib Client’s Configurations External Software Images (Tools) Strategic partner tools (SaaS) Client’s Apps & Data
Client’s Test assets
Client’s (new) Test assets & Reports
Client’s Apps & Data
(Certified) Cloud lab environment
Provisioning approach
9/23/2012 4:33 PM 0725-23_TBSC 2009 12 TBSC 2009
