“ Minimize Time to Value " for
Accelerated Go-Live Readiness
of Business Critical Software.
CORE & CONFIGURED SOFTWARE TESTING SERIVICES
Agenda
About Zensoft Services
Introduction to core and configured software products
Challenges in testing core & configured software products
Testing solutions all core & configured software need
Drivers of successful test automation adoption
Integration of testing to minimize time to value
Some of our customer success stories
o
Steelwedge reduces cost of testing cycles by 30%
o
PTC advances release and reduces feedback latency during development by 50%
o
Bajaj Finserv reduced acceptance for SFDC deployments by 75%
o
ZS associates accelerates Qualitia adoption to reduce regression cycle time by 50%
o
ZS associates improves ability to deliver more maintenance releases
o
PatTech improves confidence in making ship/no ship decisions
About Zensoft Services
Zensoft Services is an independent software testing and test automation services provider driven by experts and thought leaders in software
testing and test automation. We work with some of the smartest software-driven businesses around the world including Fortune 500
companies. Zensoft is globally recognized as a focused partner with in-depth expertise in testing solutions and provides
manual, automation,
performance and mobile testing services
for multiple industries.
Software Testing and Test Automation Services Company
Mission: “
Minimize time to value” and “accelerate go-live readiness” of business critical software
Some of Our Customers
Introduction to core & configured software products
Supply Chain Management (SCM) Solutions
We work with SCM software solution providers as well as in-house SCM software development teams; from forecasting to transportation and more. Typically, each release commands a considerable amount of time for the testing of core and configured products; and this phenomenon is applicable across the SCM software landscape including:
Lending solutions
Typically, a platform for retail consumers, SMEs and corporate lending . Configured for each customer to support seamless loan application processing, risk and financial analysis and underwriting. 3-6 person months of testing cycle for core products and every new deployment. Customers are also concerned about subsequent testing cycles during deployment enhancements.
CRM & Salesforce Configuration and Customizations
Product Life Cycle Management (PLM) Solutions
Configured and adopted by a manufacturer to manage their products through all phases of the product lifecycle. Considering subsequent
continuous enhancement, customer (manufacturer) expects testing time to be controlled right from deployment.
Channel Management Demand & Supply Planning Distribution
Fleet Management Inventory Management
Order Management Supply & Logistics Procurement Shipping
Supplier Contract Management
3
Multiple use cases: For example, financial services management
organizations use salesforce for “Retail customer Marketing and Opportunity Management”, whereas some leading technology-enabled solution providers use Salesforce for “Sales Initiation and Opportunity Management” of
products/services and also for “Technical Support” management. Most of these and other medium to large Salesforce deployments follow
continuous minor/major (configured) product enhancement release cycles which require extensive testing cycles and thereby become bottlenecks for early go-live readiness.
Challenges in testing Core and Configured software products
We understand the complexities & challenges you face in testing core and configured products, some of
which may include:
The inability to invest time in test automation due to continuous product release pressure.
Lack of experience and skills to define and adopt test automation across configured products
Lack of technical capability to map variability across different configurations and devise test automation design/
architecture, even though you have functional expertise.
Experience & Skills Continuous product release pressures
Technical expertise
Multiple product configurations
Lack of time to devise test automation methods for management of test data across product configurations.
Lack of mature, time-tested methods and processes for effective execution of test automation development and adoption.
Lack of methods & a maintainable architecture
Need for reusable test components and configurable objects to enhance the applicability/ maintainability of test
automation for core products and product configurations.
Testing solutions all core & configured software need
Reusable Assets
Expert Skills Matured
Methods
Manage
Variability Innovate & improve
With Zensoft you get matured methods, reusable assets and expert skills to minimize the time to value from testing & test automation of your SCM software. Reduce risk, ensure early and sustained ROI with our integrated product (development) driven approach to software testing and test automation.
Pro-active team that can design, implement and execute test cycles to enable making ship/no-ship decisions.
Agile (Dev-Box / in-sprint) and release readiness testing to effectively strengthen business objectives.
Product (Development) Driven Approach to design and implement
test automation.
Accelerators and framework for web, services, desktop and mobile
applications
Performance Design, Prediction, Testing, Monitoring & Diagnosis Qualitia-driven Selenium
WebDriver/QTP-based test automation to improve coverage and time to market.
Deliver and adopt test automation incrementally accelerating go-live
Drivers of successful test automation adoption for core & configured software
products
Product (development )
driven approach
Domain (core product) and technology compatible
assets
Tools & proficiency for
accelerated delivery &
adoption
Reusable & maintainable test automation
Zensoft’s successful test automation adoption for
core and configured software products is
driven by:
7
Product (Development) Driven Approach
We understand the complexities of testing core and configured products like no other and have developed and refined our unique approach that aligns testing to business goals. For every core or configured product and their feature-sets, Analyze and architect test automation
Objectives: reduce risk and re-assess scope Design, develop and deliver in increments; go agile
Provide regular interlock for governance, management and delivery Ensure early/right adoption and measured ROI
Reduce regression cycle time and feedback latency
Tools and Proficiency for Accelerated Delivery and Adoption
Assessment of your product technology, systems, architecture and environment, including a technical assessment to validate applicability of Qualitia driven Selenium WebDriver or QTP based test automation.
Identify the most flexible, robust and resilient solution to build reusable and maintainable test automation
Design and implement test automation Priority driven
Manual test case traceable Reusable/maintainable
Integration of testing to minimize time to value
What is high on agenda
of SCM solutions, lending solutions and other configurable product providers?
Reduce time of testing cycles for
core and configured products and improve time to value.
Reduce time of testing cycles for
configured product implementations
and improve time to value.
How is adoption and deployment of configured products impacting organizations?
What should also be on the agenda?
Configured Product
Customers
C u sto mer Exp er ie n ce
Core Product
Product Design Process Software/System Development and Delivery Process Customer/New Market engagement and Go-Live processConfig./ Customization Requirements Customization/ Config. Design Config./Customization Development and Deployment Customer Process and Requirements Release Acceptance Release/Go-Live
Need: Integrated Testing & Test Automation
Product Boundary
Configured Product
Customers
C u sto mer Exp er ie n ce
Core Product
Product Design Process Software/System Development and Delivery Process Customer/New Market Engagement and Go-Live ProcessConfig./ Customization Requirements Customization/ Config. Design Config./Customization Development and Deployment Customer Process and Requirements Release Acceptance Release/Go-Live Product Boundary Extend Integra te d Q A
4
SUCCESS STORIES
Typical Challenges of Configurable Product Providers and Customers
Unable to invest time in test automation due to continuous product release pressure.
Lack of experience and skills to define and adopt test automation across configured
products in a required time frame
o Have functional expertise, but lack the technical capability to map variability across different configurations and devise test automation design/architecture.
o Lack of time to devise test automation methods for management of test data across product configurations.
o Lack of matured and time-tested methods and process for effective execution of test automation development and adoption.
Need reusable test components and configurable objects to enhance the
applicability/maintainability of test automation for core product and product
configurations.
Steelwedge reduces cost of testing cycles by 30%
Overview
Steelwedge,a leading supply chain management company, provides integrated business planning solutions, uniting demand, supply and financial forecasts. Steelwedge approached Zensoft to transform its business and product delivery, and to orchestrate the automation life cycle in varied areas to ease the time to market, improve test coverage and ROI.
Address the need for seamless testing across multiple application technologies
Ensure maintainable test automation: complex workflow and processes of AUT resulting frequent user interface and workflow changes
Challenges
Highly customizable and configurable web based AUT with complex customer scenarios
60 person days of manual regression cycle with sometimes 20 resources working simultaneously, impacting time to market.
Reduce feedback latency
Customer satisfaction: need to improve coverage and prevent defect leakages
Costs: effective utilization of testing organization and budgets
Zensoft Solution
Assessment and development of detailed automation plan
Leverage AGILE development model to address frequent change in business needs and minimize risk
Drive result oriented test automation
Adoption and implementation of Qualitia to enable business users/manual testers to test complex business scenarios and execute scripts with minimal technical knowledge
For every release, separate smoke and regression automated test scripts are developed and executed with multiple sets of data
Results & Benefits
Reduction in cost per testing cycle of up to 30% with minimal failure rate (automation is partially deployed)
Business driven approach which helps business users define the key business flow and run the automated scripts
Met client application release targets & deadlines with improved test coverage
Testing performed using production-like data which replicates the actual business user operation
Multi-environment execution with minimal script failure rate
• Identification of test targets
• Defining test mission
• Controlled iterative test execution and automation
Zensoft’s managed services engagement model
driving results for Steelwedge
ZENSOFT TEAM
Incrementally Deliver Test
Automation
• Understand application (module), execution environment
• Prepare manual test cases, and plan test automation
• Design and validate test automation
• Iterations: develop, deliver, integrate and transition test
automation
• Maintain and enable team for new automation
CUSTOMER
TEAM
Adopt and
Deploy Test
Automation
• Application knowledge transfer
• Manual test case correction for test automation
• Concur on test plan and establish governance
(weekly/monthly)
• Validate test automation
• Participate in test automation and execution
EXTENDED TEAM AND TRUSTED
PARTNER FOR STEELWEDGE
Results
Automation of 700+ test cases and adoption of more than 80% of these in six months (executed as part of weekly/release cycle) reducing regression cycle time of seven manual testers (who are now being trained on automation by the Zensoft team).
Delivered assets which include testing for integration, exchange of information using excel, etc.
Zensoft’s solution further accelerates go-live readiness for Steelwedge
Improves release time by more than 200%, reduces effort by more than 300%
Usage/ Configuration Design and Implementation
Feature Usage Design/
Implementation Core
Variant ABC
Feature Group/ Module 1
Feature 1.1
Variant 1
Customer 1
Customer 3 Core
Customer 2
Feature 1.2 Core
Customer 3
Feature Group/
Module m Feature m.1 Core
Customer 1
Variant 1 Customer 2
Scenario x ……….
Analyze – e.g.: Data Model and Flow for “extension or variation of Domain specific service function(s)” The SCM software solution is configured for each customer and
each configuration needs approximately 20% to 40% variation (as compared to offered solution and different from other customer).
A new release of this cloud based solution involves execution of 1000+ test cases for core product and incremental deployment/adoption for each customer (duration 2 – 3 weeks of 7 – 8 persons each, on average, for at least 60% of customers).
With 40+ customers, it was mission critical for Steelwedge to reduce this bottleneck and accelerate go-live readiness, ensure customer satisfaction, and improve overall time to value.
Zensoft reduced regression cycle (and time to market) for core products and improved time to adoption for each customer by reducing testing cycle from 2 – 3 weeks to less than 1 week. Effort was also reduced from 7 – 8 persons to just 1 – 2 persons during each release cycle.
PTC improves time to market for SFDC deployment
Advances release and reduces feedback latency during development by 50%
Overview
PTC (Nasdaq: PMTC)enables manufacturers with software and services designed to optimize key business processes throughout the entire product lifecycle
Multiple salesforce configuration/customization projects, of medium to large complexity.
Multiple development streams/teams of the SFDC project integrate their changes every week for proposed quarterly release.
Challenges
Spending at least two person days to test weekly the build of SFDC led to stretched release timelines and impacted quality due to delayed feedback.
• Improve time to market of SFDC deployments.
• Provide early feedback on regressions and defects.
Reduce delay in sales cycle due to undetected defects that was escalating costs and impacting opportunity and revenue.
Accelerate release of changes and make the process more predictable
Solution & Benefits
Balance test automation against manual and execution of automated test cases during weekly build/ quarterly release.
Identify and automate sanity test cases (approximately 15%) to verify integrity of weekly build.
Saved approximately 15 person hours every week for the execution of sanity test cases and assessment of a weekly release.
• Minimum time taken for manual testing of 80 test cases—18 person hours.
• Maximum time taken for Execution of Automated test cases is 6 hours - executed during week-end or in the night (on an average 2 runs)
• Maximum time taken for Analysis of Automated test execution is 2 hours.
25 defects raised by automation in one year.
Results & Benefits
Confidence to make ship no-ship decisions.
Reduced risk posed by manual testing (errors, missing a test case and documentation).
Improved time to market and improved customer satisfaction
Reduced time of manual testing during feature enhancement and development.
Bajaj Finserv reduced acceptance for SFDC deployments by 75%
Advances retail loan management product launch by few weeks
Overview
This Indian financial services company (part of renowned industrial group) focused on lending, asset management, wealth management and insurance. With 24 products across 12 product lines, it is one of the fastest growing and most diversified NBFCs in the country.
Uses SFDC to manage “Retail Loan Management” opportunities and services.
Frequent business rule changes before going ahead with the production/deployment of loan management system.
Time for testing impacts business, especially during critical business periods.
Need to improve time to market without compromising on quality.
Challenges
500 business rules needs to be tested before any release
Frequent workflow changes due to change in business rules—very high impact.
Need to improve time to market and feedback latency.
20 days of manual execution time during every quarterly release for three flows, considering maximum capacity of 40 data sets per person
Solution & Benefits
Design and implement test automation to manage multiple data sets.
Drive result oriented test automation.
Adoption and implementation of Qualitia to enable business users and manual testers to test complex business scenarios and execute the scripts with minimal technical knowledge.
Execute automated test cases.
Results & Benefits
Customer can now complete the execution within five days at most with little human intervention.
Saved at least 15 days per every release of SFDC deployment.
ROI is also quite high as the test automation was designed and completed quickly by the Zensoft services team.
Changes to business rules can be incorporated with confidence and within the expected timeline.
Improved test coverage.
Confidence to make ship/no-ship decisions.
Zensoft accelerates Qualitia adoption to reduce regression cycle time by 50%
for ZS associates
Overview
ZS Associates is a global leader in sales and marketing consulting, outsourcing, technology and software. For more than 30 years, ZS has helped companies across a range of industries get the most out of their sales and marketing organizations.
ZS management recognized the need to automate testing processes to improve speed-to-market while maximizing the reliability and accuracy of their applications.
focus on maximizing testing efficiency and effectiveness.
Challenges
To reduce regression cycle time by at least 50%.
Improve test coverage to ensure world-class quality of every application.
Leverage existing domain champions to sustain quality of testing.
Ease of test automation use and training for the ZS QA team.
Reduce maintenance efforts by at least 50% to adopt changes in the applications.
Improve error handling resulting in more predictable stability and reliability.
Integrate with ZS’s existing software development tools.
Zensoft Solution
Assessment and development of a detailed automation plan.
Drive result oriented test automation. Used “Configurable Product” test automation design pattern.
Adoption and implementation of Qualitia to enable business users and manual testers to test complex business scenarios and execute scripts with minimal technical knowledge.
For every release, separate smoke and regression automated test scripts developed and executed with multiple sets of data.
Average time taken for manual testing of 140 tests ≈ 6 person days (smoke/sanity + few regression + defect leakage tests).
Maximum time taken for execution and analysis for same test cases after automation ≈ 2 Days.
Results & Benefits
Software test automation and automation enabled test execution for selected test cases.
Business driven approach which helped business users to define the key business flow and run the automated scripts.
Reduced regression cycles (cycle time reduced by 50%).
Reduced feedback latency (and post-production defects).
Zensoft’s test automation approach improves ability to deliver more
maintenance releases for ZS associates
Challenges
Business Challenge
• Time taken to test release/builds and inherent risk of inconsistent (and not exhaustive) manual testing during each release.
Business Requirement
• Reduce risk of not testing and improve turnaround time for customer requests.
Technology Challenges
• Complex workflow/event driven web-based application with heavy use of Ajax.
• Few important test scenarios contain test cases exercising external integrations like e-mail, import/export of data etc.
Zensoft Solution
Designed and developed test automation of configurable customer/ Salesforce management solution and “Customer Targeting & Activity Planning” applications.
For every release, delivered an effective way to streamline smoke/sanity and regression testing through test automation.
Adoption and implementation of Qualitia to enable business users and manual testers to test complex business scenarios and execute scripts with minimal technical knowledge.
Results & Benefits
Automation of regression tests reduced regression testing time of “Customer’s Call Planning Management” application from 12 – 13 person-days to 1.5 person-days (three including automation maintenance).
Benefits after automation of smoke tests: Reduced smoke test time and effort from 1.5 person days to 0.5 person days.
Reduced maintenance efforts by at least 50% to adopt changes in the applications.
Overview
Patriot Technology Solutions Inc. (PatTech), a subsidiary of Patriot National Inc. (NYSE: PN), is a leading provider of technology solutions for the property and casualty insurance industry.
Business Compulsion
With current drive for customer satisfaction and on-boarding of few new customers, Patriot Technology Solutions Inc. needed to make a bi-monthly release of their flagship “Workers Compensation” solution.
Business Drive
To gain better confidence in test results and reduce post production defects, CTO and CFO decided to engage Zensoft for Qualitia driven test automation of the “Workers Compensation” solution.
Challenges
With 8000+ total test cases, the team of manual testers are under heavy pressure to ensure timely go-live readiness of releases of this complex web application solution.
Zensoft Solution
Assessment and development of a detailed automation plan
Right test automation design, architecture and effective development, implementation by the Zensoft test automation team
Drive result oriented test automation. Used “Configurable Product” test automation design pattern.
Adoption and implementation of Qualitia to enable business users and manual testers to test complex business scenarios and execute scripts with minimal technical knowledge
Quantified results shared by daily execution of completed test automation on nightly build in staging environment.
Results & Benefits
The test automation and adoption of test automation is still in progress, with automation of just 1000+ major tests.
PatTech is not only saving 10 person days of manual testing effort, but has more confidence to make ship decision of the release.
PatTech improves confidence in make ship decisions
THANK YOU
+91 206 647 9400 Zensoft Services Pvt. Ltd.
4D, 6th Floor, Phase 3, Cerebrum IT Park, Kalyani Nagar Pune – 411014, Maharashtra, India