Cloud based Testing for Mobile Apps
Dada Mote
Agenda
Testing Mobile Apps Limitations
Emerging Trends
Cloud Based Testing for Mobile Apps Clouds types for Mobile Apps Testing Features of Cloud based Testing
Test Planning and Best Practices
Introduction
Growth of Mobile Platforms Growth of Vendors
Types of Mobile Apps Biggest challenge:
Testing Pre-Installed Mobile Apps
Core data activities
Functionality & Usability Automatic upgrades
Cannot be Un-installed
Testing Installable Mobile Apps
Downloading & Upgrading Download through Wired /
Wireless Media
AppStore, Online-URL, Transfer via USB, BlueTooth, InfraRed
Installation and Un-Installation Platform Specific
Testing Browser Based Mobile Apps
Supported Mobile Browsers
Opera, Skyfire, Teashark, bolt, Blazer
Accessibility and security Availability scenarios
Testing Performance/Functionality
Various Network Strengths Various Network Speeds
Various Network Types
Testing Performance/Functionality
Availability of Free Memory Memory Usage Pattern
Launched, Run, Exit, Run for long time Memory Consumption Pattern (RAM)
Testing Performance/Functionality
Continually Upgrading Devices & Apps Backward Compatibility
MSP and Vendor Impact
Battery Consumption Pattern
Testing Compatibility/Functionality
Various Input Modes
Different screen sizes and Resolutions Various Interruptions while AUT is
Traditional Apps Testing- Simulators
Advantages
Finding issues in early stage, Non-availability of device
Disadvantages
Resemblance of the device
Test environment & i/o related issues Actual end user scenarios
Mobile Apps Testing - Challenges
Testing is not straight forward Simulators are not Reliable
Real Test Bed
Real Devices
Availability, Devices w/ limited resources, Versions Real Network
Requirement of Ideal Testing Platform
Easy access & Full control to many phones Enable all types of Testing
Integrate with existing MDLC/MDF Generate Reports Easily
Enhance Collaboration among distributed teams
Emerging Trends
Advanced Testing Process Automation Testing
Mobinium, Robotium, QTP w/ M-Eux
Out-Sourcing to Real Test Bed
Beta Testing, Crowd-Sourced Testing
Remote Real Devices
General Cloud based Services
Features
Pay as you use
Any service any time Use of Virtualization Resources Availability
Scale-up and Scale-down Adopt changing conditions
General Cloud based Services- Types
Cloud Services
SaaS, PaaS, IaaS, Taas
Cloud Types
Private Cloud
Owned, Hosted, Dedicated Public Cloud
Why Cloud based Approach for Mobile?
Real Test Bed
Dynamic mobile landscape Comprehensive Testing
Efficient Testing Compatibility
Cloud based Testing for Mobile Apps
Web based secure access
Control to Many Real/Actual Devices
Testing in Live Networks Different Geo-locations
Cloud based Testing for Mobile Apps
Control on Testing process
Agile Enterprises can
control the Cloud to keep the Apps and services up-to-date with Newest
Handsets
Huge Revenue
opportunities w/ gain in the market value
Mobile Cloud Overview
100% Web based S-a-a-S Platform Holding the handset
Install Application from PC to Device
Send numbers to the device using keyboard Simulate handset events in single click
M-Cloud Infra Elements
Sync Engine Web2.0 Portal Device Management Data Adapters Push Notifications AggregationM-Cloud Infra Elements
Rapid Development
Conflict Resolution
Core Apps
Privacy and Access
Scalability
Specific Types of M-Cloud
Private M-Cloud
Owned, Dedicated, Hosted
Public M-Cloud
Hosted, Shared
Single Platform Cloud Full Mobile Cloud
M-Cloud -Public Shared Devices
Book time slot for Specific Devices
Specify Mobile Networks, Geo-locations Keep Updated the Test Plan
Complete testing activity within time
M-Cloud -Private Dedicated Devices
Secured Devices
Change/upgrade of devices within cloud Pool of Devices is part of Test strategy Network should be part of test strategy
Services by M-Cloud Owner
Lab with Versions of devices
Setup Frameworks Mobile Cloud Switch Connection Utilities Generate the Reports
Features of M-Cloud
Highest level of Reliability
Device with Active Mobile plans
Call, SMS, install apps, browse facility
Availability of Latest & upcoming Devices
24x7 applications and performance monitoring Reserve Devices whenever you need
Best Practices - Test Planning
Setup the Test Bed
Identify the Resources on M-Cloud
Identify Test Cases for M-Cloud
Identify Test Data Regulations in advance Simulate the End User Experience
Consider the Response Times
Follow International Requirements Identify Risk based scenarios
Best Practices – Test Execution
Select proper/specific M-Cloud
Location, platform, Device dependent
Connect to Device on M-Cloud and Port the Apps on the Device
Identify applicable Testing types Test across Multiple devices
M-Cloud Implementation Challenges
Firewall Exceptions & Remote configurations Application Tuning
Storage and Bandwidth cost
Cross Cloud Alignment bottlenecks
Failover Testing for disaster recovery
Elasticity and scalability- False positives Security and performance issues
Xoriant Services For Mobile Apps
Multiplatform Mobile Apps Development
Testing Framework for various platforms w/ M-Cloud services