Mobile Testing, Agile
Methodologies & You!
Before We Begin...
• It's Quiet in Here
• Q&A at End of Webinar • Contact Details Available • Let’s Go!
Today’s Presenters
William Anderson
Go2Group
Alan Trefzger
Today’s Agenda
Mobile Testing (Alan / XBOSoft) Agile Methodologies (William / Go2Group) You (Q&A)^
^
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges • Mobile QA
• Issues and solutions
Current Situation, Trends
• 100 Android devices released in 2011 • 428 Million Mobile Communication
Devices Sold Worldwide in Q1 2011
• More manufacturers, carriers, and 3rd
party application aggregators will join the competition
Global Smartphone
Penetration (by OS)
Smartphone
Penetration
Source: comScore 0.00%$ 5.00%$ 10.00%$ 15.00%$ 20.00%$ 25.00%$ 30.00%$ 35.00%$ 40.00%$ 45.00%$ United$Lots of Opportunity
• Lot of competition
• Quality and especially usability both more than ever take a front seat for user
acceptance and usage
• Low usability and / or low quality applications may be only used once
• If the user cannot learn how to intuitively use in 30 seconds, forget it
Mobile Testing
• Mobile Current Market Situation, Trends
• Mobile Application Challenges
• Mobile QA
• Issues and solutions
Mobile App Challenges
• Limited display areas, miniature
keyboards, less processing power and memory capacity
• Battery-power usage
• Lower bandwidth (but increasing)
• Proliferated mobile platform/OS combos • Differences for the same application from
Mobile Networks and
Feature Implementation
Mobile OS Features
Mobile Testing
• Mobile Current Market Situation, Trends • Mobile Application Challenges
• Mobile QA
• Issues and solutions
Mobile Testing Types
and Peculiarities
• Testing
• Functional Testing
• User Interface or Usability Testing
• Performance, Stress Testing, Compatibility Testing • Publishing Compliance Testing
• Interruption Testing
• Negative Network Testing
• Peculiarities
Choosing A Mobile
Mobile QA Issues
• Proliferation of devices, networks, OS
• Costs and complications
• Manual testing is easier yet more difficult: environment proliferation and replication
• Performance bottlenecks difficult to pinpoint • Limits of automation tools
Mobile QA Issues
and Solutions
• Issue: Different tools to cover different test cases can be overwhelming and
complicated to track results
• For instance, use adb (Android Debug Bridge) to test application installation on android mobile, and use another tool to do automation test against
mobile application
• Tools need to be manually switched from one to another
Solution: Android
Debug Bridge
• Use Windows framework to integrate tools
• Develop a script or a batch file to trigger different tools using the windows command line
• Build a mobile automation framework (based on
Windows API as previous means); call different tools with certain sequence; interval time between two calls • Can test application installation, application itself,
un-installation with one executable file
• Example: Test browser installation, functions, un-installation in 1 run, with Windows API &
Issue: Agile Project,
with Changing UI Styles
• Under time pressure, test task is intensive in the final phase of a release
• Solution: Prototype or UI design with fixed element ID or position is provided to testers
• Application is learned by testers, test tools in advance • Tester can develop automation test easily with tool
based on the prototype/design
• Apply test in various platforms or configurations, saving manual testing time
Mobile QA
Issues & Solutions
• Issue: Configuration management for Apple applications via App Store
• Solution: App Store has version control
• New downloads get the latest version
• Old users are prompted to upgrade via app store • Incompatible versions are forced to upgrade
• Users forced to have either most recent, or a compatible version
Mobile QA
Issues & Solutions
• When to test an actual device?
• UI
• Location • Multimedia
Mobile Testing
• Mobile Current Market Situation, Trends • Mobile Application Challenges
• Mobile QA
• Issues and solutions
Case Study
Mobile Devices & Speed
• Please contact XBOSoft for more details!
Summary
• Mobile QA requires an adapted strategy
• Decompose where you can in order to gain efficiencies
• Manual testing and real devices are still necessary
• But needs can be reduced through selective automation and environment simulation
3 Steps to
Agile Success!
• Fundamental understanding • Which methodology?
Fundamental
Understanding
• Why the need for agile? • Who benefits from agile? • Is it just one-and-done?
Which Methodology Is
Right For You?
• There are many!
• Benchmark, measure, discover • Likely a hybrid approach is best
Find the
Right Tools!
• Requirements, test management • Software development
• Project management (ie, Scrum masters) • Examples:
• Atlassian JIRA, GreenHopper, Bonfire, Confluence • Go2Group JaM Plugin, synapseRT, ConnectALL • HP QC / ALM, Salesforce, SugarCRM
An Example
of Agile
• Pre-Agile: Waterfall-based
• Backlog of requirements not being developed • Lots of missed deadlines!
• Why Agile?
• Many bugs, parallel / distributed development
• It’s An Agile Life
• Training: “Start thinking in stories, sprints, etc.” • Periodic releases and iterative updates
Where To
Get Started
• One Day Agile Training from Go2Group
• Includes Agile Tools Demonstration!
• Demo / example sprints and release cycles • Great place to get your toes wet