Mobinius Testing Services
MOBINIUS TESTING SERVICES
Optimize your performance and ensure a superior user experience
By the time you finish reading, the mobile app landscape will change. New OS versions will be released. A bunch of new devices will hit the market. Cool new apps will go viral, gaining millions of users and setting new standards in user
expectations. And mobile app testing will become much more complex and challenging.
Discouraged? Don’t be. The world of mobile is filled with excitement and opportunity and anyone can have the next hit app! But to make a splash, your app needs to stand up to use by thousands – if not millions – of users around the world with different devices, operating systems, networks, connections and more. To keep those users – your users – delighted, your app
needs to be high quality and thoroughly tested.
Despite the ever-changing mobile landscape, there are some constants in the realm of mobile app quality that organizations of any size – from small startups to major global enterprises – can study, understand and take advantage of.
In the following pages, we’ll discuss the mobile landscape, dispel some common myths and outline proven strategies to help you deal with the exhaustive mobile matrix. Ready to learn more? Let’s get started...
IN
2012, 31% OF COMPANIES REPORTED ACTIVELY
TESTING MOBILE APPS.
31%
(WORLD QUALITY REPORT)
IN
2013, THAT NUMBER ROSE TO 55%.
THE INCREASE COULD BE SEEN ACROSS INDUSTRIES.
KEY TAKEAWAY
The Mobile Economy Will Continue to Explode!
Three quarters of a billion iOS and Android devices across 220 countries generated over
In 2012, the market for paid application downloads reached $8 billion in the top five app platforms, up 27% from 2011 The iOS app store is going to have 435,000 new apps in 2013
Mobile application market size is going Google Play’s revenue were up 311% overall in 2012
3/4
Billion
10+
Billion
This means
•• Need for global testing coverage Need for ongoing support and user experience management• Need for cross-platform testing capabilities~54 Billion
380K
435K
2012 2013+
311%
27%
CHALLENGES
Today’s enterprise mobile and web applications are growing in complexity. Adding to this challenge is the rising volume of users, and the different devices proliferating the marketspace – that can put applications under massive stress. Therefore, you need a solution that helps capture the complete end-user experience across multiple platforms and makes the system more scalable.
MOBILE TESTING CHALLENGES AT A GLANCE
INDUSTRY CHALLENGES
• BYOD Mobile Device Management • Enterprise Level Security
• Testing on the Cloud
• Consumer and Enterprise Mobility • Native vs. Hybrid vs. mWeb vs. HTML5 • Mobile Test Automation, Security Tools
• Network Delay and Jitter • Network Disruption Testing • Network Performance Testing • Network Congestion Testing • Multi Network/Trace Testing
• Enterprise Carrier Network Switching
• 2G, 2.73G (GPRS, EDGE), 3G, 4G • WiFi (Secured, Unsecured) • WiMax
• VPN, Hotsport, Tethering • Cellular Internet, Telcom Carriers • Data loss over network
• Bandwidth, Signal Loss
NETWORK SERVICE PROVIDER NETWORK CONNECTIVITY AND VARIYING SPEED
DEVICE DIVERSITY
• Device Makers, Models
• Smart Phones, Phablets, Tablets • Device Density (Idpi, mdpi, hdpi, xhdpi) • Device Screen Sizes (Small, Normal, Larger, Extra Large Screens) • Device Orientation Challenges
• Device Browsers, Rendering Differencess
DEVICE DATA INPUT METHODS
• Touch Screen Kypad
• Non Touch, Soft/Physical Keypad • Track Balls. Qwerty Keypad • Voice (SIRI, Skyvi)
• Split Keypad • Copy and Paste • Blink of an eye
DEVICE CAPABILITY & APP FUNCTIONALITY • Bandwidth Connectivity • Camera • Phone/SMS/MMS • Contact List OTHERS
• Rapid Rollouts. Deployment Velocity • Mobile Context, Usability, Performance • Monitoring for energy consumptions • Testing with Emulators/Simulators • Device Interruption Scenarios
• Field Testing, Test Execution Challenges • iOS (3, 3GS, 4, 4GS, 5.x, 6.x)
• Android (2.x, 3.x, 4.x) • Blackberry (4.x, 5.x, 6.x, 7.x) • Windows Phone (2003, 5.x, 6.x, 7.x) • Symbian, Brew, J2ME, DADA, others
• Limited Processing Capability/Power • Locations and Languages
• Limited Memory size
• Availability of external memory SD card • Device Comm Protocols (WAP, HTTP) • Device Configuration
NETWORK SERVICE PROVIDER
MOBILE TESTING METHODOLOGY
Having a right mobile testing methodology is critical for your business and you need a prtner who understands intricate details and brings rquired knowledge as well as infrastructure
TESTING STRATEGY PLANNING DESIGN
REPORTING ENVIRONMENT
EXECUTION METHODS ANALYSIS
TESTING TYPES
FUNCTIONAL
• Validation of Functionality • Smoke / Regressions Testing • Off line access testing
• Negative Testing
APP PERFORMANCE TESTING • CPU Usage testing
• Network Usage
• Page Render time or activity Render time
USABILITY TESTING • User Experience • Competitive Analysis • Expert Review
INSTALLATION TESTING • New App Install
• Uninstall and Reinstall • Upgrade testing NON FUNCTIONAL • Network Strength/Outage/Recovery • Different NW Types • Peripheral Testing INTERRUPT • Voice / SMS interrupts • Notifications
• Battery /Cable Removal
1
2
3
4
5
6
7
8
9
10
11
LANGUAGE TESTING • Validation for Locales • Images and Text• Currencies, time zones etc. • Context SECURITY TESTING • Security Auditing • Vulnerability – Scanning • Security Scanning • Penetrating Testing MEMORY TESTING • Review of cache
• Data storage mechanism VULNERABILITY TESTING
• OWASP Vulnerabilities • Dynamic Testing • Static Code Analysis • Data Encryption MEMORY LEAK • Memory Usage • Memory Leaks • Garbage Collection
Mobinius’s Test Lab is an on-demand test infrastructure that offers end-to-end mobile testing services which ensure that the desired user experience and planned business value are delivered by the appropriate mobile solution. With it, you can test mobile apps in any real-world end-user condition throughout all stages of the SDLC.
• Access thousands of real devices • Test load, speed, geography and more • Automate, monitor and collaborate • Connect to your existing workflow
Mobile initiatives in various enterprises are still done on Line of Business basis where each LOB has its own priorities and schedules and often ends up duplicating software and hardware resources. A third Party Mobility Certification Partner can help organizations move quicker in their mobile journey with optimum cost.
Lab environments are places of perfect connectivity, limited devices and up-to-date operating systems. Sadly, that's not the world your app is going to encounter outside the walls of your test lab.
In-the-wild testing ensures your app works well in real world situations, such as:
• On a Range of Devices: The number of mobile devices grows every day, bringing with it a range of screen sizes, resolutions, processing power, etc. You'd need a warehouse to store all these devices.
• On Real Devices: Emulators and simulators simply don't cut it. Fingers on touchscreens are much different than mouse clicks and real devices aren't clean, well-maintained systems. But to house all the devices you would need for testing, you'd need unlimited space and an astronomical budget.
• On-Location: Connectivity changes with network and location, but you can't mimic those fluctuating conditions in a lab.
• Outdated Software: Not everyone regularly updates their operating system. Some Android users might not even have access to the newest version. How does your app behave on older OS versions?
HOW MOBINIUS HELPS
Mobinius has set up a ready-to-use mobility testing lab, which includes popular devices, leading automation solutions, dedicated network connectivity which you can use on a pay per use model. We maintain and upgrade the devices and OS version based on market need. It is equipped with all prominent smart devices and popular testing solutions to cater to varying customer demands. Our Lab provides a holistic Mobile Application Testing approach and helps reduce cycle time, costs and effort. We also have resident Mobility Quality Engineering Professionals in the test center to provide Complete Mobility Testing Services.
Mobinius brings High Velocity enterprise class mobile testing services to power your mobile business. Now you can control your testing costs, increase your test coverage securely and monetize by taking your application to market quickly and efficiently.
With Mobinius’s High Velocity Mobile Testing Solutions you can:
• Provision any device you want from our virtual private cloud quickly • Acquire 100% cross-platform testing support on iOS, Android, Windows, Symbian, Blackberry and more
• Leverage our test and automation experts located across the globe • Tap into our library of more than 4000+ ready-made test cases • Automate relevant test cases with ease
MOBINIUS SOLUTION
Mobinius Performance Testing services focus on end-user performance, system stress and load testing of application, and capacity planning for related infrastructure. Our performance testing experts help you manage and mitigate the risk of deploying mission-critical applications by identifying:
• What to expect once your application is in production? • Potential bottlenecks before production install
• How to tune application parameters to maximize performance? • Capacity planning for application infrastructure
MOBINIUS’S PERFORMANCE TESTING SERVICES
Mobinius’s Performance Testing Services include:
• Comprehensive end-user performance requirements based on service level agreements
• Complete understanding of infrastructure associated with application • Test planning and resource requirement analysis, use case analysis and performance scenario definition
• Test data creation and test environment setup with consideration of network performance
• Automation of performance test scenarios using tools • Test monitor setup, test execution and results analysis
• Assistance in tuning the performance parameters for webservers, appservers, OS and database servers
ACTIVITIES & DELIVERABLES
Mobinius Performance Testing is based on our customizable process and our unique Maturity Model for Quality, Process, and Automation. Our proven methodology has helped our clients realize their quality vision, reduce operation costs, accelerate time to market and deploy with confidence. DEFINE AND DESIGN ACTIVITIES DELIVERABLES DEVELOP AND BASELINE TEST AND TUNE CERTIFY AND DEPLOY
• Define performance requirements • Select performance testing tool(s) • Procure test environment
• Install and test performance test environment
• Populate test data • Design test scripts • Execute test scripts
• Add virtual users to identify bottlenecks
• Extraplation analysis based on performance data
• Capacity planning at web server, app server and database levels
• Certify application for concurrent users
• Deply risk kitigation plan
• Capacity plan
• Monitoring parameters • Tune the application server,
web server and databas • Tune the infrastructure and network
• Record, develop and test the test scripts
• Execute scripts for
debugging and base-lining
• Performance test scripts and base line report
• Performance test execution test • Define test data
• Identify usage scenarios • Identify potential risks
• Performance test plan • Risk mitigation plan
HIGH VELOCITY TESTING SERVICES
Powered by
MOBILE CLOUD
INFRASTRUCTURE
150+
MOBILE DEVICES
APPS TESTED & COUNTING
350+
MULTI-INDUSTRY
TESTING EXPERIENCE
READY-MADE TEST CASES
600+
DEEP DOMAIN
Mobinius is a leading provider of Mobile and Enterprise QA Services and Solutions; Mobile Application Development, Testing and Automation, and Certification and Sustenance