Frans Couperus
Director Global Sales, Marketing, Business Development w2bi, Inc
Mobile Device Automated
Mobile Device Automated
Testing and Certification
Testing and Certification
:
:
Profit or Peril, Pain vs. Gain
Who is w2bi, Inc?
Who is w2bi, Inc?
Wireless To Business Integration
Supplier of software solutions to the Emerging – Mature Wireless Markets
Recognized Market Leader of Automated Device Testing Solutions
Solutions deployed in USA, Canada, Korea, Taiwan, and India
Owned by employees and management
Organically Funded from Direct Operations
Cash Flow Positive since Year 1
Consistent growth history throughout 10 years of operation
Headquarters and R&D in NJ, USA
Development and Support Center in Chennai, India
Comprehensive Test Lab in NJ, USA
Who is w2bi, Inc?
Products and Experience
Products and Experience
Is Your Mobile Device Testing Platform Multi-Sweet?
Device & Application Testing Mobile Applications Device Mgmt & Content Delivery Framework mVantage Q-GENERIC QUIKPROBE Q-DAAT QUIKDRIVE Q-POWER
Market Situation
•
Wireless subscriptions growth projected at 4B in 2010
•
Wireless device growth projected at over 3B in 2010
•
Number of device vendors expected to expand to meet
the above demand and supply increased market
diversification of devices.
•
Market pressure on Operator and OEM resources
¾devices becoming more complex
¾reduced time to market intervals
¾shortened non-overlapping market life-cycles.
•
Subscriber Contracts & Roaming Agreements Cannot
Operationalize Services
Mobile Device Testing
Lab –Network Emulated Live - Field Interop
Device
Launch
Testing OPEX Increases Safe for Network
RF Parametric Minimum Performance Signal Conformance Feature System Determination System Determination
OTASP / OTAPA / OTADM
MIP / DMU
SMS / EMS / MMS
ERI / E911
Data Thruput (1X/Rev 0/Rev A)
X
Benefits of Automated Device Testing
OPEX Savings
Addtl
Addtl
Benefits of Automated Testing
Benefits of Automated Testing
70% 240-960 180-660 MIP/DMU 61% 240-300 150-180
E911 (call processing)
39%
120-150 45-60
ERI - Roaming Verification
50% 180-240 90-120 OTAPA 50% 300-360 150-180 OTASP 39% 120-150 45-60
Data Throughput 1X / EvDO
39%
480-600 180-240
EvDO Hybrid Mode SD
42% 300-480 150-180 System Determination Derivable Benefits of Automation Manual Run Time (Minutes) Automated Run Time (Minutes) Lab – Network Emulated
Operator Specific Feature Test Plans
Fully Automated & Unattended Testing
Environment
¾ Tests are automatically executed, full control of both the handset and
emulation hardware
¾ No Need for User Intervention
¾ No Inconsistencies between test engineers
¾ Automation based on Qualcomm’s ICD specification
¾ Test pairs are automatically generated. If a PRL does not generate an appropriate test pair for a given test, the test is
automatically skipped
¾ Auto Run Time - 122 hrs (5 days)
¾ Man Run Time - 290 hrs (12 days)
- Does test consistently, cost-effectively, repeatedly - Does not take vacation, get sick, or change jobs
Why Test System Acquisition?
One of the most fundamental yet complex mobile device functions
Provides insight into how a device will interact with the Live network
The ability of a device to acquire the correct CDMA system when in either a home or roaming area is key to delivering a quality subscriber experience using cost effective wireless services
Prevents unnecessary loss of revenue or revenue turnover to competing roaming partners
Live Testing Challenges
CCF & w2bi Collaboration
Live Networks are dynamic and can impact testing reproducibility
Device behavior can be impacted by non technical factors
Finding the right live network conditions can require extensive travel
Live network testing provides limited insight into device performance
System Determination Test Groups 1x
7 ACQUISITION MATCH ONLY
2.18 17 MRU 2.15 25 OTASP DIALING 2.14 10 EMERGENCY CALL ON NEGATIVE SYSTEM
2.13
1 RESCAN TO A DIFFERENT GEO
2.12 3 WILDCARD SYSTEM ID 2.11 3 DEEP SLEEP 2.10 18 SYSTEM LOST DURING TRAFFIC STATE
2.9
20 SYSTEM LOST DURING IDLE STATE
2.8 26 SERVICE REDIRECTION 2.7 8 PRL Capacity TEST 2.6 44 SILENT REDIAL 2.5 48 RESCAN 2.4 3 NEGATIVE SYSTEM 2.3 8 AVAILABLE SYSTEM 2.2 17 ACQUISITION 2.1 Test Cases Test Case Description
Test ID
System Determination Test Groups 1x-EvDO
51 ACQUISITION MATCH ONLY
3.20 19 MRU 3.17 25 OTASP DIALING 3.16 9 EMERGENCY CALL ON NEGATIVE SYSTEM
3.15
1 RESCAN TO A DIFFERENT GEO
3.14 5 WILDCARD SYSTEM 3.13 9 DEEP SLEEP 3.12 133 SYSTEM LOST DURING TRAFFIC STATE
3.11
133 SYSTEM LOST DURING IDLE STATE
3.10 43 SERVICE REDIRECTION 3.9 5 PRL UPLOAD TEST 3.8 4 SYSTEM ACQUISITION DURING TRAFFIC STATE
3.7
5 VOICE CALL DURING A DATA SESSION
3.6 92 SILENT REDIAL 3.5 449 RESCAN 3.4 12 NEGATIVE SYSTEM 3.3 16 AVAILABLE SYSTEM 3.2 42 ACQUISITION 3.1 Test Cases Test Case Description
Test ID
Key Capabilities
Dynamically generates the needed RF
conditions from the PRL using w2bi patent
pending technology
Does not use any predefined presets to set RF
conditions on the emulation hardware
Supports any operators production or test PRL
loaded onto either the test device or system
Supports IS-683A and IS-683C formatted PRL
Test Environment
GPIB
RF
GUI / CONTROLLER
VENDOR C
Traditional Solution Strategy
VENDOR A
GUI / CONTROLLER GUI / CONTROLLER
VENDOR B
GUI / CONTROLLER
VENDOR D
Decreases flexibility…. Increases cost and expense
Increases Vendor Specific Training (times x)
Lack of Vendor Consistency and Standards for UI / Test Reports
Decrease of reusable assets, both human capital and equipment capital
Market Aligned Solution Strategy
Market Aligned Solution Strategy
VENDOR A
W2bi GUI / AUTOMATION
VENDOR B
VENDOR D
Vendor Neutrality enables choice…
… and is chosen most often
VENDOR C
Reduces Vendor Specific Training (times x) … Harmonizes testing experience
Standardized UI / Test Reporting… Commonality with OEM Lab Test & Certification
Enables Vendor Choices... preserving human knowledge base & vendor automation
Cross platform training of users … a thing of the past
Interruption Testing
Interruption Testing
Home
Roam
OTADM in progress…
Phone in roaming mode…
x
Comprehensive Results Rendering
Comprehensive Results Rendering
Text verification (OCR)
Text verification (OCR)
Image verification
Consistent & Comprehensive Log Reports
Consistent & Comprehensive Log Reports
Easily sharable results in two formats
HTML logs
EXCEL logs
Detailed information regarding the steps taken to execute each test and the corresponding results identify the exact point of failure
Thank you
Celebrating 10 years of your trust in us
Celebrating 10 years of your trust in us
Frans Couperus
Dir. Global Sales, Marketing, Business Dev w2bi, Inc 2401 Morris Avenue Union, NJ 07083 [email protected] +1.908.688.1700 x14 +1.732.259.0923 (m)
