Testing 4G Ahead of the Curve Automation, is it even an option?
Jan 05, 2016
Testing 4G Ahead of the Curve
Automation, is it even an option?
4G Technical Benefits
Source: Motorola
4G Technical Benefits
Source: Motorola
4G Business Benefits
Expanded Services + New Services + Less Cost
= More Revenue
The Next Chapter in the
War for subscribers
Companies already in Trials
4G is Complex
Source: Kineto Wireless
4G is Another Layer
Source: Alcatel-Lucent, Fibresystems.org
4G Complexity is Daunting
New Technology Equals Churn
• New Devices / Standards - Daily
• High Feature Velocity
• Rapid bug fix releases
This makes an already challenging problem quite frustrating
Test Area:– Formfactors / Design
– FPGA
– Processors
– Display
– Keypad
– Touchscreen
– Camera
– Microphone
– Battery and Charger
– Data Cables (Video, USB)
– Headset
– Headset Bluetooth
– Lamp
– Storage
– Data Card (removable)
• Radio Interface (RF)
physics & controlEn-/Decoding
Throughput
• IR
• Bluetooth
• WiFi
• FM Radio
• GPS
• Additional keys for e.g.
• Loudness
• Camera
• Switch on/off
• Sensors (if applicable)
Hardware and Interfaces Software and Interfaces• Platform Capabilities
– Operating System (S60, Windows Mobile etc)
– Platform SDK
• Security• Audio
• Quality
• Codecs
• Voice recording
• Speech recognition (Voice dialling)
• Video• Quality
• Codecs
• Video recording
• Content and File Management
• DRM
• File Manager
• Data transfer via BT, IR, USB
• Graphics
• Applications without network interaction– Music
– Gaming
– Java
– Phonebook
– Calendar
– Clock / Alarm / Worldclock
– Editor
– Document viewer
– Caculator
– Currency converter
– GPS
– Radio FM
• Applications with network interaction– Mobile TV
– SMS
– MMS
– Download, upload files, pictures, videos
– Interactive gaming
– Calendar synchronisation
– Push to talk
– Web browsing
– WAP
– Call Register (in / out / missed)
– VoIP
– IPv6
• Application Interactions – With and without network interaction)
• Application running from Memory Card• Flight Mode
• Concurrency e.g.– Mobile TV and incoming call– Write SMS and incoming call– Receive SMS/MMS during Call– Receive call while any of the applications is running– Video Conference and MMS– Streaming service and incoming/outgoing call– Upload data and and incoming/outgoing call– ...
Layer 2/3 Protocol Testing (Network Signaling) GSM/GPRS/EDGE UMTS/HSPA LTE (example follows)
• Module Testing
• HW/SW Integration• System Integration
2G/3G Mobility IntraRAT-Handover InterRAT-Handover
Protocol Conformance Testing ( ->GCF)
• Services e.g.– Supported Bearers
• SIP / IMS applications (as VoIP !!)
• MBMS (as Mobile TV)
• Different Qos/QCI (=QoS class Identifier in LTE)– Bearers in parallel– Supplementary services (CLIP/CLIR...)– Location Based Services
• Throughput measurements• Performace Testing• IODT• IOT• Drive / Field tests• Type Approval
Testing Ahead of 4G
• 4G is another order magnitude on top of the existing infrastructure
• Profitability and company viability on the line.
• Unbelievable Technology Churn
• Less ability to test manually
• Script based testing is failing
Will Your 4G be on Time?
Can you take a feature test and get it into regression before you release the product or service?
Can you run a full regression suite on a new service, new device feature, or a device software update in less than a week? In two days?
No? Better hope your competitor can’t