Testing a Bluetooth Product With Web and Embedded Software

CYPRESS

PNSQC (15-17 Oct. 2001)1

Testing a Bluetooth Product With

Web and Embedded Software

Rick [email protected]

Cypress Semiconductors9125 SW Gemini Dr., Suite 200

Beaverton, OR 97008

CYPRESS

PNSQC (15-17 Oct. 2001)2

Purpose

Embedded & web based software have different constraints

Embedded & web based software have different tools

The embedded & web environments are merging Provide a planning example of a project in both

environments

CYPRESS

PNSQC (15-17 Oct. 2001)3

Presentation Structure

The process is in the paper Sample documents are in the appendix Slides available at

http://www.geocities.com/rick_clements/blue.ppt

CYPRESS

PNSQC (15-17 Oct. 2001)4

Overview

Product under test Scoping the effort The QA plan The test plan Questions Summary

CYPRESS

PNSQC (15-17 Oct. 2001)5

Internet

Product Under Test

Server

Server

Local PC

Bluetooth

CYPRESS

PNSQC (15-17 Oct. 2001)6

Scoping The Effort

Software environments Organization of the team Tools

CYPRESS

PNSQC (15-17 Oct. 2001)7

Software Environments

Internet & Windows Compatibility with different

servers running different OS Servers may be busy or

unavailable Large amount of memory

locally, storage locally and storage on servers

Tools for testing memory leaks, measuring test coverage and automating tests exist

Scoping The Effort

Embedded Runs on a single device Playing music requires real-

time limits of msec. A limited memory & storage Few off the shelf tools

CYPRESS

PNSQC (15-17 Oct. 2001)8

Possible Team Organization

Test & QA team per discipline– Software– Electrical– Mechanical

Single combined team System testing encompasses all disciplines

Scoping The Effort

CYPRESS

PNSQC (15-17 Oct. 2001)9

Organization Of The Team

Test lead Electrical, mechanical & software debug -

designers Embedded software - 1 software test engineer Windows & web software- 1 software test

engineer Internal mechanical & electrical - 1 mechanical

test engineer EMI & UL tests - 1 environmental test engineer

Scoping The Effort

CYPRESS

PNSQC (15-17 Oct. 2001)10

Tools

Windows and Internet - commercial test tool Embedded test tools developed internally

– This is a full development effort– It needs adequate planning, time & resources

Scopes, in circuit emulator, etc. Time at EMI and UL facilities will be rented

Scoping The Effort

CYPRESS

PNSQC (15-17 Oct. 2001)11

The QA Plan

Configuration management– Software / hardware changes– Typical change– Hardware description languages– Product / web configuration

Issue tracking

CYPRESS

PNSQC (15-17 Oct. 2001)12

Typical Change

Requirement for monitoring battery usage discovered

Add a gas gauge chip – Electrical & mechanical change

Add software driver for the chip Add software to display status on GUI Configuration management vitally important

QA Plan

CYPRESS

PNSQC (15-17 Oct. 2001)13

Hardware Description Languages

Blurs the line between software and Hardware Source easily managed Graphical environment - same issues as Windows Configuration management a “software thing”

QA Plan

CYPRESS

PNSQC (15-17 Oct. 2001)14

Product / Web Configuration

Web content changes quickly Software on PC changes more slowly Firmware in device changes more slowly Address in product & tests plans

QA Plan

CYPRESS

PNSQC (15-17 Oct. 2001)15

Issue Tracking

It’s a software problem Investigation shows electrical problem Fix it in software Must have a common tracking system

QA Plan

CYPRESS

PNSQC (15-17 Oct. 2001)16

The Test Plan Tools Hooks into the product Reviews Compatibility tests Host / device tests Stress tests Power tests Electrical & mechanical tests Schedule

– Schedules & staffing levels - Cem Kaner & Kathy Iberle papers

CYPRESS

PNSQC (15-17 Oct. 2001)17

Tools

Web & windows tool selection Embedded tool development Buy or rent tools for electrical and mechanical

tests

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)18

Hooks Into The Product

Affect the test approach Warning and status easier to test RS232 vs Bluetooth

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)19

Reviews

Catch error early High risk

– Interfaces– New technology– Tight timing requirements

Extendibility– Multiple languages– Multiple host platforms

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)20

Compatibility Tests

Product / web servers– Gold, silver & don’t care sites– Test when product OR site changes– On going management

Operating systems– Windows 95?, 98, ME, NT, 2000, XP?

Bluetooth cards in the host

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)21

Host / Device Tests

Protocol– Standard– Proprietary

Error handling– Handled by hardware– Handled by software

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)22

Stress Tests

Host Tests Low memory in host

Test Plan

Device Tests Play music, change

pages & download Automation

– Commands over Bluetooth– Two way communication

changes timing– Must be manual

CYPRESS

PNSQC (15-17 Oct. 2001)23

Power Tests

Operates over entire battery life - hardware Displays accurate battery life - software

Test Plan

CYPRESS

PNSQC (15-17 Oct. 2001)24

Electrical & Mechanical Tests

Internal Tests Heat

– Operation– LCD readable

Drop tests Shipping container

Test Plan

Agency Tests EMI UL

CYPRESS

PNSQC (15-17 Oct. 2001)25

Summary

Many different areas– Web software– PC software– Embedded software– Electrical– Mechanical

You can’t be an expert in all areas You need a good team