Plugtests is a professional ETSI service

1

PlugtestsTM

The ETSI Interoperability Service

March 2005

2

ETSI is…

A non-profit organization, Recognized Standards Development Organization

Based in Sophia Antipolis, south of France

688 members from 55 countries http://www.etsi.org/

ETSI are… manufacturers, network operators, service providers administrations, research bodies and users

providing a forum in which all key players can contribute: GSM, UMTS, DECT, TETRA, SAT COM, DVB, NGN, VoIP, BRAN, Powerline, IP Cablecom, …

3

Plugtests is a professional ETSI service

Created in 1999, specialized in the organization oftest events

Cost neutral Skilled ETSI Staff managing test events Experts from ETSI and other technical communities Neutral and open to all organisations Synergy Conformance & Interoperability in close

cooperation with ETSI Committees and PTCC

57 events in 5 years, 3000 engineers, 900 Companies 1600 participants surveyed ranked usefulness at 4.3/5

and Service satisfaction 4.35/5 IPv6 Plugtests in October 2004 was the

4

The ETSI testing & interoperability Resources are unique…

TC MTS (Methods for Testing and Specification) Development of methodologies, techniques and languages http://portal.etsi.org

ETSI PTCC (Protocol and Testing Competence Centre) Supports ETSI TBs on the application of formal techniques in

standards on a daily basis Development of test specifications (conformance and interop) http://www.etsi.org/ptcc

ETSI Plugtests Service Validation of standards and prototypes through

interoperability events http://www.etsi.org/plugtests

…and complimentary!

5

Who attends Plugtests events?

Our events are open to all sorts of companies (big and small) as well as engineers developing a product,

Participants do NOT have to be ETSI members

Plugtests are addressed to any company developing a product such as operators, vendors or equipmentmanufacturers, content providers orapplication providers

Standardization bodies, Fora or interest groups may also attend

6

During a Plugtests event, engineers can“Come & Test” !

Also known as bake-off (at IETF), plugfests and interop

Plugtests : Provides useful feedback to the standardization process Gives a unique opportunity to meet partners and

competitors Helps to ensure end users’ satisfaction Improves both quality and features of implementations Allows for networking with the market key players Accelerates time to market via quick product debugging

COST & TIME SAVING !

7

Plugtests look like this…

Oh I’ve found a BUG!!!!

8

PlugtestsTM :Your Fully Customizable Service

TechnicalManagement

Customized test bed, test cases set-up with experts, tests slots schedule…

EventManagement

Website, registration on-line, hosting site, legal aspects..

CommunicationManagement

Event promotional kit development, event presentation at key conferences, dissemination by internal/international press…

SponsorshipOpportunities

Sponsor us! Your value…www.etsi.org/plugtests/sponsorus

9

Areas of interest

SERVICES & APPLICATIONS J2ME, OSA-PARLAY, Video over DSL, OMA IMPS, SyncML

TELECOM Hiperlan2, DSL, SMS/MMS, NGN, Speech Quality, Powerline,

Smart Card..

IP IPv6 and Mobile IPv6, MPLS, SIGTRAN, SIP

HOT TOPICS Grid Computing, WLAN/WMAN, LBS & ITS, Security, RF-ID,

ebXML

10

Speech Quality Tests Events at ETSI: What has been done so far

1st SQTE, October 2000 – test labs HEAD acoustics, Deutsche Telekom – NDA– Anonymized

report:http://www.etsi.org/plugtests/History/2000VOIP1.htm

2nd SQTE, April 2002– test labs HEAD acoustics, Deutsche Telekom– NDA– Anonymized report:

http://www.etsi.org/plugtests/History/2002VOIP2.htm

33rdrd SQTE SQTE June and September 2004June and September 2004, “twin event” EU, US – Test laboratories of Head acoustics Europe & USTest laboratories of Head acoustics Europe & US– NDA & tutorialNDA & tutorial– Anonymized reports on Phones and Gateways: Anonymized reports on Phones and Gateways:

http://www.etsi.org/plugtests/History/2004SQTE.htm

NGN & VoIP, November 2004– Short VoIP tests (light programme provided by Head Acoustics)

11

Goals of ETSI Speech Quality Tests Events

Evaluate all conversational aspects

Listening speech quality (“status quo”) Detailed parameter tests Echo measurements, EC implementation Double talk performance tests Quality of background noise transmission

In order to Compare different implementationsCompare different implementations Document the state of the arte of technologyDocument the state of the arte of technology Give input to standardizationGive input to standardization Help companies to optimize their implementationsHelp companies to optimize their implementations

12

Test Setup Gateways

Condition Packet Loss (Equal) Additional Delay1 Delay Variation

1a 0 0 No

2a 1% 0 No

3a 2% 0 No

4a 3% 0 No

5a 5% 0 No

6a 1% 50 ms 20 ms (2)

G a t e w a y

I P

E 1

N I S T N e t

P a c k e t M O N I T O R

E 1

P a c k e t L o s s D e l a y

O u t p u t

H E A D a c o u s t i c s T e s t S y s t e m AA CC QQ UU AA

I n p u t

G a t e w a y I P I P

I S D N D S S 1 I S D N D S S 1

P B X

Condition Packet Loss (Equal) Additional Delay1 Delay Variation

1b 0 0 No

2b 5% 0 No

3b 0 50 ms 20 ms (2)

4b 5% 50 ms 20 ms(2)

13

Test Setup IP-Phones

IP NISTNet

Packet MONITOR

E1

Packet Loss Delay

Output

HEAD acoustics Test System AACCQQUUAA

Input

Gateway IP

ISDN DSS1

PBX

IP

IP Terminal

(Phone or PC)

Condition Packet Loss (Equal) Additional Delay1) Delay Variation

1c 0 100 ms No

2c 0 100 ms 20 ms(2)

3c 1% 100 ms No

4c 1% 100 ms 20 ms(2)

5c 3% 100 ms No

Condition Packet Loss (Equal) Additional Delay1) Delay Variation

1d 0 100 ms No

2d 3% 100 ms No

3d 0 100 ms 20 ms(2)

4d 3% 100 ms 20 ms(2)

14

ETSI SQTE events in 2005-2006

STQ mobile remote test event, April 2005 Workshop on STQ testing initiatives,

Lannion, 29 April 2005 4th SQTE Asia, Big (heavy program),

Taiwan (CCL/ITRI) campus, 7-11 November 2005 Supported by Head Acoustics lab,

CCL/ITRI, ETSI STQ TC and Plugtests Hosted by CCL/ITRI NDA & tutorial to participants Anonymized report

2nd SQTE (light program), Taiwan (CCL/ITRI) campus,14-18 November 2005 Supported by Head Acoustics lab,

CCL/ITRI, ETSI STQ TC and Plugtests Hosted by CCL/ITRI Light tests Workshop & conference

5th SQTE Europe, February 2006, heavy program

15

2005: Hot technologies in the pipeline

Q1 WLAN RoamingRFIDOSA-Parlay (PARLAY X)

Q3SQTEUWB

Q2STQ-mobileENUMNGN@HomeF-SMS/MMSDSL#4

Q4Smart CardGRID IPv6#6WIMAXPowerline#3

www.etsi.org/plugtests/calendar.htmwww.etsi.org/plugtests

[email protected]

16

ETSI European Telecommunications Standards Institute

ISDN integrated services digital networkGSM Global System for Mobile Communications

(cellular phone technology)UMTS Universal Mobile Telecommunications

SystemDECT Digital European Cordless

Telecommunication systemTETRA TErrestrial TRunked RAdioSAT COM Satellite CommunicationsDVB Digital Video Broadcasting NGN Next Generation NetworksVoIP Voice Over IP (Internet Protocols)BRAN Broadband Radio Access Networks Powerline, PLC Powerline Communications :

The transmission of information using the existing power

IP Cablecom : Internet Protocol Cable Communications

SDO Standards Development OrganizationsOSA Open Service Architecture,Open Service

AccessSIPIT SIP Interoperability testsSIP Session Initiation ProtocolENUM E.164 Number MappingSQTE Speech Quality Test EventPKI Public Key InfrastructureXAdES XML Advanced Electronic Signatures

ebXML Electronic Business XML (eXtensible Markup

UWB Ultra-Wide BandSIGTRAN Signaling Transport DSL Digital Dubscriber Line IPv6 Internet Protocol version 6 (current version

is version 4)MIP6 Mobile IPv6GRID Computer Grid (like power grid)SMS Short Message Service MMS Multimedia Message Service J2ME Java 2 Micro Edition IETF The Internet Engineering Task ForceTTCN The Testing and Test Control Notation

(Tree and Tabular Combined Notation)W3C World Wide Web ConsortiumTC ESI Technical Committee Electronic

Signatures and InfrastructuresOASIS Organization for the Advancement of

Structured Information StandardsCEN/ISSS Information Society Standardization

System (European Committee for Standardisation)

WLAN Wireless LAN WIMAX Worldwide Interoperability for Microwave

Access HF Human Factors

Acronyms