The Speed to Cool: Agile Testing & Building Quality In

The

Speed to Cool:

Agile Testing

& Building

Quality In

Craig Smith

Adrian Smith

4

Welcome…

“Eyyy!”

Image: © Fuzzy Door Productions / 20th Century Fox Television A C

5

Welcome…

Image: © Universal Pictures http://cf1.imgobject.com/backdrops/8af/4bc92693017a3c57fe00f8af/twins-original.jpg

Not

Related…

C

6 Image:http://techfreep.com/images/fosters.jpg

Not

Australian

for Beer!

C

7

The speed

to cool…

Image: Pineapples101 (Flickr) http://www.flickr.com/photos/pineapples101/4292778673/in/set-72157623131356129/ C

8

Thumbs up…

Cool!

Image: http://brainsyndicate.files.wordpress.com/2011/05/tumblr_lkp6t8505s1qe4wjro1_400.jpg?w=300&h=355 C

9

Choke...

Image:http://blog.vidyagamez.com/wp-content/uploads/2010/06/tumbleweed.jpg C

10 Image: http://rnstechnologies.com/content_images/small_image_2.jpg/

So, What is a

Tester?

A

11

Look left… Look

right…

A

12

Look up…

Image: http://3.bp.blogspot.com/_RdF7S0TNAHY/TOqn8MLYajI/AAAAAAAAAJI/QDBFdixiq0E/s1600/2006-06-17%252520Falling-piano.gif A

13

CSI: Software

Image: © Jerry Bruckheimer Television http://images2.fanpop.com/images/photos/4700000/CSI-Las-Vegas-9x18-Mascara-csi-4772098-2000-1333.jpg C

14 Image: http://3.bp.blogspot.com/_ZdyzysU1QPo/TA0kjLMP43I/AAAAAAAABPk/5ckzpw6OVmk/s1600/Peas+and+Carrots.JPG

Agile &

Testing

C

15

We reflect work like

this...

To Do Analysis Develop Test Done

C

16

Which is really

working like this...

To Do

Analysis

Develop

Test

Done

C

17

Remind you of

something?

Image: Craig Smith C

18

Testers in an agile team

Analyst /

Customer

Developer Tester Automation

Elaboration /

Specification Acceptance

Criteria

High

Performing

AGILE

Project

Manager

C

19

Testers in an agile

team

Developer

Tester

Analyst

More

Technical

Less

Technical

Co

de

De

sig

n

Un

it T

es

t

Au

tom

ate

d

Fu

nc

tio

na

l /

Sp

ec

iali

st

Te

sts

Ma

nu

al

Te

st

Ex

plo

rato

ry

Te

st

Re

qu

ire

me

nts

Cu

sto

me

r

Co

lla

b.

Developers need

more testing involvement

Testers need more

technical involvement

Analysts need more

testing involvement

C

20

Definition of

Quality…

(noun) the standard of something as measured

against other things of a similar kind; the degree

of excellence of something oxforddictionaries.com

Image: http://www.naccho.org/topics/infrastructure/accreditation/images/Quality-Definition.jpg / A

21

Quality means

different things

Image: http://upload.wikimedia.org/wikipedia/commons/b/b9/Steve_Jobs_Headshot_2010-CROP.jpg A

22

Implicit / Explicit Quality

Image: http://s3.amazonaws.com/integral-life-home/iceberg.jpg A

23

Testing ≠

Quality

A

24

Building Quality

In

Image: http://www.cupojoy.com/images/image/Quality%20Inn%20Exterior.jpg C

25

Quality is everyone’s

responsibility

Image: © AP http://i.telegraph.co.uk/multimedia/archive/01893/schumaker-dummies_1893704i.jpg C

26 Image: © Reveille Productions http://blogs.ubc.ca/kdergous/files/2010/10/body-language-the-office.jpg

Everyone likes to be

seen to value

quality

C

27 Image: © United Feature Syndicate http://s458.photobucket.com/albums/qq310/mrbigjohnson/Murals/?action=view&current=NovemberPics115.jpg&newest=1

Quality

from kickoff

C

28

Success sliders

1 2 3 4

Cost Scope Quality Time

X

X X

X

Fixed

Flexible

C

29

1 2 3 4

Cost Scope Quality Time

X

X X X

Fixed

Flexible

Your

Turn!

Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A

30

1 2 3 4

Cost Scope Quality Time

X

X

X

X

Fixed

Flexible

Quality almost

always at number 3

A

31

Correctness

A

32

Re

lia

bil

ity

Ro

bu

stn

es

s

Av

ail

ab

ilit

y

Inte

gri

ty

Fle

xib

ilit

y

Us

ab

ilit

y

Inte

rop

era

bil

ity

Eff

icie

nc

y

Te

sta

bil

ity

Ma

inta

ina

bil

ity

Re

us

ab

ilit

y

Po

rta

bil

ity

Reliability + + + + - + +

Robustness + + + -

Availability + +

Integrity - - - - -

Flexibility + - - + + +

Usability + - -

Interoperability - + - +

Efficiency - - - - - - - -

Testability + + + + - +

Maintainability + + + - +

Reusability - - + + - + + +

Portability + - + - + - +

Quality Trade-

offs

A

33

Defining Quality

Quality Advocates

What does quality mean to the different roles in

the team?

Quality Taxonomy

What are quality attributes?

Quality Prioritisation

How do we know what quality attributes to

include?

Quality Tradeoff Risks

What are risks with the quality attributes we are

trading off?

Quality Measurement

How do we test and measure quality?

Success Sliders

How does quality relate to the sliders?

Quality Definition

What does quality mean?

Next Steps How do we apply

quality to our work

1

2

3

4

5

6

7

8

C

34

Quality Definition

C

35 Image: © 2008 Melissa McKenney http://www.kernel.org/pub/linux/kernel/people/paulmck/Confessions/Elephant_Team_03.jpg

Shared understanding

of quality

C

36 Image: http://www.thechildmindingshop.co.uk/ekmps/shops/thecs/images/table-chalkboard-and-white-board-in-one-%5B2%5D-5540-p.jpg

Strategy

& Plan

A

37

Simple test

strategy & plans

A

38

Simple test

strategy

A

39 Image: © Sesame Workshop http://images.wikia.com/muppet/images/9/95/Sesame-english-do-you-like-it-apple_count.jpg

Reporting

& Metrics

C

40

Understand continuous integration

Image: http://confluence.atlassian.com/download/attachments/229837908/bamboo-dashboard.png?version=2&modificationDate=1297756308930 C

41

Understand code

metrics

Image: http://docs.codehaus.org/download/attachments/111706381/dashboard.png?version=2&modificationDate=1267794480088 C

42

Report how

testing is going

Image: http://1.bp.blogspot.com/-46_MdfmjelA/TVa-kb3lTJI/AAAAAAAAABU/JU38qkUXf2c/s1600/half-full-glass.jpg C

43

Your

Turn!

Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg

#1

A

HEALTH

PROJECT

DEVELOPMENT

TESTING

USER

0

1

2

3

4

5

0

1

2

3

4

5

6

7

1 2 3 4 5 6 7 8

New

Ris

ks &

Issues R

ais

ed

Num

ber

of

Ris

ks &

Issues

Iteration TEST

COVERAGE

0

5

10

15

20

25

0

1

2

3

4

5

6

7

8

9

1 2 3 4 5 6 7 8

Num

ber

of

Tests

Num

ber

of

Defe

cts

Iteration

MAINTAINABILITY PERFORMANCE 0

200

400

600

800

1000

1200

1400

1600

1800

4700

4800

4900

5000

5100

5200

5300

5400

5500

5600

5700

1 2 3 4 5 6 7 8

Lin

es o

f T

est C

ode

Lin

es o

f C

ode

Iteration

OVERALL

$-

$5

$10

$15

$20

$25

$30

0

1

2

3

4

5

6

7

8

9

1 2 3 4 5 6 7 8

Busin

ess V

alu

e

Num

ber

of

Featu

res

Iteration

BVC

A

45 Image: http://artegami.com/wp-content/uploads/2007/08/toysrus_karate_kid.jpg

Agile Testing

Practices

C

46 Image: © The Curiosity Company / 20th Century Fox Television http://images2.fanpop.com/images/photos/3200000/fry-bender-futurama-3295254-1024-768.jpg

Low Value vs High Value

C

47 Image: http://seleniumhq.org/projects/ide/

Good:

Basic Automation

C

48 Image: http://cukes.info/

Better:

ATDD / BDD

Plain text test

Production code

Step definition

C

49 Image: http://www.concordion.org/

Best:

Specification by example

C

50 Image: © Gracie Films / 20th Century Fox Television http://www.widewallpapers.net/mod/cartoons/simpsons/simpsons-1920x1200-021.jpg

Quality

Maturity

A

51

Agile Quality

Practices

A

52

Team Self-

Assessment

A

53

Quality Requirements

A

54

Quality Development

A

55

Quality Testing

A

56 Image: http://concordion.org/image/example/online-shop/AcceptanceTest.png

Quality Team

A

57

Your

Turn!

Image: http://4.bp.blogspot.com/-B0hIC1RPJpA/TZjq1IcJF3I/AAAAAAAAGdE/wlJdjuLCWoE/s1600/audience.jpg A C

No agreed approach to testing

Tests are not considered a valuable asset

An agreed approach to testing that is aligned to a definition of quality

Tests are considered a valuable asset that can be reused as features

are progressively implemented

Test strategy is agreed and understood by the team and includes

targets (coverage, defects, …)

Test strategy is documented and visible as a BVC used by the team

Non-functional requirements are agreed and included in the test

strategy

Test planning is based on risk (technical complexity and business

impact)

Test artifacts are treated with the same importance as code and are

properly maintained and refactored

The relevant ____ility and security tests form part of the test strategy

-1

1

2

3

4

Test Planning

A C

59 Image: © Orion Pictures http://sadair.com/wp-content/uploads/2010/07/Robocop_Final012-1024x768.jpg

ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENF

RCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: THE FUTURE O

F LAW ENFORCEMENT ROBOCOP: THE FUTURE OF LAW ENFORCEMENT ROBOCOP: TH

Empowering

Testing

C

60

Automation:

I work with developers to

automate tests that provide

business value and identify

system risks

Collaboration:

I work with analysts and SMEs to

ensure that testable acceptance

criteria are created for all stories

Strategy & Planning:

I am involved in the project at all

stages to ensure that testing

provides the greatest value and

quality objectives are achieved

Tools & Techniques:

I use both manual and

automated techniques using the

preferred testing tools based on

the situation

Architecture:

I have an understanding of the system

architecture and can create tests that

verify individual components and the

system as a whole Development:

I take an interest in

development practices and

monitor code quality metrics

Estimating:

I am involved in developing

estimates for projects at a story

level, for tools and infrastructure

and also for deployment/release

activities

Reporting:

I provide metrics that give

insight into project health and

system quality

Agile:

I understand Agile project delivery

and the differences between testing

in the different phases of an phase

Qualifications & Training:

I have recognised qualifications in

testing and continually update and

maintain my skills

Recruitment & Development:

I am attracted to the organisation

because testing is a cool career path

that offers heaps of opportunities and a

way of continually developing my skills

Community & Teams:

I am part of a community of

testers that are embedded

within teams but share

common values

Future tester A C

61

Testing Skills

Image: http://houndbound.com/dogblog/wp-content/uploads/2009/09/pug_graduate1.jpg A

62

Architecture Skills

Image: http://www.invermodels.co.uk/portfolios/sheriff.jpg C

63

Technical Skills

Image: http://www.logicalnetworking.net/wp-content/uploads/2010/02/TuxInSchoolComputerLab.jpg A

64

Share with

community

Image: http://www.linkline.org.uk/poster/images/Banner.png C

65

Tools & Automation

Image: Martha (Picasa) http://lh3.ggpht.com/_9kYHVyqm3zs/S70g1BiNILI/AAAAAAAADho/A4vuRNMTs50/IMG_7956.JPG A

66

Get Involved

Early

Image: http://eventstrategysolutions.com/wp-content/uploads/2010/10/early-bird.jpg C

67

Queue To

Join

Image: http://blogs.jcvi.org/wp-content/uploads/2009/11/emperor-queue.jpg C

68 Image: © Chuck Lorre Productions http://24.media.tumblr.com/tumblr_ksvfroko3J1qa88nco1_500.jpg

Wrap

Up

C

69 Image: © Jerry Bruckheimer Television http://photos.telestrekoza.com/var/resizes/Current_shows/CSI/Stills/CSI-Trilogy-Crossover/Miami_8x07/CSI-Miami-Episode-8-07-Bone-Voyage-Promotional-Photos-csi-miami-8507515-1999-1315.jpg

Do you have a testing skillset

(or are you just doing testing)?

C

70 Image: http://www.swotti.com/tmp/swotti/cacheDMLSBGFNZSBWZW9WBGU=/imgVILLAGE%20PEOPLE1.jpg

Does everybody understand their role in

quality?

A

71 Image: © HiT Entertainment / Hot Animation http://1.bp.blogspot.com/-iLEyvBHn-W0/TglUWW5Or0I/AAAAAAAAAds/HXtPDGPLghA/s1600/bob+the+builder.jpg

Are you building quality in from the

start?

A

72 Image: © Talent Associates http://confoundedinterest.files.wordpress.com/2011/06/maxwellsmart_missed_it_by_that_much.jpg?w=600&h=423

Are you measuring testing and assessing

quality?

C

73 Image: © King Features Syndicate / Lee Falk http://www.comicwallpapers.co.uk/images/main/Miscellaneous/Other/1600900/PhantomGen_1010.jpg

Are you hunting

down best practices?

A

74

Are you testers

empowered?

Image: © DC Comics http://collider.com/wp-content/uploads/superman_alex_ross2.jpg A

75

Don’t forget to use

(or improve) our quality templates

C

76

Testing is cool…

Image: © Miller-Milkis Productions http://imagetime.co.gp/key/henry%20winkler%20ron%20howard# C

77 Image: © Universal Television http://30.media.tumblr.com/tumblr_l6g4d631K31qzp4mwo1_r1_500.jpg

...but I love it when quality

comes together

C

78

Questions

???

Craig Smith

http://www.suncorp.com.au

http://www.agileacademy.com.au

http://www.craigsmith.id.au

craig.smith@suncorp.com.au

@smithcdau

Dr. Adrian Smith

http://www.ennova.com.au

http://www.agileengineeringdesign.com

adrian.smith@ennova.com.au

@adrianlsmith

79

The Agile Academy is the next wave in Agile learning and collaboration. Designed for

IT professionals, the Agile Academy is a knowledge hub that promotes Agile related

learning, knowledge sharing and capability development across the IT industry. We

offer an integrated curriculum of leading edge courses across the entire solution

development life cycle, covering all roles at varying levels.

(http://www.agileacademy.com.au)

Suncorp is one of Australia and New Zealand's largest diversified financial services

providers, supplying banking, insurance and wealth management products to around

9 million customers through well-established and recognised brands such as AAMI,

Australian Pensioners Insurance Agency, Shannons, Vero, Asteron and Tyndall, as

well as Suncorp and GIO. Today, Suncorp is Australia's fifth largest bank and second

largest domestic general insurance group, with over 16,000 staff. Suncorp has

representation in 450 offices, branches and agencies throughout Australia and New

Zealand. (http://www.suncorp.com.au)

Ennova is a software development company that specialises in helping businesses

optimise their use of technology. We are passionate about what we do and have

embedded Agile and Lean thinking into our approach to everything. This enables us

to rapidly deliver high quality software solutions that provide long term business

value. Our Agile and Lean consulting services draw on an diverse experience base

that spans the engineering, manufacturing, construction and financial services

industries. Additionally, Ennova is active in the development of software products

and therefore has first hand practical experience in the application of Agile and Lean

methods.

(http://www.ennova.com.au)