Agile Test Automation & Outsourcing Todd Little Sr. Development Manager, Landmark/Halliburton.

Agile Test Automation & Outsourcing

Todd Little

Sr. Development Manager, Landmark/Halliburton

© 2009 Halliburton. All Rights Reserved. 2

Landmark Software and Services

Common Model Representation

Well data

Production data

Seismic data

Velocity data

Reservoir /Fluid data

Structural /Stratigraphic data

Common Model Representation

© 2009 Halliburton. All Rights Reserved. 3

A typical software project

When will we get the requirements?All in good time, my little pretty, all in good timeBut I guess it doesn't matter anyway

Doesn't anybody believe me?

You're a very bad man!

Just give me your estimates by this afternoon

No, we need something today!

I already promised the customer it will be out in 6 months

No, we need it sooner.

Not so fast! Not so fast! ... I'll have to give the matter a little thought. Go away and come back tomorrow

Ok then, it will take 2 years.

Team Unity

Project Kickoff

© 2009 Halliburton. All Rights Reserved. 4

We’re not in Kansas Anymore

My! People come and go so quickly here!

I may not come out alive, but I'm goin' in there!

The Great and Powerful Oz has got matters well in hand.

"Hee hee hee ha ha! Going so soon? I wouldn't hear of it! Why, my little party's just beginning!

Developer HeroReorg

Testing

© 2009 Halliburton. All Rights Reserved. 5

Hurricane Rita

© 2009 Halliburton. All Rights Reserved. 6

Uncertainty

We expect uncertainty and manage for it through iterations, anticipation and adaptation.

Inspect and Adapt

© 2009 Halliburton. All Rights Reserved. 7

Test Automation is the Safety Net

© 2009 Halliburton. All Rights Reserved. 8

Designing Quality into the Solution

Class

Unit Tests

Class

Unit Tests

Class

Unit Tests

Business Layer

IntegrationTests

UI

Acceptance Tests

© 2009 Halliburton. All Rights Reserved. 9

Nexus Reservoir Simulation

Next Generation Reservoir Simulation

© 2009 Halliburton. All Rights Reserved. 10

System Workflow

User Interface Graphical Pre-Processing Graphical Post-Processing

High Performance Cluster

© 2009 Halliburton. All Rights Reserved. 11

Challenges

Some Simulations take hours or even days Our Testers are Petroleum Engineers, not Test

Automation Specialists Numerical Simulation is an approximation and as

such is subject to round-off and/or perturbation differences

© 2009 Halliburton. All Rights Reserved. 12

System Workflow

User Interface Graphical Pre-Processing Graphical Post-Processing

High Performance Cluster

© 2009 Halliburton. All Rights Reserved. 13

Test Automation Approach

Breadth of Coverage

Com

plex

ity o

f Tes

ts

Mid-Tier

Developer Tests

Customer Models

GUI Tests (automated)

Every Checkin

Nightly

Nightly

Weekly

Smoke Tests (manual)

© 2009 Halliburton. All Rights Reserved. 14

Simulator Regression Tests over time

0

2000

4000

6000

8000

10000

12000

14000

16000

2006 2007 2008 2009 2010

Tes

t x

Co

mp

lexi

ty

Year

Regression Tests

Customer-BP

Customer(non-BP)

Mid Tier

Dev Tests

Customer X

Customer Other

© 2009 Halliburton. All Rights Reserved. 15

Global Expertise (Houston, Bucharest, Ho Chi Minh City)

18 Dev8 PE Test

3 Dev3 PE Test

4 Auto Test

© 2009 Halliburton. All Rights Reserved. 16

The Bottom Line

Known Issues at Ship

Defects Found in Beta

0 50 100 150 200 250

104

222

3

36

20102009

© 2009 Halliburton. All Rights Reserved. 17

Leverage Global Talent

© 2009 Halliburton. All Rights Reserved. 18

Think Globally and Optimize the Whole

© 2009 Halliburton. All Rights Reserved. 19

Automate – Automate - Automate

© 2009 Halliburton. All Rights Reserved. 20

Contact

Todd Little [email protected] www.toddlittleweb.com

Joe Hughes [email protected] www.logigear.com