Leveraging Global Talent for Effective Agility

Landmark and a search for a web strategy

Leveraging Global Talent for Effective AgilityTodd LittleSr. Development Manager, Landmark/Halliburton

Joe HughesVPLogigear

2009 Halliburton. All Rights Reserved.#Drilling and CompletionsLandmark E&P EcosystemCollaborative Applications Data Management Modern Platform Expert Services

SURVEILLANCEFIELDPLANNINGEARTHMODELINGGEOLOGYGEOPHYSICSBASINREPORTINGDESIGNSIMULATIONREAL-TIMEOPTIMIZATIONData ManagementDecisionSpace PlatformProductionReservoirGeosciencesServices and Support 2009 Halliburton. All Rights Reserved.#2Petroleum Reservoir Simulation

2009 Halliburton. All Rights Reserved.#3System Workflow

User InterfaceGraphical Pre-ProcessingGraphical Post-ProcessingHigh Performance Cluster 2009 Halliburton. All Rights Reserved.#4ComputingChallengesSome Simulations take hours or even days, or even Our Testers are Petroleum Engineers, not Test Automation SpecialistsNumerical Simulation is an approximation and as such is subject to round-off and/or perturbation differences

2009 Halliburton. All Rights Reserved.#5

Managing the Coming Storm Inside the Tornado When will we get the requirements?

All in good time, my little pretty, all in good time

But I guess it doesn't matter anyway

Doesn't anybody believe me?

You're a very bad man!

Just give me your estimates by this afternoon

No, we need something today!

I already promised the customer it will be out in 6 months

No, we need it sooner.

Not so fast! Not so fast! ... I'll have to give the matter a little thought. Go away and come back tomorrow

Ok then, it will take 2 years.

Team UnityProject Kickoff 2009 Halliburton. All Rights Reserved.#6We look at a typical software project..

Were not in Kansas AnymoreMy! People come and go so quickly here!

I may not come out alive, but I'm goin' in there!

The Great and Powerful Oz has got matters well in hand.

"Hee hee hee ha ha! Going so soon? I wouldn't hear of it! Why, my little party's just beginning!

Developer HeroReorgTesting 2009 Halliburton. All Rights Reserved.#7Agile/Scrum in a Nutshell 24 hours1-4 weeksRelease Backlog

Backlog tasksPotentially ShippableProduct IncrementIteration Backlog 2009 Halliburton. All Rights Reserved.#Lan Cao - Estimating Agile Software Project Effort: An Empirical Study

2X Uncertainty, 2009 Halliburton. All Rights Reserved.#Lessons learned: If uncertainty is high, work on it earlier. Reduce Technical DebtGet to potentially shippable at each iteration. Finding and fixing the last bugs has high uncertainty plan on there being uncertainty.9System Workflow

User InterfaceGraphical Pre-ProcessingGraphical Post-ProcessingHigh Performance Cluster 2009 Halliburton. All Rights Reserved.#10Test Automation WorkflowInputOutputBaselineSimulateDifference EngineReport 2009 Halliburton. All Rights Reserved.#11Testing and Automation StrategyBreadth of CoverageComplexity of TestsMid-TierDeveloper TestsCustomer ModelsGUI Tests (automated)Every CheckinNightlyNightlyWeeklySmoke Tests (manual) 2009 Halliburton. All Rights Reserved.#Simulator Regression Tests over time

Customer XCustomer Other 2009 Halliburton. All Rights Reserved.#Record Playback Test Automation

Number of automation programs

Number of tests automated

Test : test program ratio = 1:1The more tests the greater the maintenanceReached limit of maintainabilityAutomation effort vs. number of test 2009 Halliburton. All Rights Reserved.#14

Action Based Testing

Number of automation programs

Number of tests automated

Test : test program ratio < 1:1Need for added automation declines.Long-term maintainable.Automation effort vs. number of test 2009 Halliburton. All Rights Reserved.#15Global Expertise (Houston, Bucharest, Ho Chi Minh City)

15 Dev6 PE Test2 Pgm Mgr2 Prod Mgr3 Dev3 PE Test4 Auto Test 2009 Halliburton. All Rights Reserved.#16The Bottom Line97% Reduction 2009 Halliburton. All Rights Reserved.#17Automation Across Halliburton# of Projects23# of Test Automation Engineers76# of Test Cases Automated11,018

Leveraged Investment9x 2009 Halliburton. All Rights Reserved.#1885% reduction in testing man-hours per month.Man-hours/month105,770The Bottom Line23 projects76 automation engineers11,018 test cases automated

19Overcoming Outsourcing Challenges

2009 Halliburton. All Rights Reserved.#20Outsourcing Challenge: Proprietary Data

2009 Halliburton. All Rights Reserved.#21Outsourcing Challenge: Time Shift

8 hours12 hours 2009 Halliburton. All Rights Reserved.#22Outsourcing Challenge: Xenophobia

2009 Halliburton. All Rights Reserved.#23Key Take AwaysFind and Correct Defects Early to Reduce UncertaintyA Testing Strategy Helps to Maximize EfficiencyTest Automation Helps to Maintain VelocityOutsourcing Can Work When Used Judiciously.Treat Outsourcer as a PartnerCost Effective Global TalentDistributed Teams Can be EffectiveTest Automation Does not Replace Exploratory Testing

2009 Halliburton. All Rights Reserved.#24Leverage Global Talent

2009 Halliburton. All Rights Reserved.#25Think Globally and Optimize the Whole

2009 Halliburton. All Rights Reserved.#26

Automate Automate - Automate 2009 Halliburton. All Rights Reserved.#27ContactTodd [email protected]

Joe [email protected]

2009 Halliburton. All Rights Reserved.#28Chart15000200120057703001500646150017001650785275028004300821345055005250

Dev TestsMid TierCustomer(non-BP)Customer-BPYearTest x ComplexityRegression Tests

Tests vs TimeComplexity Factor155050YearDev TestsMid TierCustomer(non-BP)Customer-BPDev TestsMid TierCustomer(non-BP)Customer-BP2006500042450002001200200757706305770300150020086463003433646150017001650200978555056867852750280043002010821690110105821345055005250

Tests vs Time

Dev TestsMid TierCustomer(non-BP)Customer-BPYearTest x ComplexityRegression Tests

Bugs vs TimeYearVersionTester DaysTARSDefectsClosedp0/p1Closed p1p0p1p0 DRE2007Cycle11+67560548033169%2008R5000.0.11118103072762686%2009R5000.0.22165201316721235109589%2010R5000.0.31244112490071754276%

SDS Chart000000700120000000800150200800020010002002025012552011025025054536366320110345289

V2N-BPN2N-BPV2N non-BPN2N non-BPE2VE2V2N2NV2VN2NV2N

SDS DataSDSYearV2VV2NN2NV2N-BPN2N-BPV2N non-BPN2N non-BPE2VE2V2N2N2006701200000000200780150000000020081002000000200200911025025020250125520201011028934554536366320OSsXP32,L64,W7x64XP32,L64,W7x64XP32,L64,W7x64L64,W7x64L64,W7x64L64,W7x64L64,W7x64XP32XP32XP cpu hours1.52.5400012Lin cpu hours1233000002655001510960000W7 cpu hours1233000002700001511000000total CPU hrs3.56.5106000005355003021960012

WhatIsThis60.8710373.4113.6222.32818.327.688.6616.23103.2770.8714.5303.21548.79544.239.022916.967.9960.87438.47323.91918.460.81439.5153.92797.81668.35129301706.91671.31281.2295.2536.1907.1774.7453.958.7212090.353.01374.92503.425.916.620.88106.5870.7923.4612.317289954.394.732875.9208.5152.1373.57215.21285.772.731734.9283.62815.61256.4507.6883.91559.21265.1874221.2517.7761.60691.9109559.8