CONFERENCE FALL 2012 Leadership Perspectives for Testers Test Strategy, Process and Design Agile Testing Performance Testing Test Automation Mobile Application Testing Strategic Business Alignment Hands-On Practicals THE LEADING CONFERENCE ON SOFTWARE TESTING www.STPCon.com 877.257.9531 Conference Tracks OCTOBER 15-18 MIAMI, FLORIDA THE LEADING CONFERENCE
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
CONFERENCE FALL 2 012
Leadership Perspectives for Testers
Test Strategy, Process and
Design
Agile Testing
Performance Testing
Test Automation
Mobile Application
Testing
Strategic Business
Alignment
Hands-OnPracticals
T H e L e A D i n g C O n f e r e n C e O n S O f T w A r e T e S T i n g
www. ST P Co n .co m 8 7 7 . 2 5 7 . 9 5 3 1
Conference Tracks
OCTOber 15-18 MiaMi , flOridaTh
e Le
ad
ing
Co
nf
er
en
Ce
P a g e 2
regiSTer www.STPCon.com or call 877.257.9531
Conference Packages and PricingMain Conference Package Dates:Wednesday,October16–Friday,October18Price: $1,295.00onorbeforeSeptember7OR
RegistRation I N F O R M A T I O NDiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage
Team Discounts
Number of Attendees
Rate Before Early Bird (9/7)
Rate After Early Bird (9/7)
1-2 $1,295 $1,695
3-5 $1,195 $1,395
6-9 $1,095 $1,295
10-14 $995 $1,195
15+ $895 $1,095
*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.
**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.
Coast to CoastCoast to CoastCONFERENCE & EXPO 2012
Cancellation Policy:All cancellations must be made in writing. You may cancel without penalty until September 14, 2012 after which a $150 cancellation fee will be charged. No-shows and cancellations after September 28, 2012 will be charged the full conference rate. Cancellation policies apply to both conference and pre-conference workshop registrations.
Adiscountedconferencerateof$129.00isavailableforconferenceattendees.Call1-800-HILTONSandreferenceGROUP CODE:STP2 / Software Test Professionals Conference rate orvisittheeventwebsiteatwww.stpcon.com/hoteltoreserveyourroomonline.RoomsareavailableuntilSeptember25oruntiltheysellout.Don’tmissyouropportunitytostayattheconferencehotel.
Platinum Sponsor
Conference Hotel
Coast to Coast Conferences Package(For 6 or More Registrations Only – Book Now and Choose Between 2 Conferences)
Dates: Software Test Professionals Conference Fall 2012 (October 16-18, 2012) AND Software Test Professionals Conference Spring 2013 (April 22-24, 2013)
Price: Take advantage of the team discounts listed below – but choose which conference each team member should attend. Register your entire team at the discounted rates listed on the Team Discount Chart below – and then decide which conference they should attend:
n Software Test Professionals Conference Fall 2012in Miami, FL on October 16-18, 2012 OR
n Software Test Professionals Conference Springin San Diego, CA on April 22-24, 2013
Testing agility leads to business fragilityItcomesasnosurprisethatwiththedownfalloftheeconomyintheUS,manyorganizationshavemadetestinganafterthought.Somehavescaledtestingeffortsbacksofarthattheend
Lee Henson is currently one of just over 100 Certified Scrum Trainers (CST) worldwide. He is also a Project Management Professional (PMP) and a PMI-Agile Certified Practitioner and has worked as a GUI web developer, quality assurance analyst, automated test engineer, QA Manager, product manager, project manager, ScrumMaster, agile coach, consultant, & training professional. Lee is a graduate of the Disney Management Institute and is the author of the Definitive Agile Checklist. He publishes the Agile Mentor Newsletter.
Uncrapify Your life!Thisaward-winningkeynoteisastudyinexactlywhatnottodo.Promisingtogivehisaudiencespermissionratherthanadvice,Jeffwill‘encourage’yourteamtocriticizeothersandoutsourceblame
n Howtoavoidnegativeandunproductiveconversationsn Thepowerofsincere,straightforwardcommunicationn Howtoapproachchangeinordertoachieveseamlessintegration
A Phi Beta Kappa graduate of Vanderbilt University, Jeff Haven began his career as a high school English teacher before branching into the world of stand-up comedy, where he worked with some of the brightest lights in American comedy and honed the art of engaging audiences through laughter. But his impulse to teach never faded, and soon he began looking for an avenue to combine both of his passions into entertaining and meaningful presentations.
P a g e 4
keynotes9 : 0 0 a m – 1 0 : 1 5 a m
CONFERENCE FALL 2 012
P a g e 5
Thursday, 18 october(9:00am – 10:00am)
KarEn n. JohnsonKaren n. JohnsonFoundern Software Test Management, Inc.
The Discipline aspect of software TestingYourmissionistoregressiontestawebsitefortheumpteenthtime,preferablywithfresheyesandathoroughreview.Afterall,you’retheoneholdingupthissoftwarefrombeingusedby
Karen N. Johnson is an independent software test consultant. She is a frequent speaker at conferences. Karen is a contributing author to the book, Beautiful Testing released by O’Reilly publishers. She is the co-founder of the WREST workshop, more information on WREST can be found at: http://www.wrestworkshop.com/Home.html. She has published numerous articles and blogs about her experiences with software testing. You can visit her website at: http://www.karennjohnson.com.
Wednesday, 17 october(This keynote will be offered immediately following lunch from 2:00pm – 2:45pm)
Matt JohnstonMatt Johnston
P a g e 5
CONFERENCE FALL 2 012
CMOn uTest
Mobile Market Metrics: breaking Through the HypeServingconsumers’voraciousappetiteforsmartphones,tablets,e-readers,gamingconsoles,connectTVsandapps–advancementsinmobiletechnologyarehappeningatwarpspeed.
Matt Johnston leads uTest’s marketing and community efforts as CMO, with more than a decade of marketing experience at companies ranging from early-stage startups to publicly traded enterprises. He continues to lead uTest’s efforts in shaping the brand, building awareness, generating leads and creating a world-class community of testers. Matt earned a B.A. in Marketing from Calvin College, as well as an MBA in Marketing & Technology from New York University’s Stern School of Business.
P a g e 6
regiSTer www.STPCon.com or call 877.257.9531
Monday, october 15, 2012 8:00am-4:00pm Registration&Information
8:00am-9:00am ContinentalBreakfast&Networking
9:00am-4:00pm Pre-Conference Workshops Pre-1:MobileTestAutomation (Brad Johnson, Fred Beringer) Pre-2:TestingMetrics:Process,Project,andProduct (Rex Black) Pre-3:NewWorldPerformance(Mark Tomlinson) Pre-4:Hands-on:RemoteTestingforCommonWebApplicationSecurityThreats(David Rhoades)
10:30am-11:00am MorningBeverageBreak
12:30pm-1:30pm Lunch
3:00pm-3:30pm AfternoonBeverageBreak
Tuesday, october 16, 20128:00am-8:00pm Registration&Information
8:00am-9:00am Breakfast
9:00am-10:15am General Session: TestingAgilityLeadstoBusinessFragility(Lee Henson)
Pre-1 Fred Beringer, VP, Product Management,SOASTA
Brad Johnson, VP Product and Channel Marketing,SOASTA Mobile Test automation Inthisfull-dayworkshop,youwillleavewiththeskillsandtoolstobeginimplementingyourmobilefunctionaltestautomationstrategy.SOASTA’sFredBeringerandBradJohnsonwillwalkyouthroughthebasics:
Brad Johnson joined the front lines of the Testing Renaissance in 2009 when he signed on with SOASTA to deliver testing on the CloudTest platform to a skeptical and established software testing market.
Fred Beringer has 15 years ofsoftware development and testing experience managing large organizations where he was responsible for developing software and applications for customers.
Pre-2 Rex Black, President,RBCS
Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.
Rex Black is a prolific author, practicing in the field of software testing today. His first book, Managing the Testing Process, has sold over 50,000 copies.
workshopsP r e - C o n f e r e n c e
P a g e 1 1
CONFERENCE FALL 2 012
Pre-2 Testing Metrics: Process, Project, and Product Someofourfavoriteengagementsinvolvehelpingclientsimplementmetricsprogramsfortesting.Factsandmeasuresarethefoundationoftrueunderstanding,butmisuseofmetricsisthecauseofmuchconfusion.Howcanweusemetricstomanagetesting?Whatmetricscanweusetomeasurethetestprocess?Whatmetricscanweusetomeasureourprogressintestingaproject?Whatdometricstellusaboutthequalityoftheproduct?Inthisworkhop,Rexwillsharesomethingshe’slearnedaboutmetricsthatyoucanputtoworkrightaway,andyou’llworkonsomepracticalexercisestodevelopmetricsforyourtesting.
Pre-3 Mark Tomlinson, President,West Evergreen Consulting, LLC
new World PerformanceIt’salwaysasignificantchallengeperformancetestersandengineerstokeepupwiththebreadthofhotnewtechnologiesandinnovationscomingataferociouspaceinourindustry.Notonlyhasthetechnologyandsystemlandscapechangedinthelastfewyears,butthemethodsandtechniquesforperformancetestingarealsoupdatingrapidly.Ourresponsibilityasperformancetestersandengineersistolearnandmasterthesenewapproachestoperformancetesting,optimizationandmanagementandserveourorganizationswiththemostvaluableknowledgeandskillpossible.InmytravelsI’veoftenheardquestionsfromfellowperformancetesters:Outofallthenewtechnologiesoutthere,whatshouldIbelearning?Whatnewtoolsforperformanceareoutthere?HowdoIbetterfitinwithagiledevelopmentandoperations?HowdoIupdatedandrefreshmyskillstokeepcurrentandvaluabletomycompany?SpendadaywithMarkandyouwillfindanswerstothesequestions.
Mark Tomlinsonis a software tester and test engineer. His first test project in 1992 sought to prevent trains from running into each other – and Mark has metaphorically been preventing “train wrecks” for his customers for the past 20 years.
Pre-4 David Rhoades, Senior Consultant,Maven Security Consulting, Inc.
Hands-on: Remote Testing for Common Web application security ThreatsTheproliferationofweb-basedapplicationshasincreasedtheenterprise’sexposuretoavarietyofthreats.Thereareoverarchingstepsthatcanandshouldbetakenatvariousstepsintheapplication’slifecycletopreventormitigatethesethreats,suchasimplementingsecuredesignandcodingpractices,performingsourcecodeaudits,andmaintainingproperaudittrailstodetectunauthorizeduse.
David Rhoadesis a senior consultant with Maven Security Consulting Inc. which provides information security assessments and training services to a global clientele. His expertise includes web application security, network security architectures, and vulnerability assessments.
P a g e 1 2
session block 1
regiSTer www.STPCon.com or call 877.257.9531
Andy Tinkhamisanexpertconsultant,focusingonallaspectsofqualityandsoftwaretesting(butmostofall,testautomation).Currently,heconsultsforaMagenic,aleadingproviderof.NETandtestingservices.
James Sivakhasbeeninthecomputertechnologyfieldforover35years,beginningwiththeSpaceShuttleandovertheyearshasencompassedwarehousesystems,cyclotrons,operatingsystems,andnowvirtualdesktops.
101 Paul Fratellone, ProgramDirectorQuality&TestConsulting,MindTree Consulting
Preparing the Qa budget, effort & Test activities – Part 1Thissessionwillbeanintroductiontopreparingatestteambudgetnotonlyfromamanpowerperspectivebutalsofromtheperspectiveoftestingeffortestimationandforecasting.Thespeakerwillbepullingfromreal-lifescenariosthathavecoveredamyriadofsituationsofcreatingorinheritingabudgetfortestingservices.Usingtheseexperiences,thespeakerwillhighlightgoodpracticesandsuccessesinadditiontopitfallstoavoid.Howtodevelopabudgetforbothprojectbased(largeenterprisewideprojectsthroughmid-sized)andportfolio/programtestingservicessupportacrosstheorganizationwillbepresented.Inpartone,thefinancial/accountingaspectsofabudget(high-level)willbediscussedandhowfull-timeequivalents(FTEs)aretrulyaccounted;thedetailsofa“fullyloaded”resourcewillbeexplained;andthedifferencebetweencapitalandoperationalexpendituresandpotentialtaxeffectswillbepresented.Wewillalsodeveloparesourceestimationmodelthatrepresentsreal-worldsituationsandintroduceconfidenceandlevels/iterationsofabudget/resourceplan.
Testing with ChaosTesterscanbecomesofocusedonthetestingathandandhowtomakethatasefficientaspossible(generallydrivenbymanagementdirectives)thatenvironmentsandtestsunconsciouslygetmissed.Broadeningthevisiontoincludeideasfromchaosandcomplexitytheoriescanhelptodiscoverwhycertainclassesofbugsonlygetfoundbythecustomer.Thispresentationwillintroducetheseideasandhowtheycanbeappliedtotestsandtestenvironments.Incorporatingrandomnessintotests
a to Z Testing in Production: Industry leading Techniques to leverage big Data for QualityTestinginproduction(TiP)isasetofsoftwaremethodologiesthatderivequalityassessmentsnotfromtestresultsruninalabbutfromwhereyourservicesactuallyrun–inproduction.Thebigdatapipefromrealusersandproductionenvironmentscanbeusedinawaythatbothleveragesthediversityofproductionwhilemitigatingriskstoendusers.Byleveragingthisdiversityofproductionweareabletoexercisecodepathsandusecasesthatwewereunabletoachieveinourtestlabordidnotanticipateinourtestplanning.
Test like a ninja: Hands-on Quick attacksInthissession,we’lltalkaboutquickattacks–smallteststhatcanbedonerapidlytofindcertainclassesofbugs.Thesetestsareeasytorunandrequirelittletonoupfrontplanning,whichmakesthemidealforquicklygettingfeedbackonyourapplicationundertest.Inthissession,we’llbrieflytalkaboutwhatquicktestsareandthendiveintospecificattacks,tryingthemonsampleapplications(ormaybeevensomerealapplications!).Thisisahands-onsession,sobringalaptoporpairwithsomeonewhohasone,andtrythesetechniquesliveinthesession!
201 Paul Fratellone,ProgramDirectorQuality&TestConsulting,MindTree Consulting
Preparing the Qa budget, effort & Test activities – Part 2InPart2ofthissession,thespeakerwillshowcaseexcel-basedworksheetstodemonstratetesteffort,testcyclesandtestcasemodelingtechniquesandhowtointroduceconfidenceinescalatinglevels/iterationsofabudgetasinformationincreasesinstabilityandaccuracythroughoutaproject/testingsupportactivity.Coveredwillalsobetheeffectsofthedeliverylifecyclemethodsandbudgeting.Howwilltestingbudgetsdifferbetweenwaterfallandagiledeliverymethods/lifecycles?
202 Lia Johnson,Manager,Drilling&EvaluationSoftwareTesting,Baker Hughes Inc.
software Reliability, The Definitive Measure of QualityThroughouttheprojectlife-cycle,measuresofquality,testsuccess,andtestcompletionareindicativeofprogress.Theculminationofthesemetricsisoftendifficultforsomestakeholderstotranslateforacceptance.Softwarereliabilitydependenciesbeginwithmodeldriventestsderivedfromuse-cases/userstoriesiniterativeoragiledevelopmentmethodologies.Aligningthetestprocesswithaproject’sdevelopmentmethodologyandinmanycasesPDMisintegraltoachievingacceptablelevelsofsoftwarereliability.Relevantdependenciesthatimpactsoftwarereliabilitybeginwithtestfirst,testcontinuously.Somedependenciesarewithinthescopeofresponsibilityforsoftwaretestprofessionals.Othersrequirecollaborationwiththeentireprojectteam.Developingapplicationsaccordingtostandardcodingpracticesisalsoessentialtoattainsoftwarequality.Unittestsdevelopedandexecutedsuccessfullyimpactsoftwarequality.Thesedependenciesandmorewillbediscussedasweexplorethedefinitivemeasureofquality,softwarereliability.
Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.
Lia JohnsonbeganhercareerattheCIAandNASAasasoftwaredeveloperupongraduationfromLamarUniversitywithaBBAinComputerScienceandisnowworkingforBakerHughesIncorporatedasaSoftwareTestingManager.
Paul Fratellone,a25yearcareerveteraninqualityandtesting,hasbeenaDirectorofQAandiswell-seasonedinpreparingdepartmentwidebudgets.
Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.
204 Robert Walsh,SeniorConsultant,Excalibur Solutions, Inc.
building a solid foundation for agile TestingSoftwaretestinginAgiledevelopmentenvironmentshasbecomeapopulartopicrecently.SomebelievethatconventionaltestingisunnecessaryinAgileenvironments.Further,somefeelthatalltestinginAgileshouldbeautomated,diminishingboththeroleandthevalueoftheprofessionaltester.WhileautomatedtestingisessentialinAgilemethodologies,manualtestinghasasignificantparttoplay,too.
Complement Virtual Test labs with service VirtualizationThissessionexplainswhyservicevirtualizationistheperfectcomplementtovirtualtestlabs–especiallywhenyouneedtotestagainstdependentapplicationsthataredifficultorcostlytoaccessand/ordifficulttoconfigureforyourtestingneeds.
301 Keith Klain, Director,HeadofGlobalTestCenter,Barclays
leading Cultural Change in a Community of TestersWhenKeithKlaintookovertheBarclaysGlobalTestCenter,hefoundanorganizationfocusedentirelyonmanagingprojects,managingprocesses,andmanagingstakeholders–thelastmostunsuccessfully.Althoughtheteamwasextremelyproficientintestmanagement,theirmisalignedprioritieshadtheeffectofcontinuallyhittingthebullseyeonthewrongtarget.Keithimmediatelyimplementedchangestoputasysteminplacetofostertestingtalentanddriveoutfear–abandoningworthlessmetricsandmaturityprograms,overhaulingthetrainingregime,andinvestinginaculturethatrewardsteamworkandinnovation.Thechallengesofthesemonumentalchangesrequiredanewkindofleadership–somethingquitedifferentfromtraditionalmanagement.
Keith KlainistheheadoftheBarclaysGlobalTestCenter,whichprovidesfunctionalandnon-functionalsoftwaretestingservicestotheinvestmentbankingandwealthmanagementbusinesses.
Karen N. Johnsonisanindependentsoftwaretestconsultantandacontributingauthortothebook,BeautifulTestingandistheco-founderoftheWRESTworkshop.
Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.
2 : 3 0 p m – 3 : 4 5 p m
3
P a g e 1 7
CONFERENCE FALL 2 012
303 Dan Downing, PrincipalConsultant,Mentora Group
Interpreting Performance Test Results – Part 1You’veworkedhardtodefine,developandexecuteaperformancetestonanewapplicationtodetermineitsbehaviorunderload.Yourinitialtestresultshavefilledacoupleof52gallondrumswithnumbers.Whatnext?Crankoutastandardreportfromyourtestingtool,senditout,andcallyourselfdone?NOT.Resultsinterpretationiswhereaperformancetesterearnstherealstripes.
Inthefirsthalfofthisdoublesessionwe’llstartbylookingatsomeresultsfromactualprojectsandtogetherpuzzleouttheessentialmessageineach.ThiswillbeahighlyinteractivesessionwhereIwilldisplayagraph,providealittlecontext,andask“whatdoyouseehere?”Wewillformhypotheses,drawtentativeconclusions,determinewhatfurtherinformationweneedtoconfirmthem,andidentifykeytargetgraphsthatgiveusthebestinsightonsystemperformanceandbottlenecks.Feelfreetobringyourownsampleresults(on a thumb drive soI can load and display)thatwecanengageparticipantsininterpreting!
finding the sweet spot – Mobile Device Testing DiversityHowcanyoupossiblydoitall?!Infinitehardware/softwarecombinations,BYOD,crowdsourcing,virtualcapabilities,datasecurity...thelistgoesonandon.Companiesarestrugglingwithinsecure,complicatedandexpensiveanswerstothemobiletestingchallenges.TheAetnatechnicalteamshavecreatedaninnovativemobiletestingsetofsolutionsthatnotonlyprotectdatabutallowformanydifferentapproachestomobiletestingacrossthelifecycle.WhetheryouwanttotestfromtheCorporateLab,fromyourownbackyardorhalfwayaroundtheworld,wehaveasolution…youchoose.
305 Brian Gerhardt, OperationsandQualityLead, Liquidnet
The Trouble with TroubleshootingOneofthemostvaluableskillsetsasoftwaretestercanpossessistheabilitytoquicklytrackdowntherootcauseofabug.Atestermaydescribewhatthebugappearstobedoing,butfartoooftenitisnotenoughinformationfordevelopers,causingarepetitivecode/build/test/re-code/re-build/re-testcycletoensue.Inthisinteractivesession,youwillrotatebetweenlearninginvestigativetechniquesandapplyingthemtoactualexamples.Youwillpracticereproducingthebug,isolatingit,andreportingitinaconcise,clearmanner.
401 Bradley Baird,SeniorManagerProductQuality,Harman International
Don’t Ignore the Man behind the CurtainJustasintheWizardofOzwhereallthegreatpyrotechnicsgoingoninpublicwerecontrolledbythewizardhiddenbehindsthecurtain,soitisinQAwhereallthegreatqualitythatthecustomersseeiscontrolledbytheQAprofessional.Ifyouignorethe“Wizard”youdosoattheriskofcompromisingQuality.ThissessionwillcovertheperilsofignoringtheQAprofessionalbehindthecurtain.WespendmonthsorevenyearstrainingaQAengineeronlytoseethemwalkoutthedoorbecauseabetteropportunitycamealong.Youdon’tjustloseapersonyouloseknowledgethatissometimeshardtoreplace.
402 David Dang,SeniorAutomationConsultant,Zenegy Technologies
optimizing Modular Test automationManycompanieshaverecognizedthevalueoftestautomationframeworks.AppropriatetestautomationframeworksmaximizeROIonautomationtoolsandminimizescriptmaintenance.Oneofthemostcommonframeworksisthemodulartestautomationapproach.Thisapproachusesthesameconceptassoftwaredevelopment:buildingcomponentsormodulessharedwithinanapplication.Fortestautomation,themodularapproachdecomposestheapplicationundertestintofunctionsormodules.Thefunctionsormodulesarelinkedtogethertoformautomatedtestcases.Whilethis
Dan Downingteachesloadtestingandoverthepast13yearshasledhundredsofperformanceprojectsonapplicationsrangingfromeCommercetoERPandcompaniesrangingfromstartupstoglobalenterprises.
David DangisanHP/MercuryCertifiedInstructor(CI)forQuickTestProfessional,WinRunner,andQualityCenterandhasprovidedautomationstrategyandimplementationplanstomaximizeROIandminimizescriptmaintenance.
Brian Copelandhasbeeninstrumentalinthetestingofcriticalbusinesssystems,frommissioncriticalapplicationstocommercialsoftware.
Interpreting Performance Test Results – Part 2Inthesecondpartofthissession,wewilltrytocodifytheanalyticstepswewentthroughinthefirstsessionwherewelearnedtoobserve,formhypotheses,drawconclusionsandtakestepstoconfirmthem,andfinallyreporttheresults.TheprocesscanbestbesummarizedinaCAVIARapproachforcollectingandevaluatingperformancetestresults:
404 Brian Copeland,QAPracticeDirector,Northway Solutions Group
agile vs fragile: a Disciplined approach or an excuse for ChaosTheManifestoforAgileSoftwareDevelopmentwassignedoveradecadeagoandestablishesasetofprinciplesaimedatincreasingthespeedatwhichcustomerscanrealizethevalueofadevelopmentundertaking.WhiletheprinciplesofAgilearearefreshingfocusondelivery,theyareoftenhijackedtobecomeanexcusefortheundisciplineddevelopmentorganization.TheAgileframework’sfocusonagilityisanythingbutundisciplinedwithprinciplessuchasTestDrivenDevelopment(TDD);howeverroguedevelopment
405 Todd Schultz,ManagingSeniorQualityAssuranceEngineer,Deloitte Digital
Mobile software Testing experienceInthishands-onsession,withdevicesinhand,wewillinvestigatetheissuesthatmobiletestersdealwithonadailybasis.Wewillexplorebothmobileoptimizedwebsitesandnativeapplications,inthenameofconsumeradvocacyandcontinuousimprovementandgainanewperspectiveonthemobilecomputingeraaswearmourselveswiththeknowledgeneededtousherinaqualityfutureforthisemergingmarket.
How to Prevent DefectsThesessionshowshowtopreventdefectsfromleakingtolaterstagesoftheSDLC.Thisisasuccessfulcasestudyinwhichawarenessandfocusonstatictestingwasincreasedoveraperiodof2years.Defectdetectionandleakageremovalmetricsweretrackedforeachoftheprojects.Thefirst2projectsexposedsomeissues.Themetricsweresharedanddiscussedwithbusinesspartners–andvariousprocessimprovementswereimplemented.Theresultsonthe4subsequentprojectsshowedmarkedreductionsindefectsthatleakedintosystemtestingandproduction.Thequalityimprovementalsocontributedtolesscostandshortertimelinesbecausere-workwascontrolled.
Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.
Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.
building a successful Test Center of excellence – Part 1In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobe
The Testing Renaissance Has arrived (on an iPad in the Cloud)Thisisthebesttimeinhistorytobeatester!Emergingfromthemostsignificanteconomic“darkage”sincetheGreatDepression,theworldtestersnowfaceisoneofimmenseopportunityandchallengeascloudcomputinghasblowninovernightandmobiledeviceshaveovertakentheplanet.Inthenewworldofspeedandscale,RenaissanceTestersarelaunching(orre-launching)theircareersbytestingtransformationaltechnologiesbyeffectivelyutilizingthosesametransformationaltechnologies.
non-Regression Test automation – Part 1Theprincipleadvantagesofautomatedtestsarerepeatabilityandspeed.Theprincipledisadvantagesarethattheyarerelativelymoreexpensivetocreatethanmanualtests,requiremoremaintenancethanmanualtests,andaremorelimitedinthespecificityofthingstheycancomparecomparedwithmanualtests.Part1ofthispresentationdescribesanotherwaytoapproachtestautomation:totestthingsthatcannotbetestedmanually.Thesetestsenableustofocusonlearningaboutthesoftware,cangobehindtheUItoextendourreach,arenotlimitedtodoingthesamethingeachtimeandcanperformhugenumbersofiterationsandcombinationsunthinkableusingmanualtestingorautomatedregressiontests.Thisapproachalsoencouragescheckingbroaderclassesoftestoutcomes,thusimprovingthetypesoferrorsthatcanbediscovered.
building a successful Test Center of excellence – Part 2In2008,Lowe’sinitiatedaQualityAssurancegroupdedicatedtoindependenttestingforIT.ThiswasLowe’sfirsttimeseparatingdevelopmentandtestingeffortsforthe62-year-oldcompany.MikeLyleswasprivilegedtobepartofthisinauguraleffort.ThepurposeofthistwopartsessionistoreviewahighlevelstudyofthebuildingofaTestCenterofExcellencewithinamatureITorganizationthatwillbeinformativeforcompaniesofvarioussizesandgrowthrelatedtoQualityAssurancematurity.
aetna Case study – Model officeTheModelOfficeProgramcameintoexistenceduetoacontractualstipulationofanewlyforgedAetna
61 2 : 0 0 p m – 1 : 1 5 p m
Robert Walsh, aproponentofAgilesoftwaredevelopmentprocessesandtechniques,believesstronglyindeliveringqualitysolutionsthatsolverealcustomerproblemsandprovidetangiblebusinessvalue.
Scott Moore hasover18yearsofITexperiencewithvariousplatformsandtechnologiesandhastestedsomeofthelargestapplicationsandinfrastructuresintheworld.
Mike Lyleshas19yearsofITexperience.HiscurrentrolecomprisesTestManagementresponsibilitiesforamajorcompanydomaincoveringStoreSystems,SupplyChain,MerchandisingandMarketing.
603 Scott Moore,President&CEO,Northway Solutions Group
application Performance Test Planning best PracticesManycompaniesexperienceperformanceissuesinproductionevenaftertheyhavetestedittoendureload.Why?Thissessionwilldemonstratethevalueofperformancetestingforreal-worldscenariosandhowtoproperlyplanforyourapplication’s“perfectstorm”.Howtocreateandreacttochaosbeforeithappensinproductionwillbeexplored.Attendeeswilllearntriedandtrueguidelinesthatcanusedtoplanforrealisticpeakloadsandunderstandwhatworstcaselookslikebeforecustomersdo.Inaddition,wewilldiscusshowcloudarchitectureandSoftware-As-A-Serviceintroducesnewproblems.Attendeeswillwalkawaywitharepeatabletestexecutionmethodologytouseonanyperformancetestingprojectinthefuture.
Technical Debt: a Treasure to Discover and DestroySometreasuresareworththeplunderastheyyieldvastamountsofrichesandjewels.Othertreasuresareoftenbetterleftuntouched.Thissessionisaboutatreasurethatnoorganizationwantstoseeorfacebuttherewardsforacknowledginganddestroyingthetreasureisvastandbountiful.Aswecontinuetoseecompaniesgrowandexpand,organizationsarebuildingVERYstrongfeaturesetsatopacrumblingarchitecturalfoundation.Learnwhatthesevendeadlysinsoftechnicaldebtare,andthestepsyoucantaketoeliminatethem!Seefirsthandwhattheveryobstaclesarethatwearetryingtoavoidyetfallingrightintotheirpath.Learnwhatthetester’sroleisinhelpingtomakecertainweneverpitfallintothisenvironmentagain.Leavearmedwiththestepswecantaketoadjusttheriggingandmakecertainweneversaildownthepathofendlessdebtagain.
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
Lee Henson’s12yearsofexperiencespanabroadarrayofsoftwareproductionrolesandresponsibilities.Heiscurrentlyoneofjustover100CertifiedScrumTrainers(CST)worldwide.
Andreas Grabnerhas10yearsofexperienceasanarchitectanddeveloperintheJavaand.NETspace.Inhiscurrentrole,AndiworksasaTechnologyStrategistfordynaTraceSoftwareintheMethodsandTechnologyteam.
Wayne AriolaisVicePresidentofStrategyandCorporateDevelopmentatParasoft,aleadingproviderofintegratedsoftwaredevelopmentmanagement,qualitylifecyclemanagement,anddev/testenvironmentmanagementsolutions.
703 Andreas Grabner, TechnologyStrategist,Compuware dynaTrace
Top 3 Performance land Mines and How to address ThemAsatester,youdonothavetheluxuryorthetimetotestrepeatedlytotrytofixslow,poorly-performingapplicationsduringloadtests.Youneedtogettothecauseofperformancequicklyandfixissuesfastandefficiently.Therearetoolsthatcanhelpinidentifyingapplicationissues,butmanyarenoteffectivefortestinginanenvironmentwheretheboundariesbetweenpreproductionandproductionareincreasinglyblurred.
building automation from the bottom Up, not the Top DownMostsoftwareautomationprojectsfail.Why?Becausetesters,managers,companiesthinkautomationtoolsaremagicalandthatautomationiseasytoimplement,justrecordandplayback–right?Wrong!Toomanytimes,ITprojectsbuyintothe‘easilyautomate’softwarefromthetoolsvendoronlytofindtheyhaveshelvedthetool6monthsdowntheroad.Buildinganautomatedtestsystemtakesjustasmuchthought,designandplanningasbuildingthesoftwareapplicationundertestitself.
705 Matt Heusser, PrincipalConsultant,Excelon Development
There Can be only one: a Testing Competition – Part 1Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.
Maintaining Quality in a Period of explosive Growth – a Case studyA12yearoldsoftwaredevelopmentfirmbegancreatingiOSapplicationswithabout20employees.Lessthan2yearslatertheyhad150employeesandweremakingawardwinningiOSandAndroidapplications.Inearly2012theywerepurchasedbyoneofthebig4accountingagenciestobethemobileextensionoftheirworld-widetechnologyconsultingbusiness.
Carl Shaulishasbeentestingsoftwarefor10+yearsandhasover15yearsofmanagementexperience.Carltakesananalyticalapproachtotestingandhasthefortitudetoembracechange.
Anna Royzmanisthetestleadinacross-functionalproductdevelopmentteamthatcreatesanddeliversgame-changingsoftwareinthefinancialindustry,where“quality”isasimportantasthe“timetomarket.”
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
Refocusing Testing strategy Within the Context of Product MaturitySameasthe“completepreplanningahead”isnottheAgilewayofdeliveringsoftware,thetestingstrategywithintheagileprojectneedstofine-tunetothevariousstagesofproductdevelopmentandmaturity.Whiletheteamandproductleadswanttobeconfidentaboutsoftwarequality,testingtasksandactivitiesneedtobeleanenoughtoavoidunnecessarytime/maintenancehurdlesorbottlenecks.Wewillreviewtestingmethodsandstyleswhichfitbestatdifferentstagesofproductmaturity(hint:thedefinitionof“quality”mayadjustforeachstage).Sessionhighlights:
Mobile Testing: Tools, Techniques & Target DevicesThenatureofthemobileindustryisinconstantfluxwithnewdevices,browserandoperatingsystemversionsbeingreleasedconstantly.Mobiletestershavetokeepdevice,browserandOScombinationsinmindwithmultipleIDEsandtestingtoolstocomeupwithriskassessmentandtestapproaches.Usageofbuilt-inSDKutilities,vendortoolsandcommandlinegoodiesareexploredinthissession.Testingtooloptionsforbothnativeandmobilewebapplicationswithideasonwhatselectioncriteriashouldbeusedareshowcasedwithrecommendations.Therequiredskilllevelofmobileapplicationtestersisslightlyhigher.Forinstance,availabletestingtoolsexpectaccesstoapplicationsourcecodewithbasicknowledgeofJava/ObjectiveCfornativeappstesting;understandingofecosystems(Eclipse/AndroidSDK,Xcode/iOSSDKetc);andknowledgeofbrowsersanddifferentrenderingengineswiththeireffectonhowpagesarerenderedisessential.Thissessionwillprovideaframeworktomanageallthesedimensionsofmobiletesting.
805 Matt Heusser, PrincipalConsultant,Excelon Development
There Can be only one: a Testing Competition – Part 2Thisdoublesessionintegratestheprevioustalksandappliesthem,simulatingrealsoftwaretesting.Afteraquickexercisetocreateteamsof2-6testers(orbringyourown),youwillbeplungedintotherealworldofsoftwaretesting:Funchallenges,deliveredundertimepressureandconditionsofuncertainty.Teamswillbejudgedoncoverage,bugsfound,thequalityofthecommunicationtheyhavewith“management”and“therestofthetechnicalstaff”,newapproachesandstrategy/leadership.Stickaroundafterthecompetition,becauseprizeswillbeawardedonthemainstageThursdaymorning.
902 Matt Heusser,PrincipalConsultant,Excelon Development
advances in software Testing – a Panel DiscussionIfthepaceofdevelopmentandtechnologyaretwotothreetimesasfast,whatnewadvancesarehappeninginsoftwaretesting?Themoderatorwillpolltopicsfromtheaudience,thenusetheK-CardMethodtoevaluatetheattentionoftheroom,expandingontopicstheroomwouldliketodiscussandmovingonasenergyfades.
Mark Tomlinsonisasoftwaretesterandtestengineer.Hisfirsttestprojectin1992soughttopreventtrainsfromrunningintoeachother–andMarkhasmetaphoricallybeenpreventing“trainwrecks”forhiscustomersforthepast20years.
Matthew Heusserisaconsultingsoftwaretesterandsoftwareprocessnaturalistwhohasspenthisentireadultlifedeveloping,testing,ormanagingsoftwareprojects.
Jean Ann HarrisonhasbeenintheSoftwareTestingandQualityAssurancefieldforover12yearsincluding4yearsworkingwithinaRegulatoryEnvironment.Hernicheissystemintegrationtesting,specificallyonmobilemedicaldevices.
903 Mark Tomlinson,PerformanceGuru,West Evergreen Consulting, LLC
Performance Testing Metrics and MeasuresThissessionwillcovertheexpansiveunderstandingofperformancetestingmetricsandhowtheycanbeusedtodrivequalityinitiativesupstreamanddownstreamintheapplicationlifecycle.Toooftentodayweseethatperformancemeasurements(CPU,DISK,MEMORY,NETWORK)areleftoutofearlytestingautomationandpass/failcriteria,whenitwouldbeabsolutelymorecost-effectiveifwecouldfindandfixthosebottlenecksearlier.Testerswhoarenewtoperformancetestingsuccesscriteriawilllearnnewwaystocorrelateandanalyzeperformancemeasurementsandextrapolatetheresultsinareliableandrepeatableway.Testerswhoareinterestedintakingtheirbug-findingskillstoawholenewlevelwillbedelightedtoexpandintoperformance-relatedtestinginvestigation,explorationandriskanalysis.
904 Sreekanth Singaraju,VP,QAandTestingServices,Alliance Global Services
How and Where to Invest Your Testing automation budgetTestautomationpromisessubstantialbenefitstoanorganizationincludingacceleratedtestcycles,increasedcoverage,accuracyinreportingandenhancedproductivity.Thereality,however,isthatinmanycases,automationprojectsfailbeforetheydeliverprojectedROIortheysubstantiallyunder-performontheobjectives.Thissessionwillcoverfiveprovenstrategiesforasuccessfultestingautomationstrategyandhowtobestallocateyourtestautomationbudget.
905 Jean Ann Harrison, ProjectManager,ProjectRealms, Inc.
Memory, Power and bandwidth – oh My! Mobile Testing beyond the GUIManytesterstodayareaskedtotestmobileapplications.Theassumptionistotestthemobileapplicationinthesamemanneroftestingawebapplicationoraclient/serverapplication.However,ifthesoftwaretesteristestingmobileapplications,thenthesoftwaretestermustnowbecomeawareofhardwareandfirmwareconditionswhichwerenotnormallyapartofprevioustestcasedevelopment.Chargingthedevicewhilethesoftwareapplicationisbeingdownloaded,installing,inusewheretheGUIisengagedareallnecessarytestsforthemobileapplicationtester.Addanothervariabletochargingthedevicetoconsidertheheatgeneratedfromchargingthebattery,anotherleveloftestscanincludenetworkcommunication,databasesearches,andmemorymanagement.Understandingthecombinationofsoftware/firmware/hardwareallcontainedwithinonecomplexsystemisnowapartofanysoftwaretesterofmobileapplications.
Joseph Oursdrawson15years’experienceprovidingexecutive-levelleadershipwhilemanaginghighprofileinitiativeswithademonstratedabilitytoleadpeopletowardssuccessfuldelivery.
Philip LewisanAdjunctProfessoratAlaskaPacificUniversityandtheProjectManagementCollegeteachinggraduatecoursesinsoftwareengineering,ITprojectmanagement,andITGovernance.
Richard Kriheli’scareerspansfifteenyearsofqualityassuranceanddesignonaccountssuchasWalmart,L’Oreal,Nokia,Vogue,BestBuy&others.HecurrentlyheadstestingeffortsforNikeatR/GA.
Dan BartowisVPofProductManagementatSOASTA,theleaderinperformancetestingfromthecloud.PriortojoiningSOASTAhewasSr.EngineeringManageratIntuit.
1001 Joseph Ours,DirectorofSoftwareQAandTestingServices,Cohesion
Redefining the Purpose of software TestingThroughoutthehistoryofsoftwaretesting,theprofessionhasevolvedfromexpectationsofjustmeetingrequirementstoensuringfitnessofuse.Alongtheway,testershavebeensaddledwiththeburdensomeexpectationsofensuringoverallqualityineachoftheseways.Inthispresentationwewilldiscussthehistoryofsoftwaretestinginordertounderstandwheretheindustryneedstogo.Wewilltalkaboutthecommonchallengesourstakeholdershaveinunderstandingourcraft,aswellassomeofthecommonnegativeperceptionsofvalue.Wewilladdressthesewithanewlydefinedpurposeofsoftwaretesting,wheretheemphasisisplacedonprovidinginformation,notjustrawdata,tostakeholders;informationofvalue.Thistransitiontoprovidinginformationwilltransformtestingintoaservicemindedgroupwhosevalueistransparentandultimatelyempoweredbytheirstakeholdersinsteadofjusttoleratedbythem.
evaluating and Improving UsabilityToday’sweb-basedapplications(WebApps)containingcomplexbusinesslogicandsometimescriticaltooperatingthebusiness,nowmusthaveanincreasedfocusonusabilityaswellasthenewerandbroaderterm,userexperience.Now,mobileappsarefollowingtheirleadandaregainingmoreandmoresophisticatedfunctionalityevenwithlimitedscreenrealestate.Thishasledtobothusabilityanduserexperiencebecomingparamountasthereisnoup-frontinvestmentforcingausertostay.EventhoughusabilityhassomeformalISOmodeldefinitions,
1003 Dan Bartow, VicePresident,ProductManagement,SOASTA
Real World Performance Testing in ProductionOnlineapplicationperformanceiscritical–noonewouldchallengethisstatement.Yetthe“dirtylittlesecret”inthewebworldisthattheamountofperformancetestingdoneonapplicationsisappallinglylow.Whenperformancetestingisdoneit’susuallyconductedinatestlab.Evenwiththoroughtestinginalabenvironment,whenapplicationsaredeployedtoproductiontheyveryfrequentlytoppleunderthepressureofreal-wordusers.Theresultsfromthisinvestmentinlabtestingarenotdeliveringtheanswersthatleadershipneedsaboutwebapplicationperformance.
1004 Richard Kriheli,AssociateDirectorofQualityAssurance,R/GA
scaling Gracefully and Testing ResponsivelyThewebisn’tjustdesktopanymore.Thewebiseverywhere,creatingafluidconundrumfortheQAprofessional.Asthetestingmatrixgrowsandgrowsintoamultiplatformexpanse,wemustbereadyfornotjustthesizeofascreen,butalsouserbrowsinghabits.Inthissession,we’llexploretheproblemspresentedbyresponsivedesign,examinetheflexiblegridandforecastsystematicsolutions.
RegisteR N O W !DiscountsEarlyBirdDiscount:RegisteronorbeforeSeptember7toreceive$400.00offanyfullconferencepackage
Team Discounts
Number of Attendees
Rate Before Early Bird
(9/7)
Rate After Early Bird
(9/7)
1-2 $1,295 $1,695
3-5 $1,195 $1,395
6-9 $1,095 $1,295
10-14 $995 $1,195
15+ $895 $1,095
*Price above is for access to the Main Conference Package. Please add $400 to your registration if you are registering for the Main Conference Package PLUS 1-Day.
**Team discounts are not combinable with any other discounts/offers. Teams must be from the same company and should be submitted into the online registration system on the same day.
regiSTer @www.STPCon.com
or call 877.257.9531
50 Conference breakout sessions in 8 Comprehensive Tracks