Agile Metrics Agile Metrics Alimenkou Mikalai Alimenkou Mikalai 27.09.2008 27.09.2008
Dec 06, 2014
Agile MetricsAgile Metrics
Alimenkou MikalaiAlimenkou Mikalai
27.09.200827.09.2008
IntroductionIntroduction
"Tell me how you will measure me and I will tell you how I will behave"
- Eliyahu Goldratt
”If you can’t measure it, you can’t improve it”
- Lord Kelvin
Metrics VS Diagnostics Metrics VS Diagnostics
Metrics UsesMetrics Uses
Understand real ROIUnderstand real ROI Plan market strategies, product Plan market strategies, product
releasesreleases Fail fast and save moneyFail fast and save money Identify and mitigate business risksIdentify and mitigate business risks Estimate new projectsEstimate new projects Award bonuses to developersAward bonuses to developers
Why Do We Measure?Why Do We Measure?
To informTo inform To compareTo compare To motivateTo motivate To understandTo understand To improveTo improve To protectTo protect
Why Metrics Are So Why Metrics Are So Important?Important?
Great help for retrospectivesGreat help for retrospectives Continuously gives feedbackContinuously gives feedback Help to have healthy code baseHelp to have healthy code base To refactor code To refactor code To be able to do frequent releasesTo be able to do frequent releases Show issues earlyShow issues early
Metrics ApproachesMetrics Approaches
Using wrong Using wrong metricsmetrics
No metrics at allNo metrics at all Using right metricsUsing right metrics
Useless MetricsUseless Metrics
Total lines of codeTotal lines of code Line of code per developerLine of code per developer Total number of completed tasksTotal number of completed tasks Total time workedTotal time worked Bugs fixedBugs fixed
Business MetricsBusiness Metrics
RTF (Running Tested Features)RTF (Running Tested Features) Earned Business Value (EBV)Earned Business Value (EBV) Net Present Value (NPV)Net Present Value (NPV) Internal Rate of Return (IRR)Internal Rate of Return (IRR) Return on Investment (ROI)Return on Investment (ROI)
RTF BasicsRTF Basics
Running – shipped in a productRunning – shipped in a product Tested – continuously pass acceptance Tested – continuously pass acceptance
teststests Features – real customer given Features – real customer given
featuresfeatures
RTF AgilityRTF Agility
RTF requires feature count to grow from first RTF requires feature count to grow from first day so team is focused on featuresday so team is focused on features
RTF requires feature count to grow RTF requires feature count to grow continuously continuously so team integrates oftenso team integrates often
RTF requires features to be tested RTF requires features to be tested so team has contract with the customerso team has contract with the customer
RTF requires tests continue to pass RTF requires tests continue to pass so tests are automatedso tests are automated
RTF requires to grow smoothly RTF requires to grow smoothly so design will need to be cleanso design will need to be clean
RTF SmellsRTF Smells
RTF is zero from start during some RTF is zero from start during some sprintssprints
RTF starts fast and then slow downRTF starts fast and then slow down RTF behaves like yoyoRTF behaves like yoyo RTF grows too quicklyRTF grows too quickly
EBV BasicsEBV Basics
Each story has its own Each story has its own relative weight relative weight assigned by product assigned by product ownerowner
Each story has binary Each story has binary status: done/not donestatus: done/not done
EBV calculated as sum EBV calculated as sum of weights for done of weights for done storiesstories
EBV AgilityEBV Agility
Focus on business value so no big Focus on business value so no big upfront designupfront design
Don’t work on layers, but on featuresDon’t work on layers, but on features Customer sees value immediatelyCustomer sees value immediately Features prioritizing instrumentFeatures prioritizing instrument Help planning releases and demosHelp planning releases and demos
Business Metrics ToolsBusiness Metrics Tools
Agile task management tool/plug-inAgile task management tool/plug-in Issues management systemIssues management system MS ExcelMS Excel
Code MetricsCode Metrics
Cyclomatic complexityCyclomatic complexity Best practices violationBest practices violation Coding standards violationCoding standards violation Possible bugsPossible bugs Code duplicationCode duplication Code coverageCode coverage Dead codeDead code Tests qualityTests quality
Code Metrics ToolsCode Metrics Tools
CheckstyleCheckstyle PMD/CPDPMD/CPD JesterJester FindbugsFindbugs SimianSimian Maven site plug-inMaven site plug-in Intellij IDEA inspectionsIntellij IDEA inspections
Checkstyle SampleCheckstyle Sample
PMD SamplePMD Sample
Findbugs SampleFindbugs Sample
Maven Site Plug-in SampleMaven Site Plug-in Sample
Intellij IDEA Inspections Intellij IDEA Inspections SampleSample
Design MetricsDesign Metrics
Code dependenciesCode dependencies Incoming (Affering Coupling)Incoming (Affering Coupling) Outgoing (Efferent Coupling)Outgoing (Efferent Coupling)
AbstractnessAbstractness Number of abstract classes and interfacesNumber of abstract classes and interfaces Number of concrete classesNumber of concrete classes
Design Metrics ToolsDesign Metrics Tools
JDependJDepend Eclipse CAP plug-Eclipse CAP plug-
inin
JDepend SampleJDepend Sample
Process MetricsProcess Metrics
Agile practice maturityAgile practice maturity Obstacles cleared per iterationObstacles cleared per iteration Obstacles carried over the next iterationObstacles carried over the next iteration User stories carried over the next User stories carried over the next
iterationiteration Defects carried over the next iterationDefects carried over the next iteration Team member loadingTeam member loading VelocityVelocity Backlog sizeBacklog size
VelocityVelocity
Classic velocityClassic velocity Speed velocitySpeed velocity Interruptions per dayInterruptions per day
Backlog SizeBacklog Size
Process Metrics ToolsProcess Metrics Tools
Issues management systemIssues management system Special agile tools/plug-insSpecial agile tools/plug-ins Physical task management toolsPhysical task management tools MS ExcelMS Excel
Automation MetricsAutomation Metrics
Code coverageCode coverage Number of builds per dayNumber of builds per day Time taken per buildTime taken per build Number of failed/success buildsNumber of failed/success builds Trends in code metricsTrends in code metrics
Automation Metrics ToolsAutomation Metrics Tools
Continuous integration toolsContinuous integration tools CruiseControlCruiseControl TeamCityTeamCity BambooBamboo HudsonHudson ContinuumContinuum
CoberturaCobertura CloverClover Maven dashboard plug-inMaven dashboard plug-in
TeamCity SampleTeamCity Sample
Cobertura SampleCobertura Sample
Testing MetricsTesting Metrics
Acceptance tests per storyAcceptance tests per story Defects count per storyDefects count per story Tests time to runTests time to run Tests run frequencyTests run frequency Manual tests per storyManual tests per story Automation percentAutomation percent Time to fix testsTime to fix tests
Testing Metrics ToolsTesting Metrics Tools
FitNesseFitNesse ConcordionConcordion SeleniumSelenium Issues management systemIssues management system Testing automation toolsTesting automation tools
Other MetricsOther Metrics
WTFs per minuteWTFs per minute VCS ActivityVCS Activity
Metrics Evaluation ChecklistMetrics Evaluation Checklist
Example: Business Value Example: Business Value DeliveredDelivered
Example: VelocityExample: Velocity
Best PracticesBest Practices
Don’t produce metrics that no one wantsDon’t produce metrics that no one wants Be honest about metrics usageBe honest about metrics usage Don’t use metrics to compare teamsDon’t use metrics to compare teams Use metrics as a basis of discussionUse metrics as a basis of discussion Don’t demoralize team with metricsDon’t demoralize team with metrics Take team state into account when Take team state into account when
selecting metricsselecting metrics Don’t select hard produced metricsDon’t select hard produced metrics
Best PracticesBest Practices
Measure outcomes, not outputsMeasure outcomes, not outputs Measure results, not activityMeasure results, not activity Measure work items done, not time Measure work items done, not time
spent per taskspent per task Follow trends, not numbersFollow trends, not numbers
Best PracticesBest Practices
Don’t measure something just because Don’t measure something just because you canyou can
Use just enough set of metricsUse just enough set of metrics Use metrics that are easy to collectUse metrics that are easy to collect Share metrics to get feedbackShare metrics to get feedback Different metrics for product and Different metrics for product and
processprocess