• Challenges in Finance • How to Automate 1. Automation Tools 2. Getting the Basics Right 3. One Size Does Not Fit All 4. Build the Team 5. Coverage – Science or Craft? 6. Get Inside the Code! 7. Pick your Arguments 8. Incentivise Good Behaviour Test Automation John Stinson
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
• Challenges in Finance• How to Automate
1. Automation Tools2. Getting the Basics Right3. One Size Does Not Fit All4. Build the Team5. Coverage – Science or Craft?6. Get Inside the Code!7. Pick your Arguments8. Incentivise Good Behaviour
Test Automation
John Stinson
Challenges in Finance• Finance IS technology• Complexity is higher than ever before• Mergers have lead to accumulation of systems• Increased regulations have increased pressure• Teams are frequently spread globally• Volumes have increased 20 times since 1995• Latencies have decreased to milliseconds• Proliferation of custom software. Approval to use open-source takes
time.• Operations separated from developers via entitlements• No sharing of information via blogs or social media• Different personalities, some driving automation, some not• Automation may pay off in 2-3 years. Bonus cycle is annual
Different Approaches for Different Lines of Business
Different Approaches for Different Lifecycle Stages
Cutting Edge Proceed Cautiously
Stable Move Forward
Legacy Handle with Care Focus on Changes or Wrap with Cheap Regression
Dev/BA
BA/QA
BA/QA
Dev/Envt/Auto
Dev/Envt/Auto
Dev/Envt/Auto
Dev/Envt/Auto
Dev/BA
Dev/BA
Dev/BA
Dev in Test
Classic BDD
Developer in Test
Dev/BA
Dev/Envt/Auto
Dev/Envt/Auto
Dev/Envt/Auto
Dev/Envt/Auto
Dev/Envt/Auto
BA
Dev/Envt/Auto
Developer Quality Mentality
Gherkins
Developers automate
Dev in Test
Dedicated automators help
keep paceAutomation focused
Dev lead drives team behaviour
4) Team Models that Work
Devswrite
frame-work Dev in
Test
BA/QA
QAQA checks coverage
5) Coverage
Science or Art?
Science of Coverage
2*12*2*2*2*4*10 = 7680
Understand RiskPerform Exploratory TestingSummarise Coverage to Stakeholders
Art of Coverage
6) Get Inside the Code!
Diff Code to understand risk of late changesView Unit Test Code Coverage in IntellijFind interesting edge cases in C# using PEXAnalyse Dependency Graph in JavaAnalyse Performance with jvisualvm
• Teamcity vs Jenkins?• Cucumber Ruby vs Cucumber JVM?• Config Management in SVN or GIT/Stash?• Certain level of unit test Coverage?• Code review process?
8) Incentivise Good Behaviour with Metrics
• What are we trying to achieve?
• How many test scenarios automated out of the manual pack?
• Unit test coverage?• Total time taken to test?• Production defects?