AUSTIN QUALITY SOFTWARE DEVELOPMENT HOW COMPANIES …files.meetup.com/20308801/HowCompaniesDoQuality.pdf · HOW COMPANIES DO QUALITY GOOGLE’S DUAL ROLES Software Engineer in Test

HOW COMPANIES DO QUALITY

AUSTIN QUALITY SOFTWARE DEVELOPMENT

HOW COMPANIES DO QUALITY

TRADITIONAL SOFTWARE QUALITY

HOW COMPANIES DO QUALITY

TRADITIONAL SOFTWARE QUALITY

HOW COMPANIES DO QUALITY

SOURCES

https://youtu.be/yRP29wFqu20

Quality at Speed

WHO IS RESPONSIBLE FOR QUALITY?

THE BURDEN OF QUALITY IS ON THE SHOULDERS OF THOSE WRITING THE CODE. QUALITY IS NEVER “SOME TESTER’S” PROBLEM…IF YOU ARE AN ENGINEER, YOU ARE A TESTER.

How Google Tests Software

HOW COMPANIES DO QUALITY

HOW COMPANIES DO QUALITY

QUALITY ENGINEERING ROLES

▸ Google

▸ Software Engineer in Test

▸ A developer role whose focus is on testability and general test infrastructure

▸ Test Engineer

▸ A role that puts testing on behalf of the user first and developers second

▸ Atlassian

▸ Quality Assistance

▸ Protect our customer

▸ Educate our developers

HOW COMPANIES DO QUALITY

ENGINEERING PRODUCTIVITY

▸ “their actual mission is one of productivity”

▸ “a large part of that productivity is avoiding re-work because of sloppy development”

▸ “Quality is thus a large part of that productivity”

NO PROJECT GETS TESTING RESOURCES AS SOME RIGHT OF EXISTENCE. THE ONUS IS ON THE DEVELOPMENT TEAMS TO SOLICIT HELP FROM TESTERS AND CONVINCE THEM THAT THEIR PROJECT IS EXCITING AND FULL OF POTENTIAL.

How Google Tests Software

EDUCATING DEVELOPERS

HOW COMPANIES DO QUALITY

6 LEVELS OF DOTS

▸ Atlassian Developer on Test

▸ 1. QA does exploratory testing

▸ 2. DoT + QA does testing + Release testing

▸ 3. QA Demo at code complete + DoT does all testing

▸ 4. QA Kickoff

▸ 5. Dev Kickoff + QA Review

▸ 6. No more DoT

HOW COMPANIES DO QUALITY

TEST CERTIFIED

▸ Google’s gamified eduction program

▸ Level 1

▸ Set up test coverage

▸ Set up continuous build

▸ Level 2

▸ No release with red tests

▸ Code coverage > 50%

▸ Level 3

▸ Require tests for all nontrivial changes

▸ Level 4

▸ Smoke tests in less than 30 mins

▸ https://mike-bland.com/2011/10/18/test-certified.html

WHAT DOES QA DO?

HOW COMPANIES DO QUALITY

WORK WITH DEVELOPERS

▸ QA demos

▸ Test notes

▸ Pair test

▸ Introduce new tools

▸ Teach automation skills

▸ Share knowledge

HOW COMPANIES DO QUALITY

EXPERIMENT

▸ Come up with ideas

▸ Convince teams to try

▸ Measure results

HOW COMPANIES DO QUALITY

BUILD

▸ Testing tools

▸ Automation frameworks

▸ Knowledge sharing systems

▸ Defect analysis tools

HOW COMPANIES DO QUALITY

GOOGLE’S DUAL ROLES

▸ Software Engineer in Test

▸ “A SET’s first job is testability. They act as consultants recommending program structure and coding style that lends itself to better unit testing and in writing frameworks to enable developers to test for themselves.”

▸ Test Engineer

▸ “TEs find and contribute to the riskiest areas of the software in whatever manner makes the most sense for that particular product.”

▸ “Ultimately, TEs are paid to protect users and the business from bad design, confusing UX, functional bugs, security and privacy issues, and so on.”

HOW COMPANIES DO QUALITY

DISCUSSION?