Top Banner
PATTERNS OF A “GOOD” TEST AUTOMATION FRAMEWORK! Anand Bagmar Software Quality Evangelist
41

Patterns of a “good” test automation framework

Mar 21, 2017

Download

Software

Anand Bagmar
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Patterns of a “good” test automation framework

PATTERNS OF A “GOOD” TEST AUTOMATION FRAMEWORK!

Anand Bagmar

Software Quality Evangelist

Page 2: Patterns of a “good” test automation framework

ABOUT ME

@BagmarAnand

Blog - essenceoftesting

about.me/anand.bagmar

Page 3: Patterns of a “good” test automation framework

WHAT DO YOU EXPECT FROM THIS SESSION?

Page 4: Patterns of a “good” test automation framework

TELL ME ...

¨ Any Managers in the room?

¨ Developers / Testers / Automation “folks” in the room?

¨ What toolset do you use for Automation?

¨ How many automated tests do you have?

¨ Have you heard the phrase - ”Test Automation code should be of Production Quality”?

¨ Do you believe it?

¨ Anyone in the room does not code / understand code?

4

Page 5: Patterns of a “good” test automation framework

Disclaimer

Page 6: Patterns of a “good” test automation framework
Page 7: Patterns of a “good” test automation framework

What is a Pattern?

Page 8: Patterns of a “good” test automation framework
Page 9: Patterns of a “good” test automation framework

https://en.wikipedia.org/wiki/Software_design_pattern

Page 10: Patterns of a “good” test automation framework

Have you heard-of or used any

Pattern(s) in Test Automation?

Page 11: Patterns of a “good” test automation framework

COMMON PATTERNS USED IN TEST AUTOMATION

¨ Page-Object

¨ Business Layer

¨ Singleton

¨ Composition

¨ Factory

¨ Builder

Page 12: Patterns of a “good” test automation framework

Test Automation Framework Patterns

Page 13: Patterns of a “good” test automation framework
Page 14: Patterns of a “good” test automation framework

Code sample - #1

Page 15: Patterns of a “good” test automation framework

Page-Object Pattern

Page 16: Patterns of a “good” test automation framework

PAGE OBJECT PATTERN

Model pagesin code

Simulates user actions

One place change

Reduces code duplication

Snippets of page

Page 17: Patterns of a “good” test automation framework
Page 18: Patterns of a “good” test automation framework

Code sample - #2

Page 19: Patterns of a “good” test automation framework

AUTOMATION FRAMEWORK WITH PAGE OBJECTS

Page 20: Patterns of a “good” test automation framework

LIMITATIONS OF PAGE-OBJECT PATTERN

¨ Test intent gets polluted

¨ Duplication of Test intent & implementation

¨ Intent becomes Imperative

¨ Maintenance challenges

¨ Scaling challenges

Page 21: Patterns of a “good” test automation framework

Business-Layer

Page-Object Pattern

Page 22: Patterns of a “good” test automation framework

BUSINESS-LAYER PAGE-OBJECT PATTERN

Page 23: Patterns of a “good” test automation framework

Code sample - #3

Page 24: Patterns of a “good” test automation framework

ADVANTAGES OF BUSINESS-LAYER PAGE-OBJECT PATTERN

¨ Validate what is important - Business requirements

¨ Test Pyramid remains sane

¨ Abstraction layers allow separation-of-concerns

¨ Changes are isolated

¨ Maintenance & Scaling becomes ‘easier’

Page 25: Patterns of a “good” test automation framework

Test Data Patterns

Page 26: Patterns of a “good” test automation framework

Why do we need to think differently about Test Data?

Page 27: Patterns of a “good” test automation framework

CRITERIA FOR TEST DATA

¨ Data is complex

¨ Needs to mimic “real” data

¨ Needs to be unique

¨ Data can be nested

¨ Though specified as static, may need to be Dynamic

¨ Data can be shared and reused

Page 28: Patterns of a “good” test automation framework

DIFFERENT WAYS TO SPECIFY TEST DATA

¨ In Test implementation

¨ In Test specification / intent

¨ In code … separate data structures / classes / etc.

¨ External files

Page 29: Patterns of a “good” test automation framework

TEST DATA SPECIFICATION EXAMPLES

¨ Excel

¨ CSV

¨ Property

¨ XML

¨ YAML

¨ Database

¨ Json

Page 30: Patterns of a “good” test automation framework

Code sample - #4

Page 31: Patterns of a “good” test automation framework

CRITERIA FOR SELECTION

¨ Easy to specify

¨ Easy to read and consume (by test framework)

¨ Ability to override specified data, easily

¨ Usable

Page 32: Patterns of a “good” test automation framework

TIPS FOR IMPLEMENTATION

¨ Consistent way to specify test data

¨ Read the data – as Business Entities

¨ Override as appropriate

¨ Create DSL to give meaning to data

¨ Use in test implementation

¨ Implement Test Data Entity Utilities – Build, Equals, Copy, Find, etc.

Page 33: Patterns of a “good” test automation framework

Locators’ Patterns

Page 34: Patterns of a “good” test automation framework

DIFFERENT WAYS TO SPECIFY ELEMENT LOCATORS

¨ In Page-Objects

¨ In separate files, per Page-Object

¨ In external files / locator files

Page 35: Patterns of a “good” test automation framework

Advantages of using Patterns for Test Automation

Page 36: Patterns of a “good” test automation framework

ADVANTAGES OF PATTERNS

¨ Well known, well understood

¨ Tried & tested solutions for common problems

¨ Reduces complexity

¨ Language neutral

¨ Aid in communication

Page 37: Patterns of a “good” test automation framework

ADVANTAGES OF PATTERNS IN TEST AUTOMATION

Saves time & effort (eventually)

Single ownership

Test Automation Code is of Production Quality!

Single point of change

Easy to –- Implement - Maintain- Debug- Scale

Page 38: Patterns of a “good” test automation framework

WHICH IS THE “BEST” PATTERN TO USE ?

Page 39: Patterns of a “good” test automation framework

It DEPENDS!on the

Context!

Page 40: Patterns of a “good” test automation framework

REFERENCES

Page Objects – Google

https://code.google.com/p/selenium/wiki/PageObjects

Page Objects – Martin Fowler

http://martinfowler.com/bliki/PageObject.html

Perils of Page-Object Pattern – Anand Bagmar

http://essenceoftesting.blogspot.in/2014/09/perils-of-page-object-pattern.html

Test Design Consideration

http://docs.seleniumhq.org/docs/06_test_design_considerations.jsp

Sample Test Framework implementation

https://github.com/anandbagmar/cuke-jvm-sample

Page 41: Patterns of a “good” test automation framework

@BagmarAnand

Blog - essenceoftesting

about.me/anand.bagmar

THANK YOU