Test Automation In Python - FINAL · Lessons learned in test automation There are alternatives to ‘pre -production’ automation Keep it as focused on risk and lightweight as possible

Test Automation In Python

Kyle McEvoy

@_kmce

Director of QA

Kyle McEvoy

@_kmce

Director of QA

First conf talk! Thanks NTD!

√

We’re hiring!fanduel.com/careers

What Python has to offer for test automation


General use case examples


General use case examples

Lessons learned in test automation

Why Python? Why not X?


● No language is truly ‘better’ overall


● No language is truly ‘better’ overall● It’s all about context!



Your skills



Your skillsSkills of team




Test co-location




Test co-location

Available packages




Test co-location

External support

Available packages




Test co-location

External support

Available packages Design principles

● Lower barrier for entry● Open source● Scripted language● Platform independent● Extensive standard library● Extensive community packages (PyPI)● Vibrant and supportive community

Python


Python


Python


Python


Python


Python


Python


Python

Java

Python

Java

Python1 < 5

Browsers

BrowsersNative Apps

BrowsersNative Apps

APIs

BrowsersNative Apps

APIsDistribution/Concurrency

BrowsersNative Apps


BDD

BrowsersNative Apps


Reporting

BDD

BrowsersNative Apps


Reporting

BDD

Test Framework

Popular test frameworks

● unittest (standard library)


● Robot Framework



● Robot Framework

● pytest



● Robot Framework

● pytest



● Robot Framework

● pytest


Basic JUnit TestFirstJUnit5Tests.java

Basic pytest Test

test_file_example.py

JUnit

pytest

Basic pytest Test


Basic pytest Test


Basic pytest Test


“test_”

Installing pytestTerminal


Pip Installs Packages

Installing pytest

PyPIYou

Installing pytest

PyPIYou


Virtual Environments

Python Virtual Environments

venv venv2 venv3- pytest (3.2.2)

- custom (1.3.1)

- pytest (3.2.2)

- custom (2.0.1)

- pytest (3.5.1)

Project1 Project2 Project3

Python Virtual Environments

wtests ios apienv- pytest (3.2.2)

- custom (1.3.1)

- pytest (3.2.2)

- custom (2.0.1)

- pytest (3.5.1)

WebTests IOSTests APITests

Basic pytest Test


Test resultTerminal

Basic pytest Test


Test resultTerminal

pytest

● Test auto-discovery

pytest

● Test auto-discovery● No boilerplate

pytest


● Detailed failure introspection

pytest



● Simple modular test fixtures

VERIFY

EXERCISE VERIFY

SETUP EXERCISE VERIFY

SETUP EXERCISE VERIFY TEARDOWN


Test Function


Test Fixtures

JUnit fixture exampleFirstJUnit5Tests.java

JUnit fixture exampleFirstJUnit5Tests.java

pytest fixture example






Use case

Use case API Test

Use case

Methods● Login● Get my username● Give money● Logout

API Test

Use case


Methods under test● Get my username● Give money

API Test

Use case



Test Setup● Login

API Test

Use case



Test Setup● Login

Test Teardown● Logout

API Test

Use case



Test Setup● Login


Already created● API Client SDK● Data models

(e.g. User)● Test user

API Test



test_file_example.pyfixtures

test_file_example.pyfixtures

test


fixtures

test

imports

conftest.py

test_usernames.py

conftest.py

test_usernames.py test_credit.py

Use case



Test Setup● Login


Already created● API Client SDK● Data models

(e.g. User)● Test user

API Test

conftest.py


conftest.py


conftest.py


test_credit.py

test_credit.py

pytest




pytest




● Great plugins & complimentary packages

Popular plugins & packages

● Selenium Python bindings (selenium)● pytest Selenium wrapper (pytest-selenium)● Appium Python bindings (Appium-Python-Client)● Behaviour-Driven Development (pytest-bdd)● Test distribution (pytest-xdist)









Terminal

Terminal



*not a real tw eet

Use case

Use case Browser Test


Page under test● Deposit page



Test Setup● Create user● Load browser● Login as user● Navigate to

Deposit Page




Deposit Page

Test Teardown● Close browser


Deposit Page



Deposit Page


user fixture


Deposit Page


user fixtureselenium fixture


Deposit Page


user fixtureselenium fixturelogged_in_browser fixture


Deposit Page


user fixtureselenium fixturelogged_in_browser fixturedeposit_page fixture


Deposit Page


user fixtureselenium fixturelogged_in_browser fixturedeposit_page fixture

selenium fixture

pages/deposit_page.py

conftest.py

tests/test_deposit_page.py




decorators.py

decorators.py

conftest.py



Client projects

Client projects API projects

Client projects API projects Services Projects



Common project

CommonFixtures & helpers

contestsusers

services & more

entriesrewards

Further readingpytest.org (Thank you pytest contributors!)



● There are alternatives to ‘pre-production’ automation


● There are alternatives to ‘pre-production’ automation● Keep it as focused on risk and lightweight as possible


● There are alternatives to ‘pre-production’ automation● Keep it as focused on risk and lightweight as possible● It’s a cultural challenge as much as it is technical


● There are alternatives to ‘pre-production’ automation● Keep it as focused on risk and lightweight as possible● It’s a cultural challenge as much as it is technical● Testability can often be underrated


● There are alternatives to ‘pre-production’ automation● Keep it as focused on risk and lightweight as possible● It’s a cultural challenge as much as it is technical● Testability can often be underrated● Have zero tolerance for test ‘flakiness’


● There are alternatives to ‘pre-production’ automation● Keep it as focused on risk and lightweight as possible● It’s a cultural challenge as much as it is technical● Testability can often be underrated● Have zero tolerance for test ‘flakiness’● Peer reviews on tests are invaluable

Thank you!@_kmce

Test Automation In Python - FINAL · Lessons learned in test automation There are alternatives to ‘pre -production’ automation Keep it as focused on risk and lightweight as possible

Documents