Automated frameworks for testing: - Experiences, trends ... · • Reuse framework knowledge. Framework, functions and tools Visualization Result Reports Management ... - Result Test

We bring you lemonade

Automated frameworks for testing:

- Experiences, trends and governance

A journey over a decade

•

•

•

Why should you automate?

•

•

•

•

•

•

What should you automate?

•

•

•

•

•

•

•

•

One tool?

Record & Replay?

Quick, easy, cheap?

Is it that simple…?

…20192018201520122010

This is me

• Ludwig Östlund

• Lemontree• Service Manager• Project lead• Test automation

engineer

• Personal:• Cycling• Rubiks cube• Fine dining• Guitar

…20192018201520122010

TEST CASE 1

SCRIPT

SCRIPT

SCRIPT

SCRIPT

SCRIPT

TEST CASE 2

SCRIPT

SCRIPT

SCRIPT

SCRIPT

SCRIPT

TEST CASE 42

SCRIPT

SCRIPT

SCRIPT

SCRIPT

SCRIPT

TEST CASE 1

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE 2

SCRIPT

SCRIPT

SCRIPT

OPEN ORDER

SCRIPT

TEST CASE 42

SCRIPT

SCRIPT

OPEN ORDER

SCRIPT

SCRIPTMaintenance!Repetitive!!Boring!!!

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT TEST CASE

SCRIPT

OPEN ORDER

SCRIPT

SCRIPT

SCRIPT

Reusable Components

Open Order

Data driven- Order number- Customer ID

Keyword Driven- CHANGE_ORDER- PLACE_ORDER- DELETE_ORDER

Test Case 1- Test data- Keywords

Test Case 2- New test data- New/Reusable keywords- Same component

New test scripts

Open Order

E2E Workflow

System 1

• Components:

• Create order

• Verify details

• Submit order

System 2

• Components:

• Open order

• Verify details

System 3

• Components

• Open order

• Verify details

• Complete order

Parallel Test Execution

Automated Test Executions

ExecutionHost

ExecutionHost

ExecutionHost

Lemontree Test Enabler (LTE)

•

•

•

•

•

•

•

•

Conditions for success

•

•

•

•

•

•

•

Test Automation Center of Excellence

•

•

•

•

•

•

•

•

•

…20192018201520122010

Mobile automation

open-source

Decentralization

What happens?

CoE

Team 1

Team 2

Team 3Team 4

Team 5

•

•

•

•

•

•

•

•

•

Challenges

…20192018201520122010

Test data - GDPR

Trends

• Demand for open-source tools

• Teams want to choose their own stack

• Proven concept is strong but requires thirdparty licence based products, more degreesof freedom wanted

• Multi programming language demand

• Reuse framework knowledge

Framework, functions and tools

VisualizationResult

Reports

Management- Project- Requirement- Test- Defects

Maintenance- Documentation- Result

Test Definition- Test data- E2E-configuration- Parameterization Test tools

- Selenium- Appium- UFT- Cypress

Technologies• Android, iOS• Java• SAP• Mainframe

Version/Source Control- Test cases- Components- Libraries

…20192018201520122010

• Continued automated testing through GUI and API

• Reuse and combine tests and components from different teams to enable E2E testing

• Connect your tools of choice

• Combine E2E automated regression with unit- and system tests in continuous builds

• Generate test data for non-automated tests

• Reuse in Robot Process Automation

• AI assisted failure analysis

Future focus areas

A journey over a decade

•

•

•

Hungry for more?Join me after lunch!