Berlin QA - Performance Testing

Performance testing & beers

Berlin QA // Because blame doesn´t fix bugs

José Aracil // Operations Manager // Globe Testing

12/04/2023Confidential and Propietary // All rights reserved // Globe Testing

About usWe are fun!


About us Focussed on Software Testing and ALM

Knowledgeable and experienced staff

Innovation: in the forefront of our services

Obsessed with excellence and attention to detail


Our services

Functional Testing Performance Testing Performance Management

Test Execution(manual or automated)

Test managementPerformance, load,stress,

soak…

System optimization

Availability and

performanceUnderstand

end user experience

Proactive problem

resolution

Foundation

Traceability & Control Vision & ReportingProcess Standardization (i.e. Waterfall, Agile)

DevOps

Application Lifecycle Management

Training & Coaching Outsourcing & turnkey projects

Diagnostics

Consulting ServicesQA Tools Deployment

Current situationWhere we stand right now

Confidential & Proprietary

Application evolution

• Valuable, but growth is capped• Costly, brittle, monolithic and

proprietary• Must change structure to evolve

• Next generations of SAP and Oracle based on SOA

• SOA driving new custom applications and legacy integrations

• New Web 2.0 models• “Mashups” in the enterprise

New and Agile Business CapabilitiesShared Services / Composite Apps

Yesterday’s applications: Today’s applications:


The challenges of our modern world

Composite Applications

Service oriented applications

Modern, mobile applications

Agile & Modern business require MODERN and FAST applications



The challenges of our modern worldAgile & Modern business require MODERN and FAST applications

Application Unavailable

10x more performance risks

Functional defects


Performance Testing

Performance• Optimal application performance is in the

experience of the end user.

Why is my application not performing?• Looks simple, if we optimize all layers in

isolation, the resulting system should perform.

Performance is in the eyes of the beholder











Probably a MEMORY leak…

or may be a CODE issue…

I guess it is NETWORK!

Does your application have performance issues?

It is probably a memory leak issue!

No, it may be a CODE issue!

I guess is Network related!

We are not ready for the 100, 1000, 100000 users!

We SHOULD haveTESTEDPerformance!

How HP LoadRunner Works

5 Analysis, diagnostics and reporting

DatabaseInternet/WANMiddle Tier

(HTTP, WebSphere, Server, Network)Applicatio

nEnd user

Thousands of users are simulated

Transaction recording

“Transfer Funds”

“Check Balance”

“Pay Bills”

Scripting1

Test Scenario

Test planning2

Load generation

3 Monitorization4


Planning

Recipe for successTest Strategy

•Set expectations•Project planning•Environment description•Responsible people•Test scenario definition•Test case definition•Monitors to be used•“Live” document


Planning

Preparation

Test Env. + Data



•Env. Setup (pre-prod)•Data load to resemble prod.

Planning

Preparation

Tool setup


Test Env. + Data •Performance testing tools•Monitorization tools•Other tools (reporting,…)

12/04/2023

Planning

Preparation

Test case design

•Transactions•Image and text checks•Test data


Tool setupTest Env. + Data


Planning

Preparation

Monitor config.


Tool setupTest Env. + Data Test case design•Select any “interesting” metrics that should be monitored•Identify advanced metrics


Planning

Preparation

Scripting


Tool setupTest Env. + Data Test case design

Monitor config.

•Turn test cases into automated scripts•Complexity changes depending on the tool used


Planning

Preparation

Smoke Test



Monitor config. Scripting

•Check that previous phases have been done properly•It doesn´t add value to carry on if there are pending items


Planning

Preparation

Execution

Baseline




Smoke Test

•Obtain a standard for comparison•If performance is not good, it doesn´t add value to carry on with other test


Planning

Preparation

Execution

Performance Testing

•Iterative process•Minimum 2 iterations




Smoke Test

Baseline


Planning

Preparation

Execution

SOAK Test




Smoke Test

Baseline

Performance Testing

Análisis +

Changes

+ R

eport

Other tests


Load Testing

Planning

Preparation

Execution

Stress




Smoke Test

Baseline

Soak Test Load Testing Other tests

Performance Testing

Análisis +

Changes

+ R

eport

•Optional test•Only if previous test are successful


Planning

Preparation

Execution

Reporting

Final report




Smoke Test

Baseline


Stress

Performance Testing

Análisis +

Changes

+ R

eport

•Summary of the test executed, problems found and solutions applied•Too much detail doesn´t add value to the project


Planning

Preparation

Execution

Reporting




Smoke Test

Baseline


Stress

Final report

Performance Testing

Análisis +

Changes

+ R

eport


Planning

Preparation

Execution

Reporting

Final reportStressSOAK TestPerformance TestingBaselineSmoke TestScriptingMonitor config.Test case designTool setupTest Env. + Data

•Transactions•Image and text checks•Test data

•Iterative process•Minimum 2 iterations



Test Strategy


Smoke Test

Baseline


Stress

Final report

Performance Testing

Análisis +

Changes

+ R

eport

•Set expectations•Project planning•Environment description•Responsible people•Test scenario definition•Test case definition•Monitors to be used•“Live” document

•Performance testing tools•Monitorization tools•Other tools (reporting,…)

•Select any “interesting” metrics that should be monitored•Identify advanced metrics

•Turn test cases into automated scripts•Complexity changes depending on the tool used

•Check that previous phases have been done properly•It doesn´t add value to carry on if there are pending items

•Obtain a standard for comparison•If performance is not good, it doesn´t add value to carry on with other test

Other tests

•Optional test•Only if previous test are successful

•Summary of the test executed, problems found and solutions applied•Too much detail doesn´t add value to the project


Load Testing•Env. Setup (pre-prod)•Data load to resemble prod.

Success Guaranteed!

Confidential and Propietary // All rights reserved // Globe Testing

Thank you for your timeJosé Aracil // [email protected]

Berlin QA - Performance Testing

Technology

success test strategy

test cases

planning preparation

software testing

performance issues

tested performance

text checks test data

planning recipe