8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
1/26
By
Sajid Manzoor
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
2/26
What is Performance Testing Goals of Performance Testing
Importance of Performance Testing
Types of Performance Testing
Pre-requisites of Performance Testing
Performance Management Performance Testing Cycle
Performance Testing Activities
Performance Symptoms and Issus
Typical Order of Fixes
Challenges with Performance Testing Performance Testing Best Practices
Difference Between Performance Testing and PerformanceEngineering
AGENDAOFTHEDISCUSSION
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
3/26
Non-Functional testing to determine the
system responsiveness, stability, reliabilityand scalability
WHATISPERFORMANCE
TESTING??
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
4/26
Access production readiness
Compare two platform to compare which performsbetter
Compare performance characteristics of systemconfigurations
Evaluate system against performance criteria
Discover what parts of the application perform
poorly and under what conditions Finding the source of performance problems
Support system tuning
PERFORMANCETESTINGGOALS
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
5/26
Most users click away after 8 seconds of delay
$4.4 billion business revenue loss due to poor webapplications performance
Failure of US Based Airlines computerized system tomaintain flight plans in Nov 2009
Aberdeen found that inadequate performance couldimpact revenue by up to 9%
Business performance begins to suffer at 5.1
seconds of delay in response times of webapplications and 3.9 for critical applications
IMPORTANCEOFPERFORMANCETESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
6/26
An additional second of waiting on a websitesignificantly impact customer satisfaction and visitorconversions
Page viewers, conversions rate and customer
satisfaction drops 11%, 7% and16% respectively
IMPORTANCEOF
PERFORMANCETESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
7/26
IMPORTANCEOFPERFORMANCETESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
8/26
Load Testing
Stress Testing Soak/Endurance Testing
Volume/Spike Testing
Scalability Testing
Configuration Testing
TYPESOFPERFORMANCE
TESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
9/26
TYPESOFPERFORMANCETESTING(COND..)
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
10/26
Stable build free from all major functional defects
Performance testing environment similar toproduction environment
No other testing should be performed whilePerformance testing
Conduct Performance testing before going live
Complete understanding and knowledge of theapplication
PRE-REQUISITESOFPERFORMANCETESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
11/26
CALLCENTERAPPLICATIONINFRASTRUCTUREEXAMPLE
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
12/26
PERFORMANCE
MANAGEMENT
ProactiveApproach
ReactiveApproach
TYPESOFPERFORMANCEMANAGEMENT
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
13/26
Performance Testing after the System Testing
Advantages Costeffective
Disadvantages Difficult to resolve the performance bottlenecks after the
complete development
Defect removal cost will exponentially increase
Whole system can be useless
REACTIVEAPPROACH
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
14/26
PERFORMANCETESTINGCYCLE
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
15/26
COREPERFORMANCETESTINGACTIVITIES
Analyze, Report and Retest
Execute Tests
Implement Test Design
Configure Test Environment
Plan and Design Tests
Identify Performance Acceptance Criteria
Identify Test Environment
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
16/26
Identify Test Environment: Performance test environment should be exactreplica of production environment
Identify Performance Acceptance Criteria: Identification of performancetesting matrices and acceptable value of each matrix
Plan and Design Test: Identification of user test scenarios based on their
importance, frequency and performance impact
Configure Test Environment: Test environment setupas identified at firststep
Implement Test Design: Scriptingof user scenarios with the help of aperformance testing tool
Execute Tests: Executionof scripted user scenarios against different user
sets with different configurations Analyze, Report and Retest: Analyzethe executed tests results with
identified matrices, report results to stake holders and Retestif tests were notpassed in previous iteration
PERFORMANCETESTING
ACTIVITIES
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
17/26
PERFORMANCESYMPTOMSANDISSUES
Symptoms of Web ApplicationPerformance Problems
Database Problems
Web Server Problems
Application Server problems
Network Problems
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
18/26
Long user response time
Memory leaks
High CPU usage
Too many open connections
Length queues for requests
Too many table scans ofdatabase
Database deadlocks
Erroneous data returned
HTTP errors
Pages not available
WEB PPLIC TIONSPERFORM NCEPROBLEMS
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
19/26
Insufficient Indexing
Fragmented Database
Out-of-date Statistics
Faulty Application Design
D T B SEPERFORM NCEPROBLEMS
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
20/26
WEBSERVER
PERFORMANCE
PROBLEMS High CPU Usage
Poor Server Design
Memory Problems
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
21/26
Poor Database Tuning
Poor Cache Management
Poor Session Management
Poor Security Design
APPLICATIONSERVER
PERFORMANCEPROBLEMS
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
22/26
NETWORKPERFORMANCEPROBLEMS
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
23/26
TYPICALORDEROFFIXES
Improve current applicationdesign (Algorithms, caching, DB
calls, memory use)
Upgrade hardware (RAM, CPU,network bandwidth)
Upgrade software infrastructure(OS, web server, database)
Upgrade system architecture (Client-serverto basic n-tier, software and hardware
changes, Use hardware load balancing /SSL
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
24/26
InfrastructureSetup
Collection and Analysis of Huge Data
Identifying the Problem Root cause
Team effort required (Product vendors, Architects, Developers,
Testers, Database administrators, Network administrators) Accuracyof results
Clientinvolvement
Testing inside the firewall
Multidimensional applications (web, SAAS, mobile etc.)
Testing on Live Server Expensive
CHALLENGESWITHPERFORMANCETESTING
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
25/26
Use Ramp up approach
Repeat the tests 2-3 times to confirm the results
Run tests at different times Run individual tests before combining them in a
single test
PERFORMANCETESTING
BESTPRACTICES
8/13/2019 introtoperformancetestingswaamtech-121018035200-phpapp01
26/26
+92-42-35782346
www.Twitter.com/SwaamTech
www.FaceBook.com/SwaamTech
http://www.twitter.com/SwaamTechhttp://www.facebook.com/SwaamTechhttp://www.facebook.com/SwaamTechhttp://www.twitter.com/SwaamTech