Intuit continuous performance testing for code camp temp

people

Intuit Continuous Performance Testing

Thiru – Principal EngineerRamki – Staff Engineer in Quality

•Takeaway•Context & overview•Solution details•Samples•Q & A

Agenda

Takeaway

•Performance Testing Landscape•Building blocks•Achieve automation•Available tools•Benefits of automation

Overview

Build

• What: – Code to artifact

• Challenges:– Wait time– Failures

• Technology:

Deploy

• What: – Artifacts to system

under test– Setup

• Challenges:– Multiple subsystems– Configuration change

• Technology:

Test

• What: – Simulate load and

observe system under test

• Challenges:– Too many systems and

parameters to watch for– Babysitting to detect

failures– Decide test

• Technology:

Metrics collection and Monitoring

• What: – CPU, load average, JVM

heap, Memory, swap, disk IO, network IO, sockets, DB connections etc

• Challenges:– Too many systems and

parameters to watch for– Babysitting to detect

failures– Decide test

• Technology:–Twiddle –Oracle AWR (automatic workload repo)

Analyze

• What: – Gather measurements

and extract meaning information

• Challenges:– Too many systems and

parameters– Consolidation– Volume

• Technology:

Report

• What: – Meaning information

to easy to digest form

• Challenges:– Make reports

available– Communication out– Format/Layout– Consolidated graphs– Volume

• Technology:

Solution

CPU graph

Tool: gnuplot (open source)

14

Challenges

Challenges

• Collecting system resources usage

• Grouping of system resource graphs for all servers

• Multiple subsystems/technologies

Benefits

• Quick Turnaround• Reduce resource cost• Effectively using hardware• No human errors• Accurate • Multiple iterations on demand• History and trend

What’s Next

• Integrate with bug tracking system

• Find out the severity• Pinpoint the issue• Provide all necessary info

Q & A

Want to talk more?We’ll be at the Intuit booth today 11:30am-3:30pm.

[email protected][email protected]

Intuit Speakers @ Silicon Code Camp 2013:SATURDAY9:45 a.m. - Ramakrishna Kollipara – “Complete Automation of Performance Testing” 1:45 p.m. - Joe Wells - “QBO: Journey From legacy Java app to a Client-side HTML5 app”3:30 p.m. - Naga Addagadde & Sangeeta Narang – “Intuit APIs for Financial Transaction Aggregation”5:00 p.m. Ted Drake –“Hitting the Accessibility High Notes with ARIA”

SUNDAY9:15 a.m. - Eugene Krivopaltsev –“Building Native Mobile Apps with Custom Views” 1:15 p.m. - Tim Hobson – “Developing Highly Instrumental Applications with Minimal Effort”

You don't want to miss out on a chance to win this cool headset. Stop by our booth to enter!

For more information about joining our organization visit our booth or connect with our onsite recruiter:

[email protected]