Page 1
©2010 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice
1
Heather Taylor – Sr Product Marketing [email protected]
HP Software Test Automation Tools
What’s New
HP Unified Functional TestingHP Functional Testing (QuickTest Pro)HP Service Test
Page 2
22
Modern Applications bring new Testing Challenges
Page 3
3
What does the business want?
Base: 206 IT decision makers with insight into budgeted modernization activities. Source: Clearing Your Path to Modern Applications and Business Agility, Forrester Research, April 6, 2010. A Forrester Consulting thought leadership paper commissioned by Hewlett Packard.
Agility…
Innovation…
Lower cost…and a better application
experience
Page 4
4
What does application modernization mean to QA?
Technology• Complex integrated
systems• Distributed components• Test GUIs, APIs, web
services and vertical integration
• RIA, Web 2.0
Process• Agile, iterative hybrids• Automate early without
GUI• Accommodate fast-paced
changes
People• Global, distributed teams• Pressure to expand skill
set or risk being outsourced
• More BA participation• Increase collaboration with
development
Asks• Shorten test cycles• Improve planning
estimates• Test more with less• Take on more technical
tasks• Improve collaboration• Align testing objectives
with overall business objectives
Page 5
5
Test and Automate early for best outcome
C1 C1
C2
C1
C2
C3
G2
C1
C2
G1 G1
C3
C1
C2
G1
G3
G2
C3
C1
C2
G1
… …BP1
BP2
G3
G2
C3
C1
C2
G1
Regression test at the end of each iteration or as part of continuous build
Automate tests when available
components become stable
C GUI-less component
G GUI element
BP business process
stable component
Page 6
6
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Interact with modern GUI interfaces, Web 2.0
Page 7
7
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
Page 8
8
Modern Applications have many layers
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
Page 9
9
Modern Applications have many layers
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Report on the quality of the entire end to end process
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
Page 10
10
Modern Applications have many layers
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Interact with modern GUI interfaces, Web 2.0
Continue the scenario to the headless layer; test the integration between the layers
Report on the quality of the entire end to end process
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
Page 11
11
HP Software solutions multi-layer testing
Process Layer
A new transaction
Exchange
Screen 5 (Java)
Screen 6 (.NET)
SAP
Screen 3 (.NET)
Screen 4 (Ajax)
Web 2.0 Billing
Screen 1(Ajax)
Screen 2 (Java)
End to end business process
Graphical user
interface layer
Headless Layer
Component 1(.Net API)
Component 2(Java API)
Component 3(web service)
Component 4(JMS service)
Component 5(web service)
Component 6(REST service)
HP Unified Functional Testing
HP Unified Functional Testing includes the ability to test the GUI layer + the Headless layer + the end to
end process.
Page 12
12
Unified Functional Testing
HP Service Test
HP Functional Testing
(QuickTest Professional& all the add-ins)
Call activities from the other
productTransfer data Unified report
HP Unified Functional Testing 11.00
Page 13
13
HP QuickTest Pro script to call HP Service Test HP Unified Functional Testing integration
HP Service Test call in QTP
Page 14
14
Unified report showing HP Service Test step
Shows activities from bothHP Functional Testing & HP Service Test
Multiple views of the flow
Full traceability for easier debugging
Page 15
1515
HP Functional Testing (QTP)
Page 16
16
What’s new with HP Functional Testing 11.00? (QuickTest Pro)
GUI and headless testing with Unified Functional Testing
Visual Object Identification
Web 2.0 and RIA support
Dev-QA collaboration with application log verification
Enhanced Reporting
Data Awareness to help Prepare and Manage Test Data
And More….
Page 17
HP Restricted | Date or Rev. #17
Visual Identification of Objects
HP Functional Testing 11.00
Page 18
18
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
Page 19
19
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Ferrari
Fiat
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
Page 20
20
Harden test scripts against changes in the application GUI
Visual Identification of Objects
– Record a test script to buy a Ferrari – yeah!
– But! The object is in different position the nextday… you’re about to buy a Fiat – boo!
– QTP allows you to identify “key” and “fragile” objects and express a geometric relationship between them
BUY
BUY
BUY
BUY
Ford
Honda
Fiat
Ferrari
// index = 0
// index = 1
// index = 2
// index = 3BUY
BUY
BUY
BUY
Ford
Honda
Ferrari
Fiat
// index = 0
// index = 1
// index = 2
// index = 3
MondayTuesday
TopGearCars.com
Page 21
21
Schematic Representation
Visual Identification of Objects
Page 22
22
New Complex Visual Relationship IdentifierVisual Relation Identifier – object details
New VRI Object
Property
Clickto Add
Page 23
23
Configure Relation
Visual Identification of Objects
Object Relation Preview on AUT
‘Static’ object
Page 24
HP Restricted | Date or Rev. #24
Collaboration between Dev and QA using AUT Log Verification
HP Functional Testing 11.00
Page 25
25
Leverage application log into the Functional Testing effort
Application Under Test (AUT) Log Verification
Detects issues of the AUT internal state
Supports Log4Net and Log4J
Enhances the test reports
Pass/fail a test according to log errors
Detailed defect description
Page 26
26
Log Tracking Pane
Log tracking Report in the Run Results Viewer
Page 27
HP Restricted | Date or Rev. #27
HP Functional Testing & HP Quality Center Integration
Data Awareness Capability
HP Functional Testing 11.00
Page 28
28
Improved data management capabilities with HP Quality Center + HP Functional Testing
Share test data across tests and test scenarios
Run tests on a subset of the data; reporting is granular to the data row level
Requirements coverage can be granular to the test data level
Data source
Req 1
Req 2
Req 3 Test 3
Test 2
Test 1 Data set 1
Data set 2
Data Set 3
Page 29
HP Restricted | Date or Rev. #29
Testing Web 2.0 and RIA
HP Functional Testing 11.00
Page 30
30
Out of the box support
Community
Testing Web 2.0 and RIA
• Simpler & faster• Harness the power of
community• Aimed for Web 2.0 controls
Extensibility Accelerator
RIA
Ajax Toolkitsand more…
Extensibility
Page 31
31
Out of the box support
Community
Testing Web 2.0 and RIA
• Simpler & faster• Harness the power of
community• Aimed for Web 2.0 controls
Extensibility Accelerator
RIA
Ajax Toolkitsand more…
Extensibility
Page 32
32
Opening web extensibility to the online community: Extensibility Accelerator
Page 33
33
Easy, wizard-like interface
Extends HP Functional Testing fast; uses Intellisense
Automated deployment
Free download from www.hp.com
Opening web extensibility to the online community: Extensibility Accelerator
Page 34
34
Improved debugging capabilities
Page 35
35
Additional Web support
– Support for Firefox on web extensibility objects−Run, Record, Learn, Spy
– Identify object according to the XPath and CSS– Automatically identify control using Xpath
Page 36
HP Restricted | Date or Rev. #36
Enhanced Reporting
HP Functional Testing 11.00
Page 37
37
Enhanced reporting and Run Results Viewer
Executive Summary
Page 38
38
Enhanced reporting and Run Results Viewer
Executive Summary
Data
Page 39
39
Enhanced reporting and Run Results Viewer
Executive Summary
DataPrevious
Run
Page 40
40
Enhanced reporting and Run Results Viewer
Customizable panes
Quick high level overview
Collaborative report viewer – No need for a FT license
Recovery for corrupted reports
Executive Summary
DataPrevious
Run
Page 41
HP Restricted | Date or Rev. #41
And more…
HP Functional Testing 11.00
Page 42
42
New Menu and EvaluatorImproved regular expressions
New Regular Expression Evaluator
aids in writing and validating regular
expressions.
Works with the Object Repository,
Checkpoints and Recovery Scenarios
Page 43
43
Object Spy Enhancements
Highlight the selected object
in the application
Copy object description
Add test object to current
repository
Page 44
4444
HP Service Test
Page 45
45
GUI
Why focus on testing the headless layer?
Page 46
46
GUI
AquaLogic
BPMS
Tibco
TradingLogistics
Rules Engines
Reservations
JMS
Java.Net
WCF
XML JSON
Fix / Swift
Web servicesSOAP
Why focus on testing the headless layer?
Page 47
47
• Bugs discovered earlier are cheaper and easier to fix
• Shorten late-stage testing cycles
Test earlier in the lifecycle
• Reduce test cycle time for services and consuming applications
Another opportunity for
automation
• Harden the building blocks of your applications
• Reduce risk in all layers of the application
Independent validation of services &
components
• …like performance, security, integrations, standards compliance and more
Can’t test all aspects through
the GUI…
Why focus on testing the headless layer?
Page 48
48
HP Service Test 11.0
Services testing made easy
• Visual, intuitive test design
• Ready-to-use test activities
• Features for both technical and non-technical users
• Test headless layer without programming
• Powerful data driving• Simple security config.
Integrations with HP Software
• Multi-layer testing with HP QuickTest Professional
• Integration with HP Loadrunner
• Industry-leading test management with HP Quality Center
• Enhanced component test management using HP Service Test Management
Technology support
• Activities for HTML, WSDL, REST, JMS, Java, WS-Security, and more OOBox
• Add custom event handlers with .NET, C# and auto-completion
• Based on standard .NET framework
• Add support for additional technologies not supported out of the box
Page 49
49
HP Service Test visual test designer
Page 50
50
Visual Test Flow Designer
drag & drop canvas
Page 51
51
Extensive Toolbox(Almost) codeless
testing
Page 52
52
Activity Properties
Page 53
53
Powerful Data Handling!
Supports text-based data tables, Excel,
XML
Page 54
54
Configuring security
Straightforward security config for most common standards including WS-Security and WCF scenarios
Page 55
55
Data driving Map fields in the property sheet to columns in the data table
Auto generate from the structure of the activity, or drive manually with existing file
Page 56
56
Creating custom events
Choose from a list of events, or create custom event handlers
Page 57
57
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 58
58
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 59
59
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 60
60
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 61
61
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 62
62
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 63
63
Custom event handlers
Auto-complete makes it easier to create custom event handlers
Page 64
64
Join the community!
– www.hp.com/go/swcommunity
– The Future of Testing blog (swcommunity)
– www.hp.com/go/functionaltesting for more product information and product availability matrix
– LinkedIn groups for QC, BPT, QTP and Service Test (new!)