Knowit
Dec 22, 2015
Knowit
Started at Knowit Quality Management Oslo AS Sept. 2013.
I have 12 years experience in the area of testing and quality assurance from both the customer and vendor side, and i have a general broad experience with test tools.
I have worked for many years in the Norwegian Armed Forces and this is where i got really intressted i testing
Utvalgte kunder: Nordea, Statsbygg, Oracle, Santander Consumer Bank, DNB, Telenor, Simens Business Services – Det Norske Forsvaret.
Kristjan KristjanssonPartner
Kristjan KristjanssonPartner / Managing Consultant, Knowit Quality Management Oslo AS
http://no.linkedin.com/in/kristjan74
+47 920 81 741
1900 specialists400 in Norway
Nordic
Bergen, Oslo, Stavanger andKristiansand
Norway
BusinessAreas
1200IT 400
Design&
Digital200Managemen
t
A large number of specialists in 3 main areas
The newsolutions
Manage-ment
A unique combination of specialists creates a unique delivery to our customers
IT
Design&Digital
User
Brand
BI UI
The newsolutions
Manage-ment
A unique combination of specialists creates a unique delivery to our customers
IT
Design&Digital
User
Brand
BI UI
” We are allways looking for more consultants, so please keep us in mind ”
Introduction
Why test automation for mobile
Challenges in test automation for mobile
HP's tool set for test automation for mobile
Demo
Q & A
Todays agenda
HP Software - Arne Christian Sandsmark
A tipping point for application delivery
2010 4 per app
201536 per app
2020120 per app
“New application projects surge in 2013 and beyond.”
“Social, mobile, analytics, cloud have reached the tipping point in 2013.”
2013
Surging application numbers
Number of releases per app per year
• Apps everywhere
• Accessed through multiple devices
• 30x increase in application releases
• Closed feedback loop with customers
• Focus on time-to-value and ROI
What we expect:
Composite applications
Search
Product
Pay
Payment
Buy
Customer Profiles
Ship
Shipping
Track
Track package
Each of these steps are interconnected software components, also called
services
Public Cloud
Traditional Managed CloudComposite
Business processes are actually an integration of existing components and services
EXAMPLE:
The Online Shopping Process
Delivering change continuously and fast is risky
Quality assurance
by validation throughout the Application Lifecycle will address these risks
Q
The Risks:
Change is constant• New
implementations• Support packs• Customizations
Speed impacts bottom line• Time to revenue• Cost of
implementation
Interdependenceincreases business risk• Apps are interdependent• Each change adds to
risk
Composite Application
HP Apps 12 addresses the spectrum of ALM stakeholders
HP ALM Unified, Automated, Collaborative
Manual tester
Business analyst
Quality Assurance
Developer (SAP/ORCL)
Developer (Java/.Net)
App Security tester
Performance engineer
VP of AppsScrum master
Functional test engineerHP Unified Functional Testing
HP Sprinter
HP Agile Manager
HP ALM Dashboard
HP Performance Testing
HP Fortify
70+ Developer Tool integrations
HP ALM Requirements Management
HP Quality Center
Stakeholders use their tool of choice, while sharing resources with complete traceability for a unified ALM experience
HP Sprinter for Mobile
PrivateCloudUFT In-housePublic
CloudFull device
controlSprinterWide
spectrum
Powerful testing suite
Effective and efficient manual testing of mobile apps and web
ManualHP Sprinter
Video streaming
Predefined Widgets
Test application
management
Interoperability
Session sharingSnapshot support
Device vitals
Automation
HP MobileCloud Express
PrivateCloudUFT In-housePublic
CloudFull device
controlSprinterWide
spectrum
Powerful testing suite
Entry-level on-premise solution
Manual Automation
Pre-packaged andpre-configured
Unlimited automation Synced data to ALM and QC
Unlimited real-time shared viewing of test execution, device booking management system
Full device controlPowerful replay
Knowit Quality Management AS - Raj Rajangam
About me
• Responsible for Test Automation in Knowit Quality Managment
• 12 years experience in test automation • International experience (eg: Coca-Cola, Barnes & Noble,
and others) • I have led a number of automation projects • Broad experience from a variety of tools / frameworks
Why mobile is vital
Brand awareness
Monetization
Boost experience
Increased revenue
Increased profitability
Mobile success and failure is very visible
Very poor appranking in app store
Competitors have4 star apps
Where is your app?
April 2012
What makes Mobile complex
DEVICE
Development platform
vs vs
Browsers
• Interoperability between 2/3/4G/wifi•More content offered by 3rd parties• Real-time services (voice, streaming)• Location-based services
NETWORK BACKEND
• Complex value chain•Mutiple integration points
Type
ClickDouble clickRight clickDrag
Tap & Multi tapDouble / long tap
DragSwipe
Pinch & zoom
Locate
Type
Rotate / Tilt
Snapshot
Authenticate
Communicate
Speak
How different Mobile testing is
Test Automation
What can get in the way?
Silos App StyleCross-
Platform Differences
Use cases
webstore
Cross-platform differences
Menu panel
Text colours
Images
Name position
Labels
Button images
Layout issue
Build amobile testing strategy
Is this your mobile test lab?Real devices, but how will it scale?
Select the right solution
Integrated testing suite Deployment options Real devices
PrivateCloud
Automate In-housePublicCloud
Full devicecontrolManual
Widespectrum
Help you scale, comply with regulations, perform complex
testing scenarios
Help you accelerate the delivery of your mobile
applications
help you understand the real end user’s
experience
Choose the right level of tests
« Must » devices « Major » devices « Market » devices
Devices 4-8 8-20 20-40New devices ~1 per quarter ~2 per quarter ~10 per quarter
PracticesEmulators + dedicated
devicesDedicated Devices Shared Devices
Unit testing
Sanity
Regression
Interoperability
Compatibility
Development Quality Assurance Production
Build the optimal device testing matrix
HP UFT Mobile
Comprehensive market leading solution for functional test automation
HP UFT Mobile
Enables a consistent, repeatable process to:
• Automate manual test scripts
• Test a broad range of technologies
• Accelerate testing cycles
• Validate quality of frequent builds
• Reduce per unit cost of testing
HP UFT mobile
• Centralized, powerful automated testing solution for all
mobile application and web based services
• Access to a LARGE mobile devices “sandbox” for validation
and manual testing
• Browsing and validating automatically across a wide array of
mobile devices
HP UFT Mobile options
Automated Functional Testing
BOTH Private and Public Cloud
HP UFTHP UFT Mobile
Private cloud of dedicated real devices
Web, DB, and other servers
Mobile
functional test
Public cloud of shared real devices
HP UFT Mobile
Test with real devices
A graphically drivencloud service
Extends UFT… one automated test, on multiple platforms(ScriptOnce)
A mobile cloud of real devices
HP UFT Mobile
Flexible and Scalable
Multiple real devicesCloud based service
Agile and Rapid
Powerful automation enables frequent test coverage
Device agnostic scripts. Write once and use on multiple devices
Able to rapidly re-test applications after each build
Integrated with HP ALM
RequirementsTraceabilityTest PlanningDefect Management
Key strengths
Mobile platform support
• Supported Operating Systems:• Android – all versions
• iOS - all versions
• BlackBerry – up to version 10 (expected to be supported on release)
• Symbian
• Windows Mobile
• WP 7.5 – LG platform
• Meego, Limo
• Supported manufacturers:
Nokia, Samsung, Motorola, Sony, LG, Apple, HTC, RIM,
Huawei, Acer, Asus, HP, Dell, Alcatel, Sharp, Toshiba, ZTE, Panasonic
PrivateCloud
Automate In-housePublicCloud
Full devicecontrolManual
Powerful testing suite
Effective and efficient manual testing of mobile apps and web
HP UFT Extension
Integrated with HP ALM
Real mobile devices(and emulators)Perform almost any operations
Device agnostic
Develop, run and schedule one test
across multiple platform
Visual & Object analysis
ManageableFull IT control on
authentication, access permission and activities
Predictable availability
GlobalAccessible from any location(VPN mandatory with MCE)
SecuredFull tractability of actions. Device cleanups and encryption abilitiesContinuous
testingSupport fast, agile
delivery
ScalableFrom single, small project to hundreds of simultaneous users
Complex scenarioadvanced built-in functionalities such voice injection and recognition, NFC, location based
Widespectrum
Automated Testing with HP UFT Mobile
Demo
QA