Page 1
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Roger Snook, [email protected] +1.703.943.1170WorldWide DevOps for Mobile and Hybrid Cloud Enablement Lead
On completion you will be able to: Understand the mobile application development marketplace
and challenges Get an overview of a DevOps approach and learn to
accelerate these DevOps practices:– STEER: direct your application based on continuous feedback
from testers and users– DEVELOP: integrate feedback directly into your development process
and use existing services or mobile apps to finish faster – TEST: apply efficient manual testing approaches and explore test
automation where it counts– DEPLOY: leverage hybrid cloud to address your agile and enterprise
services delivery
Cloud Software
Operate Develop/ Test
Deploy
Steer
DevOps Continuous Feedback
Page 2
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud 2
(B2C)
Page 3
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Mobile continues to explode in the enterprise (B2E)
2014 2016 2018
(2014) 60% of large companies used 3 or fewer
mobile apps1
The number of custom mobile
apps will double compared to 20142
The number of enterprise mobile apps is expected
to quadruple3
More than half of b2e apps will be created by the enterprise6
85% of companies have a mobile backlog of up
to 20 app4
Mobile app development will out number PC projects 4:15
Page 4
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Systems of Engagement
Systems of Record
Cloud
Develop Test Release
Rapid deployments
Transactional systems or packaged apps
ProductionEnvironment
AppStore
IntegrationDevelop Test
Frequent deployments
Few deployments
Release
Challenge: User Experience goes beyond just a User Interface
85% expect the mobile experience to be better than using a laptop or desktop
100% of mobile teams use agile methods.
90% of Mobile apps are dependent on enterprise or cloud services and their development teams
Page 5
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Dev/Tester Ops teamVP/Dir App DevLOB/Marketing
I need to Accelerate delivery of our mobile/cloud apps
I need infrastructure to Develop new capabilities, Build/run/manage mobile apps
I need Workable dev/test environments and Real time feedback on mobile/cloud apps
I don’t haveSkills or resources to stand-up a mobile infrastructure.
Challenge: How do you balance speed with quality while making apps?
>45% of customers
>60% drop in downloads
>70% of budgets4-6 weeks
experience production
delays
when rating on an app moves from
4.7 to 4.3
Devoted to maintenance
and operations
to deliver even minor
application changes to customers
Page 6
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
IBM DevOps Point of ViewEnterprise capability for continuous software delivery that enables organizations to seize market opportunities and reduce time to customer feedback
Acceleratesoftware delivery –for faster time to value
Reduce time to customer feedback – for improved customer experience
ContinuousCustomer
Feedback & Optimization
Collaborative Development
Continuous Release and Deployment
ContinuousMonitoring
ContinuousBusiness Planning
ContinuousTestingBalance speed, cost,
quality and risk – for increased capacity to innovate
Operate Develop/ Test
Deploy
Steer
DevOps Continuous Feedback
Page 7
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Successful Projects require these three elements:
• Process – the success “recipe”• Agile• DevOps
• People (Right skills: developers, testers, operational experience, LOB/Marketing)
• Tools – to accelerate the process with…
Operate Develop/ Test
Deploy
Steer
DevOps Continuous Feedback
Page 8
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Tools: IBM Delivers Value/ROI in these two areas:
Buy Ready-Made* Software Components, Apps, Services, Runtimes
*Ready-Made = Time to design, develop, AND Test
Automate (manual) Processes
Operate Develop/ Test
Deploy
Steer
DevOps Continuous Feedback
Page 9
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
15 minutes PER BUG REPORT:
savings adds up quickly!
(ALL software has bugs – since 1947)Bug, Feedback Reporting has come a long way!
Page 10
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud 10
IBM Mobile Quality Assurance for BluemixIBM MobileFirst Platform Quality Assurance Focus: In-app bug and feedback reporting
Page 11
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Quickly report data-rich bugs saving you 10-15 minutes of data entry, then transition those into your Sprints
Report the bug from the app experience Bugs/Crashes appears in your work queue
Page 12
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Voice of the Customer: Tangerine Bank’s value with MQA
YouTube Video
Page 13
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Collect/Assess your feedback before it goes public or simply continuously offer feedback to Steer your apps
Capture feedback in the app experience Assess Feedback
Page 14
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
No matter how much you test your mobile app, your users will have an opinion
To Steer: you need to know!
Page 15
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Discover what’s trending with top review clusters
Page 16
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Compare your app against your competitors
Page 17
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud 17
IBM Mobile Quality Assurance for BluemixIBM MobileFirst Platform Quality Assurance Focus: User Sentiment Analysis
Page 18
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
MQA: On-Premise or SaaS: The choice is yours
IBM MobileFirst Platform
IBM Bluemix
Mobile Quality Assurance
SaaS
On-PremiseQualityAssurance
Page 19
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
IBM DevOps for Mobile offerings Continuously Deliver High Quality Mobile Apps, Rapidly Respond to Feedback
MobileFirst Platform, Bluemix– Other on-premise IDEs (RAD/RSA/RDz/RDPower), HATS
DevOps Services/Bluemix (or on premise RTC, CLM)– Agile process support for mobile teams, task tracking
Rational Quality Manager– Collaborate on Test Plans, Cases, Execution
Rational Test Workbench– Mobile app UI testing, Performance Testing
Rational Test Virtualization Server– Virtualize backend systems for mobile apps
“MQA” MobileFirst Quality Assurance
UrbanCode Deploy - Automate mobile app deployments
Collaborative Development
Continuous Release and Deployment
Continuous Testing
Operate Develop/ Test
Deploy
Steer
DevOps Continuous Feedback
Page 20
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Sprint1: Hello World
• Coding-focused
• Native SDK (iOS, Android), single platform focus
• Single or paired developers, no defined team collaboration
• Solo Manual testing
• Stakeholder focused UX design, Visual Design
Sprint 2: Hello DevOps
• Tactical developer productivity gains with Automated Deployment pipeline (UrbanCode)
• Code-centric testing, unit testing (Selenium et al)
• Streamlined bug reporting for manual testing “in the wild” (MQA)
• Multiplatform focus for developer productivity (MobileFirst formerly Worklight)
Sprint 3: Team Sport
• Developer to Professional Tester transition to Automated UI Testing (RTW MTE)
• Collaborative Quality Control (RQM)
• Agile planning, Team-centric work item tracking, integrated, change/design Management (DevOps Services/RTC/RSA Design Manager)
•Minimize appstore risks with Performance and Virtualization Testing (RTW)
•Engage user feedback, Application Quality Feedback and Analytics (MQA)
•Secure Services and App (AppScan)
Manual, slow, error prone, fragmented, app quality concerns
Automated, repeatable, accurate, integrated.
Sprint 5: Enterprise DevOps
•Enterprise Developer integration ((DevOps Services/RTC, Enterprise IDEs: RDz, RDPower, HATS)
•Customer Experience Management, Application Usage Analytics (TeaLeaf)
•Integrated Campaign Management (Xtify)
Enterprise-Class DevOps for Mobile Application DevelopmentExample of a DevOps Transformation from Developer-focused to Enterprise-focused
Continuous Release and DeploymentContinuous Testing
Repeatable
Practiced
Collaborative Development
Reliable
Scaled
Sprint 4: AppStore
IBM can help evolve and deliver value over time!
Look for this IBM Press book later in 2015!
Page 21
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Mobile App Challenge: Balancing Speed & QualityThere’s just never enough time to test “everything”!
Goals
Test Cases
Frequency
Methodology
Basic acceptance, build acceptance
Functional testing across all existing areas of product
Compatibility across devices
Very high value to automate!
High value to automate
Medium value to automate
# of Devices
Optimal Test Strategy
Automated Testing Automated Testing Manual or Automated Testing
Smoke Testing
RegressionTesting
Compatibility Testing
Deep testing of new areas of functionality
Low value to automate
Manual Testing
New Feature Testing
Not automated
Exploratory Testing
Exploration of functionality from customer viewpoint
Manual Testing
Page 22
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud
Optimal Test Strategy
Automated Testing
Automated Testing
Manual or Automated Testing
Manual Testing Manual Testing
Accelerating Testing Strategy with “FURPS” Tools Smoke
TestingRegression
TestingCompatibility
TestingNew Feature
TestingExploratory
Testing
Tooling Simple, Rapid Record/Playback (ongoing verification) withRational Test Workbench (Mobile Test Edition)
Report results into Rational Quality Manager
Functional regression test:Rational Test Workbench Mobile Test Edition
Performance or Virtualization testing with full Rational Test Workbench
Rational Test Workbench with Keynote Device Anywhere
Streamline bug reporting – in-app bug reporting with:Mobile Quality Assurance (MQA)
Manage overall test plans withRational Quality Manager
Streamline bug reporting – in-app bug reporting OR in-app user feedback OR support A/B testing or “dark launch” testing with over-the-air distribution of:
Mobile Quality Assurance (MQA)
Page 23
© 2015 International Business Machines Corporation
DevOps Steer: An Agile Response to Customer Feedback
http://Ibm.biz/mobilequalitycloud