Top Banner
© 2015 International Business Machines Corporation DevOps Steer: An Agile Response to Customer Feedback http://Ibm.biz/mobilequality cloud Roger Snook, [email protected] +1.703.943.1170 WorldWide DevOps for Mobile and Hybrid Cloud Enablement Lead On completion you will be able to: Understand the mobile application development marketplace and challenges Get an overview of a DevOps approach and learn to accelerate these DevOps practices: STEER: direct your application based on continuous feedback from testers and users DEVELOP: integrate feedback directly into your development process and use existing services or mobile apps to finish faster TEST: apply efficient manual testing approaches and explore test automation where it counts DEPLOY: leverage hybrid cloud to address your agile and enterprise services delivery Cloud Software Operate Develop/ Test Deploy Steer DevOps Continuous Feedback
23

University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

Jul 31, 2015

Download

Technology

Roger Snook
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Roger Snook, [email protected] +1.703.943.1170WorldWide DevOps for Mobile and Hybrid Cloud Enablement Lead

On completion you will be able to: Understand the mobile application development marketplace

and challenges Get an overview of a DevOps approach and learn to

accelerate these DevOps practices:– STEER: direct your application based on continuous feedback

from testers and users– DEVELOP: integrate feedback directly into your development process

and use existing services or mobile apps to finish faster – TEST: apply efficient manual testing approaches and explore test

automation where it counts– DEPLOY: leverage hybrid cloud to address your agile and enterprise

services delivery

Cloud Software

Operate Develop/ Test

Deploy

Steer

DevOps Continuous Feedback

Page 2: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud 2

(B2C)

Page 3: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Mobile continues to explode in the enterprise (B2E)

2014 2016 2018

(2014) 60% of large companies used 3 or fewer

mobile apps1

The number of custom mobile

apps will double compared to 20142

The number of enterprise mobile apps is expected

to quadruple3

More than half of b2e apps will be created by the enterprise6

85% of companies have a mobile backlog of up

to 20 app4

Mobile app development will out number PC projects 4:15

Page 4: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Systems of Engagement

Systems of Record

Cloud

Develop Test Release

Rapid deployments

Transactional systems or packaged apps

ProductionEnvironment

AppStore

IntegrationDevelop Test

Frequent deployments

Few deployments

Release

Challenge: User Experience goes beyond just a User Interface

85% expect the mobile experience to be better than using a laptop or desktop

100% of mobile teams use agile methods.

90% of Mobile apps are dependent on enterprise or cloud services and their development teams

Page 5: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Dev/Tester Ops teamVP/Dir App DevLOB/Marketing

I need to Accelerate delivery of our mobile/cloud apps

I need infrastructure to Develop new capabilities, Build/run/manage mobile apps

I need Workable dev/test environments and Real time feedback on mobile/cloud apps

I don’t haveSkills or resources to stand-up a mobile infrastructure.

Challenge: How do you balance speed with quality while making apps?

>45% of customers

>60% drop in downloads

>70% of budgets4-6 weeks

experience production

delays

when rating on an app moves from

4.7 to 4.3

Devoted to maintenance

and operations

to deliver even minor

application changes to customers

Page 6: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

IBM DevOps Point of ViewEnterprise capability for continuous software delivery that enables organizations to seize market opportunities and reduce time to customer feedback

Acceleratesoftware delivery –for faster time to value

Reduce time to customer feedback – for improved customer experience

ContinuousCustomer

Feedback & Optimization

Collaborative Development

Continuous Release and Deployment

ContinuousMonitoring

ContinuousBusiness Planning

ContinuousTestingBalance speed, cost,

quality and risk – for increased capacity to innovate

Operate Develop/ Test

Deploy

Steer

DevOps Continuous Feedback

Page 7: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Successful Projects require these three elements:

• Process – the success “recipe”• Agile• DevOps

• People (Right skills: developers, testers, operational experience, LOB/Marketing)

• Tools – to accelerate the process with…

Operate Develop/ Test

Deploy

Steer

DevOps Continuous Feedback

Page 8: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Tools: IBM Delivers Value/ROI in these two areas:

Buy Ready-Made* Software Components, Apps, Services, Runtimes

*Ready-Made = Time to design, develop, AND Test

Automate (manual) Processes

Operate Develop/ Test

Deploy

Steer

DevOps Continuous Feedback

Page 9: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

15 minutes PER BUG REPORT:

savings adds up quickly!

(ALL software has bugs – since 1947)Bug, Feedback Reporting has come a long way!

Page 10: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud 10

IBM Mobile Quality Assurance for BluemixIBM MobileFirst Platform Quality Assurance Focus: In-app bug and feedback reporting

Page 11: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Quickly report data-rich bugs saving you 10-15 minutes of data entry, then transition those into your Sprints

Report the bug from the app experience Bugs/Crashes appears in your work queue

Page 12: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Voice of the Customer: Tangerine Bank’s value with MQA

YouTube Video

Page 13: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Collect/Assess your feedback before it goes public or simply continuously offer feedback to Steer your apps

Capture feedback in the app experience Assess Feedback

Page 14: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

No matter how much you test your mobile app, your users will have an opinion

To Steer: you need to know!

Page 15: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Discover what’s trending with top review clusters

Page 16: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Compare your app against your competitors

Page 17: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud 17

IBM Mobile Quality Assurance for BluemixIBM MobileFirst Platform Quality Assurance Focus: User Sentiment Analysis

Page 18: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

MQA: On-Premise or SaaS: The choice is yours

IBM MobileFirst Platform

IBM Bluemix

Mobile Quality Assurance

SaaS

On-PremiseQualityAssurance

Page 19: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

IBM DevOps for Mobile offerings Continuously Deliver High Quality Mobile Apps, Rapidly Respond to Feedback

MobileFirst Platform, Bluemix– Other on-premise IDEs (RAD/RSA/RDz/RDPower), HATS

DevOps Services/Bluemix (or on premise RTC, CLM)– Agile process support for mobile teams, task tracking

Rational Quality Manager– Collaborate on Test Plans, Cases, Execution

Rational Test Workbench– Mobile app UI testing, Performance Testing

Rational Test Virtualization Server– Virtualize backend systems for mobile apps

“MQA” MobileFirst Quality Assurance

UrbanCode Deploy - Automate mobile app deployments

Collaborative Development

Continuous Release and Deployment

Continuous Testing

Operate Develop/ Test

Deploy

Steer

DevOps Continuous Feedback

Page 20: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Sprint1: Hello World

• Coding-focused

• Native SDK (iOS, Android), single platform focus

• Single or paired developers, no defined team collaboration

• Solo Manual testing

• Stakeholder focused UX design, Visual Design

Sprint 2: Hello DevOps

• Tactical developer productivity gains with Automated Deployment pipeline (UrbanCode)

• Code-centric testing, unit testing (Selenium et al)

• Streamlined bug reporting for manual testing “in the wild” (MQA)

• Multiplatform focus for developer productivity (MobileFirst formerly Worklight)

Sprint 3: Team Sport

• Developer to Professional Tester transition to Automated UI Testing (RTW MTE)

• Collaborative Quality Control (RQM)

• Agile planning, Team-centric work item tracking, integrated, change/design Management (DevOps Services/RTC/RSA Design Manager)

•Minimize appstore risks with Performance and Virtualization Testing (RTW)

•Engage user feedback, Application Quality Feedback and Analytics (MQA)

•Secure Services and App (AppScan)

Manual, slow, error prone, fragmented, app quality concerns

Automated, repeatable, accurate, integrated.

Sprint 5: Enterprise DevOps

•Enterprise Developer integration ((DevOps Services/RTC, Enterprise IDEs: RDz, RDPower, HATS)

•Customer Experience Management, Application Usage Analytics (TeaLeaf)

•Integrated Campaign Management (Xtify)

Enterprise-Class DevOps for Mobile Application DevelopmentExample of a DevOps Transformation from Developer-focused to Enterprise-focused

Continuous Release and DeploymentContinuous Testing

Repeatable

Practiced

Collaborative Development

Reliable

Scaled

Sprint 4: AppStore

IBM can help evolve and deliver value over time!

Look for this IBM Press book later in 2015!

Page 21: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Mobile App Challenge: Balancing Speed & QualityThere’s just never enough time to test “everything”!

Goals

Test Cases

Frequency

Methodology

Basic acceptance, build acceptance

Functional testing across all existing areas of product

Compatibility across devices

Very high value to automate!

High value to automate

Medium value to automate

# of Devices

Optimal Test Strategy

Automated Testing Automated Testing Manual or Automated Testing

Smoke Testing

RegressionTesting

Compatibility Testing

Deep testing of new areas of functionality

Low value to automate

Manual Testing

New Feature Testing

Not automated

Exploratory Testing

Exploration of functionality from customer viewpoint

Manual Testing

Page 22: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud

Optimal Test Strategy

Automated Testing

Automated Testing

Manual or Automated Testing

Manual Testing Manual Testing

Accelerating Testing Strategy with “FURPS” Tools Smoke

TestingRegression

TestingCompatibility

TestingNew Feature

TestingExploratory

Testing

Tooling Simple, Rapid Record/Playback (ongoing verification) withRational Test Workbench (Mobile Test Edition)

Report results into Rational Quality Manager

Functional regression test:Rational Test Workbench Mobile Test Edition

Performance or Virtualization testing with full Rational Test Workbench

Rational Test Workbench with Keynote Device Anywhere

Streamline bug reporting – in-app bug reporting with:Mobile Quality Assurance (MQA)

Manage overall test plans withRational Quality Manager

Streamline bug reporting – in-app bug reporting OR in-app user feedback OR support A/B testing or “dark launch” testing with over-the-air distribution of:

Mobile Quality Assurance (MQA)

Page 23: University of Miami Briefing: DevOps Steer – an agile response to customer feedback with the IBM Cloud

© 2015 International Business Machines Corporation

DevOps Steer: An Agile Response to Customer Feedback

http://Ibm.biz/mobilequalitycloud