Top Banner
October 2017 Keys to Continuous Testing Eran Bachar and Ayal Cohen
30

Keys to continuous testing for faster delivery euro star webinar

Jan 21, 2018

Download

Software

TEST Huddle
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Keys to continuous testing for faster delivery euro star webinar

October 2017

Keys to Continuous TestingEran Bachar and Ayal Cohen

Page 2: Keys to continuous testing for faster delivery euro star webinar

calls for building, testing and releasing quality software at the pace and frequency of business needs

Demand for faster delivery of innovation

Page 3: Keys to continuous testing for faster delivery euro star webinar

DevOps

Back to the basics

Always know what the customer wants

Continuously deliver high quality, secure applications

Work together as a team

Drive out waste in the system

Keep assessing and improving the customer experience

Page 4: Keys to continuous testing for faster delivery euro star webinar

Evangelized by the startups……but a challenging proposition for large enterprises.

DevOps

Page 5: Keys to continuous testing for faster delivery euro star webinar

qualitycompliance

manual processes

open source proliferation

security

cloud

monolithic architectures

costpressures

deliver faster

software complexitymicro services

containerslong cycles

lack of insight

deliveryoutsourcing

agile

testing

tools

governance

enterprise

data

portfolio management

configuration

operationsdev

release

code

deployments

integrations

latency

user experience

test lack of automationworkflows

scaling

culture

is challenging

Page 6: Keys to continuous testing for faster delivery euro star webinar

Our Micro Focus point of view

Predict and manage Software Complexity

An explosion in composite and service-oriented architecture adoption, and software surface areas from web to

mobile to things,

Thrive with Agile and DevOps transformation

Shrinking window of monetization drive business and IT to collaborate and release faster This accelerates

adoption of Agile & DevOps practices.

Optimize Hybrid DeliverySoftware dev is shifting from primarily custom code creation to cloud service

compositions and consumption preference is shifting to cloud and

utility models

“By 2020, DevOps initiatives will cause 50% of enterprises to implement continuous testing using frameworks & open-source quality tools” Gartner Dec. FY’16

Page 7: Keys to continuous testing for faster delivery euro star webinar

You

Application changes

Time

CostQuality

Choose two

Page 8: Keys to continuous testing for faster delivery euro star webinar

Faster Delivery at a reduced cost…

means less focus on quality and low test coverage in each release.

Page 9: Keys to continuous testing for faster delivery euro star webinar

Reduced cost and increased quality/ coverage…

takes much more time to deliver.

Page 10: Keys to continuous testing for faster delivery euro star webinar

High quality and fast delivery…

tends to be expensive.

Page 11: Keys to continuous testing for faster delivery euro star webinar

The solution?

Reduce the scope of application changes

Automate testing and execution from the CI

Remove dependencies –internal and external

Page 12: Keys to continuous testing for faster delivery euro star webinar

So what do I automate?

Page 13: Keys to continuous testing for faster delivery euro star webinar

UI

API

UnitNumber of tests

CostCoverageExecution Time

Page 14: Keys to continuous testing for faster delivery euro star webinar

Unit

API

UI

Release 1 Release 2 Release 3

Unit

API

Unit

Page 15: Keys to continuous testing for faster delivery euro star webinar

Release 1 Release 2 Release 3

UI

API

Unit

UI

API

Unit

UI

API

Unit !

Page 16: Keys to continuous testing for faster delivery euro star webinar

Change in• Executable code• Configuration• Infra / environment• Data• Monitoring

Everything codified and

version controlledAutomated tests

(lots)Manual tests (few)Embedded

security scansAutomated

deploymentsAutonomous Operations

Feedback loops

Continuous Delivery pipeline

UFT Pro

StormRunnerLoad

CodarChatOps

AppPulseSiteScope

Page 17: Keys to continuous testing for faster delivery euro star webinar

Build to QA 2-4 weeks

Automation for specific areas

Major release 18-24 months

Capacity - 8 products

Build to QA – Hourly/Daily

Fully Automated CD Pipeline

SaaS release 4-8 weeksQuarterly On-prem release

Capacity – 15+ products

Multi billion dollar business unit in a Fortune 10 company

Page 18: Keys to continuous testing for faster delivery euro star webinar

18

www.advantageonlineshopping.com

Page 19: Keys to continuous testing for faster delivery euro star webinar
Page 20: Keys to continuous testing for faster delivery euro star webinar
Page 21: Keys to continuous testing for faster delivery euro star webinar

True DevOps process

Dev Git Jenkins Maven ProductionTestsIntegrated env.

CodarNexus

Repository RepositoryBuild Orchestrator Build tool Deployment

Orchestrator Server HPESW tools Server

Commit

Git plugin(listen, wait for changes) Code change available

OK

Create war(s)

Store war(s)

OK

Last war(s)Retrieve last war(s)

Post new war(s) in Staging

Perform tests

Test new war (UFT via ALM, LeanFT, SRS, NV, SV)

Tests passed/failed indication

Mark last build status pass/fail

Deploy to production (nightly)

Retrieve last successful build

Deploy to ProductionOK

Use Production data for more accurate tests (PAL/NV)

Page 22: Keys to continuous testing for faster delivery euro star webinar

True DevOps process – Micro Focus tools

JenkinsProduction

Server

CloudMicro Focus SaaS

ALI DevBridge

ALM

UFT

Mobile Center

BPT

StormRunnerLoad

AppPulse Trace

AppPulse Mobile

Network Virtualization

Staging Environment

GIT/IDE

LeanFT

Service Virtualization

Use Production data for more accurate tests

ALM Octane

StormRunner Functional

Page 23: Keys to continuous testing for faster delivery euro star webinar

True DevOps process

Page 24: Keys to continuous testing for faster delivery euro star webinar

True DevOps process

Page 25: Keys to continuous testing for faster delivery euro star webinar

True DevOps process

Page 26: Keys to continuous testing for faster delivery euro star webinar

True DevOps process

Page 27: Keys to continuous testing for faster delivery euro star webinar

Quality

Page 28: Keys to continuous testing for faster delivery euro star webinar
Page 29: Keys to continuous testing for faster delivery euro star webinar
Page 30: Keys to continuous testing for faster delivery euro star webinar

Thank youwww.microfocus.com/ADM

Ayal [email protected]@microfocus.com

Eran [email protected]@microfocus.com