Top Banner
2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved. Code Coverage as a Process Aruna Prabakar Consulting Software QA Engineer EMC [email protected]
15

Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

Jul 15, 2020

Download

Documents

dariahiddleston
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Code Coverage as a Process

Aruna Prabakar Consulting Software QA Engineer EMC [email protected]

Page 2: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Investigate tool

Code Coverage life cycle

Measuring Code Coverage success

Q&A

Page 3: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Investigate Code Coverage tools

GCOV

Emma

Coverity

BullsEye

NoUnit

INsECT

Cobertura

etc

Page 4: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Code Coverage project life cycle

Page 5: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Installable/upgradable builds

Ease of use

Make sure the whole product is included for Baseline

Can be centralized

Useful for future reports

Page 6: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Run tests

Unit Tests

System tests

Integration tests

Duplicate effort

Focus on Automation effort

Page 7: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Automated Report Generation

Ease of use

Needs to be automated

Component level coverage

Overall coverage

Page 8: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Web Server

Report link

Create Database

Database Backup

Project web server

Page 9: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Code coverage Infrastructure Example

Webserver

Product

Generate the coverage

Transfer files over to a system

Email link of

the coverage to individual/Tea

m

Run automated/manua

l tests. Code coverage files get

created.

Backup DataBase

Page 10: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Loop Back

Verification

Automation decision

Customer found defects

New feature verification

Page 11: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Code coverage generated.. whats next?

Code coverage

report generated

QA & Development

analyze the results

together

All the related files/directories are covered No Yes

Dev will investigate and checkin

the code

Rerun tests

• Add more test cases to increase coverage

• Run coverage for every release

• Run Coverage on Demand

Page 12: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Measuring Code Coverage success

Integrating into release process

Solid Baseline

Code Coverage profile is generated

Check for Code Coverage tool Compatibility before checking in the code

Code Churn

Code Coverage helps to identify code coverage for customer found defects dynamically and historically.

Page 13: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Investigate tool

•Language

Code Coverage life cycle

•Ease of use •Run tests •Report generation •Web/Database server •Loopback loop

Measuring Code Coverage success

•Getting into the whole process

Page 14: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

Q & A

Page 15: Code Coverage as a Process...Measuring Code Coverage success Integrating into release process Solid Baseline Code Coverage profile is generated Check for Code Coverage tool Compatibility

2013 Storage Developer Conference. © EMC Corporation. All Rights Reserved.

THANK YOU