Top Banner
How (Much) Do Developers Test? Moritz Beller @Inventitech Andy Zaidman, Georgios Gousios, Annibale Panichella, Igor Levaja
59
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: How (Much) Do Developers Test?

How (Much) Do Developers Test?

Moritz Beller@Inventitech

Andy Zaidman, Georgios Gousios, Annibale Panichella, Igor Levaja

Page 2: How (Much) Do Developers Test?
Page 3: How (Much) Do Developers Test?
Page 4: How (Much) Do Developers Test?
Page 5: How (Much) Do Developers Test?
Page 6: How (Much) Do Developers Test?
Page 7: How (Much) Do Developers Test?

Thou shalt not have less than 80% coverage

Page 8: How (Much) Do Developers Test?
Page 9: How (Much) Do Developers Test?
Page 10: How (Much) Do Developers Test?

Brooks, 1975

Page 11: How (Much) Do Developers Test?

50% … of Project Effort

Brooks, 1975

Page 12: How (Much) Do Developers Test?
Page 13: How (Much) Do Developers Test?
Page 14: How (Much) Do Developers Test?
Page 15: How (Much) Do Developers Test?
Page 16: How (Much) Do Developers Test?

How (Much) Do You Test?

Page 17: How (Much) Do Developers Test?
Page 18: How (Much) Do Developers Test?
Page 19: How (Much) Do Developers Test?

34

Page 20: How (Much) Do Developers Test?
Page 21: How (Much) Do Developers Test?
Page 22: How (Much) Do Developers Test?
Page 23: How (Much) Do Developers Test?

Students

Page 24: How (Much) Do Developers Test?

4.2 yr

Page 25: How (Much) Do Developers Test?

OMG!!!

Page 26: How (Much) Do Developers Test?

Histogram of Testing Time

50% of students test only 4% of their time, or less

Page 27: How (Much) Do Developers Test?
Page 28: How (Much) Do Developers Test?

Thou shalt not have less than 75% coverage

Page 29: How (Much) Do Developers Test?

Thou shalt not have less than 75% coverage

Students

Page 30: How (Much) Do Developers Test?
Page 31: How (Much) Do Developers Test?

Estimated 27%

Page 32: How (Much) Do Developers Test?

Estimated 27%

Reality 9%

Page 33: How (Much) Do Developers Test?
Page 34: How (Much) Do Developers Test?
Page 35: How (Much) Do Developers Test?

>1,000

Page 36: How (Much) Do Developers Test?

13 yr

Page 37: How (Much) Do Developers Test?
Page 38: How (Much) Do Developers Test?

Estimated 48%

Page 39: How (Much) Do Developers Test?

Estimated 48%

Reality 25%

Page 40: How (Much) Do Developers Test?

65% of test executions fail.

Page 41: How (Much) Do Developers Test?
Page 42: How (Much) Do Developers Test?

50% of test failures are fixed within 10 minutes.

Page 43: How (Much) Do Developers Test?

Image source: http://www.agilenutshell.com/test_driven_development

Page 44: How (Much) Do Developers Test?

Image source: http://www.agilenutshell.com/test_driven_development

Page 45: How (Much) Do Developers Test?

Nobody follows TDD (strictly).

Image source: http://www.agilenutshell.com/test_driven_development

Page 46: How (Much) Do Developers Test?
Page 47: How (Much) Do Developers Test?
Page 48: How (Much) Do Developers Test?
Page 49: How (Much) Do Developers Test?
Page 50: How (Much) Do Developers Test?
Page 51: How (Much) Do Developers Test?
Page 52: How (Much) Do Developers Test?
Page 53: How (Much) Do Developers Test?
Page 54: How (Much) Do Developers Test?
Page 55: How (Much) Do Developers Test?
Page 56: How (Much) Do Developers Test?

@InventitechMoritz Beller, TU Delft

How (Much) Do Developers Test?

TestRoots.org

Page 57: How (Much) Do Developers Test?

@InventitechMoritz Beller, TU Delft

How (Much) Do Developers Test?

TestRoots.org

Page 58: How (Much) Do Developers Test?

@InventitechMoritz Beller, TU Delft

How (Much) Do Developers Test?

TestRoots.org

Page 59: How (Much) Do Developers Test?

@InventitechMoritz Beller, TU Delft

How (Much) Do Developers Test?

TestRoots.org