1st lecture on software testing given to KTU students. September 2015

Sergejus Bartoš[email protected]

Introduction to Software Testing

What is testing profession about?What is testing industry?What is the history of testing?What are the testing trends, schools, etc.?What is a career path for testers?

When is the Testers day?

http://blog.jetbrains.com/youtrack/2010/09/happy-testers-day/

What is $$$ in software testing?

Pierre Audoin Consultants has forecasted the software testing spends to hit Euro 100 billions by 2014.

IDC and Gartner forecast that the enterprise spending on independent testing services would cross the benchmark USD 30 billions (Euro 25 billions) by 2015.

Lithuanian GDP 2014 is about Euro 36 billions (www.vz.lt).

Some Expensive Software Mistakes

• Mariner Bugs Out (1962), Cost: $18.5 million Disaster: The Mariner 1 rocket with a space probe headed for Venus diverted from its flight path shortly after launch.

• World War III… Almost (1983), Cost: Nearly all of humanity Disaster: The Soviet early warning system falsely indicated the United States had launched five ballistic missiles

• Patriot Fails Soldiers (1991), Cost: 28 soldiers dead, 100 injured. Disaster: During the first Gulf War, an American Patriot Missile system in Saudi Arabia failed to intercept an incoming Iraqi Scud missile.

• Cancer Treatment to Die For (2000), Cost: Eight people dead, 20 critically injured.

http://top-100s.blogspot.com/2009/05/10-most-expensive-software-blunders.html

History of Software Testing

History of Software Testing

History – before 1970

1958 – First independent Test Team at IBM

1960s: Testing is mentioned in “Computer Programming Fundamentals” book by Jerry Weinberg as separated from debugging.

Some of the Testing methods whitepapers are published (IBM, 1967)

NATO report mentions Software Quality (1968)

History – 1970’s

Equivalence Classes, Boundaries, Error Guessing, Cause/Effect Graphing, Cyclomatic complexity, Quality metrics, structure based testing, code inspections…

History – 1980’s

Test Cases; V-Model System/Integration/Unit, Code, Branch, Input Coverage Metrics

IEEE 829

Exploratory Testing introduced by Cem Kaner(1988)

Black-box and White-box testing techniques are defined

History – 1990’s

Record-play software (Winrunner)

First Star conference (1992, Las Vegas)First EuroStar conference (1993, London)

Tmap published (1995)ISEB certification created (1998)

James Bach – Context Driven Testing (1999)

History – 2000’s

James Bach – Rapid Software Testing, Session Based Testing

ISTQB founded (2002)

IBM Rational Tester (2002), Selenium (2004)

"Schools of Software Testing“, 2003 - Bret Pettichord

uTest – crowdsourcing, 2008

Our Days

Acceptance Test Driven Development (ATDD)

Behavior Driven Testing (BDT)

Schools of Software Testing

http://www.testingeducation.org/conference/wtst_pettichord_FSofST2.pdf

Analytical School (structural testing)

Factory School (requirement traceability)

QA School (gatekeeping over testing)

Context Driven School

ISTQBBy 2015:

Over 400 000 certificates(13 000 growth per quarter)

In 100 countries

What are the Names?

TesterQATest AnalystTest Engineer

What Software Tester Does?

Breaks things?“Monkey testing”?Writes unit tests?Writes automated scripts?Finds and report errors?

What software tester does?

Software tester does not make software but makes it better.

But what is the job?

What is software testing about ?

Software testing is a process of executing a program or application with the intent of finding the software bugs. (ISTQB)

The principle objective of software testing is to give confidence in the software. (Unknown Author)

Software testing is an investigation conducted to provide stakeholders with information about the quality of the product or service under test. (Bertrand Meyer)

“Testing is improving the world one bug at a time.”

“Testing is like fishing but you get paid.”