Software quality requirements: a systematic mapping study

+

The 20th Asia-Pacific Software Engineering Conference APSEC’13

Presented by: Sofia Ouhbi

Software Quality

RequirementsA systematic mapping

study

Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval

3 Dec 2013

2+

Software Quality RequirementsIntroduction

3 Dec 2013Software Quality Requirements: A systematic mapping study. APSEC'13

Software Quality Requirements: A systematic mapping study. APSEC'13 3

+

“Although quality is pursued in order to satisfy users, it is important to note that the quality desired by users is not universal but rather subject to constant change”

SQuBOK, JUSE

2007

Software quality could be defined as “the totality of characteristics of an entity that bear on it’s ability to satisfy stated and implied needs”

ISO/IEC 9126-1

3 Dec 2013

Software Quality Requirements: A systematic mapping study. APSEC'13

4+ISO/IEC 250nn (SQuaRE)

3 Dec 2013

2501nQuality Model

Division2500nQuality

Management Division2502nQuality

Measurement Division

2503n

Quality Requiremen

t Division

2504n

Quality Evaluation

Division


5+ISO/IEC 25030

3 Dec 2013

Stakeholder Needs

Stakeholder Requiremen

ts

System Requiremen

ts

Stakeholder Quality Needs

Stakeholder Quality

Requirements

System Quality Requirements

Software Requirement

s

Software Quality

Requirements

25010 Quality Model

2502n Quality

Measurement

Requirements Definition Process

Requirements Analysis Process


6+ISO/IEC 25030

3 Dec 2013

System requirem

entsSoftware requirem

ents

Software product requirem

ents

Other system requirements

Software development requirements

Include for example requirements for computer hardware, data, mechanical parts, and human business processes

Development organisation requirementsDevelopment process requirements

Inherent property

requirements

Functional requirementsQuality in use requirementsExternal quality requirements

Assigned property

requirements

Managerial requirements including for example requirements for price, delivery, date, product future, and product supplier

Internal quality requirements

Software quality requirements

7+

Software Quality RequirementsSystematic mapping study



8+Systematic mapping questions• Which publication sources and channels are the main targets for SQR

research? MQ1• How has the frequency of SQR research changed over time? MQ2• What are the research types of SQR studies? MQ3• What are the research approaches of SQR studies? MQ4• What are the contribution types of SQR research? MQ5• What are the RE activities that were addressed by SQR research? MQ6• What are the well-known SQ models that were used for specifying QR? MQ7• What are the artifacts that were reported in SQR literature? MQ8• What is the most reported SQR type in literature? MQ9

3 Dec 2013


9+Search strategy

(Software OR Application*) AND Quality AND (Requirement* OR Attribute* OR “No* functional” OR Need*) AND (Engineer* OR Elicitat* OR Analys*

OR Specif* OR Validat* OR Process*)

3 Dec 2013

IEEE Digital Library, ACM Digital Library, Science Direct and Google

scholar. 657 candidate studies


10+Study selection

Published papers before

1990 and after 2012

EC1 Papers

presenting a general focus on SQ

EC2 Papers

presenting a general focus on RE

EC3

Papers that focus only on system QR and do not discuss SQR

EC4 Papers

that focus only on functional requirements

EC5

3 Dec 2013

51 selected studies


11+MQ1. Publication sourceConferences,

43%RE

COMPSACCRIWG DBKDA

ECSAEMC

HICSSIACC

ICCGIICIII

ICSEICSQ

ICSSEAQSICQWESEAASEDMSEKE

STRQASwSTE

Journals, 29%REJ

IEEE Soft.JOTAE

ESWAIEEE LATIEICE TIS

ISTJSS

SQPTSE

Workshops, 20%

COMPSACWREFSQWoSQ

IWSPMSEW

SOQUA

Symposium, 4%

METRICSSSD

Other, 4%

BookPhD Thesis

3 Dec 2013


12+MQ2. Publication trend

3 Dec 2013

1990

1992

1994

1996

1998

2000

2002

2004

2006

2008

2010

2012

0123456789

Identified studies Empirical studies


13+MQ3,4. Research types and approaches

3 Dec 2013

05

1015202530

14 121 6

9

9 ReviewTheorysurveyExperimentCase study


14+MQ3,4,5,6 results summary

3 Dec 2013


15+MQ7. SQ models

3 Dec 2013

35%

2%2%

4%

58%

ISO/IEC 9126McCallBoehmOtherNo


16+MQ8,9. Artifacts and SQR types

3 Dec 2013

17+Conclusions and Implications


o Theoretical solutions need to be applied in practice and validated empirically

o There is a need for more studies:o focusing on the non-functional requirements validation,o which identify and specify SQR according to a chosen SQ

modelo Researchers should get familiarized with ISO/IEC 25010

standardo SQ in use requirements need to be more explored by SQR

researchersFuture researcho SLR on empirical SQR studies

Software Quality Requirements: A systematic mapping study. APSEC'13 18

+Thank you for your attention!Any questions?

3 Dec 2013

+

The 20th Asia-Pacific Software Engineering Conference APSEC’13

Presented by: Sofia Ouhbi

Software Quality

RequirementsA systematic mapping

study

Sofia Ouhbi, Ali Idri, José Luis Fernández Alemán, Ambrosio Toval

3 Dec 2013