By Ozlem Albayrak CTIS 494 Quality Assurance and Reliability by Dr. Ozlem Albayrak 2007 Fall.

by Ozlem Albayrak

CTIS 494

Quality Assurance and Reliability

by

Dr. Ozlem Albayrak

2007 Fall

by Ozlem Albayrak

Introduction to CTIS494

Course Elements:

- Students

- Instructor

- Course Material

by Ozlem Albayrak

Instructor

Ozlem Albayrak– Computer Eng. Bilkent, 1992– M.B.A., Bilkent, 1994– M.S., UMCP, 1998– Phd., Ankara, 2002

Room# 212Phone: 290 5039E-mail: [email protected]

by Ozlem Albayrak

The Students

? Attendance Get to Know Why are they here? Expectations, Interests

This is an ELECTIVE course, may require more...

by Ozlem Albayrak

Office Hour

Tuesday: 14:40-15:30Thursday: 8:40-10:30

e-mail orappointment

by Ozlem Albayrak

CTIS 494 Outline (1)

Week Subject

17.09 Introduction to Software Quality Assurance

24.09 Software Inspections and Testing

01.10 Capability Maturity Model

08.10 ISO9000 and SPICE (1 hour missing)

15.10 Software Quality Metrics

22.10 Seven Basic (B7) Tools of Quality

29.10 The Seven MP Tools

05.11 MIDTERM (30%)

by Ozlem Albayrak

CTIS 494 Outline (2)

12.11 5S for Intelligent Housekeeping in Software Development

19.11 Software QFD and Voice of the Customer

26.11 Risk Assessment and Failure Modes and Effects Analysis

03.12 Quality Measures and Statistical Methods for Trustworthy Software

10.12 Verification and Validation (PROJECT REPORTs Submission 15%)

17.12 Testing and Evaluation (1 hour missing)

24.12 Integration, Extension and Maintenance for Trustworthiness (PROJECT PRESENTATIONs 20%)

31.12 Review (2 hours missing)

7.12 FINAL (35 %)

by Ozlem Albayrak

Today ...

Week Subject

17.09 Introduction to Software Quality Assurance

24.09 Software Inspections and Testing

01.10 Capability Maturity Model

08.10 ISO9000 and SPICE (1 hour missing)

15.10 Software Quality Metrics

22.10 Seven Basic (B7) Tools of Quality

29.10 The Seven MP Tools

05.11 MIDTERM (30%)

Introduction to Software Quality Assurance

by Ozlem Albayrak

Course Material

Not limited to: The main text book References All quality related high quality sources

by Ozlem Albayrak

References (1)

“Quality Assurance for Information Systems” by W. E. Perry, QED Technical Publishing Group 1991.

“Statistical Quality Design and Control” by R. E. DeVor, T. Chang, J.W. Sutherland Macmilllan, 1992.

“Software Quality Assurance Reliability and Testing” Chris Summers 1987.

by Ozlem Albayrak

References (2)

“Handbook of Software Quality Assurance”, G. G. Shulmeyer, CDP J. I. McManus 1987.

“Total Quality” J.W. Dean, Jr. J. R. Evans West 1994.

by Ozlem Albayrak

Grading

1 Midterm 30% (II. Parts: Closed and Open book)

1 project 35% (Group of 4)

1 Final 35% (Open book)

by Ozlem Albayrak

Course Goal:

Software Quality Assurance and ReliabilityThis course provides students with the

analytical and management tools necessary to solve software quality problems and implement effective quality systems.

by Ozlem Albayrak

Topics include:

voice of the customer analysis, the Six Sigma problem solving methodology, process capability analysis, measurement system analysis, design of experiments, statistical process control, failure made and effects analysis, quality function development, and reliability.

by Ozlem Albayrak

What is Quality?

by Ozlem Albayrak

Concentration on:

SOFTWARE QUALITY ASSURANCE

by Ozlem Albayrak

Requirements

Come to class prepared (search related subjects)

Involve in in-class-case studies or exercises Team work is important part of the course

by Ozlem Albayrak

Project

Details are written in the handouts

You will evaluate your clasmates studies

by Ozlem Albayrak

CTIS494 PROJECT DETAILS

35% of the total grade is from the projects (same weight as final)

The course project is a group project each of which will be developed by 4 students.

Project subjects will be announced by the instructor. Project requires groups to submit a report and deliver a in-class presentation. Reports will be submitted 2 weeks before the presentations.

by Ozlem Albayrak

Project Report specifications

Project reports will be prepared as web pages that can be accessed by all the students and the istructor.

The groups are free to design their web pages format, but the generated pages should be readable and understandable.

Navigation among the pages should be carefully organized.

The quality of the web pages will be determined by is content, format as well as its timely distribution. Late submissions will be heavily penalized.

by Ozlem Albayrak

Project Presentations

Project study will be presented in classroom. Following the presentations there will be a question-answer

session during which the instructor and the other students are allowed to ask questions.

Those students who prepare good questions will be awarded by the instructor.

Fluency of the presentation is as important as its content, thus the groups are urged to prepare their presentations in advance to deliver a high quality presentation.

Duration of the presentations will be announced by the instructor. Using time effectively is an important element.

by Ozlem Albayrak

Project Evaluation

20% of the project grade is allocated for project presentation and 15% is for the project report.

15% includes evaluation of the following items:– Content– Format and ease and fluency of navigation– Timely delivery

20% includes evaluation of the following items:– Content– Fluency of the presentation– Obedience to time limits– Answers to questions

by Ozlem Albayrak

Quality exercise

Define high quality toilette paper? Single (5 min) In groups of two (5 min) Reviews....... Hw # : form a group of four One address for the class and registration to

the group.... Do not wait for invitation register

by Ozlem Albayrak

What is quality?

by Ozlem Albayrak

Different Perspectives on Quality

Beauty is in the eye of the beholder For the same course one may say it is highly

theoretical, while others state that it is highly practical.

There are many different definitions and dimensions of Quality

by Ozlem Albayrak

Quality Dimensions

Transcendent Product based User based Manufacturing based Value based

by Ozlem Albayrak

Transcendent

Quality is something that is intiutively understood but nearly impossible to communicate, such as beauty and love.

I like it, because I just like it....!!!

by Ozlem Albayrak

Product based

Quality is found in the components and attributes of a product.

I like it, because the product has ....

by Ozlem Albayrak

User based

If the customer is satisfied, the product has good quality.

I am satisfied with this product.

by Ozlem Albayrak

Manufacturing based

If the product conforms to design specifications, it has good quality.

The product is of xxx standards.

by Ozlem Albayrak

Value based

If the product is perceived as providing good value for the price, it has good quality.

This is the best one I can buy at this price.

by Ozlem Albayrak

Garvin’s 8 quality dimensions

Durability

Features

Performance

Reliability

Conformance

Serviceability

Aesthetics

Percieved quality

by Ozlem Albayrak

Performance

Efficiency with which a product achieves its intended purpose

by Ozlem Albayrak

Features

Attributes of a product that supplement the product basic performance

by Ozlem Albayrak

Reliability

Propensity (eğilim) for a product to perform consistently over its useful design life

by Ozlem Albayrak

Conformance

Is a particular dimension of a product is within the allowable range of tolerance of the specification, the product conforms.

by Ozlem Albayrak

Durability

The degree to which a product tolerates stress or trauma without failing

by Ozlem Albayrak

Serviceability

Ease of repair for a product

by Ozlem Albayrak

Aesthetics

Subjective sensory characteristics such as taste, feel, sound, look and smell.

by Ozlem Albayrak

Perceived Quality

As the customer perceives the quality.

QUALITY

by Ozlem Albayrak

Service Quality dimensions

More difficult to define than to define product quality

Tangibles Service reliability Assurance

by Ozlem Albayrak

Differing Functional Perspectives on Quality

Engineering Operations Strategic Management Marketing Financial Human Resources

by Ozlem Albayrak

Engineering

Engineering is an applied science.– Product Design Engineering– Concurrent Engineering (simultaneous

performance)

Statistics + technical orientation

by Ozlem Albayrak

Design Life Cycle

Idea Generation

Preliminary Design

Prototype Development

Final Definition

Product Design Evaluation

Implementation

Iterations

by Ozlem Albayrak

Operations

Focus was initially on statistical process control Uses system view underlying modern quality

management thinking

by Ozlem Albayrak

Strategic Management

Refers to the planning processes Long term orientation

Goal: to achieve sustainable competititve advantage

by Ozlem Albayrak

Generic Strategic Planning Process (1)

Firm Mission and Goals

Strategic Options

Business level strategy

Corporate level strategy

Operational Subplans

External analysis Internal analysis

by Ozlem Albayrak

Generic Strategic Planning Process (2)

Operational Subplans

Conflict Politics and Change

Organizational Reward System

OrganizationalDesign

Strategic Alignment betweenStructure and Goals

by Ozlem Albayrak

Marketing

Customer satisfaction

by Ozlem Albayrak

Financial

Risk of investment vs. Potential rewards

by Ozlem Albayrak

Deming Value Chain

Improve quality

Cost decrease

Productivity Improves

Capture the market

Stay in business

Provide Jobs and more jobs

by Ozlem Albayrak

Human Resources

Employee empowerment Job analysis Total quality human resources management

by Ozlem Albayrak

The Three Spheres of Quality

Quality Management

Quality Assurance

Quality Control

by Ozlem Albayrak

Quality Control

Scientific method includes:– Analysis ( a process is broken into fundamental

pieces)– Relation (relationships between parts)– Generalization (how interrelationships apply to the

larger phenomenon of quality being studied)

Quality Control

by Ozlem Albayrak

Quality Control Activities

Monitoring process capability and stability Measuring process performance Reducing process variability Optimizing processes to nominal measures Performing acceptance sampling Developing and maintaining control charts

by Ozlem Albayrak

Quality Assurance

Activities associated with guaranteering the quality of a product or service.

Quality Assurance

by Ozlem Albayrak

Quality Assurance Activities

Failure mode and effect analysis Concurrent Engineering Experimental Design Process improvement Design team formation management Off-line experimentation Reliability/durability product testing

by Ozlem Albayrak

Quality Management

Management processes that overarch and tie toegther the control and assurance activities make up quality management.

Quality Management

by Ozlem Albayrak

Quality Management Activities

Planning for quality improvement Creating a quality organizational culture Providing leadership and support Providing training and re-training Designing a system to reinforce quality ideals Facilitating organizational communication

by Ozlem Albayrak

Other perspectives

Value Added Perspective Cultural Perspectives

by Ozlem Albayrak

Contingency Theory

There is no theory or method for operating a business that can be applied in all instances.

This provides flexibility to managers in pursuing quality.

by Ozlem Albayrak

Summary

Different perspectives on quality management Quality sphere is composed of:

– Quality Control– Quality Assurance– Quality Management

Discussion Questions

by Ozlem Albayrak

Quality Example

Define high quality toilette paper? Single (5 min) In groups of two (5 min) Reviews....... One address for the class and registration to

the group.... Do not wait for invitation register

by Ozlem Albayrak

CTIS 494

Software Quality Assuranceby

Dr. Ozlem Albayrak

2007 Fall

by Ozlem Albayrak

A Practical Approach to Software Quality

Book by

G. O’Regan

Slides by

Dr. Ozlem Albayrak

2006 Spring

by Ozlem Albayrak

Outline

Software Engineering Challenge History of Software Failures Background to Software Quality History of Quality Software Engineering Modern Software Quality Management

by Ozlem Albayrak

Software Engineering Challenge

Challenge is to deliver:High quality software on time to the customer

Focus on customer satisfaction

by Ozlem Albayrak

Software Engineering Challenge

Overestimation How to estimate cost and schedule accurately

is a big challenge Risk management is key Example: Taurus project at London Stock

Exchange was 13,200% late and costed a lot, and abondened

by Ozlem Albayrak

Software Engineering Challenge

Changing requirements In civil engineering there are also problems Software eng. Less mature than civil eng.

by Ozlem Albayrak

History of Software Failures

Y2K problem– Find and analyze all code with a Y2K impact– Plan and make necessary changes– Cost to UK is $32 billion!!!

Software quality needs to be a key driving factor

by Ozlem Albayrak

Introduction to Software Quality(2)

History of Quality– Shewart– Deming– Juran– Crosby– Other Quality Gurus

by Ozlem Albayrak

Background to Software Quality

Customers have high expectations In the market there are many high quality

companies Late delivery leads to extra cost

by Ozlem Albayrak

Background to Software Quality (2)

What is software quality– “Conformance to the requirements” Crosby– “Fitness for use” Juran

– ISO 9126 standard for information technology

by Ozlem Albayrak

ISO 9126 – Quality Characteristics

Functionality: extent to which functions are avaliable Reliability: extent to which software reliable Usability: users say easy to use

Efficiency Maintainability: easy to maintain Portability: easy to transfer do different environments

by Ozlem Albayrak

Total Quality Management

Modern approach to quality management is TQM– Customer focus– Process improvement– Development of quality culture

by Ozlem Albayrak

Software Quality Control

Extensive inspections and testing Formal reviews Aim is to identify defects White box and black box tests Unit, function, subsystem, system,

performance, integration, acceptance tests

by Ozlem Albayrak

History of Quality

Shewhart– Statistian at AT&T, 1920s– PDCA Model

Plan Do Check Act

by Ozlem Albayrak

History of Quality (2)

Deming– 1945s, Japan– 14 step programme– Consistent purpose and direction in the organization

is more important then everyone doing his best alone

by Ozlem Albayrak

History of Quality (3)

Juran– Another giant in the quality movement– Fitness for use– 10 step programme

Crosby– Has influenced CMM (Capability Maturity Model)

by Ozlem Albayrak

Other Quality Gurus

Taguchi Ishikawa Feigenbaum

by Ozlem Albayrak

Introduction to Software Quality(3)

Software Engineering– Requirements Analysis– Specification– Design

Architectural Functional Object-oriented reuse Verification of Design

– Implementation

by Ozlem Albayrak

Introduction to Software Quality(4)

– Implementation– Testing

Unit Integration Sub-system System Performance Acceptance

– Maintenance

by Ozlem Albayrak

Maintenance

1st Malcom Baldridge Quality award to Motorola Steps of Six Sigma:

– Identify product or service– Identify customer and requirements– Identify needs to satisfy customer– Define process of doing work– Eliminate waste– Ensure continious improvement by:

Measuring, analyzing and controlling improved process

by Ozlem Albayrak

Modern Software Quality Management

Software Inspections Software Testing Software Quality Assurance Problem Solving

– Fishbone diagrams - Trend Graph– Histograms - Scatter Graphs– Pareto Chart - Failure Mode Effect Analysis

by Ozlem Albayrak

Modern Software Quality Management(2)

Modeling Cost of Quality Metrics Customer Satisfation Assessments Total Quality Management

by Ozlem Albayrak

Metrics

Measurement is important part of science and engineering

Goal Question Metric by Basili

Data, Charts, Analysis, Trends, Action

by Ozlem Albayrak

Customer Satisfaction

Execute Plan

Customer Saticfaction Surveys

Customer Saticfaction Measurement

Improvement Planning

by Ozlem Albayrak

Formal Methods

Advantage:– Utilization of mathematical models are being used– Lead to more robust(gürbüz) systems

by Ozlem Albayrak

Modern Software Quality Management

Future of Software Quality Organizational Culture and Change Formal Methods Quality and the Web

by Ozlem Albayrak

Quality and the WEB

Accesss from everywhere in the world May different browsers Usability, look and feel important Performance as key concept Security Many transactions at any time Avaliability (24x365) RelaibilityJAD/RAD with spiral development suggested

by Ozlem Albayrak

End of Musical notes

by Ozlem Albayrak

Review Next class:

Search web for software quality assurance

Come to class to discuss