Top Banner
Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, DRM, or how to do design research or how to do design research Research Clarification DESCRIPTIVE STUDY I PRESCRIPTIVE STUDY DESCRIPTIVE STUDY II
25

Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

Mar 28, 2015

Download

Documents

Emma Gray
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

Lucienne BlessingUniversité du Luxembourg

Autumn Lecture-Workshop seriesUniversity of Bath, 19 November 2009

DRM,DRM,or how to do design researchor how to do design research

Research Clarification

DESCRIPTIVE STUDY I

PRESCRIPTIVE STUDY

DESCRIPTIVE STUDY II

Page 2: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 2

Status of design researchStatus of design research

It is no simple matter to define the contents, the research approach and the community behind research in engineering design. (Cantamessa)

It is not easy to see the trends of evolution, to identify landmarks of development, to judge the scientific significance of the various approaches, and to decide on the target fields for investments. (Horvath)

Variety of approaches, methods, concepts, terms, Lack of overview of research results (of theory) Lack of use of results in practice Lack of scientific rigour

Page 3: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 3

What is design research?What is design research?

Improving design (product and process)

people

product

process

organisationtools & methodsUnderstanding

Support

micro-economy

macro-economy

Page 4: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 4

Aims of design researchAims of design research

Aims: the formulation and validation of models and theories about

the phenomenon of design, as well as the development and validation of knowledge, methods and

tools - founded on these models and theories – to improve the design process (i.e. support industry producing

successful products).

It is the methodology that makes a topic of investigation scientific.

Design research must be scientific in order for the results to have validity in some generic, practical sense. For this, design research has to develop and validate knowledge systematically. This requires a research methodology.

Page 5: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 5

Characteristics of design researchCharacteristics of design research

Not only aimed at increasing our understanding about design (design-as-is), but also at the use of this understanding to change the actual situation (design-as-should-be).

This requires two theories/models: about the existing situation (reference model) and about the desired situation (impact model)

Design research includes theory/model development and support development (to get from the existing to the desired situation)

Challenge: Designing is a complex activity: many different influencing

variables that are strongly interrelated, and both the influencing factors and links between these are dynamic.

Page 6: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 6

Results

DRM: A Design Research MethodologyDRM: A Design Research Methodology

Research Clarification

DESCRIPTIVE STUDY I

PRESCRIPTIVE STUDY

DESCRIPTIVE STUDY II

Goals

Understanding

Support

Evaluation

Empirical data & Analysis

Assumption &Experience & Synthesis

Empirical data & Analysis

Basic method Stages ResultsBasic method Stages

Literature & Experience &

Analysis

Page 7: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 7

Research Clarification stage (RC)Research Clarification stage (RC)

Role in DRM: identify goals, focus, main research problems, questions and/or

hypotheses, the relevant disciplines and areas to be reviewed and those to which to contribute (ARC diagram);

develop Initial Reference and Impact Models, i.e., models of the believed existing and desired situations;

identify preliminary Success Criteria and Measurable Success Criteria against which to evaluate the outcome of the research;

Page 8: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 8

Network of Influencing FactorsNetwork of Influencing Factors

Productreliability

Maintenancecost

Amount of profit

Market share

+

+

_

_

_

[A]

[A]

_

Companyimage

_

_

[A]

[A]

Research task: Improve reliability of products to improve product performance (increase sales)

Two types of network:- Reference Model (existing situation)- Impact Model (desired situation)

Productreliability

0 0

+_

Use of DfR-methods

[E][A]

Productreliability

0 0

+_[E][A]

Productreliability

0 0

+_

Use of DfR-methods

[E][A]

Productreliability

0 0

+_[E][A]

Page 9: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 9

Initial (partial) Impact ModelInitial (partial) Impact Model

amount of profit

market share

+

+_

[A]

[A]

_

companyimage

[A]

[A]

supportreliability

assessment

+

+

+

+

+

[A]

maintenancecost

productreliability

amount of profit

market share

+

+_

[A]

[A]

_

companyimage

[A]

[A]

supportreliability

assessment

+

+

+

+

+

[A]

maintenancecost

productreliability

Page 10: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 10

Research Clarification stage (RC)Research Clarification stage (RC)

Role in DRM: To identify goals, focus, main research problems, questions and/or

hypotheses, the relevant disciplines and areas to be reviewed and those to which to contribute (ARC diagram);

To develop Initial Reference and Impact Models, i.e., models of the believed existing and desired situations;

To identify preliminary Criteria against which to evaluate the outcome of the research;

To provide focus for DS-I stage in finding relevant influencing factors;

To provide focus for development of support that addresses those factors that are likely to have the strongest influence and realizes the desired situation;

To provide focus for Evaluation stage for evaluating effects of developed support against criteria and goals of the research.

Overall research plan + preliminary understanding (Initial Reference and Impact Models)

Page 11: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 11

Results

DRM: A Design Research MethodologyDRM: A Design Research Methodology

Research Clarification

DESCRIPTIVE STUDY I

PRESCRIPTIVE STUDY

DESCRIPTIVE STUDY II

Goals

Understanding

Support

Evaluation

Empirical data & Analysis

Assumption &Experience & Synthesis

Empirical data & Analysis

Basic method Stages ResultsBasic method Stages

Literature & Experience &

Analysis

Page 12: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 12

Descriptive Study I Stage (DS-I)Descriptive Study I Stage (DS-I)

Role in DRM to obtain better understanding of existing situation by identifying and

clarifying in more detail the factors that influence the preliminary Criteria and the way in which these factors influence the Criteria;

to complete the Reference Model including the Success Criteria and Measurable Success Criteria;

to suggest the factors (Key Factors) that might be suitable to address in the PS stage, as these are likely to lead to an improvement of the existing situation;

to provide a basis for the PS stage for the effective development of support that addresses those factors that have the strongest influence on success, and can be assessed against the Criteria;

to provide detail that can be used to evaluate the effects of the developed support in DS-II.

Reference Model, Success and Measurable Criteria, Key Factors, Initial Impact model, implications for support development

Page 13: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 13

Reference ModelReference Model

Use of DfR-methods

Success Criterion

Productreliability

Customer satisfaction

Market share

+

+

+

+[1]

Price _

_+0 [2]

Other factors

Other factors [A]

[1]

[1] +_

Quality of product

Quality of production

_

_

[1]

Maintenancecost

_

+

+

Warrantycost

+

++

[4]

[3,4]

[3]

+

Operatingcost

+

+

_

[3]

[5]

Measurable Criterion

0+

% of project time left

to improve

_

Product- specificity of DfR- methods

0_+

[E][A]

Key Factor

Page 14: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 14

Initial Impact ModelInitial Impact Model

use of DfR methods

preliminarySuccessFactor

productreliability

customersatisfaction

market share

++

++

[2]

other factors

other factors

[1]

+ _

quality of product

++

maintenancecost

_

+

_

warrantycost

_

__

_

_

_

preliminary MeasurableSuccsss Factor

++

% ofproject time left

to improve

+

preliminaryKey Factor

assessreliability

in early designstages

_

+

price

operatingcost

quality of production

use of DfR methods

preliminarySuccessFactor

productreliability

customersatisfaction

market share

++

++

[2]

other factors

other factors

[1]

+ _

quality of product

++

maintenancecost

_

+

_

warrantycost

_

__

_

_

_

preliminary MeasurableSuccsss Factor

++

% ofproject time left

to improve

+

preliminaryKey Factor

assessreliability

in early designstages

_

+

price

operatingcost

quality of production

Page 15: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 15

Prescriptive Study stage (PS)Prescriptive Study stage (PS)

Impact model, Intended Support, Actual Support, Support evaluation

Role in DRM to use understanding from DS-I (or DS-II) to determine the factors to be

addressed in PS (the Key Factors) to improve the existing situation;

to develop an Impact Model describing the desired, improved situation expected as a consequence of addressing the selected Key Factors;

to select the part of the Impact Model to address and to determine the related Success and Measurable Success Criteria;

to develop the Intended Support and to realize this to such a level of detail that an evaluation of its effects can take place against the Measurable Success Criteria;

to evaluate the Actual Support with respect to its in-built functionality, consistency, etc., – the Support Evaluation;

to develop an Outline Evaluation Plan for DS-II.

Page 16: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 16

+

automatically combine idea

building blocks

support exploration

of ideas

provide a wide range

of ideas+

OR

Concept B

Concept A

provide a wide range

of ideas

automatically combine idea

building blocks

Success Factor

customer satisfaction

+++

cost of production

MeasurableSuccessFactor

profit

++

+ _+

KeyFactor

quality of product

no. of ideas considered during

design

[A]

[2,3][3,4][5]

Alternative conceptsAlternative concepts

Page 17: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 17

Intended Support and Actual SupportIntended Support and Actual Support

Intended Support: description of the complete support as envisaged by the researcher.

Actual Support: a realisation of the Intended Support for the purpose of evaluation may cover only part of functionality may be implemented in a different way. focuses on the core contribution of the research project,

i.e., the core functionality of the Intended Support To develop the Actual Support, it is necessary to

start developing an Outline Evaluation Plan. The intended evaluation determines the comprehensiveness of the Actual Support.

Page 18: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 18

Scope of prototype/demonstrator Scope of prototype/demonstrator to prove conceptto prove concept

functionality of Intended Support

functionality ofActual Support

core contribution

Page 19: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 19

Descriptive Study II stage (DS-II)Descriptive Study II stage (DS-II)

Role in DRM To identify whether the support can be used in the situation for which it is

intended and whether it does address the factors it is supposed to addressed (Application Evaluation: applicability and usability)

To identify whether the support contributes to success, addressing usefulness, implications and side effects (Success Evaluation: usefulness)

The whole network has to be addressed to find weak spots. The Reference Model and the Impact Model are also evaluated

Application Evaluation, Success Evaluation(Impact and Reference Model evaluations)

Page 20: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 20

% of design time spent on modifications

time-to-market

number of modifications

quality of product

amount of profit

+

satisfaction of customer

_

_

++

+

_

_

[A]

[5] [A] [A]

[E]

cost of production

_[A]

Success Factor

Measurable Success Factor

quality of design

evaluation

[A]

+

+

+ +[A]

supportproblem

definition

+[A]

+

+

_ _

+

[A]

Success Evaluation

Application Evaluation

Support Evaluation

Key Factor

quality ofproblem definition

Types of evaluationTypes of evaluation

Page 21: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 21

Effects on the evaluation outcomeEffects on the evaluation outcome

Gross outcome

=Effect of support

(net outcome)+

Effect of other

processes+

Effect of evaluation research

Rossi: Evaluation: a systematic approach

Page 22: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 22

Results

DRM: A Design Research MethodologyDRM: A Design Research Methodology

Research Clarification

DESCRIPTIVE STUDY I

PRESCRIPTIVE STUDY

DESCRIPTIVE STUDY II

Goals

Understanding

Support

Evaluation

Empirical data & Analysis

Assumption &Experience & Synthesis

Empirical data & Analysis

Basic method Stages ResultsBasic method Stages

Literature & Experience &

Analysis

Page 23: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 23

Types of Design ResearchTypes of Design Research

1. Review-based

2. Review-based

3. Review-based

4. Review-based

Comprehensive

Comprehensive

Review-based

Review-based

Initial

Comprehensive

Review-based

Initial/Comprehensive

Initial

Comprehensive

5. Review-based Comprehensive Comprehensive Initial

6. Review-based

7. Review-based

Review-based

Comprehensive

Comprehensive

Comprehensive

Comprehensive

Comprehensive

DescriptiveStudy I

PrescriptiveStudy

DescriptiveStudy II

ResearchClarification

1. Review-based

2. Review-based

3. Review-based

4. Review-based

Comprehensive

Comprehensive

Review-based

Review-based

Initial

Comprehensive

Review-based

Initial/Comprehensive

Initial

Comprehensive

5. Review-based Comprehensive Comprehensive Initial

6. Review-based

7. Review-based

Review-based

Comprehensive

Comprehensive

Comprehensive

Comprehensive

Comprehensive

DescriptiveStudy I

PrescriptiveStudy

DescriptiveStudy II

ResearchClarification

Page 24: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

University of Bath, 2009 Lucienne Blessing 24

Key pointsKey points

DRM emphasises the need for formulating success as well as measurable

criteria; the importance of descriptive studies to increase our

understanding of design products and processes to inform the development of design support;

the systematic development of design support; the different types of evaluation necessary to assess the

developed support in the light of the aims the different possible types of research projects

Page 25: Lucienne Blessing Université du Luxembourg Autumn Lecture-Workshop series University of Bath, 19 November 2009 DRM, or how to do design research.

THANK YOU FOR YOUR ATTENTIONTHANK YOU FOR YOUR ATTENTION

You must learn from the mistakes of others.You can't possibly live long enough to make them all

yourself.“

Sam Levenson, teacher and comedian