1/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Jan ClaesTeaching assistant : PhD 2009 – 2015
Supervisors UGent : Geert Poels & Frederik GaillySupervisors TU/e : Paul Grefen & Irene Vanderfeesten
Investigating the process of process modeling and its relation to model quality
2/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Comprehensive overview PhD
3/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
4/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
P1
Chapter 1• BPM conference paper P1• Explorative research• Hypothesis building• Observational modeling sessions• Structured process modeling relates to
model quality• Correlation, t-test, linear regression
5/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
Chapter 2• BPM workshop paper P1• ISEB journal paper A1• PPMChart visualization• Observational modeling sessions• Visualization theories
DESIGN SCIENCE
Process visualization
P1 A1
6/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
Chapter 3• CAiSE workshop paper P1• ISF journal paper A1• Explanatory theory development• Structured Process Modeling Theory (SPMT)• Cognitive theories• Observational modeling sessions• Correlation, t-test, PLS-SEM, EGA
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
P1 A1
7/29www.janclaes.info
DESIGN SCIENCEProcess model quality
improving modeling method
Overview
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
DESIGN SCIENCETool support
A1Chapter 4• Main contribution• Prescriptive theory, modeling method• Structured Process Modeling Method (SPMM)• > measure cognitive style• > determine modeling style
8/29www.janclaes.info
Overview
DESIGN SCIENCEProcess model quality
improving modeling method
BEHAVIOURAL SCIENCELink between process and cognitive
overload
DESIGN SCIENCE
Process visualization
BEHAVIOURAL SCIENCELink between process and model
characteristics
Chapter 5• Tool support• Visualizing structure of model to help
modeler during model creation• Phased modeling
DESIGN SCIENCETool support
?
9/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
How to test the developed theory (SPMT)?
10/29www.janclaes.info
Research model
A B A determines BA B The more A, the more B+ A B The more A, the less B– A B A translates into B
learning style
degree of serialization
adopted serialization style
need for structure
field-dependency
– +
intrinsic cognitive load for modeling phases
intrinsic cognitive load for aggregation phases
cognitive overload
intrinsic cognitive load for strategy building phases
+ + +
serialization style fitstructuredness of serialization
– – – –
1 2 3
process model quality overall construction effort
+–
11/29www.janclaes.info
Cognitive style
Need for structure
Learning styleField dependencySensory
Visual
Inductive
Active
Sequential
Intuitive
Auditory
Deductive
Reflective
Global
I ♥ ︎chaos I #$@&! chaos
DON’T SEE THE FOREST THROUGH THE TREES
12/29www.janclaes.info
Observational modeling sessionJools experimental platformSimple modeling notation
activity – edge – start event – end event – xor gateway – and gateway
Experimental flow Cognitive tests Pre-survey Tool tutorial Modeling sessions Post-survey Interviews
13/29www.janclaes.info
Cognitive testsFour cognitive tests
Operation Span Test Counting Span Test Reading Span Test Hidden Figures Test
Fully-automated in toolTaken at homeAvoiding cheating
Intrinsic motivation Limited cheat detection (score, time, tool focus)
14/29www.janclaes.info
Pre-survey and post-surveyCognitive style
Need for structure scale Learning style scale
Cognitive load Intrinsic, extraneous, germane cognitive load scale
Prior knowledge domain, language, modeling
Cognitive fit language, modeling language, tool
Demographics
15/29www.janclaes.info
Tool tutorial
16/29www.janclaes.info
Modeling session
17/29www.janclaes.info
InterviewsFeedback cognitive profileFeedback used modeling styleFeedback cognitive loadFeedback SPMTGeneral feedback
18/29www.janclaes.info
Modeling style
Flow oriented modeling
19/29www.janclaes.info
Modeling style
pausesnumber of big gaps
distancelines between
consecutive operations
progressnumber of operations
per 3 minutes
overlapnumber of overlapping
operations
alterationsnumber of non-green dots
20/29
FACULTY OF ECONOMICS AND BUSINESS ADMINISTRATION
www.janclaes.info
Processing empirical data: statistical madness
21/29www.janclaes.info
Modeling effectiveness and efficiencySemantic quality
Completeness & correctness (of content) Number of semantic errors
22/29www.janclaes.info
Modeling effectiveness and efficiencySyntactic quality
Correctness (of syntax) Number of syntactic cognitive errors
23/29www.janclaes.info
Modeling effectiveness and efficiencyTime
Time between start reading case and last operationEffort
Number of operations
24/29www.janclaes.info
Research model
A B A determines BA B The more A, the more B+ A B The more A, the less B– A B A translates into B
learning style
degree of serialization
adopted serialization style
need for structure
field-dependency
– +
intrinsic cognitive load for modeling phases
intrinsic cognitive load for aggregation phases
cognitive overload
intrinsic cognitive load for strategy building phases
+ + +
serialization style fitstructuredness of serialization
– – – –
1 2 3
process model quality overall construction effort
+–
25/29www.janclaes.info
CorrelationCognitive style
Mod
elin
g st
yle
Modeling resultCognitive load
26/29www.janclaes.info
T-test
Learning style Need for structure Field dependency
Load
Synt
axTi
me
Effor
t
27/29www.janclaes.info
PLS-SEM
28/29www.janclaes.info
PLS-SEM
29/29www.janclaes.info
Thanks for you attention!
> Do you have feedback on my research plans? <> Do you have questions? <
http://www.janclaes.infoTwitter: @janclaesbelgium