An Empirical Study on End-users Productivity Using Model-based Spreadsheets Laura Beckwith J´ acome Cunha Jo˜ ao P. Fernandes Jo˜ ao Saraiva HCIResearcher, Denmark, [email protected]Universidade do Minho, Portugal, {jacome,jpaulo,jas}@di.uminho.pt Universidade do Porto, Portugal, [email protected]EuSpRIG 2011 July 14 – 15 J´ acome Cunha (UMinho) EuSpRIG 2011 1 / 19
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
An Empirical Study on End-users Productivity UsingModel-based Spreadsheets
Laura Beckwith Jacome Cunha Joao P. Fernandes Joao Saraiva
HCIResearcher, Denmark, [email protected] do Minho, Portugal, {jacome,jpaulo,jas}@di.uminho.pt
Much research has been done to prevent spreadsheet end-user errors
Model-Driven Engineering (MDE) is a promising approach
We have created a set of different model-based spreadsheets
ww�Need to evaluate their impact
Jacome Cunha (UMinho) EuSpRIG 2011 3 / 19
Introduction
Much research has been done to prevent spreadsheet end-user errors
Model-Driven Engineering (MDE) is a promising approach
We have created a set of different model-based spreadsheets
ww�Need to evaluate their impact
Jacome Cunha (UMinho) EuSpRIG 2011 3 / 19
Original Spreadsheet - original
A project management system
Tabular spreadsheet (database like spreadsheet)
Jacome Cunha (UMinho) EuSpRIG 2011 4 / 19
Functional Dependencies
A ⇀ B means that the values in column A uniquely determine valuesin column B
If two values two rows in column A are equal, then the correspondingvalues in B are also equal
For example, suppose A = {A1,A2} and B = {B1,B2}:
A1 A2 B1 B2
a1 a2 b1 b2
a1 a3 b1 b1
a1 a2 b1 b2
(a) Table inducing A ⇀ B.
A1 A2 B1 B2
a1 a2 b1 b2
a1 a3 b1 b1
a1 a2 b2 b2
(b) Table not inducing A ⇀ B.
Jacome Cunha (UMinho) EuSpRIG 2011 5 / 19
Relational Model
From the spreadsheet data (also from formulas) we can inferfunctional dependencies
From these dependencies, we can compute a relational databaseschema
A ⇀ BC D ⇀ E...
Infer FDs
Original SS
RDB Schema
Infer RDB Schema
Reasoning about FDs
Jacome Cunha (UMinho) EuSpRIG 2011 6 / 19
Refactored Spreadsheet - refactored
We use the relational model to generate a new refactored spreadsheet(respecting the relational model)Each entity separated in a different tableCombo boxes used to list allowed values (from other tables)
Jacome Cunha (UMinho) EuSpRIG 2011 7 / 19
Visual Spreadsheet - visual
From functional dependencies we can generate edit assistanceA ⇀ B: A columns become green combo boxes and B redSimilar to originalCombo boxes help user introducing data
Jacome Cunha (UMinho) EuSpRIG 2011 8 / 19
The Entire Picture
A ⇀ BC D ⇀ E...
Infer FDs
Original SS
RDB Schema
Infer RDB Schema
Reasoning about FDs
Generate Refactored SS
Refactored SS
Generate Visual SS
Visual SS
Goal: compare efficiency and effectiveness of original, refactored and visual
Jacome Cunha (UMinho) EuSpRIG 2011 9 / 19
Research Questions
RQ1 Do end users introduce fewer errors when they use one of themodel-based spreadsheets versus the original unmodified one?
RQ2 Are end users more efficient using the model-based spreadsheets?
RQ3 Do particular models lead to fewer errors in particular tasks?
Jacome Cunha (UMinho) EuSpRIG 2011 10 / 19
Study Design
Background questionnaire, followed by a list of tasks and a postquestionnaire
No initial tutorial was given to the participants
38 participants: 25 females and 11 males, all students
Tasks for inserting and editing data and computing statistics
3 different spreadsheet applications (projects, dishes andproperties)
3 different models (original, refactored, visual)
Each participant received 3 spreadsheets, each of a differentapplication/model