How to implement Survey

Implementation of an International School Data collection project

Author: Fernando Rui Pinheiro CamposAgrupamento de Escolas Cardoso Lopes

Portugal

Project: ICT as an independent learning tool

Comenius Meeting

Belgium, February 2, 2009

02-02-2009 Fernando Rui Campos 2

Process to collect data

Moodle Plataform

Module QuesttionaireEach partner as its

own enviroment

AnswerQuestionnaire

Cardoso LopesFilipe Neri

Santo AntónioAraskoll

DBMS(Moodle)

ExtractingData

File ConvertionFirst check

http:

http:

SPSSimport

codebook

DBMS(SPSS)

02-02-2009 Fernando Rui Campos 3

Excel import Phase – part #1

02-02-2009 Fernando Rui Campos 4

Excel import Phase – part #2

02-02-2009 Fernando Rui Campos 5

Excel import Phase – part #3

02-02-2009 Fernando Rui Campos 6

After conversion to Excel

� First Line includes variable names fromMoodle, build during the design of thequestionnaire template.

02-02-2009 Fernando Rui Campos 7

Importing to SPSS

02-02-2009 Fernando Rui Campos 8

After a successful import

02-02-2009 Fernando Rui Campos 9

First Procedure

� By default SPSS import adjust all the variables to “Nominal”

� Adjust the variable type in “measure” according to:

� Continnuos variables like : Ages need to be convert to scale .

� Likert scale questions 1-5 : Studends leves questions needto convert to ordinal.

�

example

02-02-2009 Fernando Rui Campos 10

Internal Data validation

� First step

� Basic validation

02-02-2009 Fernando Rui Campos 11

Validation Rules

02-02-2009 Fernando Rui Campos 12

Validation Example with only a few samples and analyzing data

� SPSS statistics viewer

02-02-2009 Fernando Rui Campos 13

Detect anomaly in Data

02-02-2009 Fernando Rui Campos 14

Detect missing values

02-02-2009 Fernando Rui Campos 15

Cronbach Alpha – Example with real dataextracted from Answer to the questionnaire

Acording to Garson(2008). “The widely-accepted social science cut-off is that alpha should be.70 or higher for a set of items to be considered a scale, but some use .75 or .80 whileothers are as lenient as .60.”

02-02-2009 Fernando Rui Campos 16

Excel File with Three color, ClassExample (This as simulated data)

Level 3Level 2Level 1

Notes: Level 1 - max. 60%,Level 2 - max 80%, Level 3 -100%1201200911406AIdentification reference

Level 1 - 30FM1115

52265M1414

77377M1113

44255F1310

42170M159

53353F115

62,4278F114

44,8256F113

56270F112

32240F131

Final ClassificationLevelClassificationGenderAgeNº

6K0-100%12-01-200911h40

ClassScaleDateTime

02-02-2009 Fernando Rui Campos 17

Things to Add or change to questionnaire after pre-test

1- Add Subjects to the list, and the option Other

2- Add the reference age of the students

3- Add as option the location to found the digital resource used

4- Include explanation for the scale NS/NR or N/A (depends in the language ) actual question 17.

6- Corrected the scale question 12 , level 4 – partially agree .

7- Other minor changes.

8- Added Identification Reference (to Link the students results).

9- Need for an additional user name for each teacher

02-02-2009 Fernando Rui Campos 18

Updated Questionnaire(after pre-test)

02-02-2009 Fernando Rui Campos 19

Updated Questionnaire(after pre-test cont.)

02-02-2009 Fernando Rui Campos 20

What to do to the openquestion?

� Last question can be answered in mother tongue language (if the teacher doesn't understand) and in English (translated from an expert (an English teacher for example).

� Content analysis from the Questionnaire Open question.

02-02-2009 Fernando Rui Campos 21

Before continue

� Ethical question

� Need a document with authorizations from teachers to be public their data.

� Common document in English

02-02-2009 Fernando Rui Campos 22

Things to be done

� Organize the authorizations � Create the questionnaire after the pretest Phase

and distribute for all the partners. � Create one user for each teacher in each partner.� Create the codebook for the final version, for

students results and teacher questionnaire.� Create de digital resources for additional disciplines

that want to include the three color method or other methods.

� Choose a set of statistics tests according to the project objectives and available data.

� Many other implementation details …

02-02-2009 Fernando Rui Campos 23

References� Garson,D.G.,2008. Available on Line at http://faculty.chass.ncsu.edu/garson/PA765/standard.htm .

� Campos,F., Maio,V. (2008) . Unpublished document. Medidas em Educação uma Introdução.

� http://moodle.org/, Modules and plugins available at May 15, 2008.

� http://www.cardosolopes.net/elearning, available at May 23,2008.

� SPSS version 17, http://www.spss.com/ .

02-02-2009 Fernando Rui Campos 24

The End

Thanks for your patience

http://www.cardosolopes.net

Fernando Rui P. [email protected]

Agrupamento de Escolas Cardoso Lopes Amadora, Portugal