Impact of Maine Learning Technology Initiative May 2006 ...

The Impact of the Maine Learning Technology Initiative

on Teachers, Students, and LearningMaine’s Middle School 1-to-1 Laptop Program

Dr. David L. SilvernailDirector

Center for Education Policy, Applied Research & EvaluationUniversity of Southern Maine

Gorham, Maine, United StatesMay 2006

2

The Maine Learning Technology Initiative (MLTI) has provided all 7th and 8th

grade students and their teachers with laptop computers, and provided schools and teachers technical assistance and professional development for integrating laptop technology into their curriculum and instruction.

3

Research and Evaluation Strategies: Mixed Methods Approach

1. Longitudinal survey studies with teachers, students, and principals.

2. Interviews with stratified samples of school personnel.

3. Selected site visits and observations.

4. Analysis of documents.

5. Controlled experimental study in a statewide sample of mathematics classrooms.

4

Primary Data Sources

1. Surveys: Teachers (n = 4,980)Students (n = 42,575)Principals (n = 500)Superintendents (n = 117)

2. Interviews: (n = 635)3. Site Visits: (n = 54)4. Classroom Observations: (n = 60)5. Document Analysis

5

Core Research and Evaluation Questions

How are the laptops being used by teachers and students?

What are the impacts of the laptops on instruction and learning?

6


7


Teachers are using the laptops to:

57.6%

63.7%

57.6%

63.7%

48.6%

26.9%

56.6%

74.0%

54.2%

Conduct research for lesson plans

Develop instructional materials

Using presentation software

Providing classroom instruction

Produce homework assignments

Assess student work

Manage student information

Communicate with colleagues

Communicate with parents

Creating & Providing

Instruction

Assessment & Monitoring

Communication

8

Students use the laptops to:

Use in Learning Context*

44.2%

18.2%

42.4%

41.4%

78.9%

Use laptop to write firstdrafts and edit papers

Use laptop to work withspreadsheet/databases

Use laptop to take notes

Use laptop to organizeinformation

Use laptop to research infoon Internet or World Book

* Frequency: Range = at least once a week to several times daily.

9

Students use the laptops to:Use in Learning 21st Centure Skills*

60.5%

41.2%

37.5%

51.2%

58.3%

39.8%

35.9%

35.7%

33.9%

Gather data from multiple sources tosolve problem.

Gather data about real-life problem.

Learn by using laptop to interact withworld outside school.

Evaluate info obtained on the internet.

Learn things from more than one subjectat once.

Critically analyze data or graphs from themedia.

Solve complex problems by analyzing andevaluating info.

Explain problem-solving process orthinking.

Visually represent or investigateconcepts.

Gathering Information

Analyzing Information

* Frequency: Range = at least once a week to several times daily.

10

What are the impacts of the laptops on instruction and learning?

11

What are the impacts of the laptops on instruction & learning?

Teacher Responses

0%

20%

40%

60%

80%

100%

I canindividualizecurriculum to

fit studentneeds with

laptop

Having alaptop hashelped me

access moreup-to-date

info

I can betteraccess diverse

teachingmaterials and

resources

I can covermore materialin class when

we uselaptops

I can exploretopics in

greater depthwith mystudents

Use of laptopshelps me

creatematerials

which bettermeet statelearning

standardsSomewhat Agree Agree Strongly Agree

12


Teacher Responses: Impact on Facilitating Learning

0%

20%

40%

60%

80%

100%

Students more activelyinvolved with learning

when use laptops.

Students do more workwhen using laptops.

Students more apt torevise/edit work when

done on laptops.

Laptops allow mystudents to get workdone more quickly.

My students are moreorganized when we use

laptops.

Laptops make it easierfor students to gather

information fromdifferent sources.

Somewhat Agree Agree Strongly Agree

13


Teacher Responses: Impact on Student Learning

0%

20%

40%

60%

80%

100%

The quality of mystudents' work

increases when we usethe laptops.

My students are betterable to understand

when we use laptops.

My students are moreengaged when we use

laptops.

Laptops havefacilitated students'ability to integrateinformation frommultiple sources.

Students learning tocritically assess qualityof info they obtained

from Internet.

Students are able toexpress ideas more

effectively when usinglaptops.

Students better ableto study real-lifeissues/problems

using laptops thanwithout them.


14


Student Responses: Impact on Work and Learning

0%

20%

40%

60%

80%

100%

I am more likely to edit mywork when it is done on the

laptop.

I get my work done morequickly now that I have my

laptop.

I do more work when I usemy laptop.

I am better able tounderstand my school work

when we use laptops.

The quality of my work hasimproved since I received

my laptop.

I am more interested inschool when we use the

laptops.


15


Student Responses: Students Capable of doing these 21st Century Skills Effectively:

96%

71%

73%

64%

70%

65%

96.2%

0% 20% 40% 60% 80% 100%

Use Word Processor

Use Spreadsheet to calculate

Use Spreadsheet to creategraphs

Use Database to sortinfo/create reports

Use Online discussions togather info

Use Multimedia software

Use Search engines

16

Teachers: Improvements in students’ engagement and learning in the following areas:

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

ClassParticipation

Interactionwith Teacher

Interactionwith Students

Motivation Engagement WorkIndependently

Multi-tasking

Traditional At-Risk High-Achieving Special Education


17


Teacher Responses: Overall Impact on Learning & Skill Development

0.0%

20.0%

40.0%

60.0%

80.0%

100.0%

Data indicate thattechnology is positively

affecting studentengagement

Data indicatetechnology is positively

affecting studenttechnology literacy

Data indicate a positiveeffect on 21st Century

skills

Data indicatetechnology is positively

affecting studentachievement

18

What do principal’s report as the impacts of the laptops on learning?

0% 20% 40% 60% 80% 100%

Achievement of StateLearning Standards

Achievement by at-riskstudents

Achievement by specialneeds students

Achievement by higherachieving students

Student learning

Some Improvement Significant Improvement

19

Has the laptop program improved student learning on standardized achievement tests?

Generally still unknown at this time.

Reasons:• Local autonomy in laptop implementation.• Limitation of state standardized tests.

20

Example of Achievement Results

Comparison of Online and Paper MEA Writing Samples

StatisticsWriting

Online PaperAverage 539.6* 536.6

SD 9.9 9.2n 1,816 14,870

* Statistically significant difference (p<.05); Effect Size = .326

Related Research Evidence:> In higher performing schools, students use their laptops more often

for composing, drafting, and creating final written reports.> Students using their laptops for writing have greater probability of

success in achieving proficiency on state standards.

21

Example of Achievement Results

Maine Impact Study of Technology Mathematics (MISTM) Randomized field trial using experimental research design. Approximately 240 Experimental and Comparative (control) classrooms in 45

Maine middle schools are participating in the study. A two-year technology-infused professional development intervention is provided. Standardized tests were developed and validated for measuring State of Maine

mathematics achievement standards. Year One Preliminary results:

Teachers in Experimental classrooms report they are more competent in teaching mathematics using technology.

Students in Experimental classrooms are performing significantly (p<.05) better than students in Comparative classrooms on standardized tests measuring Maine mathematics standards.

22

Two Keys to Successful ProgramResearch Evidence

Administrative SupportTeachers who report strong school administrative support:• Use laptops more in developing lessons, providing instruction, and

individualizing the curriculum.• Report greater student engagement and higher student achievement.

Professional DevelopmentTeachers who report more participation in effective professional development

activities:• Spend more time creating lessons and delivering instruction using the

technology.• Are better able to customize their lessons and instructions to meet

individual student needs.• Report higher quality student work and more, and deeper student

understanding of content.

23

Summary:

There is a growing body of evidence that Maine’s Learning Technology Initiative (middle school laptop program) is impacting teachers, students, and learning in many positive ways:

o Teachers are more effectively helping children achieve Maine’s state learning standards.

o Students are more motivated to learn, are learning more, and learning it more deeply.

o Students are acquiring 21st Century skills.

o The one-to-one laptop program is bringing about positive change in the acquisition of knowledge.

24

It is changing the nature of acquiring knowledge because it:

1. Increase access to up-to-date information.2. Increases speed and type of learning.3. Increases customizing and individualizing

student learning.4. Optimizes teachable moments.5. Levels the learning playing field.6. Transforms role of teacher from gatekeeper to

provider of gateways to learning and knowledge.

25

http://www.usm.maine.edu/cepare

http://www.mistm-maine.usInquiries may be directed to Dr. David L. Silvernail at:

Telephone: 207.780.5044Email: [email protected]

Copies of MLTI research and evaluation reports available on the following website:

Impact of Maine Learning Technology Initiative May 2006 ...

Documents