Top Banner
Approaches to Evaluating Supplemental Online Learning Programs Robin Winder, Director of Student Learning, Florida Virtual School Amy McGrath, Principal/Lead Instructor, World Languages, Florida Virtual School Joe Freidhoff, Director of Michigan Virtual Learning Research Institute, Michigan Virtual School December 2013
37

2013 Evaluation of Online Programs

May 25, 2015

Download

Education

iNACOL

This leadership webinar focused on current practices for evaluating program effectiveness, the evaluation tools in use and how state online schools analyze multiple sources of data to understand program success. Presenters will lead a discussion of important considerations around the ongoing formative data collected to inform teachers and administrators about what contributes to student success in online courses. The panelists will explore how their programs approach collection of data and what methodology they use to organize and present data for school or district leaders.
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: 2013 Evaluation of Online Programs

Approaches to Evaluating Supplemental Online Learning Programs

• Robin Winder, Director of Student Learning, Florida Virtual School• Amy McGrath, Principal/Lead Instructor, World Languages, Florida Virtual

School• Joe Freidhoff, Director of Michigan Virtual Learning Research Institute,

Michigan Virtual School

December 2013

Page 2: 2013 Evaluation of Online Programs

Webinar Focus• Evaluation of Supplemental Online

Programs– Information can apply to full time programs as

well as blended learning programs– Takes time to learn what to evaluate, how to

evaluate and how to report results– Perspectives from two well established

programs• Michigan Virtual School: Est. 2000• Florida Virtual School: Est. 1996

Page 3: 2013 Evaluation of Online Programs

Michigan Virtual Schoolwww.mivhs.org

Page 4: 2013 Evaluation of Online Programs

About Michigan Virtual School

Fast Facts• Created in 2000 by Public Act 230• Supplemental Program• Mainly High School, Some Middle School• Over 138,000 enrollments since its inception• Currently offer around 200-250 different online

courses

Page 5: 2013 Evaluation of Online Programs

Program Evaluation

• Accreditation• Perceptual Data• Reporting Results• Internal Monitoring• External Assistance

Page 6: 2013 Evaluation of Online Programs

Accreditation

Page 8: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 9: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 10: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 11: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 12: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 13: 2013 Evaluation of Online Programs

Reporting Results

Available from: http://www.mivu.org/Portals/0/LegislatureReport_2013.pdf

Page 14: 2013 Evaluation of Online Programs

Internal Monitoring

Page 15: 2013 Evaluation of Online Programs

Internal Monitoring

Page 16: 2013 Evaluation of Online Programs

Internal Monitoring

Page 17: 2013 Evaluation of Online Programs

Internal MonitoringFigure 8. School Names for Drops (Min. 5 Drops)

Page 18: 2013 Evaluation of Online Programs

Internal Monitoring

Vendor Comparison Report

Page 19: 2013 Evaluation of Online Programs

External Assistance

Available from: http://www.sri.com/sites/default/files/publications/supporting-k-12-students-online-learning-2.pdf

Page 20: 2013 Evaluation of Online Programs

Florida Virtual Schoolwww.flvs.net

Page 21: 2013 Evaluation of Online Programs

Florida Virtual SchoolPart –time, Full- time, Global School

Talk about milestones! As we completed our 15th year, we have served 819,488 total students.

Page 22: 2013 Evaluation of Online Programs

Fully Accredited• North Central Association Commission on

Accreditation and School Improvement• North West Accreditation Commission• Southern Association of College and

Schools Council on Accreditation and School Improvement

• NCAA approval of Core Courses

Page 23: 2013 Evaluation of Online Programs

The Florida Virtual School ApproachSTUDENT DRIVEN

Page 24: 2013 Evaluation of Online Programs

Depth of Knowledge

The effectiveness of my virtual program is ____

A. Highly Effective

B. Effective

C. Below Target

D. Unsure

Page 25: 2013 Evaluation of Online Programs

Formative Assessment• Learning Styles• Pre/Post Tests +• Module Exams +• Live Lessons +• Discussion Based Assessment

= Competency Based Learning

Page 26: 2013 Evaluation of Online Programs

Formative DataTracking Student Success

• Parents and Students are surveyed at intervals• Data Reports that reveal student engagement• Course Health Reports

Page 27: 2013 Evaluation of Online Programs

FLVS Quality AssuranceExamples

• Instructional Audits• Fidelity Checks• Concern & Celebration Reports• Principal Requests• Executive Leadership Requests

Page 28: 2013 Evaluation of Online Programs

Summative Assessments

• Segment Exams• End of Course Assessment• AP Results

Page 29: 2013 Evaluation of Online Programs

FLVS Leaders Influence Student Learning by Promoting Vision

• Balanced Score Card

“Inspect what we Expect”

Page 30: 2013 Evaluation of Online Programs

Algebra EOC Assessment Compared to State

Page 31: 2013 Evaluation of Online Programs

Geometry EOC Assessment Comparison to State 2012-2013

School Year

Page 32: 2013 Evaluation of Online Programs

Biology EOC Assessment Comparison to State 2012-2013 School Year

Page 33: 2013 Evaluation of Online Programs

2012 AP Results

Page 34: 2013 Evaluation of Online Programs

Reporting

• Annual Reports both externally and internally

• Board Updates Monthly• Community Relations Department

Page 35: 2013 Evaluation of Online Programs

FLVSComprehensive Organizational Confidence in

STUDENT MASTERY OUTCOMESbecause of….

• Adaptive Instruction• Competency Based Instruction

• Reflection on student engagement• Quality Assurance and Accountability

Page 36: 2013 Evaluation of Online Programs

Questions

Page 37: 2013 Evaluation of Online Programs

Contact Information

• Florida Virtual School – www.flvs.net – Robin Winder, [email protected] – Amy McGrath, [email protected]

• Michigan Virtual School - www.mivhs.org/ – Joe Freidhoff, [email protected]