Using Project Outcome to Measure & Build a Better Summer ...

Using Project Outcome to

Measure & Build a Better

Summer Library Program

April 27, 2017

What we will cover today

• Project Outcome & Summer Learning

oAdministering Project Outcome Surveys

oUsing Project Outcome Data

• From the Field

oPikes Peak Library District

oGeorgia Public Library Service

• Questions & Discussion

Today’s Speakers

Crystal SchimpfProject Outcome

Joanna Nelson RendónPikes Peak Library District

Colorado Springs, Colorado

Elaine BlackGeorgia Public Library Service

Atlanta, Georgia

About Project Outcome

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Webinar Archives

How to Successfully Roll Out Project Outcome in Your Library

Surveys for 7 Service Areas

Dummy Data

2015-2016 Totals

▪ 104 Libraries

▪ 16,800+ total responses

96% strongly agree or agreed that they

read more oftenas a result of the summer reading program

Summer Reading Surveys

If yes – click “Raise Hand” icon

Poll:

Did your library administer

Project Outcome surveys

for Summer Reading in

2015 or 2016?

Changes to Survey Management Tool

New site launches:

May 1

Old Survey Portal

closes:

April 30

Joanna Nelson Rendón

Adult Services Manager – East Library

Pikes Peak Library District

• Serve a population of 616,000

• 14 locations and bookmobile

• 477 employees

Pike Peak Library District

Our goal: Summer Reading Refresh

• Summer Reading participation was stagnant

• Intrinsic motivation

• Can Project Outcome guide our refresh?

Chocolate Olympics at High Prairie Library.

Summer Reading Participation: 2016

Teens: 4,843 registered | 2,017 completed

Children: 18,885 registered | 8,605 completed

After hours

Clue at the

Library!

Getting to know Project Outcome

• District-wide committee to

talk about and utilize

Project Outcome.

• First test with one of our

Adult Education programs.

Timeline

April 2016 Committee meetings about

Project Outcome

May 2016 Administer survey for Adult

Education - GED

July 2016 Children’s and teen services print

and distribute survey

August 2016 Analyze results

Fall/Winter 2016 Start planning for 2017

Implementing the Survey: Training Staff

• Children’s Services, Teen Services, IT,

Marketing

• Across 14 locations – point people

Implementation: Online Surveys

• Survey available online and on paper

• July 2016 we had the survey available

• Participants were emailed a link to the survey

A fantastic game of Quidditch!

Implementation: Paper Surveys

• Paper surveys available for parents/children/teens

Tip: have the parent and children/teen surveys on

different colors of paper!

• Prizes!

Dragon Eggs program!

Collecting Survey Data

• Project Outcome form is easy

• Paper surveys

▪ Tip: mark the survey when done entering

• Get contact info prize drawing

Analyzing the Data

• So much data with 2906 responses!

Results from the

children and teen

surveys.

Lessons Learned

• Paper surveys

▪ Use different colors!

▪ When entering, check each one as completed

• Location specific questions

• Surveys

Administering Surveys:

Summer Reading

Four Key Outcomes

Knowledge

Confidence

Skill/Application

Awareness

Survey Questions: Caregivers

• My child maintained or increased their reading skills

• My child is a more confident reader

• My child reads more often

• My child uses the library more often

• What did your child like most about the program/service?

• What could the library do to help your child continue to

learn more?

Summer Reading Surveys

Caregivers Children/Teens Adults

Summer Reading Survey Questions Updated in 2016

Immediate Survey Guidelines

• Patron-Reported

Learning

• Immediate Impact

• End of Program

Administering Immediate Surveys

• Give paper surveys out at end of program

• Email/text link to online survey at end of program

• Give clear instructions, including Likert scale order

• Have a drop-box for completed paper surveys

• Have a volunteer on hand to help

Administering Summer Reading Surveys

• Track attendance based on actual participation

• Survey overall summer program participation,

not individual events

• Use the appropriate survey for the age group

Creating Summer Reading Surveys

• Survey Topic & Age Group

• Program Info: Name, Dates, & Locations

• Survey Customization

• Access Paper Surveys

• Get Links to Online Surveys

Create New Survey

Dummy Data

1

2

3

Summer Reading Surveys

Caregivers Children/Teens Adults

Administering the Surveys

• Each survey must be given in its entirety

• Survey questions cannot be edited

https://pixabay.com/en/pencil-pencils-eraser-1277094/

Integrating Additional Questions

• Limit 3 per survey

• Common multi-choice questions available in tool

• Add your own open-ended question

• May increase survey fatigue

• May remove anonymity of surveys

What questions do you have for Joanna?

What questions do you have about

Summer Reading survey administration?

Please share your questions in chat

Elaine Black

Director for Youth Services

Georgia Public Library Service

First Year Project Outcome Pilot

Implemented with 6 Georgia Public Libraries

• Why

• Set-up

• Library buy-in

• State expectations

Results from pilot--takeaways and redux

• Better, more consistent communication for

State Library

• Limited participation in surveys

• Uneven implementation

• Results helpful for LSTA year-end reports

State Level Reports: Georgia

State Level Reports: Georgia

Plans for 2017

• May Work Day

• Consistent messaging

• Regular check-ins

• Goals for survey participants

Using Project Outcome Data:

Summer Reading

Dummy Data

Using Survey Results

General Advocacy

Justify Funding Requests

Programming Decisions

Community-Based

Partnerships

What is your goal?

Programming Decisions: Tips

1. Review open-ended feedback for suggestions

2. Ask for programming staff input

3. Identify areas for improvement

Detail Dashboard

Raw Data: Open Ended Responses

What questions do you have for Elaine?

What questions do you have about using

Summer Reading outcome data?

Please share your questions in chat

Are you ready to use Project Outcome for

Summer Reading in 2017?

What else do you need?

Please share your questions in chat

Changes to Survey Management Tool

New site launches:

May 1

Old Survey Portal

closes:

April 30

Next Webinar

Project Outcome Update:

Website & Survey Management Improvements

Thursday, May 11, 2017

1-2 pm Central

Registration is open now!

Consultant Webinar

Project Outcome for Library Consultants ($)

Thursday, May 18, 2017

1-2 pm Central

Registration is open now!

Free Project Outcome Training Resources

• Getting Started

• Surveys

• Data Collection

• Data Analysis

• Taking Action

• From the Field

Community of Practice

www.projectoutcome.org

If you haven’t already…

• Sign up on the Project Outcome website

• Browse free training resources

• Continue the conversation on Community of Practice

• Create your Summer Reading Survey (after May 1)

www.projectoutcome.org

Thank you!