Measuring, managing, marketing, documenting and proving your worth! Joyce Kasman Valenza.

Measuring, managing, marketing, documentingand proving your worth!

Joyce Kasman Valenza

Warning!Warning!

• This is a hybrid presentation!• Listen and think about what you want

to explore later.• Download this presentation at:• http://mciu.org/~spjvweb/treefalls.ppt

Why?Why?

• Data is important to prove your worth• To understand your impact • To reflect on your practice

Would anyone hear it?Would anyone hear it?

About piesAbout pies

LibraryPhys edTechnologyEnglishScienceSocial StudiesMathStudent Activities

They just don’t get bigger!

Who is slicing your pie?

Who is slicing your pie?

For the sake of your learners . . . For the sake of your learners . . .

•You must figure out how to get an appropriate slice

•Or bake another pie!

Perception is critical!Perception is critical!

You must:• Craft “reporting forms” that show you at your

best• Demonstrate your impact on learners and

learning • Demonstrate how you have made teachers’

jobs easier, more effective. • Demonstrate your vision for the program

Money tends to flow where success is, where the excitement it!

Does that person who slices the pie really know what you do?

Does he or she understand your contribution to the learning

community?

Does that person who slices the pie really know what you do?

Does he or she understand your contribution to the learning

community?

Quick:Quick:

Name something important you do for learners that no one

knows you do!

According to an SLJ survey:According to an SLJ survey:

• Only 37% of principals said that the teacher-librarian made them familiar with current research of library programs and student achievement.

• Only 35% of principals were made familiar with current research on reading development

• Lau, Debra. “What Does Your Boss Think About You.” SLJ Sept. 2002.

More from the SLJ survey:More from the SLJ survey:

• Only 47% believed there was a direct link between an effective media center and student achievement

• Only 26% believed that librarians taught regularly scheduled classes

• Only one third believed that librarians took a pro-active role in the school

• Half said their librarian’s primary role was “caretaker.”

Gary Hartzell’s response:Gary Hartzell’s response:

Though expressing support for the media center is the “socially preferred” response, when you dig deeper “the truth comes out. . . Principals think they should say that but they don’t back it up with a budget or appropriate staffing.”

According to SLJ:According to SLJ:

“The message is clear: librarians must make themselves more visible by better articulating their mission and the impact they have on student learning.”

Administrators value outcomes!

We all value and protect the things and people that make us more successful, make our jobs easier, and make us look good. Convincing your principal that you and your library can do those things will go a long way toward making clear that it's in his or her best interests to give you the time and tools you need to sustain a quality library media program.

Gary Hartzell, Professor, Department of Education Administration, University of Nebraska at Omaha.

Do you know. . .what keeps that person

up at night?

Supporting those who support you:Supporting those who support you:

Concerns How you can help

Put others firstPut others first

• Our projects and practices should benefit others

• Do no appear self-serving • Take part in school activities and

meetings— decisions are made by those who show up

• Make others look good

Library’s “outputs”Library’s “outputs”

"[Librarians] need to talk about how many research lessons they presented, how many books they booktalked, and detail the collaborations they've had with teachers."

Mike Eisenberg. "This Man Wants to Change Your Job." SLJ. September 2002)

One LM_NetterOne LM_Netter

• Goal?Flexible scheduling

Is that the goal?

Your outcomes (should) impact learners, the whole

school!

How are you perceived?How are you perceived?

• As an add-on or drop-and-run special?

or• As an instructional partner who

directly impacts student learning?

Is the perception. . . Is the perception. . .

That your library and its initiatives make a difference in student learning?

Do teachers and administrators say, “We need to see more of this!”?

That the library contributes to the continuous improvement of the school program?

Two weaponsTwo weapons

“You really need two psychological weapons when fighting to make your program a budget priority: a thick skin and a deep-felt mission. Without them, you’ll get eaten alive; with them, you can accomplish anything.”

Doug Johnson

It’s about mission

Your mission:Your mission:

• Guiding principles that state goals, values, and vision

• Should be achievable• Consider larger mission of the

school• Should be a mission the whole

school can endorse

Goals concentrate our

energy!

Teacher-Librarian

Principal

Planning / Advisory

Committee

Building / District Goals

National / State/ Local

Content Area Standards

Information Power / NETS

Process Standards

Library MissionGoals,

Objectives

Needs of

learners

Teacher-Librarian

Others?

Faculty goals:

Needs of

learners:

Parent goals:

Principal’s goals:

Libraries don’t exist in vacuums. It’s about others!

Setting goalsSetting goals

• Building• Instructional• District• Professionaland. . .• Teaching and learning• Program Administrative• Information access and deliveryMid-year and end-year updates

SMART Guidelines for Goal Setting

SMART Guidelines for Goal Setting

• Specific: What exactly do you wish to accomplish?

• Measurable: benchmarks? How will you know you have reached them?

• Attainable /Action Oriented: what specific steps will you take?

• Realistic• Timely: Set target date(s)

Examples?

* Michael Angier

Let’s create a SMART goal.Let’s create a SMART goal.

Making Instruction Explicit!Making Instruction Explicit!

“Pedagogical intervention is at the core of being a teacher-librarian.”

“If school libraries do not contribute to learning outcomes, and if teacher-librarians cannot articulate what these outcomes are, then school libraries are on shaky ground.”

Ross Todd, IASL, 2003

A cut-back scenarioA cut-back scenario

When asked why teacher-librarians were cut, the director of human resources said:“these proposed cuts will not affect

student learning and will not disrupt the learning process.”

How is learning demonstrated?How is learning demonstrated?

1. What the student knows

2. What the student can do with what he or she knows

3. The student’s confidence and motivation in carrying out the demonstration.

Spady and Marshall. “Light not heat on OBE.”

ASBJ Nov. 1994

Ask your learnersAsk your learners

• Cognitive• Affective• Social• Physical

Video--BaselineVideo--Baseline

Two years laterTwo years later

Last yearLast year

Surveys as powerful toolsSurveys as powerful tools

• Student satisfaction• Faculty satisfaction• Plagiarism / academic integrity• Readers’ interest

SurveysSurveys

• Student feedback is very revealing!• Surveys reflect attitudes, confidence • Baseline and comparison

• First grade and fifth grade• Before and after a unit• Freshmen and senior• Before and after an initiative

• Paper• Video focus groups

Two-question survey:Two-question survey:

• During this term, how did the library best help you learn?

• During this term, how could the library help you learn better?

Ross Todd, IASL, 2003 (quoting one teacher-librarian’s feedback survey)

Your two- or three-question survey?Your two- or three-question survey?

http://surveymonkey.com

Need to Communicate!Need to Communicate!

• Newsletters• Frequent, targeted emails• Intrude politely on meetings

• Decisions are made by those who show up• Get invited, offer to host meetings

• USE your website!• As your teaching portfolio• As a dynamic public relations tool• As a knowledge management site with you as CIO

Share successShare success

“Hear No Evil, See No Evil, Speak No Evil” WebShots.com 26 May 2003 http://www.webshots.com/g/25/522-sh/18287.html

•Document•Memos•Goals and updates•Newsletters•Reports

No one will know what

you are doing unless you report it!

How do we measure and share impacts & outcomes?

Essentials!Essentials!

• Skills with • Spreadsheets• Desktop publishing• Presentation• HTML editors, blogs

• Importance of library assistants!

PowerPoint as a Chart Creator

PowerPoint as a Chart Creator

0

10

20

30

40

50

60

70

80

90

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

EastWestNorth

1st Qtr2nd Qtr3rd Qtr4th Qtr

0102030405060708090

100

1st Qtr 2nd Qtr 3rd Qtr 4th Qtr

EastWestNorth

How many pathfinders this year?How many pathfinders this year?

Pathfinder menu

http://mciu.org/~spjvweb/pathmenu.html

How do you share new experiences / resources?

How do you share new experiences / resources?

Types of reportsTypes of reports

• Full written report--give to board, administrators, tech director, advisory team

• Oral presentation to board, building level meetings, department meetings

• “Executive” summary share with full staff • Survey results--baseline, over time• Summaries of anecdotal research

• Observations, video interviews, samples of student work, journals, etc.

The annual reportThe annual report

• http://mciu.org/~spjvweb/annualreport05.pdf

• OLA Template• http://accessola.com/osla/toolkit/home.h

tml

From the OLA Toolkit

Who uses you?Who uses you?

Usage by classes / groups 2004 /2005

Art

Music

English

Language

Guidance

PE

Tech ED

Math

Science

Special Ed

Social Studies

MCCC/DeLeon

Tech

Other/Meetings

Jacquie Henry’s Daily Schedule and Attendance Stats

Jacquie Henry’s Daily Schedule and Attendance Stats

Period Classes / Activities

1

2

3

4

5

6After school

A. ___# students using library before school, homeroom, lunch

B. __# independent study hall students

C. __#after school users

D. __#total independent users (A +B+C)

E. __# classes today (E X 25?)

F. __# students in research classes

G. __Grand total using the LMC today (D + F)

From LMC, January 2006

Your Web use stats—easy!Your Web use stats—easy!

Extreme Tracker http://extremetracking.com/open?login=jvalenza

Database use statisticsDatabase use statistics

MONTHLY USAGE SUMMARY Summarizes activity For the month of December 2005

Inside Usage Remote Usage Total Usage Total Sessions 1676 314 1990 Connect Time (min) 14836 2884 17720 Avge Session Time (min) 9 9 9 Total Fulltext 2070 525 2595 Total Retrievals 3227 701 3928 Total Searches 12411 2613 15024 Total Turnaways 0 0 0

MONTHLY DATABASE USAGE by databaseFor the month of December 2005 Sessions FT Retrievals Searches Expanded Academic ASAP 71 123 147 162 (Inside) 62 111 135 149 (Remote) 9 12 12 13 Gale Biography Res Center 304 348 568 1661 (Inside) 261 285 463 1377 (Remote) 43 63 105 284 General Ref Ctr Gold 102 90 119 170 (Inside) 81 71 96 138 (Remote) 21 19 23 32 Literature Resource Center 260 637 1021 1636 (Inside) 204 478 791 1319 (Remote) 56 159 230 317 Opposing Viewpoints 251 258 638 2892 (Inside) 237 241 609 2752 (Remote) 14 17 29 140 Science Resource Center 19 21 52 206 (Inside) 12 6 27 69 (Remote) 7 15 25 137

How would you use this data?

Library Evening Usage

*Dec 2002 - Snow Day/Bomb Scare Day

*Jan 2003 – 1 weather day / 1- bomb scare / Feb 26 & March 5 Ice-closed

Library Evening Usage

0

20

40

60

80

100

120

Sept Oct Nov Dec Jan Feb Mar Apr May June

2000-2001

2001-2002

2002-2003

2003-2004

2004-2005

Teacher Librarian Toolkit for Evidence Based Practice

http://accessola.com/osla/toolkit/home.html

C:\Documents and Settings\Joyce Valenza\Desktop\Resources.htm

From:

Power Tools

Recharged

ALA Editions,

2004

From a librarian:From a librarian:

“I do not let an opportunity go by when I let staff know about what the library contributes to learning. I always quote some of the things the students have said to illustrate my points. The school has got the idea that what I am about is helping kids learn. The key thing, in my view, is to have something to say that goes beyond gut reaction. The student survey does just that. The teachers hear what students have to say.” (Ross Todd, 2004)

Results are used to:Results are used to:

• Make decisions on improving services

• Identify learning gaps• Design future information literacy

instruction• Plan the whole-school agenda

Why evaluate your program?Why evaluate your program?

• Help increase budget• Refocus on goals• Improve program• Critical for long range planning

Response to this year’s report:Response to this year’s report:

Dear Joyce,What an impressive annual report. Thank you for all you have done this

year. I have been sending information about our library to my friend and mentor, . . ., Superintendent of Schools in West Chicago. He is assembling a team to review his library and make recommendations. I'd like to talk with you about participating on the team. I don't think they could have anyone better. Thanks once again for your outstanding work. You have certainly 'raised the bar' for not only the libraries in the nation, but our High School. What you do has an impact on the entire school. I don't have to tell you that, but I'd like to take this opportunity to tell you how much you are valued. Have a nice summer. You have certainly earned it.Roseann

Joyce,The library report is excellent - and the accomplishments are outstanding. Congratulations to Michelle, Joan and you for a great year.ThanksJoe

Video as evidenceVideo as evidence

• Rubrics• Senior exit interviews

• Baseline• Annual

• School issues and growth• Be part of this research

Video--Seniors

Evidence-based practice is reflective practice!

Our measurements and study should improve our practice!

Reflective practice is:Reflective practice is:

• honest• multi-sourced• based on systematic analysis• involves thinking about and learning from

your own practice and from the practices of others

• offers new perspectives • improves judgment• increases the probability of taking informed

action when situations are complex and uncertain.

In most professionsIn most professions

• Colleagues learn by sharing with each other

• Colleagues learn by evaluating products

• Teams of workers critique each others’ work• Architects• Lawyers• Writers

“Looking at student work is a way to move out of complacency. Looking at student work brings you face to face with your values.”

Daniel Baron, Director Outreach Services, Harmony School Education Center.

Librarians have a major stakeLibrarians have a major stake

• However hard you are teaching, do you have any real evidence that students are learning those skills and adopting those behaviors?

• Student products are evidence of their true level of information fluency

• Consider what pieces of products you might examine—works cited, thesis statements, etc.

The video Looking at Student Work: A Window Into the Classroom is available from the Annenberg Institute for School Reform's Looking at Student Work Web page or by calling 401-863-7990.

Tuning Protocol in actionTuning Protocol in action

Why use protocols?Why use protocols?

• Creates a structured environment for speaking listening, and questioning

• Makes the most of limited time• Promotes deep, meaningful

conversation about teaching and learning

From Joyce’s principal:From Joyce’s principal:

If you want the support of your administrators:

If you want the support of your administrators:

• Show them your impact on student learning / achievement

• Document tangible learning outcomes

• Do not advocate for libraries; advocate for learners

• This evidence may not exist• You must gather it!

Getting started!Getting started!

• Do the job. Live Information Power!• Plan explicit lessons. Use explicit rubrics.• Document collaborative plans• Paper trail.

• Collect samples of student work• Survey• Lesson plans• Checklists• Portfolios• Rubrics

From Information Power:From Information Power:

Simple checklist strategies: check levels of student info literacy and tech skills, knowledge, attitudes before and after instruction• Ask student to rate level of skills: thesis

development, documenting sources, note cards, evaluation, etc.

• Look for general statements, opinions“More than 75% of the class described dramatic

improvement in their ability to evaluate sources.”

From Information Power:From Information Power:

Conferencing strategies: devise activities where students can reflect on their work, their skills, and the benefit of library instruction

“We conferenced with all the senior seminar students, examining their preliminary bibliographies and tentative thesis statements. Students felt far more confident about continuing their research. At the end, we noted fewer incidents of plagiarism, very few ‘research holes,’ and more focused products.”

From Information Power:From Information Power:

Rubric strategies: Evaluate students based on a set of criteria that clearly defines the impact of your lessons

“In evaluating student essays, we discovered that more than 80% of the students developed proficient thesis statements, an increase of 30% over the first assigned essay in the fall.”

Rubrics to document learningRubrics to document learning

• Make sure that information literacy goals are integrated into all research-based assignment rubrics (offer to help write and assess)

• Look at rubrics and work at beginning and end of semester or school year

• Look at one criteria at a time• Is documentation improving? Are students’

questioning skills improving?

More Information PowerMore Information Power

Journaling strategies: Document your instruction and the outcome of your instruction.

“Student research journals revealed 35% more students used our subscription databases since we introduced them in instruction. Among their comments . . . . ‘I never knew how many scholarly articles I could find in EBSCOhost!’”

More Information PowerMore Information Power

Portfolio strategies: Gather samples of students’ work over a period of time and match them to your school’s curriculum goals and information literacy requirements.

“Suzie’s sixth grade writing shows growing mastery of careful documentation. She is developing an analytical voice as a writer.”

Tell stories!Tell stories!

• Anecdotal evidence is evidence!• Stories make arguments easier to

understand and more memorable• Connect emotionally with audience• Have your teachers (and your students)

share their stories too• Plagiarism• Rubrics• Diversity

Ben’s StoryBen’s Story

Information need: Conditions in Civil War prisons

A good searcher

300 books!

Problem: Not every student is as motivated as Ben

Michelle’s StoryMichelle’s Story

Thesis: Hitler’s personality was the primary reason for the Holocaust

Research holes: Mein Kampf,Rise and Fall of the Third Reich

Lesson: A search engine is not a reference librarian

Human intervention is still critical!!!

Problem: Kids/people don’t know what they don’t know

Your voluntary focus on evidence-based practice:Your voluntary focus on evidence-based practice:

• Demonstrates your commitment to learning• Convinces the “pie-slicers” of the worth of

funding libraries, evidence of your value to the learning community

• Enables you to better plan more effective instructional intervention

• Moves you to more scientific practice, beyond the hunch, beyond library advocacy

• Improves your practice as a teacher-librarian!

Accountability for forward thinking!

How are you visioning?How are you leading?

How are you visioning?How are you leading?

• What new tools are you planning to incorporate this year?

• How are you responding to the read/write Web?• Blogs• Wikis

Equity:• Open Source• Academic readiness?

More important issue:What if I don’t do it?

This is an opportunity!

Game plan for changeGame plan for change

• Issue (Pick just one for now!)

• Vision

• Anticipate the resistance

• Plan the first steps

“Energy and persistence alter all things.”

Ben Franklin