Mental Health Program Evaluation Template MHPET ONLINE

Mental Health Program Mental Health Program Evaluation Template Evaluation Template

MHPET ONLINEMHPET ONLINE

ObjectivesObjectives

Participant will be able to…Determine whether the on-line MHPET

is an appropriate tool for your setting. Determine what needs to be in place in

order to use the on-line MHPETLearn the steps for using the on-line

Mental Health Planning and Evaluation Template.

MHPET PurposeMHPET Purpose

Enhance the evaluation of mental health services in the SBHC and/or in any school setting

Improve mental health practices in the SBHC and/or in any school setting

Collect data for school mental health advocacy and technical assistance efforts at NASBHC

Need for Quality Improvement in Need for Quality Improvement in Mental Health in SBHCsMental Health in SBHCs

Increased recognition that objective measures are needed for SBHC quality of care, especially in mental health

Such a measure needs to recognize:– Many disciplines involved in providing MH

services– Wide range of interventions– Limited translational research around best

practice in schools

Qualifiers and CaveatsQualifiers and CaveatsQuality Improvement for mental health

services in schools is new and unfamiliar territory

Consider where your program is developmentally

This is not about judgment i.e. good or bad, right or wrong

Should not be tied to staff performance appraisal or funding

MHPET MHPET DevelopmentDevelopment

In January 2004 NASBHC convened a workgroup to develop an evaluation tool

Adapted the School Mental Health Quality Assessment Questionnaire (MH-QAQ) developed by Mark Weist et al. at the Center for School Mental Health – Broadened questions from clinician to program

level– Expanded questions to be inclusive of school staff

and non-mental health providers– Shortened, fewer dimensions and indicators

MHPET web-based tool MHPET web-based tool www.nasbhc.orgwww.nasbhc.org

Beta testing ’07-’08April ’08 went online

– Set up to be completed by teams– Individuals complete tool independently– Computer generates average score for

team.– Teams go back 3-6 months later to

complete a second time– Computer generates second set scores

with comparison to first set.

Using the Web-Based Using the Web-Based MHPETMHPET

Principles for SBHCsPrinciples for SBHCs

Supports the school Responds to the community Focuses on the student Delivers comprehensive care Advances health promotion activities Implements effective systems Provides leadership in adolescent and

child health

http://www.nasbhc.org/site/c.jsJPKWPFJrH/b.2743459/k.9519/NASBHC_Principles_and_Goals_for_SBHCs.htm

Laura Hurwitz

Laura Hurwitz

Laura Hurwitz

James A Davis Middle School 1224 Clarendon Ave.

Bessamer, AL

2

3

Set Two Survey will be available after…

3

James A Davis Middle School 1224 Clarendon Ave.

Bessamer, AL

Set Two Survey will be available after July 25, 2008

3

0

Using Results for Quality Using Results for Quality ImprovementImprovement

Indicators with scores of 3 or less are automatically flagged as potential areas for improvement

Place the MHPET results in the context of other data.

Raters select targeted areas for improvement(dimensions and/or indicators with averages that are low relative to others)

Using MHPET to identify Using MHPET to identify improvement targetsimprovement targets

Parallel to goal setting with a student/client:– What are the strengths?– What areas are in need of improvement?– Realistic?– Obtainable?

Examine the lowest rated indicators first.– Which of these can you impact in the next 6

months? “Halo effect”

– By focusing on 2-3 indicators is there potential to positively impact others?

Continuous Quality Continuous Quality Improvement: PDSAImprovement: PDSA

Identify areas for improving quality and resources for improving target areas (PLAN)

Develop and implement improvement plan (DO)

Compare scores 3-6 months later and assess progress (STUDY)

Revise plan (ACT)

3

3

MHPET Next StepsMHPET Next StepsDevelop compendium of quality

improvement resources for each indicator

MHPET will have on-line link to resource for each indicator

Develop training module on quality improvement (School Mental Health Capacity Building Partnership)

Collect and analyze national data from MHPET

NASBHC Resources for Quality NASBHC Resources for Quality Improvement: www.nasbhc.orgImprovement: www.nasbhc.org

Paper version currently availablehttp://www.nasbhc.org/atf/cf/{CD9949F2-2761-42FB-BC7A-CEE165C701D9}/MHPET.pdf General mental health resourceshttp://www.nasbhc.org/site/c.jsJPKWPFJrH/b.2642293/k.85AC/mental_health.htm

Resource for Quality Improvement:Resource for Quality Improvement:The School Mental Health ConnectionThe School Mental Health Connection

www.schoolmentalhealth.org In association with University of

Maryland Center for School Mental Health (CSMH) www.csmh.umaryland.edu

40 indicators of quality in school mental health services

PowerPoints provide background information, a menu of suggested activities, helpful hints, web resources, and references

Other Resources for Quality Other Resources for Quality ImprovementImprovement

Center for Health & Health Care in Schools www.healthinschools.org

UCLA Center for Mental Health in Schools www.smhp.psych.ucla.edu

National Technical Assistance Center for Children's Mental Health at Georgetown University Center for Child and Human Development www.gucchd.georgetown.edu

IDEA Partnership www.sharedwork.org

Contact InformationContact Information

Laura Hurwitz, LCSWDirector, School Mental Health Programs

lhurwitz@nasbhc.org202-638-5872, x 205

Deirdre Taylor Administrative Manager

dtaylor@nasbhc.org202-638-5872, x 204