Demonstrating the Outcomes
What Does it Take to Make a Difference?
Joint PDI / STRADA MASTERCLASS
Purpose of Today Purpose of Today
“PDI has made a significant contribution to the voluntary sector’s response tothe needs of children and young people in the context of family andcommunity, from the specific areas of drug and alcohol misuse. It is clearfrom the data surveyed that a much more holistic, strengths basedperspective has been taken by the projects, than just what drugs and alcoholdo to young people and families. In some respects this perspective has beenahead of its time.
The measurement of outcomes has been to some extent pioneered by thePDI approach. PDI understands that what we measure should not be limitedto that which we can measure. PDI is assisting in the development of how weshow to both voluntary and statutory funders that the reporting of the ‘soft’outcomes, the ‘distance travelled’ for many families and young peopleaffected by drug and alcohol misuse depends upon more complexinterpretation than quantitative data can provide.”
Continuation Study of Practice Issues Evidenced in Projects Funded through PDI; STRADA (June 2010)
PDI JourneyPDI Journey
Achieving an Outcome Achieving an Outcome Focus on helping projects understand what realistic
outcomes they can support and how this can help contribute to the longer journey
Offer ongoing guidance, support and training to help think through how outcomes and evaluation significantly impacts on delivery and planning
Understanding the importance of the soft measures, how they contribute to the ‘hard outcomes’
The Outcomes The Outcomes
Improved health and well-being
Increased confidence and self-esteem
Increased coping skills
Improved parenting capacity
Increased safety of children
Improved educational/employment attainment
Reduced or abstained substance use
The Indicators The Indicators
Increased attendance at school
Improved family relationships
Parents setting routines and boundaries
Parents ensuring children access dental/health appointments
Parents understanding the impact of their substance use
Children have improved behaviour
Children are more able to make friends
Families are accessing community activities
Families have improved involvement with statutory services
Parents are accessing employment training opportunities
Increased identification of children at an earlier stage
Young people are involved in less risky behaviours
Progressing ChangeProgressing Change
RELATIONSHIPRELATIONSHIPS S THROUGHOUTTHROUGHOUT
Knowing this worksKnowing this works
Knowing this worksKnowing this works Relationship is key, using the workers
experience and skills – observation.
Strengths based approaches isn’t just for assessment, an effective tool to be used to measure change.
It isn’t a form filling exercise – outcomes are about seeing the difference.
self-evaluation can work as long as it is robust and genuine understanding of how it helps.
Seeing the resultsSeeing the resultsReported Core PDI Outcomes (33 projects – Apr 2012)
Seeing the resultsSeeing the resultsReported Indicators of Self-esteem and confidence (33 projects – Apr 2012)
Seeing the resultsSeeing the results PDI OUTCOME LOGIC MODEL – FUNDING TO PROJECTS
PDI Core Outcomes
Indicators of Change (Project outcomes)
Indicators of Change (first steps)
Core Types of PDI Funded Approaches
Family/Parenting Capacity work
Intensive Support for young people
Children, young people and parents are re-engaged or regularly attending nursery, school, or employment volunteering opportunities
Increase in the safety of children
Increase in attainments in education, employment
Improved parenting skills
Reduction or abstinence in drugs and alcohol
High Level PDI Outcomes
Improved aspirations and opportunities for children and young people Improved confidence,
self-esteem and resilience
We have improved the life chances for children, young people and families at risk
Increase in the health and well-being for children and young people
National Outcomes
Our young people are successful learners, confident individuals, effective contributors and responsible citizens
Our children have the best start in life and are ready to succeed
We live longer and healthier lives
Children and young people have increased awareness of the risks associated with substance issues
Assumptions: This is not an extensive list of project outcomes, but encompasses the key components of reporting outcomes by projects The national outcomes are contributing factors to the Scottish Government’s strategic objectives, Healthier, Smarter, Safer and Stronger This logic model focuses on the primary outcomes relating to PDI work (see Weaver’s Triangle in Evaluation Framework and Work Plan)
Parents and young people have improved their engagement with statutory services
Parents and young people have an increased understanding of the impact of their substance use
Parents are now ensuring children attend and access health and education appointments Children, young people and parents have identified and accessed positive alternative activities
Children, young people and parents are identifying specific goals that will support their progress
Children are either/on or off the register, supervision or statutory measure
Parents have developed structured routines and boundaries Parents and young people have made positive changes to their substance use Parents, children and young people are engaging well with other services (including diversionary activities) Parents, Children and young people have improved coping skills
So what next?So what next?
We don’t know it all!! We don’t know it all!!
We need to improve our support and learning to:
Improving awareness of IT skills and database systems
Continual PDI self-development
Better ways of effectively and supportively involving children in evaluation
Become over complacent in a world of outcomes
Additional Information Additional Information Lloyds TSB Foundation for Scotland:
www.ltsbfoundationforscotland.org.uk
Evaluation Support Scotland: www.evaluationsupportscotland.org.uk
Partners in Evaluation: www.pievaluation.co.uk
Outcome Star: http://outcomesstar.org.uk/