Evaluation to Support Strategic Planning in Indian/Native
Communities
Doug Novins, PhD
Candace Fleming, PhD
The Role of the Evaluation in CoC
• Provide a knowledge base for the planning effort
• Facilitate the process for developing the capacity for ongoing evaluation efforts
• Examine the feasibility of the service system models
• Document and disseminate the results of the initiative
Key Differences:CoC versus Typical Evaluation
• In CoC, evaluation provides important information (“data”) that is used in the planning effort
Refine Service SystemModel
A Typical Evaluation Model for Strategic Planning Efforts
Design Service SystemModel
Assess Service System Model(Feasibility Assessment)
Assess Planning Effort
(Process Evaluation)
Refine Service SystemModel
The Circles of CareEvaluation Model
Design Service SystemModel
Assess Service System Model(Feasibility Assessment)
Assess Planning Effort
(Process Evaluation)
Assess Needs and Existing Services Measure Development
Key Differences:CoC versus Typical Evaluation
• In CoC, evaluation provides important information (“data”) that is used in the planning effort
• In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer
Key Differences:CoC versus Typical Evaluation
• In CoC, evaluation provides important information (“data”) that is used in the planning effort
• In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer
• In CoC, the community is an active participant in designing and implementing the evaluation plan, not simply the “target” of evaluation activities
Components of the Evaluation
Define SeriousEmotional/Behavioral
Disturbance
AssessCommunity
Needs
DescribeSystem ofServices
Outline GoalsMarshal Resources
Components of the Evaluation
Design/Modify the ServiceSystem Model
Define SeriousEmotional/Behavioral
Disturbance
AssessCommunity
Needs
DescribeSystem ofServices
Outline GoalsMarshal Resources
Components of the Evaluation
Design/Modify the ServiceSystem Model
Develop OutcomeMeasures
Define SeriousEmotional/Behavioral
Disturbance
AssessCommunity
Needs
DescribeSystem ofServices
Outline GoalsMarshal Resources
Components of the Evaluation
Design/Modify the ServiceSystem Model
Develop OutcomeMeasures
Assess Feasibility
Define SeriousEmotional/Behavioral
Disturbance
AssessCommunity
Needs
DescribeSystem ofServices
Outline GoalsMarshal Resources
Components of the Evaluation
Design/Modify the ServiceSystem Model
Develop OutcomeMeasures
Assess Feasibility
Assess Planning Effort(Process Evaluation)
Define SeriousEmotional/Behavioral
Disturbance
AssessCommunity
Needs
DescribeSystem ofServices
Outline GoalsMarshal Resources
Our Role and Mandate
• To provide a clear framework for the grantees to use in designing their evaluation efforts
• To allow the grantees to design an evaluation effort that is most consistent with the priorities of their communities.
• To facilitate a process for identifying common domains for each of the evaluation components.
Our Role and Mandate
• To provide a clear delineation of CoCETAC and grantee roles and responsibilities in the evaluation effort.
• To provide consistently high quality technical assistance through a specific set of activities.
CoCETAC Technical Assistance Activities
• Grantee Meetings• Evaluator Meetings• Site Visits• Scheduled Technical Assistance Conference Calls• Ad Hoc Conference Calls and Email Exchanges• Detailed Reviews and Critiques of Evaluation Reports• Maintain World Wide Web Site• CoC Distribution List
Grantees Role and Mandate
• Development of site specific domains, constructs, and measures
• Obtain necessary IRB and other research approvals• Data collection, reduction, and analysis• Provide site-specific content to CoCETAC website• The writing and submission of local interim and final
reports.