Evaluation to Support Strategic Planning in Indian/Native Communities Doug Novins, PhD Candace Fleming, PhD.

Evaluation to Support Strategic Planning in Indian/Native

Communities

Doug Novins, PhD

Candace Fleming, PhD

The Role of the Evaluation in CoC

• Provide a knowledge base for the planning effort

• Facilitate the process for developing the capacity for ongoing evaluation efforts

• Examine the feasibility of the service system models

• Document and disseminate the results of the initiative

Key Differences:CoC versus Typical Evaluation

• In CoC, evaluation provides important information (“data”) that is used in the planning effort

Refine Service SystemModel

A Typical Evaluation Model for Strategic Planning Efforts

Design Service SystemModel

Assess Service System Model(Feasibility Assessment)

Assess Planning Effort

(Process Evaluation)

Refine Service SystemModel

The Circles of CareEvaluation Model

Design Service SystemModel

Assess Service System Model(Feasibility Assessment)

Assess Planning Effort

(Process Evaluation)

Assess Needs and Existing Services Measure Development

Key Differences:CoC versus Typical Evaluation

• In CoC, evaluation provides important information (“data”) that is used in the planning effort

• In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer

A Typical Evaluation Model for Strategic Planning Efforts

ProgramStaff

Evaluator

The Circles of CareEvaluation Model

ProgramStaff

Evaluator

The Circles of CareEvaluation Model

Program&

EvaluationTeam

Key Differences:CoC versus Typical Evaluation

• In CoC, evaluation provides important information (“data”) that is used in the planning effort

• In CoC, the evaluator is a full participant in the planning effort, and not an outside “objective” observer

• In CoC, the community is an active participant in designing and implementing the evaluation plan, not simply the “target” of evaluation activities

A Typical Evaluation Model for Strategic Planning Efforts

ProgramStaff

Evaluator

Community

The Circles of CareEvaluation Model

Program&

EvaluationTeam

Community

The Circles of CareEvaluation Model

Program&

EvaluationTeam

Community

Components of the Evaluation

Outline GoalsMarshal Resources

Components of the Evaluation

Define SeriousEmotional/Behavioral

Disturbance

AssessCommunity

Needs

DescribeSystem ofServices

Outline GoalsMarshal Resources

Components of the Evaluation

Design/Modify the ServiceSystem Model

Define SeriousEmotional/Behavioral

Disturbance

AssessCommunity

Needs

DescribeSystem ofServices

Outline GoalsMarshal Resources

Components of the Evaluation

Design/Modify the ServiceSystem Model

Develop OutcomeMeasures

Define SeriousEmotional/Behavioral

Disturbance

AssessCommunity

Needs

DescribeSystem ofServices

Outline GoalsMarshal Resources

Components of the Evaluation

Design/Modify the ServiceSystem Model

Develop OutcomeMeasures

Assess Feasibility

Define SeriousEmotional/Behavioral

Disturbance

AssessCommunity

Needs

DescribeSystem ofServices

Outline GoalsMarshal Resources

Components of the Evaluation

Design/Modify the ServiceSystem Model

Develop OutcomeMeasures

Assess Feasibility

Assess Planning Effort(Process Evaluation)

Define SeriousEmotional/Behavioral

Disturbance

AssessCommunity

Needs

DescribeSystem ofServices

Outline GoalsMarshal Resources

Our Role and Mandate

• To provide a clear framework for the grantees to use in designing their evaluation efforts

• To allow the grantees to design an evaluation effort that is most consistent with the priorities of their communities.

• To facilitate a process for identifying common domains for each of the evaluation components.

Our Role and Mandate

• To provide a clear delineation of CoCETAC and grantee roles and responsibilities in the evaluation effort.

• To provide consistently high quality technical assistance through a specific set of activities.

CoCETAC Technical Assistance Activities

• Grantee Meetings• Evaluator Meetings• Site Visits• Scheduled Technical Assistance Conference Calls• Ad Hoc Conference Calls and Email Exchanges• Detailed Reviews and Critiques of Evaluation Reports• Maintain World Wide Web Site• CoC Distribution List

Grantees Role and Mandate

• Development of site specific domains, constructs, and measures

• Obtain necessary IRB and other research approvals• Data collection, reduction, and analysis• Provide site-specific content to CoCETAC website• The writing and submission of local interim and final

reports.

AIANP Resourceson the World Wide Web

• AIANP– http://www.uchsc.edu/ai

• CoCETAC:– http://www.uchsc.edu/ai/coc

• NCAIANMHR– http://www.uchsc.edu/ai/ncaianmhr

• The Healthy Nations Initiative– http://www.uchsc.edu/ai/hni