Title VINational Training and Technical Assistance Forum and Listening
Session
Title VI Program EvaluationMay 1, 2007
Bob HornyakU.S. Administration on Aging
How does AoA use Data?• Government Performance and Results Act of
1993 and PART• AoA Performance Budget• Congressional Budget Justification• Program Evaluations• Information for other Federal and non-Federal
organizations• Information for general public
The data that grantees provide to AoA show that the programs and services provided through the Older Americans Act are achieving the intended results.
AoA focuses on three areas of performance measurement:
• Improve Program Efficiency
• Improve Client Outcomes
• Improve Effective Targeting to Vulnerable Elders
Performance measures:• help show how the programs are structured,• what processes or procedures are actually done, and• what the program is producing.
Performance measures tell us whether the goals of the program are being met. Measures fall primarily into four categories:
• Inputs• Outputs• Outcomes• Impacts
“Inputs” – refer to things that the system uses to make other things happen. Examples:• Funding – OAA and other federal funds, local community funds, private and nonprofit funds• People - AoA, SUA, AAA, Tribes, Community Service Providers, Volunteers• Technology – Strategic use of information technology• Laws – Related legislation, Executive Orders, policies, and regulations
“Outputs” refer to specific things that the program will produce immediately. Examples:
• number of trainings
• number of people served
• units/hours of services
• expenditures
“Outcomes” refer to the results of the outputs, usually expressed as an increase or a decrease. Examples:
percentage increase in people served through home and community-based services
improved knowledge
increase in the proportion of expenditures on HCBS rather than institutional care.
Output Outcome
Input Impact
“Impact” refers to the overall or long term goal attainment:
• Improved health and well-being of elders and their caregivers
Administration on Aging Administration on Aging Administration on Aging Administration on Aging
Title VI Organizations (238)Title VI Organizations (238)Title VI Organizations (238)Title VI Organizations (238)
Serving Older Native AmericansServing Older Native Americans
Serving Older Native AmericansServing Older Native Americans
Information/ Information/ Assistance and Assistance and OutreachOutreach
• 1 million hours empowering elders to make informed choices
Information/ Information/ Assistance and Assistance and OutreachOutreach
• 1 million hours empowering elders to make informed choices
In-Home ServicesIn-Home Services
1 million hours of personal care, chore, home health, homemaker
In-Home ServicesIn-Home Services
1 million hours of personal care, chore, home health, homemaker
Funding Funding
• $32,353,000
Funding Funding
• $32,353,000
Transportation ServicesTransportation Services
• 892,000 rides to meal sites,
medical appointments and
other critical activities
Transportation ServicesTransportation Services
• 892,000 rides to meal sites,
medical appointments and
other critical activities
Congregate Congregate NutritionNutrition
• 1.9 million meals
Congregate Congregate NutritionNutrition
• 1.9 million meals
Home Delivered Nutrition Home Delivered Nutrition • 2.3 million meals
Home Delivered Nutrition Home Delivered Nutrition • 2.3 million meals
Native American Family Native American Family Caregiver Support ProgramCaregiver Support Program
• Over 4,300 caregivers receiving services
Native American Family Native American Family Caregiver Support ProgramCaregiver Support Program
• Over 4,300 caregivers receiving services
The Aging NetworkThe Aging Network
Information/ Assistance
Outreach Transportation
Year Service Units Service Units Service Units
2003 693,999 229,040 908,311
2004 755,096 236,403 829,020
2005 862,390 215,621 892,242
Change: 2003 - 2005 168,391 -13,419 -16,069
% Change 24.3% -5.9% -1.8%
Information/ Assistance
Outreach Transportation
Year Service Units Service Units Service Units
2003 693,999 229,040 908,311
2004 755,096 236,403 829,020
2005 862,390 215,621 892,242
Change: 2004 - 2005 107,294 -20,782 63,222
% Change 15.5% -9.1% 7.0%
In-Home Services,
Chore Service
In-Home Services,
Family Support
In-Home Services, Home
Health Aid Service
In-Home Services, Homemaker Service
In-Home Services, Telephoning
In-Home Services, Visiting
Year Service Units Service Units Service Units Service Units Service Units Service Units
2003 128,836 84,630 68,346 139,203 220,717 415,352
2004 107,634 74,396 28,087 106,437 205,013 459,767
2005 108,685 82,777 57,040 146,992 232,017 555,283
Change: 2003 - 2005 -20,151 -1,853 -11,306 7,789 11,300 139,931% Change -15.6% -2.2% -16.5% 5.6% 5.1% 33.7%
In-Home Services,
Chore Service
In-Home Services,
Family Support
In-Home Services, Home
Health Aid Service
In-Home Services,
Homemaker Service
In-Home Services,
Telephoning
In-Home Services, Visiting
Year Service Units Service Units Service Units Service Units Service Units Service Units
2003 128,836 84,630 68,346 139,203 220,717 415,352
2004 107,634 74,396 28,087 106,437 205,013 459,767
2005 108,685 82,777 57,040 146,992 232,017 555,283
Change: 2004 - 2005 1,051 8,381 28,953 40,555 27,004 95,516% Change 0.8% 9.9% 42.4% 29.1% 12.2% 23.0%
Congregate Meals
Home Delivered
Meals
Year Service Units Service Units
2003 1,656,272 2,161,879
2004 1,633,538 2,090,739
2005 1,901,956 2,287,957
Change: 2003 - 2005 245,684 126,078% Change 14.8% 5.8%
Congregate Meals
Home Delivered
MealsYear Service Units Service Units
2003 1,656,272 2,161,879
2004 1,633,538 2,090,739
2005 1,901,956 2,287,957
Change: 2004 - 2005 268,418 197,218% Change 16.2% 9.1%
Legal Assistance
Ombudsman Services
Year Service Units Service Units
2003 2,648 2,799
2004 5,145 5,087
2005 2,241 4,917
Change:2003 - 2005 -407 2,118% Change -15.4% 75.7%
Legal Assistance
Ombudsman Services
Year Service Units Service Units
2003 2,648 2,799
2004 5,145 5,087
2005 2,241 4,917
Change: 2004 - 2005 -2,904 -170% Change -109.7% -6.1%
Serving Elders at Risk (1995 – Title VI):• More than 50% of congregate meal recipients had
incomes at or below the poverty level.• For 45% of congregate meal recipients, the
congregate meal was the major or only source of food for the day.
• 28% of home delivered meal recipients were elders living alone.
• 29% of congregate meal recipients were elders living alone.
Efficiency: Title VI Services increase the number of units of service provided to elders per thousand dollars of AoA funding:
FY 2004 (252)
FY 2005 (255)
Let’s talk about:
Inputs, Outputs, Outcomes, Impacts and Plans