WRITING BRIEF EVALUATION REPORTS FOR BRIDGE YEAR OBJECTIVES Sue Haun, Jeanette Treiber, Robin Kipke May 29, 2014
Feb 25, 2016
WRITING BRIEF EVALUATION REPORTS
FOR BRIDGE YEAR OBJECTIVES
Sue Haun, Jeanette Treiber, Robin Kipke
May 29, 2014
AGENDA Structure of the Brief Report From Progress Report to BER Reporting Results for Asset, Policy & Retail Campaign Objectives
Summarizing Data for Retail Campaign Objectives
2
BRIDGE YEAR BRIEF REPORTS
3
STRUCTURE OF THE BRIEF REPORT
What was your goal? How did you go about achieving it?
What happened as a result?
What does that mean for your program? 4
FROM PROGRESS REPORT TO BER
5
SOURCES OF INFORMATION Bridge Year Plan CX Results Evaluation Activity Write-ups Progress Reports Tell Your Story
6
PROJECT DESCRIPTION Describe the need State the objective and indicator
Describe what you did and why Identify activity timeframes Explain any changes to your plan 7
EVALUATION METHODS
Design parameters Samples Data collection procedures
Limitations Analysis methodologies
8
THE RESULTS
Present summary of key findings
Explain what the data reveal
Describe how the data informed your project
9
CONCLUSIONS
10
So what? Status report What worked/didn’t work Future recommendations
REPORTING RESULTS FORASSET, POLICY AND RETAILOBJECTIVES
11
TYPES OF OBJECTIVES
Policy Asset Retail Campaign
12
SUMMARIZING DATA FORRETAIL CAMPAIGN OBJECTIVES
13
TIP #1 – DATA COLLECTION TRAININGTEP staff trained a total of 10 youth to collect data for the store observation survey in July 2013. The training covered key concepts regarding the Core Survey, as well as the four modules: Flavored Products, Price and Promotions, Placement and Exterior, and Nutrition and Alcohol. To ensure high quality data collection, trainees practiced inputting data onto handheld devices; completed the Survey Practice Slide Deck Questionnaire provided by CTCP; participated in a field test that included pharmacies, convenience stores, and a supermarket; then repeated the Survey Practice Slide Deck Questionnaire. Correct answers to 70% of the questions is a passing score. All (100%) of the trainees scored 93% or higher indicating a high degree of competence. 14
TIP #2 – STORE OBSERVATIONTo investigate the marketing tactics and availability of both healthy and unhealthy products in the retail environment, observations were conducted in a random cluster sample of tobacco retailers in Bear County in July 2013 as part of a statewide effort. Using the core and nutrition modules provided by CTCP, observation data from 145 stores were collected by trained volunteers on handheld devices. Data for key indicators from the core survey are presented in Table 1 (on the next slide). Other key findings included the following:• Almost all (98.6%) sold cigarettes, cigarillos (91.7%) and
chewing tobacco (84.8%) but only 24.2% sold low or non-fat milk or a variety of fresh fruit (19.8%)
• The average price for one Swisher Sweets cigarillo, any flavor, was $.90
• Almost one-third (30.07%) of the stores had more that 33% of the windows covered by signs
15
TIP #2 – STORE OBSERVATION SURVEY
16
TIP #3 – PUBLIC OPINION POLLTo obtain a measure of public knowledge and sentiment on tobacco in the retail environment, a public opinion poll was conducted in Fur City, Cubby Hollow and Wilderness Gap in April 2014. The face-to-face survey of 63 Bear County residents was carried out by trained volunteers using handheld devices. Highlights of the results follow.Tobacco Products – Most (85.71%) respondents stated it is easy to buy cigarettes at stores near where they live; 61.90% stated it is easy to buy cigarillos (little cigars); most (84.13%) stated it is easy to buy chewing tobacco; and about half (50.79%) stated it is easy to buy e-cigarettes.Laws – Fifty-eight percent (58.73%) of respondents stated they would support a law that bans pharmacies from selling tobacco products; andAlmost two-thirds (60.32%) indicated they would support a law to prevent stores near schools from selling tobacco products
17
TIP #3 – PUBLIC OPINION POLL
18
TIP #4 – KEY INFORMANT INTERVIEWSThe key informant interviews were conducted in May 2014 in Bear City, the targeted jurisdiction, with city council members, the city manager, the city planner and two tobacco retailers. The key findings are summarized below. The most significant facilitators to policies that give consumers healthier options in stores included the following:• Belief that there is a connection between the health crisis and
the food, beverage, alcohol and tobacco products being sold in stores (nine of nine respondents); and
• Support for incentives in the form of financial aid tax credits in exchange for adopting health promoting practices (nine of nine respondents).
The most significant barriers to policies that regulate tobacco, alcohol, food and beverage sales and/or advertising included the following: • There was a mixed response to the role government should play
in making retail environments healthier, e.g., three respondents indicated that government should play a role in making retail environments healthier; while two respondents indicated that government should provide incentives, but not regulate; while four respondents replied “I don’t know.”
19
TIP #5 – MEDIA ACTIVITY RECORDMedia efforts were successful in generating positive coverage about tobacco control issues in local media. We sent out press releases to all six media outlets in our area (including online) and took part in the coordinated regional press event to release findings from the Healthy Stores for a Healthy Community store observations. Five of the six outlets picked up the story, framing the issue as problematic due to illegal sales of tobacco products to youth, sneaky tobacco marketing tactics aimed at kids, and exposure to alcohol and tobacco advertisements can hook kids early; pointing to the need for regulating marketing and tobacco retail licensing. As a result of this coverage, a potential audience of 235,000 in our community may have been reached with this news.
20
WEBINAR RECAP Essential components for Bridge Year BERs
From the progress report to the BER Reporting results for different types of objectives
Summarizing data for retail campaign objectives
21
QUESTIONS?
22
RESOURCES For more information on writing reports, visit the TCEC website: http://tobaccoeval.ucdavis.edu/recordings.php Tips to Writing Final Evaluation Reports (5/27/10
Recorded Webinar)http://tobaccoeval.ucdavis.edu/tools.php Guidelines: Tell Your Story Guidelines: Writing Quality Final Evaluation Reports Sample Brief Evaluation Reports 23
Photos: Shutterstock, Microsoft, TCEC
Our team — Diana Cassady, Jeanette Treiber, Robin Kipke, Catherine Dizon, Diana Dmitrevsky, Jorge Andrews & Sue Haun
Our website — http://tobaccoeval.ucdavis.edu
Our email — [email protected]
Our main line — 530.752.9951 24