FINALEVALUATION
AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
SEPTEMBER26,2019
DatumforResearchandConsultancyResearchTeam
Contact:Sana’a,Yemen|Telephone:+967775457255|E-mail:[email protected]
ShoqiA.Maktary CountryDirectorSearchforCommonGroundAddress:AmmanStreet,Sana'a,YemenPhone:+967733888623Email:[email protected]
SamahQassem ProjectManager SearchforCommonGround Address:AmmanStreet,Sana'a,Yemen Phone:+967733483626 Email:[email protected]
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
2
SearchforCommonGround|YEMEN
TableofContents2.1. Introduction 92.2. Project Overview 103.1. Study Design 123.2. Objectives 123.3. Evaluation Criteria and Key Evaluation Questions 123.4. Scope 133.5. Sampling Method 143.6. Data Collection Tools and Sample Size 143.7. Data Analysis 163.8. Limitations 164.1. Relevance 174.1.1. Participation 174.1.2. Community Needs 174.2. Efficiency 194.3. Effectiveness 214.3.1. Youth-led Dialogues 214.3.2. Relationship Among Community Dividing Lines 224.3.3. Competencies Increasing and Participation 244.4. Impact 244.4.1. Perceptions of Key Informant People 244.4.2. Perceptions of Beneficiaries 264.5. Sustainability 27
TableofFiguresFigure1ActivitiesParticipationLevel Error! Bookmark not defined.Figure2RelevancetoCommunityNeeds Error! Bookmark not defined.Figure3Youth-ledDialogueEffectivenessinDealingwithCommunityIssuesError! Bookmark not defined.Figure4ProjectIncreasedCollaborationWithinCommunity Error! Bookmark not defined.Figure5YLDs&CBIsStrengthenedRelationshipwithYouthLeaders Error! Bookmark not defined.Figure6IMsCompetencyinReachingCommonGroundAmongParticipantsError! Bookmark not defined.Figure7InterventionsSatisfaction Error! Bookmark not defined.Figure8YLDs&CBIsHelpedinReducingConflict Error! Bookmark not defined.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
3
SearchforCommonGround|YEMEN
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
4
SearchforCommonGround|YEMEN
Abbreviations
CDA CommunityDialogueApproach
CSO CivilSocietyOrganization
CBI Community-BasedInitiatives
DAC DevelopmentAssistanceCommittee
FGD FocusGroupDiscussion
IM InsiderMediator
KII KeyInformantInterview
MoPIC MinistryofPlanningandInternationalCorporation
OECD OrganizationforEconomicCooperationandDevelopment
Search SearchforCommonGround
USD UnitedStateDollar
YER YemeniRial
YLD Youth-LedDialogue
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
5
SearchforCommonGround|YEMEN
1. ExecutiveSummary
Thepresentreportcapturesthefindingsfromafinalevaluationof‘AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation’project(hereafterreferredtoasAFutureCalledPeace), which was funded by USAID and implemented by Search for Common Ground (Search) inpartnershipwithfourlocalpartnerorganizations.Thiswasa20-monthproject(December01,2017toJuly30, 2019)whichwas operationalized across four districts in three governorates: 1) Al-SheikhOthmandistrictinAden;2)Al-Ma’aferdistrictinTaiz;and3)Al-MaqaterahandToorAl-BahadistrictsinLahj.
ThegoalofAFutureCalledPeacewastoenhanceyouthleaders’role(ages20to35)totransformconflictwithoutviolence.Inordertoachievethisgoal,Searchhadproposedtwospecificobjectives:
1. Youthleaders’capacityinconflictanalysisandconflicttransformationisstrengthened;and2. Collaboration among youth leaders and between youth and elders across dividing lines is
strengthened.
AFutureCalledPeacewas suspendedbyUSAID in June2015due to theoutbreakof the conflict butresumedinNovember2017tore-engageYemeniyouthleadersinfourgovernorates:Sana’a,Aden,Lahj,and Ibb. Search staff experienced a series of delays and setbacks in launching theproject due to thesecurity instabilityandthedifficulty incoordinationwithbothMinistriesofPlanningand InternationalCooperation(MoPIC)intheNorthandtheSouthofYemen.MoPIC-Sana’aintheNorthofYemenprovedto be particularly sensitive toward peacebuilding initiatives, which led Search leadership to take thestrategic decision to shift implementation to the MoPIC-Aden authority, therefore concentrating onbuildingislandsofstabilityinAden,Lahjand,Taizgovernorates.
InJune2019,towardthecloseoftheproject,Searchconductedafinalevaluationinordertomaximizethe effectiveness of its programming and engage in continuous improvement and learning withinprogramsandacrosstheorganizations.Themainobjectivesofthisevaluationwereto:
1. Evaluatetheproject'sperformanceintermsofachievingitsobjectivesandexpectedresults;2. Evaluatetheimplementationofthemainactivitiesoftheproject;3. Evaluateproceduresandprocessesforsettinguptheprojectasdescribedintheprojectproposal;4. Evaluatechangesassignedtotheprojectandlessonslearned;5. Document lessons learned and provide practical recommendations for better design and
implementation,aswellasrecommendationsonidentifyingthefuturepriorityareas;and6. Identifythedifficultiesencounteredduringtherealizationoftheproject.
MethodologyThe evaluation team used mixed-methodology (both qualitative and quantitative) data collection toinvestigateandformulatefindingsthatarehighlightedintheobjectivesmentionedabove.Inparticular,genderandlocationdisaggregationweretakenintoconsiderationwhendevelopingtoolsandanalyzingfindings.Tocollectqualitativedata,theevaluationteaminterviewed51people(37%women)throughfourfocusgroupdiscussions(FGDs)--oneineachdistrict--and12in-depthinterviews.Moreover,theevaluationteamconductedacomprehensivedocumentanalysiswiththeinvolvementoftheprojectteamto identify issuesand challenges facedby theSearch teamduring the implementationof theproject.Please see Annex 4 for a full list of project documents used in the evaluation process. To obtain
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
6
SearchforCommonGround|YEMEN
quantitativedata,theteamsurveyed206communitymembersanddialogueparticipants,35%ofwhomwerewomen.TheevaluationwasguidedbytheOrganizationforEconomicCooperationandDevelopment- Development Assistance Committee (OECD-DAC) criteria for evaluating conflict prevention andpeacebuildingprogrammingnamely:(Relevance,Effectiveness,Efficiency,Impact,andSustainability),andwasstructuredalongwiththeevaluationquestionsspecifiedinthetermsofreference(ToR).PleaseseeAnnex1toviewthefullToRforthefinalevaluation,writtenandpostedbySearch.
LimitationsThisparticularevaluationhasencounteredanumberofchallenges:
● Somecommunity-basedinterventionshavebeenimplementedorwereongoingafterthestartofthefinalevaluation.Therefore,thedatacollectingprocesswasbroughttoatemporaryhaltuntilSearchfinishingimplementingtheselectedcommunity-basedinterventions.Thischallengewascircumventedbyrepeateddatacollectionafterthecompletionofcommunity-basedinitiatives.
● SomeofthelocalpartnerorganizationswerelatetosubmitactivityreportstotheSearchteam,so there was a delay in providing the participants’ contact information to Datum team, inparticularinAl-ShiekhOthmandistrict.
● DuetotherecentunrestandsporadicarmedclashesinAden1,Datumteamcouldnotconductthekeyinformantinterviewwiththelocalauthority.
● Many local community members in Al-Shiekh Othman district refused or were reluctant torespond to the surveybecause theywerebusywithEidAl-Adhapreparations,ordue to theirsecurityconcernsaftertherecentpolitical-militarychaosinAden.
● Localpartnerorganizationsdidnotdealprofessionallywithattendancesheetsaswellastraditionsthatconstrainwomenfromsharingtheirphonenumbers,somostofthephonenumbersofthelocalcommunitymembersincludingwomenwhoparticipatedinthecommunitydialogueswereincomplete,wrong,orrepeated.
● Poormobilenetworkcoverageinthesouthernareashasmadeitdifficulttoreachbeneficiaries.
KeyFindingsRelevance:Theevaluationfoundtheprojecttobehighlyrelevanttotheneedsofthetargetedcommunitiesandtheirexistingissues.Thiscanbelargelyattributedtotheprojectactivitieshavingbeenbasedonathoroughanalysisofthecontextandadaptationbasedonfindingsfromthebaselinestudy.Theprojectbroughtallcommunitymemberstogethertosolvetheirproblemspeacefully,resultinginincreasedsocialcohesionandcollaborationamidgovernance,security,economic,political,andsocialcrises.Inaddition,theprojectbuiltstrongfoundationsfornon-violentconflictresolutionculturewithinthecommunityatatimewhenpeoplearesufferingfromviolenceandtheabsenceofpeacefuldialogues.Importantly,youthhavebeensignificantlyaffectedbyalltheseissuesandhencetheirplacementattheheartofthisprojectwashighlyrelevant.ThecollectedprojectdataindicatedthatallprojectactivitiessuchasInsiderMediators’training,conflictscans,communitydialoguemeetings,community-basedinitiatives,andregionalclosuremeetings,weresufficientlyrelatedtothelocalcommunities’needs.Inparticular,youth(youngwomenandmen)indicatedthattheprojecttrainingandotheractivitieswereveryusefultothem.Participantsreported 1OnAugust10,2019,theseparatistSouthernTransitionalCouncil(STC)seizedgovernmentmilitarycampsandthepresidentialpalaceinAdenafterthekillingofacommanderoftheUAE-backedsouthernseparatists,Brig.Gen.Muniral-Yafei.Sincethat,armedclasheshavebrokenoutinmostofthesoutherngovernoratesbetweentheSTCandYemen'sinternationallyrecognizedgovernment,whichistryingtorecapturethetemporarycapital,Aden.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
7
SearchforCommonGround|YEMEN
thatitbuilttheircapacitiesinconflicttransformationandsocialcohesion,aswellasincreasedtheirsenseofresponsibility.
Finally,therewasajointagreementamongallstakeholdersthroughtheconductedFGDs,keyinformativeinterviews(KIIs),andsurveysthatthedeliveredcommunity-basedinitiativesadequatelyreflectedtheirneedsandconcerns,asidentifiedduringthecommunitydialogues.Someexpressedtheirdissatisfactionthat not all community initiatives were implemented, however believed that those which wereimplementedprovidedsharedsolutionstotheeverydayproblems.
Effectiveness:Theevaluationresultsfoundthisprojecttobeveryeffective.InsiderMediators(youngwomenandmen),indicatedduringFGDsthat theprojecthelpedthemtogainmoreconfidenceandpresencewithin thesociety.Thetargetedsocietiesdevelopedwillingnesstobringadversariestogetherandtransformconflictwithout violence. Insider Mediators have become more visible in their communities. In all targeteddistricts,98%oftherespondentsfromalltargeteddistrictsstatedthattheyouthmanagedthecommunitydialogues skillfully and have acquired the necessary skills to facilitate dialogue around conflict andpotentialforpeacebuildingaswellasdealappropriatelywithcommunityproblemsandrelatedissues.Also,duringtheproject,thecommunitiesbecamefamiliarwithnon-violentwaysofresolvingconflicts,collaboration,andrespectbetweencommunitymembers.
Intotal,96%ofsurveyrespondentsindicatedthatthecommunitydialoguesandotherprojectactivitiesstrengthened the relationshipbetweenyouth leaders andelders aswell as reduced thegapbetweenthem.ThiswasconfirmedthroughfindingsfromthefocusgroupdiscussionswithInsiderMediatorsandkeyinformativeinterviewswithcommunityleadersandlocalauthorities.
According to thedata collected anddesk review, theproject successfully enhanced the roleof youthleaders in transforming conflicts in their communities without violence. Indeed, the project hasstrengthenedthecapacitiesofyouthleadersinconflictanalysisandtransformation,anditenhancedthecollaboration between youth leaders and elders across dividing lines. This success, however, waschallengedbythedelayinthedeliveryofcommunityinitiatives,accordingtotheInsiderMediators.Thetemporary halt and implementation of fewer community interventions than planned negativelyinfluencedthetrustthathadbeenbuiltbetweenyouthleadersandthetargetsocietiesasawhole.
EfficiencyTheevaluationshowedthattheprojectwasefficientlymanagedastherewerestructures,systems,andprocesses in place for efficientmanagement of the project, partnershipmanagement, and structuraldecisionmaking.Threemembers ineachpartnerCivilSocietyOrganization(CSO)wereresponsibleforcoordination,finances,logistics,andprojectmanagementineachdistrict.TheyreceivedsupportthroughorientationsessionsandcontinuancesupervisionfromSearchthroughadedicatedprojectmanagementteam comprising of a Project Manager, a Project Coordinator for southern governorates, ProjectCoordinatorfornortherngovernorates,andaProjectFinanceOfficer.TheprojectteamalsodevelopedM&E tools tomeasure the impactandqualityof theyouthcapacitybuilding training;dialoguedesigntraining;communitydialoguesessions;andtheregionallevelmeetings.TheSearchteamalsodevelopedpre-andpost-testsandqualitative&quantitativeassessmentsurveys.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
8
SearchforCommonGround|YEMEN
Inspiteofthis,theprojectexperiencedfinancialchallengeswhichwasbeyondthecontrolofSearchstaff.Namely,aftertheunfreezingoftheprojectin2017,theeconomiccollapseinYemenandcontinuousrisingprices were not anticipated. Therefore, despite the well-defined financial management system, thebudgetallocatedtoconduct24communityinterventionswasnotenough;Searchwasabletodeliveronly10of24community initiatives.Furthermore, therewasadelay in installment transactionsdue to thefinancialsituationandshortageofcashinbanks,whichresultedinthesuspensionofimplementationoftheselectedcommunityinitiatives.
Lastly,somelocalCSOpartners indicatedthattheyspentmoretimeworkingontheprojectthantheirtime budgeted in the project paid. Throughout the assessment, there was no indication of reportdisagreementoverissuesrelatedtotheprojectandfinancialmanagement.
In general, the project demonstrated value formoney and time, considering the number of activitiesimplementedwithinaspaceof20monthsinacomplexandvolatileimplementationcontext.Insimilarprojectcontextsofthismagnitude,quality,anddelivery,theprojectcouldhavecostmoreinmonetarytermsandtimethanwhatwasprovided.
SustainabilityThere is strong evidence that the project has produced sustainable outcomes, both in terms of thechanges itdeliveredat the individual levelandat thecommunity level.Mostof the InsiderMediatorsgainednewskills in conflict transformation,and theydemonstratedapplicationof these skills in theireverydaylives.Also,thenewsocialpositiontheyacquiredforbeingcommunityInsiderMediatorsgavethemmore respect and acceptance among community leaders and local authorities. These skills andpracticeshavebecomeembeddedwithin theyouth IMs, for instance, theyouth leaders inAl-Ma’aferdistrictcontinuedtosolveconflictwithoutviolenceevenaftertheprojecthadendedwhenfacedwithaland conflict between two brothers. In another example, youth leaders in Al-Sheikh Othman districtcollectedmoneyfromtraderstomakeatemporarywall (ironnet)tosolveaconflictwhentheSearchteamwasdelayedinimplementingacemeterywallinitiative.
Inaddition,theprojectstrengthenedmechanismsforthecommunitytoidentifyandresolvegrievances.Forinstance,asocialleaderwhoattendedcommunitydialoguesfollowedthesamemethodofconflictresolution to mitigate an identified conflict. This indicates that people in the targeted districts willcontinuetousetheskillstheyacquireddirectlyorindirectlyduringtheprojectactivities,aftertheprojectclose.
The InsiderMediatorsdid,however,providerecommendationsforhowprojectsustainabilitycouldbestrengthened.Onesuggestionwasenhancedcollaborationwiththelocalauthoritiesandencouragetheirmore comprehensive participation in strengthening community-level social cohesion, alongsidecommunity leaders. Also, Insider Mediators could more proactively seek funding opportunities andavailable resources which could be leveraged to to continue to transform and resolve conflicts.Furthermore,Searchshouldfollowupactivitiesbyholdingperiodiccommunitymeetingswhichinvitesallmembersandfacetsofthecommunitystructure.Finally,Searchcouldinitiateaforumtogatheryouth,communityleaders,andlocalauthoritiestofamiliarizeandsensitizethecommunitytotheimportanceofthecommunitydialoguesessions.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
9
SearchforCommonGround|YEMEN
Impact:In general, the evaluation found the project to be impactful for young women and men. Projectparticipantsgainedskillsinconflictanalysisandconflicttransformation,whichtheycanutilizeinsolvingtheir communities’ problemsorworkingwith other projects in the future.Moreover, the communitydialogueswere found tobean innovativemechanism that strengthened theproject's impact throughconveningmultiplelevelsofsociety.Inparticular,theprojecthashadanimpactonwomen’sparticipationin peacebuilding. This, in turn, has had an effect on the wider society’s acceptance of women aspeacebuilders-whichisexpectedtocontinuetodevelopsolongasactivitiessuchasthoseinthisprojectcontinuetobeimplemented.Nevertheless,itisimportanttonotethattheopinionsregardingtheprojectimpactdiddifferfromonedistricttoanother.Thiscanmainlybeattributedtotheincompleteandinconsistentimplementationofcommunity initiatives,whichwere fewer than agreed. For instance, in Toor Al-Baha, conflicts amongHeteenschools’studentsdecreasedduetothecommunity-basedinitiativewhichprovidedchairstotheschool, as agreed. However, in Al-Sheikh Othman district, the impact of the community-basedinterventionwasnotasexpectedsinceonly50solarlightswereprovidedinlieuoftheanticipated123.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
10
SearchforCommonGround|YEMEN
2. BackgroundInformation
2.1. IntroductionSince2015,Yemenhasbeeninthemidstofacomplexarmedconflictthathashadamajor impactoncivilians,resultinginseverestructuraldamage,widespreadhungerandmalnutrition,outbreaksofcholeraandotherpreventablediseasesandsevereeconomicdecline.Duringnearlyfouryearsofconflict,overthreemillionpeoplehavebeendisplaced.24million,nearly80%,ofthepopulationofYemenareinneedofhumanitarianorprotectionassistance2.
Search for Common Ground has identified several pressing needs across Yemeni communities, mostnotablyaneedforinterventionswhosepurposeistostrengthensocialcohesionandincreasethelevelofcommunityengagementinconflictresolutionanddevelopmentactivities.ThroughCommunityDialogueApproach(CDA),communitiesandlocalcivilsocietyworkwithlocalgovernanceactorstoidentifylocalconflictdynamicsandleadpeacebuildinginitiativesthatresolvethese.
Theproject“‘AfutureCalledPeace:’StrengtheningYemeniYouthLeadershipforConflictTransformation”wasfundedbyUSAIDandimplementedbySearchforCommonGround(Search)inpartnershipwithfourlocal CSOorganizations; SOSCentre ForDeveloping YouthCapacities inAden,Al-WedAssociation forDevelopment in Taiz, thePulseOrganization forDevelopmentandPeace inAl-Maqatirah in Lahj, andWomenCentreforStudiesandTrainingsinToorAl-BahainLahj.Thiswasa20-monthproject(December01,2017toJuly30,2019).Ithasbeendoneinfourdistrictsinthreegovernorates:1)Al-SheikhOthmandistrictinAden;2)Al-Ma’aferdistrictinTaizand3)Al-MaqaterahandToorAl-BahadistrictsinLahj.
Search for Common Ground’s (Search) CMM-funded project “‘A future Called Peace:’ StrengtheningYemeniYouthLeadershipforConflictTransformation”wasaffectedbyUSAID’sfullsuspensionofnon-humanitarian funding,effective June1,2015,due to theoutbreakof the conflictbut theprojectwasresumedinNovember2017tore-engageYemeniyouthleadersinfourgovernorates:Sana’a,Aden,Lahj,andIbb.Search-YemenstaffexperiencedaseriesofdelaysandsetbacksinlaunchingtheprojectduetothesecurityinstabilityandthedifficultyincoordinationwithbothMinistriesofPlanningandInternationalCooperation(MoPIC) intheNorthandtheSouth.Therefore,Search-Yemenstafftargetedanothertwodistrictswhich are located outside of theMoPIC-Sana’a sphere. The new two districts areAl-Ma’aferdistrictinTaizandToorAl-BahadistrictinLahj.
Withineachgovernorate,Searchhaschosentotargetamixofurban,semi-urban,andruralsettingsthatwould increase the skills andcapacitiesofdiverseyouth in theNorthandSouthand strengthen theirrelationshipswithkeystakeholdersatalocalandnationallevel.Theinclusionoffewergovernoratesthanoriginallyplannedpriortoprogramsuspensionenabledswiftimplementationandaconcertedfocusondeliveringimpact-drivenresults.Theinclusionofdiversecontextualenvironments,suchasrural,semi-urban,andurban,allowedtheprogramtoengagenotonlywithyoung,politically-engagedpeacebuildersinurbancentersbutalsowithsecond-tierleaders,suchassonsanddaughtersofsheikhsandgovernment
2OCHA.(2018).2019HumanitarianNeedsOverview.Retrievedfromfile:///C:/Users/youmna/Desktop/refernces%20for%20UNESCO%20%20report/references%20for%20the%20final%20draft%20uniesco/2019_Yemen_HNO_FINAL.pdf
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
11
SearchforCommonGround|YEMEN
officialsinmoreruralsettings.Thismixallowedforabroaderexchangeofexperiencesandperspectivesfromparticipants.
2.2. ProjectOverviewTheoverallgoalofthisprojectwastoenhanceyouthleaders’role(ages20to35)totransformconflictwithout violence. In order to achieve that goal, the project has two specific objectives and resultingoutcomes:
● Objective 1: Youth leaders’ capacity in conflict analysis and conflict transformation isstrengthened.
o Outcome1.1:Youthleadersineachofthetargetgovernoratesareequippedtoanalyzeconflictdynamics,conflicttriggers,andidentifyopportunitiestotransformconflict.
o Outcome1.2:Youthleadersinthetargetgovernoratesimplementsuccessfulinitiativestorespondcollaborativelytoconflict.
● Objective2:Collaborationamongyouthleadersandbetweenyouthandeldersacrossdividinglinesisstrengthened.
o Outcome2.1:Healthyrelationshipsamongstyouthparticipantsandbetweenyouthandeldersarecreatedacrossdividinglinesandwithstakeholdersatalocalandnationallevel.
o Outcome2.2:Lessonslearnedonyouth-ledpeacebuildingeffortsaresharedacrossthesedividinglinesandwithstakeholdersatalocalandgovernoratelevel.
TheoryofChangeTheAFutureCalledPeaceprojectwasbasedontwocomplementarytheoriesofchangewhichunderpinthe overall project theory of change: If emerging youth leaders’ capacities are strengthened andnetworked,thencollaborativeactiontomitigateconflictswillresult.ThesetwocomplementarytheorieslinkedtotheconflictdynamicsinYemen:
1. TheInside-Outtheoryofchange,specificallythecommoncomplexidentitiestheory.Thisstatesthatifkeyactorsand/orabodyofindividualsonallsidesoftheconflictdiscoversharedvaluesandmultifacetedcomplexidentities,includingconstructivein-groupself-esteem,theninclusivebroader"valueidentities"thatunitegroupswillform.
Thistheoryofchangeispertinentforthisprojectbecauseitreflectsthedegreetowhichnationalidentitiesareunderminedbypressuretoidentifymorestronglywithatribe,clan,religion,caste,region,orculturalbackground.Thisprojectseekstoenableyouth leadersto findvalue indiversity, recognizingcommoninterestsdespitetheirdifferences,firstlywithintheirgovernorateandthenwithyouthleadersfromothergovernorates with contrasting identity profiles. This change will thus support constructive conflictengagementandstrengthenresiliencetonegativemanipulationandviolentactionbyone'sowngroup.
2. The Healthy Relationships theory of change, specifically the community-based peacebuildingtheory.This states that ifbelligerentgroupswithina communityaregiven theopportunity tointeract,thentheywillbetterunderstandandappreciateoneanotherandwillprefertoresolveconflictspeacefully.
Thistheoryofchangefocusesonthestrengthoftherelationshipsbetweentheyouthleaders,butalsobetweenyouthandanoldergenerationofleaders,elders,andgovernmentofficials.Thisproposedprojectseeks to transform intra- and inter-generational relationships from one of mistrust, prejudice, and
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
12
SearchforCommonGround|YEMEN
adversarialapproachestowardonerootedincommoninterests.Asthehealthoftherelationshipbetweenthesegroupsimproves,thelikelihoodofviolencebetweenthemdeclines.
Theseabove-mentionedoutcomeswereachievedbythefollowingactivities:
1. LocalPartnersPartnerships:Prior toactivity implementation,Searchpartneredwithone localCSOperdistrict.Theprojectpartnerassistedintheidentificationofyouthparticipantsandhelpedfacilitateactivityimplementation.
2. IdentifyYouthLeaders:AcollaborativemappingexercisedbetweenSearchanditslocalpartnersineachdistricttoidentify20ormoreyouthleaders.SearchandlocalpartnersheldFGDsandKIIswithvariousstakeholderstoidentifyexistingyouthstructures,includingpolitical,tribal,religious,secular,sports-based,orprofessionalassociations.
3. Youth Capacity Building Training: One four-day training per district was held to build youthparticipants’ capacity in three modules: conflict resolution, conflict analysis, mediation andfacilitationtechniques.
4. Youth-led Conflict Scans: Trained youth-led conflict scans within their local communities toidentify local-level conflicts affecting youth, highlight push/pull conflict drivers, notepotentialavenuesofmitigationandresolution,andidentifyacademicresourcesforpeace,includinghumanresources, social capital, resolution mechanisms, etc. Conflict scans utilized Search’s existingconflictscantool.
5. Youth Peacebuilding Dialogue Design Training: Youth attended a four-day capacity buildingworkshoptodevelopdialogueproposalsaimedataddressingconflictsidentifiedintheconflictscans. Search and local CSOpartners oversaw thedialoguedesignproposal development andensured each was sustainable, locally-owned, built around a clear goal and objectives, andidentifieskeybeneficiaries.
6. Youth-led Dialogue Processes: Submitted dialogue proposals were evaluated by Search andpartnerCSOsbasedoncriteriadevelopedbySearch.SelecteddialogueproposalsfundedthroughSearch, after ensuring of sustainability, gender-inclusivity, relevance, local ownership, andinclusion.Youthfacilitatedaseriesoflocalstakeholderdialogueprocessestodiscusstheiryouth-relatedissuesanddeveloppotentialsolutionstotheircommonproblems.
7. Community-based Initiatives:Basedonthe issues identified intheconflictscansanddialogueconclusions,youthleadersdevelopedproposalsforcommunity-basedinitiatives,designedwithparticipationby the targetedcommunity, localauthorities,and traditional leaders togeneratebuy-in.
8. Regional-levelMeetings:Tworegional-levelmeetingswereheldattheendoftheproject;oneconveningyouthrepresentativesfromAl-Ma’aferandAl-Maqatirah(TaizandLahjgovernorates)and the other for youth representatives Al-Sheikh Othman and Toor Al-Baha (Aden and Lahjgovernorates).Themeetingsbroughttogetheryouthleadersfromthetargetedgovernoratestonetwork,shareexperiences,andexchangelessonslearned,includingpresentationsontheyouthimplementedprojects.
Inadditiontotheactivitiesmentionedabove,SearchconductedabaselinestudyinJuly2018aimedtotesttheproject’sunderlyingassumptionsonyouthengagementinpeace-buildingbycollectingyouthandcommunitymembers’perceptions.InApril2019,Searchconductedamid-termevaluationtooutlinethe
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
13
SearchforCommonGround|YEMEN
resultsoftheproject,showcaselessonslearnedthusfar,andprovidereflectionsandrecommendationsfortheupcomingfinalprojectperiod.
3. Methodology
3.1. StudyDesignTheevaluationemployedbothquantitativeandqualitativeparticipatorymethods.Bothquantitativeandqualitative data were analyzed with gender, age, and location disaggregation. To ensure reasonablegender representation, at least 30% of the sample sizewaswomen. The qualitative and quantitativefindingsweresynthesizedfollowingtheprojectindicators.Furthermore,theevaluationwasguidedbytheOrganizationforEconomicCooperationandDevelopment-DevelopmentAssistanceCommittee(OECD-DAC) criteria for evaluating conflict prevention and peacebuilding programming namely: (Relevance,Effectiveness, Efficiency, Impact, and Sustainability), and was structured along with the evaluationquestionsspecifiedintermsofreference(ToR).DatacollectiontookplacebetweenJuly1toAugust19,2019.Theevaluationfieldworkwascarriedontworoundsduetotheabsenceoffullbeneficiaries’dataandsecurityconcerns,especially inAden.The first roundfromJuly1 to July15,2019andthesecondroundwasbetweenJuly29toAugust19,2019.
3.2. ObjectivesThefinalevaluationobjectivesfocusedonthefollowing:
1. Evaluatetheproject'sperformanceintermsofachievingitsobjectivesandexpectedresults;2. Evaluatetheimplementationofthemainactivitiesoftheproject;3. Evaluateproceduresandprocessesforsettinguptheprojectasdescribedintheprojectproposal;4. Evaluatechangesassignedtotheprojectandlessonslearned;5. Document lessons learned and provide practical recommendations for better design and
implementation,aswellasrecommendationsontheidentificationoffuturepriorityareas;and6. Identifythedifficultiesencounteredduringtherealizationoftheproject.
3.3. EvaluationCriteriaandKeyEvaluationQuestionsThe evaluation is based on theOECD-DAC peacebuilding Evaluation Criteria (relevance, effectiveness,impact,efficiency,andsustainability).Inparticular,thestudyaimedtogatherrelevantdatainordertoshedlightonthefollowingquestions:Relevance:
● Towhatextentdidthisprojectrespondtothetargetedcommunityneedsandexistingissues?● Whatistherelevanceoftheinterventionsasperceivedbybeneficiariesandstakeholders?● How relevant were the instruments (Insider Mediators’ training, conflict scans, community
dialoguemeetings, and community initiatives) dedicated during the project to transform theconflictorthedriversoftheconflict?
Effectiveness:● Towhatextentwastheprojectsuccessfulinachievingitsstatedgoal?● Towhatextentwastheprojectsuccessfulinachievingitsstatedobjectives?:1)Youthleaders’
capacity in conflict analysis and conflict transformation is strengthened, and 2) Collaborationamongyouthleadersandbetweenyouthandeldersacrossdividinglinesisstrengthened.
● TowhatextentwastheprojecteffectiveinprovidingInsiderMediators’trainingwiththeskillsandcapacitiesneededtoenhanceyouths’engagementtotransformconflictwithoutviolence?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
14
SearchforCommonGround|YEMEN
● To what extent did the various project activities contribute to the achievement of projectobjectives?
● Whatwerethemajorfactorsinfluencingtheachievementornon-achievementoftheobjectives?● Whatwerethemajorprojectresultsandlessonslearned?
Efficiency:● Doestheprojectdeliveritsoutputsandobjectivesinanefficientmanner(resultsagainstcosts)?● Wereactivitiescost-efficient(resourcesappliedresults)?
Sustainability:● TowhatextentaretheobjectivelyverifiableresultssustainablebeyondSearchorUSAIDsupport,
disaggregatedbygender,age,andlocation?● Whatcouldhavebeendonedifferentlysotheprojectbecomesmoresustainableinthefuture?● Havenewmechanismsbeendesignedtocontinueanyworkinitiatedbythisproject?Ifyes,will
theinitiativessustainpost-project?Impact:
● Whatarethebroaderchanges,positiveornegative,intendedorunintended,oftheinterventionsinthecontext?Towhatextentarethesechangesdesirable?
● What changes can be ascertained in attitudes, behaviors, and relationships as a result of thecommunitydialoguesessionsandmediationactivities?
● Whatcouldhavebeendonedifferentlytomaketheprojectbeofhigherquality,greaterimpact?Thiswill include lessons learned,projectmanagementand implementation, andworkingwithyouthwithinlocalcommunities.
● Captureand/orincorporatesuccessstories,whenapplicable–thathavebeenthemostsignificantchanges as a result of theproject interventions. In addition to the above linesof inquiry, theevaluationisexpectedtoprovideinformationagainstthekeyindicatorsaslistedintheprojectlogframe.
3.4. ScopeThefieldworkofthisfinalevaluationtookplaceinfourdistrictsofthreegovernoratesandsurveyswerecollected from the sub-districts where the community-based interventions have partially or entirelydelivered,asisshowninthefollowingtable:
Governorate
District Sub-district Delivered Community-basedinitiative
Aden Al-SheikhOthman AL-Mahareeq Installed street lights andpurchased solar powerappliances to supply electricityforstreetlights.
Taiz Al-Ma’afer Al-Sawa FurnishedandequippedtheCivilStatusDepartment.
Al-Anbooh RehabilitatedtheTrainingCentrein26Septemberschool.
Al-Shaoba Furnished and Equipped Al-HiabAcademicInstitute.
Lahj Al-Maqatirah Al-Sawaleha,Al-Gerbavillage
ConstructedaprotectivefenceonAl-Gerbadam.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
15
SearchforCommonGround|YEMEN
Al-Sawaleha,Al-HamraandAl-Barhvillages
Fixed leaking holes in Al-Barhdam.
Al-Anboah,Al-Raboaa, Al-Heda, andMahdadvillages
Fixedtheoldwaterpumpengine.
ToorAl-Baha Al-Gareek Purchased chairs for HiteensecondarySchool.
Al-Zakak FurnishedandequippedthelocalHealthUnit.
3.5. SamplingMethodTwosamplingmethodswereused,apurposivesampleandarandomsample.Thepurposivesamplewasusedtoidentifyandinterviewthekeyinformantsofthisfinalevaluation.Therandomsamplingwasusedforthesurveywithlocalcommunitymembers.Thefinalevaluationtargetgroupswereasfollows:
3.6. DataCollectionToolsandSampleSizeDatum’steamdevelopedthefinalevaluationtools,asledbytheteamleader.ThetoolsweresharedwithSearchforreviewandfeedback.UponreceivingtheapprovalfromSearch,thetoolsweredispatchedtothe field team and used to facilitate data collection. Data for the evaluationwas collected using thefollowingtools:
Deskstudy
All relateddocumentsoftheprojectwerereviewedandanalyzed, includingbutnot limitedtoprojectproposalandimplementationplans,projectprogressreports,monitoringandevaluationreports,preand
Stakeholders Tool Planned Achieved Location
LocalCSOpartner KII 4 4 Evaluationlocation
Communityleaders KII 4 4 Evaluationlocation
Localauthorities KII 4 3 Evaluationlocation
Searchprojectstaff KII 1 1 Sana’a
InsiderMediator FGD 4 4 Evaluationlocation
LocalCommunitymembersanddialoguesparticipants
Survey 180 206 Evaluationlocation
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
16
SearchforCommonGround|YEMEN
post-training tests, and training reports. The desk review aided in verifying the progress of activitiesagainsttheprojectplanandlogframe.
FocusGroupDiscussions(FGDs)Atotalof4FGDswereconducted(oneineachdistrict)thatincluded40InsiderMediators.OfthetotalFGDsparticipants,17werewomen(42.5%).FGDshelpedinconsolidationthedatacollectedfromboththesurveysandKIIs.
In-DepthKeyInformantInterviews(KIIs)Atotalofelevenoutofananticipatedtwelvein-depthKeyInformantInterviews(KIIs)wereconductedwithcommunityleaders,localCSOpartners,localauthorities,andSearchstaff.DuetotherecentarmedclashesinAden,DatumteamcouldnothaveaninterviewwiththelocalauthorityinAl-SheikhOthmandistrict. KIIswere used as a qualitative tool to gathermore in-depth information about the project’seffectiveness,efficiency,impact,andsustainability.TheKIIshelpedinobtainingdetailedinformationfromthemost relevantpersonsconcerningdifferent issues, challenges, success stories,and thebenefitsofsuchinterventions.Additionally,theKIIshelpedinexploringthemainchangesthattargetedcommunitiesandCSOsfacedinadoptingthedialogueapproach.Thelistofinformantswaspre-agreedwithSearchandisdetailedbelow:TargetGroups Taiz Aden Lahj Total
Al-Ma’afer Al-SheikhOthman
Al-Maqatirah ToorAl-Baha
LocalPartner 1 1 1 1 4LocalAuthorities 1 0* 1 1 3CommunityLeaders
1 1 1 1 4
Total 11*OneinterviewwasplannedwiththelocalauthoritiesinAl-SheikhOthmanhoweverwasnotconducted
duetoinsecurityinAden.
Questionnaire(StructuredSurvey)Finally,atotalof206respondentscompletedthesurvey.Ofthetotalsurveyrespondents,72werewomen(35%). Inthebeginning, itwasagreedtoconduct180surveys,45ineachdistrict. Inthefirst instance,manyoftherespondentsprovidednegativefeedbackbecauseSearchhasnotyetdeliveredcommunity-basedinitiativesorhavedeliveredafewofthem.Datumteampostponedthesurveysinceitbecameclearthattheevaluationwouldbebiasedasaresultofthetimingofthesurvey,whichdidnotcapturethefullextent of project implementation. Subsequently, the Datum team contacted the local communitymemberswherethecommunity-basedinterventionshadbeenimplemented.TheDatumteamsurveyedrecipientsviaphone,howevermanyphonenumbersoflocalcommunitymemberswhoparticipatedinthe community dialogueswere unavailable or incorrect. Thus, theDatum teameventually visited thetargetedareatomeetbeneficiariesandfillinthesurvey.Thesurveywasconductedtogatherquantitativedata from localcommunitymembers tomeasuretherelevanceandeffectivenessof theactivitiesandinterventions.Also,thesurveymeasuredthelevelofsatisfactionamongthecommunitymembersontheprojectactivitiesandinterventions.Thesampleofsurveyrespondentsisillustratedbelow:
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
17
SearchforCommonGround|YEMEN
3.7. DataAnalysisTheanalysisof thequantitativesurveyswasconductedusingMicrosoftExcelpivot tables,andfor thequalitativedata,acodingmethodwasemployedtocategorizethedatainawaytoextractthesupportiveinformationaswellasquotations.
Forthisevaluation,allprecautionshavebeentakentoensuredataquality.First,thetoolsweretranslatedintoArabicandtheenumeratorsweretrainedbeforeconductingthesurveys.TheenumeratorswerealsotrainedinmoderationtechniquesforFGDsandKIIs,aswellasinnotetaking.Finally,thecollecteddatawas analyzed and reviewed in order to identify errors and oversights. A debriefing meeting of 5-10minuteswasheldeverydaytoshareinformationonabnormalities.
3.8. LimitationsThisparticularevaluationhasencounteredanumberofchallenges:
● Somecommunity-basedinterventionshavebeenimplementedorwereongoingafterthestartofthefinalevaluation.Therefore,thedatacollectingprocesswasbroughttoatemporaryhaltuntilSearchfinishingimplementingtheselectedcommunity-basedinterventions.Thischallengewascircumventedbyrepeateddatacollectionafterthecompletionofcommunity-basedinitiatives.
● SomeofthelocalpartnerorganizationswerelatetosubmitactivityreportstotheSearchteam,so there was a delay in providing the participants’ contact information to Datum team, inparticularinAl-SheikhOthmandistrict.
● DuetotherecentunrestandsporadicarmedclashesinAden,Datumteamcouldnotconductthekeyinformantinterviewwiththelocalauthority.
● Many local community members in Al-Sheikh Othman district refused or were reluctant torespond to the surveybecause theywerebusywithEidAl-Adhapreparations,ordue to theirsecurityconcernsaftertherecentpolitical-militarychaosinAden.
● Localpartnerorganizationsdidnotdealprofessionallywithattendancesheetsaswellastraditionsthatconstrainwomenfromsharingtheirphonenumbers,somostofthephonenumbersofthelocalcommunitymembersincludingwomenwhoparticipatedinthecommunitydialogueswereincomplete,wrong,orrepeated.
● Poormobilenetworkcoverageinthesouthernareashasmadeitdifficulttoreachbeneficiaries.
Governorate Districts SampleSize SampleSize Total SampleSize
Women Men
Taiz Al-Ma’afer 33 46 79
Aden Al-SheikhOthman
11 23 34
Lahj ToorAl-Baha 14 31 45
Al-Maqatirah 14 34 48
TotalInterviews 206
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
18
SearchforCommonGround|YEMEN
4. Findings
Thissectiondemonstratesthecollectedpointsofviewoftheparticipatingstakeholders (beneficiaries,localauthorities,community leaders,partners,and InsiderMediators)ontherelevance,effectiveness,efficiency,impact,andsustainabilityoftheprojectinthetargeteddistricts.
4.1. RelevanceTherelevanceindicatormeasurestheextenttowhichachievedactivitiesalignwithcommunityneedsaswellastotheprojectgoalandobjectives.Itisworthmentioningthatthecollectedfeedbackdemonstratedanoverallpositivefeedbackabouttherelevanceofconductedactivitiestotheprojectobjectivesaswellastothecommunityneeds.
4.1.1. ParticipationTherewasslightvariationintheparticipationofcommunitymembersbetweenYouth-LedDialogues(YLD)andCommunity-BasedInitiatives(CBI). It isworthmentioningthattheparticipationrateforYLD(98%)wasbiggerthanCBI(70%).ThefemaleparticipationraterotheYLD(35%)washigherthanfortheCBI(26%).Femaleparticipationwashighest intheAl-Ma’aferYLD.Accordingto IMs inAl-Ma’aferDistrict,therewerefiveagreed-uponprojects,althoughSearchimplementedonlythreeofthesenotincludingapendingproject.
Inordertoincreaseparticipation,all localpartnersexpressedtheneedtoincludelocalauthoritiesandsocialfiguresinexchangingexperiencesandinfollow-upandmonitoringoftheinitiatives.Inoneconcreteexample,thelocalpartnerinAl-SheikhOthmanexpressedtheneedtoincludelocaltraders,youth,andotherlocalleaders.
4.1.2. CommunityNeedsThe project’s high relevance came from the alignment of the projectmission and approachwith theYemenicommunitycontext,andtheneedforbuildingyouthandcommunitycapacityforeffectiveconflictresolutionandresiliencewhenaddressingdevelopmentissuesdrivenbyconflict.Thiswasreflectedinthe
Figure Activities Participation Level
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
19
SearchforCommonGround|YEMEN
statementsprovidedbythecommunity leaders inalltargeteddistricts.AccordingtoFaisalAl-Fadhli,acommunityleaderinAlMa’aferreported:
“Theprojectwasveryappropriateforthecommunitycultureandfulfilleditsmission,asitbuiltyouth
capacitiesandskillsidentifiedasripeforinterventionintheconflictscanandanalysis,andthenresolved
identifiedconflictsviadialogue.Inaddition,theprojectcameupwithappropriatesolutionsforthe
developmentissuesthecommunityfaces”
Furthermore; the project brought all community constituencies together, thus strengthening socialcohesionand collaborationwhilebuilding strongbases for anon-violent conflict resolution culture toemergewithinthecommunity.
Onascaleofthree,thesurveyrespondentsstatedthattheinterventionswererelevanttothecommunityneedsas illustrated in (Figure2). It isworthmentioning that the InsiderMediatorsconductedconflictscansinthetargeteddistrictsasawaytoidentifythemostappropriateinterventionsareas,andtoholddialoguesthatcanidentifythemostappropriateinterventionsthatrespondtothecommunityneeds.
Accordingtothesurveyrespondents,theimplementedinterventionswerehighlyrelevanttotheyouth-led dialogue outcomes as it shows in. Nevertheless, there were some negative opinions expressedregardingtherelevanceoftheprojectactivities,inparticularforthecommunityinitiativesinAl-Ma’aferand Al-Maqaterah. However, these concerns centered around the delay in implementing someinterventions as well as not implementing some of the agreed-upon interventions. Also, the studyindicatedalackofcommunicationbetweenthelocalauthoritiesandthelocalcommunity.Searchreliedon the local authorities to inform community members that only a few of the community-basedinterventionswillbeimplementedduetobudgetrestrictions.However,thelocalauthoritiesfailedtorelaythis message comprehensively to all community members. As a result, survey respondents oftennegativelyratedsomeactivities.
Relevent
Irrelevant 0.0
0.5
1.0
1.5
2.0
2.5
3.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 2: Relevance to Community Needs
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
20
SearchforCommonGround|YEMEN
However,intheFGDheldinAl-SheikhOthman,thereweremultiplecomments(fouroutoften)regardingtheneedformoreawarenessofhowtofosteracultureofdialoguebeforeimplementingsuchprojectsinordertoachievethedesiredgoals.
“Tryingtosolveconflictsbydialogueandimplementinginitiativeswithoutspreading
thecultureofdialoguetosolveconflictswithoutviolencewon’tcoverthecommunity
needsandtheconflictswillcontinuewithdifferentreasons”
ParticipantinAl-SheikhOthmanFGD
It isworth noting that IMs in each of the four targeted districts received training sessions from localpartners in conflict resolution, conducting local conflict scans, designing and managing communitydialogues,implementingcommunityinitiatives,andfacilitatingregionalclosuremeetings.Thesetrainingsessionsprovidedyouthwithvarious skillsneeded for conflict resolution thathelped themgainmoreconfidenceandpresencewithintheircommunitiesandincreasedthesenseofresponsibilityamongyouth.
“Thetrainingenhancedmyself-confidenceandIbecameabletoworkwiththe
communityeffectively.Italsoimprovedmyabilitytocommunicatewithpeopleasa
communityInsiderMediator”
FemaleInsiderMediatorfromToorAl-Baha
However,theInsiderMediatorsfromAl-SheikhOthmanexhibitedsomedissatisfactionthatthetrainingsessionwasinsufficientandthattheyneededmoretimeandpracticetobecomesufficientlycompetenttoperformtheirdutiesintheproject.
“Thetrainingwasn’tenoughtofulfillourneedsasInsiderMediatorsandtobuildour
abilitiesinconflictanalysisandresolution.FewInsiderMediatorswereabletomanage
dialoguesessionsandtherestplayedrolesascoordinators.Inaddition,thepractical
trainingonscantoolsdidn’ttakeenoughtimeandwefaceddifficultiesduringthescan
andreporting.Atthebeginningofthefieldwork,ourreportsweren’tacceptedandwe
weregivensomepractical comments fromtheSOScentercoordinator tohelpus in
performingthescanandinmanagingdialoguesessions.”
InsiderMediatorfromAl-SheikhOthman
Thelocalpartnershaddifferentviewsabouttheactivitiesoftheproject,forinstanceinAl-Ma’aferthelocalpartnerexpressedthattheactivitiesweresufficientbutmoretrainingdayswereneeded.Ontheotherhand,a localpartnerinToorAl-Bahaproposedcreatingawarenesssessionsonresolvingconflictthroughdialogue.Anothersuggestionwastoincluderights-basedlanguageinadditiontodevelopmentalissuesintrainings.
4.2. EfficiencyThisindicatormeasurestheextenttowhichprojectresultshavebeenachievedatareasonablecost(i.e.howinputs/meanshavebeenconvertedintoactivitiesintermsofquality,quantity,time,andthequalityoftheresultsachieved).Thisindicatorisusedtoensurethatthemostefficientprocesshasbeenadopted.Themeasure ofwhether the project results have been achieved at a reasonable cost from the localpartner’s point of view varied. For instance, in Al-Ma’afer District the local partner stated that the
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
21
SearchforCommonGround|YEMEN
identified budget was insufficient due to the large number of conflicts and problems within thecommunity.Moreover,theInsiderMediatorswerefarfromtheareasinwhichtheyoperated,leadingtotheir allocated expenses being barely enough to cover their transportation costs. Regarding the timededicatedtotheactivities.Inaddition,thelocalpartnerinAl-Ma’aferreportedthattherewasinsufficienttimededicatedtoactivitiesandprojectimplementation.Forexample,thetimededicatedfortrainingwasonlysufficienttoperformtheoreticaltrainingsessions.InAl-Maqaterah,thelocalpartnernotedthatthebudgetwasinsufficientgiventheremotelocations,significanttravel,andfortheneededprojectsupport(suchasprintingmaterialsandadditionalstafftime).
In Toor Al-Baha, the local partner stated that the budget dedicated for training was sufficient butexpresseddissatisfactionregardingthebudgetdedicatedfortheworkteam,giventheeffortandtimethey exerted. Furthermore, transportation allowance was not allocated for the consultant andcoordinator,resultinginthelocalpartnerusingtheirownbusfortransportationneeds.Lastly,thepartnerstatedsaidthattherewasinsufficienttimetocompletetheirtasks.
AccordingtothelocalpartnerinAl-SheikhOthmandistrict,theallocatedbudgetfortheproject’sactivitieswassuitable,exceptforcommunity-basedinterventionswhichrequiredalargerbudgetduetotheirlargerscope.Thelocalpartnerwassatisfiedwiththeprojectdurationandimplementationplan.
The evaluation team interviewed the Search project teammembers to inquire about the reasons forfluctuatingefficiencyinthedeliveryofprojectactivities,andreceivedthefollowingresponses:
● Searchre-announcedsomeofthetendersduetounrealisticquotesreceived,causingdelaysininterventionimplementation.
● Therewasdifficulty inobtainingpermits fromtheSana’aauthoritiesto implementtheprojectthatledtotheexclusionofSana’aandIbbGovernoratesintheproject.
● Search’s teamwasunable to implementCommunity interventionsall atoncedue to financialissueswiththebank(lackofavailablecurrency),whichresultedinsufficientfundstocoordinatesimultaneousimplementation.
● Problemsoccurredwithsomedistrictscoordinatorswhoslowedtheimplementationofactivities,suchasthoseinAl-MaqaterahinLahjGovernorate.
● Theprojectstartedin2015,andevenafterupdatingbudgetslater,inflationcontinuedtoaffectpricingofmaterials,fuel,andbasiccommodities.Duetothis,theallocatedbudgetwasinsufficientandnotflexibleenoughtoadjusttotherealitiesofimplementation.
● TheSearchteamimplementedninecommunityinterventionsthatprovidedthemostbenefitsforamajorityofyoungpeople,orthatserveamajorityofpeopleinthecommunities,withinbudgetlimitations.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
22
SearchforCommonGround|YEMEN
4.3. EffectivenessThissectionintendstoassessthecontributionmadebyresultstotheachievementoftheprojectpurpose,andhowassumptionsaffectedprojectachievements.Thisincludesaspecificassessmentofthebenefitsaccruingtotargetgroups,includingwomenandmenandidentifiedvulnerablegroupssuchaschildren,theelderlyanddisabled
4.3.1. Youth-ledDialoguesTheyouth-leddialogueswereveryeffective inmanyaspectsas they foundproper solutions for long-standingcommunityissues,spreadthecultureofnon-violenceconflictresolutionsthroughdialogueandincreased collaboration and respect between communitymembers. These gains were common in alltargeteddistricts.AccordingtoAnwarAbbas–LocalCouncilMemberfromAl-Maqaterah:
“Theyouth-leddialoguesweregreatastheyidentifiedtheproblemsthatthecommunityissuffering
fromandwantsasolutionforthem,inaddition,thedialoguesfoundpropersolutionsandsuggestionfor
them,moreover,thedialoguesincreasedcollaborationandcoordinationbetweentheyouthasInsider
Mediatorsandthecommunityleadersandthesocietyingeneral”
As shown in Figure 3 above, the respondents agreed for a good extent of the effectiveness of theconducted interventions. Importantly theproject increased theabilityof the targetedcommunities tosolveconflictswithoutviolenceasitwasdifficulttobringtheconflictpartiestogetherononetablefordialogueandreachacommongroundforsolutions.Nowthecommunityexperiencedthenon-violentwayofresolvingconflictsandtheyouthacquiredthedesiredskillstodoso.
“Theconflictscanandthedialoguesessionswithallcommunitymembersandconflictparties’
participationhelpedinidentifyandsolvethecomplaintsandthegrievances
presentedtothelocalauthoritieswhichcouldn’tsolvebecauseofthesecurityandthe
economicsituation”
InsiderMediatorfromAl-ShiekhOthman
Effective
NotEffective 1.0
1.5
2.0
2.5
3.0
3.5
4.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 1 Youth-led Dialogue Effectiveness in Dealing with Community Issues
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
23
SearchforCommonGround|YEMEN
4.3.2. RelationshipAmongCommunityDividingLinesTheprojecthashighly increased thecollaborationamongcommunitymembersasaround98%of thesurvey respondents, as shown in Figure 4 below, expressed the effectiveness of project activities inincreasingthecollaborationamongcommunitydivinglines.
Thispositiveresulthighlightstheeffectivenessoftheprojectwasdespitetheinabilitytoimplementallinterventions.Communityrespondentsclearlyappreciatedthecultureofdialogueandawareness-raisingofnon-violence that thisproject forwarded. Inaddition, theprojectbridged thegap thatwaspresentbetween youth and elders. The InsiderMediators clearly expressed how effective the projectwas inreachingacrosstheyouth-elderdividewithintheircommunities,specificallyacommunicationgapthatwasfeltstronglybyparticipants.AsshowninFigure5below,accordingto96%ofrespondents,cross-generational relationshipshadbeenstrengthenedasa resultof theproject.Moreover, themanner inwhich youth mediators used their accrued skills and navigated the leadership space provided themdemonstratestheirpotentialtoeffectchangeandpositivelyinfluencetheircommunities.
IncreasedCollaboration
NoEffects 1.0
1.5
2.0
2.5
3.0
3.5
4.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 2 Project Increased Collaboration Within Community
Strengthened
Notstrengthened 1.0
1.5
2.0
2.5
3.0
3.5
4.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Youth-ledDialogueProcesses(Scale) Community-basedInitiatives(Scale)
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
24
SearchforCommonGround|YEMEN
However, some results from the evaluation pose a risk to the impact of the overall project. InsiderMediatorsstatedthatthedelayandsuspensionofsomeinitiativesstrainedthetrustthathadbeenbuiltbetweenthemandtheentirecommunity,andnotonlyelders.Furthermore,inAl-ShiekhOthmanInsiderMediators reported thatSearch implemented initiatives in coordinationwith local authoritieswithoutappropriatelyacknowledgingtheirroleasyouthleaders.ThismayhavebeenduetothemoresensitivecoordinationeffortswiththeDistrictDirector,wholaterresigned.
The consequences of not implementing all of the community-based initiatives is also reflected in thesurvey results, as 39% of the total respondents stated that the community-based initiatives didn’tstrengthen the relationship with youth leaders. Digging deeper, 13%, 29%, 35% and 35% of therespondentsinAl-Ma’afer,Al-Maqaterah,Al-SheikhOthman,andToorAl-Baha-respectively-statedthatthe community-based initiatives somewhat strengthened the relationship with youth leaders. Thismoderate levelof satisfaction toward the implementationof community-based initiatives isnot ideal,while4%ofrespondents inToorAl-Bahahadnegativeperceptiontowardcommunity-based initiativesstrengtheningtherelationshipwithyouthleaders.
TotallyAgree
TotallyDisagree 1.0
1.5
2.0
2.5
3.0
3.5
4.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 3 IMs Competency in Reaching Common Ground Among Participants
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
25
SearchforCommonGround|YEMEN
4.3.3. CompetenciesIncreasingandParticipationClear improvements in IMsability to reachcommonground for theaddressedcommunity conflicts inreflectedinFigure6,below.Interestingly,theresultsshowwomenratedatahighercompetencyrateinmanagingdialoguesessionsthantheirmalecounterparts.
Ontheotherhand,womentakeasubstantialburdenoflife'sdifficulties,especiallyinlocalcommunitieswherewomenareconstrainedbydiscriminatorytraditionsandcustoms.Therefore,the importanceofwomen's participation in conflict resolution surely increases the effectiveness of conflict resolutionprocessstages. InsiderMediatorsexpressedthisacrossall targeteddistricts,despitediffering levelsofparticipationanddifficultiesfacedrelatedtoparticipation.InAl-Ma’aferandAl-Maqaterahdistricts,theInsiderMediatorsstatedthatwomenwereveryeffectiveinprojectparticipationevenmorethanmenastheyfoundawaytopresenttheproblemstheyface,provideandimplementwin-winsolutions.
“Iwasabletoendadomesticconflictthatcontinuedfortenyearsbyusingskillslearnedfrom
theproject”
FemaleInsiderMediatorfromToorAl-Baha
4.4. ImpactThissectiontendstomeasuretheeffectoftheprojectonitswiderenvironmentanditscontributiontothewiderpolicyorsectorobjectives.
4.4.1. PerceptionsofKeyInformantPeopleOverall,theKIIssuggestthattheprojecthadanimpactonthetargetedcommunities,specificallyregardingcapacitybuildingforyouth,aswellasprovidingthetargetedcommunitieswithnon-violentapproachestoresolvinglocalconflicts.Inthisregard,oneofAl-Ma’aferdistrictleaders,Mr.AdelAliAbdo-TheGeneralManagerofAl-Ma’aferdistrictstatedthat:
TotallyAgree
TotallyDisagree 1.0
1.5
2.0
2.5
3.0
3.5
4.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 4 IMs Competency in Reaching Common Ground Among Participants
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
26
SearchforCommonGround|YEMEN
“Therewasanimpacttoagreatextent,asoneofthemostimportantimpactsoftheprojectwas
buildingthecapacitiesandtheskillsthatcouldbeusefulinfulfillingthecommunityneedsandsolvethe
conflicts.Inadditiontoenhancingthecultureofdialogueinthecommunityandstrengthenthe
collaborationtidesandunderstandingamongcommunitymembers”.
Moreover,theInsiderMediatorsinAl-Ma’aferdistrictsharethesameperceptionofthepositiveimpactoftheprojectinbuildingthecapacitiesandtheskillsrequiredtosolvecommunityconflicts.Onlyafewnegativecommentswereshared,forinstance,thenon-implementedinitiativesreturnednegativeimpactonthemandtheyfacedsomenegativeaccusations.
InAl-Maqaterahdistrict,theperceptionofcommunitymembers,communityleaders,andlocalauthoritiesontheimpactoftheprojectweremoderate.Fromtheirpointofview,theimplementationofafewofthecommunity-based interventions resulted in decreasing the impact. Insider Mediators are the onlypositivelyimpactedbecauseoftheskillsandcapacitiestheygainedinconflicttransformationanddialoguefacilitation.Mr.EssamAbdo-Al-ShaimaSchoolManagerelaboratedthat:
“Theprojectactivitiessomewhatdidn’tmakeanychangesexceptthecapacitiesandtheskillsacquired
byyouthwhichcouldbeusefulinsolvingcommunityconflicts,butallthathasbeenlearnedweren’t
implementedontheground(referringtocommunity-basedinterventions),therefore,thecommunity
didn’tbenefitafterall.”
Ontheotherhand,theInsiderMediatorsinAl-Maqaterahdistrictexpressedprideinwhattheywereabletodo for their communities. InToorAl-Baha,however, somemediators sharednegative impactsasaresultofnotimplementingtheagreed-uponinitiatives,whichresultedinabreakdownoftrustbetweentheyouthleadersandthecommunity,despitethepositiveimpactofgainingskillsandcapacitiesinconflictresolution. One of the project activities included the installment of water tanks for one of targetedvillages.However, the activitywasnot implementedand that impactednegatively asonlyhalf of thevillagehasawatertankwhichrefusingtosharethewaterwiththeotherhalf.Thisissuecontinuestobemediatedbythelocalyouth,withadditionalfundingbeingsoughtelsewhere.
Nevertheless,inToorAl-Baha,thecommunityexperiencedpositiveimpacts.Indeed,theprojectresolvedaconflictoveragirls’schoolduetothelackofchairs,andresolvedalong-standingconflictovertheclosureofahealthcenter.However,thisimpactneedstobeexpandedtoothervillagesofToorAl-Bahaasthelocalauthorityleaderexpressed.
“Theprojectactivitiesmadeanimpactbutitdidn’treachallthecommunityofToorAl-Baha
district,weneedtoexpandtheprojecttoincludeallvillagestomaketheimpact
inclusiveforallToorAl-Bahadistrict.Thecurrentprojectsupportedonlytwoareas
targetingaschoolandahealthcenteranditdidmakeapositiveimpact”
RoshdiThabet–GeneralmanagerofficeadministratorofToorAl-Baha
InAl-SheikhOthman,theInsiderMediatorsexperiencedapositiveimpactinbuildingyouthcapacitiesinconflictscan,sessionsmanagementandleadingthedialoguestocomeupwithsolutionsandinitiatives.Inaddition,theproject introducedtheyouth leadersasagentsofpeace,effectivelychampioningnon-violentconflictresolutionintheircommunities.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
27
SearchforCommonGround|YEMEN
EventhoughoneoftheimplementedinterventionsinAl-SheikhOthman(installationoflightingunitsinthestreets)broughtanincreasedsenseofsecurity,respondentsexpressedtheirdissatisfactionbecauseSearchdidnotdeliverallcommunity-basedinterventionsidentifiedinthedialoguesessions.Moreover,Searchwasunabletomeetallthecriteriaidentifiedintheproposal:providing50lightsinsteadof123Duetobudgetaryrestrictions.Search’sinsistenceonworkingwithlocalauthoritiesdirectlyduetosensitivitiesregardingtheDistrictDirectorresultedinInsiderMediatorsexpressingtheyfeltby-passedintheprocess..Mr.SameerAli,acommunityleaderinAl-Mahareeqsaid:
“Thefeelingofsecurityandsafetywelivetodaybecauseofthelightingprojectisenough,peoplecomein
andoutsafelyandfreelydespitetheprojectdidn’tcoverallareas,inaddition,theprojectpresentedthe
youthasdependablecommunity-servingleadersandtheylistentothemandgotothemwheneverthere
isaproblem.”
4.4.2. PerceptionsofBeneficiariesOverall,therewasagoodextentofsatisfactionwiththeimplementedinterventions.Approximately93%of the total respondents were satisfied with the delivered activities. Nevertheless, there was adissatisfactionstatedbyaround20%ofrespondentsinAl-Ma’aferandAl-Maqaterahdistricts,asshowninFigure7below.Thisislikelyduetotheinabilitytoimplementallidentifiedinterventions,asstatedintheprevioussections.
Theimpactofthereducedconflictlevelswasmeasuredthroughthesurvey.Resultsshowthattheyouth-leddialoguesplayedakeyroleinsolvingandreducingconflictbyspreadingthecultureofcollaborationanddialogueasaneffectivetooltosolvenonviolentconflicts.AsshowninFigure8below,theresultspresent that 60% of the total respondents perceived the youth-led dialogues strongly helped andimpactedinreducingconflictswithinthecommunity,while36%perceivedthedialoguesassomewhatimpactingthereductionofconflictwithinthecommunity.
Satisfied
NotSatisfied 0.0
0.5
1.0
1.5
2.0
2.5
3.0
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Figure 5 Interventions Satisfaction
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
28
SearchforCommonGround|YEMEN
4.5. SustainabilityThis section assesses the likelihood of benefits produced during the project continuing after externalfundinghasended.
TheInsiderMediatorsexpressedthattheskillsandthecapacitiestheyacquiredwillcontinuetobeusedaslongasthecommunityisinneedfortheirinterventions.Inaddition,theylookforwardtodevelopingthese skills and capacities to continue benefiting the community. In addition, the youth mediatorsappreciate their new social positions acquired whilst becoming community Insider Mediators. Forinstance, theyouth leaders inAl-Ma’aferdistrictcontinuetoplay their role insolvingconflictwithoutviolenceevenaftertheprojectended.For instance,theysolvedadisputebetweenbrothersoverlandrights,aswellassolvinganotherconflictoverlandinheritancewhenmalemembersofthefamilyrefusedtogivetheirsisterstheirshareoftheinheritance.AnotherexamplewasexhibitedbyAl-ShiekhOthmanyouthleaderswhocollectedrequiredfundsfromtraderstomakeatemporarywall(ironnet)tolimittheconflictduringdelaysfacedininterventionimplementation.
Indeed,severalaspectsoftheprojectappeartocontributetothelong-termsustenanceofprojectresults.AccordingtotheInsiderMediators,sustainableresultsincludefurthercollaborationbetweenthemselvesandthelocalauthorities,alongwiththecommunityleaders,suchasholdingperiodiccommunitymeetingsto pro-actively address divisive issues and brewing conflicts. Also, they suggested the creation of acooperativemechanismthatwouldgatheryouth,localauthorities,andcommunitymemberstocontinuesensitizationeffortsontheimportanceofdialogueandnon-violence.
Regarding local partners, most stated that they will continue the project’s work using voluntarycontributionsfromlocalcommunities,eithermonetary,time,ormaterials,tohelpmediatorsimplementfuture dialogue results. For example, the local partner in Al-Ma’afer stated that theywould continuetrainingyouthleadersonconflictresolutionanddialoguemanagement.InAl-Maqaterahthelocalpartnerplans to continue implementing community-based initiatives and actively seeking funds fromhumanitarian organizations in order to implement such activities alongside the continuation of
HelpedinReducingConflicts
Didn'tHelpinReducingConflicts
1.00
1.50
2.00
2.50
3.00
3.50
4.00
Female Male Female Male Female Male Female Male
Al-Mafeer Al-Maqatirah SheikhOthman ToorAl-Baha
Youth-led(Scale) Communitybased(Scale)
Figure 6 YLDs & CBIs Helped in Reducing Conflict
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
29
SearchforCommonGround|YEMEN
performingcommunitydialoguesandmeetingsondistrictandgovernorate level. InAl-SheikhOthmanandToorAl-Baha,localpartnersstatedthattheyhaveatotalnumber44(22inAl-SheikhOthmanand20in ToorAl-Baha) of female andmale youth leaders trained and able to identify conflicts andmanagedialoguesessionsthattheywillingtocontinueworkingwiththem.
5. ProjectIndicators
The following table summarizes the project’s outcome indicators that were measured and recordedthroughoutthelifeoftheproject.
Table1:TableShowingProjectOutcomesbyIndicator
Achievedin theProject
ProjectTarget
Commentson
%ofTargetAchieved
ProjectGoal:Toenhanceyouthleaders’roletotransformconflictwithoutviolence.
% of surveyed community stakeholders whobelieve that youth are helping to reduceviolenceintheircommunities.
66%
65% Targetmet
This result according to 206personsfromlocalcommunitieswho were surveyed. Also,secondary sources whichincluded FDGs and KII withInsider mediators, localauthorities,communityleaders,indicatedthattheyouthleaders(Insider Mediators) helped inreducing violence in thetargetedcommunities.
Objective1:Youthleaders’capacityinconflictanalysisandconflicttransformationisstrengthened.
1. Thenumberof youthparticipantswhohaveacquired the necessary skills to facilitatedialogue around conflict and potential forpeacebuilding.
87 70 Targetedsurpassed
ExpectedResult 1.1:Youth leaders in eachof the target governorates areequipped to analyze conflictdynamics,conflicttriggers,andidentifyopportunitiestotransformconflict.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
30
SearchforCommonGround|YEMEN
1.1.1. The number of people participating inUSG supported events, trainings, or activitiesdesigned tobuildmass support forpeaceandreconciliation(referencePS6.2-4).
82 80+ Targetmet
1.1.2. Number of USG supported events,trainings,oractivitiesdesignedtobuildsupportforpeaceorreconciliationamongkeyactorstotheconflict(referencePS6.23).
4 4 Targetmet
ExpectedResult1.2:Youthleadersinthetargetgovernoratesimplementsuccessfulinitiativestorespondcollaborativelytoconflict
1.2.1.Thenumberofpeacebuildingandstabilityinitiativesimplementedbyyouthleaders.
09 20+ Target not met due to budgetrestrictions.
1.2.2.Thenumberofnewgroupsor initiativescreated through USG funding, dedicated toresolving the conflict or the drivers of theconflict(referencePS6.2-1).
24 20-24 Targetmet
Objective 2: Collaboration among youth leaders and between youth and elders across dividing lines isstrengthened.
2. Percentageofyouthparticipantswhoreportincreased collaboration within their localcommunitiesacrossdividinglines.
60% 60% Targetmet
Most survey’s respondents, KIIand FGDs intervieweesindicated that healthyrelationships amongst youthparticipantsandbetweenyouthand elders are created acrossdividing lines and withstakeholders at a local andnationallevel.
ExpectedResult2.1:Healthyrelationshipsamongstyouthparticipantsandbetweenyouthandeldersarecreatedacrossdividinglinesandwithstakeholdersatalocalandnationallevel.
2.1.1.Percentageofyouthandlocalcommunitystakeholders who report improvedunderstandingofsuccessfulapproachestolocallevelpeacebuildingefforts.
50%
60% Targetnotmet
Insider Mediators during FGDsindicated that there was animproved understanding ofpeacebuilding efforts. Theybelieve that cooperation withcommunity elders and othercommunityinformalleadershas
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
31
SearchforCommonGround|YEMEN
increased due to Search’sprojectactivities.However,dueto the reducing of the numberofcommunity-based initiatives,community leaders and localauthority during KII reporteddecreasing in trust to InsiderMediatorsandtheirefforts.
ExpectedResult2.2:Lessonslearnedonyouth-ledpeacebuildingeffortsaresharedacrossthesedividinglinesandwithstakeholdersatalocalandgovernoratelevel.
2.2.1. The number of USG funded events,trainings,oractivitiesdesignedtobuildsupportfor peace or reconciliation on amass scale (FreferencePS.6.2-2).
2 2 Targetmet
2.2.2. Number of participants taking part inonlineexchanges
104 36 Targetsurpassed
TherearethreeWhat’sgroups:1- What’sup group for Al-Ma’afer and Al-MaqatirahInsiderMediatorsinadditiontosomecommunityleaderswhichare60.
2- Toor Al-Baha groupcomposedof20.
3- Al-Shiekh Othman groupmade of 24 Insider Mediatorplusotheryouthleaders.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
32
SearchforCommonGround|YEMEN
6. Conclusions
ThankstoSearch’scontextualknowledgeandbaselinestudycarriedoutatthebeginningoftheproject,theactivities,andthemesoftheprojectrespondedwelltothecommunity’sneeds.Themainstrengthoftheprojectliesintargetingyouthasprimarybeneficiariesand,buildingtheircapacitiestobepotentialactorsofconflicttransformation.Thefinalevaluationconfirmedtherelevanceoftheproject,whichhasinvestedinyouthbyinvolvingtheminalltheproject’sactivities.Ontheotherhand,theInsiderMediators,who participated in focus group discussions, lamented the limited of engaging them in deliveringcommunity-based interventions, as well as the non-implementation of all 24 community-basedinterventions,whichremainthemostimportantactivityforlocalcommunitiesintheproject.
Thestudyfoundthattheprojectachieveditsoverallgoalofenhancingyouthleaders’role(ages20to35)to transformconflictwithoutviolence in the four targeteddistricts;Al-Ma’afer,Al-SheikhOthman,Al-Makaterah,andToorAl-Baha.Inaddition,theevaluationdeemsthatthemajorityoftheresults/outcomeswere achieved despite some of the activities not fulfilling their full quota. Furthermore,most of theevaluationrespondents,inparticularInsiderMediators,highlightedthepositiveelementsoftheprojectand how the project directly affected their knowledge and skills and understanding for a peacefulenvironmentthroughmediationanddialogue,asopposedtoresortingtoviolence.Ithasnotonlybecomeanalternativetoviolencebutisnowconsideredthebesttooltousewhendealingwithanyconflictwithinthecommunityandinthefamily.Similarly,mostofthesurveys,KIIsandFGDsrespondentsbelievethattheprojectresultedinapositiveimpactingeneral.However,theimpactonalargerscaleoftheseactionsisnotguaranteedduetolackofaplanforsustainability.
To sum up, the project has strengthened the capacity of young people in conflict management andsensitizedalargenumberofyoungpeopleonnon-violenceandCommonGroundapproach.Ithasalsocontributedtocreatingnewplatformsofdialoguebetweenyouth,theelderandcommunityleaders,aswellasreducingthegapbetweenthem.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
33
SearchforCommonGround|YEMEN
7. Recommendations
● AmorerobustinternalandexternalcommunicationsystemneedstobeputinplaceatSEARCHandbetweenSEARCHandthepartnersandtargetbeneficiaries,especiallywithregardstoanycommunity interventionsnotbeingable tobe implemented. It is important toensure thatallrelevant persons are communicated towith regards to any changes,whichwill influence theeffectivenessoftheimpactoftheproject.
● SEARCH should enhance the project ownership of the local partners through providing ToTtraininginconflicttransformationandmediationtotheimplementingpartners’personnelsothelocalpartnerscangivethetrainingfortheinsidermediators.Inthisproject,thelocalpartnerorganizations had mainly a logistical role. If the partner organizations had more ownership,sustainabilityandqualityoftheperformancewoulddramaticallyincrease.
● SEARCHshouldfocusitseffortsonencouragingmorefemaleparticipationinalltheproject’s
activities.SEARCHneedstocontinuecommunicationwithlocalNGOs,localauthoritiesandlocalcommunitiesabouthownecessarytheparticipationofwomenis,andrelevanttotheworkthattheyplantodotogether.Thistypeofdialogueandnegotiationongendermainstreamingneedtooccuratthebeginningoftheproject.SEARCHshouldknowandunderstandthestakeholdersandtheircontexttopreparesuitablemeansofpersuasion.Forexample,conductacampaigntolocalcommunitiesabouthowtoengagemorewomenintheprojectorholddiscussionmeetingswith local authorities and local partner organization on how to involve more women in theproject’sactivities.
● Thisfinalevaluationtookplacebeforeorduringtheimplementationofsomecommunity-based
interventions,sofollowupactivitiesneedtobeensuredtomeasuretheimpactoftheproject.Theseneedtobepracticalandtofindwaysofconnectingdifferentlocalcommunitieswithotherstoensurethattheprojecthasaspillovereffectonthetargetedcommunities.
● Anewextension/projectwillbeneededtocontinueimplementingallcommunityinterventionsthatwereproposedduringthecommunitydialogues.Thenewextension/projectwillrequiretheassurancesofastrongerfinancialsystemtobeinplaceatSEARCHtoensureregularcashflowtotheimplementingteamsofSEARCHandthepartners.Thesequenceindeliveringactivitieswillprevent the gap between conducting the community dialogues and the implementation ofcommunity interventions. As a result, local communities will no longer get angry nor lostconfidenceintheInsiderMediatorsaswellasSEARCH.Also,thenewextension/projectwillregainthetrustandconfidenceofthecommunities,andnewbridgeswillbebuilt.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
34
SearchforCommonGround|YEMEN
8. Annexes
Annex1:TermsofReferences
FinalEvaluation:AFutureCalledPeace1.ContextOrganizationalBackground:SearchforCommonGround(SEARCH)workstopreventandendtheviolentconflictbefore,during,andafteracrisis.SEARCHhasa33-yeartrackrecordofequippingindividualsandsocietiestofindalternativestoviolence.Westrivetobuildsustainablepeaceforgenerationstocomebyworkingwithallsidesofaconflict,providingthetoolsneededtoworktogether,andfindingconstructivesolutions.Ourmissionisto transform the way the world deals with conflict, away from adversarial approaches and towardcooperativesolutions.Insteadoftearingdownanexistingworld,wefocusonconstructinganewone.Wedo this through a type of peacebuilding called “conflict transformation.” We shift the everydayinteractionsbetweenhostilegroupsofpeople,sotheycanworktogethertobuilduptheircommunity,choosingjointproblem-solvingoverviolentmeans.SEARCH’smissioninYemenistopromotethecultureof dialogue and diversity through the involvement of all the components of the society, and whilereinforcing their capacities. SEARCHYemen isworkingduring theongoing conflict tohelpmembersofYemeni societyapproachconflictsanddifferences inaconstructivemanner, throughcooperationanddialogue.SEARCHYemeniscurrentlyoperationalinmanygovernoratesandmaintainsawideandrobustrelationshipnetworkoflocalcivilsocietyorganizations.
ProjectSummary:Theoverallgoalof theproject is toenhanceyouth leaders’ role (ages20 to35) to transformconflictwithout
violence.Inordertoachievethatgoal,theprojecthastwospecificobjectives:•Objective1:Youthleaders’capacityinconflictanalysisandconflicttransformationisstrengthened.• Objective 2: Collaboration among youth leaders and between youth and elders across dividing lines is
strengthened.TheoryofChange:Thisproposedprojectisbasedontwocomplementarytheoriesofchange:
1. TheInside-Outtheoryofchange,specificallythecommoncomplexidentitiestheory.Thisstatesthatifkeyactorsand/orenoughindividualsonallsidesoftheconflictdiscoversharedvaluesandmultifaceted complex identities, including constructive in group self-esteem, then inclusivebroader"valueidentities"thatunitegroupswillform.
This theoryof change reflects thedegree towhichnational identitiesareunderminedbypressure toidentify more strongly with a tribe, clan, religion, caste, region, or cultural background. Thisprojectseekstoenabletheyouthleaderstofindvalueindiversity,recognizingcommoninterestsdespitetheirdifferences,firstlywithintheirgovernorateandthenwithyouthleadersfromothergovernorateswithcontrastingidentityprofiles.Thischangewillthussupportconstructiveconflictengagementandstrengthenresiliencytonegativemanipulationandviolentactionbyone'sowngroup.
2. TheHealthy Relationships theory of change, specifically the community-based peacebuildingtheory.This states that ifbelligerentgroupswithina communityaregiven theopportunity tointeract,thentheywillbetterunderstandandappreciateoneanotherandwillprefertoresolveconflictspeacefully.
Thistheoryofchangefocusesonthestrengthoftherelationshipsbetweentheyouthleaders,butalsobetweenthemandtheoldergenerationofleaders,elders,andgovernmentofficials.Theprojectsoughttotransformthisrelationshipfromoneofmistrust,prejudice,andadversarialapproaches
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
35
SearchforCommonGround|YEMEN
towardonerootedincommoninterests.Asthehealthoftherelationshipbetweenthesegroupsimproves,thelikelihoodofviolencebetweenthemdeclines.
Theprojectactivitiesare:1- BaselineAssessment.2- LocalPartnersPartnerships.3- IdentifyYouthLeaders4- YouthCapacityBuildingTraining5- Youth-ledConflictScans6- Mid-termEvaluation7- YouthPeacebuildingDialogueDesignTraining8- Youth-ledDialogueProcesses9- Community-basedInitiatives10- Regional-levelMeetings
2.Objectivesoftheevaluation:SEARCHasanorganizationiscommittedtoconductingevaluationsforprojectsinordertomaximizetheeffectivenessofitsprogrammingandengageincontinuousimprovementandlearningwithinprogramsandacrosstheorganizations.TheSEARCHapproachtoevaluationsisgroundedintheguidingprinciplesofitswork:participatory;culturallysensitive;affirmingandpositivewhilehonestandproductivelycriticalandvaluingknowledgeandapproachesfromwithinthecontext.SEARCHwillapplythisapproachtotheevaluationofthisproject,whichwillbecarriedoutinconsultationandinparticipationwithkeyrelevantstakeholders,appropriatecommunitygroupsorkeycivilsocietyindividuals.Theevaluationobjectiveswillfocusonthefollowing:1.Evaluatetheproject'sperformanceintermsofachievingitsobjectivesandexpectedresults;2.Evaluatetheimplementationofthemainactivitiesoftheproject;3.Evaluateproceduresandprocessesforsettinguptheprojectasdescribedintheprojectproposal;4.Evaluatechangesassignedtotheprojectandlessonslearned;
5.Documentlessonslearnedandprovidepracticalrecommendationsforbetterdesignandimplementation,aswellasrecommendationsontheidentificationoffuturepriorityareas;
6.Identifythedifficultiesencounteredduringtherealizationoftheproject.
3.Evaluationcriteriaandkeyevaluationquestions:ThepurposeoftheevaluationistoprovideanindependentassessmentontheaddedvalueoftheSEARCHinterventions in Yemen, taking note of beneficiary perspectives, and of the effectiveness, efficiency,impact,andsustainabilityoftheimplementedproject.Resultsoftheevaluationandlessonslearnedwillcontributetodesigningamethodologyforpreventinginter-communalconflictandpromotinglocalsocialcohesionthatcanbereplicatedonalargerscalebeyondthisspecificproject.The evaluation is based on theOECD-DAC peacebuilding Evaluation Criteria (relevance, effectiveness,impact,efficiency,andsustainability),investigatingtheirsetofquestions,andutilizingand/oraddressingtheperformanceindicatorsdescribedintheprojectdocument.Relevance:
● Towhatextentdidthisprojectrespondtothetargetedcommunityneedsandexistingissues?● Whatistherelevanceoftheinterventionsasperceivedbybeneficiariesandstakeholders?● How relevant were the instruments (Insider Mediators’ training, conflict scans, community
dialoguemeetings, and community initiatives) dedicated during the project to transform theconflictorthedriversoftheconflict?
Effectiveness:● Towhatextentwastheprojectsuccessfulinachievingitsstatedgoal?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
36
SearchforCommonGround|YEMEN
● Towhatextentwas theprojectsuccessful inachieving its statedobjectives,1)Youth leaders’capacityinconflictanalysisandconflicttransformationisstrengthened.2)Collaborationamongyouthleadersandbetweenyouthandeldersacrossdividinglinesisstrengthened?
● TowhatextentwastheprojecteffectiveinprovidingInsiderMediators’trainingwiththeskillsandcapacitiesneededtoenhanceyouths’engagementtotransformconflictwithoutviolence?
● To what extent did the various project activities contribute to the achievement of projectobjectives?
● Whatwerethemajorfactorsinfluencingtheachievementornon-achievementoftheobjectives?● Whatwerethemajorprojectresultsandlessonslearned?
Efficiency:● Doestheprojectdeliveritsoutputsandobjectivesinanefficientmanner(resultsagainstcosts)?● Wereactivitiescost-efficient(resourcesappliedresults)?
Sustainability:● TowhatextentaretheobjectivelyverifiableresultssustainablebeyondSEARCHorUSAIDsupport,
disaggregatedbygender,age,andlocation?● Whatcouldhavebeendonedifferentlysotheprojectbecomesmoresustainableinthefuture?● Havenewmechanismsbeendesignedtocontinueanyworkinitiatedbythisproject?Ifyes,will
theinitiativessustainpost-project?Impact:
● Whatarethebroaderchanges,positiveornegative,intendedorunintended,oftheinterventionsinthecontext?Towhatextentarethesechangesdesirable?
● What changes canbe ascertained in attitudes, behaviors, and relationships as a result of thecommunitydialoguesessionsandmediationactivities?
● Whatcouldhavebeendonedifferentlytomaketheprojectbeofhigherquality,greaterimpact?Thiswill include lessons learned,projectmanagementand implementation,andworkingwithyouthwithinlocalcommunities.
● Capture and/or incorporate success stories, when applicable – that have been the mostsignificantchangesasaresultoftheprojectinterventions?
Inadditiontotheabovelinesofinquiry,theEvaluationisexpectedtoprovideinformationagainstthekeyindicatorsaslistedintheprojectlogframe.4.Scope:The final evaluation will investigate principal target groups: CSO actors, youth and local communityrepresentativesinthetargetgovernorateslistedbelow:Governorate DistrictTaiz Al-Ma’aferLahj ToorAl-BahaandAl-MaqatirahAden SheikhOthman
The evaluation sample should adequately cover the project target area and be representative of thecommunitystructure.5.Methodology:Theevaluationwillemploybothquantitativeandqualitativeparticipatorymethods.Bothquantitativeandqualitative data will be analyzed with gender, age, and location disaggregation. The qualitative andquantitativefindingsareexpectedtobesynthesizedinaccordancewiththeprojectindicators.Thesamplingmethodologyforthetoolsand/orinstrumentswillbedesignedbytheconsultant,referringtotheproject’sRMPandincoordinationwithSearch-Yemen’sProjectManager,DMEManager,andthe
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
37
SearchforCommonGround|YEMEN
RegionalDMESpecialist. Thesamplingmethodologyshouldincludeatleast30%femaleinthesamplesizeoftheevaluationtorepresentthefemalebeneficiaries.
Furthermore,aspartofthedatacollectionandanalysisprocess,theconsultantisrequiredtorespectthefollowingEthicalPrinciples:
- Comprehensiveandsystematicinquiry:Consultantshouldmakethemostoftheexistinginformationandafullrangeofstakeholdersavailableatthetimeofthereview.The consultant should conduct systematic,data-based inquiries.Heorsheshouldcommunicatehisorhermethodsandapproachesaccuratelyandinsufficientdetailtoallowotherstounderstand,interpretandcritiquehisorherwork.Heorsheshouldmakeclearthelimitationsofthereviewanditsresults.
- Competence: Consultant should possess the abilities, skills, and experienceappropriatetoundertakethetasksproposedandshouldpracticewithinthelimitsofhisorherprofessionaltrainingandcompetence.
- Honesty and integrity: Consultant should be transparent with thecontractor/constituent about any conflict of interest, any changemade in thenegotiatedprojectplanandthereasonswhythosechangesweremade,andanyrisk that certain procedures or activities produce a misleading review ofinformation.
- CultureSensitivity:Consultant respects thesecurity,dignity,andself-worthofrespondentsandprogramparticipants.Theconsultanthastheresponsibilitytobesensitivetoandrespectdifferencesamongstparticipantsinculture,religion,gender,disability,age,andethnicity.
AllthedataproducedbythisstudybelongsexclusivelytoSearchandallremainingcopiesofthedatawillbeasthefollowingdeliverables:
● A final evaluation plan (Inception Report) detailing a proposed methodology and writtenevaluationtoolsandcoverthefollowing:
- Inclusiveness—the methodology should include a wide range of viewpoints,specificallygenderandage-sensitivity.
- Mixed-methodapproaches—bothqualitativeandquantitativemethodsneedtobepresentinthemethodology.
- The rigor of the evidence-based approach and methodology—gatheredinformationneedstobereliableandtransparent.
- Ethics - themethodologyneeds to considerethics inorder toensure that theevaluationisfullyobjective.
● Datacollectionandoversightofthedatacodingprocess.● AfirstdraftofthefinalevaluationreportforreviewbySEARCHstaffandotherstakeholders.● Afinalevaluationreport(40-45pagesinlength)thatconsistsof:
- Tableofcontents-Executivesummaryofkeyfindingsandrecommendations–nomorethan3pages.
- Researchfindings,analysis,withassociateddatapresented,whereappropriateincleargraphsorcharts.
- ConclusionandRecommendationsforfutureprojectimplementation.- Appendices, which include a detailed description of the methodology with
research instruments, list of interviewees, bibliography, and evaluator(s) briefbiography.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
38
SearchforCommonGround|YEMEN
- Twoboundhardcopiesandsubmittedinelectronicform.● ThefullreportshouldbeinEnglish.● Therawdatacollectedfromthefield.● SEARCHmayexerciseeditorialcontroloverthefinalreport.●
6.Duration&Deadlines:Thedurationofthecontractwillbeatotalperiodofsevenweeksstartingfromthetimeofsignature.Specificdateswillbeagreeduponatthebeginningoftheconsultancy.7.LogisticalSupport:SEARCHwillprovidepreparatoryandlogisticalassistancetotheevaluator,whichinclude:
● Backgroundmaterialsfordeskreview(projectproposal,meetingnotes,reports,etc)● Communicationthroughphone,email● QuantitativeandqualitativedocumentationcollectedandgatheredbySearch● Interviewees(andtheircontactinformation)● Technicalassistance● Meetingarrangementswithstakeholdersandbeneficiaries
8.TeamMembers:TheevaluationwillbeconductedbyanindividualorafirmmanagedbytheevaluationfocalpointpersonatSEARCH-YemenandsupervisedbyMENADM&Especialist.Theevaluatorwilltraveltothepreviouslymentionedgovernorates toconduct thiswork. The finalwritingof thedeliverablescanbeconductedexternallytothearea.9.RequirementsofConsultant/Firm:SEARCHseeksanexperiencedevaluatorwiththefollowingqualifications:
● MinimumBachelor’s leveldegreeinconflictresolution, internationalrelations,arelatedsocialsciencefieldorstatistics.
● ProficiencyinArabicandEnglish.● More than 5 years of experience in project evaluation or the equivalent in DM&E expertise,
includingcollectingdataininterviews,surveysandfocusgroupsdiscussion.Evaluationmethodsanddatacollectionskills,particularlyinactiveorpost-conflictcontexts.
● Experienceinpeacebuildingorconflictresolution.● UnderstandingofandexperienceinYemen.● Strongcommunicationandwritingskills.● Understandingofandexperienceworkingwithcivilsocietyorganizations.● Abilitytobeflexiblewithtimeandworkschedule.
10.HowtoApply:Toapply,SearchYemeninvitesallinterestedandqualifiedcandidates(individualsorteams)tosubmitthefollowingdocuments:
● Curriculumvitae● Aletterofinterest,indicatingclearlyhowtheirexperiencemeetsdesiredqualifications● Shortbiography(ies)ofthecandidate(s).● Atechnicalproposalproposingamethodologyfortheevaluation● Afinancialproposalforthecompletionoftheaforementioneddeliverables.● Acopyofoneevaluationconductedbythecandidate(s)inEnglish.
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
39
SearchforCommonGround|YEMEN
● 2referencescontactdetails.
Annex2:FinalEvaluationMatrix
ThefollowingevaluationmatrixaddressedtheDACcriteriaandtheindicatorsintheprojectlog-frame.
Relevance: The appropriateness of project objectives to the problems that it was supposed to address, and to the physical and policyenvironmentwithinwhichitoperated.Itshouldincludeanassessmentofthequalityofprojectpreparationanddesign–i.e.,thelogicandcompletenessoftheprojectplanningprocess,andtheinternallogicandcoherenceoftheprojectdesign;extenttowhichtheprojectisinlinewithstrategicprioritiesunderwhichtheprojectwasfunded
Main-Questions Sub-Questions Methods DataSourcesTo what extent did this project respond to the targetedcommunityneedsandexistingissues?
● How was thetraining receiveduseful to you andyour community?Pleaseexplain
● Explain how relatedthetrainingreceivedto your needs andcapacities tomanage andconduct Youth-ledDialogue Processesand Community-basedInitiatives.
● Are there otheractivitiesthatshouldhave been includedintheproject?
● Are there otherpersons ororganizations orgroups of personsthat should havebeen or should be
survey,Key informantinterviews(KII),Focus group discussions(FGD)
partner Civil SocietyOrganizations(CSO),youth leaders (InsiderMediators),targeted communities’members and leaders,localauthorities,SEARCHprojectstaff
What is the relevance of the interventions as perceived bybeneficiariesandstakeholders?
How relevant were the instruments (Insider Mediators’training, conflict scans, community dialogue meetings, andcommunity initiatives) dedicated during the project totransformtheconflictorthedriversoftheconflict?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
3
SearchforCommonGround|YEMEN
moreinvolvedintheproject?
● How are theoutcomes of theproject relevant tothe current contextregarding theconflict in thetargetedcommunities?
● Is there anythingelse that could bedone to make thisproject morerelevant to theconflict context inthe targeteddistricts?
● Did women haveany role in conflicttransformationduring the projectwithin thecommunity?
Efficiency:Thefactthattheprojectresultshavebeenachievedatareasonablecost,i.e.,howwellinputs/meanshavebeenconvertedintoactivities, in terms of quality, quantity and time, and the quality of the results achieved. The generally, requires comparing alternativeapproachestoachievingthesameresults,toseewhetherthemostefficientprocesshasbeenadopted.
Main-Questions Sub-Questions Methods DataSourcesDoes the project deliver its outputs and objectives in anefficientmanner(resultsagainstcosts)?
● How efficient andtimely has thisproject beenimplemented and
documentsreview,KII
SearchProjectstaff
Wereactivitiescost-efficient(resourcesappliedresults)?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
4
SearchforCommonGround|YEMEN
managed under theProjectproposal?
● Did the budget
amount wasefficient accordingto the number ofbeneficiaries? Howorwhy?
● What were theconstraints thatcaused to delays inachieving theactivities?
Effectiveness: Anassessmentof the contributionmadeby results to theachievementof theprojectpurpose, andhowassumptionshaveaffectedprojectachievements.Thisshouldincludeaspecificassessmentofthebenefitsaccruingtotargetgroups,includingwomenandmenandidentifiedvulnerablegroupssuchaschildren,theelderlyanddisabled
Main-Questions Sub-Questions Methods DataSourcesTo what extent was the project successful in achieving itsstatedgoal?
● How effective werethe Youth-ledDialogue Processesand their resultinginterventions inincreasingcommunityresilience toconflict? ExplainWhy/Whynot?
● Do you think thatthe projectincreases the abilityof the targeted
survey,KII,documentsreview,FGD
partner Civil SocietyOrganizations(CSO),youth leaders (InsiderMediators),targeted communities’members and leaders,localauthorities,SEARCHprojectstaff
To what extent was the project successful in achieving itsstated objectives, 1) Youth leaders’ capacity in conflictanalysis and conflict transformation is strengthened. 2)Collaborationamongyouth leadersandbetweenyouthandeldersacrossdividinglinesisstrengthened?TowhatextentwastheprojecteffectiveinprovidingInsiderMediators’ trainingwith the skills and capacities needed toenhance youths’ engagement to transform conflict withoutviolence?Towhatextentdidthevariousprojectactivitiescontributetotheachievementofprojectobjectives?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
5
SearchforCommonGround|YEMEN
Whatwerethemajorfactorsinfluencingtheachievementornon-achievementoftheobjectives?
communities tosolve conflictwithout violence?Explain why/whynot?
● Do you feel thatactivitiescontributedsignificantly to theproject’s overallgoals? Why or whynot?
● Are womensufficiently involvedin the projectactivities? If no,why?
● What would yousuggest is the mostsignificant orappropriate of(training, dialogueprocess, communityinitiatives) theproject hasachieved?Why?
● Haveall thespecificobjectives andplanned outcomesbeen achieved? Ifno,why?
● To what extent doyou think that thereceived training
Whatwerethemajorprojectresultsandlessonslearned?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
6
SearchforCommonGround|YEMEN
provided you withappropriate toolsand skills to solveconflicts?
● What are the keylessons learnedfromtheproject?
● Doyouknowofanystories– that havebeen the mostsignificant changesas a result of theproject? Can youmention some ofthe other conflictsthat have beensuccessfullyaddressedusing theproject mechanismswithout the projectinterventions?
● what were thechallenges facedachieving theproject objectiveseffectively?
● To what extent theproject contributesto improvedcollaborationamong youth andelders?Ifso,didthisimprovedcollaboration
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
7
SearchforCommonGround|YEMEN
contribute to anyimprovements inconflicttransformation inyour district?Provideexamples
Impact:Theeffectoftheprojectonitswiderenvironment,anditscontributiontothewiderpolicyorsectorobjectives
Main-Questions Sub-Questions Methods DataSourcesWhatarethebroaderchanges,positiveornegative,intendedorunintended,ofthe interventions inthecontext?Towhatextentarethesechangesdesirable?
● Do you think thatthis project makeschanges (has animpact) to thecommunity? Yesorno, if yes, explain,please?
● To what extent doyouthinktheimpactof this project willsustain or remainafter theendof theproject?
● How was yourpersonal experiencein participating intheproject?
● What are somesignificanthighlightsofwhatyoulearnedfromtheproject?
● Givemeanexampleof how the projectimpactedyourlife.
survey,KII,documentsreview,FGD
partner Civil SocietyOrganizations(CSO),youth leaders (InsiderMediators),targeted communities’members and leaders,localauthorities,SEARCHprojectstaff
Whatchangescanbeascertainedinattitudes,behaviors,andrelationshipsasaresultofthecommunitydialoguesessionsandmediationactivities?Whatcouldhavebeendonedifferentlytomaketheprojectbeof higher quality, greater impact? This will include lessonslearned, project management and implementation, andworkingwithyouthwithinlocalcommunities.Captureand/orincorporatesuccessstories,whenapplicable–thathavebeenthemostsignificantchangesasaresultoftheprojectinterventions?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
8
SearchforCommonGround|YEMEN
● Are there particularaspects of theproject that youbelieve was doneverywell?
● Has the level ofcommunicationbetween youthleaders and eldersimprovedduringthepasteightmonths?
● Are young peopleable to share theirconcerns and ideaswith the localauthorities?
Sustainability:Anassessmentofthelikelihoodofbenefitsproducedbytheprojecttocontinuetoflowafterexternalfundinghasendedandwithparticularreferencetofactorsofownershipbybeneficiaries,policysupport,economicandfinancialfactors,socio-culturalaspects,genderequality,appropriatetechnology,environmentalaspects,andinstitutionalandmanagementcapacity.
Main-Questions Sub-Questions Methods DataSourcesTo what extent are the objectively verifiable resultssustainablebeyondSEARCHorUSAIDsupport,disaggregatedbygender,age,andlocation?
● How are you goingto apply theknowledge yougained from thetraining to yourcommunity? Canyou provide anexample?
● Are there any plansand or strategies tosustain the gainsmade in youth andcommunities aftertheproject?
survey,KII,documentsreview,FGD
partner Civil SocietyOrganizations(CSO),youth leaders (InsiderMediators),targeted communities’members and leaders,localauthorities,SEARCHprojectstaff
What could have been done differently, so the projectbecomesmoresustainableinthefuture?
Havenewmechanismsbeendesignedtocontinueanyworkinitiatedbythisproject?Ifyes,willtheinitiativessustainpost-project?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
9
SearchforCommonGround|YEMEN
● How effective werethe exit strategies,and approaches tophaseoutassistanceprovided by theproject, includingcommunityinitiatives?
● Do you think thebenefits of theinterventions arelikely to continueafterSearchfundinghas beenwithdrawn?Canyoumention some ofthe other conflictsthat have beensuccessfullyaddressed withoutthe projectinterventions?
Annex3:EvaluationTools
Keyinformativeinterview(KII)forSearchprojectstaff
DateofInterview DayofInterview Time of Starting theInterview
Time of Finishing theinterview
NameofInterviewer:IntervieweeName InterviewPlace
Gender MaleFemale
Person withdisability
Yes
No
IntervieweeStatusCitizenInternallydisplacedperson(IDP)Refugee
Job/Capacity PhoneNumber
Questions:1. Towhatextentdidthisprojectrespondtothetargetedcommunityneedsandexistingissues?2. Arethereotheractivitiesthatshouldhavebeenincludedintheproject?Whatandwhy?3. Arethereotherpersonsororganizationsorgroupsofpersonsthatshouldhavebeenorshould
bemoreinvolvedintheproject?Whoand/why?4. How efficient and timely has this project been implemented andmanaged under the Project
proposal?5. Didthebudgetamountwasefficientaccordingtothenumberofbeneficiaries?Ifyeshowwas
that?6. Towhatextentwastheprojectsuccessfulinachievingitsstatedgoalandplannedobjectives?7. Arewomensufficientlyinvolvedintheprojectactivities?Ifno,why?Ifyeshow?8. Whatwould you suggest is themost significant or appropriate of (training, dialogue process,
communityinitiatives)theprojecthasachieved?Why?9. Havetherebeenunforeseenresultsorunforeseenbeneficiaries?Ifyes,why?10. Doyouthinkthatthisprojectmakeschangessuchincreasecommunity-levelsocialcohesionand
communityidentifyingandresolvinggrievances?Yesorno,ifyes,explain,please?11. Inyouropinion,whatwerethemajorachievementsoftheproject?12. Whatwerethemajorfactorsinfluencingtheachievementornon-achievementoftheobjectives?13. Areyouawareofnewmechanisms thatbeendesigned to continueanywork initiatedby this
project?Ifyes,whatarethey?Willtheysustainpost-project?14. Arethereanyplansandorstrategiestosustainthegainsmadeinyouthandcommunitiesafter
theproject?Ifyes,whatarethey?15. Whatcouldhavebeendonedifferentlysotheprojectbecomesmoresustainableinthefuture?16. Aretheresuccessstoriesthathavebeenthemostsignificantchangesasaresultoftheproject
interventions?Whatcouldhavebeendonedifferentlytomaketheprojectbeofhigherquality,greaterimpact?
17. Whatare:● Thesuccesses
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
11
SearchforCommonGround|YEMEN
● Challenges● Risks● Opportunities
fromtheproject?18. Didyouhaveanexitstrategyfortheproject?Ifyes,wouldyoupleasedescribeit?Ifno,why?
Fromyourpointofviewwhatwerethemostsuccessfulmechanismsforidentifying/resolvinggrievancesandwhy?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
12
SearchforCommonGround|YEMEN
Keyinformantinterview(KII)forLocalPartner(CSOs)
DateofInterview DayofInterview Time of Starting theInterview
Time of Finishing theinterview
NameofInterviewer:IntervieweeName InterviewPlace
Gender MaleFemale
Governorate1 Aden 2 Lahj 3 Taiz
District
InterviewStatusCitizenInternallydisplacedperson(IDP)Refugee
Thepersonwithadisability(PWD)
Yes
No
Job/Capacity PhoneNumber
Questions:1. HowdidyourCSOparticipateinthisproject?2. Howrelevantwerethefollowingactivitiestoyourneedsandcapacitiestoservethecommunity?
Why/whynot/pleaseexplain?▪ technicalandfinancialissues,▪ CommunityDialogueApproach(CDA),▪ howtoconductlocalizedconflictscans,▪ dialoguedesignandfacilitation▪ howtomanageandimplementcommunityinitiatives▪ regional-levelmeetings
3. Towhat extent do you think this project is related to youth and targeted community needs?
Why/whynot?Howcanyouexplain?4. Towhatdegreehavetheprojectactivities/interventionscontributedtoimprovedrelationships
betweentargetedyouthleadersandeldersintheircommunities?5. Did the project instigate changes among the communitymembers and the youth individuals
involvedintheproject?Whatwerethesechangesifany?6. Hasthelevelofcommunicationbetweenyouthleadersandeldersimprovedduringthepasteight
months?Why?7. Didwomenhaveanyroleinconflicttransformationduringtheprojectwithinyourcommunity?
Yes,ornopleaseexplain.8. Whatdidtheprojectaddtoyou?Whatskillshaveyouacquired?Pleaseexplainwithexamples.9. Inyouropinion,howdidyourCSObenefitfromthisproject?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
13
SearchforCommonGround|YEMEN
10. How can you describe the influence of the project on your community in general and youngpeopleinparticular?Elucidatewithexamplesifpossible.
11. Towhatextentwillyoucontinueusingtheacquiredskillsafter theendof theproject?Pleaseexplain.
12. WhatrolescanyourCSOperformtoassurethefuturesustainabilityoftheproject?13. Arethereanyplansandorstrategiestosustainthegainsmadeinyouthandcommunitiesafter
theproject?14. Can you illustrate any conflict in your community that has been solved by using the project
mechanismsaftertheendoftheproject?WerethereanysomeofIllustrateotherconflictsthathave been successfully addressed using the project mechanisms without the projectinterventions?
15. Whatarethemostsignificantchangesasaresultoftheproject?(Successfulstories)16. Whataretheobstaclesthatmayhavelimitedthesuccessoftheprojectactivities?17. Whatarethemainelementsofthestrengthofthisproject?18. Whatarethemainelementsofweaknessinthisproject?19. Towhatextentdoyouthinkthedevotedbudgetandtimewereefficienttotheprojectactivities
andobjectives?20. Arethereotheractivitiesthatshouldhavebeenincludedintheproject?21. Arethereotherpersonsororganizationsorgroupsofpersonsthatshouldhavebeenorshould
bemoreinvolvedintheproject?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
14
SearchforCommonGround|YEMEN
Keyinformativeinterview(KII)forlocalauthoritiesandCommunityLeaders
DateofInterview DayofInterview Time of Starting theInterview
Time of Finishing theinterview
NameofInterviewer:IntervieweeName InterviewPlace
Gender MaleFemale
Governorate1 Aden 2 Lahj 3 Taiz
IntervieweestatusCitizenInternallydisplacedperson(IDP)Refugee
Thepersonwithadisability(PWD)
YesNo
Job/Capacity PhoneNumber
Questions:1. Haveyouheardabout“AFutureCalledPeace”project?Whatdoyouknowaboutit?2. Is“AFutureCalledPeace”projectculturallyappropriatetothecommunity?Explainwhyyes/no3. Doyouthinktheactivities“conflictscans,Youth-ledDialogueProcessesandCommunity-based
initiatives”respondtothetargetedcommunity(malesandfemales)needs?4. Arethereotheractivitiesthatshouldhavebeenincludedintheproject?Whatarethey?5. Didyouparticipateinanyoftheconflictscansinyourcommunity?Whatwasyourfeedback?Did
youthinktheywereusefulornotuseful?/How?Canyouexplainit?Provideexamples?6. Towhatextenttheprojecthelpedinlocalacceptingofyouthasleaders?Pleaseexplain?7. Towhatextentdidtheprojectcontributetoconflicttransformationwithoutviolenceamongthe
localcommunitymembers?Pleaseexplain?8. Towhatextentdidyouandyourcommunitybenefitfrom(nameofthecommunityinitiativein
thatdistrict)?Whatarethebenefitsachievedoutoftheproject?9. How effective were the Youth-led Dialogue Processes and their resulting interventions in
increasing community resilience to conflict and community-level social cohesion? ExplainWhy/Whynot?
10. Arewomensufficientlyinvolvedintheprojectactivities?Ifno,why?11. Whatcouldpromotewomenrolesinconflicttransformationwithinthecommunity?12. Do you think that this projectmakes changes (has an impact) to the community? Yes or no,
explain,please.13. Towhatextentdoyouthinktheimpactofthisprojectwillremainaftertheendoftheprojectand
why?14. Haveyouheardaboutanyotherconflictsthathavebeensuccessfullyaddressedaftertheendof
theproject?Wouldyoupleaseprovideexamples?15. Whatweresomeofthethingsyouwouldchangeabouttheproject?Why?16. Arethereparticularaspectsoftheprojectthatyoubelievecouldhavedonebetter?Whatare
they?17. Whatareyourrecommendationstoimprovetheimpactoftheprojectinthefuture?
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
15
SearchforCommonGround|YEMEN
Surveyforbeneficiaries:localcommunitymembers&DialogueParticipants
survey TimeofStartingthesurvey TimeofFinishingthesurvey NameofInterviewer:IntervieweeName(optional)
InterviewPlace
Gender MaleFemale
Age1 Lessthan18 3 24-29 5 36-412 18-23 4 30-35 6 Morethan41
Governorate1 Aden 2 Lahj 3 Taiz
Education 1Primary 2Secondary 3Undergraduate 4Graduate
IntervieweestatusCitizenInternallydisplacedperson(IDP)Refugee
Thepersonwithadisability(PWD)
YesNo
Job/Capacity PhoneNumberOptional
Questions:1. HaveyouheardorparticipatedinanyactivitywithSearch’s“AFutureCalledPeace”project?
�Participate(gotoquestion3)�Heardbutnotparticipated.(gotoquestion2)�No(endtheinterview)
2. Ifyouheardbutdidnotparticipate,waswhatyouheard:�Positive�NegativePleaseexplain:____________________________________________(Gotoquestion4)
3. Whatprojectactivitiesdidyouparticipatein?Andhowusefulwerethey?Activities Veryuseful Somewhat
usefulLittleuseful Not useful
atallIf usefulhow? Ifnotusefulwhy?
Youth-ledDialogueProcesses
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
16
SearchforCommonGround|YEMEN
Community-basedInitiatives
4. Towhatextentdoyoufeeltheprojectwasrespondedtocurrentcommunityneedsinthecurrent
situation?Veryrelevant Somewhatrelevant Somewhatirrelevant Totallyirrelevant
5. IMsweregoodatreachingacommongroundamongparticipants?Totallyagree Somewhatagree Somewhatdisagree Totallydisagree
Ifimplementedbaseddisagreeortotallyagree(why?)6. To what extent did the activities you were involved in helping build /strengthen positive
relationshipswithyouthleaders?Activities Strengthened
verymuchSomewhatstrengthened
Notstrengthened
Totally notstrengthened
Youth-ledDialogueProcesses
Community-basedInitiatives
7. Towhatextentdidtheprojecthelpincreasecollaborationamongcommunitymembers?Stronglyhelped Somewhathelped Slightlyhelped Didnothelpatall
8. Canyouprovideexamplesofpositivecollaborationthathappenedasaresultoftheproject?______________________________________________________________________________________________________________________________
9. To what extent did the project activities that you involved in helped reduce conflict in yourcommunity
Activities Stronglyhelped
Somewhathelped
Slightlyhelped
Did nothelpatall
Youth-led DialogueProcesses
Community-basedInitiatives
10. TowhatextentdoyouthinktheYouth-ledDialogueProcessesconductedbytheprojectwereeffectiveindealingwiththecommunityissues?
Veryeffective Somewhateffective Slightlyeffective Totallynoteffective
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
17
SearchforCommonGround|YEMEN
11. Towhatextentwere the interventions implementedbasedon theagreed-upon resultsof theYouth-ledDialogueProcesses?
toagreatextent toagoodextent toalittleextent Notatall
Ifnotatall,why?_______________________________________________________________
12. TowhatextentareyousatisfiedwiththeinterventionimplementedasaresultoftheYouth-ledDialogueProcesses?
Totallysatisfied Satisfied to someextent
Satisfied to someextent
TotallyDissatisfied
Ifyoutotallysatisfiedordissatisfiedexplainwhy:_______________________________________________________________
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
18
SearchforCommonGround|YEMEN
FocusgroupDiscussionQuestionsforInsiderMediator(Youthleaders)Questions:Relevance:
1. Doyouthinkthetraining▪ Respondtoyourneedsandcapacitiestotransformconflictswithoutviolence?Explainhow▪ Respondtoyourcommunityneedsornot?Pleaseexplainhow
Note:remindparticipantaboutthemainactivitiesoftheprojectsuchasYouthCapacityBuildingTraining (conflict resolution, conflict analysis, mediation and facilitation techniques),Youth-led Conflict Scans, Youth Peacebuilding Dialogue Design Training, Youth-led
DialogueProcesses,Community-basedInitiatives,andtheRegional-levelMeetingsEffectiveness:
2. Towhatextenthasyourabilitiesincreasedin:▪ conflictresolution,conflictanalysis,mediationandfacilitationtechniques▪ leadConflictScans▪ leadDialogueProcesses▪ raisingcommunity-levelsocialcohesion▪ identifyingandresolvinggrievancesandhowbesttoutilizewhatskillsyouhaveinthefuture
3. Doyouthinktheprojectcontributestoimprovedcollaborationamongyou(youth)andeldersinyourcommunity?Ifso,explainhow?
4. Doyouthinktheprojectcontributestoimprovedcommunity-levelsocialcohesion?Ifso,explainhow?
5. Are women sufficiently involved in the project activities? Did they have any role in conflicttransformationduringtheprojectwithinthecommunity?Ifyes,explaintheirrole
Sustainability:
6. Canyoumentionsomeof theotherconflicts thathavebeensuccessfullyaddressedusing theprojectmechanismsaftertheendoftheproject?Pleasegivedetails.
7. Willyoucontinueusingtheacquiredskillsaftertheproject?Howso?
8. Whatarethemajorfactorswhichinfluencetheachievementornon-achievementofsustainabilityofthisproject?Givesolutionstonon-achievementfactors.
Impact:9. Doestheprojectnegativelyorpositivelyinfluenceyouandyourcommunity?Pleaseexplainhow.10. Fromyourpointofviewwhathashappenedtoyourcommunityaftertheimplementationofthis
project11. Whatsuggestions/recommendationstoimprovesimilarprojectsinthefuture?Arethereother
personsororganizationsorgroupsofpersonsthatshouldhavebeenorshouldbemoreinvolvedintheproject?Pleaseexplainwhy
FinalEvaluation|AFutureCalledPeace:StrengtheningYemeniYouthLeadershipforConflictTransformation
19
SearchforCommonGround|YEMEN
Annex4:DocumentsConsulted
Theevaluationreviewedavailableprojectdocuments,including:
- Sixquarterlyreports.- AmendedWorkplan.- BaselineStudy:AFutureCalledPeace-BaselineStudy.- MidTermevaluation:AFutureCalledPeace.- RevisedProgramNarrative:SEARCHCMMResumedFunding.- MonitoringandEvaluationLearningPlan.- ConflictScanReports:ToorAl-Baha,Al-Maqaterah,Al-SheikhOthmanandAl-Ma’aferdistricts.- Proposalsofcommunitydialogues.- Attendancesheetofallactivitiesinalldistricts.- PreandPost-trainingtests.- Community-basedinitiativesproposalsevaluations.- Conflictsscanproposals.