Terms of Reference - Promundo · 2019. 10. 7. · evaluator for the purpose of conducting a final evaluation of Prevention+ according to the terms of reference set out herein. Key

1

Prevention+AnnualPlan2018

Funded by:

TermsofReferenceForconductingtheFinalEvaluationofthe

Prevention+programme©Prevention+Consortium,Utrecht,October,2019

2

OverviewThePrevention+consortium,comprisingRutgers,SonkeGenderJustice,andPromundo-US,seektheservicesofanevaluatorforthepurposeofconductingafinalevaluationofPrevention+accordingtothetermsofreferencesetoutherein.Keydetails:ProgramLocations: Indonesia,Rwanda,Uganda,LebanonApplicationDeadline: 11November2019Timeline: 1December2019–30September2020Budgetrange: €145,000-€175,000Prevention+isthefirst-ever,multi-intervention,globaltestcaseforengagingmenandboysinpreventinggender-basedviolenceatalargescale.Itthrivesonthediversity,strengthandcollaborationofexperts;evidence-based,evaluatedapproachesattheindividual,community,institutionalandgovernmentlevels;cross-countrylearning;andglobaladvocacy.ProgrammeactivitiesarerunninginparallelinIndonesia,Rwanda,Uganda,andLebanon,andwillconcludeattheendofcalendaryear2020.Astheenddateapproaches,theinstitutionsinvolvedintheprogrammeareeagertoinvestigateanddocumentlessonsaboutthesuccessesandchallengesoftheprogrammetoinformourfutureprogrammingandtheviolencepreventionfieldasawhole.Inthecourseofitsfive-yearperiod,Prevention+willprovidekeyinsightsintotheefficacyofitstheoryofchangeandthelong-termsustainabilityofthisworkatalargescale,throughthelensofgovernmentbuy-inandinstitutionaluptake,aswellasculturalrelevanceandimpactattheindividualandcommunitylevels.Thisincludesevaluatingtheprogram’seffectivenessinachievingitsintendedoutputsandoutcomes,butthisisnotthesoleorprimarypurposeoftheFinalEvaluationsetoutinthisdocument.Instead,theFinalEvaluationtobeconductedbytheselectedapplicantwillfocusonthreeareasofinquiry:(1)whether/howtheparticulardefiningstrategiesofPrevention+provedeffectiveasoriginallydesigned,(2)whether/howtheprogramcreatedself-sustainingstructuresforGBVpreventionorresponsewithingovernmentandlocalinstitutions,and(3)whether/howtheprogramwascarriedoutinawaythatwasaccountabletoitscoreprinciplesasestablishedattheoutset.Theconsortiumcallsforanexternal,independentpartytoaddressallthreeofthesequestionsclearlyandcomprehensively,asdescribedingreaterdetailbelow,inallfourcountrieswherePrevention+hasbeenimplemented:Indonesia,Lebanon,Rwanda,andUganda.Furtherdetailsabouttheprogramme,theapplication/selectionprocess,andthetimelinefortheassignmentarepresentedbelow.

ProgrammeBackgroundThePrevention+programmefocusesonengagingmentoendallformsofgender-basedviolence(GBV),includingbypromotingthefullereconomicparticipationandself-relianceofwomen.Theprogram’slong-termobjectiveistocontributetoagenderjustsociety,freeofGBV,bytransformingharmfulsocialnormsdrivingGBVattheindividual/relationship,community,andcivilsocietylevelandtoensurethatthesechangesarefirmlyrootedinasupportivelegalandpolicyframework.Theprogrammestrategyseekstoscale-upevidence-basedgender-transformativeinterventionsworkinginstrategicpartnershipswithkeypublicsectorsandCSOs,towardtheseends.TheprogrammeencompassesdirectprogramimplementationinUganda,Rwanda,Indonesia,aswellasacommunity,institution,andgovernment-basedsetofactivitiesacrosstheMiddleEastandNorthAfricaregion,coordinatedbyapartnerorganizationbasedinLebanon.TheprogrammeisaffiliatedwiththeMenEngageGlobalAlliance,andsupportedbytheAllianceasatechnicalpartnerespeciallyforinternationaladvocacy.Theprogrammeisdesignedtocatalyzechangesacrossthesocio-ecologicalmodel,withspecificactionsatalllevels:

• Attheindividualandrelationshiplevel,theprogrammeaimstoprovide(young)menandwomenaccesstoinformationandeducationconcerningrelationships,gender(includingpositiveformsofmasculinities),sexuality,parentingandgenderjustice(interventions:ProgramH/P/M,OneManCan).Survivorsandmenusingviolenceareofferedindividual,coupleandgroupcounselling(interventions:YouthLivingPeace,ToolkitforMen).Theprogrammeengagesmenascaringfathers(interventions:ProgramP,Fathergroups)andaspartnersofwomeninWEEprogrammes(intervention:JourneysofTransformation).

• Highquality,evidence-basedmass&socialmediaandcommunicationsstrategiesthatengagemenandboysusingpositivemalerolemodels(interventions:OneManCan,ProgramH/P/M,MenEngageAlliancemovementbuilding)andbystanderapproaches(interventions:LivingPeace,ProgramH/P/M,OneMan

3

Can)arealsoincludedinordertochangesocialnormsandcreateindividualandcommunityaccountability.

• Throughinstitutionalizationandcapacitybuilding,theprogrammeconsortiumworkswithCSOs(includingwomen’srightsandwomen’seconomicempowermentorganizations)andrelevantpublicservicestoincorporategendertransformativeapproachesandgenderjusticeintheirprogrammesandactivities.

• Throughadvocacyeffortstheconsortiummembersfocusonencouragingnationalgovernmentstointroduceandenactnewlegislationaimedatpreventingandeliminatinggender-basedviolence,andtostrengthenenforcementofexistingpoliciesorlegislation.Thisworkincludesinternationaladvocacytoleveragenationalefforts,andnationallydrivenlocaladvocacyefforts.

FinalEvaluation–KeyQuestionsTheFinalEvaluationtobeledbythesuccessfulapplicantwilladdressthreekeyquestions,definedincarefulconsiderationbyPrevention+consortiumandprogrammepartners,tobestdocumentthelessonsoftheprogrammeandinformfuturework.Thekeyquestionsare:1.Strategyareas:TowhatextentdidtheparticulardefiningstrategiesofPrevention+succeedasoriginallydesigned?Thethreestrategiesofparticularinterest,ascurrentlyimagined,include:engagingmenandboysinthepreventionofGBV;workingsimultaneouslyandcomprehensivelyacrosslevelsofthesocio-ecologicalapproach,includingtheinternationaladvocacywork;andworkingwithmassmediaandrolemodelstoadvanceindividualchange.Foreachofthesestrategies,weexpecttheevaluatortoassessexisting1andnewdatatoconsider:

• Whatfactors,ineachsetting,havepromotedorhinderedthesuccessofthisstrategy?• Accordingtostakeholders,whathascontributedtopositivechanges,whatarereasonsfornegative

results,orreasonsfornotbeingabletoactuallyimplementthisstrategy?• Whatspecificconditionsneedtobeinplaceforthisstrategytobe(most)successful?• Dotheseconditionsvarybetweeninterventionareasandbetweencountries?• Towhatextenthasthisstrategycontributedtothecapacitystrengtheningofcivilsocietyorganizationsto

advancewomen’srightsandgenderequality?2.Institutionalization&sustainability:HowsuccessfulhasPrevention+beenintermsoftheinstitutionalizationofgendertransformativeapproaches(topreventGBV)?What-ifany-concretenew,self-sustainingstructurescanwepointto?Theobjectiveofthisevaluationquestionistodocumentandascertainanypolicychanges,changesinorganizationalorgovernmentstructures,orotherverifiablynewinstitutionsoutsideoftheprojectstructureitself,thatresultedfromPrevention+effortsatanylevel.Evaluatorswillassessexistingandnewdatatoconsider:

• Whatspecificnewinstitutionsorprocessesthatsustaintheprogrammeortheoutcomeshavebeencreated?Thiscanincludethedevelopmentofwhollynewstructures,makinguseofexistingstructures,and/oradaptationofexistingones.

• Whatwereconditionsthatcontributedtothesuccessfulestablishmentofthese?• Whatwereconditionsthatpresentedchallenges,andhowwerethesechallengesovercome?• Howcantheseinstitutionalizationlessonsbeappliedelsewhere,basedonprogrammeevidence?• Ifapplicable:Howhaveprogramsmanagedtodealwiththeconservativeenvironmentwheretheyworkin

(fromansocio-ecologicalperspective)?• Ifapplicable:HavePrevention+partnersinfluencedotherinstitutionsandCSOstoadoptasimilarfocus

andchangetrajectory?3.Accountabilityandprogrammecoreprinciples:Howhavetheprojectprinciples(asestablishedinthePrevention+TheoryofChange)contributedtothePrevention+programmeobjectives?Theobjectiveofthisquestionistoholdtheprogrammeaccountabletoitsowncoreprinciples.Thefivecoreprinciplesare:(1)promotehumanrights,includingtherightsofwomenandgirls;(2)donoharm,prioritizingthe

1 This can be monitoring data, data from (semi-)annual reports or mid-term reviews.

4

needsandsafetyofsurvivorsofviolence;(3)workwith,remainaccountabletoandindialoguewithwomen’srightsmovementsandorganisationstopromotegenderjustice;(4)Engagemenaspartofthesolutionandpromotepositivemasculinities;and(5)Beinclusiveandresponsivetodiversitiesamongmen.Evaluatorswillassessexistingandnewdatatoconsider:

• HowseriouslydidprogrammeteamstakeuptheseprincipleswithinPrevention+?Whatarethedocumentableresultsofcloseradherencetotheprinciples(orlackthereof),whethergoodorbad?

• Towhatextentdidadheringtotheseprinciplesaddvaluetotheprogram?• Whatdecisionsdidwemakebasedontheprinciples,thatwewouldn’thavemadeotherwise?• Forwhichprinciplesdoesouradherenceshowroomforimprovementand/orfurthervalueclarification?

Process,Deliverables,andIllustrativeTimelineTheFinalEvaluationprocesswillbeafluidcollaborationbetweenthesuccessfulapplicantandvariouspartieswithinthePrevention+consortium,allworkingwithunifiedgoals.Thetermoftheevaluationexerciseisdesignedsoasnottoberushed,andinsteadtoofferenoughtimeforthenecessarydatacollectionandreviewtoprepareathorough,thoughtful,andusefulassessmentofallthreekeyquestions.Thefinalprocesswillbedesignedandrevisedoverthetermoftheassignmentbyallparticipatingparties,butattheoutsetweimagineaprocesssuchasthefollowing:Step1:Introductorymeetingsanddocumentexchange:ThePrevention+consortiumwillbeeagertoholdinitialmeetingswiththeselectedapplicantassoonaspossibleinthetimeline,toclarifyanyquestionsrelatedtotheassignment,andtoprovidenecessarybackgrounddocumentation,data,andothermaterialsasneeded.Thisstepwilltakeupnomorethanthefirstmonthoftheassignment.Step2:Inceptionreportandapproval/finalizationofevaluationdesign:Theinceptionreportistheevaluator’sfirstkeydeliverable,andtheiropportunitytospecifythemethodologyandworkplanfortheassignmentinfulldetail,includingaproposedset-upforthefinalreport.Thedocumentwillalsoprovidetheprogrammeteamstheopportunitytoprovidefeedbackandclarityonanyunclearelementstotheevaluator.Theinceptionreportshouldbecompletedwithinoneortwomonthsofthestartoftheassignment,andfinalizedverysoonthereafter.Duetothevariationinprogrammeactivitiesineachcountrylocation,theevaluationmethodologywilllikelyneedtospecifycountry-specificevaluationdesignswithintheinceptionreport.Theevaluatorwillbewarmlyinvitedtoestablishtheseplansinclosecollaborationwiththedesignatedteamoftherelevantcountryteams.Furthermore,theevaluationdesignsshoulddemonstrateacomprehensiveunderstandingoftheprogrammesineachcountry,andclearlydemonstratehowtheapproachwilladequatelyanswerallthreekeyquestions.Step3:Datacollection:Uponapprovaloftheinceptionreport,theevaluatorwillcarryouttheirevaluationdesign,includinganyandallnecessaryactivitiestogathernewdataineachcountrylocation.Thedetailsofthisstepwillbedeterminedintheinceptionreport.Datacollectionandsitevisits(asnecessary)mayspanseveralweeksormonthsin2020.Step4:Dataanalysisandfirstdraftofreport:Thisevaluationassignmentdoesneedtoresultinoneconsolidatedevaluationreport,addressingallthreekeyquestionsindetail,substantiatedbycountrylevelexamplesandevidence,andwritteninaclearandcompellingstylewhichwillbeeffectiveforviolencepreventionprogramstaffaswellasageneralaudience.AfirstdraftofthefinalreportshouldbedeliveredbyapproximatelyJuly,2020.Aproposedset-upforthisreportwillbeincludedintheinceptionreportStep5:Reportfeedbackandworkshop:Uponreceiptofthefirstdraftofthereport,Prevention+teamswillreviewandprovidefeedbackandrequeststotheevaluator.Theevaluatorshouldbepreparedtomakerevisionsandworkcollaborativelywiththeteamatthisstepinordertoimprovetheprecision,writingstyle,usefulness,andothercharacteristicsofthefinalreport.Itislikelythatameetingtovetandadjustthereportwillbeusefulatthisstep.Theprogrammeteamwillnotmakeanyrequestsoftheevaluatorthatjeopardizetheintegrityandindependenceoftheevaluationfindings.ThisworkshopwilllikelytakeplaceinAugust2020.Step6:Deliveryandpublicationofthefinalreport:Theconcludingstep,afterthesuccessfulrevisionsofthereport,isfortheevaluatortopreparethefinalreportforpublicrelease,including(ideally)coordinatingthecopyeditingandlayoutdesignofthereportsuchthatitissuitableforwidepublicrelease,dissemination,andpresentations.TheenddateforthisfinaldeliverableisSeptember30,2020.ThisdeliverywillbedoneinclosecollaborationwiththecommunicationstaffofRutgers.

5

Throughout:Intendedusersandaudienceofthefinalproduct.Considerationsoftheultimateusers/usesoftheevaluationshouldinformallevaluationdecisions.Weanticipatethatthekeyaudiencesandendusersofthereportinclude:! Membersandpartnersoftheconsortium.Thefindingswillbeusedbyconsortiummembersandinthe

programmecountriestosteerandadapt,andtoidentifysuccessfulstrategiesandlessonslearned.Insightsfromthefinalevaluationwillprovideinsightsintowhichapproachesneedtobestarted,continued,revisedorstoppedforwhichtargetgroups.

! Programparticipantsandstakeholdersineachcountry.Engagingdirectlywiththisaudienceensuresdownwardaccountabilityandforlearning,inspirationandmotivation.

! Theinternationalfieldofviolencepreventionprogramming,includinginternationalknowledgeplatformsforGBVpreventionandmaleinvolvement.Thiswillcontributetogloballearningandinnovationconcerningbestpractices,scalableinterventions,andlessonslearned.

! Furthermore,theevaluationreportwillbesharedwiththeMinistryofForeignAffairsoftheNetherlands(theprimarydonoroftheprogramme)andtheDutchdevelopmentsectorinparticular.

Throughout:Collaborativecommunication:Regularupdatesontheprocess,forexampleonthecountrystudies,arerequired.Theapplicantshouldaddressthecommunicationprocessandcollaborationbetweenthedifferentpartiesintheirproposal.

TheSuccessfulApplicantTheconsortium,throughitsleadagencyRutgers,wantstocontractone(lead)organisation,responsibleforthedeliverablesandtheprocessimplemented.Wealsowelcomeapplicationsthatreflectacollaborationofmultipleorganisationsforthisassignment;researchinstitutesand/orindependentresearchers/consultantscancollaborateinordertoconductthefinalevaluation.Itislikelyimpossibleforasingleindependentevaluatortoaccomplishthisassignment,giventhescopeoftravelanddatacollectionrequiredwithinthetimeline.Thesuccessfulapplicationwillidentifyoneormorekeypersonnelwithintheevaluationteamwhomeetdesiredcriteriasuchasthefollowing:! Master’sdegreeinsocialsciencesandadvancedskillsinquantitativeandqualitativeresearchmethodologies;! Proventrackrecordintheevaluationofgenderequality,engagingmenandboys,andGBVprogrammes,

particularlyinlong-termassignmentssuchasthisone,thathavebeenimplementedinmultiplecountries;! Atleastfiveyears’experienceinthedevelopmentsector;! Knowledgeofgenderequality,GBVprevention,andcollaborativeprogramming,includingapproachesto

engagemenandboys;! Provenexperienceinqualitativeandquantitativedatacollectionandanalysisforevaluations;! Provencollaborationwithresearchinstitutionsinthesouth;! Abilitytoworkindependently,takeinitiativeandrespondappropriatelytoconstructivefeedback;and! Experienceinsharinganddiscussingevaluationfindingswithclients,in-countrypartnersandbeneficiaries,and

withinaninternationalresearchnetwork.Thesuccessfulapplicationshouldidentifyoneleadresearcheroftheresearchteamtobetheprimarycontactpersonforthefinalevaluationworkinggroupsoftheconsortium.Thispersonshould:! Haveprovenexperienceinlayeredandcomplexevaluations;! Haveastrongmethodologicalbackgroundinmulti-countryevaluations;and! Haveprovenexperienceinusingamixedmethodologyapproach.Theevaluationteamshouldnotcomprisecurrentorformerstaffofanyofthemembersorpartnersoftheconsortium,inordertoprotecttheindependenceoftheevaluation.Applicantshavetheoptionofwhetherornottosub-contractlocalin-countryresearchteams,inaccordancewiththeirevaluationdesigns.In-countryresearchteamsmusthaveknowledgeofthecontextofthecountries,andareabletodointerviewsinthelocallanguage.

6

HowtoApplyApplicationsforthisroleareopenuntil11November,2019.Pleasesendyourapplicationtocontact@promundoglobal.orgPleaselimittheproposaltexttonomorethan8pages.Theproposaltextshouldbeanarrativedemonstratingthefollowing:! Yourindividualorinstitutionalskillsandbackgroundwhichmakeyousuitableforthisassignment;! Yourtrackrecordontheevaluationofgenderequality,engagingmenandboys,andGBVprogrammes:list

yourevaluations,andsendtwoexamplesofrecentevaluationswithyourapplication;! Yourvisionforthecollaborationbetweentheresearchparty,thePrevention+consortiumandthecountry

programmeteamsduringtheentireprogrammeperiod;! Yourunderstandingofeachofthethreekeyevaluationquestions,andhowyouimagineaddressingthemina

unifiedmulti-countryevaluationreport;! Adescriptionofresearch/datacollectionmethodologiesyouproposetoaddressthesequestions;! Adescriptionofyourapproachtowritingeffectivelyforanaudiencecomprisingbothtechnicalexpertsand

generalreaders;! Adescriptionofapproachtoincorporatingfeedbackandrevisingevaluationreports,includingthrough

workshops;and! Aclearidentificationoftheleadresearcherandanyadditionalkeypersonnelconnectedwithyourapplication.Inadditiontotheproposaltext,pleasesubmitsupplementarymaterialsincludingthefollowing:! Aninitialbudgetproposal,(withamaximumof€175,000)includingthenumberofdaysyouwouldspendon

theassignmentanddailyfees(budgetshouldcoverallcostsin-countryaswell,includinglogisticalcosts).Theproposalthatwillbeselectedwillprovideanappropriatebalancebetweenthequalityandthecostsoftheevaluation.Thereissufficientbudgetavailableforanextensive,high-qualityevaluation.

! CVs,highlightingrelevantexperience(s)andpersonalprofile,oftheleadresearcherandallnamedkeypersonneloftheresearchteam.Fromthesedocumentsitshouldbecleartheleadresearcherandtheothermembersoftheresearchteammeetthecriteriaabove.

! Atleastone,preferablytworecentstudies/writingexamplesonsimilarthemeswithsignificant/primarywritingbytheleadresearcher.

! Ifapplicable:names,contactdetails,andCVsorcountry-specificresearchinstitutesorconsultantsthatwillbeinvolvedintheprogramme.

AdditionalNotesForinquiriespleasecontactBrianHeilman,throughPromundo’soffice([email protected]).Note1.Thiscallforproposalshasbeendistributedamongtheprofessionalnetworksoftheconsortium,throughourwebsitesandsocialmedia,andalsothroughseveralemaillistservsofevaluationandviolencepreventionpersonnel.Note2.Rutgersisnocontractingauthoritywithinthemeaningofthe‘Aanbestedingswet2012’(theDutchPublicProcurementAct).Thistenderprocedureisavoluntaryandprivatetenderprocedure.TheAanbestedingswet2012aswellastheprinciplesofprocurementlawareexplicitlynotapplicable.ApplicantsareherebyadvisedthatRutgersisnotcommittedtoanycourseofactionasaresultofitsissuanceofthisTermsofReferenceand/oritsreceiptofaproposalfromtheapplicantorotherformsinresponsetoit.Rutgersreservesallrightsandlibertiesregardingthetenderprocedure,including:

• therighttoterminatethetenderprocedureatanymomentintime;• therighttorejectanyproposal;• therighttoengagenegotiationswithoneormoreparties(alsothird-parties)regardingthecontractora

partthereof;• therighttoawardthecontractorapartthereof;• therighttoawardthecontracttooneormoreparties;• therighttomakeanydecisionsubjecttoconditions.• therightnottoawardthecontract;

7

• therighttodepartfromormodifytheproposedframeworkand/oranyotherprocedureinrelationtotheTermsofReference.