YOU ARE DOWNLOADING DOCUMENT

Please tick the box to continue:

Transcript
Page 1: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EvaluationoftheEmergencyShelterandNon-FoodItemsClusterintheUkraine

CarolineDewast&VidarGlette

ExternalEvaluationNovember2015FinalReport,February2016

Page 2: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE2OF50

Executivesummary InNovember2013,theGovernmentofUkraine(GoU)decidedtoabandonanagreementthat

wouldstrengthenitstieswiththeEU,sparkinglarge-scale protests.InMarch2014,aconflicteruptedwithRussia’sunilateralannexationofCrimea,leadingtoafirstwaveofpopulationdisplacement.Asecondwaveofdisplacementfollowedshortlyafter,asaconsequenceofseparatistoffensivesintheDonbasregion.Aceasefireagreement(MinskI)wasreachedinSeptember2014.However,clasheseruptedagaininearly2015,causingathirdwaveofdisplacement.Asecondceasefireagreement(MinskII)wassignedinFebruary2015.Ongoingceasefireviolations,heavyshellingandarmedconflicthavedisplaced1.5millionpeople,creatingfluctuatingpopulationmovementsincludingsecondarydisplacement,commutingacrossthecontactline,andreturns.Theinfluxhasplacedastrainonhostcommunities,especiallyinareaswithahighratioofinternallydisplacedpeople(IDPs)comparedtothelocalpopulation.

ActivationoftheShelterCluster InJuly2014,UNHCRactivatedasheltersectorandstarteddevelopingasectoralstrategy,

anticipatingits’leadershipresponsibilityfortheShelterCluster(SC).TheRegionalFocalPoint(RFP)totheGlobalShelterCluster(GSC)wasdeployedtoUkraineinSeptember2014.AmonthlaterhiscontractwithGSCendedandhewasrecruitedbyUNHCRtoleadthesheltersector,priortotheformalactivationoftheclustersystem.HelaterbecametheShelterClusterCoordinator(CC)andhasremainedtheCCtodate.Theclustersystemwasactivatedon23rdDecember2014withUNHCRasleadagency(CLA)fortheUkraineSC,inpartnershipwiththeMinistryofRegionalDevelopmentandHousing(MoRD)andMinistryofSocialPolicy(MoSP).Asub-nationalSCwasactivatedinJuly2015,basedinSlovianskandledbyPeopleinNeed.Manyinformantsrecognisedtheadvantageofhavinganinternationalnon-governmentalorganisation(INGO)asco-chairoftheSC.

TheResponse TheshelterresponseintheGovernmental-ControlledArea(GCA),hasbeenmostlywelltargeted

andappropriate,supportedbytheSCcoordinationservices.TheSChasbeendescribedasthemosteffectiveclusterinUkraine,withahighlyvaluedinformationmanagement(IM)systemandcountry-widemappingprocesses.TheSChasalsoledtechnicalworkinggroups(TWIG),particularlyonshelterwinterisationandcashassistancewhichwereessentialforharmonisingandstandardisingtheshelterresponse.Monitoringofcashforshelteractivitieshaveshownhighlevelsofbeneficiarysatisfactionwiththeprogramme.Thehumanitarianset-uphasbeendescribedas“Kyivcentric”andsomewhatdisconnectedfromprioritiesontheground.Humanitarianactorshavestruggledtoengagewiththenationalgovernment,whilerelationswithregionalandlocalauthoritieshavebeencomparativelybetter.TheaccessrestrictionstotheNon-Governmental-ControlledArea(NGCA)hasbeenoneofthemainchallengestoprovidingrapidandadequatehumanitarianassistancetovulnerablecommunitiesinthoseareas.Anumberofactorsbasedinthefield,includingUNHCR,havebeenrunninginformalsheltermeetingstobettercoordinateshelteroperations.However,whentheSCsub-nationalhubwasactivated,anumberofmisunderstandingsoccurredamongstUNHCRstaff,highlightingalackofinternalawarenessoftheclustersystem.

Page 3: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE3OF50

KeySCpersonnelwerefulfillingdualresponsibilitiesfortheSCandUNHCRuntilApril2015.Whilekeyinformantsgenerallyperceivedthatthisdouble-hattingwaswellmanagedbythestaffinquestion,itblurredthelinesbetweentheSCandtheCLA,andcontributedtoaperceivedconflictofinterestduringCashWorkGroup(CWG)discussions.

ActivitiesoftheShelterCluster

SCmeetings(SCM)havebeenrespondingtotheneedsofSCpartnersthroughregularmeetings

inKyivandad-hocregionalcoordinationmeetingsuntiltheactivationofthesub-nationalhubinJuly2015,basedinSloviansk.TheSCstrategy,settingoutkeyprioritiesforthesector,wasdraftedinSeptember2014andrevisedinJune2015.ThefirstStrategicAdvisoryGroup(SAG)meetingwascalledinDecember2015,anduntilthenallstrategicdecisionsandprioritiesweremadeinplenaryduringSCM.TheSCTeam(SCT)ledanumberoftechnicalworkinggroups(TWIGs)whichwereverywellreceivedbySCpartners.TheSCTalsoledearlydiscussionsoncashtransferprogramming,discussingcashforshelteraswellasMulti-Purpose-CashGrant(MPCG).InMay2015,OCHAactivatedaninter-sectoralCashWG(CWG),whichresultedin3monthsofdisagreementsandnegotiationsamongsthumanitarianagency,ontheharmonisationoftheMPCGtransfervalue,andtheHCTdecidingtomakecashaseparatesectionintheHumanitarianResponsePlan.This,unfortunately,drewattentionawayfromtheprovisionofhumanitarianassistance.TheSChaspublishedregularsituationupdatesandfactsheets,circulatedviaemailsandthroughtheirGooglegroup.Thesedocumentshaveenabledagenciestodevelopadvocacymessagestodonors,governmentandtheirhead-quarters.Apost-distributionmonitoring(PDM)template,forcashassistancedevelopedbytheSC,contributedtoconsistencyinagencyreportingandimprovedtransparencyandaccountabilityvis-à-vistheaffectedpopulation.Overall,theSChasbeenvaluedfortheinformationitproduces.However,themajorityofthematerialaimstoprovideanoverviewofthesituation,andisdirectedatstakeholdersinKyiv.Anincreaseinfield-leveltoolsandanalysisisdesiredbyimplementingagencies.WhiletheSCTareseenasresponsiveandhelpfulinrespondingtoindividualagencyrequests,itisbelievedthattimecouldbesavedbymakingdocumentsmoreeasilyaccessibleandtraceable.TheSCThasprovidedcapacitybuildingforSCpartners,includingnationalnon-governmentalorganisations(NNGOs)throughvariousforums,TWIGs,SCMandindividualad-hocmeetings.ThetranslationofmeetingsandkeydocumentsintoEnglish,RussianandUkrainianhasbeenessentialtoallowingengagementwithnationalactors.

Conclusions OveralltheSCisperceivedasoneofthestrongestandmostrelevantclustersofthisresponse.

EverykeyinformanthighlightedthestrengthoftheSCcomparedwithotherclustersinUkraine.Thegeneralperceptionshowsasatisfactoryprioritisationofactivities,butsomeinformantsexpressedtheneedtorefinethisprioritisation,stressingtheimportanceofneedsinNGCAandthelackofhumanitarianassistanceinthisarea.ThelackofbaselinedataespeciallyinNGCAremainsachallengetoprovidingaclearpictureofthecontext.SCMminutesandtheinter-clusterContingencyPlandescribedtheneedtosupportauthoritiesincarryingoutmoreeffectiveIDPtrackinginordertoimproveoverallbaselinedata.

Page 4: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE4OF50

Inlightoftheclustertransition,authoritiesinKyivdonotcurrentlyappearreadyorwillingtotakeonfurtherrolesorresponsibilitiesinthehumanitarianresponse.ThusthemostlikelyscenariofordeactivationoftheSCisanimprovementofthehumanitariansituation,minimisingtheneedtocoordinateresponseandgaps.

Keyrecommendations

FortheShelterClusterTeam Actionpoints:

KR-1 Increaseengagementwithlocalactors,includingauthoritiesandNNGOs.

• Continueawarenessraisingontheclustersystemforlocalactors.(R.24)

• Carryoutadvocacytolocalandregionalgovernmentonaharmonisedresponse.(R.29)

KR-2 Systemiseclustermeetingsandclarifythecoordinationstructure.

• Formalisethedecentralisedcoordination:standardisingtheinformalsheltermeetings,withfocalpointsreportingbacktotheSCT.(R.8)

• Createanorganisationalmapofthecoordinationstructure,withnational,sub-nationalanddecentralisedmeetingsandfocalpoints.(R.9)

KR-3 Improvesectoraldataandsystemisethedisseminationofdocuments.

• Worktoimprovethebaselineoftheconflict-affectedpopulation.(R.12)

• Producefield-orientedtoolsandanalysis.(R.13)• Createanindexdocumentlinkingtokeymaterials.(R.17)

FortheShelterCluster ActionpointsKR-4 Increaseactiveandconscious

engagementofSCpartnersinstrategicdecisionmaking.

• EnsureSCpartnersareactivelyandconsciouslyinvolvedindecisionmaking.(R.7&12)

• UsetheSAGasaforumtodefineanddevelopstrategies,priorities,workplans,andpreparejointassessments.(R.7)

KR-5 Strengthentheworkonaccountabilitytoaffectedpopulationsandassistancetovulnerablepeople.

• Setupavulnerabilityworkinggroupforguidanceonbeneficiaryselectionandinclusion.(R.32)

• Improvecommunicationmessagestotheaffectedpopulationonthetypeofassistanceprovided,howandtowhom,withfeedbackmechanisms.(R.31)

ForGSCandUNHCR Actionpoints:KR-6 Buildastrongerinternal

awarenessoftheroleasCLA.• DevelopastandardinformationpackageforUNHCRstaff

ontheroleandresponsibilityofclustersandCLA,stressingtheimportanceofdedicatedCC.(R.1)

KR-7 IncreaseengagementwithHCTandICCG.

• RequestforHC/HCTtoincreasetransparency,andtakeleadershipinengagingnationalactors.(R.14&29)

• DemandforCCtobepresentatHCTmeetings.(R.15)• ContinuetoguideICCGdiscussions,ensuringtheyare

relevant,i.e.discusstheneedforaCCPM.(R.26)KR-8 Buildsheltersectorcapacity

ontheuseofcashmodalities.• Providededicatedcashexpertiseand/orspecificSC

guidanceoncashprogramming.(R.22)KR-9 Encourageclusterarchitecture

review,usinglessonslearnedfromUkrainetoinformfutureclusteractivation.

• AdvocateforaUkraineclusterarchitecturereview,tolearnfrommiddleincomecountriesonappropriatecoordinationstructures.(R.27)

• InitiateadiscussionwithGlobalICCGandIASCforglobalevaluationofthehumanitariancoordinationsystem,toconsiderdevelopmentofcoordinationstructuresthataremoreadaptabletodifferentcontexts,whileremainingtransparentandaccountable.(R.27)

Page 5: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE5OF50

TableofContents

1.

1.12.

2.12.22.32.4

3.3.13.24.

4.14.24.34.44.54.6

4.74.8

Executivesummary 2Keyrecommendations 4TableofContents 5ListofTablesandFigures 6Acknowledgements 6Introduction 7PurposeandScopeoftheEvaluation 7Methodology 7Overview 7EvaluationQuestions 7DataCollectionandAnalysis 8LimitationstotheEvaluation 8Context 9Overview 10HumanitarianResponse 10FindingsandRecommendations 11ClusterActivationandLeadership 11Supportingshelterservicedelivery(Corefunction#1) 15Informingstrategicdecision-makingbytheHC/HCT(Corefunction#2) 18Strategy,planning,policyandstandards(Corefunction#3) 20Shelteradvocacyandcommunication(Corefunction#4) 24MonitoringandreportingonimplementationofShelterClusterstrategy,shelterachievementsandcorrectiveaction(Corefunction#5) 25Contingencyplanning/preparedness/capacity-building(Corefunction#6) 26Accountabilitytoaffectedpopulations(Corefunction#7) 28Annexes A. ListofRecommendations 32B. TermsofReference 36C. ListofKeyInformants 42D. FieldVisitSchedule 43E. OnlineSurveyQuestionnaire 44F. PrioritisationofICCGItems 46G. RecommendationsfromIMReviewMissiontoShelterClusterUkraine 47H. Bibliography 49I. ListofAcronyms 50

Page 6: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE6OF50

ListofTablesandFigures

Fig.1 TimelineofkeyeventsTab.1 TitleandroleoftheSCTpersonnelFig.2 UkraineShelter/NFIClusterCoordinationteamstructureTab.2 Table:Onlinesurveyrespondersindicatingthefrequencyofuseofdifferentsourcesof

information.Tab.3 Tablesummarisingthecashtransfervalueagreed,discussedorrecommendedduringvarious

meetingsbetweenOctober2014andAugust2015 Acknowledgements Theevaluationteamwouldliketothankallthosewhohaveprovidedtheirsupportandinput

tothisevaluation.Weareparticularlygratefulfortheconstructiveguidanceandsupportfromtheevaluationmanager,GreggMcDonald,andtheconstructiveinputsandcommentsfromtheevaluationfeedbackgroupfromDavideNicolini,MiguelUrquia,andIgorChantefort.Finally,wearethankfulforthesupportoftheUkraineShelterClusterTeam:IgorChantefort,KateHolland,AndriiMazurenko,DaryaZhagina,andKaterynaCarmina.Wealsoacknowledgethewillingnessofalltheindividualswhohaveprovidetimeandinsightsthroughmeetings,interviews,telephoneandSkypeconversations;thosewhohaveorganised,facilitatedandhostedusduringsitevisits;thosewhohaveparticipatedtotheonlinesurvey;andallthosewhohavecontributedtothisevaluation.WeappreciatethetimeofUNHCRstaffinGenevaandBerlinforfacilitatingtheevaluationdeployments,andtotheGlobalShelterClusterteamfortheirtechnicalcontributionandexpertise.

Disclaimer Theviewsandrecommendationsexpressedinthisdocumentarethoseoftheevaluation

team,theydonotnecessarilyreflectthoseoftheShelterClusterteam,theGSCorUNHCR.Responsibilityforanyomissionsorerrorsoffactorinterpretationrestswiththeauthors.

Page 7: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE7OF50

1. Introduction

1.1 PurposeandScopeoftheEvaluation Thepurposeofthisindependentevaluationistoreviewtheeffectivenessofthecoordination

servicesprovidedbytheUNHCR-ledEmergencyShelterandNFIClusterCoordinationTeamtothehumanitarianresponsetotheUkrainecrisisthatbeganin2014.

Objective Theevaluation’sobjectiveistoidentifykeylessonsfromwhathasbeenachievedsofarandto

offerrecommendationstoimproveandinformfuturecoordinationoftheongoingresponse. TheGlobalShelterClusterandUNHCRwillusetheevaluationoutcomesandrecommendations

toimprovefuturedeploymentstosimilarcrises.TheUNHCR-ledcoordinationteamwilluseittolearnfromthefindingsandimprovecurrentpractices.ThiswillbecompletedthroughaManagementResponsePlan(seetemplateinAnnexF)detailingwhichrecommendationsareacceptedandwillbeactedupon,when,andbywhom.

2. Methodology

2.1 Overview Toconductthereviewandmeasuretheeffectivenessofthecoordinationservicesprovidedto

date,theevaluatorshaveadoptedanumberofevaluationtoolsandmethods,detailedbelow.ThestructureofthereviewwasbasedontheOECD/DACcriteriaandtheevaluationquestionsalsodetailedbelow.TheevaluationwillconsidertheperspectiveoftheSCT,SCpartners,GSCsupportteam,theCLAandUNHCRUkraineoffice,theinter-clustercoordinationmembersincludingOCHA,donors,governmentalcounterpartsatnationalandregionallevelandbeneficiariestargetedbyshelterimplementingagencies.

2.2 EvaluationQuestions

ThereviewoftheUkraineSCwilladdressthequestionslistedbelow,asoutlinedinthe

evaluationTermsofReference(AnnexA).Theorderhasbeenchangedtocorrespondtotheclustercorefunctions(inparenthesisisthesectionwherethequestionandrelatedfindingsarediscussed):

Q1. DidtheShelterClusterfulfilitscorefunctionsasdefinedbytheIASC?(4)Q2. Havelessonslearntfrompreviousclusteractivationsbeenutilised?(4.1)Q3. WasthereevidenceofsupportfromtheGlobalShelterCluster?(4.1)Q4. Towhatextentdidtheclusteraddvaluetotheresponseundertakenbyshelteractors?(4.2)Q5. Wouldithavebeenpossibletoaddthesamevalueinamoreefficientway?(4.2)Q6. HastherelationshipwiththeHCTandtheclusterbeeneffective?(4.3)Q7. Hastheclustereffectivelysetitspriorities?Aretheregapsinthesepriorities?(4.4)Q8. Didtheclusterdoenoughadvocacytodonors,governmentandothers?(4.5)Q9. Istheclustersupportingthegovernmenttotakeupacoordinationroleinthefuture?(4.7)

Q10. Whatrealdifferencedidtheclustermaketothepeopleaffectedbytheconflict?(4.8)Q11. Werecross-cuttingissuesandvulnerabilitiesexploredandacteduponwithinthecluster?(4.8)

Page 8: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE8OF50

2.3 DataCollectionandAnalysis Toconducttheassignment,theevaluatorsadoptedthefollowingmethodsofdatacollectionand

analysis: � DeskReview–athoroughandcomprehensivedeskreviewofdocumentation,filesand

reports,availableonsheltercluster.org,ontheGooglegroup,ontheinternalShelterClustershareddrive,throughdocumentsprovideddirectlytotheevaluators,andusinganyotherinformationavailableonline,includingonhumanitarianresponse.info

� 32keyinformantinterviews(refertoAnnexDforthelistofkeyinformants)� Anonlinequestionnaire,whichwasdevelopedanddistributedduringthefieldvisitinorder

toreachawideraudience� StakeholdermappingexercisewiththeSCT� SitevisitswithPINinSlovianskandNRCinSievierodonetsk

2.4 LimitationstotheEvaluation

Somekeyinformantswerenotconsultedforthisreview-theHCandtheHeadofOCHA.

Unfortunately,althoughmeetingswiththesekeyactorshadbeenscheduled,duetochangesintheirschedulethemeetingswerecancelledwithnoreschedulingpossibilitywithinthetimeframerequired.

TheauthoritieswereonlyconsultedindirectlyinthefieldandinKyiv.Inthefield,theevaluator

metwithanNNGOrepresentativewhowasalsoworkingpart-timefortheregionalauthoritiesasanadvisortothehumanitarianresponse.InKyiv,althoughameetingwasscheduledwitharepresentativeoftheMoRD,itwascancelledlastminutebecausetheevaluatorwasnotaUkrainiannationalandwasnotabletoenterthegovernmentbuilding.Thusthetranslatorwhowasaccompanyingtheevaluatorproceededwiththemeetingonbehalfoftheevaluator.Bothofthesemeetingsprovidedindirectinformationonthegovernment’sengagementanditsperceptionoftheSC,asaresultofwhichsomeinformationcanresultinspeculativeassumptions.

ThedeskreviewwasbasedonmaterialprovidedbytheGSCandtheUkraineSCT,aswellasthe

informationavailableonthesheltercluster.organdhumanitarianresponse.infowebsites,theUkraineSCGoogleGroup,andlater,theSCTinternalserver.However,asnotedfurtherinthereport,therehavebeeninconsistenciesinrecordinganduploadingofinformationtotherelevantplatforms,whichhasledtosomeinformationgapsespeciallywhenverifyingdataprovidedbykeyinformants.

Finally,theevaluationteamunderstandsthatthisreviewisnotafinancialauditofthe

coordinationservices.Asaresult,ithasnotevaluatedthespecificdetailsoftheclustercoordinationfinancesandexpenditure.Rather,ithasfocusedontheoperationalandqualitativeaspectsoftheservicesprovidedbytheUkraineSCT.

Page 9: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE9OF50

3. Context

Fig. Timeline

Roman UkraineconflictItalics HumanitarianresponseBold Sheltersector

2013

Nov UkraineoptsoutofEUagreementDec ProtestseruptinKyiv

2014

Feb Maidanprotestsclimax,presidentYanukovychleavesMar RussiaincorporatesCrimea,firstwaveofdisplacementApr Pro-RussianseparatistoffensivesintheDonbasregion,secondwaveofdisplacementJun PoroshenkoelectedpresidentJul ReportsofincreasedRussiansupporttorebels

Aug Sheltersectoractive,coordinatedbyUNHCR UNHCRestablishapresenceinMariupol

Sep ArrivaloftheShelterClusterRegionalFocalPoint PublicationofShelter/NFISectorStrategy Ceasefiresigned(MinskI)

Oct StartofCashforWinterisation(ledbytheSC) UNHCRestablishapresenceSievierodonetsk,Dniepropetrovsk,DonetskandKharkiv

Dec FormalactivationoftheClustersystem EstablishmentoftheUkraineShelterClusterbasedinKyiv 2015

Jan LaunchoftheStrategicResponsePlan(SRP) OCHAestablishregionalcoordinationinSievierodonetsk,Kharkiv,Mariupol Renewedseparatistoffensive

Feb BattleofDebaltseve,thirdwaveofdisplacement Secondceasefiredealagreed(MinskII) Publicationofrevised2015UkraineSRP

Mar UNHCRhighstaffturn-overApr CCandShelterAssociatestopdoublehattingandbecomededicatedtotheSC

RecruitmentofUNHCRShelterOfficer FirstOCHA-ledCashWG AccessrestrictiontoNGCA

May AgreementwithPINtoco-chairtheShelterCluster,andleadasub-nationalhub. UNHCRestablishapresenceinLuhansk OCHAestablishesregionalcoordinationinLuhansk

Jun PublicationofShelter/NFIClusterStrategyJul Sub-nationalShelterClusterbecomesoperationalwiththefirstmeetinginSloviansk

StartofOCHAregionalcoordinationinKramatorskSep UkrainiantranslationofShelter/NFIClusterStrategyDec SCTcallsthefirstSAGmeeting

Page 10: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE10OF50

3.1 Overview InNovember2013,thedecisionoftheGoUtoabandonanagreementthatwouldstrengthen

tieswiththeEUsparkedlarge-scaleprotests,andinFebruary2014violentclashesbetweendemonstratorsandauthoritiestookplaceinKyiv.InMarch2014,aconflicteruptedwithRussia’sunilateralannexationofCrimeaandareferendumonstatuswasheldintheAutonomousRepublicofCrimea,leadingtoafirstwaveofpopulationdisplacementfromCrimea.

SincetheeruptionofhostilitiesintheDonbasregioninApril2014,insecurityanddisplacement

haveincreasedacrosseasternUkraine.Ongoingceasefireviolations,heavyshellingandarmedconflicthavedisplaced1.5millionpeople.AsofAugust2015,theMoSPregistered1,459,226IDPsinGCA,withfluctuatingpopulationmovementsincludingsecondarydisplacement,commutingacrossthecontactline,andreturns.Thisinfluxofpeoplehasplacedastrainonthehostingpopulation,inparticularinareaswithahighratioofIDPscomparedtothelocalpopulation.

Thoseremaininginconflict-affectedareasofDonbasregion,particularlyindenselypopulated

urbanareas,facesecuritythreatsduetoon-goingmilitaryactivity.Basiclife-savingserviceshavebeendisrupted,accesstotheNGCAhasbeenrestricted,accesstobanksandcashservicesislimited,foodandcommoditiesareincreasinglyexpensiveanddifficulttoobtain,andanupsurgeinlawlessnesshasbeenobserved.1

AlthoughUkraineisamiddleincomecountry,thecapacityofthegovernmenthasbeenfurther

constrainedbyeconomiccrisis,tofullyprovideservicesinGCA.Itsabilitytoprovideservicesinareasnotfullyundergovernmentcontrolislimited.Inaddition,theabilityofthestatetorehabilitateinfrastructureandshelterhasbeenweakenedbythisongoingconflict.

3.2 HumanitarianResponse

BeforemovingontothereviewoftheUkraineSC,itispertinenttolookatsomeoftheexternal

factorsthathavehadimplicationsontheset-upoftheclustersystem,andthehumanitarianresponseasawhole.Firstly,theactivationoftheclustersystemwithallclustersbasedinKyivhasresultedina“Kyivcentricresponse”,removedfromdiscussionsinthefield.Consideringthesizeofthecountryandthetimerequiredtotraveltotheaffectedareas,the“Kyivcentric”set-uphasnegativelyimpactedontheentirehumanitarianresponseinUkraine.SomeorganisationshaveshiftedtheirfocusfromKyivtothefield,openingfieldofficesinSloviansk,Sievierodonetsk,Kharkiv,Donetsk,Mariupol,andDniepropetrovsk.Thislateshifttowardsthefieldhasbeenpositiveintermsoftherelevanceoftheresponse.However,thedistancebetweenthesehubsremainssuchthateachlocationappearstobeoperatingandcoordinatingindependentlyfromtheothers.

Thishasbeenexacerbatedbytherestrictionsonaccessandpermissiontooperateandprovide

assistanceintheNGCA.Manydiscussionsandmeetingshavebeenfocusingontheissueofaccess.Thisisundeniablyofgreatconcernforhumanitarianactorstryingtoprovideassistance,buttheextensivefocusononeissuehasresultedinotherchallengesbeingomittedfromdiscussions.Thishighlypoliticisedenvironmenthastoanextentdistractedthehumanitarianactors–includingclustercoordinators–fromtheircorefunctions.

1UkraineHumanitarianNeedsOverview(HNO),2015.

Page 11: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE11OF50

4. FindingsandRecommendations

Q.1 DidtheShelterClusterfulfilitscorefunctionsasdefinedbytheIASC? OveralltheSCisperceivedasoneofthestrongestandmostrelevantclustersinthisresponse.

EverykeyinformantexplainedthestrengthoftheSCcomparedtootherclustersinUkraine.However,theyalsohighlightedanumberofchallengesandrecommendations,whichwillbepresentedanddiscussedinthischapterinrelationtothecorefunctionsofthecluster.2

Thefindingsofthisstudyhavebeencategorisedintoeightsections,throughoutwhichthe

evaluationquestionshavebeendistributed:Clusteractivationandleadership;andthe6corefunctionsdefinedbytheInter-AgencyStandingCommittee(IASC),with“Accountabilitytoaffectedpopulations”asanadditionalone.ThereviewisbasedontheOECD/DACcriteria:relevance,effectiveness,efficiency,impactandsustainability.Thisstructureprovidesasuitableframeworktoreviewandmeasuretheeffectivenessofcoordinationservicesprovidedtodate.

Asummaryofkeyrecommendationscanbefoundintheexecutivesummary.Inthischapter,the

detailedrecommendationsaredistributedundertheeightheadingsmentionedabove,andpresentedinrelationwiththefindingstowhichtheycorrespond.

4.1 ClusterActivationandLeadership

Q.2 Havelessonslearntfrompreviousclusteractivationsbeenutilised?

ClusterActivation

4.1.1 AsheltersectorwasestablishedinUkrainearoundJuly2014.AUNHCRemergencycoordinatortookresponsibilityfor,andleadershipof,runningsectoralmeetings,sharingmeetingminutesandinitiatingacommonstrategy.InitialcontactwasmadewiththeGSC,whoprovidedremotesupportanddeployedtheRFPinSeptember2014totakeovertheseresponsibilities.TheclustersystemwasofficiallyactivatedbytheEmergencyReliefCoordinatoron23rdDecember2014toenhancecoordinationbetweenactorsinvolvedintheresponse.

4.1.2 UNHCRwasappointedCLAfortheSCandhasleditinpartnershipwiththeMoRDandMoSP,and

withvariousNGOpartnerscoordinatingtoprovideanappropriateresponsetothecrisis.TheRFPbecametheCCandremainsinthispositiontoday.NationalcoordinationtookplaceinKyiv,withasub-nationalhuboperationalsinceJuly2015,basedinSlovianskandledbyPeopleinNeed(PIN).TheSChashadtheadvantageofbuildingonthepre-existingsheltersectorandstaffretainedfromsectortocluster.ThiscontinuitygreatlybenefitedthecoordinationservicesprovidedtoSCpartners,andisaresultoflessonslearntfrompreviousclusteractivations.

4.1.3 InSeptember2014,thesheltersectorfirstdraftedastrategythatwaslaterupdatedbytheSC.The

mostrecentreviewoftheSCstrategydatesfromJune2015.3GiventheprotractedcrisisinUkraine,withongoingconflictdespiteanagreedceasefire,theSCadoptedadualapproach,combininglife-savingemergencyassistance,andlonger-termsheltersolutions.

Leadership

4.1.4 UNHCRasCLAhasprovidedresources,capacity,andcompetentstaffallowingtheShelterClusterTeam(SCT)tobeabletooperateeffectivelyandtakeleadershipofthesector.Ithasanticipatedthisleadershiprolebyproactivelysettingupasectoralworkinggrouppriortotheactivationofthe

2ShelterClusterToolkit,CoreFunctions,andIASCreferencemodule,July2015.3ShelterClusterStrategy,June2015,retrievedfromhttp://sheltercluster.org/response/ukraine

Page 12: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE12OF50

clustersystem.TheSCthusinheritedthemomentum,knowledgeandresourcesfromthesectoralworkinggroup,andbecamea“rolemodel”forotherclusters.

4.1.5 BetweenFebruaryandMarch2015,theSCTidentifiedtheneedofactivatingasub-nationalSChub.

Carefulconsiderationwasgiventothelocationofthehubtakingintoaccountneeds,locationshelteractors,activitiesandpoliticalengagement.Establishingasub-nationalhubwhenmostofthecoordinationstructurewasstillKyiv-centricsetaprecedentforotherclusters.TheSCTalsoconsideredtheimportanceofanotheragencyco-chairingtheSCandactassub-nationalclusterlead.InMay2015,PeopleinNeed(PIN)wasidentifiedandapproachedasapotentialpartner.Fundingwassecured,andthesub-nationalclusterbecameoperationalinJuly2015.PINmobilisedresourcesandcompetentstafftofulfiltheirrole,andaneffectivehandoverbetweentheNationalCCandthesub-nationalCCallowedforasuccessfultransferofresponsibilities.Asrecommendedinlessonslearntfromotherclusteractivations,havinganINGOasco-chairoftheSChasbeenessentialtoempowerotherINGOstoengageinthecoordinationstructure,andhasalsoincreasedtheSC’slegitimacy.Indeed,manyorganisationsacknowledgedtheimportanceofhavinganINGOasco-chair.

4.1.6 TheSChadalsodiscussedthepotentialofopeningotherhubs,mainlyinlocationswithUNHCRfield

offices.Thesehubswerenotactivated,probablyduetothesmallnumberofshelteractorsandthelimitedneedforcoordinationintheselocations.TheSCalsohadlimitedresources,andSlovianskwasidentifiedbytheSCasapriorityfordecentralisingthecoordination.

4.1.7 Anumberofmisunderstandingsarosefromtheactivationofthesub-nationalhub.Someofthem

resultedincorrectiveactions,butcertainissuescouldhavebeenanticipatedandprevented.• TheactivationprocesswaslikelynotcommunicatedwellenoughbytheCCtoUNHCR

management.ThiswasalsoexacerbatedbyUNHCRmanagementstaffturnover,includingcountryrepresentatives,emergencycoordinatorsandfieldstaff.

• UNHCRmanagementdidnotproperlyinformtheirfieldofficesandakeyinformantstated:“Thesub-nationalclusterwasestablishedwithzeroconsultationinternally[toUNHCR](…)Therewasabitofconfusion,andwhats/hewasgoingtodoinrelationtoUNHCR.”

• SomeUNHCRstaffhavelimitedexperienceoftheclustersystem.Asaresult,theyhavenotdistinguishedbetweenrefugeeoperationswhereUNHCRhastheleadershipincoordinatingtheresponse,andanIDPcontextwheretheclustersystemcoordinatestheresponseandwheretheclustersoperateindependentlyfromtheirleadagency.Consequently,someUNHCRfieldstaffhavebeenleadingsheltermeetingswithoutclearconsentfromtheSC,andwithoutsharingminutesofmeetingswiththeSCT.ThiswaspartlyresolvedbytheCC’sproactivecommunicationwithUNHCR’sCountryRepresentativeandUNHCRheadoffieldoffice.However,someUNHCRfield-officesstillleadsheltermeetingswithoutclearreportinglinestotheSCT.

• SomekeyinformantsfromtheUNHCRraisedquestionsaroundthemeaningofProviderofLastResort(PoLR).Iftheyweretoactonthisresponsibility,theyfelttheneedtoleadthecoordinationbetweenlocalactors,inordertobetterunderstandremaininggaps.

ThesemisunderstandingstookupthetimeandenergyoftheCC,andcouldhavebeenmitigatedwithdeeperunderstandingfromUNHCRstaffontheirroleandresponsibilityasCLA.

R.1

Priority

ForUNHCRandGSC:IncreaseinternalawarenessofUNHCRstaffontheclustersystem.DevelopandprovideastandardinformationpackageforUNHCRCountryRepresentativesandUNHCRstaffontheirroleandresponsibilitiesasCLA.ThisguidanceshouldexplainthecoordinationroleofUNHCRinrefugeeoperationsversusanIDPcontext,andshouldaddressmanagementandreportinglinesbetweenUNHCR-ledclustersandUNHCRstaffinmain-office,sub-officesandfield-offices.(KR-6)

Page 13: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE13OF50

WithregardstotheCLAroleasPoLR,GSCguidanceexplainsthat“Whilsttheshelterclusters’roleandresponsibilitiesrangefromemergencytolonger-termshelter,theconceptofProviderofLastResort4willonlyapplytomeetingemergencyneedsandnottotheprovisionoflongertermshelterorhousingorlongertermsettlementplanning.”5

Clusterpersonnel

4.1.8 AsofNovember2015,theUkraineSCTwasmadeupofthefollowingsixstaff:

Tab.1 Title Role Deploymentdates1 NationalCluster

CoordinatorShelterClusterCoordinator GSCRFPduring09/14;UNHCR-recruitedfrom

10/14tocurrent(doublehattinguntil04/15)2 ShelterClusterCo-Chair&

Sub-NationalCoordinatorShelterClusterCoordinator 06/15to11/15

3 ShelterAssociate* InformationManager&DeputytotheNationalClusterCoordinator

Inposition07/14tocurrent;doublehattingfrom09/14to04/15

4 Sub-NationalClusterAssistant*

TranslatortotheSub-NationalCC

06/15-current

5 InformationManagerAssociate*

GISandmapping 50%SC/50%UNHCRsince12/14

6 Intern* IMAssistant 09/15to11/15*Ukrainiannational

Fig.2

HC

HCTClusterco-chair

Sub-nationalShelter/NFICC

Sub-nationalShelter/NFIassistant

NationalShelter/NFICC

UNHCR

CountryRep

Shelterassociate

DatamanagementassociateIMO

UkraineShelter/NFIClusterCoordinationteamstructure.6

4.1.9 UNHCRhasprovidedcompetentpersonneltoruntheSC,andtheCCandsub-nationalCCbothhavepriorexperienceinclustercoordination.Additionally,theGSCdrewonlessonslearntbydeployingtheirRFPandrapidlyprovidingqualifiedstafftothecountryinneed.TheRFPwasdeployedinSeptember2014(beforetheformalactivationoftheSC)andremainstheCCtodate.

4.1.10 However,theCCandtheShelterAssociatewerenotdedicatedtotheircoordinationrolefrom

October2014untilApril2015,whenUNHCRrecruitedaShelterOfficertomanagetheshelteroperations.ThisresultedinkeySCstaffbeingoverloadedwithworkandthereforeunabletodedicateappropriatetimetothetasksrequired.

4.1.11 Inthisparticularcontext,thedoublehattingwasmentionedasproblematicbyoneorganisation,withregardstotheCashWG.SinceUNHCRandtheSCTwerestronglyalignedwhileanumberofotheragencies’perspectivedifferedfromUNHCR,itwasperceivedthatUNHCRusedtheclusterasleverageduringdiscussionsintheCashWG.7

4.1.12 Thatsaid,mostotherorganisationsperceivedthedoublehattingaswellmanagedbyboththeCC

andtheShelterAssociate,andfeltthatoncethededicatedUNHCRShelterOfficerarrived,acleardistinctionbetweentheclusterandUNHCRasleadagencywasobserved.

4RefertoIASCdefinitionoftheProviderofLastResort,IASCReferenceModule,July2015.5ShelterClusterToolkit,Scopeofcountry-levelshelterclusters.6AdaptedfromUkraineShelterClusterTermsofReference(Annex3totheUkraineShelter/NFIClusterStrategy).7Refertosection4.4.14to4.4.18forfurtherinformationonCashWG.

Page 14: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE14OF50

R.2 ForCLAandGSC:TheindependenceoftheCLAfromtheSCTisessentialinenablingtheviewsandinterestsoftheentiresectortoberepresented.ItisthereforerecommendedthatUNHCRandtheGSCdeploydedicatedteamstoruntheSC,andinparticulardeployadedicatedCC.8

4.1.13 TheCCmobilisedstaffwithinUNHCRinordertoacquireasmuchhumanresourcesaspossiblefor

thecluster.TheShelterAssociate(whomainlyfocusedonIM)wasretainedasdedicatedstaff.AnIMAssociatesupportingbothSCandUNHCRwithdevelopingmapshasrecentlybeenprovidingmoresupporttotheSC.TheCCalsorecruitedaninternforadditionalIMsupport.

4.1.14 ThepositivecollaborationandworkatmospherebetweenUNHCRSCstaffandPINSCstaffgreatly

benefitedthefunctioningoftheteam.TheSCThasbeeneffectiveatprovidingrelevantdatatoSCpartners,aswellasleadingtechnicaldiscussionsonreconstruction,repairs,andwinterisation.TWIGsprovidedaunifyingplatformforSCpartnerswhilstbeingstronglyactionoriented.

HQ/GlobalClustersupport

Q.3 WasthereevidenceofsupportfromtheGlobalShelterCluster?

4.1.15 TheGSChasprovidedsupporttotheUkraineSCfromitsinception,includingthedeploymentoftheRFP,theREACHassessment,supportinsettingupthewebsite,andremoteassistanceondevelopingstrategicdocumentsanddealingwithdiscussionsaroundtheCWGledbyOCHA.TheGSCcarriedouttwofieldvisitstoUkraine,oneforcoordinationsupportinFebruary2015,andoneforIMsupportinAugust2015.Asaresultofthesevisits,theclusterstrategywasrevisedandredrafted,TWIGTermsofReference(ToRs)wereprepared,andtheactivationofasub-nationalhubwasagreedandfundingwasidentified.TheGlobalIMalsoprovideddirectsupportwithafieldvisitandin-depthrecommendationsandactionpointstoimprovetheIMservicesprovided9.InOctober2015,theCCandtheShelterAssociateattendedtheGSCmeetinginGeneva.ThisguidanceandsupportprovidedbytheGSChasbeenvaluedbytheSCTandfurthersupportwouldbewelcomed,especiallyinregardstoimprovingsynergieswithothercountryclusters.

R.3 ForGSCandSCT:Improvecross-fertilisationbetweendifferentcountryclusters.Itwasrecognised

thatinJuly2015,theGSChassetupaGooglegroupforthatpurpose.

4.1.16 ItwasalsonotedbytheGSCthatcommunicationwiththeUkraineSCTandCCwassomewhatinconsistent,attimeslackingresponsivenessfromtheCC.ItwasalsounderstoodthattheSCTandCCwereextremelystretchedduringtheperiodofdouble-hatting,andthereforeunabletoupdatetheGSConaregularbasis.

R.4 ForGSCandSCT:Improvecommunicationbetweenglobalandcountrylevelthroughregular

scheduledupdates,onamonthlyorquarterlybasisdependingonneeds.ThiswouldallowtheGSCtoprovidemoreappropriatesupport,anticipatingcertainissuesandprovideaplatformofexchangefortheCC.

4.1.17 ThedoublehattingofthetwoSCstaffwasresolvedinMay2015oncetheUNHCRShelterOfficer

wasrecruited.Thistooklongerthanexpectedduetorecruitmentprocesses. RelationswithIASCactors

4.1.18 RelationswiththeHCandHCThavebeenminimalsincetheCCdoesnotdirectlyattendHCTmeetings,anditisattendedbytherepresentativeofCLA.Referto4.3.4formoredetails.

8RefertoIASCReferenceModule,July2015,p5andp11.9RefertoAnnexH

Page 15: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE15OF50

4.1.19 TherelationshipbetweenOCHAandtheSChasbeensomewhatfragile,aresultofthehighnumberofrequestsfromOCHAtoCCsthatwerenotalwaysseenasapriorityfortheSCTandSCpartners,aswellastheongoingissueswiththeCWGdescribedin4.4.14to4.4.21.

R.5 ForGSC:Provideglobalguidanceonwhichinter-clustercoordinationtools,reports,andreviewsaregenerallyperceivedasapriority,whichonesarecompulsoryfortheSCtocontributeto,andwhichonesarealowerpriority.RefertoAnnexG.

4.1.20 TherelationsbetweenOCHA,theSCandSCpartnersatfieldlevelhavebeenmoreeffectivethanin

Kyiv.OCHAcallsforGeneralCoordinationmeetingsinvarioushubsintheGCAandNGCA,whichareattendedbyareamanagersandthesub-nationalSC.Akeyinformantnotedthat“OCHAhasfilledanimportantrolebuildingrelationshipsinthefieldbetweenpartners”andinsomeareaswithlocalauthorities.DespiteitbeingmentionedthatsomeoftheOCHA’sstaffwerenotexperiencedcoordinators,theyneverthelesshadagoodknowledgeofthecontext.

R.6 ForSCT:Lessonslearnthaveshowntheimportanceofstrengtheningpositiverelationships,thusit

wouldberecommendedfortheSCTtofocusontheirrelationshipwithOCHAinthefield.

4.2 Supportingshelterservicedelivery(Corefunction#1)

Q.4 Towhatextentdidtheclusteraddvaluetotheresponseundertakenbyshelteractors?Q.5 Wouldithavebeenpossibletoaddthesamevalueinamoreefficientway?

4.2.1 TheshelterresponseinUkrainehasincludedrehabilitationandwinterisationactivities,aswellas

cashassistanceandcashforrent.TheSChasbeenaddingvaluetotheresponsebyaimingtofulfilitscorefunctionsandbysupportingservicedeliverythroughcoordinationandinformationmanagement,technicalsupportandintegration(see4.8.4and4.8.5formoredetails).ThissectionwillexplainhowtheSChasaddedvalueandwhereitcouldhavedonethisinamoreefficientway.

Coordinationmanagement

4.2.2ASAGmeetingwasfirstcalledinDecember2015,althoughtheSCStrategydocumentfromJune2015listsnamesofpermanentSAGmembers.TheCCexplainedthatduetotheset-upandlimitednumberofactiveSCpartners,alldecisionsanddevelopmentofstrategicdocumentshappenedinplenaryduringSCM.Therefore,theCCdidnotconsideritaprioritytocalltheSAG.

R.7

Priority

ForCCandSCT:WhileasmallandfunctionalSCMcanbeaneffectivedecisionmakingplatformforstrategicpriorities,itisrecommendedtoestablishaSAGwithagreedToR,acommittedgroupoforganisationsincludinganactiveandconsciousparticipationofrelevantdonors.SAGmembers’responsibilityextendsbeyondregularclusterattendance,andshouldbeformalised.(KR-4)

4.2.3 TheSCMeetings(SCM)inKyivwereheldweeklyuntilMarch2015.Sincethentheyhavebeen

runningonafortnightlybasis.Atsub-nationallevel,SCMhavebeentakingplaceonanad-hocbasisuntiltheappointmentofadedicatedco-chairandsub-nationalCC.SinceJuly2015,SCMhavebeenrunningonamonthlybasisinSlovianskorKramatorsk,withsomeadditionalad-hocmeetingsinSievierodonetsk,Dniepropetrosk,Kharkiv,Zaporizhzhia,andDonetsk.SCMhavegenerallybeenrunningconsistently,althoughdataanalysisonclustermeetingsshowedthattheywerenotconsistentlytakingplaceonthesamedayoftheweekorinthesamelocation.Thiswaslikelyinordertoremainflexibleandprovidemeetingsonthedaysandinthelocationsthatsuitedmostactors,howeverconsistencyintimeandplaceofmeetingscanallowformoreregularpartnerengagementandabroaderreachtolessactiveSCpartners.

4.2.4 InMariupolandSievierodonetsk,SCpartnershaveheldinformalsectoralmeetingsonaweekly

basistobettercoordinatetheirfieldoperations.Intheselocalities,therewasnodedicatedshelter

Page 16: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE16OF50

focalpoint,yetmeetingswereperceivedasuseful.UNHCRfieldofficeshavealsobeenrunninginformalsectoralmeetingswiththefewactorspresentintheirlocation.InKharkivandDonetsk,forinstance,theheadsofsub-officehavecalledshelterandprotectionmeetingsonaregularbasis.However,noneofthesemeetingshavebeenconsistentlyfeedingbacktotheSCT.Thead-hocandflexibledecentralisedcoordinationstructurehasallowedformeetingstotakeplaceinvariousfieldlocationswheretheSCTwasnotabletoestablisharegularpresence.However,theSCThasnothadtheopportunitytoadequatelyrespondtocertainissuesduetotheinformalnatureoftheset-up.

R.8

Priority

ForSCT:StandardisetheinformalsheltermeetingsthatarenotledbytheSCT,whilstremainingflexibleandsupportivetothoseleadingthem.FormalisingthedecentralisedhubswouldenabletheSCTtoimproveitsleadershiprole,strengtheninformationflows,andallowfortheSCTtobeproactiveratherthanreactive.ThiscouldalsoprovidetheSCwithfurtherreach,withregardstothecoordinationservicesprovidedtopartners.(KR-2)� Identifyfocalpoint(s)toreporttoSCT� AnnouncemeetingsthroughtheSCmailinglistsothatotheractorsintheareamayattend� Shareminutesofmeetingtemplatewiththoseleadingthemeetings� Requestminutesofmeetings,andsharewithSCpartnersforaccountabilityandpreparedness

measures� PromoteSCreportingtools(5W)� Sharecontactlists

4.2.5 AllSCMinSlovianskincludedrepresentativesfromlocalauthoritiesexceptone(27thAugust2015).

TherehasalsobeenasolidrepresentationofnationalNGOs,churchesandcivilsocietyorganisations(CSOs).Thefirstsub-nationalSCMinSievierodonetskwasattendedby14agencies,includingrepresentativesfromLuhansklocalauthorities(intheNGCA).ThetwonextmeetingsinSievierodonetskwasattendedby5and7stakeholdersrespectively,alloftheminternational.

4.2.6 SomeactorswereunsureoftheSC’sgeographicalcoverage,andunderstoodthattheSCwasnot

coordinatingcertaingeographicalareas:“Whenthesub-clusterinSlovianskwasestablished,theywereplanningtoincludeacitywhichwaspartofKharkivareaandthecoverageofthesub-clusterwasonlyclarifiedlater”.WhiletheSCTmightnotberunningSCMinalloperationalhubs,theSCshouldcoverallaffectedareasthroughaclearstructurethatcouldincludethedecentralisedcoordinationsystemledbyotheragencies.

R.9

Priority

ForSCT:Developanddisseminateanorganisationalmapofthecoordinationstructure,10withthesub-nationalsubanddecentralisedhubs.ThiswouldprovidetheSCTwithfurtheraccountabilityandtransparencyonthecoordinationstructurealreadyinplace.(KR-2)

4.2.7 Therehavebeen67meetingsin2015,includingTWIGs,nationalandsub-national.Meeting

minutesarepreparedandsharedregularlythroughtheGoogleGroup,while35meetingminutesoutof67fromthesameperiodarefoundontheclusterwebsite(52%).

R.10 ForSCT:Consolidateasystematiccoordinationmanagementapproachby:

- SharingdraftSCMagendapriortoSCMwithpartnersallowingthemtocontributeitems.- Consistentlydraftingandsharingofmeetingminutes:includingnameoforganisations

attendingforaccountabilityandreportingpurposes,andrecordingofkeydecisions.- UploadallmeetingminutesandrelevantdocumentsontheSCwebsite,withrelevanttags.

Whenandwherepossible,allowremoteattendanceviatelecomtoextendthereachofSCM.

4.2.8 TheSChasalsocarriedoutanumberofTWIGstodiscussanddevelopguidelinesontechnicalissuesincludingwinterisation,cash,permanentshelter,HLP,andheavyrepairs(Referto4.4).

10ForanexamplerefertoShelterClusterPhilippinesHubOverview,sheltercluster.org

Page 17: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE17OF50

Informationmanagement

4.2.9 OveralltheSChasbeenvaluedfortheinformationitproduces,includingmapsandanalysis,butthisinformationissometimeshardtofind.TheGooglegrouphasbeenaneffectivetooltocommunicatewithSCpartnersbutitislessefficientforstoringdocuments.11KeyinformantshavebeencontactingtheSCTdirectlytoacquireinformation,sincethewebsiteoftendoesnotcontainthelatestupdates.ThisshowsthattheSCTisveryresponsivetoSCpartnersbutitisnotanefficientwayofdisseminatinginformation.ThetablebelowclearlyshowsthatSCpartnerstendtoretrievemostoftheSCinformationfromemailsandthewebsite.

Tab.2 Sourceofinformation >3/week 1-3/week 1-3/month <1/month never

Emails 4% 41% 48% 4% 4%Website 4% 15% 41% 30% 11%Googlegroup 4% 15% 19% 26% 37%Onlinesurveyrespondersindicatingthefrequencyofuseofdifferentsourcesofinformation.

R.11 ForSCT:Improvethedisseminationofinformationthroughconsistentuploadofalldocuments

sharedwithSCpartnersontheSCwebsite,essentiallyusingthewebsiteasadepositoryofdata.AmoreeffectiveuseofthewebsitecouldallowSCpartnerstofindtheinformationtheyneedindependentlyandthiswouldreducetheneedforone-to-oneintensivepartnersupport.

4.2.10 DespitetheeffortsoftheIMteaminproducingrelevantdataanalysis,thelackofbaselinedata

remainsachallengetoprovidingaclearpictureofthecontext.ThelackofinformationfromNGCAishighlightedbymostkeyinformants,andisduetolackofaccessandsecurity.Butthereisalsoalackofbaselinedataonhousingdamage,needsandgapsinGCA–despiterelativelystableaccesssinceFebruary2015.ExcludingtheREACHassessment(Referto4.2.11below),therehasbeennoinitiativetocarryoutaquantitativehouseholdleveldamageassessment,asakeyinformantexplained:“Westilldon’tknowhowmanyhouseshavebeendamagedandhowmanyhavebeenrepaired”.ThecurrentSCbaselinedataisbasedontheREACHassessment,arepresentativesampleonlyfocusedonIDPs.Thisprovidesinitialdatabutissubjecttoobviouslimitations.

4.2.11 TheREACHassessmentwascarriedoutto“facilitatetheestablishmentofabaselineofthe850,000

IDPsregisteredbyMoSP”andprovidedadditionaldatatotheexistingmulti-sectorialneedsassessment.Thisassessmentwasgenerallyverywellreceived,especiallyconsideringthegenerallackofbaselinedata.However,afewactorshadconcernsabouttheREACHprocess.DespitetheassessmentteambeingdeployedtoUkraineforabout4weeksbetweenMayandJuly2015todevelopaquestionnaireincollaborationwithSCpartners,someactorsbasedinthefieldfeltexcludedfromtheprocess.Whilethequestionnairewascirculatedforcomments,severalinformantsmentionedthattheywereonlyinformedafewdaysbeforetheassessmentwasgoingtotakeplace.ThisfeedbackreflectsthechallengeofKyivbeingdisconnectedfromthefield.TwootherinformantsalsomentionedthattheREACHassessmentonlyfocusedonIDPs,thusrepresentingonlyoneportionofthebeneficiariestargetedbytheSC.Asaconsequence,agenciesrequestedapilotassessmentofnon-IDPsinothergeographicalareas.

R.12

Priority

ForSCandSCT:Workonimprovingtheoverallbaselinedata,includingGCAandaccessiblepartsofNGCA.ThedatashouldincludehousingdamageandvulnerabilitiesofalltargetgroupsdetailedintheSCstrategy.TheSAGshouldadviseonhowtocarryoutsectoralassessments,definingthetargetpopulationandgeographicalarea.LeverageonCLAandco-chairwithaccesstoDonetskandLuhansktogatherfurtherdataonlocalitieswhereothersmightnothaveaccess.(KR-3&4)

11RefertheMissionReport,GlobalShelterClusterIMmissiontoUkraine,BoHurkmans,August2015.ThisreportprovidesdetailsrecommendationtotheUkraineShelterClusterandGSConhowtoimproveIMservices.RefertoAnnexH.

Page 18: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE18OF50

4.2.12 ItseemsthattheIMservicesprovidedhavefocusedmoreonthe“bigpicture”,providingusefulinformationforKyiv:headsofagencies,government,anddonors.Indeed,somekeyinformantshavenotedthat“theinformationisproducedmoreforKyivthanforthefield”.Thiscouldbeexpected,astheSCofteninitiallyfocusesonprovidinganoverviewofthecontext,andthencollectsmoredetaileddataforadditionalfield-levelanalysis.Forexample,theSCTrecentlyreleasedamapontheGreyzoneforwinterisation,gapsanalysisofDecember2015,providingfieldlevelgapanalysis,perceivedasamoreusefulforimplementingstaff.

4.2.13 Additionally,itwasmentionedbyanumberofkeyinformantsthattheInternationalCommitteeof

theRedCross(ICRC),whoremainanobservertotheSC,providealargeamountofshelterassistancethatisnotalwaysrepresentedintheinformationanalysisdevelopedbytheSCT.

R.13

Priority

ForSCT:Continuetoprovideanoverviewofthecontext,whilealsoproducingmoredetailedneedsandgapsanalysis,maps,graphsandotherusefultoolsrelevantaimedatthefieldlevel.ExploreopportunitiesofimprovingtherepresentationofSCobserverswithsensitivedata(suchasICRC)intheanalysistoprovideacleareroverviewofthecoverageandgaps.(KR-3)

4.2.14 Allfurtherrecommendationoninformationmanagementshouldbereferredtothemissionreport

ofBoHurkmans,GSCIMAssociatefromAugust2015.RefertoAnnexH. Integration

4.2.15 TheSCTconsistsmainlyoflocalstaff,withtheexceptionoftheNationalCCandsub-nationalCC.TheNationalCCisfluentinRussian,whichhasbeenofgreatadvantageinengagingawiderrangeoflocalactors,authoritiesandNNGOs.Thesub-nationalCChadadedicatedtranslatortoprovidesupportduringmeetings.Althoughtheset-upofthehumanitarianresponselackslocalinvolvement,theSChasdoneitsbesttoprovideanopenplatformforintegratingnationalactorsandallowingfortheirparticipationinSCM,alsowitnessedbythetranslationofkeydocumentsintoUkrainianandRussian.Despitethis,fewNNGOsattendclustermeetings,mainlyduetoalackofawarenessoftheclustersystemandhumanitarianstructure.

4.2.16 Integrationwithauthoritieshasbeenchallengingformanyactors.Referto4.7.4-4.7.13.

4.3 Informingstrategicdecision-makingbytheHC/HCT(Corefunction#2)

Q.6 HastherelationshipwiththeHCTandtheclusterbeeneffective?

4.3.1 TheHC/HCThasbeencriticisedasaweakstrategicdecision-makingbodybymostkeyinformants

interviewedforthisreview.“TheHCTisnotveryeffective.Someactorspresenthavealotofexperience,andotherstaketoomuchspacewithnoexperience”.AlthoughtheHCTshouldbeaneffectivedecisionmakingplatforminUkraine,withahighnumberofINGOsrepresentedandMSFandICRCattendingasobservers,thismechanismhasbeenadysfunctionalplatformforreasonsdetailedbelow.

4.3.2 ItwasnotedthattheHumanitarianCoordinator(HC)isUNDPstaffhasbeendescribedashaving

limitedexperiencewithhumanitarianresponse.ThishasmeantthatOCHA,whoactsasasecretariattotheHC,hasbeenoverwhelmedandhasinherentlytakenleadershipondecisionsrelatedtohumanitarianissues.The“weakHCThasprovidedroomforOCHAtomonopolisethedebate”andOCHA“isworkingbeyonditsmandate”.ThelackofleadershiphasmadetheHCTintoareactiveratherthanproactiveplatform,“certainissuesarenotbeingputonthetableandarenotbeingdiscussed.TheonlyfocusoftheHCTisaccreditation(meaningaccess).”

4.3.3 TheHCThasbeencriticisedforlackofaccountabilityandtransparency,withnoorveryfew

minutesofmeetingsshared,andnoofficialrecordofthediscussionsanddecisionsmade.Some

Page 19: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE19OF50

NGOshavestatedthattheyhavepushedforsomedecisionstobetakenattheHCTmainlytomoveforwardwithimplementingtheresponsebecausetheHCTdoesnotprovideaneffectiveplatformfordiscussion,debate,ornegotiation.

R.14

Priority

ForGSCandUNHCR:RequestforaccountabilityandtransparencyoftheICCGandHCT,byaskingHCT/OCHAforallmeetingminutes,reports,assessmentsandotherrelevantdocumentsproducedforICCGandHCTmeetingstobesharedandpublishedonhumanitarianresponse.info.(KR-7)

4.3.4 TheCCdoesnotattendHCTmeetingsandtheclusterisrepresentedbytheCLA.Althoughthisis

commonpractice,insomecountriestheCCjoinsHCTmeetingstoprovidetechnicalsupportandensurethattheinterestsoftheclusterarerepresented.InUkraine,thenon-attendanceofCCsinHCTmeetingshasbeenquestionedassomedecisionsmadeinHCTmeetingsrequirethetechnicalknowledgeofasectoralrepresentative,whichaCLArepresentativemightnothave.InJuly2015,followinganHCTretreat,arecommendationwasmadetoincludeCCsasobserversandadvisorsduringHCTmeetings.Thisrecommendationwasneveractionednorimplemented.

R.15

Priority

ForUNHCRandSCT:RequesttheHCTtoactonits’decisionfromtheJuly2015retreat,toinviteCCstoHCTmeetings.Untilthen,theSCTistoprovidetheCLArepresentativewithSCupdatespriortoeachHCTmeeting,andorganiseadebriefingsessionwiththeSCTafterwards.(KR-7)

4.3.5 Additionally,thereisthequestionsofhowaCLAcanrepresentitsagencyandthesector(s)itleads

inHCTmeetingswhentheopinionsofthetwodiffer.ShouldtheCLAhaveadditionalvotes:onefortheorganisationandoneforeachclusteritrepresents,orshouldtheCCbepresentduringHCTmeetings?AlthoughCLAhasaroleinsupportingtheCCinsituationswhererelationswithotherIASCactorsarefragile,thiscannotalwaysbeachievedduetoperceivedconflictsofinterest.Asaresult,thecluster’sopinionisoftennotrepresentedatHCTmeetings.

4.3.6 DonorsdonotusuallyattendHCTmeetingsinUkraine.However,insomecountries,toensurethe

donorcommunityisinvolvedindiscussionsanddecision-making,adonorrepresentativemaybeinvitedtoallHCTmeetingorquarterlyHCTanddonormeetingsareorganised.InUkrainetherehasbeenonlyonemeetingwithHCTmembersanddonors.ThissuggeststhatthereisaneedtostrengthencommunicationbetweentheHCTandthedonorcommunity.

R.16 ForUNHCRandSCT:AdvocatetheHCTtoexplorewaysofinvolvingthedonorcommunityinthis

humanitarianplatform,withtheaimofincreasingitsrelevanceandeffectiveness. Jointassessments

4.3.7 AnumberofjointassessmentshavebeencarriedoutinUkraine.TheOCHA-ledHumanitarianSituationMonitoring(HSM)wasfirstpublishedinDecember2014,andhasprovidedanongoingsourceofmulti-sectorinformation.Evenifthisinitialdatawasincomplete,itformedthebasisofthe2015SRP.However,itwasexplainedbyanumberofkeyinformantsthattheHSMprovidedaverylimitedoverviewofthecontext,thatthemethodologywasbasedonasampleof66raions12outof172mostaffectedraions,thatthecommunitylevelassessmentwasbasedonkeyinformantinterviews,andthattheinstitutionalassessmentfocusedoneducationandhealth.ForSCpartnersthisprovidedaverylimitedoverviewastheirneedforhouseholdleveldatawascrucialtostrategicallyplantheirprogrammes.

4.3.8 BetweenFebruaryandMarch2015,theUkraineNGOsForumcarriedoutaMulti-SectorNeeds

Assessment(MSNA)toacquireabetteroverviewofneedsintheDonbasregionandinformthedesignofhumanitarianresponses.Theassessmentprovidednewusefuldataandabetteroverviewofthesituation,butduetotheaccessrestrictiontothemostaffectedareas,thiscouldstillnot

12RaionsarethesecondlevelofadministrativedivisionofUkraineandareprimarythemostcommondivisionofregionsofUkraine.

Page 20: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE20OF50

serveasabaselinefortheSC.InJuly2015ashelterREACHassessmentwascarriedoutandprovidedadditionaldatatotheexistingHSMandMSNA,seesection4.2.11.

4.3.9 TheHNOthatwascarriedoutinDecember2015fortheHRP2016,didnotprovideclusterswith

anyparticularlynewinformation.Additionally,theoutcomeofthereportwasnotofficiallysharedwiththenationalauthorities.Manyoftheassessmentsdetailedaboveweredevelopedwithoutconsistentsupportorinclusionofnationalactors,NNGOsandauthorities.

4.4 Strategy,planning,policyandstandards(Corefunction#3)

Q.7 Hastheclustereffectivelysetitspriorities?Aretheregapsinthesepriorities?

ShelterClusterStrategy

4.4.1Toestablishpriorities,theSCusuallyusestheSAGasaforumfordiscussionanddecision-making.InUkraine,thefirstSAGmeetingwasonlycalledinDecember2015,anduntilthenallstrategicdecisionsandprioritiesweredefinedinplenaryduringSCM.ForfurtherinformationontheSAGreferto4.2.2.

4.4.2 TheSCstrategydocumentthatsetsoutthesectoralprioritieswasfirstdraftedinSeptember2014

andlaterrevisedinJune201513.The2014strategyclearlydefinespriorityactivitiesandthepopulationofconcern,whichincludes“IDPs,communitiesdirectlyaffectedbytheconflict,returnees,hostcommunities”.Thedocumentalsoemphasisesonwinterisationassistanceandthe“onewarmroom”concept,NFIdistribution,cashassistance,transitionalandrecoveryshelter,aswellasreconstructionincludingofbasicinfrastructure.

4.4.3 Therevised2015SCstrategytakesadualapproach,combininglife-savingemergencyassistance,

andlonger-termsheltersolutions.14Thedocumentprovidesdetailsontargetgroupsandnewclusterobjectives.Theseobjectivesemphasisethreepoints:(1)themostvulnerablelivinginGCAandNGCA,(2)harmonisationoftechnicalstandards,and(3)decentralisationofthecoordination.Thestrategyalsoelaboratesonbeneficiaryselection,cross-cuttingissues,advocacy,contingencyplanning,andpresentskeychallenges,suchasaccess.

4.4.4 Theonlinesurveycarriedoutforthisevaluationstatesthat45%ofrespondentsconfirmhaving

beenpartofdevelopingtheSCStrategy,and59%and15%oftherespondentsperceivetheprioritiesasbeingrelevantandveryrelevant.Only3%perceivetheprioritiesasnotbeingrelevant.75%oftherespondentswhoseetheprioritiesasveryrelevantcomefromNNGOs.Additionally,52%ofrespondentconfirmhavingadaptedtheirprogrammeaccordingtotheprioritiesandgapsidentifiedbytheSC.Accordingtothemajorityofpartners,theSChaseffectivelysetoutprioritiestorespondtotheneedsoftheaffectedpopulation.

4.4.5 Yet,twokeyinformantsrepresentinglargeagenciesmentionedthatuntilJune2015,theSChad

mainlyfocusedonassistancetoIDPs(referringtotheIDP-focusedREACHassessmentasanexample)whiletheirorganisationswererepairingandreconstructinghousesofthenon-displacedpopulation.Additionally,asmentionedpreviouslytheREACHassessmentwasalsoonlyfocusedonIDPdata.Oneofthekeyinformantquestionedhowandwhenthisdecisionwasmade.AlthoughbothstrategydocumentsfromSeptember2014andJune2015clearlymentionthattheSCtargetpopulationiswiderthanjustIDPs,itseemsthatsomelargeactorswerenotwellinformedofthepriorities.Thiscouldalsobeexplainedby:

13ShelterClusterStrategy,June2015,retrievedfromhttp://sheltercluster.org/response/ukraine14idem

Page 21: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE21OF50

� WeakdisseminationofkeydocumentsincludingtheSCstrategy(RefertoR.11&R.17).Forexample,the2014SCstrategyisnotavailableonthewebsite(possiblyreplacedbythemostrecentversion),eventhoughitwouldbeusefultoincludeitfortransparency.

� Highturnoverofstaffinagencies,whichmeansthatsomeinformationisnothandedoverandtheSCdoesnotsystematicallysharekeydocumentswithnewarrivals.

� DisconnectionbetweenthefieldandKyiv,andthechallengeincommunicatingdecisionswithfieldactors.Indeed,mostofthestrategicdiscussionsaretakingplaceinSCMinKyiv,despitetheoutcomepotentiallyhavingasignificanteffectonthefield.

R.17

Priority

ForSCT:Developastandardpackageofkeydocuments.Forexample,theSCPhilippineshaddevelopedaTechnicalIndexdocumentwithlinkstoallkeytechnicaldocuments.ThiswasausefultooltoincreasethedisseminationofkeydocumentstonewSCpartners,andtohandoverallkeySCdocumentstonewlyarrivedstaff.(KR-3)

4.4.6 Althoughthegeneralperceptionsuggestsasatisfactoryprioritisationofactivities,someindividuals

expressedtheneedtorefinetheprioritisation.Forexample,afewkeyinformantshavehighlightedtheoutstandinghumanitarianassistanceinNGCAandstressedtheimportanceofprioritisingtheseareas.DuetotherestrictedaccessofNGCAandthecurrentbroadprioritiessetoutbytheSC,manyagencieshavebeenpreventedfromprovidingassistanceinNGCAandhavere-targetedtheirassistancetoGCA,leavingvulnerablefamiliesinNGCAwithnosupport.

R.18 ForSCTandSC:RefineSCstrategicprioritieswithstrongerdataforNGCA.TheSCshouldwork

towardsidentifyingthespecificneedsandassistancerequiredinNGCAandbetterguidegeographicalprioritisation,differentiatingtheneedsofDonetskandLuhanskastwodistinctlocations.TheSChastheadvantageofbeingledbyPINandUNHCRwhobothhavebeengrantedaccesstoNGCA.

HumanitarianResponsePlan(HRP)

4.4.7 TheHRPistheinter-sectoralstrategydocumentthatsetsoutpriorities,andpresentsprojectsoractivitiespersectormatchedwithfundingfortheoverallcountrystrategytoberealised.Itisbroaderthanthesheltersector,andtheprioritiesareoftenextractedfromsectoralstrategies.

4.4.8 The2015SRP(nowcalledHRP)wasdraftedveryquicklywithminimalbaselinedata.Manykey

informantsexplainedthatitwasnotaparticularlysuccessfuldocumentduetothelimitedtimeframeprovidedtodeveloparelevantdocumentinaconsultative,accountableandtransparentmanner.EventhoughitwasrevisedinFebruary2015,mostsectorsexplainedthatthebaselinedataavailableatthattimewaslargelyinaccurate.TheOCHAHeadofOfficealsoimposedanactivity-baseddocumentratherthanaproject,whichwasnotwelcomedbyclusterpartnersnorbytheSCT.Asaresult,therelevanceofthe2015SRPhasbeenquestionedbyanumberofkeyinformants.

4.4.9 The2016HRPhasreceivedmixedfeedback.Inafirstinstance,theCCsweresuccessfulin

convincingOCHAinmakingtheHRPaproject-baseddocumentratherthananactivity-basedone.Secondly,anumberofSCpartnersexplainedthatgoingthroughtheprocessofdevelopingthedocumentwasuseful,asitforcedthemtothinkstrategicallyaheadoftimeandtoplantheiractivitiesaccordingly.TheSCTconvenedanumberofHRPmeetingstodevelopanactivitymatrixwithdetailedactivities,costs,durationandtimeframe.HarmonisingtheseactivitiesallowedSCpartnerstodeveloptheirownproposalswithmoreconfidenceanddetails,sincethemomentumoftheseHRPmeetingsprovidedusefuloperationaldiscussions.

4.4.10 EventhoughtheSCembracedtheHRPprocessallowingorganisationstostrategicallydeveloptheir

programmefollowingacommonstrategy,itwasstillverymuchperceivedasaKyivcentric,inefficientprocess,especiallysincethefocuswasonfunding.Indeed,theUkraineHRPseemedto

Page 22: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE22OF50

bemainlyusedtoattractandjustifyfunding.However,someofthedonorsexplainedthattheyusuallyselectagenciesbasedonpreviousexperiencesworkingtogether,ratherthanontheHRP.

4.4.11 Finally,donorsalsomentionednothavingbeeninvolvedintheprocessofpreparingtheHRP.This

includestheSC.Asaresult,donorswerepresentedwithafinaldocumentanda“catalogueofprojectswhichwerenotprioritised”.ThismeansthattheHRPhasperhapsbeenamoreusefulprocessthroughwhichagenciescandevelopacommonstrategywithactivitiesandbudgets.However,fordonorsitdoesnotprovideaclearoverviewofthehumanitarianpriorities,norisitperceivedtobedevelopedinacollaborativeandconsultativemanner.

R.19 ForSCT:InvolvedonorsinthedevelopmentoftheSCsectionoftheHRP. WorkingGroups

4.4.12 TechnicalWorkingGroups(TWIGs)wereestablishedinresponsetoaneedtodiscussandresolvetechnicalissues.TheSCstrategy15identifiesthreeTWIGscurrentlyestablished:(1)PermanentSheltersolutions,(2)ShelterandNFImonetization,and(3)HousingLandandPropertyRights–thelatterinpartnershipwiththeProtectionCluster.ThedeskreviewhasidentifiedtwoadditionalactiveTWIGs:WinterisationWG,andaheavyrepairsWG.

4.4.13 MostSCpartnersmentionTWIGsamongthegreatestaddedvalueoftheSC.“ThewinterisationWG

wasthemostsuccessful,itreallyunifiedeveryone”;“theSChasbeenveryuseful,especiallythroughthetechnicalWG,andharmonisingtheresponseatdifferentlevels”;“ThedocumentthatcameoutoftheTWIGswasverygood,theydidalotofworkandtherecommendationthatcameoutisrealistic”.Itallowedshelterprogrammemanagerstodevelopbetterstrategiesandprojectproposals.ItalsoaddedweighttosubmissionstotheirHQanddonors,anditbroughtagenciestogetherfocusingonoperationalissuesratherthanpoliticalbarriers.TheseTWIGshavebeensousefulthatmostagencieshaverequestedformoretechnicaldiscussions.

R.20 ForSCT:ContinueitseffortsinidentifyingtechnicalissuesandaddressingthemthroughTWIGs.

CashWorkingGroup

4.4.14 TheSCalsoleadaCashWG(CWG),whichwaslaternamedtheSCMonetisationWG,whenOCHAtooktheleadinrunninganinter-clusterCWGinApril2015.ThisWGresultedinusefuldiscussionsbutalsoraisedanumberofissuesanddisagreementsdetailedhere.

4.4.15 AcashadvisorfromUNHCRcametosupportUNHCR’soperationsandprovidedsupporttotheSCT

leadingtheCWG.ThisresultedintheSCtakingtheleadamongstotherclusterstoharmonisetheMulti-PurposeCashGrant(MPCG)transfervalue,wheremanyagenciesincludingOCHA,donorsandtheFoodSecurityClusterandmanyotherswereinvolved.ThevalueagreedinFebruary2015wasgoingtoberevisedinMay201516,butanewvaluewasonlyagreedinAugustafteranadditionalthreemonthsoflengthilydebateanddisagreements.AkeyinformantexplainedthatUNHCRmighthaveinfluencedthepositionoftheSCT,whichwouldhavecontributedtowardsexacerbatingthenegotiations.

4.4.16 TheSCTsoughtadvicefromtheGSCteamwhenOCHA’sCWGwantedcashtobecomeaseparate

sectionintheHRP2016.SinceMPCGrespondedtomulti-sectoralneedsitwasconsideredthatthisshouldbemonitoredseparatelyfromclusteractivities.However,extractingtheseactivitiesfromeachclustermonitoringresponsibilitywasanissuefortheSCandotherclustertobeableidentifygapsandcoverageoftheirownsector.TheHCTtookthefinaldecision,agreeingtomakecasha

15ShelterClusterStrategy,June2015,retrievedfromhttp://sheltercluster.org/response/ukraine16MeetingminutesfromCWG,20April2015.

Page 23: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE23OF50

separatesectionintheHRP.ThisconflictedwiththeGSCposition,andalthoughtheywereinformedofthedebate,theywereunabletoprovideleverageintimetosupporttheSCininfluencingthedecisionincountry.TheGSCtookthisissueseriouslyandhascommissionedfurtherresearchoncashandsheltertoinformtheirdecisionmaking.

R.21 ForGSC:Suchcountry-leveldisagreementsmayhaverepercussionsontheSCnotonlynationally,

butalsogloballyasthesedecisionscouldbeusedasprecedentsofgoodpracticeforfutureemergencies.WhentheGSChasapositionthatisnotalignedwithdecisionsmadeatcountryleveltheseneedtobeformallyexpressed,documentedandaddressedatgloballevel.

4.4.17 Thetablebelowsummarisesthecashtransfervalueagreed,discussedorrecommendedduring

variousmeetingsbetweenOctober2014andAugust2015(extractedfrommeetingminutes).

Tab.3 Oct-14 TBC Feb-15 Apr-May-Jun15 Jul-15 Aug-15Chair ECHO ECHO/SC SC OCHACWG OCHACWG OCHACWGParticipants SC,PIN,DRC,

WFPInfoextractedfrommeetingminutesOCHACWGfrom04/15

DRC,SCI,DFIDconsortium,ECHO,OFDA,OCHA,ACF,PIN,WFP,UNHCR,FSC

OCHA,DRC,SavetheChildren,WFP,SCCC,UNHCR,IOM,PIN,GOAL

OCHA,ECHO,ICRC,DRC,DFIDconsort.,WFP,UNHCR,IOM,PIN,ADRA,GOAL

OCHA,ECHO,DRC,DFIDconsort.,WFP,ACF,PIN,ADRA,GOAL

USD/Person/Month

food:45/per/monthWinter:235for3months

Winter:100/per

15/per/mfor3months

Manydiscussions,noagreement

cashtransfervaluefordiscussion34/per/monthfor6months

DFIDConsortium30/per/m

Governmentsubsidywasbasedon23USD/person/month.ICRCcashassistancewasbased16USD/person/month.

4.4.18 Thediscrepanciesbetweenthedifferentcashtransfervaluespresentedinthetableabovemaybe

explainedbytheincreasedmarketpricesthroughout2015,butalsobytheunderliningpurposeofthesegrants.ThedisagreementsonthepurposeoftheMPCGincludedwhetheritshouldcoverrent,whetheritshouldcoveraperiodof3or6months,andincluderecoveryaswellasemergencyneeds.“ICRC’sbasket(…)iscalculatedonthecostofcurrentcopingmechanisms.Notintendedtotakearecoveryobjectiveorenablehouseholdstoreducerisk.”17Thisresultedinhighlyvariablecashtransfervalues,despiteathoroughunderlyinganalysis.

4.4.19 WhenOCHAactivatedaninter-sectorialCWGinApril2015,theyinitiallydidnotinvitetheSCTwho

hadbeenleadingaTWIGonthissubject.ThisledtoimmediatequestioningoftheCWGlegitimacy,anddisagreementsbetweenagenciesandclusters.Thethreemonthsofnegotiationsbetweenorganisationsinvolvedanunnecessarypersonalandpoliticaldebate,whichsloweddowntheprocessofprovidinghumanitarianassistance.

4.4.20 Asaresult,adecision-makingstructurefortheCWGwasestablishedthroughasteeringcommittee

attendedbyCLAanddonors,separatingthetechnicaldiscussionsfromstrategicdecisions.Thisstructureseemsinappropriate,sinceitwouldhavebeendesirabletohavedecisionsendorsedbysectoralexpertsratherthanheadsofagencies.IthasalsobeenunclearwhattheICCGmembers’responsibilitiesareintermsofstrategicdecisionforanOCHA-ledWG.

R.22

PriorityForGSC:ProvidededicatedcashexpertiseandspecificSCguidanceoncashprogramming,includinghowtodefinecashtransfervalues,andhowtodealwithmulti-purposecashgrantsattheinter-clustercoordinationandHC/HCTlevel.(KR-8)

17MeetingminutesfromCWG,29July2015.

Page 24: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE24OF50

ForSCTandGSC:Advocateallinter-clusterCWGtoprovidetechnicaladvicetothesectors(ratherthanbecomingsector,creatingseparatesectionsundertheHRP).Thereisaneedtoprovideclearguidanceonthedifferentcashmodality,MPGC,conditionalcash,restrictedcash,unconditionalcash,aswellasdefiningthecashterminologies,andprovidingrelevanttools.

4.5 Shelteradvocacyandcommunication(Corefunction#4)

Q.8 Didtheclusterdoenoughadvocacytodonors,governmentandothers?

4.5.1 TheGSCdefinesadvocacyas“atargetedcommunicationwiththegoaltochangeadecisionmaker’s

opinions,attitudes,actionsorlackofactions.Advocacyusuallyaimstoinfluencepublicpolicyorresourceallocationwithinpolitical,economicandsocialsystemsandinstitutions”.18

4.5.2 TheSCstrategymentionsthat“keyadvocacymessageswillbedevelopedandvalidatedbytheSAG

inconsultationwiththeProtectionCluster”19.ItalsostatesthattheSCTwillidentifygapsandadvocatedonorsonbehalfofclusterpartnersforfurtherfunding,aswellascross-cuttingandinter-sectorialissues.AsthefirstSAGmeetingwasheldinDecember2015,itisassumedthatallearliershelteradvocacyactivitieswerediscussedinplenaryduringSCM.

4.5.3 InthecontextofUkraine,theSCadvocacyhasfocusedonthefollowingactivities:

� Informationsharingandcommunicationofhumanitarianneedsforthepurposeoffundraising(maps,factsheet,strategicdocuments,technicalguidelines);

� Humanitarianaccess,includingaccesstovariousshelteritems,andtogeographicalareasinneedofhumanitarianassistance(especiallyNGCA);

� Raisingawarenessoftheclustersystem;� Harmonisingreconstructionstrategieswithauthorities.

4.5.4 TheSChasbeenconsistentinthepublicationofinformationwhichhasenabledagenciesto

developadvocacymessagesaimedatdonors,governmentandtheirhead-quarters.Accordingtotheonlinequestionnaire,59%ofrespondentsconfirmthattheyhaveusedSCinformationtodeveloptheirownadvocacymessages.

4.5.5 Accordingtokeyinformants,mostoftheadvocacymessageshavebeendevelopedatinter-cluster

orHCTlevel,especiallywithregardstoissuesofaccessandlackoffunding.TheSCwasinvolvedinbothplatforms,throughtheCLAandICCGadvocatingonbehalfofitsmembership.“OCHAhasbeentakingtheleadonadvocacyespeciallyonproblemsofaccess”.

4.5.6 SomementionedthatSCadvocacyshouldhavefocusedalsoonaccesstosheltermaterials(NFIs,

heaters,constructionmaterials,etc.)andothersmentionedtaxesonhumanitariangoodsimposedbytheauthorities.20SomeactorsbelievedthatOCHAspenttoomuchtimedoingadvocacyandforgotitscorefunctionofcarryingoutjointassessmentsinordertogetabetteroverviewofdamages,especiallyinNGCA21.Overall,therewastoomuchfocusonadvocatingaccess,asaresultofwhichotherimportantissueswereleftbehind,ornotdiscussedatall.

4.5.7 Accordingtotheonlinequestionnaire,37%ofrespondentsbelievetheSChasproducedandshared

ausefuladvocacymessage,onbehalfofclusterpartners,todonors.48%saidIdon’tknow.Ontheotherhand,22%thinkthattheSChasproducedandsharedusefuladvocacymessagesonbehalfofclusterpartnerstothegovernment,with59%respondingIdon’tknow.Inbothcasestherearehalformorewhodonotknowwhethertheclusterhasdoneenoughadvocacy.Thisisnotable,and

18CommunicationandAdvocacyStrategyfortheShelterCluster,March2014retrievedfromhttp://www.sheltercluster.org/19ShelterClusterStrategy,June2015,retrievedfromhttp://www.sheltercluster.org/20AccordingtotheCC,theGoUiscurrentlyworkingonhowtoexpeditethetaxexemptionprocessforhumanitarianprojects.21AssessmentintheNGCAismadedifficultbyaccess,butalsosafetyrisksassociatedwithdatacollectionandsharingwithKyiv.

Page 25: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE25OF50

couldeitherbeperceivedasconcerning,assumingthatadvocacymessageshavenotreachedallshelteractors,oritcouldbeunderstoodthatsomeadvocacymessagesarenotofinteresttoallactors.Only22%believetheSChasexercisedsufficientadvocacywithgovernment:“therecouldhavebeenmoreadvocacywithlocalauthorities”.

R.23 ForSC:Ensurethatabroadrangeofrelevantissuesareaddressedintheadvocacymessages

developedbythecluster,notsolelyfocusingononespecificchallenge.

4.5.8 TheSChasalsodonecommunicationandadvocacytoraiseawarenessontheclustersystemandtheroleoftheSCinUkraine.Morerecently,theSChasproactivelyinitiatedcommunicationwiththeauthorities,forexamplethroughtheheavyrepairTWIGs,wheretheSCworkedtowardsharmonisingandagreeingonacommonstrategyforthepermanentreconstruction.Indeed,alotofquestionswerebeingraisedwithregardstotherepairandreconstructionoflargeinfrastructuredamagerelatedtoshelter,suchaswaterpipelinesforheating,andelectricitysystemswhichhavenotbeenmaintainedandnowrequirelargeinvestments.

R.24

PriorityForSCT:Continueeffortsoncommunicationwithlocalandregionalgovernmentontheharmonizationoftheresponse,usingthistooltoadvocatefurthercoordination.(KR-1)

4.5.9 Afurtheradvocacygapthatneedsincreasedfocusistheissueofshelterbeinganemergency

process,insteadofmerelyarecoveryprocesswhichmayprovidepermanentsheltersolutions.InNovember2015,duringaHRPpresentationtodonors,therewasadebateastowhethertheSCshouldbetalkingabout“permanentsolutions”especiallywhentherearestillemergencygaps.Somehumanitariandonorsdonotperceivepermanentreconstructionasbeingahumanitarianresponse.DonorsneedstobebetterinformedoftheSCcountrystrategy,whichincludes:“(…)provid[ing]longer-termsheltersolutionsforpopulationsseekingeitherreturnorintegrationintohost-communityforIDPs,conflictaffectedpopulation(…)”22.Furthermore,theGSCstrategyincludesrecoveryandreconstruction.

R.25 ForGSC:Advocateitspositionwithregardstodurablereconstructionandrepairsduringa

humanitarianresponse.Thereisaneedtoraisedonor’sawarenessontheGSCpositiononshelterrecoveryanddurablesolutions.Indeed,theGSC3rdstrategicobjectivestatesthatitwillthroughadvocacyandcommunication“Enhancearticulationofthelinkagesbetweenshelterriskreduction,preparedness,relief,recovery,anddevelopment,througharesilienceapproach,resultinginaseamlesstransitionfromemergencyrelieftorecoveryandreconstruction”23.

4.6 MonitoringandreportingonimplementationofShelterClusterstrategy,shelter

achievementsandcorrectiveaction(Corefunction#5)

4.6.1 ThroughtheIMsystemtheSCTmonitorstheprogressoftheactivitiescarriedoutbyitspartnerssincetheactivationofthecluster.Thishasallowedagenciestobetterunderstandthecontextinwhichtheyoperateandidentifyareaswiththehighestneeds.However,thisreviewhasalsoidentifiedlimitationstotheSCIMsystem.Refertosections4.2.9to4.2.14.

4.6.2 TheSChassetupacoordinatedPostDistributionMonitoring(PDM)systemforallcashassistance.

AgenciesusethetemplatedevelopedbytheSCandsharetheoutcomeofthePDMinareport,whichincludesrecommendationsandcorrectiveactions.Thishasbeenaneffectivetool,combinedwiththe5Wmatrix,tomonitortheprogressofthesheltersector.

4.6.3 TheSChasnotcarriedoutaClusterCoordinationPerformanceMonitoring(CCPM),whichtheIASC

recommendstobeimplementedsixmonthsaftertheonsetofanemergency.

22ShelterClusterStrategy,June2015,retrievedfromhttp://www.sheltercluster.org/23GSCStrategy2013-2017,retrievedfromhttp://www.sheltercluster.org/global

Page 26: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE26OF50

R.26Priority

ForSCT:DiscusswithSCpartnerstheneedtocarryoutaCCPM.ThisexternalreviewcoverspartsofwhataCCPMwouldachieve,howevertheprocessandoutcomesareclearlydifferent.(KR-7)

4.6.4 Someofthekeyinformantshaverecommendedaglobalclusterarchitecturereview.Theyare

questioningthereasonsbehindtheactivationoftheclustersysteminUkraine,therelevanceoftheHC/HCT,andtheaccountabilityofOCHA,aswellastheheavycoordinationstructure,describedasself-servingratherthanasprovidingessentialhumanitariancoordinationservices.Timeandtimeagain,clustersareactivatedfollowingacrisisusingatemplateformatthatisnotadaptedtothecontext.Ukrainehasneverbeforeexperiencedasimilarcrisisandthehumanitariansystemputinplaceislackingwhenitcomestoleadershipandcoordinationwithgovernmentandcivilsociety.Whenthehumanitariancoordinationsystemfailstoaddresssuchfundamentalprinciples,onemayquestionitslegitimacy.Howcanthissystemremaineffectiveintermsofleadership,aswellasadaptabletothecontext,transparentandaccountable?

R.27

PriorityForGSCandSCT:AdvocateaUkraineclusterarchitecturereview,throughacomprehensiveandaction-orientedevaluationofthecurrenthumanitariancoordinationstructure,lookingat:(KR-9)� Coordinationstructuresadaptedtothecontext(specificallyformiddleincomecountries).� Coordinationstructuresthatenablefurtherengagementoftheauthoritiesandfurther

ownershipoflocalactors.� Coordinationsystemwithclearleadershipbyrelevanthumanitarianactors,whileremaining

transparentandaccountable.

InitiatediscussionswiththeGlobalICCGandIASCforaglobalevaluationofthehumanitariancoordinationsystem,toconsideringdevelopingcoordinationstructuresthataremoreadaptabletodifferentcontextsincludingmiddleincomecountries,andremaintransparentandaccountable.

4.7 Contingencyplanning/preparedness/capacity-building(Corefunction#6)

Q.9 Istheclustersupportingthegovernmenttotakeupacoordinationroleinthefuture?

Contingencyplanning

4.7.1 The2015SRPhadamarginalsectiononcontingencyplanningandpreparedness.ThissectionwasupdatedfollowingacontingencyplansupportmissionfromGenevainMay2015.Theoutcomeofthisexercisewasacomprehensiveinter-clusterContingencyPlan,whichincludedclusterresponsibilitiesduringthefirstthreemonthsofanescalationofviolenceresultinginincreasedvulnerabilities,displacementandpressureonhostcommunities.

4.7.2 Priortothisinter-clusterexercise,theSChadbeenleadingdiscussionssinceearlyMarch2015on

preparednessactivitiesandtrackingofwarehousecontents.AnonlinetemplateforwarehousetrackingwasadoptedbyotherclustersinMay2015,tocentralisethestockpilingofinformationandmonitoringinonedatabase.TheSCconfirmedtheywouldcontinuetomonitorwarehousestatuseswithadditionalsupportfromtheLogisticscluster24.Thishasbeenanimportantpreparednessandcontingencyplanningmeasure.

4.7.3 Atinter-clusterlevel,therehasbeenalackofpreparednessforandadequateresponsetothe

scenariooflosingaccesstoNGCA.Indeed,sinceJuly2015,mostoperationalactorshavelostaccesstoNGCA,andtheinter-clusterContingencyPlaninplaceseemstohavefailedtoaddresstheneedsofthosevulnerablecommunities.Itwasmentionedbyseveralpartnersthat:

24ShelterClusterStrategy,June2015.

Page 27: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE27OF50

� Duetolackofaccess,fundingoriginallyallocatedforNGCAhasbeenretargetedtoGCAcommunities,leavingbehindvulnerablehouseholdsinNGCA.

� TheactorsstilloperationalinNGCAareconcernedaboutthelackofresponsetovulnerableandinaccessiblecommunities;marketsareineffective,makingcashinterventionsirrelevant.

� ManyorganisationswhohavelostaccesstoNGCAareworkingremotelythroughimplementingpartners,mainlyNNGOs,whoarethemselvesoverstretchedandoverworked.Thereisaneedforcapacitybuildingandmonitoringtoensureanadequateresponseandreducetheriskofcorruption,butlittlecanbeachievedduetoaccessrestrictions.

R.28 ForSCT:IncludeintheSCcontingencyplanasectiononsettinguparemotecoordinationsystem

forNGCAtosupportactorsoperatingonbehalfofothers.Developanagreedmechanismwithfocalpointsandinformationsharingsystem,toallowforasystematicapproachofremoteassistance,limitingduplicationofassistance,reducinggapsandallowingformonitoringofprogrammesandaccountabilitytoaffectedpopulation.

Capacitybuilding

4.7.4 CivicactivismhasbeenhighthroughoutthecrisisinUkraine,andtherewasanexistingenergyandwillingnessfromlocalactorstoengage.However,NNGOsandCSOshaveexpressedalackoffamiliaritywiththeinternationalhumanitariansystem,andrequestedcapacitybuildingandcross-fertilisationbetweenlocalandinternationalactorsinvolvedintheresponse.

4.7.5 UNHCRorganisedaCivilSocietyForuminKharkivinDecember2015whereNNGOscouldshowcase

theirorganisationandprojects.Despitesuchefforts,someNNGOshaveconveyedalackofwillingnessfromsomeinternationalorganisationstoengage.

4.7.6 SCMminutesandtheinter-clusterContingencyPlandescribedtheneedtosupportauthoritiesto

carryoutmoreeffectiveIDPtracking.SinceOctober2014,MoSPisresponsiblefortrackingIDPs,althoughduringanacutecrisistheymaynothavetheresourcesandcapacitytodeliverinatimelyandeffectivemanner.

4.7.7 TheSChasprovidedcapacitybuildingforSCpartners,includingNNGOsthroughvariousforums,

TWIGs,SCMandindividualad-hocmeetings.ThetranslationofmeetingsandkeydocumentsintoEnglish,RussianandUkrainianhasbeenessentialtoallowengagementwithnationalactors.ThishighlightstheeffortsfromtheSCTtoreachouttocivilsocietyandauthorities,howeveritwasacknowledgedbytheCCthatfurtherengagementisstillrequired.

R.29

PriorityForSCT:Increaseawarenessraisingactivitiesofclustersystemforlocalactors,includingauthoritiesandNNGOs.Bybuildingontherelationshipsestablishedandthedocumentationstranslated,thereisanopportunitytoincreasethereachoftheSC.(KR-1)AdvocatetheHCTtotaketheleadinengagingwithlocalactors,civilsocietiesandauthorities.Provideauthoritieswiththeappropriatesupport,capacitybuildingandresources.(KR-7)

Transition,de-activationandexitstrategy

Q.9 Istheclustersupportingthegovernmenttotakeupacoordinationroleinthefuture?

4.7.8 “GoodpracticesuggeststhattheHC/HCT,clustersandnationalauthoritiesshoulddeveloptransitionandde-activationstrategiesatthestartofaresponse”25

25IASCReferencemodule,July2015.

Page 28: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE28OF50

4.7.9 Inreality,thisisdifficultinaconflictresponsewherethesituationremainsvolatile,unpredictableandcanregressrapidly.However,despiteviolationsoftheceasefireagreement,thesituationinUkrainehasimprovedduring2015.Oneyearhaspassedsincetheformalactivationoftheclustersystem,andatransitionplanshouldbediscussedandprepared.IASCguidancerecommendsanannualreviewoftheclusterandcoordinationarchitecturetobecarriedoutbytheHC/HCT,withaviewtocontinuing,deactivating,scalingdownand/orhandingoverclustersasappropriate.

4.7.10 “Theconditionfordeactivationofformallyactivatedclustersmaybeconsideredwhenatleastone

oftheconditionsthatledtoitsactivationisnolongerpresent(1)thehumanitariansituationimproves(…)(2)Nationalstructuresacquiresufficientcapacitytocoordinateandmeetresidualhumanitarianneeds”.26

4.7.11 Ukraineisamiddle-incomecountrywithsomenationalandlocalcapacitytorespondto

emergencies.Severalgovernmententitieshaveengagedintheresponse,butconsideringthedeterioratingeconomiccontextandpressureonsocialservices,thequestionremainsofhowmuchleft-overcapacityauthoritiesretainwithwhichtocoordinatetheresidualhumanitarianneeds.Theinternalgovernmentcoordinationstructure–STAB–waspartlyeffectiveintheearlystagesoftheresponse,buthasbeenlesseffectiverecently.VariousinformantsmentionedthatthehumanitariancrisisinEasternUkrainedoesnotseemtobeakeypriorityforthegovernmentinKyiv.Atregionallevel,thereareweeklymeetings,whichtheUNHCRCountryRepresentativehasattendedonce,whileOCHAseemtobeattendingoccasionally(notverified).AuthoritiesatregionallevelappearmoreopentoengagingwiththeSCandtheyhave,onseveraloccasions,hostedandopenedSCmeetingsinSloviansk.

4.7.12 Asmentionedinsection2.3,theevaluatorwasnotabletomeetwiththeauthoritiesdirectlydueto

bureaucraticrestrictions.TheissuesfacedattemptingtomeetwiththeauthoritiesinKyivillustratessomeofthechallengestheSChasfacedtryingtoengagewithauthorities.

4.7.13 AuthoritiesinKyivarefornownotreadynorwillingtotakeonfurtherrolesorresponsibilitiesinthe

humanitarianresponse.ThusthemostlikelyscenariofordeactivationoftheSCisanimprovementofthehumanitariansituation,minimisingtheneedtocoordinateresponseandgaps.Theunderlyingassumptionwouldbethattheshelterresponseisharmonised,implementingactorsknowwheretheyareworking,shelterstandardsacrossthesectorshavebeenagreed,andthatgapsareminimalandaddressedthrougheffectivecoordinationbetweenimplementingorganisationsandwiththelocal/regionalauthoritiesandcivilsociety.Inthiscase,theneedforafulltimededicatedSCcoordinationteammaynotberequired.

R.30 ForSC:InitiatediscussionsaroundtransitioninternallywithSCpartners.Developatransitionplan

involving,asmuchaspossible,nationalcounterpartsanddevelopmentactors,linkinghumanitarianandlongertermrecovery,andaligningwithnationaldevelopmentobjectives.FortheGSC:Providefurtherguidanceastohowandwhentostartthetransition.EspeciallyinacontextsuchasUkraine,wherethenatureoftheconflictismovingtowardsaprotractedcrisis,thegovernmenthascapacitybutcurrentlydoesnotseemwillingtoengagefurther.

4.8 Accountabilitytoaffectedpopulations(Corefunction#7)

4.8.1 TheGSCprovidesguidanceonAccountabilitytoAffectedPopulations(AAP)throughinformation

producedbytheGSCAccountabilityWG.Itstatesthat“Accountabilityfortheimplementationofshelterprogramslieswithclustermembers,nottheclusterteammembersthemselves(…)However,thecoordinationteamshouldbeaccountabletoclustermembers,promotingtransparencyandpositivecoordination.Shelterclustersshouldadvocatefor:

26IASCReferencemodule,July2015.

Page 29: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE29OF50

� Inter-sectoralmessagingwithaffectedpopulations� Clustermembersseeingaccountabilityasbeingtoallaffectedpopulations,notjustthose

narrowlydefinedwithinspecificprojects� Areacoverage:ensuringthatgapsarenotinfluencedbypressuresotherthanneed.27”

4.8.2 TheSCinUkrainehasprovidedaplatformtoencouragetransparencyandaccountabilityto

affectedpopulationsthroughdiscussionsoncashassistanceandPostDistributionMonitoring(PDM).TheSC–throughtheCashWG28–developedaPDMtemplatetogeneratereportssharedwithotherclusterpartners.Thisprovidedorganisationswithatooltobetterunderstandtheimpactoftheirinterventionsandforthesectortomeasuretheeffectofshelteractivities,butonlyfocusedononetypeofassistance:cash.Hopefully,thePDMalsoencouragesorganisationstousesimilarsystemsforothershelterassistance.ThePDMprovidedfeedbackonbeneficiarysatisfaction,andhowwasthecashutilised.Acomplaintsmechanismismentioned,butnodetailedinformationisavailableonthismechanismoutsidethePDMquestionnaire.

4.8.3 AlthoughthePDMhasprovidedaplatformforaccountabilityandcommunicationwithaffected

populationswhoreceivecashassistance,thereisnoevidencethatthiswasappliedtoothershelterassistance,suchasNFIdistributions,repairsandreconstruction.Additionally,thereisnoevidenceavailableonlineofinter-clusteraccountabilitymessagestoaffectedpopulationsinUkraine.“Partoftheissuearoundofacceptanceofcashgrants/complaintsinthecommunities(i.e.thosethatgetanddon’tget)islackofbeneficiarycommunicationbymanyagencies.Packagesneedtobeclearlycommunicatedtobeneficiaries,i.e.vulnerabilitycriteriaandjustificationfortransferamounts,wheredifferent.OCHAwilltakeforwardbeneficiarycommunicationasatechnicalareatosupportintheCWG.”29Whilebeneficiarycommunicationhasbeendiscussedatclusterandinter-clusterlevel,thereisnoevidenceofafollow-up.

R.31

PriorityForSCT:Encouragetheuseofvarioustools–amongSCpartners–toincreaseaccountabilitytoaffectedpopulationsbeyondthecashPDM.Thismayincludeinter-sectoralcommunicationmessagestoaffectedpopulation;feedbackandcomplaintsmechanisms;diagnosistoolsforcommunicationwithaffectedpopulations;orbeneficiary-ledcommunityevaluation30.(KR-5)

Q10. Whatrealdifferencedidtheclustermaketothepeopleaffectedbytheconflict?

4.8.4 TheSChasindirectlymadeadifferencetothepeopleaffectedbytheconflict,byproviding

coordinationservicesthatallowimplementingagenciestoworkeffectivelyandprovidetargetedandrelevantassistance.Insomeareas,theseserviceshavehadarealaddedvalue,inotherslessso.Examplesofpositiveimpactinclude:� OutreachoftheshelterassistancethroughtheIMsystemandmapping(althoughithasbeen

notedthatgapsremain,especiallyintheNGCA).� Targetedandappropriateshelterresponse,aimingtoprovidethepeopleaffectedbythe

conflictwithnecessaryitemsandappropriateshelterassistance.� HarmonisationoftheassistancethroughTWIGs,aimingtoprovidethepopulationinneedwith

equalandfairshelterassistancefromonefamilytoanother,andacrossagencies.� Emergencyreferralsystemduringwinterisation(26outof26referralsaddressedin2015)� Providingafeedbackandcomplaintsmechanismforcashassistance,asdescribedabove.

4.8.5 ReportscomingoutofthePDMframeworkdescribedaboveshowageneralsatisfactionof

beneficiariestowardsthecashassistanceprovided.IOMstatesthatoutof644households,89%of 27AccountabilitytoAffectedPopulations,November2013,GSCAccountabilityWorkingGroup,retrievedfromhttps://www.sheltercluster.org/sites/default/files/docs/ACCOUNTABILITY-%20two%20page%20summary-2013-11-11.pdf28Priortotheactivationoftheinter-clusterCashWG29Meetingminutes,CWG21May201530AccountabilitytoAffectedPopulations,November2013,GSCAccountabilityWorkingGroup,retrievedfromhttps://www.sheltercluster.org/sites/default/files/docs/ACCOUNTABILITY-%20two%20page%20summary-2013-11-11.pdf

Page 30: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE30OF50

respondentsaresatisfiedortotallysatisfiedwiththeprogram,and73%aresatisfiedwiththeamountofcashprovided.31ADRAreportsthatoutof820households,91%ofrespondentsaresatisfiedortotallysatisfiedwiththeprogram,and96%aresatisfiedwiththecashamount32.

4.8.6 Twofieldvisits(toSlovianskandSievierodonetsk)highlightedtheextentoftheneeds,andthe

limitedhumanitarianfundingavailabletorespond.Insomecases,organisationshavebeenunabletocomplywithminimumstandardsestablishedbytheSC,suchasthe“onewarmroom”concept,butotheragencieshavesteppedinto“topup”theassistanceforextremelyvulnerablefamilies.Aninformalreferralsystemandgoodcoordinationbetweenagencieshasfilledcertaingaps,whileothersremain.Forexample,onehousevisitedhadreceivedassistancefromtwoorganisationsbutwasstillnotcomplyingwiththe“onewarmroom”standard.Thefamilyhadbeenobligedtorentasmallsummershedwhilegatheringenoughfundstofinalisetherepairs.

Cross-cuttingissues

Q11. Werecross-cuttingissuesandvulnerabilitiesexploredandacteduponwithinthecluster?

4.8.7 TheSCStrategymentionsthattheSC“willensureattentiontoandmainstreamingofcross-cuttingissuesinallactivities,incooperationwithotherclustersasappropriate,inparticularwiththeProtectionandWASHClusters”.Thelistofcross-cuttingissuesfromtheSCStrategyare:

� Age� Disabilities� Environment� Gender� Housing,LandandProperty(HLP)� HumanRightsconsiderations,e.g.freedomofmovement� MinesandUXOs� Registration&Populationtracking� Stockpiling&contingency(refertocontingencyplanningsection)� Incomegeneration� Ownervs.rental� Humanitarianaccesstodisputedareas&conflict-affectedpopulation� Humanitarianaccesstogoods

4.8.8 Thereisevidenceofsomeoftheissuesabovebeingaddressedanddiscussed,whileothershave

beenomitted.The2015HRPidentified“protectionastheoverarchingconcernandcentraltothehumanitarianplanningandresponseofeachclusteractiveinUkraine”33.Mostcross-cuttingissueswereviewedthroughaprotectionlens,ausefulapproachfortheSCinUkraineconsideringthattheProtectionClusterisalsoledbyUNHCR,andtheproximityofCCofficesallowsforeffectivepartnershipandcross-fertilisation.Forexample,theSC’svulnerabilitycriteriaforcashassistance34wasdevelopedwithsupportfromtheProtectionCluster.Thedocumentprovidedguidanceoncashassistancemodalitiesinrelationtothefollowingcriteria:age,disability,health,gender,familysize,income,financialresilienceandsocialnetwork,housingdamage,andhousingsituation.TheSCalsoholdsacomprehensivedatacollectionofpopulationfiguresanddisplacementdata,whichisanalysedbytheSCTonamonthlybasis,andpresentedanddisseminatedthroughmapsandtables.

4.8.9 Whilethevulnerabilitycriteriadocumentwasperceivedasausefultool,itswiderdissemination

andusewashinderedbythefactthatitonlyappearedontheclusterwebsiteinAugust2015,andwascategorisedunder“cashassistance”.Manyofthecriteriaarealsohighlyrelevantforother

31“PreliminaryResultsofPDM,CashAssistancetoIDPsin10Regions”,IOM,October2015.32PDMreportprovidebyADRA,CashAssistancetoIDPs,October2015.33HRP2015,retrievedfromhttps://www.humanitarianresponse.info/34VulnerabilityCriteriaforCashAssistance,retrievedfromhttp://www.sheltercluster.org/response/ukraine

Page 31: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE31OF50

shelterassistance,especiallywhenconsideringthatthisistheonlydocumentonbeneficiaryselectionandvulnerabilityavailableonthewebsite.

4.8.10 MinutesfromanumberofSCMshowdiscussionsandcontributionsfromclusterpartnersoncross-

cuttingissues.HelpAgeprovidedinputstothevulnerabilitycriteriadocumentmentionedabove.HandicapInternationalgaveapresentationondisabilityinclusionatnationalandsub-nationallevel.Butdespiteinitiativestoexploreanddiscusscross-cuttingissuessuchasage,disability,gender,andenvironment,specificandsystematicguidancefromtheSCislacking.

R.32

PriorityForSC:ActivateavulnerabilityWGoridentifyafocalpointwiththefollowingtasks:� Developcluster-wideguidanceonvulnerabilityandbeneficiaryselection,developingacluster-

specificscoringsystemtosupportagenciesintheirprioritisation35.� Createamatrixwhichprovidesguidanceonvulnerabilitiesmatchedwithshelterassistance

type,allowingagenciestoprioritisetheirassistancewhileminimumstandardsaremet.(KR-5)

4.8.11 Asprotectionwasconsideredacross-cuttingissuetotheresponseintheHRP2015,somespecificaspectssuchasage,genderanddisabilitywouldbeinterestingtodiscussattheinter-clusterlevel.Forexample,inthePhilippinesandPakistan,anactive“AgeandDisabilityTaskForce”providedsupportandguidancetotheclusters.WhilethisisnotadirectresponsibilityoftheSC,thisrepresentsanopportunityforSCpartners.

R.33 ForSCT:RequesttheICCGtoactivateanAccountabilitytoAffectedPopulationWGoran

AccountabilityTaskForce,toaddressconcernsrelatedtobeneficiarycommunication,transparencyandaccountability.ExamplescanbefoundinothercountriesanditisbelievedtobeparticularlyrelevantinUkraine,especiallyconsideringthestrengthofcivilsociety.ThiscouldbeanopportunityforSCpartnerwithaspecificexpertiseinageanddisabilityinclusion,oranyothercross-cuttingissues,totakethelead,developinter-clusterguidanceandcontributetobettermainstreaming.

35RefertoSCPhilippines,Beneficiaryselectionandrecommendationsontargetingandprioritisationasanexample,availableathttps://www.sheltercluster.org/sites/default/files/docs/prioritisation_final_v1_2.pdfandhttps://www.sheltercluster.org/sites/default/files/docs/Beneficiary%20Selection%20Criteria%20-%20Background%20Document%201.pdf

Page 32: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE32OF50

Annex A. ListofRecommendations

Clusterleadership

R.1Priority

ForUNHCRandGSC:IncreaseinternalawarenessofUNHCRstaffontheclustersystem.DevelopandprovideastandardinformationpackageforUNHCRCountryRepresentativesandUNHCRstaffontheirroleandresponsibilitiesasCLA.ThisguidanceshouldexplainthecoordinationroleofUNHCRinrefugeeoperationsversusanIDPcontext,andshouldaddressmanagementandreportinglinesbetweenUNHCR-ledclustersandUNHCRstaffinmain-office,sub-officesandfield-offices.(KR-6)

Clusterpersonnel

R.2 ForCLAandGSC:TheindependenceoftheCLAfromtheSCTisessentialinenablingtheviewsandinterestsoftheentiresectortoberepresented.ItisthereforerecommendedthatUNHCRandtheGSCdeploydedicatedteamstoruntheSC,andinparticulardeployadedicatedCC.36

GlobalShelterCluster/HQSupport

R.3 ForGSCandSCT:Improvecross-fertilisationbetweendifferentcountryclusters.ItwasrecognisedthatinJuly2015,theGSChassetupaGooglegroupforthatpurpose.

R.4 ForGSCandSCT:Improvecommunicationbetweenglobalandcountrylevelthroughregularscheduledupdates,onamonthlyorquarterlybasisdependingonneeds.ThiswouldallowtheGSCtoprovidemoreappropriatesupport,anticipatingcertainissuesandprovideaplatformofexchangefortheCC.

RelationswithIASCactors

R.5 ForGSC:Provideglobalguidanceonwhichinter-clustercoordinationtools,reports,andreviewsaregenerallyperceivedasapriority,whichonesarecompulsoryfortheSCtocontributeto,andwhichonesarealowerpriority.RefertoAnnexG.

R.6 FortheSCT:Lessonslearnthaveshowntheimportanceofstrengtheningpositiverelationships,thusitwouldberecommendedfortheSCTtofocusontheirrelationshipwithOCHAinthefield.

Coordinationmanagement

R.7Priority

ForCCandSCT:WhileasmallandfunctionalSCMcanbeaneffectivedecisionmakingplatformforstrategicpriorities,itisrecommendedtoestablishaSAGwithagreedToR,acommittedgroupoforganisationsincludinganactiveparticipationofrelevantdonors.SAGmembers’responsibilityextendsbeyondregularclusterattendance,andshouldbeformalised.(KR-4)

R.8Priority

ForSCT:StandardisetheinformalsheltermeetingsthatarenotledbytheSCT,whilstremainingflexibleandsupportivetothoseleadingthem.FormalisingthedecentralisedhubswouldenabletheSCTtoimproveitsleadershiprole,strengtheninformationflows,andallowfortheSCTtobeproactiveratherthanreactive.ThiscouldalsoprovidetheSCwithfurtherreach,withregardstothecoordinationservicesprovidedtopartners.(KR-2)� Identifyfocalpoint(s)toreporttoSCT� AnnouncemeetingsthroughtheSCmailinglistsothatotheractorsintheareamayattend� Shareminutesofmeetingtemplatewiththoseleadingthemeetings� Requestminutesofmeetings,andsharewithSCpartnersforaccountabilityand

preparednessmeasures� PromoteSCreportingtools(5W)� Sharecontactlists

36RefertoIASCReferenceModule,July2015,p5andp11.

Page 33: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE33OF50

R.9Priority

ForSCT:Developanddisseminateanorganisationalmapofthecoordinationstructure,37withthesub-nationalsubanddecentralisedhubs.ThiswouldprovidetheSCTwithfurtheraccountabilityandtransparencyonthecoordinationstructurealreadyinplace.(KR-2)

R.10 ForSCT:Consolidateasystematiccoordinationmanagementapproachby:� SharingdraftSCMagendapriortoSCMwithpartnersallowingthemtocontributeitems.� Consistentlydraftingandsharingofmeetingminutes:includingnameoforganisations

attendingforaccountabilityandreportingpurposes,andrecordingofkeydecisions.� UploadallmeetingminutesandrelevantdocumentsontheSCwebsite,withrelevanttags.Whenandwherepossible,allowremoteattendanceviatelecomtoextendthereachofSCM.

Informationmanagement

R.11 ForSCT:ImprovethedisseminationofinformationthroughconsistentuploadofalldocumentssharedwithSCpartnersontheSCwebsite,essentiallyusingthewebsiteasadepositoryofdata.AmoreeffectiveuseofthewebsitecouldallowSCpartnerstofindtheinformationtheyneedindependentlyandthiswouldreducetheneedforone-to-oneintensivepartnersupport.

R.12Priority

ForSCandSCT:Workonimprovingtheoverallbaselinedata,includingGCAandaccessiblepartsofNGCA.ThedatashouldincludehousingdamageandvulnerabilitiesofalltargetgroupsdetailedintheSCstrategy.TheSAGshouldadviseonhowtocarryoutsectoralassessments,definingthetargetpopulationandgeographicalarea.LeverageonCLAandco-chairwithaccesstoDonetskandLuhansktogatherfurtherdataonlocalitieswhereothersmightnothaveaccess.(KR-3&4)

R.13Priority

ForSCT:Continuetoprovideanoverviewofthecontext,whilealsoproducingmoredetailedneedsandgapsanalysis,maps,graphsandotherusefultoolsrelevantaimedatthefieldlevel.ExploreopportunitiesofimprovingtherepresentationofSCobserverswithsensitivedata(suchasICRC)intheanalysistoprovideacleareroverviewofthecoverageandgaps.(KR-3)

InformingHC/HCTstrategicdecision-making

R.14Priority

ForGSCandUNHCR:RequestforaccountabilityandtransparencyoftheICCGandHCT,byaskingHCT/OCHAforallmeetingminutes,reports,assessmentsandotherrelevantdocumentsproducedforICCGandHCTmeetingstobesharedandpublishedonhumanitarianresponse.info.

R.15Priority

ForUNHCRandSCT:RequesttheHCTtoactonits’decisionfromtheJuly2015retreat,toinviteCCstoHCTmeetings.Untilthen,theSCTistoprovidetheCLArepresentativewithSCupdatespriortoeachHCTmeeting,andorganiseadebriefingsessionwiththeSCTafterwards.(KR-7)

R.16 ForUNHCRandSCT:AdvocatetheHCTtoexplorewaysofinvolvingthedonorcommunityinthishumanitarianplatform,withtheaimofincreasingitsrelevanceandeffectiveness.

Shelterclusterstrategy

R.17Priority

ForSCT:Developastandardpackageofkeydocuments.Forexample,theSCPhilippineshaddevelopedaTechnicalIndexdocumentwithlinkstoallkeytechnicaldocuments.ThiswasausefultooltoincreasethedisseminationofkeydocumentstonewSCpartners,andtohandoverallkeySCdocumentstonewlyarrivedstaff.(KR-3)

R.18 ForSCTandSC:RefineSCstrategicprioritieswithstrongerdataforNGCA.TheSCshouldworktowardsidentifyingthespecificneedsandassistancerequiredinNGCAandbetterguidegeographicalprioritisation,differentiatingtheneedsofDonetskandLuhanskastwodistinctlocations.TheSChastheadvantageofbeingledbyPINandUNHCR,bothwithaccesstoNGCA.

37ForanexamplerefertoSCPhilippinesHubOverviewonsheltercluster.org

Page 34: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE34OF50

R.19 ForSCT:InvolveddonorsinthedevelopmentoftheSCsectionoftheHRP.

Workinggroups

R.20 ForSCT:ContinueitseffortsinidentifyingtechnicalissuesandaddressingthemthroughTWIGs.

CashWorkingGroup

R.21 ForGSC:Suchcountry-leveldisagreementsmayhaverepercussionsontheSCnotonlynationally,butalsogloballyasthesedecisionscouldbeusedasprecedentsofgoodpracticeforfutureemergencies.WhentheGSChasapositionthatisnotalignedwithdecisionsmadeatcountryleveltheseneedtobeformallyexpressed,documentedandaddressedatgloballevel.

R.22Priority

ForGSC:Providededicatedcashexpertiseand/orspecificSCguidanceoncashprogramming,includinghowtodefinecashtransfervalues,andhowtodealwithmulti-purposecashgrantsattheinter-clustercoordinationandHC/HCTlevel.(KR-8)

ForSCTandGSC:Advocateallinter-clusterCWGtoprovidetechnicaladvicetothesectors(ratherthanbecomingsector,creatingseparatesectionsundertheHRP).Thereisaneedtoprovideclearguidanceonthedifferentcashmodality,MPGC,conditionalcash,restrictedcash,unconditionalcash,aswellasdefiningthecashterminologies,andprovidingrelevanttools.

Shelteradvocacyandcommunication

R.23 ForSC:Ensurethatabroadrangeofrelevantissuesareaddressedintheadvocacymessagesdevelopedbythecluster,notsolelyfocusingononespecificchallenge.

R.24Priority

ForSCT:Continueeffortsoncommunicationwithlocalandregionalgovernmentontheharmonizationoftheresponse,usingthistooltoadvocatefurthercoordination.(KR-1)

R.25 ForGSC:Advocateitspositionwithregardstodurablereconstructionandrepairsduringahumanitarianresponse.Thereisaneedtoraisedonor’sawarenessontheGSCpositiononshelterrecoveryanddurablesolutions.

Monitoring

R.26Priority

ForSCT:DiscusswithSCpartnerstheneedtocarryoutaCCPM.ThisexternalreviewcoverspartsofwhataCCPMwouldachieve,howevertheprocessandoutcomesareclearlydifferent.(KR-7)

R.27Priority

ForGSCandSCT:ForGSCandSCT:AdvocateaUkraineclusterarchitecturereview,throughacomprehensiveandaction-orientedevaluationofthecurrenthumanitariancoordinationstructure,lookingat:(KR-9)� Coordinationstructuresadaptedtothecontext(specificallyformiddleincomecountries).� Coordinationstructuresthatenablefurtherengagementoftheauthoritiesandfurther

ownershipoflocalactors.� Coordinationsystemwithclearleadershipbyrelevanthumanitarianactors,whileremaining

transparentandaccountable.

InitiatediscussionswiththeGlobalICCGandIASCforaglobalevaluationofthehumanitariancoordinationsystem,toconsideringdevelopingcoordinationstructuresthataremoreadaptabletodifferentcontextsincludingmiddleincomecountries,remaintransparentandaccountable.

Page 35: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE35OF50

Contingencyplanning

R.28 ForSCT:IncludeintheSCcontingencyplanasectiononsettinguparemotecoordinationsystemforNGCAtosupportactorsoperatingonbehalfofothers.Developanagreedmechanismwithfocalpointsandinformationsharingsystem,toallowforasystematicapproachofremoteassistance,limitingduplicationofassistance,reducinggapsandallowingformonitoringofprogrammesandaccountabilitytoaffectedpopulation.

Capacitybuilding

R.29Priority

ForSCT:Increaseawarenessraisingactivitiesofclustersystemforlocalactors,includingauthoritiesandNNGOs.Bybuildingontherelationshipsestablishedandthedocumentationstranslated,thereisanopportunitytoincreasethereachoftheSC.(KR-1)AdvocatetheHCTtotaketheleadinengagingwithlocalactors,civilsocietiesandauthorities.Provideauthoritieswiththeappropriatesupport,capacitybuildingandresources.(KR-7)

Transition,de-activationandexitstrategy

R.30 ForSC:InitiatediscussionsaroundtransitioninternallywithSCpartners.Developatransitionplaninvolving,asmuchaspossible,nationalcounterpartsanddevelopmentactors,linkinghumanitarianandlongertermrecovery,andaligningwithnationaldevelopmentobjectives.

FortheGSC:Providefurtherguidanceastohowandwhentostartthetransition.EspeciallyinacontextsuchasUkraine,wherethenatureoftheconflictismovingtowardsaprotractedcrisis,thegovernmenthascapacitybutcurrentlydoesnotseemwillingtoengagefurther.

Accountabilitytoaffectedpopulation

R.31Priority

ForSCT:Encouragetheuseofvarioustools–amongSCpartners–toincreaseaccountabilitytoaffectedpopulationsbeyondthecashPDM.Thismayincludeinter-sectoralcommunicationmessagestoaffectedpopulation;feedbackandcomplaintsmechanisms;diagnosistoolsforcommunicationwithaffectedpopulations;orbeneficiary-ledcommunityevaluation.38(KR-5)

Cross-cuttingissues

R.32Priority

ForSC:ActivateavulnerabilityWGoridentifyafocalpointwiththefollowingtasks:� Developcluster-wideguidanceonvulnerabilityandbeneficiaryselection,developinga

cluster-specificscoringsystemtosupportagenciesintheirprioritisation.39� Createamatrixwhichprovidesguidanceonvulnerabilitiesmatchedwithshelterassistance

type,allowingagenciestoprioritisetheirassistancewhileminimumstandardsaremet.(KR-5)

R.33 ForSCT:RequesttheICCGtoactivateanAccountabilitytoAffectedPopulationWGoranAccountabilityTaskForce,toaddressconcernsrelatedtobeneficiarycommunication,transparencyandaccountability.ExamplescanbefoundinothercountriesanditisbelievedtobeparticularlyrelevantinUkraine,especiallyconsideringthestrengthofcivilsociety.ThiscouldbeanopportunityforSCpartnerwithaspecificexpertiseinageanddisabilityinclusion,oranyothercross-cuttingissues,totakethelead,developinter-clusterguidanceandcontributetobettermainstreaming.

38AccountabilitytoAffectedPopulations,November2013,GSCAccountabilityWorkingGroup,retrievedfromhttps://www.sheltercluster.org/sites/default/files/docs/ACCOUNTABILITY-%20two%20page%20summary-2013-11-11.pdf39RefertoSCPhilippines,Beneficiaryselectionandrecommendationsontargetingandprioritisationasanexample,availableathttps://www.sheltercluster.org/sites/default/files/docs/prioritisation_final_v1_2.pdfandhttps://www.sheltercluster.org/sites/default/files/docs/Beneficiary%20Selection%20Criteria%20-%20Background%20Document%201.pdf

Page 36: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE36OF50

Annex B. TermsofReference

EvaluationoftheEmergencyShelterandNonFoodItemsClusterintheUkraine1. BackgroundInNovember2013,thedecisionoftheGovernmentofUkrainetoabandonanagreementthatwouldstrengthentieswiththeEUsparkedlargescaleprotests,andinFebruary2014violentclashesbetweendemonstratorsandlawenforcementtookplaceinKiev.InMarch2014,areferendumonstatuswasheldintheAutonomousRepublicofCrimea,leadingtoafirstwaveofdisplacementofpersonsfromCrimea.ViolenceintheDonbasregionineasternUkrainehasintensifiedsinceMay2014,withasecondwaveofdisplacementoccurringinJulyandmajorhumanitarianneedsemerging.Followingeventsinnon-governmentcontrolledareasofDonbasfromautumn2014,changeinconflicttrendshaveledpeopletoreturnhomeandthenforcedthemintodisplacementagain.InOctober2014,theGovernmentofUkraineannouncedadedicatednewIDPregistrationsystem(Resolution#509)alongwitharesolutiononstateprovisionofcashassistancetocoverutilitybillsforallregisteredIDPsfor6months(Resolution#505).ALawonIDPswasadoptedbytheGovernmentofUkraineinOctober2014,includingprovisionsforthenewregistrationsystemandoutliningofestablishmentofrightsofIDPstofreeaccommodationandemployment.Initially,withmoderatelylownumbersofdisplacedpersons,hostingcommunitiesandvolunteergroupstackledthecrisiswell.However,withfurtherincreaseofIDPscomingperdaytheneedsexceededthecapacityofexistingsocietalmechanismstorespond.InDecember23,2014theClustersystemwasofficiallyactivatedbytheEmergencyReliefCoordinatortoenhancecoordinationamongmembersofthehumanitariancommunity.UNHCRwasappointedastheleadagencyfortheEmergencyShelterandNFIscluster.InJanuaryandFebruary2015athirdwaveofmassdisplacementoccurredfromareasundershelling(Debaltsevocrisis).Asof1stJune2015thereare1.3millionpersonsregisteredasdisplacedbytheMinistryofSocialPolicy,withfluctuatingpopulationmovementsincludingsecondarydisplacement,commutingacrossthecontactline,andreturns.TheEmergencyShelterandNonFoodItemsClusterispartneredwiththeMinistryofRegionalDevelopment&MinistryofSocialPolicyandledbyUNHCRwithvariousNGOpartnerscoordinatingtoprovideanappropriateresponsetothecrises.NationalcoordinationisconductedinKievwithsub-nationalcoordinationoccurringinvariousareasasillustratedbelow.Office/location ClusterMechanism Regularityof

meetingsHostingorganization

Status

National NationalCluster Weekly UNHCR ActivatedNorthernDonbasSeverodonetsk,Sloviansk,Iziumtobediscussed

Sub-national fortnightly PIN Activated

SouthernDonetsk,(mariupol,berdiansk,Nikopol,zaparojihie)

Sub-national(inproject)

Fortnightly

Tobedetermined

Inprojectinregardofthegrowingnumbersofpartners.PreviousUNHCRdecentralizedmeetinginMariupolnotworking.Possibilitytoidentifyasub-nationalclusterforthisarea

Dniepropetrovsk Decentralizedcoordinationmeeting

FortnightlyOnhold

UNHCR Activated,onholdfromMay2015

Page 37: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE37OF50

Kharkiv Decentralizedcoordinationmeeting

FortnightlytillMay2015,actuallymonthly

UNHCR Activated

Kiev Decentralizedcoordinationmeeting

FortnightlytillMay2015,actuallymonthly

UNHCR Activated

Donetsk DecentralizedcoordinationmeetingorSub-nationalcluster(tobediscussedifassociatedwithLuhansk)

Fortnightlyoraccordingtofeasibility

UNHCR(compulsory)

Activatedbutirregularduetoregistrationissues

Luhansk DecentralizedcoordinationmeetingorSub-nationalcluster

Fortnightly

UNHCR(compulsory)

Inproject

2. EvaluationpurposeUNHCRShelterandSettlementsSectionseekstoreviewtheeffectivenessofthecoordinationservicesprovidedbytheUNHCR-ledEmergencyShelterandNFICoordinationTeamtothehumanitarianresponsetotheUkrainecrisisthatbeganin2014.Theevaluationistoidentifykeylessonsfromwhathasbeenachievedthusfarandrecommendationstoimproveandinformfuturecoordinationoftheongoingresponse.UNHCRwillusetheevaluationoutcomesandrecommendationstoimprovefuturedeploymentsintosimilarcrises.TheUNHCR-ledcoordinationteammemberswilluseittolearnfromthefindingsandimprovecurrentpractices.ThiswillbecompletedthroughaManagementResponsePlanthatwillbecompleteddetailingwhichrecommendationsareaccepted,whichwillbeactedupon,bywhom,andwhenandthatprogressontheimplementationofthiswillbemade.Thereportwillbepublicandavailableatsheltercluster.orgallowingtheHumanitarianCountryTeamtouseittoinformthecurrentcoordinationarrangementsfortheshelterresponseintheUkraineandClusterpartnersmayuseitasreferenceforimprovingtheirshelterresponseasrelevant.Assuchthemainpurposeoftheevaluationisasfollows:

1. AppraisetheserviceprovidedbytheUNHCRcoordinationteamtotheparticipatingclusteragenciesincludingGovernment,UNagencies,RedCrossRedCrescentMovement,NGOsbothnationalandinternational,andotherrelevantactors.

2. Understandthemembersengagementandthebenefitsoftheirparticipationintheclusters3. ReviewandanalysetheexperienceofUNHCRwithrespecttotheestablishmentandoperationofthe

EmergencyShelterandNFICluster,withaparticularemphasisonlessonstobelearntforfutureoperationsanddeployments.

4. Appraisetheapproachandmanagementoftheclusteractivitiesundertakenatasub-nationallevelandtheireffectiveness.

5. ExaminetheactivitiesundertakenbytheEmergencyShelterandNFIClusterandtheirrelevancetothesectorwithafocusoncashprogramming.

6. Reviewandevaluatetherelationswithothersectors,theIASCcoordinationactors,theGovernment/INGOandothercoordinationmechanismsincludinginter-clustercoordinationasapplicable

7. ExamineanyworkinggroupscurrentlywithintheEmergencyShelterandNFIClusterfortheirrelevanceandiftheseshouldcontinuewitharecommendationontheresourcesrequiredtosupportsuchworkinggroups.

8. ProviderecommendationswithregardtoUNHCRsleadershipoffutureemergencyshelterclustercoordinationactivities.

9. EvaluatetherelationsbetweentheclusterandUNHCRatCountry,RegionalandGloballevels.

Page 38: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE38OF50

3. EvaluationscopeTheevaluationistocovertheperiodfromthetimeofclusteractivationtothepresentdaycoveringthedifferentcoordinationdeploymentsundertakenandthegeographicareasofbothcoordinationandshelteractivities.ParticularfocusistobeonthenationalcoordinationactivitiesundertakeninKyiv,sub-nationalcoordinationactivitiesundertakeninNothernDonbass(DonetskaandLuhanskaGovernmentalcontrolled)andtoacertainextentinDonetskaNonGovernmentalControlledArea,Dnipropetrovska,Kharkivska,andZaporizka.Theevaluationisalsotoappraisetheeffectoftheclustercoordinationactivitiesonthetypeofshelterresponse,thedeliveryofsheltermaterialsandimpactonbeneficiaries.4. EvaluationcriteriaTheevaluationistofollowtheOECD/DACcriteriaasperbelow:Relevance.Theextenttowhichtheaidactivityissuitedtotheprioritiesandpoliciesofthetargetgroup,recipientanddonor.EffectivenessAmeasureoftheextenttowhichanaidactivityattainsitsobjectives.EfficiencyEfficiencymeasurestheoutputs--qualitativeandquantitative--inrelationtotheinputs.ImpactThepositiveandnegativechangesproducedbyahumanitarianintervention,directlyorindirectly,intendedorunintended.SustainabilitySustainabilityisconcernedwithmeasuringwhetherthebenefitsofanactivityarelikelytocontinueafterdonorfundinghasbeenwithdrawn.Projectsneedtobeenvironmentallyaswellasfinanciallysustainable.InadditiontotheOECD/DACcriteriaabovethefollowingcriteriawillbefollowed:ClusterCorefunctionsandsupportingfunctions:

- Clusterleadership- Clusterpersonnel- Strategy,planning,policyandstandards- Informingstrategicdecision-makingbytheHC/HCT- Contingencyplanning/preparedness/capacity-building- Clusterresourcesandpartnerships- Supportingshelterservicedelivery- Shelteradvocacyandcommunication- MonitoringandreportingonimplementationofShelterClusterstrategy,shelterachievementsand

correctiveactionOtheradditionalcriteria,

- Lessonslearnedfromotherclusterdeployments- Clustercontributiontoshelterresponse- Accountabilitytoaffectedpopulations- Attentiontocross-cuttingissues,i.e.

• age• disability,• environment• gender,• HIVandAIDS• humanrights

Page 39: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE39OF50

• mentalhealth• minesandotherexplosivedevices

- Spherestandardsandindicators- ShelterClusterstandardsandindicators

5. MainevaluationquestionsTheevaluationistoensurethatthefollowingquestionsareaddressedthroughvariousmethodsofinformationcollectionandarerelatedtothecriteriaabove.Anyadditionorreductioninthelistofquestionsbelowistobearticulatedintheinceptionreportandagreedwiththeinternalevaluationmanager.

- DidtheShelterClusterfulfilitscorefunctionsasdefinedbytheIASC?- Towhatextentdidtheclusteraddvaluetotheresponseundertakenbyshelteractors?

- Whatrealdifferencedidtheclustermaketothepeopleaffectedbytheconflict?- Wouldithavebeenpossibletoaddthesamevalueinamoreefficientway?

- Istheclustersupportingthegovernmenttotakeupacoordinationroleinthefuture?- Hastheclustereffectivelysetitspriorities?Arethereanygapsintheprioritiestheclusterhasset?

- HastherelationshipwiththeHCTandtheclusterbeeneffective?- Havelessonslearntfrompreviousclusteractivationsbeenutilised?- Didtheclusterdoenoughadvocacytodonors,governmentandothers?

- Werecross-cuttingissuesandvulnerabilitiesexploredandacteduponwithinthecluster?- WasthereevidenceofsupportfromtheGlobalShelterCluster?

6. MethodologyThemethodologywillbedevelopedbasedontheShelterClusterEvaluationGuidelinesandshouldinclude;

a. DeskReview- Reviewofavailabledocumentedmaterialsrelatingtothestart-up,planning,implementation,andimpactof

theEmergencyShelterandNFICluster.Allrelevantdocumentationisavailableathttps://www.sheltercluster.org/response/ukraine

b. DataCollectionandStakeholdersAnalysis- InterviewswithShelterClustermemberagencies(NGOsandINGOs)- InterviewswithotherUNagenciesparticipatinginShelterCluster.- Interviewswithregionalshelterclusterleadagenciesandco-chairs.- InterviewswithotherclusterleadlikeProtection,WASH,CCCMclustersandOCHAtoanalysetheinter-

clustercoordinationmechanism.- InterviewswithkeyNGO/INGOstaffthathavehadakeyrole(SAG,TWIG,sub-nationalcoordination)in

theshelterclustercoordination.- Informalinterviewswithbeneficiariesduringsitevisitswherepossible- Observationsoftheimpactandacceptanceofshelterinterventionsonthelivesofbeneficiaries

*Asuggestedlistofintervieweeswillbeprovidedtotheevaluatorc. ThistermsofreferenceistobesharedwiththeSAGinUkraineallowingsomeaugmentationtobestsuitthe

requirementsofthecontext.d. DraftreporttobesharedwiththeUNHCRCountryRepresentative,theCoordinator,theUkraineSAGandthe

SSSinGenevae. Thefinalreportandmanagementresponseplanwillbepubliclyavailable.

7. Risks,constraintsandassumptionsTheongoingtensionsintheaffectedareasmaynecessitatechangesintheoperationalsituationandpossiblypreventaccesstotheaffectedregionwithlittlenotice.

Page 40: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE40OF50

Humanitarianassistancecontinuestobehinderedinnon-governmentcontrolledareasduetotheregistrationprocessbydefactoauthorities.FurthertothepotentiallackofaccesstoaffectedareasthereisalackofreliablebaselinedataandfurthermoreIDPpopulationbaselineisrelyingonMinistryofSocialPoliciesdatawhichisunderrevision.Furthermore,duetosecurityconstraintalongthecontactlineandalsowithintheNonGovernmentalControlledArea,datacollectionremainsexceedinglydifficult.ThemovementofpopulationandsecondarydisplacementareverydifficulttoestimateduetothelargegeographicalterritoryofUkraineandthefluidityofthepoliticalsituationmaytriggerrapidchangesintermsofPopulationofConcern(returnornewdisplacement).TheaffectedpopulationandmanyofthepartnersworkmainlyinRussian/Ukranian.InKievatranslatorcouldbeprovided,butforfieldvisittheconsultantshouldsecuretranslationcapacityifrequired,thisiscommonlyavailableforapproximately$100-150USDperday.Theconsultantshallforeseealimitedrequestintermoftranslationsupportandbeabletopartiallybeabletocopewiththelanguagebarrier(30%ofthemission).AssistancefortransportationtoandaroundfieldsitesislimitedduetooperationalprioritieshoweverUkrainehasafunctioningrailnetworkandtaxisarereadilyavailableinallareas.Thecluster’smembercompositionchangeswithainfluxofinternationalNGOfirstandsecondquarterof2015.Furthermore,thesemissionsopeninginduceahighturnoveroftheirstaffandonlyrecentlyclustermemberstaffingstabilisedwithanabilitytocapitaliseinstitutionalmemory.ItisassumedthatClusterpartnersandotheragenciesarewillingtoshareinformationaboutactivities,achievementsandchallenges(includinginternalorganisationalchallenges).Atboththenationalandsub-nationallevelUNHCRandClusterpartnerswillattempttofacilitatethemissiontoensuretheconsultantisabletofulfiltheircommitments.8. ScheduleTheevaluationwillbeimplementedduringapproximately30-40daysoveratwo-monthperiodbetweenNovemberandDecember2015.Atotalof15-20daysofthisperiodwillbespentinthefield.Thereportmusthavebeensubmitted,reviewedandacceptedbytheShelterandSettlementSectionandallfinancialtransactionsmusthavetakenplacebeforetheendofthisperiod.Amoredetailedtimelinewithdeadlinesanddeliverableswillbeincludedintheinceptionnotementionedbelow.Approximatetimingofthemissioncouldpotentiallycover:

- 5to7daysatnationallevel(Kyiv)focusingongeneralclusteraspects- 5to7daysatsubnationallevel(Sloviansk,Severodonetsk)focusingonfieldaspectonpriorityzonenearthe

contactline.- 2to4daysinKharkivorDniepropetrovskreviewingclusterinvolvementonfieldlevelinareadistanttothe

contactline.9. Mainoutputs

1. Inceptionreport(asampleformatwillbeprovided)inEnglish2. DraftEvaluationreportinEnglishwithexecutivesummary,keyrecommendationsandsupporting

information.Thisdocumentwillbereviewedbytheevaluationmanager,theUkraineShelterClusterCoordinator,theUNHCRrepresentative,andtheUkraineClusterSAG.Thesestakeholderswillprovidecommentsandclarificationstothereportofwhichtheexternalconsultantshouldtakeintoaccount.Alterationstothefinalreportasaresultofcommentsshouldbeevidencebased,restrictedtoclarificationsandforoperationalsecurityissues.

3. FinalEvaluationreportnotexceeding40pagesinEnglishwithexecutivesummary,keyrecommendationsandsupportinginformation.Thisdocumentwillbecompletedbyaddressingtheclarificationsmadetothedraftdocument.ThisdocumentwillbethebasisfortheManagementResponsePlan.

4. Recommendationsrelatingtotheclusterstructureandsystemstosupportfutureactivationand/orclosureinUkraine.Asannexes:

5. Additionalnotes,summariesofinterviewsetc.asappropriateorsupportingdocumentation.

Page 41: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE41OF50

6. Summaryofreviewactivitiesundertakenincludinginterviews,visits,documentsreviewedetc.7. Commentsonuseandapplicabilityofshelterclusterevaluationguidelines

Expectedtimelinefortheevaluation:- Selectionofevaluator/sandsigningofcontractbyendOctober- InceptionReportfirstweekofNovember- DesktopreviewcompletedbyendsecondweekNovember- UkrainefieldworkcompletebyendsecondweekDecember- DraftreportsubmissionpriortoendDecember- FinalreportsubmittedendJanuary2016

10. Evaluator(s)TheevaluationwillbecarriedoutbyanexternalindependentconsultantwithsupportofaninternalevaluationmanagerfromUNHCRinGenevaandthecoordinationteamintheUkraine.

- ExternalIndependentConsultant:leadstheevaluationprocess,carryoutthedeskreview,dotheinterviews(skypeorphone),planthetriptotheUkraineincoordinationwiththeevaluationmanagerandthecoordinationteamontheground,leadthefieldvisit,leadtheinterviews,writethedraftevaluation/review,finalizetheevaluation/reviewaccordingtothecommentsreceived.

- InternalEvaluationManager:Adviseonthepreparationofthetrip,givefeedbackandorientationonthepeopletobeinterviewed,givebackgroundtotheissuesraisedbytheintervieweesasrequired.Givecommentstothedraftevaluation/reviewandanyotheractionsthattheyandtheexternalconsultantmightfindusefulfortheevaluation/review.

TheevaluatorwillhaveathoroughunderstandingofHumanitarianReformandtheTransformativeAgenda,oftheIASCandUNHCRguidancerelatedtotheShelterCluster,andofthecontextinUkraine,preferablywithpreviousexperienceinthecountrybutnotdirectlylinkedtothecurrentESNFIclusteroperationsinUkraine,oranyotherconflictofinterestthatwouldinterferewiththeindependenceoftheevaluation.11. Management

UNHCRwillprovideacomprehensivesecuritybriefing,theconsultantwillberequiredtoabidebythesecurityprotocolsofUNHCRatalltimes.Theconsultantwill,priortoacceptanceofanycontracthavecompletedboththebasicandadvancedonlinesecuritytrainingthroughtheUNHCRwebsiteandagreetorelevantcodeofconductrequirements.UNHCRwillarrangetravelbookingstoKyivandprovidereasonableassistanceinobtaininganyrequiredvisaforworkbeingundertakeninUkraineandGenevaifrequired.Accommodation,interpretation,workspace,otherlogisticswhileinUkrainewillbefacilitatedbyUNHCRinKyiv.AccommodationandworkspaceifrequiredwillbeprovidedwhileinGenevabyUNHCRShelterandSettlementsSection.Thescheduleoffeesonceagreedisasfollows: 30%afteracceptanceoftheinceptionreport 30%afterdraftreportreceived 40%afterfinalreportapproved

Page 42: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE42OF50

Annex C. ListofKeyInformants

Organization/title # Name(s) Location20/11 GSC,GFPforUkraineuntilAugust2015 1 DavideNicolini Geneva*23/11 UNHCR,ShelterOfficer,Dniepropetrosk 2 Andreaparisi Kyiv

ProtectionClusterCoordinator 3 ChristineGoyer Kyiv24/11 PIN,SitevisitofhouserepairsinSemenovka,Sloviansk 4 ViktorGladchenko Sloviansk

PIN,ShelterProgrammeManager 5 AndrewMeyer Sloviansk ShelterCluster,Co-chairandsub-nationalCC 6 KateHolland Sloviansk

25/11 ICRC,Delegate,WatHabEngineer 7 AleksanderMailyan Sloviansk ADRA,ProjectDirector 8 MariaSliacka Sloviansk UNHCRHeadofsub-office,Kharkiv 9 AslakGimseSolumsmoen Sloviansk

26/11 SOS-Kramotorsk/RegionalGovtAdvisor 10 AleksanderVoroshkov Kramotov SavetheChildren/AreaManager 11 EvaSztacho Sloviansk

27/11 UNHCRHeadofsub-office,Sievierodonetsk 12 JeffWilkinsonKonstaninDmitrenko

Sievierodonetsk

NRC,Shelterfieldvisit–ShelterPM 13 KobaTsiramua Sievierodonetsk30/11 UNHCR,DeputyCountryRep(actingCountryRep) 14 VannoNoupech Kyiv

ShelterCluster,NationalCC 15 IgorChantefort Kyiv GSC,EvaluationManager 16 GreggMcdonald Skype ShelterCluster,ShelterAssociate,IM 17 AndriiMazurenko Kyiv OCHAfieldoffice,HumanitarianAdvisor 18 TaguiMelkumyan Sievierodonetsk* PIN,DeputyCountryDirector 19 VanessaMerlet Kyiv

1/12 MercyCorp,CountryDirector 20 StuartWillcuts Sievierodonetsk* UNHCRheadofoffice,LuhanskNGCA 21 DimitarJelev Luhansk* CRS,ProgrammeManager 22 ErikHeinonen Sievierodonetsk*

2/12 NRC,ShelterProgrammeAdvisor 23 AntoineBarbier Kyiv FourthSociety 24 RuslanViksich Kyiv DRC,DFIDconsortiumCoordinator 25 JorengStahlhut Kyiv USAID,SupervisoryProjectdevelopmentofficer 26 GregoryOlson Kyiv

3/12 WashCC 27 CarmenParadiso Kyiv DRC,EmergencyResponseTeam 28 IslaFraser Kyiv ECHO,HumanitarianAidExpert,HeadofOffice 29 SamuelMarie-Fanon

MamarMerzoukKyiv

OCHA,HumanitarianOfficer 30 IvaneBochorishvili Kyiv MinistryofRegionaldevelopmentandhousing,Head

ofpriorityconstructionprojectsimplementation31 NadiyaLeonidivna Indirectly,

translator

4/12 OCHA,CashWGCoordinator 32 RuthAggiss Kyiv *Carriedoutoverphone/Skype

Page 43: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE43OF50

Annex D. FieldVisitSchedule

Monday23 Tuesday24 Wednesday25 Thursday26 Friday27

Place Kyiv Sloviansk Sloviansk Sloviansk Sievierodonetsk

09:00Introductions

TraveltoSloviansk

UNHCRHeadofsub-officeforSievierodonetsk

10:00

NationalShelterClustermeeting

StructuralrepairWG

11:00 ICRCWatHabDelegate Sub-National

ShelterClustermeeting

fieldvisitNRC

12:00 UNHCRShelterOfficer

StructuralrepairWG

13:00 ADRA

ProjectDirector

14:00 Planningofevaluation

fieldvisitPINStructuralrepair

WG

SOS-Kramotorsk&Reptolocalauthorities

TraveltoKyiv

15:00 discussionwithSCT

PINShelterManager

16:00 ProtectionClusterCoord SCCo-chair

Sub-nationalCC

UNHCRHeadofsub-officefor

Kharkiv

SavetheChildrenAreaManager

17:00 Planningofevaluation

Monday30 Tuesday1 Wednesday2 Thursday3 Friday4

Place Kyiv Kyiv Kyiv Kyiv Kyiv

09:00

MercyCorpsCountryDirector

NRCShelterAdvisor

WASHClusterCoord

OCHACashWGCoord

10:00

11:00 UNHCRCountryrep UNHCRheadof

sub-officeLuhansk

FourthWaveSociety

DRCEmergencyCoord

presentationoninitialfindingsof

thereview

12:00

SCNationalCC

13:00

14:00

SCIM

DFID MoRD finaldiscussionwithSCUkraine

15:00

OCHAsub-office DRCDFIDconsortium OCHA

Humanitarianofficer

16:00

PINdept.countrydirector

ErikCRS USAID17:00

Page 44: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE44OF50

Annex E. OnlineSurveyQuestionnaire

1. Doyouworkfor?

◯InternationalNGO◯UNorganisation◯NationalNGO◯Nationalauthority◯RedCrossMovement◯Donor◯Other(specify)

2. Theorganizationyouworkforisa:

◯Shelter/NFIClustermember◯Shelter/NFIClusterobserver*◯Other◯Don’tknow◯ShelterClusterCoordinationteam◯Inter-ClusterCoordinationGroup(OCHA,ClusterLeadAgency,orotherClusterCoordinator)*Observersarenotfullmembersofaclusterbutmayshareinformationwithitandparticipateinitsmeetings

3. AtwhatleveldoyouparticipateintheShelterCluster?

◯National-Kiev◯Other(specify)◯Sub-national-NorthernDonbas◯Bothnationalandsub-national

4. HowoftendoyouparticipateintheShelterClustermeeting?

◯Always(everymeeting)◯Mostly(mostmeetings)◯Sometimes(fromtimetotime)◯Rarely(onlyattendedmeetingonceortwice)◯Never

5. HowusefuldoyoufindShelterClustermeetings?

◯Veryuseful◯Mostlyuseful◯Somewhatuseful◯Notuseful◯Idon’tknow

6. WhereandhowdoaccessShelterClusterinformation?(multiplechoicequestion)

◯ShelterClusterwebsite◯GoogleGroup◯Emails◯Printout◯Wordofmouth◯Other

7. HowoftendoyouvisittheShelterClusterwebsite?

◯Morethan3timesperweek◯1-3timesperweek◯1-3timespermonth◯Lessthanoncepermonth◯Never

8. HowoftendoyouusetheShelterClusterGooglegroup?

◯Morethan3timesperweek◯1-3timesperweek◯1-3timespermonth◯Lessthanoncepermonth◯Never

9. HowoftendoyoureadanduseinformationfromShelterClusterteamemails?

◯Morethan3timesperweek◯1-3timesperweek◯1-3timespermonth◯Lessthanoncepermonth◯Never

10. HowusefuldoyoufindtheinformationontheShelterClusterwebsite,Googlegroupand/oremails?

◯Veryuseful◯Mostlyuseful◯Somewhatuseful◯Notuseful◯Idon’tknow

11. HasyourorganisationparticipatedinTechnicalWorkingGroups?

◯Always(everytime)◯Mostly(mosttimes)◯Sometimes(fromtimetotime)◯Rarely(onlyonceortwice)◯Never

12. HaveyoureceivedusefultechnicalguidancefromtheShelterCluster?

◯Veryuseful◯Mostlyuseful◯Somewhatuseful◯Notuseful◯Idon’tknow

13. Hasyourprogrammemet/usedthetechnicalstandards/guidancefromtheShelterCluster?

◯Yes◯Partially◯No◯Don’tknow

14. HowdoyouperceivetheShelterCluster’sguidanceonaddressingcross-cuttingissues(gender,age,disabilities,environment,health,humanrights)?

◯Completelysufficient◯Mostlysufficient◯Somewhatsufficient◯Notsufficient◯Idon’tknow15. HasyourorganisationhelpeddeveloptheShelterClusterStrategy?*

◯Yes◯No◯Wasnothere◯Don’tknow

16. DoyouthinktheprioritiessetoutbytheShelterClusterstrategyasthemostrelevant?

◯Veryrelevant◯Mostlyrelevant◯Somewhatrelevant◯Notrelevant◯Idon’tknow

Page 45: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE45OF50

17. HasyourorganisationcontributedtoShelterClustermonthlyreporting:Who/What/Where/When/Forwhom(5W)?

◯Yes◯No◯Idon’tknow

18. HaveyouadaptedyourcoveragebasedongapsidentifiedbytheShelterCluster?

◯Yes,completelyadapted◯Someadaptation◯Alittleadaption◯Noadaptation◯Idon’tknow

19. HasyourorganisationusedinformationproducedbytheShelterCluster(maps,factsheet,advocacy)forinternalpurposesand/orprogrammedevelopment?

◯Yes◯No◯Idon’tknow20. HasyourorganisationusedShelterClusterinformation(strategy,maps,factsheetsetc)todevelop

advocacymessages?

◯Yes◯No◯Idon’tknow

21. HastheShelterClusterproducedandsharedusefuladvocacymessagesonbehalfoftheShelterClustermembersfordonors?

◯Yes◯No◯Idon’tknow

22. HastheShelterClusterproducedandsharedusefuladvocacymessagesonbehalfoftheshelterclustermembersforgovernment?

◯Yes◯No◯Idon’tknow

23. HowdoyouperceivetheShelterCluster’sinvolvementwithNationalauthoritiesinKiev?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

24. HowdoyouperceivetheShelterCluster’sinvolvementwithauthoritiesatsub-nationallevel?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

25. HowdoyouperceivetheShelterCluster’sinvolvementwithNationalNGOs?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

26. Doyouorstaffinyourorganisationattendotherclustermeetings?

◯No◯Idon’tknow◯Yes(WASH)◯Yes(Protection)◯Yes(Livelihoods/EarlyRecovery)◯Yes(Food)◯Yes(Health/Nutrition)◯Yes(Education)◯Yes(Logistics)

27. HowdoyouperceivethecoordinationbetweentheShelterClusterandInternationalNGOs?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

28. HowdoyouperceivethecoordinationbetweentheShelterClusterandUNagencies?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

29. HowdoyouperceivethecoordinationbetweentheShelterClusterandtheRedCrossMovement?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

30. HowdoyouperceivethecoordinationbetweentheShelterClusterandthedonorcommunity?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

31. HoweffectiveisthecoordinationbetweenShelterClusterandotherclusters(e.g.Wash,Protection)?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

32. Howeffectiveisthecoordinationatinter-clusterlevelwithOCHA?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

33. HoweffectiveisthecoordinationattheHCTlevel?

◯VeryEffective◯Effective◯Somewhateffective◯Noteffective◯Idon’tknow

Page 46: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE46OF50

Annex F. PrioritisationofICCGItems Inlightofthehighnumberofreports,strategydocuments,assessments,monitoring,andworking

groups,ledbyOCHAandtheICCG,itwouldbeusefultoprovidealistofitemsfrequentlyencounteredduringanemergencyandwhichoftheseshouldbeconsideredhighpriorityandcompulsoryfortheCCtocontributeto,andwhichitemsarerecommendedand/oradvisedbutnotessential.ThistablecouldbeincludedinthepackageprovidedtoUNHCRstaff(referKR:7)

Thetablebelowprovidesanon-exhaustivelistofitems,meetingsandreporttypesfrequently

usedduringemergencies.ItwouldbeusefulfortheGSCtoelaboratethislistandprovideapriorityscoringtofacilitatethetaskofCC:

Description

Priority

Est.workload

(hou

rs/w

eek)

NotesMandatory

Impo

rtant

Advised

Meetin

gs

ICCG/Inter-clustermeeting X 4 OCHAIMWG X 3 OCHACashWG X 3 OCHAAAPWG X - OCHACWCWG X - HumanitarianCountryTeam X 2 Mandatorytobrief,CLArepresents.

Weeklyworkload,externalmeetings 12 Reportifactualtimeexceedsby50%

Repo

rts/Jo

int

Assessmen

t

Mid-yearPMR X - QuarterlyPMR X - MIRA/MSNA X - Othermulti-clusterassessment X - OCHASitRep X 2 HumanitarianBulletin X 0.5

Weeklyworkload,externalreports 3 Reportifactualtimeexceedsby50%

Other

CentralEmergencyResponseFund

X -

HumanitarianNeedsOverview X - HumanitarianResponsePlan X - Adhocworkshop(preparationofHRP,contingencyplanning)

X -

Weeklyworkload,othercommitments - Reportifactualtimeexceedsby50%

Page 47: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE47OF50

Annex G. RecommendationsfromIMReviewMissiontoShelterClusterUkraine BelowisalistofrecommendationsfromthemissionreportfromBoHurkmanfollowingthe

InformationManagementreviewmissiontoShelterClusterUkraineon24-29August2015:

1.

1.

1.

2.

3.

4.

1.2.

1.

2.

3.

4.

1.2.

Useofe-mailRecommendationsforGlobalShelterClusterSet-upShelterClustere-mailaccountsperfunctionintheclustercoordinationteamandforwardincominge-mailtoexistingorganisationalaccountstoensureeaseofusefortheclustercoordinationteamandpredictabilityforclusterpartners.RecommendationsforShelterClusterUkraineExplaintopartnersthattheycanusetheGoogleGroupse-mailaccounttowritetoallpartnersifneeded.UseofthewebsiteRecommendationsforGlobalShelterClusterTraintheclustercoordinationteamontheuseofTableauandinstallTableauPublicsothatinteractivetablescanbekeptup-to-date.ProvidebasicguidanceontheuseoftheDrupalcontentmanagementsystemtoensurethatcontentisuploadedproperlyandthatinteractivedashboardscanbeembedded.ExplorepossibilitiesofconnectingtheShelterClusterwebsitewithHR.infotoavoidhavingtomaintaintwowebsites.Needtobeabletoclearlydistinguishbetweenlatestofficialversionanddraftversionsofuploadeddocuments.RecommendationsforShelterClusterUkraineOnceagreedupon,makerecommendedNFIkitcontentavailablepersituationandregion.Trytoupdatethewebsiteregularly(forinstanceweeklyonFridaymornings).DatastorageandsharingRecommendationsforGlobalShelterClusterLookattheoptionofexpandingonthepaidDropboxplanfromFICSStoavoidtheuseofpersonalaccountsthatrunoutofspaceratherquickly.GoogleAppscanbeconsideredforwiderimplementationaswellgiventhewideuseofGoogleSheetsandForms.SupportfromFICSSinGIStrainingandsettingupArcGISsoftwarewithtemplatesshouldbemadeavailabletootherclustersasneeded.Itisgoodpracticetorecordrequestsfrompartnersformapstotracktheirusage.RecommendationsforShelterClusterUkraineSmallerworkinggroupsforoperationalcoordinationareneededintheeast.BeneficiaryduplicationshouldbeavoidedthroughsharingnationalIDnumber(iflegallypossibleandconsenthasbeengivenbythebeneficiaries),however,thisrequiresanationalhumanitarianregistrationdatabasethatcurrentlydoesnotexist.

Page 48: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE48OF50

1.

1.

1.

2.3.

1.

1.

1.

2.

3.

1.

1.2.

ContactlistRecommendationsforGlobalShelterClusterConsiderusingGmailasthee-mailproviderforShelterClustere-mailaccountstoavoidtheneedtoregisternewe-mailaccountsforthepurposeofaccessingGoogleApps.RecommendationsforShelterClusterUkraineAddadditionalfields(suchasorganisationcategoryandparticipationinnational/sub-nationalclustermeetingsand/orTWIGs/SAG)tothecontactlisttoavoidhavingtoaddthisinformationmanuallyafterwards.MapsRecommendationsforGlobalShelterClusterEnsurethattheGISOfficerisenrolledintheupcomingGISandDataVizWorkshopinGeneva,followedbyadebrieftotheclustercoordinationteamandIMWG.ExploreoptionsforpublishingstaticmapstoArcGISOnline.NeedtodefinestandardiconsandgraphicsforuseonmapsbytheShelterCluster.RecommendationsforShelterClusterUkraineIncludemoretrendanalysisinthemapswherepossibleandresourceallowing.WhoisdoingWhat,WhereandWhen(4W)RecommendationsforGlobalShelterClusterAgreeonwhetherornotthevalueofinterventionsshouldbecapturedinthe4W.RecommendationsforShelterClusterUkraineExpandthecoverageofthe4Wwherepossiblebygatheringinformationoninterventionsbyotheractors(suchasforinstancetheICRC)atlocallevelandsharecluster4Wwiththemfortheiruse.Someinformationmighthavetobekeptinternalbutcanstillservetogetamorecomprehensiveideaabouttheneedsmetbyotheractors.Inmostcases,thisinformationcanbegatheredthroughthesub-nationalcluster.Exploreoptionsofmakingthe4Wavailableonlinesothatpartnerscanaccessthemostup-to-dateversionatanytime.Regularlycheckwithpartnerstoseeifadditionaltrainingisneededinusingthe4Wtools.AssessmentsRecommendationsforGlobalShelterClusterandShelterClusterUkraineMakemobiledatacollectionmethodologyandtoolsavailabletoclusterpartners,theGSCandShelterClusterUkrainecouldsupportotherclusterswiththis.Alibraryofassessmentformscanbecreatedaswell.GeneralrecommendationsAlwaysmakerawdataavailabletopartners.Needtokeeptheassessmentmethodologysimpleandtrainenumeratorsofpartners.

Page 49: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE49OF50

Annex H. Bibliography DavidsonS.,AReviewoftheIFRC-ledShelterClusterHaiti2010,April2011. GlobalShelterCluster,AccountabilityWorkingGroup,ShelterClusterIndicatorGuidelines,Version

2–Draft,October2013 GlobalShelterClusterToolkit,Scopeofcountry-levelshelterclusters,retrievedfrom

https://www.sheltercluster.org/working-group/coordination-toolkit GlobalShelterClusterStrategy2013-2017,retrievedfromhttp://www.sheltercluster.org/global GlobalShelterCluster,Missionreport-IMmissiontoUkraine,BoHurkmans,August2015.

RetrievedfromUkraineShelterClusterinternaldrive. GlobalShelterCluster,CommunicationandAdvocacyStrategyfortheShelterCluster,March2014

retrievedfromhttp://www.sheltercluster.org/ GlobalShelterCluster,AccountabilityWorkingGroup,AccountabilitytoAffectedPopulations,

retrievedfromhttps://www.sheltercluster.org/ GlobalShelterCluster,Evaluationguidelines-OverviewTools,February2015. HedlundK.,ShelterandNFIClusterEvaluationCycloneGiriResponse,MyanmanOctober2010to

January2011,IFRC,July2011. HighLevelPanelonHumanitarianCashTransfer,DoingCashdifferently,ALNAPStudy,London:

ALNAP/ODI. InterAgencyStandingCommittee,ReferenceModuleforClusterCoordinationatCountrylevel,

Revised,July2015. KellettJ.,AReviewoftheEmergencyShelterClusterKoshiFloodsEmergencyResponse,Nepal,

fromAugust2008,IFRC,March2009. KnoxClarke,P.andCampbell,L.(2015)Exploringcoordinationinhumanitarianclusters,ALNAP

Study.London:ALNAP/ODI. OCHA,UkraineHumanitarianNeedsOverview(HNO),2015 OCHA,UkraineHumanitarianResponsePlan2015,retrievedfrom

https://www.humanitarianresponse.info/ OCHA,UkraineContingencyPlanning,May2015. OCHA,UkraineHumanitarianSituationMonitoring,December2014. RantanenJ.,ShelterClusterReview2009IndonesiaEarthquake,IFRC,January2011. REACH,Shelter&NFINeedsAssessmentReport,Ukraine,August2015. ShelterClusterUkraineStrategy,September2014,retrievedfromUkraineShelterClusterinternal

drive. ShelterClusterUkraineStrategy,June2015,retrievedfrom

http://sheltercluster.org/response/ukraine ShelterClusterUkraine,Factsheet,August2015 ShelterClusterUkraine,Factsheet,September2015 ShelterClusterUkraine,Factsheet,November2015 ShelterClusterUkraine,ToR,May2015. ShelterClusterUkraine,Ukraine:CashAssistancePostDistributionMonitoringReport(2014-2015),

Summaryreport,June2015 ShelterClusterUkraineTechnicalGuidelines. ShelterClusterUkraine,VulnerabilityCriteriaforCashAssistance,retrievedfrom

http://www.sheltercluster.org/response/ukraine ShelterClusterPhilippines,Beneficiaryselectionandrecommendationsontargetingand

prioritisation,retrievedfrom:https://www.sheltercluster.org/ UkraineNGOForum,UkraineMulti-SectorNeedsAssessment(MNSA)report,March2015,

retrievedfromhttp://acaps.org/

Page 50: 160302 Final Report Evaluation of the Ukraine Shelter Cluster · the Ukraine SC, in partnership with the Ministry of Regional Development and Housing (MoRD) ... The shelter response

EVALUATIONOFTHEEMERGENCYSHELTERANDNON-FOODITEMSCLUSTERINTHEUKRAINE| 2015-2016

FINALREPORT|FEBRUARY2016 PAGE50OF50

Annex I. ListofAcronyms

AAP AccountabilitytoAffectedPopulationCC ClusterCoordinatorCLA ClusterLeadAgencyGCA Government-controlledareaGSC GlobalShelterClusterHC HumanitarianCoordinatorHCT HumanitarianCountryTeamHRP HumanitarianResponsePlanIASC Inter-agencyStandingCommitteeHH Household

ICCG Inter-ClusterCoordinationGroupIDP InternallydisplacedpersonIM InformationManagement

INGO Internationalnon-governmentalorganisationMoRD MinistryofRegionalDevelopmentandHousingMoSP MinistryofSocialPolicyMSNA Multi-SectoralNeedsAssessmentMPCG Multi-PurposeCashGrant

NFI Non-foodItemsNGCA Non-governmentcontrolledareasNGO Non-governmentalorganisation

NNGO Nationalnon-governmentalorganisationOCHA UnitedNationsOfficefortheCoordinationofHumanitarianAffairsPoLR ProviderofLastResortPDM PostDistributionMonitoringPIN PeopleinNeedRC ResidentCoordinatorRFP RegionalFocalPointtotheShelterClusterSC ShelterCluster

SCM ShelterClusterMeetingSCT ShelterClusterTeamSES State’sEmergencyServicesSRP StrategicResponsePlanTOR TermsofReference

TWIG TechnicalWorkingGroupUNDP UnitedNationsDevelopmentProgramme

UNHCR UnitedNationsHighCommissionerforRefugeesWG WorkingGroup


Related Documents