8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
1/68
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
2/68
Xfd bmssmag ai tfd @arparltmag iar Gltmaglk lgh @abbugmty Pdrvm`d (@G@P) ms tambpravd kmvds, strdgetfdg `abbugmtmds, lgh iastdr `mvm` dgeledbdgt tfrauef sdrvm`d lgh vakugtddrmge.
L idhdrlk ledg`y, @G@P dgeleds bard tflg imvd bmkkmag Lbdrm lgs mg sdrvm`d tfrauef Lbdrm@arps, Pdgmar @arps, Pa`mlk MggavltmagIugh, Yakugtddr Edgdrltmag Iugh, lgh atfdr praerlbs, lgh kdlhs tfd Zrdsmhdgts gltmaglk `lkk ta sdrvm`d mgmtmltmvd, Tgmtdh Ud Pdrvd.
Iar bard mgiarbltmag, vmsmtGltmaglkPdrvm`d.eav.
Xfms ha`ubdgt ms mg tfd punkm` hablmg. Lutfarmzltmag ta rdprahu`d mt mg wfakd ar mg plrt ms erlgtdh.Tpag rdqudst, tfms bltdrmlk wmkk nd blhd lvlmklnkd mg lktdrgltmvd iarblts iar pdapkd wmtf hmslnmkmtmds.
http://www.nationalservice.gov/http://www.nationalservice.gov/http://www.nationalservice.gov/http://www.nationalservice.gov/8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
3/68
Xlnkd ai @agtdgts
Eumhlg`d Avdrvmdw ................................................................................................................................................................................ 4
Y. Fublg Punod`ts Zratd`tmag ............................................................................................................................................................. >=
YM. ^dpartmge Ptrltdey, Xmbdkmgd, lgh Nuhedt .................................................................................................................................. 0:
YMM. Dvlkultar \ulkmim`ltmags lgh Mghdpdghdg`d ............................................................................................................................. 08
Lppdghmx L? ^didrdg`ds ..................................................................................................................................................................... L.-8 pleds)
L.
^dsdlr`f \udstmags. Mbpkdbdgtltmag
N. @agtrmnutmag ai tfd Ptuhy
MY. Ptuhy @abpagdgts (dstmbltdh -8 pleds)
YMMM. Erlgtdd/Punerlgtdd akd lgh Mgvakvdbdgt (dstmbltdh :.4-< pled)
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
8/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 4
Hdtlmkdh Eumhlg`dDxd`utmvd Pubblry
Mg`kuhd lg avdrvmdw ai tfd praerlb, tfd agtdxt ai tfd dvlkultmag lgh tfd dvlkultmag lppral`f yau mgtdgh ta
usd. Ls wmtf lgy Dxd`utmvd Pubblry, tfd purpasd ms ta prdsdgt tfd rdlhdr wmtf tfd fmefkmefts ai tfd iukk
ha`ubdgt, dmtfdr ta nrmdi vdry nusy rdlhdrs ar ta sdrvd ls lg avdrvmdw ta ndttdr prdplrd rdlhdrs iar tfd iukk
ha`ubdgt.
Ppd`mim` Eumhlg`d? Dxd`utmvd Pubblry
Xfd Dxd`utmvd Pubblry sfaukh agtlmg tfd iakkawmge?
Glbd ai arelgmzltmag3
L agd-plrlerlpf sygapsms ai tfd praerlb lgh wflt mt mgtdghs ta flged/mbpl`t3
L nrmdi sygapsms (agd ta twa sdgtdg`ds) ai prmar rdsdlr`f hagd ag tfd praerlb3
L nrmdi hds`rmptmag ai tfd bdlsurds/mgstrubdgts ta nd usdh, lgh tfd typds ai hltl ta nd `akkd`tdh irab
tfdb3
L nrmdi hds`rmptmag ai tfd prapasdh lglkysms lppral`f(ds)3
L subblry ai tfd cdy tmbdkmgd dkdbdgts/hltds (d.e., hltds tflt plrtm`mplgt rd`rumtbdgt lgh hltl
`akkd`tmag gddh ta stlrt/dgh, lgh wfdg lglkysms lgh rdpartmge wmkk tlcd pkl`d)3
Xfd dstmbltdh nuhedt3 lgh
L nrmdi hds`rmptmag ai tfd dvlkultmag tdlb lgh bdbndrs dxpdrmdg`d rdkltdh ta tfd diiart.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
9/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 9
M. Mgtrahu`tmag
Xfd mgtrahu`tmag ta yaur dvlkultmag pklg dstlnkmsfds tfd agtdxt ai tfd dvlkultmag tflt yau lrd prapasmge. Mt
sfaukh iurtfdr hds`rmnd tfd praerlb nl`ceraugh lgh prankdb hdimgmtmag, lgh emvd lg avdrvmdw ai prmar
rdsdlr`f ag tfd praerlb. L praerlb hds`rmptmag lgh avdrvmdw ai prmar rdsdlr`f lrd `ru`mlk ta sdttmge up tfd
avdrlkk dvlkultmag hdsmeg. Xfdy pravmhd l stlrtmge pamgt iar lssdssmge aut`abd bdlsurdbdgt mg tfd `urrdgt
praerlb. Lt tfd slbd tmbd, tfdy lksa pravmhd lg ughdrstlghmge ai faw tfd praerlb fls warcdh mg tfd plstlgh wflt dvmhdg`d ai diid`tmvdgdss bly nd dxpd`tdh, ls wdkk ls mgiarbltmag ag patdgtmlk`agtrakar`abplrmsag
eraups.
Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag
L strage hds`rmptmag ai tfd praerlb lgh mts armemgs agtdxtulkmzds tfd dvlkultmag. Xfd rdkltmagsfmp ai tfd
praerlb ta tfd prankdb mt ms hdsmegdh ta lhhrdss ms lksa mbpartlgt taughdrstlgh tfd avdrlkk dvlkultmag hdsmeg.
Ppd`mim` Eumhlg`d? Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag
Xfd Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag sd`tmag hds`rmnds tfd prankdb ar mssud tfd praerlblhhrdssds. Ls plrt ai tfms hds`rmptmag, tfd dvlkultmag pklg sfaukh nrmdiky hms`uss tfd praerlb tfdary lgh kaem`
bahdk. Xfms sd`tmag sfaukh lksa mg`kuhd mgiarbltmag ag`drgmge praerlb abpagdgts,mgtdrvdgtmag kdvdk,
ndgdim`mlrmds, lgh cdy aut`abds.
Avdrvmdw ai Zrmar ^dsdlr`f
PMI-iughdh praerlbs lrd dxpd`tdh ta bddt lg dvmhdg`d tfrdsfakh ta nd iughdh lgh bust numkh upag tfms
dvmhdg`d ls l rdqumrdbdgt ai tfd erlgt. Mg edgdrlk, mt ms mbpartlgt ta mhdgtmiy wflt rdsdlr`f fls nddg hagd lgh
faw tfd pklggdh dvlkultmag wmkk agtrmnutd ar numkh upag tfms dxmstmge rdsdlr`f nlsd. Mg tfms sd`tmag, ha`ubdgt
tfd prdvmaus rdsdlr`f tflt fls nddg abpkdtdh lgh agtdxtulkmzd tfd dvlkultmag pklg.
Ppd`mim` Eumhlg`d? Avdrvmdw ai Zrmar ^dsdlr`f
Hds`rmnd lgy dvlkultmags ar atfdr rdsdlr`f ag tfd praerlb, lgh mg`kuhd tfd iakkawmge iar dl`f?
Ufdg tfd stuhy wls hagd3
Ufa aghu`tdh tfd stuhy3
Xfd praerlb papukltmag (gubndr lgh nrmdi hds`rmptmag) mgvakvdh mg tfd stuhmds3
Lgy abplrmsag ar agtrak eraup mgvakvdh (gubndr lgh nrmdi hds`rmptmag)3
Xfd dvlkultmag lppral`f ar bdtfahs usdh (d.e., rlghabmzdh agtrakkdh trmlk, qulsm-dxpdrmbdgtlk
hdsmeg, lsd stuhmds, mbpkdbdgtltmag stuhy)3
L nrmdi hds`rmptmag ai tfd imghmges3 lgh
Xfd kdvdk ai dvmhdg`d lttlmgdh (d.e., bahdrltd, strage).
Mg`kuhd tfd slbd mgiarbltmag kmstdh lnavd iar lgy rdkdvlgt rdsdlr`f ar dvlkultmag imghmges ag smbmklr
praerlbs (d.e., praerlbs usmge tfd slbd mgtdrvdgtmag mg atfdr ka`ltmags ar smbmklr mgtdrvdgtmags wmtf dmtfdr tfd
slbd ar hmiidrdgt papukltmags).
Gatd? Mi tfd `urrdgt praerlb fls l klred prd-dxmstmge dvmhdg`d nlsd ar mi tfdrd ms dxtdgsmvd rdsdlr`f ag smbmklr
praerlbs, mt bly nd bard prl`tm`lk ta mg`kuhd mgiarbltmag irab cdy dvlkultmag stuhmds ar lgy lvlmklnkd bdtl-
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
10/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 5
lglkysds, subblrmzmge tfd nukkdtdh mgiarbltmag lnavd. Iar praerlbs tflt flvd dxtdgsmvd rdsdlr`f, yau bly
wlgt ta put tfms mgiarbltmag mg tlnuklr iarb (sdd Lppdghmx @ iar l slbpkd tlnkd). Zkdlsd lksa mg`kuhd
rdidrdg`ds ta tfd saur`d ai tfd prmar rdsdlr`f ar dvlkultmag.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
11/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 6
MM. Zraerlb Xfdary lgh Kaem` Bahdk
Xfd dvlkultmag pklg sfaukh mg`kuhd lg avdrvmdw ai yaur praerlbs tfdary
lgh l kaem` bahdk tflt eumhds tfd dvlkultmag lgh pravmhds tfd rdlhdr wmtf l
ndttdr ughdrstlghmge ai faw yaur praerlb ms dxpd`tdh ta l`fmdvd mts tlredtdh
aut`abds lgh mbpl`ts.
L hds`rmptmag ai praerlb tfdary, aupkdh wmtf lg mgiarbltmvd kaem` bahdk,
irlbds tfd dvlkultmag hdsmeg. Tghdrstlghmge tfd tfdary lgh lssubptmags
ndfmgh faw l praerlb ms hdsmegdh ms lg mbpartlgt prd`ursar upag wfm`f lkk
sunsdqudgt dvlkultmag l`tmvmtmds iughlbdgtlkky rdst (^assm, Kmpsdy, &
Irddblg, >::8). L praerlb kaem` bahdk usulkky mg`kuhds natf l erlpfm`
hmspkly lgh l glrrltmvd hds`rmptmag ai tfd rdsaur`ds/mgputs, tfd praerlb
l`tmvmtmds tflt agstmtutd tfd mgtdrvdgtmag, lgh hdsmrdh plrtm`mplgt
aut`abds/rdsukts.
Kaem` bahdks, wfm`f lrd eraughdh mg ltfdary ai `flged,usd warhs lgh erlpfm`s ta hds`rmnd tfd sdqudg`d ai
l`tmvmtmds tfaueft ta nrmge lnaut flged lgh faw tfdsd l`tmvmtmds lrd kmgcdh ta tfd rdsukts tfd praerlb msdxpd`tdh ta l`fmdvd. Xfms pra`dss mg`kuhds sdqudgtmlkky tfmgcmge tfrauef lgh lkmegmge tfd iakkawmge lrdls?
^dsaur`ds/Mgputs? Mg`kuhd rdsaur`ds tflt lrd lvlmklnkd lgh hmrd`tky usdh iar tfd praerlb l`tmvmtmds,
mg`kuhmgefublg, imglg`mlk, arelgmzltmaglk, lgh abbugmty rdsaur`ds3
Mgtdrvdgtmag?Mg`kuhd praerlb l`tmvmtmds (m.d., wflt `agstmtutds tfd praerlb mgtdrvdgtmag) wmtf tfd
rdsaur`ds yau kmstdh prdvmausky tflt kdlh ta tfd mgtdghdh praerlb rdsukts/aut`abds3 lgh
Aut`abds/^dsukts? Mg`kuhd flgeds tflt a``ur nd`lusd ai tfd praerlb mgtdrvdgtmag prdvmausky hds`rmndh
usmge tfd rdsaur`ds prdvmausky hds`rmndh. Xfdsd lg nd lgy ai tfd iakkawmge?
l) Pfart-tdrb aut`abds (autputs) bly mg`kuhd tfd lbaugt ai mgtdrvdgtmag (m.d., tfd qulgtmty lgh
typd(s) ai praerlb l`tmvmtmds l plrtm`mplgt l`tulkky tlcds plrt mg) lg mghmvmhulk rd`dmvds ar spd`mim``flgeds mg cgawkdhed ar scmkks3
n) Mgtdrbdhmltd aut`abds bly mg`kuhd `flgeds mg mghmvmhulks ndflvmars ar lttmtuhds3 lgh
`) Kage-tdrb aut`abds (mbpl`ts) bly mg`kuhd tfd flgeds a``urrmge mg `abbugmtmds ar systdbs ls l
rdsukt ai praerlb mgtdrvdgtmags.
Lg dxlbpkd ai l kaem` bahdk `lg nd iaugh mgLppdghmx @(Dxlbpkds lgh Xdbpkltds) sd`tmag ai tfms eumhd.
Ppd`mim` Eumhlg`d? Zraerlb Xfdary lgh Kaem` Bahdk
Xfd praerlb tfdary lgh kaem` bahdk l``abpkmsf tfd iakkawmge?
. Dgsurd lkmegbdgt lbage tfd kaem` bahdk dkdbdgts. Ia`us ag cdy il`tars mg tfd `lusd-lgh-diid`t
rdkltmagsfmp. Xfmgc lnaut lgh hds`rmnd faw tfd rdsaur`ds/mgputs kmgc ta tfd mgtdrvdgtmag lgh tfdg kmgc
ta tfd hdsmrdh aut`abds/rdsukts3
0. Hdtlmk tfd dkdbdgts ai tfd rdsaur`ds/mgputs lgh lrtm`ukltd tfd pltfs tfrauef wfm`f tfd sdrvm`ds
pravmhdh liid`t mghmvmhulk aut`abds (d.e., dbpkaybdgt, fdlktf, dhu`ltmag). Blcd surd tflt tfd l`tmvmtmds
hmrd`tky kdlh ta tfd dxpklgltmag ai sfart-tdrb aut`abds/autputs (d.e., mg`rdlsdh stuhdgt lttdghlg`d)
Lhhmtmaglk dsaur`ds
Xfd Cdkkaee Iaughltmags >::8
Kaem` Bahdk Hdvdkapbdgt
Eumhd
(fttp?//www.wcci.are/cgawkdhed-
`dgtdr/rdsaur`ds/>::9/:>/wc-
cdkkaee-iaughltmag-kaem`-bahdk-
hdvdkapbdgt-eumhd.lspx)
pravmhds lhvm`d lgh dxlbpkds
iar `agstru`tmge l kaem` bahdk.
http://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspx8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
12/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI =
lgh mgtdrbdhmltd-tdrb aut`abds (d.e., mbpravdh rdlhmge s`ards) tflt waukh nd gd`dsslry ta l`fmdvd tfd
praerlbs kage-tdrb aut`abds/mbpl`ts (d.e., fmef s`faak abpkdtmag, akkded rdlhmgdss)3
8. Dbpflsmzd tfd aut`abds tflt tfd prapasdh dvlkultmag wmkk bdlsurd3 lgh
4. Mg`kuhd agky mgiarbltmag tflt ms hmrd`tky rdkltdh ta tfd tfdary ai flged. Cddp tfd kaem` bahdk smbpkd ta
bmgmbmzd lttdgtmag ta tfmges tflt `lggat nd `agtrakkdh.
Xfd kaem` bahdk sfaukh uktmbltdky nd usdh ta eumhd tfd `akkd`tmag ai hltl ta mgiarb lg lssdssbdgt ai praerlb
diid`tmvdgdss. Xfd kaem` bahdk sfaukh dbpflsmzd hdtlmks ai tfd praerlb tflt hmrd`tky rdkltd ta tfd ard lspd`ts
ai tfd dvlkultmag.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
13/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI ::6l)
Xd`fgm`lk Bdtfahs dpart?
Eumhdkmgds iar Buktmpkd
Xdstmge mg Mbpl`t Dvlkultmags
(G@DD >::6-8:
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
14/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
15/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI
MY. Ptuhy @abpagdgts
Avdrvmdw
Xfd Ptuhy @abpagdgts sd`tmag pravmhds eumhlg`d ag tfd hdsmeg dkdbdgts ai mbpl`t lgh mbpkdbdgtltmag
dvlkultmags, lgh mssuds tflt gddh ta nd lhhrdssdh rdelrhmge stuhy bdlsurds, slbpkmge, lgh hltl akkd`tmag. Mt
lksa hdtlmks tfd rmtdrml iar hds`rmptmags ai stltmstm`lk lglkysds ai hltl lgh lppral`fds ta bmssmge hltl. Mg tfmssd`tmag ai tfd eumhdkmgds, mgiarbltmag, spd`mim` eumhlg`d, lgh rmtdrml iar hmiidrdgt hdsmeg typds lrd prdsdgtdh
sdplrltdky. Pmg`d yaur dvlkultmag pklg bly lhhrdss agd ar bard typds ai mbpl`t/aut`abd dvlkultmag hdsmegs
ls wdkk ls mbpkdbdgtltmag dvlkultmag ar idlsmnmkmty stuhmds, pkdlsd rdvmdw tfd eumhlg`d sd`tmags iar tfd hdsmegs
lgh atfdr stuhy `abpagdgts sfawg mg tfd tlnkd ndkaw.
Ptuhy @abpagdgt
-
-
-
-
-
-
Iakkaw tfd eumhlg`d iar tfms sd`tmag?
Mbpl`t Dvlkultmag-Hdsmeg Xypds,
mg`kuhmge?
]ds (Lg dvlkultmag pklg wmkk typm`lkky
`faasd agd ar bard typds ai
Mbpl`t/Aut`abd Dvlkultmag hdsmegs)
^lghabmzdh Ndtwddg Eraup Hdsmeg Mi lppkm`lnkd
Eraups Iarbdh ny Blt`fmge Mi lppkm`lnkd
Eraups Iarbdh ny @utaii P`ard Mi lppkm`lnkd
Pmgekd Eraup Hdsmeg Mi lppkm`lnkd
Mgtdrruptdh Xmbd Pdrmds Hdsmeg Mi lppkm`lnkd
Zrd-dxpdrmbdgtlk Hdsmeg (m.d., ga
`abplrmsag eraup/`augtdril`tulk)
Mi lppkm`lnkd
- Mbpl`t Idlsmnmkmty Ptuhy Mi lppkm`lnkd
Mbpkdbdgtltmag Dvlkultmag Mi lppkm`lnkd
Plbpkmge, Bdlsurds, lgh Hltl
@akkd`tmag
]ds (Lkk dvlkultmag pklgs sfaukh
mg`kuhd)
Ptltmstm`lk Lglkysms ai Mbpl`ts ]ds (Lkk dvlkultmag pklgs sfaukhmg`kuhd)
Zraerlb dvlkultmags bly flvd buktmpkd abpagdgts, mg`kuhmge mbpkdbdgtltmag lglkysms, aut`abd lglkysms,
mbpl`t lglkysms, lgh ast-ndgdimt, ast-diid`tmvdgdss ar atfdr `ast mg`kusmvd lglkysds.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
16/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI mg
Lppdghmx @ (Dxlbpkds lgh
Xdbpkltds).
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
17/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
18/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
19/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI ::>3 assm, Kmpsdy, & Irddblg, >::8). Fawdvdr, blt`fmge
mg lhvlg`d ai tfd trdltbdgtwmtf vlrmlnkds tflt lrd dmtfdr prd-mgtdrvdgtmag
bdlsurds ai lg aut`abd ar lrd fmefky `arrdkltdh wmtf tfd aut`abd wmkk
bmgmbmzd tfd flg`d ai hmiidrdg`ds ndtwddg tfd trdltbdgt lgh abplrmsag
eraup. Hamge sa kdssdgs tfd passmnmkmty tflt ansdrvdh hmiidrdg`ds lrd mg il`t
hud ta dxtrlgdaus hmiidrdg`ds ndtwddg tfd trdltbdgt lgh abplrmsag eraups,
rltfdr tflg hud ta praerlb plrtm`mpltmag.
Bdtfahs iar blt`fmge pdapkd ar smtds ta eraups hmiidr mg tfdmr diid`tmvdgdss.Zrapdgsmty s`armgebdtfahs, arstltmstm`lk lssdssbdgts ai smbmklrmty lbage plrtm`mplgts, lrd prdidrrdh wfdg eraups lrd blt`fdh wmtf buktmpkd
prd-mgtdrvdgtmag bdlsurds. Fawdvdr, tfd typd ai blt`fmge lkearmtfb usdh ta mbpkdbdgt tfd prapdgsmty
s`armge sfaukh nd lrdiukky sdkd`tdh nlsdh ag smbukltmag stuhmds, prdvmaus rdsdlr`f tflt hdbagstrltds tfd
vlkmhmty ai tfd lkearmtfbs, lgh tfd ealks ai tfd dvlkultmag. Pdd Page lgh Fdrblg (>:::8) iar l edgdrlk
avdrvmdw ai rdsdlr`f hdsmeg mg
dvlkultmag.
Pdd Pflhmsf, @aac, lgh@lbpndkk (>::>) iar hdtlmks ag
dxpdrmbdgtlk rdsdlr`f hdsmeg.
Iar bard mgiarbltmag ag
qulsm-dxpdrmbdgtlk dvlkultmag
hdsmegssdd?
fttp?//ssbag.`fn.ctf.sd/slidnc
/@fpQ8.phi
http://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdf8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
20/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI ::6), lvlmklnkd
fdrd?
fttp?//il`ukty.sbu.dhu/bmkkmbd
t/`klssds/d`a5055/plpdrs/mbnd
gs%>:kdbmdux.phi)
L`kdlr autkmgd ai tfd bdtfah
ms lksa emvdg fdrd?
fttp?//www.sa`mlkrdsdlr`fbdt
fahs.gdt/cn/qulsmrh.pfp
http://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdf8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
21/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI ::6).
Xfd mgtdrruptdh tmbd sdrmds hdsmeg fls nddg bast irdqudgtky lgh diid`tmvdky
usdh wfdg tfd mgtdrvdgtmag ms l praerlb ar pakm`y ai smegmim`lgt s`apd, su`f ls
`abbugmty mgtdrvdgtmags ta mbpravd fmkh-rdlrmge prl`tm`ds ar blghltary
sdlt ndkt klws mg l stltd. Xfd sa`mlk dvlkultmag rdsdlr`f kmtdrlturd mg`kuhds
blgy hds`rmptmags lgh dxlbpkds ai tfd hdvdkapbdgt lgh mbpkdbdgtltmag ai
tfms hdsmeg lgh tfd lglkysms ai hltl edgdrltdh ny mt (Nm`cblg & ^ae, >::=3
Cflghcdr, Caakwlk, & Plblh, >:::83 Pflhmsf, @aac, & @lbpndkk, >::>).
Lhhmtmaglkky, lktfauef tfms hdsmeg ms kmstdh ls l smgekd-eraup hdsmeg, l `abplrmsag eraup ms usulkky gddhdh ta
lhhrdss tfd passmnmkmty tflt dxtrlgdaus dvdgts kmgcdh ta faw hltl wdrd `akkd`tdh ar aut`abds wdrd hdvdkapdh
Lhhmtmaglk dsaur`ds
Xfd Hdplrtbdgt ai
Dhu`ltmags Uflt Uarcs
@kdlrmgefausd(ltfttp?//mds.dh.eav/g`dd/ww`/)
pravmhds blgy rdsaur`ds
rdkltdh ta dvlkultmag hdsmeg.
Lhds`rmptmag ai mgtdrruptdh
tmbd sdrmds hdsmegsms emvdg ny
Mbndgs lgh Kdbmdux (>::6),
(lvlmklnkd fdrd?
fttp?//il`ukty.sbu.dhu/bmkkmbd
t/`klssds/d`a5055/plpdrs/mbnd
gs%>:kdbmdux.phi)
Pdd Nm`cblg lgh ^ae (>::=)
iar mgiarbltmag ag blgy
hmiidrdgt dvlkultmag hdsmegs.
Pdd Cflghcdr, Caakwlk, lgh
Plblh (>:::>) iar mtltmags
ai stuhmds tflt flvd usdh tfd
mgtdrruptdh tmbd sdrmds hdsmeg.
http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
22/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
23/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >:
Ppd`mim` Eumhlg`d? Idlsmnmkmty Ptuhmds
Hds`rmnd tfd nlrrmdrs ta mbpkdbdgtmge l iukk-s`lkd stuhy ymdkhmge bahdrltd ar strage dvmhdg`d lgh pravmhd l
`abpkdtd hds`rmptmag ai tfd idlsmnmkmty stuhy ta nd `aghu`tdh, mg`kuhmge, ls lppraprmltd, stuhy dkdbdgts rdkltdh
ta l hds`rmptmag ai tfd praerlb, dgeledbdgt wmtf stlcdfakhdrs, ar lssdssbdgts ai hltl lvlmklnmkmty lgh
qulkmty. Xfd dvlkultmag pklg sfaukh lhhrdss tfd pklgs ta tdst tfd prl`tm`lkmty ai tfd usd ai l `agtrak ar
`abplrmsag eraup ar atfdr augtdril`tulk. Hds`rmnd faw tfd idlsmnmkmty stuhy prdplrds tfd praerlb lgh tfd
dvlkultars iar pklggmge, mbpkdbdgtmge, lgh abpkdtmge l bard rmearaus dvlkultmag.
@abnmgltmag ai Hdsmegs lgh/ar Lglkysds
Mg sabd smtultmags, usmge l abnmgltmag ai sdvdrlk stuhy hdsmegs bly nd usdiuk ta `lpturd tfd dvmhdg`d ai
diid`tmvdgdss ai tfd praerlb. Iar dxlbpkd, l sblkk s`lkd ^@X bly nd usdh lkagesmhd l klredr blt`fdh
`abplrmsag stuhy wmtf eraups iarbdh ny prapdgsmty s`ard blt`fmge.
Ppd`mim` Eumhlg`d? @abnmgltmag ai Hdsmegs lgh/ar Lglkysds
Mi buktmpkd stuhy hdsmegs ar lglkysds lrd abnmgdh, tfd prapaslk sfaukh pravmhd kdlr hdtlmks ai lkk
`abpagdgts, mg l``arhlg`d wmtf tfd spd`mim`ltmags pravmhdh lnavd. Iurtfdr, tfd prapaslk sfaukh pravmhd lrltmaglkd iar usmge l `abnmgltmag lppral`f, wmtf l ia`us ag faw usmge buktmpkd lglkysds aiisdts tfrdlts ta
mgtdrglk lgh dxtdrglk vlkmhmty.
Gatd tflt tfd hdsmeg typds hms`ussdh lnavd lrd gat mgtdghdh ta nd l iukk kmst, lgh atfdr hdsmeg typds lgh
`abnmgltmags ai hdsmeg typds lppraprmltd ta yaur praerlb lgh dvlkultmag ealks lrd wdk`abd.
Mbpkdbdgtltmag Dvlkultmag
Mbpkdbdgtltmag dvlkultmag ms lg lssdssbdgt ai faw wdkk l praerlb hads wflt
mt sdts aut ta ha. ^ltfdr tflg ia`usmge ag tfd aut`abds, fawdvdr,
mbpkdbdgtltmag dvlkultmags ia`us ag tfdpra`dssny wfm`f l praerlb pravmhds
sdrvm`ds ar atfdrwmsd l``abpkmsfds mts bmssmag. Mbpkdbdgtltmag stuhmds dgtdr
ag hms`drgmge faw kasdky tfd l`tulk ruggmge ai tfd praerlb blt`fds tfd
tfdary tflt edgdrltdh natf tfd praerlb mg edgdrlk, ls wdkk ls tfd plrtm`uklr
`abpagdgts tflt plrtm`mplgts dxpdrmdg`d.
Ppd`mim` Eumhlg`d? Mbpkdbdgtltmag Dvlkultmag
Mbpkdbdgtltmag stuhmds lrd strageky dg`aurledh ls plrt ai lgy dvlkultmag pklg. Xfd praerlb tfdary lgh kaem`
bahdk sfaukh eumhd tfd mbpkdbdgtltmag dvlkultmag. Lg mbpkdbdgtltmag dvlkultmag dxlbmgds natf faw wdkk
tfd praerlb blt`fds tfd tfdary ndfmgh mts `rdltmag, lgh wflt tfd praerlb l`tulkky hads ag tfd eraugh. Mglhhmtmag, lg mbpkdbdgtltmag dvlkultmag strmvds ta ug`avdr tfd dxl`t pra`dssds tflt kdlh ta aut`abds. Xfd pklg
sfaukh bdlsurd vlrmltmag mg mbpkdbdgtltmag wmtfmg tfd praerlb ls wdkk ls l`rass praerlb smtds, ls wlrrlgtdh
Xfd pklg sfaukh lssdss natf tfd qulgtmty lgh qulkmty ai sdrvm`ds hdkmvdrdh ta tfd tlredt papukltmag.
Lhhmtmaglkky, tfd pklg sfaukh dxlbmgd mi tfd praerlb ms mghddh sdrvmge tfd pdapkd iar wfab mt wls mgtdghdh,
lgh mi lppraprmltd, mi tfdrd ms l `agtrak ar `abplrmsag eraup wfa bly ar bly gat nd rd`dmvmge smbmklr sdrvm`ds
tfrauef lgatfdr praerlb ar praerlbs.
Lhhmtmaglk ^dsaur`ds
Pdd Udmgdr (>::8) iar
mgiarbltmag ag
mbpkdbdgtltmag dvlkultmag
rdsdlr`f hdsmeg.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
24/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >::4).
Ppd`mim` Eumhlg`d? Plbpkmge Zklg lgh Zawdr Lglkysms
Plbpkmge Zklg
Imrst, hds`rmnd tfd papukltmag ta wfm`f tfd stuhy rdsukts wmkk nd edgdrlkmzdh - tflt ms, tfd eraup ai mghmvmhulks
ta wfab tfd stuhy rdsukts waukh lppky. Xfms bmeft mg`kuhd hdtlmks su`f ls tfd sa`mlk, d`agabm`, ar
hdbaerlpfm` flrl`tdrmstm`s (rl`d, edghdr, dt`.), lt-rmsc stltus, ar edaerlpfm` ka`ltmag ai tfd papukltmag.
Mbpartlgtky, tfd dvlkultmag pklg sfaukh hdbagstrltd tflt tfd slbpkd tflt wmkk nd hrlwg wmkk nd rdprdsdgtltmvd
ai tflt papukltmag.
Lhhmtmaglk ^dsaur`ds
Bard hdtlmks, lgh mgstru`tmags
iar `lk`ukltmge stltmstm`lk
pawdr, `lg nd iaugh ag tfd
T@KL stltmstm`lk abputmge
saitwlrd wdnsmtd?
fttp?//www.lts.u`kl.dhu/stlt/h
ld/
Pdd Nkaab (>::4) iar bard
mgiarbltmag ag slbpkd smzd
lgh BHDP mg dvlkultmag
rdsdlr`f.
http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
25/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >>
Xa ha tfms, hds`rmnd dxl`tky faw tfd plrtm`mplgts wfa wmkk nd mg tfd slbpkd wmkk nd sdkd`tdh irab tfd dgtmrd
passmnkd papukltmag ai plrtm`mplgts. Xflt ms, plrtm`mplgts bmeft nd sdkd`tdh tfrauef agd ai sdvdrlk td`fgmquds?
smbpkd rlghab slbpkmge, strltmimdh rlghab slbpkmge, agvdgmdg`d slbpkmge, ar sabd atfdr slbpkmge
pra`dhurd. Xfd slbpkmge pklg, wfm`f hds`rmnds tfd td`fgmqud lgh mg`kuhds tfd smzd lgh `abpasmtmag ai tfd
slbpkd, sfaukh rdikd`t tfd nuhedt lgh tmbdkmgd ai tfd praod`t.
Zawdr Lglkysms lgh Bmgmbub Hdtd`tlnkd Diid`t Pmzd
Xfd dvlkultmag pklg sfaukh mg`kuhd l pawdr lglkysms lgh BHDP lk`ukltmags iar tfd prapasdh rdsdlr`f hdsmeg
lgh dstmbltdh slbpkd smzds. Xfdsd lk`ukltmags sfaukh lpturd wfdtfdr tfd slbpkd usdh mg tfd dvlkultmag wmkk
nd klred dgauef iar tfd mbpl`t lglkysms ta pravmhd bdlgmgeiuk rdsukts. L pawdr lglkysms lgh BHDP
`lk`ukltmag sfaukh nd prdsdgtdh iar dl`f lglkysms mg tfd dvlkultmag pklg, mg`kuhmge lkk sun-erauplglkysds.
Zawdr lglkysds `lg nd `aghu`tdh usmge tfd irdd praerlbs ^ lgh E*Zawdr, ls wdkk ls PZPP, PLP lgh PXLXL.
Iar hdsmegs tflt flvd buktmpkd kdvdks ai lglkysms ar lssmeg trdltbdgt lgh agtrak lt tfd eraup, rltfdr tflg
mghmvmhulk kdvdk, tfd irddAptmblk Hdsmeg Paitwlrd(fttp?//smtdblcdr.ubm`f.dhu/eraup-
nlsdh/aptmblkQhdsmegQsaitwlrd) `lg nd usdh ta dstmbltd pawdr lgh BHDP.
Plbpkd dtdgtmag
Xa dgsurd tflt tfd dvlkultmag ms ls strage ls passmnkd, mt ms mbpartlgt ta try ta blxmbmzd tfd gubndr ai
plrtm`mplgts (ar eraups ar smtds) wfa tlcd plrt mg tfd stuhy. Xfms bdlgs gat agky rd`rumtmge plrtm`mplgts, nut
lksa blcmge surd tflt ls blgy pdapkd ls passmnkd lrd plrt ai hltl `akkd`tmag diiarts hurmge tfd stuhy, ls wdkk ls
mg lgy iakkaw-up pdrmah. Xfms ms trud iar praerlb plrtm`mplgts, ls wdkk ls iar lgy `agtrak ar `abplrmsag eraup
bdbndrs.
Ppd`mim` Eumhlg`d? Plbpkd dtdgtmag
Xfd dvlkultmag pklg sfaukh hds`rmnd faw tfd stuhy wmkk cddp trl`c ai plrtm`mplgts lgh tfdmr hltl (mhdlkky,
wfdg edgdrltmge tfd slbpkd spd`mim`ltmags lgh hltl akkd`tmag strltdey). Xfms pklg sfaukh mg`kuhd bd`flgmsbs
iar bagmtarmge, trl`cmge, lgh traunkdsfaatmge mssuds rdkltdh ta cddpmge plrtm`mplgts mg tfd stuhy.
Xfdsd prl`tm`ds bmeft mg`kuhd systdbltm` fd`cs ai hltl `akkd`tmag prl`tm`ds ta dgsurd tflt hltl lrd ndmge
`akkd`tdh ag l rdeuklr nlsms irab lkk plrtm`mplgts, tfus fdkpmge mhdgtmiy lgy plrtm`mplgts wfa flvd gat nddg
`agtl`tdh mg l emvdg pdrmah ai tmbd. Xfms `aukh lksa mg`kuhd flvmge strltdemds mg pkl`d iar iakkawmge up wmtf
plrtm`mplgts wfa lrd gat rdspaghmge ar plrtm`mpltmge mg dmtfdr praerlb ar hltl akkd`tmag l`tmvmtmds. Mt ms
mbpartlgt ta rdbdbndr tflt mghmvmhulks wfa kdlvd l praerlb prmar ta tfd abpkdtmag ai lkk abpagdgts stmkk
gddh ta nd trl`cdh ls plrt ai tfd hltl akkd`tmag diiarts. Lkk plrtm`mplgts, lgh agtrak ar abplrmsag eraup
bdbndrs, lrd mhdlkky trl`cdh lgh pravmhd hltl hurmge tfd dgtmrd stuhy pdrmah, rdelrhkdss ai praerlb
plrtm`mpltmag, ka`ltmag, ar dlsd ai l``dss.
Bdlsurds
Dgsurmge tflt tfd bdlsurds sdkd`tdh lrd rdkmlnkd, vlkmh, lgh lppraprmltd ta usd iar tfd stuhy ms l cdy wly ta
rdhu`d tfrdlts ta mgtdrglk vlkmhmty lusdh ny tfd stuhy mtsdki. Pdkd`tmag ai paarky vlkmhltdh ar ugrdkmlnkd
bdlsurds lg kdlh, iar dxlbpkd, ta lg diid`tmvd praerlb sfawmge ga rdsukts.
^dkmlnmkmty rdidrs ta tfd edgdrlkmzlnmkmty ai l plrtm`uklr bdlsurd. Xflt ms, mi l bdlsurd ms usdh avdr lgh avdr
lelmg ag tfd slbd eraup ai pdapkd, mt sfaukh ymdkh tfd slbd rdsukts. Ylkmhmty rdidrs ta tfd dxtdgt ta wfm`f l
bdlsurd lhdqultdky rdikd`ts tfd ag`dpt ughdr agsmhdrltmag3 mi l bdlsurd blt`fds tfd ag`dpt mg qudstmag,
http://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_software8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
26/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >0
bast rdspaghdgts wmkk mgtdrprdt mt mg smbmklr wlys. Lppraprmltdgdss rdidrs ta
blt`fmge bdlsurds ta tfd papukltmag ar s`lkd ai l stuhy. Xa mkkustrltd,
bdlsurds tflt rdqumrd kmtdrl`y sfaukh gat nd usdh wmtf yauge `fmkhrdg ar
ughdr-dhu`ltdh papukltmags. Buktmpkd wlys dxmst ta tdst vlkmhmty lgh
rdkmlnmkmty ai bdlsurds3 sdd Bly dt lk. (>::=) ar tfd Tgmvdrsmty ai Kddhs (>:::
=:
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
27/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >8
Ppd`mim` Eumhlg`d? Bdlsurd Ylkmhmty, ^dkmlnmkmty, lgh Fmstary ai Tsd
Hds`rmnd vlkmhmty, rdkmlnmkmty, lgh fmstary ai usd iar lkk bdlsurds usdh mg hltl
`akkd`tmag l`tmvmtmds. Lt l bmgmbub, dl`f survdy, tdst ar mgtdrvmdw bdlsurd
usdh sfaukh flvd dvmhdg`d ai tfd iakkawmge?
^dkmlnmkmty (d.e., tdst-rdtdst rdkmlnmkmty iar bdlsurds wmtf mghmvmhulk
mtdbs, @ragnl`fs lkpfl iar tdsts/s`lkdh survdys)3 Il`d vlkmhmty (d.e., pmkat tdstmge wmtf lppraprmltd papukltmags, rdvmdw
ny sdrvm`d pravmhdrs)3 lgh,
@agtdgt vlkmhmty (d.e., rdvmdw ny agtdgt dxpdrts, systdbltm` lkmegbdgt wmtf cdy lrdls ta nd bdlsurdh).
Mg lhhmtmag, survdys ar tdsts tflt usd s`lkds ar edgdrltd s`ards sfaukh pravmhd hdtlmks ai dxpkarltary il`tar
lglkysms (Zdtt, Kl`cdy, & Pukkmvlg, >::0), `agimrbltary il`tar lglkysms (Nrawg, >::9), lgh vlkmhltmag lelmgst
aut`abds, ls wdkk ls fmstary ai usd, mi lvlmklnkd.
Mi rdkmlnmkmty lgh vlkmhmty ai bdlsurds flvd ydt ta nd hdtdrbmgdh, lg lglkysms pklg iar hamge sa sfaukh nd
prdsdgtdh. Mi gag-vlkmhltdh, sdki-hdvdkapdh bdlsurds ai cdy aut`abds lrd ta nd usdh, pravmhd l oustmim`ltmag iar
tfd usd ai tfms bdtfah avdr lgy prd-dxmstmge lgh prd-vlkmhltdh bdlsurds.
Hltl @akkd`tmag L`tmvmtmds
L systdbltm` pklg iar `akkd`tmge hltl iar tfd dvlkultmag bust nd mg pkl`d ta dgsurd strage rdsukts. Xfd bdlsurds
mghm`ltdh mg tfd dvlkultmag pklg hm`tltd tfd hltl akkd`tdh. Hltl iar plrtm`mplgts lgh iar `agtrak ar abplrmsag
eraup bdbndrs bly `abd irab l vlrmdty ai saur`ds, gat lkk ai wfm`f bly nd plrt ai tfd praerlb.
Hltl `akkd`tmag mhdlkky stlrts prmar ta praerlb plrtm`mpltmag ta ndst `lpturd plrtm`mplgts nlsdkmgd stltus. Mg tfd
slbd vdmg, mhdgtm`lk hltl irab natf plrtm`mplgts lgh agtrak ar abplrmsag eraups sfaukh nd akkd`tdh
wfdgdvdr passmnkd. Hltl akkd`tmag aitdg agtmguds dvdg litdr plrtm`mplgts lrd ga kagedr plrt ai tfd praerlb. Mt
ms mbpartlgt ta blp aut tfd tmbmge ai hltl `akkd`tmag ta dgsurd tfd ndst passmnkd dvlkultmag.
Ppd`mim` Eumhlg`d? Hltl @akkd`tmag L`tmvmtmds
Mhdgtmiy hltl saur`ds iar lkk bdlsurds, ls wdkk ls tfd typd ai hltl ta nd `akkd`tdh lkage wmtf faw tfdy wmkk nd
`akkd`tdh. Hds`rmptmags sfaukh `avdr hltl iar praerlb plrtm`mplgts ls wdkk ls `agtrak ar `abplrmsag eraup
bdbndrs.
Dstlnkmsf l nlsdkmgd stltus iar praerlb plrtm`mplgts lgh agtrak ar `abplrmsag eraup bdbndrs. Nlsdkmgd hltl
lrd mbpartlgt iar lssdssmge flged mg plrtm`mplgts avdr tmbd. Hds`rmnd wfdg tfd `akkd`tmag ai nlsdkmgd hltl wmkk
a``ur. Lksa, hms`uss wfdtfdr tfd nlsdkmgd bdlsurds ndmge usdh lrd abplrlnkd iar natf praerlb plrtm`mplgts
lgh agtrak ar abplrmsag eraup bdbndrs.
Hltl bly nd `akkd`tdh ny tfd dvlkultmag tdlb, ny praod`t stlii, ar ny sabd atfdr plrty. Mghm`ltd wfa wmkk `akkd`t
lkk hltl usdh mg tfd dvlkultmag. Gatd tfd rakd ai praod`t stlii bdbndrs mg rdkltmag ta tfd hltl `akkd`tmag pra`dss.
Mi lhbmgmstrltmvd hltl wmkk nd usdh, spd`miy tfd saur`d(s) lgh lvlmklnmkmty ai tfd hltl, lgh tfd dvlkultmag tdlbs
dxpdrmdg`d warcmge wmtf tflt typd ai mgiarbltmag.
Hds`rmnd tfd wly mg wfm`f hltl lrd ta nd `akkd`tdh. Ppd`miy mi hltl wmkk nd `akkd`tdh tfrauef lhbmgmstrltmvd
rd`arhs, praerlb systdbs, ar tfrauef mgstrubdgts spd`mim`lkky rdltdh iar tfd purpasd. Iar dxlbpkd, wmkk
Lhhmtmaglk ^dsaur`ds
Pdd Zdtt, Kl`cdy lgh Pukkmvlg
(>::0) iar l hms`ussmag ai
dxpkarltary il`tar lglkysms.
Pdd Nrawg (>::9) iar bard
mgiarbltmag ag `agimrbltary
il`tar lglkysms.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
28/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >4
plrtm`mplgts abpkdtd survdys, wmkk praod`t stlii blmgtlmg rd`arhs tflt wmkk nd usdh, ar wmkk lhbmgmstrltmvd hltl
su`f ls l`lhdbm` trlgs`rmpts nd usdh1 Mt ms kmcdky tflt sabd `abnmgltmag ai diiarts wmkk nd rdqumrdh ta `lpturd
lkk tfd hltl tfd bdlsurds wlrrlgt.
Xfd wly mg wfm`f hltl lrd `akkd`tdh bly gat nd mhdgtm`lk iar natf praerlb plrtm`mplgts lgh `agtrak ar
`abplrmsag eraup bdbndrs, nut mhdlkky tfd slbd hltl wmkk nd akkd`tdh l`rass natf eraups. Mghm`ltd lgy
hmiidrdg`ds mg hltl akkd`tmag ndtwddg tfd twa eraups, mg`kuhmge saur`ds, bdlgs ai hltl akkd`tmag, lgh wfa
wmkk akkd`t tfd hltl.
Imglkky, mg`kuhd l tmbdkmgd autkmgmge tfd hltl ta nd `akkd`tdh lt vlrmaus pamgts (iar dxlbpkd, wflt hltl lrd
`akkd`tdh prmar ta praerlb plrtm`mpltmag, hurmge, lgh litdr). Mghm`ltd dxpd`tdh slbpkd smzds lt vlrmaus pamgts mg
tmbd mg tfd hltl akkd`tmag pra`dss.
Ptltmstm`lk Lglkysms ai Mbpl`ts
Xa dgsurd tfd stragedst passmnkd dvmhdg`d rdsukts irab tfd dvlkultmag, tfd arrd`t stltmstm`lk lglkysms td`fgmquds
bust nd dbpkaydh. Xfd stltmstm`lk td`fgmqud fasdg wmkk hdpdgh ag tfd typds ai rdsdlr`f qudstmags lgh
aut`abds ar mbpl`ts spd`mimdh mg tfd rdsdlr`f hdsmeg3 tfdy wmkk lksa hdpdgh ag tfd typd(s) lgh qulgtmty ai hltl
`akkd`tdh. Iar dxlbpkd?
Ptuhmds tflt `akkd`t hltl l`rass tmbd wmkk gddh ta usd stltmstm`lk bahdks tflt lrd lppraprmltd iar su`f
hltl (d.e., imxdh diid`ts bahdks)3
^dsdlr`f hdsmegs wmtf abplrmsag eraups bly gddh ta stltmstm`lkky agtrak iar lttrmnutds ai eraup
bdbndrs (d.e., rderdssmag bahdks)3 lgh
Hdsmegs tflt mgvakvd gdstdh hltl, su`f ls stuhdgts wmtfmg `klssraabs wmkk gddh bahdks tflt flghkd tflt
typd ai mgtdrl`tmag (d.e., fmdrlr`fm`lk kmgdlr bahdks).
Hmiidrdgt typds ai hltl wmkk lksa gd`dssmtltd hmiidrdgt stltmstm`lk bahdks. Iar dxlbpkd, hdtdrbmgmge mi sabdagd
usds bard ar kdss sdrvm`d litdr praerlb plrtm`mpltmag mbpkmds tflt tfd aut`abdbdlsurd vlrmds lkage l agtmguaus spd`trub (m.d., gubndr ai vmsmts ar sdrvm`d
utmkmzltmags). Xfms typd ai qudstmag waukh rdqumrd tfd usd ai l bahdk tflt imts
tfms typd ai hltl lgh tflt lg lksa lhdqultdky tlcd mgta l``augt atfdr il`tars
ndsmhds praerlb plrtm`mpltmag (mhdlkky) ta ls`drtlmg tfd mbpl`t ai praerlb
plrtm`mpltmag ag tfd gubndr ai vmsmts (d.e., l kmgdlrrderdssmagar rdkltdh
bahdk). @agvdrsdky, mi tfd aut`abd ai mgtdrdst ms wfdtfdr ar gat l stuhdgt
dgrakkdh mg akkded, tfd aut`abd fls agky twa ltdearmds (dgrakkdh ar hmh gat
dgrakk), lgh tfd stltmstm`lk bahdk bust nd lppraprmltd iar tflt typd ai
`ltdearm`lk hltl (d.e., l kaemstm` rderdssmag ar rdkltdh bahdk).
Bard hdtlmks ag spd`mim`, abbagky usdh stltmstm`lk bahdks lrd hdtlmkdh mg Xlnkd < mg Lppdghmx @ (Dxlbpkdslgh Xdbpkltds) ai tfms ha`ubdgt.
Mgtdgt ta Xrdlt (MXX) lgh Xrdltbdgt ag Xrdltdh (XAX) Lglkysms Irlbdwarcs
Xwa blmg pdrspd`tmvds dxmst iar eumhmge lglkysms mg dvlkultmags. Mi tfd prapasdh stuhy fls l rlghabmzdh
ndtwddg-eraups hdsmeg, lgmgtdgt-ta-trdlt(MXX) irlbdwarc ms sueedstdh (tfauef gat rdqumrdh). Xfms
irlbdwarc stlrts wmtf tfd prdbmsd tflt lglkytm`lkky, dvlkultars lrd lssdssmge aut`abds nlsdh ag praerlb
`abpagdgts rltfdr tflg plrtm`mplgt dxpdrmdg`d. Xfms irlbdwarc ms usdiuk nd`lusd mt (::=) iar mgiarbltmag ag
`luslk mgidrdg`d lgh
mgstrubdgtlk vlrmlnkds
irlbdwarc mg XAX
rlghabmzdh `kmgm`lk trmlks.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
29/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >9
ta abplrd tfd aut`abds ai plrtm`mplgts (ar eraups ai plrtm`mplgts) ndtwddg
tfasd wfa wdrd lssmegdh ta rd`dmvd praerlb sdrvm`ds lgh tfasd wfa wdrd gat
lssmegdh ta tfd praerlb, lgh (>) edgdrltds lg ugnmlsdh dstmbltd ai tfd
lvdrled praerlb diid`t iar plrtm`mplgts aiidrdh tfd praerlb. Xfd MXX
irlbdwarc ms aitdg usdh nd`lusd tfd mbpl`t dstmbltd ms tfd agd tflt ms aitdg ai
bast mgtdrdst ta pakm`yblcdrs (Nkaab, >::4).
Fawdvdr, mg prl`tm`d, mgtdrvdgtmags lrd bard kmcdky ta nd mbpkdbdgtdh wmtfvlrymge hderdds ai imhdkmty ta tfd mgtdghdh mbpkdbdgtltmag pklg. Pmbmklrky,
kdvdks ai plrtm`mpltmag lg rlged irab plrtm`mplgts gat tlcmge plrt lt lkk ta
tfasd abpkdtmge lkk lspd`ts ai l praerlb. Xfd ugnmlsdh dstmbltd irab lg MXX lglkysms irlbdwarc wmkk rdikd`t
tfms rlged. Iar tfms rdlsag, tfd mbpl`t dstmbltd irab tfd MXX ms aitdg agsmhdrdh tfd bast pakm`y rdkdvlgt
nd`lusd mt ms nlsdh ag tfd dxpdrmbdgtlk stru`turd ai tfd hltl (m.d., rdsukts hdpdgh upag dmtfdr plrtm`mpltmge, lt
lgy kdvdk, ar gat lt lkk).
Xfdtrdltbdgt-ag-trdltdh(XAX) lglkysms, wfm`f ms nlsdh ag wflt plrtm`mplgts l`tulkky dxpdrmdg`d, bust
typm`lkky nd antlmgdh irab lg dxtdgsmag ai tfd gag-dxpdrmbdgtlk stru`turd ai tfd hltl (Nkaab, >::4). Bardavdr,
tfd ugnmlsdh dstmbltd ai l praerlbs diid`t ag lg aut`abd `lg nd `abprabmsdh ny gag-rlghab bmssmge hltlag tfd aut`abd. Xfms passmnmkmty, lgh faw mt wmkk nd flghkdh mi mt a``urs, sfaukh nd lhhrdssdh mg tfd dvlkultmag
pklg ughdr bmssmge hltl.
@agvdrsdky, XAX lglkysms typm`lkky rdqumrds tfd dvlkultar ta lglkyzd hltl akkd`tdh ag mghmvmhulks nlsdh ag
tfdmr kdvdk ai praerlb plrtm`mpltmag. Nd`lusd praerlb plrtm`mplgts sdki-sdkd`t tfdmr kdvdk ai praerlb
plrtm`mpltmag, lglkysds tflt dstmbltd praerlb mbpl`ts l``arhmge ta tfdsd kdvdks lrd ny glturd qulsm-
dxpdrmbdgtlk.
Ppd`mim` Eumhlg`d? Hltl Lglkysms
Apdg tfd stltmstm`lk lglkysms sd`tmag ai tfd dvlkultmag pklg ny hds`rmnmge tfd MXX lglkysms irlbdwarc lgh tfdghds`rmnmge mi tfms irlbdwarc wmkk nd suppkdbdgtdh wmtf lgatfdr irlbdwarc, su`f ls XAX. Iar hdsmegs tflt
iarb eraups tfrauef atfdr lppral`fds, su`f ls blt`fmge, tfd prmg`mpkd ai ndemggmge wmtf lg MXX irlbdwarc
stmkk lppkmds lgh sfaukh nd rdikd`tdh mg tfd dvlkultmag pklg. Iar dxlbpkd, wfdg blt`fmge ms usdh ta iarb
eraups prmar ta praerlb hdkmvdry, mghmvmhulks (ar eraups ai mghmvmhulks) sfaukh nd lglkyzdh mg tfd eraups
tfdy wdrd mg lt tfd tmbd ai blt`fmge.
Zravmhd kdlr hdtlmks ai tfd hltl lglkysms usdh ta hdtdrbmgd praerlb diid`ts. Hds`rmnd tfd typds ai stltmstm`lk
lglkysms ta nd ughdrtlcdg, spd`miymge hds`rmptmvd lglkysms lgh/ar mgidrdgtmlk lglkysms ls lppraprmltd. Mg`kuhd
hds`rmptmags ai stltmstm`lk bahdks. Gatd tfd`avlrmltdstfd `flrl`tdrmstm`s ar vlrmlnkds tflt wmkk nd usdh mg tfd
bahdk mg tfd hms`ussmag, lgh kdlrky hdkmgdltd tfd slbpkd (iukk ar plrtmlk3 mg`kuhmge lgtm`mpltdh smzd) ta nd
usdh iar dl`f lglkysms.
Kmst lgh hds`rmnd tfd stltmstm`lk pra`dhurds ta nd usdh mg lglkysms (iar dxlbpkd, hds`rmnd tfd AKP rderdssmag,
kaemstm` rderdssmag, LGAYL, ar wfltdvdr bahdk imts tfd lglkysms pklg ndst). Xlnkd < (mg tfd Dxlbpkds lgh
Xdbpkltds sd`tmag SLppdghmx @R lt tfd dgh ai tfms ha`ubdgt) kmsts abbag stltmstm`lk bahdks usdh mg
dvlkultmag hdsmeg lkage wmtf dxlbpkds ai tfdmr lppkm`ltmag. Xfd rdlsags wfy pra`dhurds wdrd sdkd`tdh,
mg`kuhmge tfd stuhy hdsmeg lgh aut`abd(s) agsmhdrdh, sfaukh lksa nd hds`rmndh. Mbpartlgtky, tfd stltmstm`lk
pra`dhurds prapasdh bust lkmeg wmtf tfd rdsdlr`f qudstmags, lgh arrdspagh ta tfd pawdr lglkysms usdh ta
hdtdrbmgd tfd bmgmbub slbpkd smzd.
Lhhmtmaglk ^dsaur`ds
Bard mgiarbltmag ag lgh
dxlbpkds ai stltmstm`lk
lglkysms `lg nd iaugh ag tfd
T@KL stltmstm`lk abputmge
wdnsmtd?
fttp?//www.lts.u`kl.dhu/stlt/dxlbpkds/hdilukt.ftb.
http://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htm8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
30/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >5
Xfd dvlkultmag pklg sfaukh nd `kdlr ag tfd kdvdk ai stltmstm`lk lglkysms (d.e., mghmvmhulk ar smtd) lgh tfms lglkysms
sfaukh nd lt tfd slbd kdvdk ls tfd rlghab lssmegbdgt ar blt`fmge (d.e., mghmvmhulk ar smtd). Xfd lglkysms gddhs
ta blt`f tfd kdvdk ai lssmegbdgt mg arhdr ta dgsurd tflt dvlkultars ha gat blcd lg drragdaus mgidrdg`d lnaut
tfd stltmstm`lk smegmim`lg`d ai tfd praerlb diid`t (m.d., ls`rmnmge l trdltbdgt mbpl`t ag mghmvmhulks wfmkd
lglkyzmge praerlb smtds mg leerdeltd). Iurtfdr, tfd dvlkultmag pklg sfaukh mg`kuhd tfd spd`mim`ltmag ai tfd
stltmstm`lk bahdk usdh ta dstmbltd tfd praerlb diid`t, mg`kuhmge tfd lhhmtmag ai lgy avlrmltds, wdmefts, ar
atfdr lhoustbdgts. Zravmhd tfd lssubptmags blhd mg tfd bahdk lgh mghm`ltd wfdtfdr lgy ai tfdsd lssubptmags
lrd kmcdky ta nd vmakltdh. Iar qulsm-dxpdrmbdgtlk lgh prd-dxpdrmbdgtlk stuhmds, tfd dvlkultmag pklg sfaukh lksa
mg`kuhd l hdtlmkdh hms`ussmag ai tfd stltmstm`lk bdtfahs usdh ta agtrak iarsdkd`tmag nmlsag ansdrvdh
`flrl`tdrmstm`s arrdkltdh wmtf tfd aut`abds ai mgtdrdst.
Bmssmge Hltl
Mt ms ta nd dxpd`tdh tflt sabd plrtm`mplgts (ar `agtrak ar `abplrmsag eraup bdbndrs) bly hrap aut ai tfd
stuhy, tfd praerlb, ar atfdrwmsd nd`abd mbpassmnkd ta `agtl`t. Xfms `rdltds bmssmge hltl, ar fakds mg tfd
`akkd`tdh hltl, tflt gddh ta nd hdlkt wmtf mg arhdr iar l stltmstm`lkky saugh lglkysms ta tlcd pkl`d. Ufdg
rdsdlr`fdrs lgh dvlkultars rdidr ta bmssmge hltl, tfdy edgdrlkky lrd rdidrrmge ta mgiarbltmag tflt wls gat
`akkd`tdh, nut `aukh flvd nddg.
Bmssmge hltl `lg nd l prankdb wfdg trymge ta ughdrstlgh tfd diid`ts ai l praerlb. Iar dxlbpkd, mi agky flki ai
lkk plrtm`mplgts abpkdtd lg dgtmrd praerlb, nut lkk ai tfdb sfaw pasmtmvd flged, mt rdblmgs ug`kdlr mi tfd
mbpl`t ms hud ta tfd praerlb ar mi mt ms hud ta tfd `flrl`tdrmstm`s ai tfd pdapkd wfa `abpkdtdh tfd praerlb. Mi
gatfmge ms cgawg lnaut tfd pdapkd wfa hmh gat `abpkdtd tfd praerlb, mt waukh nd hmiim`ukt ta sly wmtf
`drtlmgty tflt lgy flged iaugh lbage plrtm`mplgts wls hud ta praerlb plrtm`mpltmag.
Ppd`mim` Eumhlg`d? Bmssmge Hltl
Xfd dvlkultmag pklg sfaukh hds`rmnd faw lttrmtmag rltds wmkk nd `lk`ukltdh, natf iar tfd stuhy ls l wfakd (mg
edgdrlk, tlcmge mgta l``augt tfd gubndr ai plrtm`mplgts wfa wdrd agtmguausky plrt ai tfd stuhy vdrsus tfdgubndr ai plrtm`mplgts wfa wdrd plrt ai tfd stuhy agky hurmge l plrtm`uklr, trug`ltdh pdrmah ai tmbd). Pmbmklr
ta tfd avdrlkk lttrmtmag rltd, hmiidrdgtmlk lttrmtmag rltds, ar tfd rltds lt wfm`f plrtm`uklr suneraups (d.e., bdg
vdrsus wabdg) `agtmgud ta tlcd plrt mg tfd stuhy ar gat, sfaukh lksa nd lhhrdssdh mg tfd pklg. Xfd pklg sfaukh
hds`rmnd faw rukds wmkk nd `agstru`tdh iar hd`mhmge faw kage plrtm`mplgts flvd nddg mg tfd praerlb mg arhdr
iar tfdb ta `augt ls flvmge abpkdtdh tfd praerlb ar gat, ar, mi lppraprmltd, wflt agstmtutds tfd vlrmaus
lbaugts ai praerlb dxpasurd ar `abpkdtmag.
Xa mkkustrltd, mt bly pravd usdiuk ta abplrd plrtm`mplgts wfa abpkdtdh lg dgtmrd praerlb wmtf plrtm`mplgts
wfa abpkdtdh plrt ai tfd praerlb, ls wdkk ls tfd agtrak ar abplrmsag eraup ta ndttdr ughdrstlgh faw
hmiidrdgt lbaugts ai dxpasurd ar plrtm`mpltmag liid`t aut`abds. Cddpmge trl`c ai natf lnsakutd lgh hmiidrdgtmlk
lttrmtmag lg lksa nd fdkpiuk iar mbpkdbdgtltmag dvlkultmag, taa. Xflt ms, cgawmge wfdg plrtm`mplgts kdlvd lpraerlb bly fdkp mhdgtmiy lgy strdgetfs ar wdlcgdssds ai tfd praerlb.
Pabdtmbds, nut gat mg dvdry `lsd, lhoustbdgts lrd blhd ta hltl ta lhoust iarnmlsdsrdkltdh ta bmssmge hltl.
Hds`rmnd lgy pra`dhurds pklggdh iar lhoustmge hltl ta lssdss lgh/ar hdlk wmtf tfdsd nmlsds mg tfd hltl. Mg
plrtm`uklr, lgy usd ai buktmpkd mbputltmag, tfd rdpkl`dbdgt ai bmssmge hltl wmtf sunstmtutdh vlkuds, sfaukh nd
dxpklmgdh iukky lgh kdlrky. Hltl ag aut`abds ai mgtdrdst sfaukh gdvdr nd mbputdh, fawdvdr.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
31/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >6
Ppd`mim` Eumhlg`d? Buktmpkd Aut`abd Bdlsurds
Hds`rmnd tfd wlys mg wfm`f tfd dvlkultmag hdsmeg wmkk tlcd mgta l``augt tfd
usd ai, lgh patdgtmlk prankdbs rdkltdh ta tfd usd ai, buktmpkd aut`abd
bdlsurds. Ufdg buktmpkd aut`abd bdlsurds lrd spd`mimdh, dvlkultars gddh ta
nd `lrdiuk ai drrars tflt bly hdvdkap mg `abplrmge tfdb. Mi tfdrd lrd buktmpkd
rdkltdh agimrbltary qudstmags, ar l smgekd agimrbltary qudstmag dvlkultdh
usmge buktmpkd aut`abds, hdtlmk tfd lhoustbdgts ta nd blhd ta lglkysds tardhu`d tfd kmcdkmfaah ai l Xypd-M drrar (mg`arrd`tky rdod`tmge l fypatfdsms tflt
ms mg il`t `agimrbdh) a``urrmge. Xd`fgmquds tflt `lg nd usdh ta lhoust iar su`f l passmnmkmty lrd tfd arhdrmge ai
buktmpkd aut`abds (prmblry, sd`aghlry, dt`.) lgh l``arhmgeky lhoustmge tfdp-vlkudsiar dl`f aut`abd, tfd usd
ai l stltmstm`lk pra`dhurd su`f ls l Nagidrragm lhoustbdgt, ar usmge BLGAYL mi tfdrd lrd buktmpkd aut`abds.
Lhhmtmaglk ^dsaur`ds
Pdd Nklcdsky, dt lk. (>::=) ag
buktmpkd aut`abd bdlsurds mg
dvlkultmaglt
fttp?//www.g`nm.gkb.gmf.eav/
pb`/lrtm`kds/ZB@0:84644/.
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
32/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI >=
Y. Fublg Punod`ts Zratd`tmag
Mg edgdrlk, PMI-iughdh dvlkultmags (lgh atfdr idhdrlkky-iughdh dvlkultmags) wmkk rdqumrd dmtfdr Mgstmtutmaglk
^dvmdw Nalrh (M^N) lppravlk, ar lg dxpklgltmag ai wfy M^N lppravlk ms gat gddhdh/lppraprmltd iar tfd
prapasdh stuhy. Dvlkultmag pklgs edgdrlkky gddh ta nd hdsmegdh ta bddt stlghlrhs iar fublg sunod`ts
pratd`tmag mi tfdy usd mghmvmhulk kdvdk hltl akkd`tdh irab pdapkd (wfdtfdr plrtm`mplgts, agtraks ar
`abplrmsag eraups) tflt `aukh nd pdrsaglkky mhdgtmimlnkd. Mi tfd dvlkultmag `akkd`ts gdw hltl irab fublgsunod`ts, mt ms kmcdky tflt tfd dvlkultmag pklg wmkk gddh ta mg`kuhd faw tfd praerlb ar dvlkultar wmkk antlmg
lppravlk iar tfd hltl `akkd`tmag pra`dss irab lg M^N. Mi tfd hltl fls lkrdlhy nddg `akkd`tdh, iar dxlbpkd, irab
l prdvmausky dxmstmge survdy, M^N lppravlk bly gat nd gddhdh. Fawdvdr, mt ms lkwlys l eaah mhdl ta antlmg l
wlmvdr irab lg M^N stltmge tflt fublg sunod`ts pratd`tmag wls gat gddhdh. Xfms ms plrtm`uklrky usdiuk mi, mg
tfd iuturd, tfd rdsukts wmkk nd sunbmttdh ta `drtlmg pddr-rdvmdwdh oaurglks. M^N lppravlk ms gat gddhdh iar hltl
tflt ms gat `akkd`tdh lt tfd kdvdk ai tfd mghmvmhulk pdrsag. Iar dxlbpkd, imglg`mlk hltl, fausmge `abpkdtmags, ar
oans `rdltdh lt lg arelgmzltmag waukh gat gddh M^N lppravlk ta nd `akkd`tdh ar lglkyzdh.
Xfd spd`mim` mgiarbltmag rdqumrdh ny lg M^N bly vlry, fawdvdr. Edgdrlkky, tfd lppkm`ltmag wmkk mg`kuhd l
hds`rmptmag ai tfd stuhy, slbpkmge bdtfahs, hltl akkd`tmag bdtfahs lgh mgstrubdgts, lgh typds ai lglkysms ta
nd `aghu`tdh. Mi gddhdh, mt bly mg`kuhd tfd oustmim`ltmag iar `akkd`tmge hltl irab vukgdrlnkd papukltmags. Mi
mgiarbdh agsdgtms rdqumrdh, tfd M^N lppkm`ltmag wmkk kmcdky lsc iar tfd typd ai `agsdgt, ls wdkk ls pra`dhurds
lgh ha`ubdgts ta nd usdh mg antlmgmge mgiarbdh `agsdgt. Imglkky, tfd M^N wmkk nd mgtdrdstdh mg faw tfd
pdrsaglkky mhdgtmimlnkd hltl wmkk nd flghkdh lgh sd`urdky stardh, ls wdkk ls wfdg lgh faw tfd hltl wmkk nd
hdstraydh.
Ppd`mim` Eumhlg`d? Fublg Punod`ts Zratd`tmag
Ptltd faw Fublg Punod`ts Zratd`tmag wmkk nd dgsurdh lgh wfdtfdr ar gat M^N lppravlk wmkk nd gd`dsslry. Mi
M^N lppravlk wmkk gat nd saueft, dxpklmg wfy.
Mi tfd dvlkultmag mg`kuhds pdrsaglkky mhdgtmimlnkd hltl, tfdg tfd dvlkultmag pklg sfaukh mg`kuhd tfd iakkawmge?
Xfd glbd ai tfd M^N tflt wmkk nd usdh3
Xfd typd ai lppravlk saueft3
Xfd pra`dss usdh ny tfd glbdh M^N iar sd`urmge tfd lppravlk3
Uflt hltl wmkk nd sunod`t ta mgiarbdh `agsdgt3 lgh
Lg avdrvmdw ai faw mgiarbdh agsdgt wmkk nd antlmgdh.
Mg lhhmtmag, M^N lppravlk edgdrlkky klsts iar l spd`mim` pdrmah ai tmbd, lgh tflt tmbd sfaukh nd hds`rmndh lgh
`agiarb ta tfd dvlkultmag tmbdkmgd sunbmttdh.
Xfd M^N lppravlk pra`dss hads tlcd tmbd lgh tfdrd bly nd lssa`mltdh `asts ls wdkk. @fd`c wmtf tfd M^N yau
pklg ta usd hurmge yaur dvlkultmag pklg hdvdkapbdgt ta imgh aut mts tmbdkmgd lgh wfdtfdr tfdrd lrd `asts.
Mg`kuhd tmbmge lgh ast mgiarbltmag mg tfd dvlkultmag pklg tmbdkmgd lgh nuhedt.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
33/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 0:
YM. ^dpartmge Ptrltdey, Xmbdkmgd, lgh Nuhedt
Avdrvmdw
Xfd rdpartmge strltdey, tmbdkmgd, lgh nuhedt lrd rmtm`lk abpagdgts ai tfd dvlkultmag pklg. Xfd pra`dss ai
lkmegmge tfdsd abpagdgts wmtf tfd td`fgm`lk lspd`ts ai yaur dvlkultmag hdsmeg wmkk fdkp yau hdtdrbmgd
wfdtfdr yaur dvlkultmag ms l`tulkky idlsmnkd. Mg lhhmtmag, tfdy pravmhd tfd rdlhdr wmtf cdy mgiarbltmagrdelrhmge faw tfd pklg wmkk l`tulkky nd mbpkdbdgtdh lgh bagmtardh.
^dpartmge Ptrltdey
Xfd ia`us ai lg dvlkultmag rdpartmge strltdey ms ta dgsurd tflt tmbdky mgiarbltmag ms lvlmklnkd iar hd`msmag
blcmge lt cdy pamgts mg tfd praerlbs praerdss. Xfdsd cdy pamgts wmkk kmcdky lkmeg wmtf tfd praerlb kaem`
bahdk. Ufmkd tfd sd`tmags lnavd flvd autkmgdh faw tfd praerlb wmkk antlmg lgh lglkyzd mgiarbltmag rmtm`lk
iar lssdssmge tfd mbpkdbdgtltmag lgh aut`abds ar mbpl`ts ai tfd praerlb, tfd rdpartmge strltdey wmkk dxpklmg
faw tfd mgiarbltmag wmkk nd hmssdbmgltdh.
Mg hdvdkapmge tfd rdpartmge strltdey, ia`us ag wflt cdy mgiarbltmag ms gddhdh ny hd`msmag blcdrs mg`kuhmgearelgmzltmag stlii, ls wdkk ls iughdrs, nalrh bdbndrs lgh atfdrs mgvdstdh mg tfd aut`abd ai tfd praerlb.
Xfdg, hdvdkap l sdrmds ai rdparts tflt bddt tfdsd mgiarbltmag gddhs lgh lrd lkmegdh wmtf tfd dvlkultmag
tmbdkmgd (m.d., wflt hltl ms lvlmklnkd lt tfasd pamgts). Mi tfd kaem` bahdk pdrbmts, mt ms aitdg usdiuk ta lkmeg tfd
dvlkultmag tmbdirlbd wmtf tfd tmbmge ai mgiarbltmag gddhs. Xflt wly, tfd dvlkultmag lg nd tfd bast usdiuk. Mt
ms kmcdky tflt lt kdlst l nlsdkmgd lgh imglk rdpart wmkk nd gddhdh. Mgtdrbdhmltd rdparts lrd vlkulnkd mi tfdrd lrd
smegmim`lgt bagmtarmge ar hltl akkd`tmag pamgts lkage tfd wly. Mi tfd dvlkultmag ms buktm-ydlr, tfdg lg lggulk
rdpart bmeft mg`kuhd tfd smegmim`lgt bmkdstagds iar tflt ydlr lgh `aukh augt ls tfd mgtdrbdhmltd rdpart.
Pmg`d praerlbs aitdg lrd rdqumrdh ta rdpart ta iughdrs lgh nalrhs ag buktmpkd dvlkultmag l`tmvmtmds, mt ms eaah
prl`tm`d iar dvlkultars ta `abpkdtd rdparts ai dl`f `abpagdgt ai tfd stuhy ls tfdy a``ur (iar natf
mbpkdbdgtltmag lgh mbpl`t dvlkultmag). Xfms sfaukh nd plrt ai tfd dvlkultars s`apd ai warc lgh wmkk lkkaw
yau ta flvd tfd bast rd`dgt mgiarbltmag lvlmklnkd iar hd`msmag blcmge, ta bagmtar tfd dvlkultmag, lgh ta nd
prdplrdh iar rdpartmge ta erlgtars. Dvlkultmag l`tmvmty rdparts aukh mg`kuhd tfd iakkawmge?
^dpart subblrmzmge tfd hdsmeg3
Pubblry ai mgstrubdgt hdvdkapbdgt3
Hdtlmkdh hds`rmptmag ai faw slbpkmge wls hagd, mg`kuhmge gubndrs ai `agtraks lgh plrtm`mplgts lgh
lgy mssud(s) dg`augtdrdh3
^dpart ag dl`f hltl `akkd`tmag, mg`kuhmge dl`f mgstrubdgt usdh, faw blgy wdrd `akkd`tdh, irab wfab
(smtds, agtraks, plrtm`mplgts, gubndr abpkdtdh), lgh wfdg3 lgh
Hdtlmkdh rdpart ai hltl lglkysms aghu`tdh, mg`kuhmge lgy mssuds tflt lrasd ar hdvmltmags irab tfdarmemglk lglkysms pklg lgh subblrmds ai rdsukts ta hltd.
Ppd`mim` Eumhlg`d? ^dpartmge
Kmst lkk rdparts tflt wmkk nd prahu`dh lkage wmtf hltds. Ppd`miy faw dl`f rdpart lkmegs wmtf tfd dvlkultmag pklg
(d.e., nlsdkmgd, mgtdrbdhmltd, imglk) lgh wflt smegmim`lgt l`tmvmtmds wmkk nd mg`kuhdh (d.e., iakkaw up hltl
`akkd`tmag). Kmst tfd bloar sd`tmags ai tfd rdpart lgh wflt tfdy wmkk `avdr. Nd surd ta rdpart ag mbpkdbdgtltmag
ls wdkk ls mbpl`t dvlkultmags.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
34/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 0
Ppd`mim` Eumhlg`d? Nuhedt
Xmbd Irlbd
Xfd dvlkultmag nuhedt sfaukh rdikd`t natf tfd tmbd lgh `asts tflt mt wmkk tlcd ta l`fmdvd tfd dvmhdg`d ealks
autkmgdh. Mi `urrdgt eulrlgtddh iughmge ms agky iar plrt ai tflt tmbd, mhdgtmiy wfm`f partmags ai tfd nuhedt lrd
iughdh lgh wfm`f lrd praod`tdh.
Nuhedt @abpagdgts
Xfd dvlkultmag nuhedt sfaukh agtlmg faurs lgh asts ny pdrsag ar pasmtmag iar dl`f bloar stdp mg tfd
dvlkultmag, lgh iar lgy atfdr sdrvm`ds tfd dvlkultar ms pravmhmge, su`f ls td`fgm`lk lssmstlg`d iar praod`t stlii.
]aur nuhedt sfaukh lksa mhdgtmiy lgy atfdr hmrd`t `asts lssa`mltdh wmtf tfd dvlkultmag mg`kuhmge trlvdk,
prmgtmge, bltdrmlks lgh suppkmds, lgh abbugm`ltmags. Mghmrd`t lgh avdrfdlh asts sfaukh nd mg`kuhdh, dmtfdr
ny pravmhmge sdplrltd kmgds iar tfdb, ar ny kalhmge tfdb agta hmrd`t `asts. ]aur nuhedt sfaukh gatd wfm`f ai
tfdsd lppral`fds yau wmkk tlcd.
Mt bly nd usdiuk, plrtm`uklrky mi yaur dvlkultmag pklg fls blgy `abpagdgts, ta hdvdkap (lgh mg`kuhd ls lg
lppdghmx) l Kdvdk ai Diiart (KAD) `flrt tflt mhdgtmimds faurs ny tlsc lgh sun-tlsc, ny pdrsag. Hdvdkapmge lhdtlmkdh KAD `flrt `lg tlcd tmbd, nut mt pravmhds l vlkulnkd taak ta `fd`c tflt yaur pklg ms idlsmnkd. Iar
dxlbpkd, lg KAD `flrt `lg tdkk yau wfdtfdr yaur praod`tdh gubndr ai hltl `akkd`tars wmkk flvd dgauef faurs
lvlmklnkd ta `akkd`t prd-mbpkdbdgtltmag hltl ndiard yaur praerlb stlrts, ar mi yau wmkk gddh ta flvd bard hltl
`akkd`tars warcmge lt tfd slbd tmbd.
L gatd lnaut nuhedtmge iar dvlkultmags?
Xfd lbaugt ai lg dvlkultmag nuhedt wmkk vlry hdpdghmge ag tfd spd`mim` hdsmeg sdkd`tdh, tfd gubndr ai smtds
lgh plrtm`mplgts, tfd bdlsurds prapasdh, tfd tmbdirlbd iar bdlsurdbdgt, tfd typd ai lglkysms prapasdh, tfd
gubndr lgh typd ai rdparts, lgh atfdr il`tars. Nuhedts irab l eraup ai 5: PMI dvlkultmags rd`dmvdh lvdrled
::
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
36/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 00
`lggat `aghu`t lg dvlkultmag tflt tlredts l bahdrltd kdvdk ai dvmhdg`d ls hdimgdh ny tfd PMI iar kdss tflg
$54,::: pdr ydlr.
Dvlkultmag asts lgh dvlkultmag-ta-praerlb nuhedt rltmas vlry nlsdh ag tfd stuhy hdsmeg fasdg lgh
mg`rdlsd wmtf hdsmegs tflt sddc ta dstlnkmsf luslk mbpl`t.
Xfd prm`d ai dvlkultmag eads up ls tfd kdvdk ai dvmhdg`d hdsmrdh eads up. Ptrage dvmhdg`d ms
hmsprapartmagltdky bard dxpdgsmvd. Agd hrmvmge il`tar ms wfdtfdr ar gat tfd stuhy ms aghu`tdh l`rassbuktmpkd smtds.
Lkk hdsmeg typds flvd tfd patdgtmlk ta nd dxpdgsmvd.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
37/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 08
YMM. Dvlkultar \ulkmim`ltmags lgh Mghdpdghdg`d
Avdrvmdw
Dvlkultar qulkmim`ltmags lrd rmtm`lk ta l su``dssiuk dvlkultmag tflt wmkk strdgetfdg tfd kdvdk ai dvmhdg`d. L
smgekd dvlkultar ar l tdlb ai dvlkultars ms imgd, sa kage ls lkk tfd gd`dsslry scmkks lrd avdrdh. Ufdg sdkd`tmge
lg dvlkultar, mt fdkps mi tfd dvlkultar fls warcdh wmtf smbmklr praerlbs lgh fls hdbagstrltdh dxpdrmdg`d mg`aghu`tmge tfd spd`mim` typd ai dvlkultmag hds`rmndh mg tfd dvlkultmag pklg.
Ppd`mim` Eumhlg`d? Dvlkultar \ulkmim`ltmags
Xfms sd`tmag sfaukh ia`us ag tfd praerlb dvlkultar lgh tfd dvlkultars nl`ceraugh lgh qulkmim`ltmags.
Dxpklmg wfy tfd dvlkultar wls sdkd`tdh, mg`kuhmge tfd dxtdgt ai tfd dvlkultars dxpdrmdg`d wmtf natf tfd
`agtdgt lrdl lgh tfd typd ai dvlkultmag. Xfms wmkk kmcdky mg`kuhd kmstmge tfd dvlkultars dxpdrmdg`d wmtf smbmklr
mgtdrvdgtmags lgh wmtf tfd typd ai @X ar\DHtflt tfd dvlkultmag ms usmge (d.e., lg ^@X mg wfm`f s`faaks,
rltfdr tflg stuhdgts, lrd rlghabky lssmegdh ta trdltbdgt ar agtrak). Kmst tfd cdy pdapkd hdsmegmge lgh
avdrsddmge tfd dvlkultmag lgh dgsurmge mts qulkmty lkage wmtf tfdmr dhu`ltmag/trlmgmge lgh typd lgh ydlrs ai
dxpdrmdg`d.
Ydrmiy tflt tfd dvlkultar lg flghkd tfd s`lkd lgh smzd ai tfd prapasdh dvlkultmag. Zravmhd lt kdlst agd
dxlbpkd ai lg dvlkultmag tflt ms smbmklr mg smzd, `abpkdxmty, lgh gubndr ai smtds. Hms`uss tfd dxpdrmdg`d tfd
dvlkultar fls mg blglemge smbmklr dvlkultmag prata`aks (d.e., tfms typd ai slbpkmge, hltl akkd`tmag, lglkysms). Mi
rdkdvlgt, hads tfd dvlkultar flvd tfd `lpl`mty ta `aghu`t lg dvlkultmag wmtf buktmpkd smtds l`rass l nralh
edaerlpfm` lrdl1
Ppd`mim` Eumhlg`d? Dvlkultar Mghdpdghdg`d
Mg`kuhd mgiarbltmag tflt hds`rmnds tfd mghdpdghdg`d ai tfd dvlkultar irab tfd praerlb. Xa l`fmdvd l fmef
qulkmty dvlkultmag, mt ms mbpartlgt tflt tfd dvlkultar flvd dgauef mghdpdghdg`d ta rdghdr lg fagdst lghugnmlsdh apmgmag ai tfd praerlbs aut`abds lgh mbpl`ts. Fawdvdr, mt ms lksa mbpartlgt tflt tfd praod`t stlii
nd lnkd ta pravmhd tfd avdrsmeft gddhdh ta dgsurd tflt tfd dvlkultmag bddts dxpd`tdh stlghlrhs. Imglkky, mt ms
mbpartlgt tflt tfd dvlkultar gat flvd agikm`ts ai mgtdrdst rdelrhmge tfd dvlkultmag.
Xa lhhrdss tfdsd mssuds, pravmhd l hds`rmptmag ai tfd rdkltmagsfmp ndtwddg tfd praerlb lgh tfd dvlkultar, lgh
wflt stdps lrd ndmge tlcdg ta dgsurd mghdpdghdg`d lgh lkkdvmltd lgy lpplrdgt ar rdlk agikm`ts ai mgtdrdst. Mg
hamge tfms, mt ms mbpartlgt ta dxpklmg tfd stru`turd ai tfd rdkltmagsfmp ndtwddg tfd mgtdrvdgtmag lgh tfd
dvlkultmag, mg`kuhmge natf tfd rakd ai tfd praerlb stlii wmtf rdspd`t ta tfd dvlkultar. Xfms mg`kuhds
hdtdrbmgmge wfdtfdr tfd dvlkultar ms fmrdh ny tfd praerlb arelgmzltmag, lgh mi tflt dvlkultar ms lg dbpkaydd,
`agsuktlgt, ar autsmhd imrb. Mg lhhmtmag, wflt lrd tfd rdpartmge lgh imglg`mlk lrrlgedbdgts ndtwddg tfdpraerlb lgh tfd dvlkultar1 Ufa ms rdspagsmnkd iar emvmge hmrd`tmag lgh pravmhmge avdrsmeft1
Lhhrdss wfdtfdr ar gat tfdrd lrd `agikm`ts ai mgtdrdst rdkltdh ta tfd dvlkultmag. @agikm`ts ai mgtdrdst `aukh nd
rdkltdh ta l plrt ai tfd praerlb, tfd dvlkultar, ar tfd rdkltmagsfmp ndtwddg tfd twa. Iar dxlbpkd, fls tfd
dvlkultar pklydh l rakd mg hdsmegmge tfd praerlb, ar ms tfd pdrsag supdrvmsmge tfd dvlkultar lksa rdspagsmnkd
iar praerlb mbpkdbdgtltmag lgh su``dss1 Mi tfdrd lrd `agikm`ts ai mgtdrdst, tfdy sfaukh nd hms`kasdh lgh
bdlsurds tlcdg ta bmtmeltd tfdb hms`ussdh.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
38/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
gltmaglksdrvm`d.eav/PMI 04
Mg tdrbs ai avdrsmeft, mg`kuhd l hds`rmptmag ai wfa, lt tfd praerlb kdvdk, ms rdvmdwmge dvlkultmag pklgs
pravmhdh ny tfd dvlkultar(s) lgh tfdmr qulkmim`ltmags ta ha sa. Mg lhhmtmag, tfd hds`rmptmag ai avdrsmeft sfaukh
hms`uss faw tfd praerlb wmkk blcd surd tflt tfd dvlkultar stlys ag s`fdhukd, prahu`ds tfd rdqumrdh
dvlkultmag prahu`ts (d.e., hdsmeg, mgstrubdgts, hltl, lglkysms, rdparts), lgh faw tfd mghmvmhulk(s) pravmhmge
avdrsmeft lg hdtdrbmgd tfd qulkmty ai tfd prahu`ts lgh wfdtfdr tfdy bddt stlghlrhs ai s`mdgtmim` dvmhdg`d
lgh agiarb ta rmearaus rdqumrdbdgts su`f ls tfasd dxpd`tdh ny tfd PMI.
Imglkky, tfd sd`tmag ag dvlkultar mghdpdghdg`d ms tfd pkl`d ta dxpklmg faw tfd imghmges wmkk nd rdkdlsdh. Ufltlrd tfd rakds ai tfd praerlb mg rdkdlsmge tfd dvlkultmag imghmges1 Hads tfd dvlkultar flvd tfd lnmkmty ta rdkdlsd
imghmges mghdpdghdgt ai tfd praerlb1 Faw wmkk lkk plrtmds dgsurd tflt imghmges lrd rdkdlsdh mg l tmbdky
blggdr1
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
39/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
L.::=) (Dhs.).Lppkmdh sa`mlk rdsdlr`f bdtfahs. Xfauslgh Alcs, @L? ^ussdkk Pled.
Nklcdsky, ^., Blzubhlr, P., Hdw, B., Fau`c, Z., Xlge, E. ^dygakhs, @., & Nuttdrs, B. (>::=). @abplrmsags ai
bdtfahs iar buktmpkd fypatfdsms tdstmge mg gdurapsy`fakaem`lk rdsdlr`f. Gdurapsy`fakaey, >0(>)? >44-98.
Nkaab, F.P. (>::9).Xfd `ard lglkytm`s ai rlghabmzdh dxpdrmbdgts iar sa`mlk rdsdlr`f.(BH^@ Uarcmge
Zlpdr ag ^dsdlr`f Bdtfahakaey.) dtrmdvdh irab fttp?//www.bhr`.are/smtds/hdilukt/imkds/iukkQ400.phi.
Nkaab, F.P. (Dh.). (>::4). Kdlrgmge bard irab sa`mlk dxpdrmbdgts? Dvakvmge lglkytm` lppral`fds. Gdw ]arc? ^ussdkk
Pled.
Naru`f, ^.I. (::9) @agimrbltary il`tar lglkysms iar lppkmdh rdsdlr`f.Gdw ]arc? Eumkiarh.
Mbndgs, E., & Kdbmdux, X. (>::6). ^derdssmag hms`agtmgumty hdsmegs? L eumhd ta prl`tm`d. Oaurglk ai
D`agabdtrm`s,(>), 9::8).U.C. Cdkkaee Iaughltmag kaem` bahdk eumhd.^dtrmdvdh irab
fttp?//www.wcci.are/cgawkdhed-`dgtdr/rdsaur`ds/>::9/:>/wc-cdkkaee-iaughltmag-kaem`-bahdk-
hdvdkapbdgt-eumhd.lspx
Cflghcdr, P.^., Caakwlk, E.N., & Plblh, F.L. (>:::=). Tsmge stltd tdsts mg dhu`ltmag dxpdrmbdgts?
L hms`ussmag ai tfd mssuds(G@DD >::=-:::=:::5).^lghabmzdh imdkh trmlks lgh mgtdrglk vlkmhmty? Gat sa ilst by irmdgh. Zrl`tm`lk Lssdssbdgt,
^dsdlr`f & Dvlkultmag. (::8). Dvlkultmag? L systdbltm` lppral`f (5tf dh.). Xfauslgh Alcs,
@L? Pled.
P`fa`fdt, Z., @aac, X., Hdcd, O., Mbndgs, E. Ka`cwaah, O.^., Zartdr, O., & Pbmtf, O. (>:
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
40/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
L.>
P`fa`fdt, Z._. (>::6l). Xd`fgm`lk bdtfahs rdpart? Eumhdkmgds iar buktmpkd tdstmge mg mbpl`t dvlkultmags (BZ^ ^didrdg`d
Ga.? 90::-::=).Ulsfmgetag, H@? Gltmaglk @dgtdr iar Dhu`ltmag Dvlkultmag lgh ^demaglk Lssmstlg`d,
Mgstmtutd ai Dhu`ltmag P`mdg`ds, T.P. Hdplrtbdgt ai Dhu`ltmag.
P`fa`fdt, Z._. (>::6n). Xfd kltd prdtdst prankdb mg rlghabmzdh `agtrak trmlks ai dhu`ltmag mgtdrvdgtmags (G@DD >::=-
8:00).Ulsfmgetag, H@? Gltmaglk @dgtdr iar Dhu`ltmag Dvlkultmag lgh ^demaglk Lssmstlg`d, Mgstmtutd ai
Dhu`ltmag P`mdg`ds, T.P. Hdplrtbdgt ai Dhu`ltmag.
P`fa`fdt, Z._., & @fmlge, F. (>::=). Dstmbltmag lgh Mhdgtmim`ltmag ai tfd @abpkmdr Lvdrled @luslk Diid`t Zlrlbdtdr mg
Dhu`ltmag ^@Xs (G@DD >::6-8:::>). Dxpdrmbdgtlk lgh qulsm-dxpdrmbdgtlk hdsmegs iar edgdrlkmzdh
`luslk mgidrdg`d.Nastag? Faueftag Bmiikmg.
Page, B., & Fdrblg, . (>:::6).UU@ pra`dhurds lgh stlghlrhs flghnaac (Ydrsmag >.:).^dtrmdvdh irab
fttp?//mds.dh.eav/g`dd/ww`/rdidrdg`ds/mha`vmdwdr/Ha`.lspx1ha`mh2
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
41/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.:::=).Plbpkmge l hmvdrsd luhmdg`d? Xmpsfddt #46.Tgmvdrsmty Zlrc, ZL? Zdgg Ptltd @aapdrltmvd
Dxtdgsmag. fttp?//dxtdgsmag.psu.dhu/dvlkultmag/phi/XP46.phi
Zmdr`d, P. (>::::).Pabd nlsm` mhdls ai slbpkmge.^dlhmge, Tgmtdh Cmgehab
fttp?//www.rdlhmge.l`.uc/ss`/g/rdsaur`ds/Ha`s/PabdQNlsm`QMhdlsQAiQPlbpkmge.phi
Dvlkultmag Lppral`f lgh Hltl @akkd`tmag
Erddgsdmh, K. (>:`-l868-==h6>i5:-8`>l-6h>8-
=l54`9=8=>4::=).Mssuds mg baugtmge rlghabmzdh dxpdrmbdgts mg dhu`ltmaglk rdsdlr`f lgh dvlkultmag.
Ekanlk Oaurglk ai Dhu`ltmaglk ^dsdlr`f, 6(), >5.
fttp?//www.ekanlkoaurglksdrmds.`ab/mghdx/mghdx.pfp/eodr/lrtm`kd/vmdwImkd/4=/phi
Ckltt, O. & Xlykar-Zawdkk, D. (>::4).Pygtfdsms ai kmtdrlturd rdkltmvd ta tfd rdtraspd`tmvd prdtdst hdsmeg.Zrdsdgtdh lt
Lbdrm`lg Dvlkultmag Lssa`mltmag @agidrdg`d.
fttp?//`abb.dvlk.are/DYLK/ dsaur`ds/YmdwHa`ubdgt/1Ha`ubdgtCdy2hh96`i05-5
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
42/68
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
43/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.0
Lkkmsag, Z. H. (>::=).Bmssmge hltl.Mg ^. D. Bmkkslp & L. Blyhdu-Akmvlrds (Dhs.), Xfd PLED Flghnaac ai
\ulgtmtltmvd Bdtfahs mg Zsy`fakaey(p. 5>-6=). Xfauslgh Alcs, @L? Pled Zunkm`ltmags Mg`.
fttp?//www.stltmstm`lkfarmzags.`ab/wp-`agtdgt/upkalhs/>:/:::/:), 0-
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
44/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.8
Iukk ^dvmdw @fd`ckmst
Dxd`utmvd Pubblry
Xfd iakkawmge mtdbs lrd nrmdiky hds`rmndh?
Xfd praerlb lgh mgtdghdh aut`abds/mbpl`ts3
Xfd prmar rdsdlr`f3 Xfd tlredtdh kdvdk ai dvmhdg`d3
Xfd dvlkultmag hdsmeg mg`kuhmge `abplrmsag/`agtrak eraup lppral`f3
Xfd bdlsurds/mgstrubdgts3
Xfd prapasdh lglkysms lppral`fds3
Xfd dvlkultmag tmbmge/tmbdkmgd lgh nuhedt3 lgh,
Xfd dvlkultmag tdlb.
Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag
Xfd pakm`y mssud ar prankdb tfd praerlb ms hdsmegdh ta lhhrdss lgh wfy mt sfaukh nd lhhrdssdh ms su``mg`tky hds`rmndh.
Xfd mssud ar prankdb ms irlbdh nlsdh ag l rdvmdw ai rdsdlr`f. Xfd praerlb bahdk ms hds`rmndh nrmdiky mg tfd mgtrahu`tmag, lgh mg`kuhds cdy mgiarbltmag su`f ls wfa plrtm`mplgts wmkk nd, tfd
mgtdrvdgtmag kdvdk, lgh cdy aut`abds.
Avdrvmdw ai Zrmar ^dsdlr`f
Zrmar rdsdlr`f `aghu`tdh ag tfms praerlb ms su``mg`tky hds`rmndh.
Puiim`mdgt mgiarbltmag ms pravmhdh ta mhdgtmiy tfd prmar kdvdk ai dvmhdg`d lttlmgdh ny tfd praerlb .
Zrmar rdsdlr`f `aghu`tdh ag smbmklr praerlbs ms su``mg`tky hds`rmndh.
Puiim`mdgt mgiarbltmag ms pravmhdh ta mhdgtmiy tfd prmar kdvdk ai dvmhdg`d lttlmgdh iar smbmklr praerlbs .
Kaem` Bahdk
Natf l glrrltmvd lgh l erlpfm`lk hmspkly tflt iakkaws tfd `flmg ai rdlsagmge lrd mg`kuhdh.
Xfd kaem` bahdk ag`dpts, mg`kuhmge lkk aut`abds ta nd bdlsurdh, lrd kdlrky hdimgdh.
Faw tfd rdsaur`ds lgh l`tmvmtmds kdlh ta tfd aut`abds ms hds`rmndh.
Agky lspd`ts hmrd`tky rdkltdh ta tfd tfdary ai flged lrd mg`kuhdh.
Mbpl`t \udstmags
Zraerlb mbpl`t qudstmags tflt tfd stuhy wmkk lhhrdss lrd `kdlrky stltdh.
Xfd qudstmags lrd `agsmstdgt wmtf tfd kaem` bahdks stltdh aut`abds.
Mi tfdrd lrd buktmpkd qudstmags rdkltdh ta tfd slbd aut`abd, `agimrbltary lgh dxpkarltary qudstmags lrd `kdlrky hdimgdh.
Xfd agimrbltary rdsdlr`f qudstmag(s) rdprdsdgt(s) tfd blmg mbpl`t qudstmag(s) iar tfd prmblry aut`abd tflt tfd stuhy lg
lhhrdss wmtf l cgawg kdvdk ai stltmstm`lk prd`msmag (nlsdh ag stltmstm`lk pawdr).
\udstmags lhhrdss praerlbbltm` l`tmvmty mg tfd praerlb plrtm`mplgt eraup lgh, wfdg idlsmnkd, tfd `abplrmsag ar `agtrak eraup.
\udstmags lrd pfrlsdh su`f tflt eraups lg nd abplrdh ta ughdrstlgh gdt diid`t ai mgtdrvdgtmag lgh hmiidrdg`ds.
Mbpl`t qudstmags ha gat mg`kuhd mbpkdbdgtltmag qudstmags.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
45/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.4
Mbpkdbdgtltmag \udstmags
Zraerlb mbpkdbdgtltmag qudstmags lrd `kdlrky stltdh.
Ufdg idlsmnkd, tfd mbpkdbdgtltmag qudstmags sfaukh lhhrdss tfd kdvdk ai praerlb-kmcd sdrvm`ds rd`dmvdh ny tfd abplrmsag
eraup.
Mbpkdbdgtltmag qudstmags ha gat mg`kuhd mbpl`t qudstmags.
Xfd `agtrmnutmag ta ughdrstlghmge tflt tfd dvlkultmag wmkk blcd ms `kdlrky stltdh.
@agtrmnutmag ai tfd Ptuhy
Xfd kdvdk ai dvmhdg`d tfd praerlb ms tlredtmge ms hds`rmndh.
Faw tfd prapasdh dvlkultmag bddts tfd `rmtdrml iar tfms kdvdk ai dvmhdg`d ms mg`kuhdh.
Mbpl`t Dvlkultmag Hdsmeg Pdkd`tmag
Xfd PDZ kdlrky mhdgtmimds tfd stuhy hdsmeg sdkd`tdh.
Xfd hds`rmptmag ai tfd hdsmeg hrlws upag prdvmaus rdsdlr`f ar kmtdrlturd, wfdrd lvlmklnkd.
Xfd PDZ prdsdgts l rltmaglkd iar tfd hdsmeg sdkd`tdh.
Xfd PDZ oustmimds tfd tlredt kdvdk ai dvmhdg`d nlsdh ag l hms`ussmag ai mgtdrglk lgh dxtdrglk stuhy vlkmhmty.
^lghabmzdh Ndtwddg-Eraups Hdsmeg (mi lppkm`lnkd)
Tgmt ai rlghab lssmegbdgt ms kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).
Zra`dhurds ta `aghu`t tfd rlghab lssmegbdgt, mg`kuhmge wfa mbpkdbdgtdh tfd rlghab lssmegbdgts, faw tfd pra`dhurds wdrd
mbpkdbdgtdh, lgh pra`dhurds usdh ta vdrmiy tflt pranlnmkmty ai lssmegbdgt eraups, lrd hds`rmndh lgh edgdrltdh ny rlghab
gubndrs.
Nka`cmge, strltmim`ltmag, ar blt`fmge pra`dhurds usdhta mbpravd prd`msmag mg tfd dstmbltd ai tfd praerlb diid`t ar ta nlklg`d
eraups ag bdlsurdh flrl`tdrmstm (s)lrd hds`rmndh.
Xfd praerlb eraup lgh ta tfd dxtdgt passmnkd, tfd agtrak eraup aghmtmags lrd hds`rmndh.
Lgy ag`drgs tflt prapasdh strltdemds ar lppral`fds wmkk kdlh ta gagdqumvlkdgt eraups lrd hms`ussdh.
Tgmt ai blt`fmge ms kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).
Zra`dhurds ta `lrry aut tfd blt`fmge ta iarb l `abplrmsag eraup lrd hds`rmndh.
Ndtwddg-Eraups Hdsmeg- Iarbdh ny Blt`fmge (mi lppkm`lnkd)
L prd`dhdgt mg tfd kmtdrlturd iar mg`kuhmge tfd vlrmlnkds usdh mg tfd blt`fmge ms mg`kuhdh.
Bdtfahs usdh ta iarb tfd prapasdh abplrmsag eraup lrd hds`rmndh su`f tflt tfd vlkmhmty ai tfd blt`fmge ms dxpklmgdh.
^dlsags wfy tfd `abplrmsag eraup bmeft hmiidr irab tfd trdltbdgt eraup lgh tfrdltdg mgtdrglk vlkmhmty, lgh tfd wlys mg wfm`f
tfd prapasdh bdtfahs lhoust iar tfasd hmiidrdg`ds, lrd hms`ussdh.
Ndtwddg-Eraups Hdsmeg- Iarbdh ny @ut-aii P`ard (^HH) (mi lppkm`lnkd)
Bdlsurd lgh utaii s`ard lrd kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).
@utaii s`ard ms `kdlrky hdkmgdltdh lgh oustmimdh.
Bdtfahs usdh ta lppky tfd utaii s`ard lrd hds`rmndh mg hdtlmk.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
46/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.9
Pmgekd Eraup Hdsmeg (mi lppkm`lnkd)
Dl`f mgtdrvdgtmag pflsd ai tfd hdsmeg, mg`kuhmge tfd nlsdkmgd aghmtmag, ms kdlrky hds`rmndh.
Gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms hdtlmkdh.
Gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms suiim`mdgt ta dstlnkmsf trdgh lgh rukd aut rmvlk dxpklgltmags.
Xmbmge ai bdlsurds prd/past mgtdrruptmag ms lppraprmltd ta tfd mgtdrvdgtmag.
Mgtdrruptdh Xmbd Pdrmds Hdsmeg (mi lppkm`lnkd)
Gubndr ai bdlsurdbdgt pamgts ndiard lgh litdr tfd mgtdrvdgtmag ms hds`rmndh.
Xfd gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms sfawg ta nd suiim`mdgt ta dstlnkmsf l trdgh lgh rukd aut rmvlk
dxpklgltmags.
Xfd tmbmge ai bdlsurds prd/past mgtdrruptmag ms sfawg ta nd lppraprmltd ta tfd mgtdrvdgtmag.
@abplrmsag lsds lrd kdlrky hds`rmndh.
Zrd-Dxpdrmbdgtlk Hdsmeg (mi lppkm`lnkd)
Iukk stuhy hdsmeg ms `kdlrky lgh abprdfdgsmvdky dxpklmgdh.
Hds`rmptmag ai tfd trdltbdgt lgh `augtdril`tulk eraups lrd mg`kuhdh.
Ufdrd lppraprmltd, lssmegbdgt ai stuhy plrtm`mplgts ta eraups ms hds`rmndh.
Lhhmtmaglk tfrdlts ta tfd mgtdrglk vlkmhmty ai tfd hdsmeg lrd hms`ussdh.
Ulys iuturd dvlkultmags lg nd hdsmegdh ta rukd aut tfdsd tfrdlts lrd hds`rmndh.
Idlsmnmkmty Ptuhy (mi lppkm`lnkd)
Iukk stuhy hdsmeg ms `kdlrky lgh abprdfdgsmvdky dxpklmgdh.
Hds`rmptmag ai tfd trdltbdgt lgh `augtdril`tulk eraups lrd mg`kuhdh.
Ufdrd lppraprmltd, lssmegbdgt ai stuhy plrtm`mplgts ta eraups ms hds`rmndh.
Xfd mgstrubdgts ar pra`dssds ta nd tdstdh mg tfd idlsmnmkmty stuhy lrd hds`rmndh.
@abnmgltmag Hdsmeg (mi lppkm`lnkd)
@kdlr hdtlmks ai lkk hdsmeg `abpagdgts lrd pravmhdh.
L rltmaglk iar usmge l `abnmgdh lppral`f tflt mhdgtmimds faw tflt lppral`f lhhrdssds tfrdlts ta mgtdrglk lgh dxtdrglk vlkmhmty ms
hms`ussdh.
Ppd`mim` pklgs iar bdlsurmge imhdkmty ai praerlb mbpkdbdgtltmag (m.d., faw wdkk tfd praerlb wls l`tulkky mbpkdbdgtdh) mg tfd
praerlb eraup lrd prdsdgtdh.
Zklgs iar bdlsurmge tfd kdvdk ai praerlb sdrvm`ds tfd praerlb eraup l`tulkky rd`dmvdh, mg`kuhmge tfd rmtdrml iar lssdssmge
wfdtfdr lg lhdqultd lbaugt lgh qulkmty ai tfd praerlb wls hdkmvdrdh ta plrtm`mplgts, lrd hds`rmndh.
Mbpkdbdgtltmag Dvlkultmag
Zklgs iar lssdssmge wfdtfdr tfd `agtrak ar `abplrmsag eraup rd`dmvdh praerlb sdrvm`ds, mg`kuhmge tfd `rmtdrml iar lssdss tfd dxtdg
ta wfm`f tfdrd wls hmiiusmag ai tfd praerlb ta tfd `agtrak ar `abplrmsag eraup lrd pravmhdh.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
47/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.5
Plbpkmge Zklg lgh Zawdr Lglkysms Dvlkultmag
Xfd smzd lgh `abpasmtmag ai tfd slbpkd ms hds`rmndh lgh ms `agsmstdgt wmtf tfd Nuhedt sd`tmag.
Plbpkmge pklg ms hdsmegdh ta sdkd`t plrtm`mplgts tflt lrd rdprdsdgtltmvd ai tfd papukltmag irab wfm`f tfdy wdrd sdkd`tdh.
Xfd tlredt papukltmag irab wfm`f tfd slbpkd wls sdkd`tdh lgh tfd slbpkd sdkd`tmag pra`dhurds, mg`kuhmge lgy edaerlpfm`
rdemags tlredtdh lrd hds`rmndh.
Ptltmstm`lk pawdr ms dstmbltdh lgh agsmstdgt wmtf tfd stuhy hdsmeg. Xfd stltmstm`lk pawdr lglkysms usdh ta lrrmvd lt tfd slbpkd smzd ms hds`rmndh, lgh mg`kuhds tfd bmgmbub hdtd`tlnkd diid`t smzd
(BHDP) tflt fls lg 6: pdr`dgt flg`d ai ndmge stltmstm`lkky smegmim`lgt lt l spd`mim` lkpfl kdvdk.
Aut`abd(s) lgh lssubptmags usdh mg tfd stltmstm`lk pawdr lk`ukltmags lrd hds`rmndh.
Ufdg tfdrd lrd pklgs ta `aghu`t lglkysds ai suneraups, lhhmtmaglk stltmstm`lk pawdr lglkysds lrd prdsdgtdh ta dstmbltd tfasd
BHDP.
Plbpkd ^dtdgtmag
Ptrltdemds ta rd`rumt stuhy plrtm`mplgts lrd hds`rmndh.
Lktdrgltmvd strltdemds tflt lg nd mbpkdbdgtdh mi tfd mgmtmlk strltdey ms ugsu``dssiuk lrd autkmgdh.
Zklg hds`rmnds strltdemds lgh mg`dgtmvds ta rd`rumt lgh rdtlmg stuhy plrtm`mplgts (d.e. rdbugdrltmag iar lkk plrtm`mplgts).Oustmim`ltmag ms emvdg iar lbaugt ai rdbugdrltmag.
L blgledbdgt pklg ta bagmtar, trl`c, lgh traunkdsfaat mssuds tflt lrmsd mg rdtlmgmge tfd stuhy slbpkd hurmge praerlb
mbpkdbdgtltmag ms hds`rmndh.
Bdlsurds
Faw dl`f aut`abd ms lkmegdh wmtf tfd kaem` bahdk.
Mi tfdrd lrd buktmpkd aut`abds, ls mghm`ltdh ny tfd kaem` bahdk lgh tfd rdsdlr`f qudstmags, tfd pklg hmiidrdgtmltds ndtwddg
`agimrbltary lgh dxpkarltary aut`abds `agsmstdgt wmtf tfd kaem` bahdk lgh rdsdlr`f qudstmags.
Faw dl`f vlrmlnkd irab tfd kaem` bahdk wmkk nd bdlsurdh ms hdtlmkdh.
Iar dl`f bdlsurd, wfdtfdr tfd bdlsurd wmkk nd hdvdkapdh ar fls lkrdlhy nddg hdvdkapdh (m.d., l abbdr`mlkky lvlmklnkd, aii-tfd-sfdki bdlsurd) ms dxpklmgdh.
Mi tfd aut`abd bdlsurd hmiidrs l`rass smtds ar eraups/sun eraups ai slbpkd bdbndrs, faw tfd hmiidrdgt bdlsurds wmkk nd
`abnmgdh ms hds`rmndh.
Bdlsurd Ylkmhmty, ^dkmlnmkmty lgh Fmstary ai Tsd
Mgiarbltmag rdelrhmge dl`f bdlsurds rdkmlnmkmty lgh vlkmhmty (d.e., @ragnl`fs lkpfl), lgh vlkmhltmag lelmgst aut`abds ls wdkk ls
fmstarm`lk usd, mi lvlmklnkd, ms pravmhdh.
Mi rdkmlnmkmty lgh vlkmhmty ai bdlsurds flvd ydt ta nd hdtdrbmgdh, lg lglkysms pklg iar hamge sa ms prdsdgtdh.
Hltl @akkd`tmag L`tmvmtmds (iar dl`f hltl saur`d tfd PDZ mg`kuhds)
L hds`rmptmag ai nlsdkmgd bdlsurds ms pravmhdh.
Xfd tmbmge ai nlsdkmgd akkd`tmag rdkltmvd ta stlrt ai tfd mgtdrvdgtmag ms hds`rmndh. Ufdtfdr nlsdkmgd bdlsurds lrd lhdqultd iar lssdssmge nlsdkmgd dqumvlkdg`d ms dxpklmgdh.
L hds`rmptmag ai wfa wmkk `akkd`t tfd hltl ms mg`kuhdh .
L hds`rmptmag ai tfd rakd ai stlii bdbndrs hdkmvdrmge tfd mgtdrvdgtmag wmtf rdelrh ta hltl `akkd`tmag ms hds`rmndh. Xfd tmbmge ai tfd hltl `akkd`tmag, rdkltmvd ta hdkmvdry ai tfd praerlb ms dxpklmgdh. Hms`ussmag ai faw tfd hltl wmkk nd `akkd`tdh ms mg`kuhdh.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
48/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.6
Hms`ussmag ai wfdtfdr tfd bahd ai hltl `akkd`tmag ms tfd slbd iar tfd mgtdrvdgtmag lgh `agtrak eraups ms mg`kuhdh. Mi lhbmgmstrltmvd rd`arhs (d.e. s`faak l`lhdbm`/trulg`y rd`arhs3 ugdbpkaybdgt mgsurlg d hltl) wmkk nd usdh, tfd saur`d lgh
lvlmklnmkmty ai tfdsd hltl ls wdkk ls tfd dvlkultars dxpdrmdg`d usmge tfdsd hltl saur`ds lrd hds`rmndh. Dxpd`tdh slbpkd smzds lt dl`f hltl `akkd`tmag pamgt lrd mg`kuhdh.
Ptltmstm`lk Lglkysms ai Mbpl`ts
Mi l ndtwddg-eraups hdsmeg ms pklggdh, lg Mgtdgt-ta-Xrdlt (MXX) lglkysms ms hds`rmndh, wfm`f abplrds aut`abds ndtwddg tfasd
lssmegdh praerlb sdrvm`ds lgh tfasd gat lssmegdh.
L kdlr hds`rmptmag ai tfd stdps ai tfd lglkysms ms pravmhdh.
Faw tfd stltmstm`lk lglkysms ai tfd hltl ms lkmegdh wmtf tfd rdsdlr`f qudstmags ms dxpklmgdh.
Faw tfd stltmstm`lk lglkysms ms lkmegdh su`f tflt tfd ugmt ai lglkysms arrdspaghs ta tfd ugmt ai lssmegbdgt ms hds`rmndh.
Xfd stltmstm`lk bahdk usdh ta dstmbltd tfd praerlb diid`t ms iukky spd`mimdh lgh lkk vlrmlnkds mg tfd bahdk (lgh tfdmr adiim`mdgts)
lrd hdimgdh.
Lssubptmags ai tfd bahdk lrd kmstdh.
Xfd praerlb diid`t bahdk ms sfawg ta nd `agsmstdgt wmtf tfd stltmstm`lk bahdk usdh iar tfd stltmstm`lk pawdr lglkysms hurmge tfd
hdsmeg stled.
Bahdk dstmbltmag pra`dhurds lrd mg`kuhdh. Mi lppkm`lnkd, avlrmltd lhoustbdgts ta dstmbltdh praerlb diid`ts, lhoustbdgts iar bmssmge hltl, dstmbltmag ai stlghlrh drrars, lgh
`arrd`tmags iar buktmpkd `abplrmsags lrd hds`rmndh.
Mi usmge l gag-rlghabmzdh ndtwddg-eraups hdsmeg, stltmstm`lk bdtfahs tflt lhdqultdky agtrak iar sdkd`tmag nmls ag ansdrvdh
`flrl`tdrmstm`s lrd hds`rmndh.
Plbpkd ^dtdgtmag lgh Bmssmge Hltl
Faw avdrlkk lgh hmiidrdgtmlk lttrmtmag wmkk nd `lk`ukltdh lgh lssdssdh ms hdtlmkdh.
Lg autkmgd ai spd`mim` pra`dhurds pklggdh iar lssdssmge lgh lhoustmge iar patdgtmlk nmlsds, hud ta gag-`agsdgt lgh hltl gag-
rdspagsd, ms mg`kuhdh.
Lgy mgtdgtmags ta usd buktmpkd mbputltmag iar bmssmge hltl lrd hms`ussdh. Xfms mbputltmag sfaukh blt`f tfd lglkysms ta nd`aghu`tdh (tfd mbputltmag bahdk sfaukh usd buktm-kdvdk pra`dhurds mi tfd lglkysms ms buktm-kdvdk3 mi tfd stltmstm`lk lglkysms usds
blxmbub kmcdkmfaah ar Nlyds ta mg`arparltd bmssmge hltl plttdrgs, tfdg tfms sfaukh lksa nd gatdh).
L nrmdi hds`rmptmag ai faw tfd pklg ms hdsmegdh ta bmgmbmzd bmssmge hltl wmtf plrtm`uklr ia`us ag bmgmbmzmge hmiidrdgtmlk lttrmtmag
ms pravmhdh.
Buktmpkd Aut`abd Bdlsurds
Mi tfd prapaslk fls buktmpkd rdkltdh `agimrbltary rdsdlr`f qudstmags, ar l smgekd `agimrbltary qudstmag dvlkultdh usmge buktmpkd
aut`abds, lhoustbdgts blhd ta rdhu`d tfd flg`d ai l Xypd-M drrar lrd hds`rmndh.
Fublg Punod`ts Zratd`tmag
Mi tfd rdsdlr`fdrs wmkk warc wmtf pdrsaglkky mhdgtmimlnkd hltl, pra`dhurds ta sd`urd M^N lppravlk lrd hms`ussdh. Zklgs rdqumrmge
M^N lppravlk sfaukh mg`kuhd?
M^N(s) tflt wmkk rdvmdw tfd sunbmttdh lppkm`ltmag3
Xypd ai lppravlk saueft lgh pra`dss iar sd`urmge tfms lppravlk3
Hurltmag tflt tfd lppravlk wmkk nd mg diid`t, lgh dxpd`tdh lppravlk hltd3 lgh,
Xmbdkmgd iar wfdg lgh faw tfms lppravlk wmkk nd sd`urdh.
Zklgs tflt ha gat rdqumrd M^N lppravlk dxpklmg wfy tfdy ha gat tfmgc lppravlk ms gd`dsslry.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
49/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
N.=
^dpartmge
Xfd rdpartmge strltdey kmsts tfd rdparts tflt wmkk nd sunbmttdh, tfdmr tmbmge lgh agtdgt.
^dparts mg`kuhd lt kdlst l nlsdkmgd lgh imglk rdpart.
Iar buktm-ydlr dvlkultmags, lg lggulk rdpart ms mg`kuhdh.
Xfd agtdgt ai tfd rdparts avdrs lkk tfd bloar dvlkultmag dvdgts/l`tmvmtmds, tfdmr rdsukts/imghmges, lgh rd`abbdghltmags.
Xmbdkmgd
Xfd tmbdkmgd gatds tfd pdrmah iar hdsmeg (mg`kuhmge M^N kdlrlg`d mi gddhdh), nlsdkmgd hltl akkd`tmag, prdtdstmge, rlghab
lssmegbdgt, mgtdrvdgtmag mbpkdbdgtltmag, past-tdstmge, lgh dl`f iakkaw-up pdrmah, mi lppkm`lnkd.
L tmbdkmgd iar hltl `akkd`tmag, iakkaw-up, lglkysms, lgh rdpartmge ms mg`kuhdh.
P`fdhukd iar `akkd`tmge lgh rdpartmge ag mgtdrbdhmltd aut`abds tflt lrd lkmegdh wmtf kaem` bahdk lgh dvlkultmag hdsmeg ms
mg`kuhdh.
M^N lppravlk ms mg`kuhdh mg tfd tmbdkmgd.
Nuhedt
L kmst ai cdy dvlkultmag lgh praerlb stlii/`agsuktlgts, mg`kuhmge rakds lgh tatlk gubndr ai faurs, ms pravmhdh.
Lppraxmbltd asts ny bloar abpagdgts ai tfd stuhy (d.e., pklggmge lgh praod`t lhbmgmstrltmag, mgstrubdgt hdvdkapbdgt, M^N
lppravlk, slbpkmge, hltl akkd tmag, hltl lglkysms, rdpart wrmtmge, prdsdgtltmags), ny ydlr, lrd mg`kuhdh. Zkdlsd rdidr ta tfd
Dxlbpkds ai Nuhedtmg Lppdghmx @.
Tgiughdh, nut lgtm`mpltdh, dvlkultmag ydlrs lrd mg`kuhdh ls dstmbltds.
M^N `asts lrd mg`kuhdh mg tfd nuhedt.
Xfd nuhedt ms lkmegdh wmtf tfd rdsdlr`f hdsmeg lgh tlredt kdvdk ai dvmhdg`d.
Dvlkultar \ulkmim`ltmags
Xfd dxtdgt ta wfm`f tfd dvlkultar/tdlb fls suiim`mdgt `lpl`mty ta `aghu`t tfd prapasdh dvlkultmag, mg tdrbs ai td`fgm`lk
dxpdrmdg`d lgh tfd smzd/s`lkd ai tfd dvlkultmag, ms hds`rmndh.
Xfd dvlkultar/tdlbs prmar dxpdrmdg`d wmtf smbmklr dvlkultmags ms hds`rmndh.
Dvlkultar Mghdpdghdg`d
Ptdps tflt wmkk nd tlcdg ta dgsurd tfd mghdpdghdg`d ai tfd dvlkultmag lrd dxpklmgdh.
Xfd rakd tflt tfd praerlb wmkk pkly mg avdrsddmge tfd dvlkultmag ms hds`rmndh.
Xfd pra`dss ta dgsurd tflt tfd dvlkultars imghmges lrd rdkdlsdh mg l tmbdky ilsfmag, lgh, wfdg tfd dvlkultmag ms abpkdtdh, tfd
dxtdgt ta wfm`f tfd dvlkultar wmkk nd lnkd ta rdkdlsd tfd imghmges wmtfaut prmar lppravlk ny tfd praerlb/arelgmzltmag ms hds`rmndh
Faw tfd mgmtmlk rdkdlsd ai tfd rdsukts wmkk nd flghkdh ny tfd dvlkultar lgh wflt tfd praerlb/arelgmzltmag rakd wmkk nd mg
hmssdbmgltmge tfd imghmges ms dxpklmgdh.
Hms`ussmag ai tfd rdvmdw pra`dss tflt wmkk nd usdh ta dgsurd tflt tfd dvlkultmag bddts stlghlrhs ai s`mdgtmim` dvmhdg`d ms mg`kuhdh.
Lgy patdgtmlk dvlkultar ar praerlb `agikm`ts ai mgtdrdst lrd dxpklmgdh.
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
50/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
@.
Zrmar Dvmhdg`d ai Zraerlb Diid`tmvdgdss- Plbpkd Xlnkd
Xmtkd, Lutfar,
Zunkm`ltmag ]dlr lgh
Paur`d ai Ptuhy
Zddr
^dvmdw
(]/G)
Hltd ai
Hltl
@akkd`tmag
Ptuhy Xypd
(^@X, \DH,
Aut`abds
agky)
Plbpkd
Pmzd
Plbpkd
Hds`rmptmag
Aut`abd
Bdlsurds Cdy Ptuhy dsukts Diid`t Pmzds
Pmbmklrmty ta
Zrapasdh Zraerl
Diid`ts ai Litdr P`faak
@flrl`tdr Dhu`ltmag ag
^dlhmge P`ards, Pbmtf,
^.K. lgh Had, O.B. >::>
Zrmvltd dvlkultmag
lvlmklnkd lt
www.dvlk.are G ::: ^@X
8:: X
0:: @
Dkdbdgtlry
P`faak stuhdgts
erlhds >-4, mg l
hmstrm`t wmtf 94%
Fmsplgm`
papukltmag.
@XNP,
Zlrtm`mplgt
lgh Zlrdgt
Purvdys
Zlrdgts ai plrtm`mplgts
wdrd bard kmcdky tflg
gag-plrtm`mplgts ta
rdpart tflt tfdmr `fmkhrdg
flh mbpravdh rdlhmge
scmkks.
Ga smegmim`lgt hmiidrdg`d
wls iaugh ag tdst s`ards.
.> iar plrdgt
eraup
hmiidrdg`ds
G/L iar
`fmkhrdg
Xfms stuhy ia`us
ag tfd slbd
mgtdrvdgtmag lt l
hmiidrdgt smtd, wm
l hmiidrdgt
papukltmag.
Aur Lggdx >::=
Zraerlb Dvlkultmag
^dpart, >::= G >: erlhd
kdvdks ag tfd XAU^D Gat `lk`ukltdh
Ptuhy ai tfd slb
mgtdrvdgtmag
`aghu`tdh lt tfd
slbd praerlb sm
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
52/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG IT
@.0
Kaem` Bahdk Dxlbpkd
Plbpkd Kaem` Bahdk? Plbpkd Zraerlb, @akkded Zrdplrltmag Ea @akkded!
Mgputs L`tmvmtmds Autputs Aut`abds Mbpl`ts@akklnarltmge s`faaks lgh stlii
Ea @akkded! nalrh
Ea @akkded! kdlhdrs lgh gltmaglkstlii
Imglg`mlk suppart iar Ea @akkded!
irab iaughltmags, prmvltd
mghmvmhulks, nusmgdssds, lgh
eavdrgbdgt
Hltl systdb ta trl`c stuhdgts
praerdss lgh pravmhd ageamge
iddhnl`c
\ulrtdrky kdlhdrsfmp warcsfaps
iar pddr kdlhdrs
Xlmkardh praidssmaglk
hdvdkapbdgt iar tdl`fdrs lgh`augsdkars
]dlr-kage `klss iar sdgmars ag
`akkded/ pastsd`aghlry pklggmge
Ea @akkded! praerlb iar gmgtf
tfrauef dkdvdgtf-erlhdrs
0: Zddr kdlhdrs trlmgdh
0: Xdl`fdrs lgh `augsdkarsrd`dmvd 8: faurs ai praidssmaglk
hdvdkapbdgt
>:: sdgmars lttdgh tfd ydlr-kage
`klss
9:: gmgtf tfrauef dkdvdgtf
erlhdrs plrtm`mpltd mg tfd Ea
@akkded! praerlbbmge
Ptlii lgh stuhdgts mg`rdlsd
dxpd`tltmags iar stuhdgts fmef
s`faak l`lhdbm` l`fmdvdbdgt
Ptlii lgh stuhdgts mg`rdlsddxpd`tltmags iar pastsd`aghlry
dhu`ltmag
Pdgmars elmg cgawkdhed lnaut
tfd `akkded lppkm`ltmag lgh
dgrakkbdgt pra`dss
P`faak-wmhd akkded-eamge
`ukturd tflt kaacs ndyagh fmef
s`faak erlhultmag
Mg`rdlsd mg abpkdtdh akkdedlppkm`ltmags lgh mg atfdr
bmkdstagds mg tfd `akkded
lppkm`ltmag pra`dss
Mg`rdlsd mg fmef s`faak
lttdghlg`d, pdrsmstdg`d, lgh
erlhultmag
Mg`rdlsd mg akkded dgrakkbdgt
lgh su``dss
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
53/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG IT
@.8
Dxlbpkds ai Xmbdkmgds
Plbpkd Dvlkultmag Xmbdkmgd mg Erlpfm` Iarb
Zklggmge
M^N
Plbpkmge
Hltl @akkd`tmag Mgstrubdgt @rdltmag
Hltl @akkd`tmagLglkysms
Mgtdrvmdws wmtf Cdy Ptlii
^dpart Urmtmge
^dpart Hdlhkmgds
Bddtmges wmtf Zraerlb Ptlii
< > 0 8 4 9 5 6 = -0 Bagtf ? Dvlkultmag Nuhedt
Xfd tdbpkltd ndkaw ms lgatfdr lppral`f ta pravmhmge l hdtlmkdh Dvlkultmag Nuhedt.
@ast ny Dvlkultmag @abpagdgt? Dvlkultar, Zraod`t Ptlii, lgh Atfdrs
Xfd tdbpkltd ndkaw ms iar ]dlr < nut tfd imglk dvlkultmag nuhedt sfaukh `avdr tfd iukk kdgetf ai
tfd dvlkultmag (d.e. ]dlr >, ]dlr 0, dt`.).
8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014
56/68
DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH
@.5
]dlr