Page 1
1
EdReports.orgQualityInstructionalMaterialsTool:EnglishLanguageArts3-8ReviewToolContents
TableofContentsAboutEdReports.org.................................................................................................................................................................................................................2AboutThisTool.........................................................................................................................................................................................................................3
InstructionsforConductingHighQualityReviews.................................................................................................................................................5UsingtheToolandToolkit:ReferenceMaterialstoSupportQualityReviews........................................................................................................................5HowtoApplyRatingsUsingtheEvaluationToolin4Steps....................................................................................................................................................6BackgroundInformationofReviewedMaterials...................................................................................................................................................................10Gateway1:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence................................................11
ReviewersusedatarecordedinRatingSheets1.1-1.3todeterminetheoverallratingforgrade3-5materials.........................................................................14ReviewersusedatarecordedinRatingSheet2.1todeterminetheGateway2overallrating....................................................................................................16
Gateway2:StrategyandPurpose........................................................................................................................................................................................16RatingSheet3.1:UseandDesigntoFacilitateStudentLearning...............................................................................................................................................17RatingSheet3.2:TeacherPlanningandLearningforSuccesswithCCSS...................................................................................................................................18ReviewersusedatarecordedinRatingSheets3.1-3.5todeterminetheGateway3overallrating.............................................................................................22
GatewayGateway3:StructuralSupportsandUsabilityIndicators........................................................................................................................................223a-e:UseandDesigntoFacilitateStudentLearning.....................................................................................................................................................................223f-j:TeacherPlanningandLearningforSuccesswithCCSS..........................................................................................................................................................223k-n:Assessment...........................................................................................................................................................................................................................223s-w:EffectiveTechnologyUse.....................................................................................................................................................................................................22
Page 2
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
2
IntroductionTheCommonCoreStateStandards(CCSS),informedbythreedecadesofknowledgearoundlearning,createanunprecedentedopportunitytoimprovestudentachievementnationwide.However,simplyadoptingtheCommonCoreandworkingwithteachersontheinstructionalshifts—asover40-plusstatesaredoing—willnotdirectlytranslateintostudentsuccess.Evidenceindicatesthatinstructionalmaterialshaveasignificanteffectonstudentoutcomes.1AndasHarvard’sRichardElmoreargues,togetinsidetheinstructionalcoreandimprovelearningatscale,itisessentialtogetqualitycontentintothehandsofteachersandstudents.2Ifqualityinstructionalmaterials(e.g.,textbooks,curriculum,digitalresourcesandotherinstructionalcontent)areascriticalastheresearchsuggests,localdecisionsaboutwhatCCSSmaterialstoadoptorpurchasearenowmoresignificantthanever.Publishersareupdatingtheirmaterials,independentcurriculumprovidersarelaunchingandteachersnationwidearegenerouslypublishingtheirownmaterialsforthebenefitofothers.States,districtsandorganizationsalsohavebeendevelopinganddisseminatingCommonCore-alignedlessons.Withsomanynewandrepackagedinstructionalproductsbeingintroducedintoaquicklychangingmarketplace,stateanddistrictleadersandeducatorsneedindependentinformationaboutinstructionalmaterialsinordertomakeinformedpurchasingdecisionsand,overtime,tomovetheneedleonstudentperformance.AboutEdReports.orgOurVision:AllstudentsandteachersintheUnitedStateswillhaveaccesstothehighest-qualityinstructionalmaterialsthatwillhelpimprovestudentlearningoutcomes.
OurMission:EdReports.orgwillincreasethecapacityofteachers,administratorsandleaderstoseek,identifyanddemandthehighest-qualityinstructionalmaterials.Drawinguponexperteducators,EdReports.org’sevidence-basedreviewsofinstructionalmaterialsandsupportofsmartadoptionprocesseswillequipteacherswithexcellentmaterialsnationwide.
OurTheoryofAction:Credibleinformationagainstqualitycriteriainaquicklychangingmarketplacehelpseducatorsmakebetterpurchasingdecisionsandimprovestudentperformance.Identifyingexcellenceandimprovingdemandforcredibleinformationwillimprovethesupplyofqualitymaterialsovertime,leadingtobetterstudentachievementoutcomes.
1G.Whitehurst.“Don’tForgetCurriculum.”BrownCenterLettersonEducation.(Washington,DC:BrookingsInstitute,2009);M.ChingosandG.Whitehurst.ChoosingBlindly:InstructionalMaterials,TeacherEffectivenessandtheCommonCore.(Washington,DC:BrownCenteronEducationPolicyatBrookings,April2012).2RichardElmore,inhisworkontheinstructionalcore,assertsthattherearethreewaystoimprovestudentlearningatscale:(1)raisethelevelofcontentthatstudentsaretaught;(2)increasetheskillandknowledgethatteachersbringtotheteachingofthatcontent;and(3)increasethelevelofstudents’activelearningofthatcontent.R.Elmore.ImprovingtheInstructionalCore(Cambridge,MA:HarvardGraduateSchoolofEducation,2008).
Page 3
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
3
AboutThisToolEdReports.orgconvenededucatorstodevelopthistooltoprovideeducators,stakeholders,andleaderswithindependentandusefulinformationaboutthequalityofcoreEnglishlanguageartsinstructionalmaterials(whetherdigital,traditionaltextbook,orblended).ExperteducatorswillusethetooltoevaluatefullsetsofinstructionalmaterialsinEnglishlanguageartsagainstnon-negotiablecriteria(seeFigure1).Thistoolbuildsontheexperienceofeducators,curriculumexperts,stateprocesses,andleadingrubricdevelopersandorganizations–suchasAchieve,Inc.,theCouncilofGreatCitySchools,andStudentAchievementPartners,amongothers–thathaveconductedreviewsofinstructionalmaterials,lessons,andtasks.Tocreatetheevaluationtool,EdReports.orgconductedresearchintotheuseofcommonly-usedrubrics,gatheredinputfromeducatorsandEnglishlanguageartsexpertsduringanationwidelisteningtour,interviewedprofessorsofEnglishlanguagearts,developersandpublishersofmaterials,andconvenedanAnchorEducatorWorkingGroup(AEWG).ThetoolmayberefinedbytheAEWGafterthefirstsetofreviewsiscomplete.Thetoolhasthreemajorgateways(seeFigure1)toguidetheevaluationprocess.ReviewerswillapplythethreegatewayssequentiallytoensureEdReports.orgreportstothefieldtheextenttowhichmaterialsareCCSS-alignedandusablebyeducators.ThosematerialsthatmeetorpartiallymeettheexpectationsforGateway1(TextQualityandComplexity,andAlignmenttoStandardswithTasksandQuestionsGroundedinEvidence)willmovetoGateway2(BuildingKnowledgewithTexts,Vocabulary,andTasks).OnlythosematerialsthatmeettheexpectationsforbothGateway1andGateway2willbereviewedinGateway3(UsabilityIndicators).Tosupporteachindicatorrating,reviewersdocumentspecificevidencefromthematerials.
Page 4
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
4
Figure1:GatewayEvaluationProcessforReviewofEnglishLanguageArtsMaterials(grades3-8)
“Meets”or“PartiallyMeets” “Meets”forGateways1AND2movetoGateway2 movetoGateway3
Gateway 1: Text Quality and Complexity, and Alignment to Standards with Tasks and Questions Grounded in Evidence
Gateway 2: Building Knowledge with Texts, Vocabulary, and Tasks
Gateway 3: Instructional Supports and Other Usability Indicators
Are quality anchor texts at grade level text complexity? Do they represent the rigor and balance addressed in the standards? Are the tasks and questions in reading, writing, speaking, listening, and language aligned to grade level standards? Do they support student learning?
Do materials build students’ knowledge across topics and content areas? Is instruction intentionally and coherently sequenced to build vocabulary? Do questions and tasks build to culminating tasks that demonstrate students’ ability to analyze components of texts and topic?
Does the instructional material support high quality instruction?
Page 5
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
5
InstructionsforConductingHighQualityReviewsUsingtheToolandToolkit:ReferenceMaterialstoSupportQualityReviewsInadditiontotheEdReports.orgQualityInstructionalMaterialsTool:EnglishLanguageArts3-8,reviewersworkwiththefollowingmaterialsasreferences:
● TheCommonCoreStateStandardsforEnglishLanguageArts,includingAppendices(includingtheRevisedAppendixA)● Publishers'CriteriafortheCommonCoreStateStandardsforEnglishLanguageArts,Grades3-12● Supportmaterialstoidentifytextcomplexityandrigorappropriateforeachgrade● EvidenceGuides(technicaldocumentationsupportindicatinghowtocollectevidence,wheretofindevidenceandreportinginformation)
Page 6
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
6
HowtoApplyRatingsUsingtheEvaluationToolin4StepsSTEP1:ReviewtheCriteriaandIndicatorsforeachGateway
● EachGatewayconsistsofanumberofCriteriaandIndicators.CriteriainGateways1and2refertoAlignmentandQuality.CriteriainGateway3referstoUsability.
● ReviewersmustprovidearatingaccordingtothescoreoptionsprovidedforeachIndicatorandmustcitemultipleexamplesofspecific,concreteevidencetojustifytherating.Reviewersdocumentevidence,includingpagenumbers,lessonnames,unittopics,etc.,inanevidencecollectiondocument.
Page 7
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
7
STEP2:RateeachIndicator
● ReviewerswillevaluateinstructionalmaterialsagainsteachIndicatorusingtheappropriateratingscale.● EvidenceGuideswillprovidein-depth“look-fors”foreachcriteriontoguidetheexpertreviewer.EachRatingissupportedwithevidence
fromthematerialsthatspecificallyalignswiththecriteria.
Page 8
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
8
STEP3:DeterminetheCriterionRating
● AnoverallratingforeachCriterionisdeterminedbyaddingthetotalpointsearnedfromtheCriterion’sIndicators.● OncethetotalfromtheIndicatorsisadded,selecttheRating(e.g.,MeetsExpectations,PartiallyMeets,etc.)basedonwherethepointtotal
falls(seesamplebelow).
Page 9
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
9
STEP4:DeterminetheFinalGatewayRating
● ThescoringfromeachCriterionisaddedtodetermineafinalGatewayScore.GatewayScoresaredeterminedusingthesameratingscaleasearlier.
SampleGatewayRating
CRITERIA RATINGSCORE EVIDENCEGateway1:TextQualityandComplexityandAlignmenttotheCCSS-ELAHigh-qualitytextsarethecentralfocusoflessons,areattheappropriategradeleveltextcomplexity,andareaccompaniedbyqualitytasksalignedtothestandardsofreading,writing,speaking,listening,andlanguageinservicetogrowliteracyskills.Meetsexpectations(Grade3-5:37-42points;Grades6-8:32-36points)Partiallymeetsexpectations(Grades3-5:21-36points;Grades6-8:18-31points)Doesnotmeetexpectations(Grades3-5:<21points;Grades6-8:<18points)Partiallymeets=ContinuetoGateway2
1a-1f.Textsareworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)
PointTotalsfromRatingSheet(s):
17
1g-1o:Materialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttexts.
PointTotalsfromRatingSheet(s):
12
1p-1r:Materialsprovideexplicitandsystematicinstructionanddiagnosticsupportinphonics,vocabularydevelopment,morphology,syntax,andfluency.(Grades3-5)
PointTotalsfromRatingSheet(s):
6
Materialsmust“MeetExpectations”or“PartiallyMeetExpectations”inGateway1tobereviewedinGateway2.Materialsmust“MeetExpectations”inBOTHGateway1andGateway2tobereviewedinGateway3.
Page 10
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
10
EvaluationToolBackgroundInformationofReviewedMaterials
MATERIALSREVIEWReviewerName:_______________________________________________________________________________________________Date:_________________________________________________________________________________________________________TitleofInstructionalMaterial:____________________________________________________________________________________Grade:________________________________________________________________________________________________________Publisher:_____________________________________________________________________________________________________EditionYear:___________________________________________________________________________________________________Additionalreferences,notes,links:_________________________________________________________________________________
Page 11
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
11
Gateway1:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence• Aretextsworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)?• Istherearangeoftasksandquestionstodevelopreading,writing,speaking,listening,andlanguagethatarehighqualityandalignedwith
theappropriategradelevelstandards?• Arequestionsofhighqualityandtextspecifictosupportopportunitiesforrichandrigorousevidence-baseddiscussionsandwriting?• Forgrades3-5,domaterialssupportfoundationalskillsdevelopment?
RatingSheet1.1:TextComplexityandQuality
• For‘TextComplexityandQuality’toattainascoreof‘MeetsExpectations,’materialmustearnatleast18points.
CRITERION INDICATORS RATING EVIDENCETextsareworthyofstudents’timeandattention:textsareofqualityandarerigorous,meetingthetextcomplexitycriteriaforeachgrade.Materialssupportstudents’advancingtowardindependentreading.Earned:_____of20pointsMeetsexpectations
(18-20points)
Partiallymeetsexpectations(10-17points)
Doesnotmeetexpectations(<10points)
1a.Anchortextsareofpublishablequalityandworthyofespeciallycarefulreadingandconsiderarangeofstudentinterests.
024
1b.Materialsreflectthedistributionoftexttypesandgenresrequiredbythestandardsateachgradelevel. 024
1c.Textshavetheappropriatelevelofcomplexityforthegradeaccordingtoquantitativeanalysis,qualitativeanalysis,andrelationshiptotheirassociatedstudenttask.
024
1d.Materialssupportstudents’increasingliteracyskillsoverthecourseoftheschoolyear.(Seriesoftextsshouldbeatavarietyofcomplexitylevelsappropriateforthegradeband.)
024
1e.Anchortextsandseriesoftextsconnectedtothemareaccompaniedbyatextcomplexityanalysisandrationaleforeducationalpurposeandplacementinthegradelevel.
012
1f.Supportmaterialsforthecoretext(s)provideopportunitiesforstudentstoengageinarangeandvolumeofreadingtosupporttheirreadingatgradelevelbytheendoftheschoolyear.
012
Page 12
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
12
RatingSheet1.2:AlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence• For‘AlignmenttotheStandardswithTasksandQuestionsGroundedinEvidence’toattainascoreof‘MeetsExpectations,’materialmust
earnatleast14points.
CRITERION INDICATORS RATING EVIDENCEMaterialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttextstobuildstrongliteracyskills.Earned:____of16pointsMeetsexpectations
(14-16points)
Partiallymeetsexpectations(8-13points)
Doesnotmeetexpectations(<8points)
1g.Mostquestions,tasks,andassignmentsaretext-dependent,requiringstudentstoengagewiththetextdirectly(drawingontextualevidencetosupportbothwhatisexplicitaswellasvalidinferencesfromthetext).
012
1h.Sequencesoftext-dependentquestionsandtasksbuildtoaculminatingtaskthatintegratesskills(maybewriting,speaking,oracombination).
012
1i.Materialsprovidefrequentopportunitiesandprotocolsforevidence-baseddiscussionsthatencouragethemodelinganduseofacademicvocabularyandsyntax.
012
1j.Materialssupportstudents’listeningandspeakingaboutwhattheyarereadingandresearching(includingpresentationopportunities)withrelevantfollow-upquestionsandevidence.
012
1k.Materialsincludeamixofon-demandandprocesswriting(e.g.multipledrafts,revisionsovertime)andshort,focusedprojects,incorporatingdigitalresourceswhereappropriate.
012
1l.Materialsprovideopportunitiesforstudentstoaddressdifferenttexttypesofwritingthatreflectthedistributionrequiredbythestandards.
012
1m.Materialsincludefrequentopportunitiesforevidence-basedwritingtosupportcarefulanalyses,well-defendedclaims,andclearinformation.
012
1n.Materialsincludeexplicitinstructionofthegrammarandconventionsstandardsforgradelevelasappliedinincreasinglysophisticatedcontexts,withopportunitiesforapplicationbothinandoutofcontext.
012
Page 13
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
13
RatingSheet1.3(Grades3-5ONLY):TasksandQuestions:FoundationalSkillsDevelopment(Grades3-5)• For“TasksandQuestions:FoundationalSkillsDevelopment(Grades3-5)”toattainascoreof‘MeetsExpectations,’materialsmustearnat
least5points.
CRITERION INDICATORS RATING EVIDENCETasksandQuestions:FoundationalSkillsDevelopment(Grades3-5):Materialsinreading,writing,speaking,listening,andlanguagetargetedtosupportfoundationalreadingdevelopmentarealignedtothestandards.Earned:____of6pointsMeetsexpectations
(5-6points)
Partiallymeetsexpectations(3-4points)
Doesnotmeetexpectations(<3points)
1o.Materials,questions,andtasksaddressgrade-levelCCSSforfoundationalskillsbyprovidinginstructioninphonics,wordrecognition,morphology,vocabulary,syntax,andreadingfluencyinaresearch-basedandtransparentprogression.
012
1p.Materials,questions,andtasksguidestudentstoreadwithpurposeandunderstandingandtomakefrequentconnectionsbetweenacquisitionoffoundationskillsandmakingmeaningfromreading.
012
1q.Instructionalopportunitiesarefrequentlybuiltintothematerialsforstudentstopracticeandachievereadingfluencyinoralandsilentreading,thatis,toreadon-levelproseandpoetrywithaccuracy,rateappropriatetothetext,andexpression.
012
Page 14
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
14
OverallGateway1Rating:TextQualityandComplexityandAlignmenttotheStandardswithTasksandQuestionsGroundedinEvidenceReviewersusedatarecordedinRatingSheets1.1-1.3todeterminetheoverallratingforgrade3-5materials.ReviewersusedatarecordedinRatingSheets1.1-1.2todeterminetheoverallratingforgrades6-8materials.
CRITERIA RATINGSCORE EVIDENCEGateway1:TextQualityandComplexityandAlignmenttotheCCSS-ELAHigh-qualitytextsarethecentralfocusoflessons,areattheappropriategradeleveltextcomplexity,andareaccompaniedbyqualitytasksalignedtothestandardsofreading,writing,speaking,listening,andlanguageinservicetogrowliteracyskills.
Meetsexpectations(Grade3-5:37-42points;Grades6-8:32-36points)
Partiallymeetsexpectations(Grades3-5:21-36points;Grades6-8:18-31points)
Doesnotmeetexpectations(Grades3-5:<21points;Grades6-8:<18points)
Doesnotmeet=doesnotcontinuetoGateway2
1a-1f.Textsareworthyofstudents’timeandattention(ofquality,rigorous,andattherighttextcomplexityforgradelevel,student,andtask)
PointTotalsfromRatingSheet(s):
1g-1n:Materialsprovideopportunitiesforrichandrigorousevidence-baseddiscussionsandwritingabouttexts.
PointTotalsfromRatingSheet(s):
1o-1q:Materialsprovideexplicitandsystematicinstructionanddiagnosticsupportinphonics,vocabularydevelopment,morphology,syntax,andfluency.(Grades3-5)
PointTotalsfromRatingSheet(s):
Page 15
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
15
Gateway2:BuildingKnowledgewithTexts,Vocabulary,andTasks• Doinstructionalmaterialsbuildstudents’knowledgeacrosstopicsandcontentareas?• Isacademicvocabularyinstructionintentionallyandcoherentlysequencedtobuildvocabulary?• Doquestionsandtasksbuildinrigorandcomplexitytoculminatingtasksthatdemonstratestudents’abilitytoanalyzecomponentsof
textsandtopics?• Arereading,writing,speaking,listening,andlanguageskillstaughtandpracticedinanintegratedmanner?
Ratingsheet2.1:BuildingKnowledge● For“BuildingKnowledge”toattainascoreof‘MeetsExpectations,’materialsmustearnatleast28points.
CRITERION INDICATORS RATING
Materialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguageEarned:_____of32pointsMeetsexpectations
(28-32points)
Partiallymeetsexpectations(16-27points)Doesnotmeetexpectations(<16points)
2a.Textsareorganizedaroundatopic/topicstobuildstudents’abilitytoreadandcomprehendcomplextextsindependentlyandproficiently.
024
2b.Materialscontainsetsofcoherentlysequenced,highqualityquestionsandtasksthatrequirestudentstoanalyzethelanguage,keyideas,details,craft,andstructureofindividualtexts.
024
2c.Materialscontainacoherentlysequencedsetofhighqualitytext-dependentquestionsandtasksthatrequirestudentstoanalyzetheintegrationofknowledgeandideaswithinindividualtextsaswellasacrossmultipletexts.
024
2d.Thequestionsandtaskssupportstudents’abilitytocompleteculminatingtasksinwhichtheydemonstratetheirknowledgeofatopicthroughintegratedskills(e.g.combinationofreading,writing,speaking,listening).
024
2e.Materialsincludeacohesive,year-longplanforstudentstointeractandbuildkeyacademicvocabularywordsinandacrosstexts. 024
2f.Materialsincludeacohesive,year-longplantosupportstudents’increasingwritingskillsoverthecourseoftheschoolyear,buildingstudents’writingabilitytodemonstrateproficiencyatgradelevelattheendoftheschoolyear.
024
2g.Materialsincludeaprogressionoffocusedresearchprojectstoencouragestudentstodevelopknowledgeinagivenareabyconfrontingandanalyzingdifferentaspectsofatopicusingmultipletextsandsourcematerials.
024
2h.Materialsprovideadesign,includingaccountability,forhowstudentswillregularlyengageinavolumeofindependentreadingeitherinoroutsideofclass. 024
Page 16
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
16
OverallGateway2Rating:BuildingKnowledgewithTexts,Vocabulary,andTasksReviewersusedatarecordedinRatingSheet2.1todeterminetheGateway2overallrating.
CRITERIA
RATINGSCORE
EVIDENCE
Gateway2:StrategyandPurposeMaterialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguage.Meetsexpectations(28-32points)Partiallymeetsexpectations(16-27points) Doesnotmeetexpectations(<16points)
2a-2h:Materialsbuildknowledgethroughintegratedreading,writing,speaking,listening,andlanguage.
PointTotalsfromRatingsSheet:
Page 17
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
17
Gateway3:InstructionalSupportsandUsabilityIndicators● Gateway3RatingSheetsincludesomeIndicatorsthatareratedandsomethatarenotrated.IncaseswhereIndicatorsarenotrated,the
evidencecollectedprovidesvaluableinformationaboutinstructionalmaterials,althoughtheindicatorisnotscoredanddoesnotaffecttheratingfortheCriterionorGateway.3
RatingSheet3.1:UseandDesigntoFacilitateStudentLearning
● For“Useanddesignfacilitatestudentlearning”toattainascoreof“MeetsExpectations,”materialmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
Useanddesignfacilitatestudentlearning:Materialsarewelldesignedandtakeintoaccounteffectivelessonstructureandpacing.Earned:_____of8pointsMeetsexpectations(7-8points)Partiallymeetsexpectations(5-6points)Doesnotmeetexpectations(<5points)
3a.Materialsarewell-designedandtakeintoaccounteffectivelessonstructureandpacing.
012
3b.Theteacherandstudentcanreasonablycompletethecontentwithinaregularschoolyear,andthepacingallowsformaximumstudentunderstanding.
012
3c.Thestudentresourcesincludeamplereviewandpracticeresources,cleardirections,andexplanation,andcorrectlabelingofreferenceaids(e.g.,visuals,maps,etc.).
012
3d.Materialsincludepublisher-producedalignmentdocumentationofthestandardsaddressedbyspecificquestions,tasks,andassessmentitems.
012
3e.Thevisualdesign(whetherinprintordigital)isnotdistractingorchaotic,butsupportsstudentsinengagingthoughtfullywiththesubject.
3 Forindicatorsthatdonotcurrentlyreceiveanumericalrating,EdReports.orgisprovidingevidenceofthepresenceoftheseindicatorsbutwearecurrentlynotincludingthemintheratingsuntilwegathermoreinformationfromreviewersandthefieldontheirusefulness.
Page 18
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
18
RatingSheet3.2:TeacherPlanningandLearningforSuccesswithCCSS● For“TeacherPlanningandLearningforSuccesswithCCSS”toattainascoreof“MeetsExpectations,”materialsmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
TeacherPlanningandLearningforSuccesswithCCSS:MaterialssupportteacherlearningandunderstandingoftheStandards.Earned:_____of8pointsMeetsexpectations
(7-8points)Partiallymeets
expectations(5-6points)Doesnotmeet
expectations(<5points)
3f.Materialscontainateacher'seditionwithampleandusefulannotationsandsuggestionsonhowtopresentthecontentinthestudenteditionandintheancillarymaterials.Whereapplicable,materialsincludeteacherguidancefortheuseofembeddedtechnologytosupportandenhancestudentlearning.
012
3g.Materialscontainateacher’seditionthatcontainsfull,adult-levelexplanationsandexamplesofthemoreadvancedliteracyconceptssothatteacherscanimprovetheirownknowledgeofthesubject,asnecessary.
012
3h.Materialscontainateacher’seditionthatexplainstheroleofthespecificELA/literacystandardsinthecontextoftheoverallcurriculum.
012
3i.Materialscontainexplanationsoftheinstructionalapproachesoftheprogramandidentificationoftheresearch-basedstrategies.
012
3j.Materialscontainstrategiesforinformingallstakeholders,includingstudents,parents,orcaregiversabouttheELA/literacyprogramandsuggestionsforhowtheycanhelpsupportstudentprogressandachievement.
Notscored
Page 19
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
19
RatingSheet3.3:Assessment● For“Assessment”toattainascoreof“MeetsExpectations,”materialsmustearnatleast7points.
CRITERION INDICATORS RATING EVIDENCE
Assessment:MaterialsofferteachersresourcesandtoolstocollectongoingdataaboutstudentprogressontheStandards.Earned:_____of8pointsMeetsexpectations
(7-8points)Partiallymeets
expectations(4-6points)Doesnotmeet
expectations(<4points)
3k.Materialsregularlyandsystematicallyofferassessmentopportunitiesthatgenuinelymeasurestudentprogress. 012
3l.The purpose/use of each assessment is clear:i. Assessmentsclearlydenotewhichstandardsarebeing
emphasized. 012
ii. Assessmentsprovidesufficientguidancetoteachersforinterpretingstudentperformanceandsuggestionsforfollow-up.
012
3m.Materialsshouldincluderoutinesandguidancethatpointoutopportunitiestomonitorstudentprogress. 012
3n.Materialsindicatehowstudentsareaccountableforindependentreadingbasedonstudentchoiceandinteresttobuildstamina,confidence,andmotivation.
NotScored
Page 20
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
20
RatingSheet3.4:DifferentiatedInstruction● For“DifferentiatedInstruction”toattainascoreof“MeetsExpectations,”materialsmustearnatleast9points.
CRITERION INDICATORS RATING EVIDENCE
Differentiatedinstruction:Materialsprovideteacherswithstrategiesformeetingtheneedsofarangeoflearnerssothattheydemonstrateindependentabilitywithgrade-levelstandards.Earned:_____of10pointsMeetsexpectations(9-10points)Partiallymeetsexpectations(6-8points)Doesnotmeet
expectations(<6points)
3o.Materialsprovideteacherswithstrategiesformeetingtheneedsofrangeoflearnerssothecontentisaccessibletoalllearnersandsupportstheminmeetingorexceedingthegrade-levelstandards.
012
3p.Materialsregularlyprovideallstudents,includingthosewhoread,write,speak,orlistenbelowgradelevel,orinalanguageotherthanEnglish,withextensiveopportunitiestoworkwithgradeleveltextandmeetorexceedgrade-levelstandards.
024
3q.Materialsregularlyincludeextensionsand/ormoreadvancedopportunitiesforstudentswhoread,write,speak,orlistenabovegradelevel.
012
3r.Materialsprovideopportunitiesforteacherstouseavarietyofgroupingstrategies. 012
Page 21
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
21
RatingSheet3.5:EffectiveTechnologyUse● For“EffectiveTechnologyUse,”indicatorsarenotratedbutevidenceshouldbecollectedifincludedinreviewmaterials.EdReports.org
considerstechnologyusetobeanimportantelementofusability,butsinceprintedandonlinematerialsvarywidelyintheiruseoftechnology,wearenotscoringtheseindicatorsatthistime.
CRITERION INDICATORS RATING EVIDENCE
Effectivetechnologyuse:Materialssupporteffectiveuseoftechnologytoenhancestudentlearning.Digitalmaterialsareaccessibleandavailableinmultipleplatforms.
3s.Digitalmaterials(eitherincludedassupplementarytoatextbookoraspartofadigitalcurriculum)areweb-based,compatiblewithmultipleInternetbrowsers(e.g.,InternetExplorer,Firefox,GoogleChrome,etc.),“platformneutral”(i.e.,arecompatiblewithmultipleoperatingsystemssuchasWindowsandAppleandarenotproprietarytoanysingleplatform),followuniversalprogrammingstyle,andallowtheuseoftabletsandmobiledevices.
Notscored
3t.Materialssupporteffectiveuseoftechnologytoenhancestudentlearning,drawingattentiontoevidenceandtextsasappropriate.
Notscored
3u.Materialscanbeeasilycustomizedforindividuallearners.
i. Digitalmaterialsincludeopportunitiesforteacherstopersonalizelearningforallstudents,usingadaptiveorothertechnologicalinnovations.
Notscored
ii. Materials can be easily customized for local use.
3v.Materialsincludeorreferencetechnologythatprovidesopportunitiesforteachersand/orstudentstocollaboratewitheachother(e.g.websites,discussiongroups,webinars,etc.)
Notscored
Page 22
EdReports.orgQualityInstructionalMaterialsTool:ELA3-8
22
OverallGateway3:InstructionalSupportsandUsabilityIndicatorsReviewersusedatarecordedinRatingSheets3.1-3.5todeterminetheGateway3overallrating.
CRITERIA RATINGSCORE EVIDENCE
GatewayGateway3:StructuralSupportsandUsabilityIndicatorsMeetsexpectations(30-34points)Partiallymeetsexpectations(24-29points) Doesnotmeetexpectations(<24points)
3a-e:UseandDesigntoFacilitateStudentLearning
Pointtotalsfromratingssheets:
3f-j:TeacherPlanningandLearningforSuccesswithCCSS
Pointtotalsfromratingssheets:
3k-n:Assessment
Pointtotalsfromratingssheets:
3o-r:DifferentiatedInstruction Pointtotalsfromratingssheets:
3s-v:EffectiveTechnologyUse