Page 1
Neal Kingston CV 1
CurriculumVitaeNealMartinKingston
EDUCATIONPh.D. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1983M.Phil. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1983M.Ed. EducationalMeasurement,TeachersCollege,ColumbiaUniversity,NewYork,NY,1978M.A. PsychologyinEducation,TeachersCollege,ColumbiaUniversity,NewYork,NY,1977B.A. LiberalStudies(concentrationsinBiology&Education),StateUniversityofNewYork,
StonyBrook,NY,1974EMPLOYMENTHISTORY2006–presentUniversityofKansas,SchoolofEducation,Lawrence,Kansas Director,AchievementandAssessmentInstitute,2012–present Professor,PsychologyandResearchinEducation,2012–present ProgramCoordinator,Research,Evaluation,Measurement,andStatisticstrack
2010–2011 Director,CenterforEducationalTestingandEvaluation,2009–2012 InterimDepartmentChair,PsychologyandResearchinEducation,Fall2009 Co‐Director,CenterforEducationalTestingandEvaluation2008–09 AssociateDepartmentChair,PsychologyandResearchinEducation,2008–10 AssociateProfessor,PsychologyandResearchinEducation,2006–20122004–2006 CTBMcGraw‐Hill,Monterey,CA VicePresident‐GeneralManagerandVicePresidentofResearch1996–2004 MeasuredProgress(namechangedfromAdvancedSystemsin1998),Dover,NH SeniorVice‐President1997‐2004 Vice‐President1996‐971996 AssessmentConsultant19931995 KentuckyDepartmentofEducation,Frankfort,KY AssociateCommissioner,OfficeofCurriculum,Assessment,andAccountability19911993 AssessmentConsultant19821991 EducationalTestingService,Princeton,NJ ExecutiveDirector,WorkplaceAssessmentandTraining,199091 DirectorofGraduateRecordExaminationsResearchandNewTestingInitiatives,
198990 DirectorofGraduateRecordExaminationsResearchandTestDevelopment,
198789 GroupHead,SchoolandHigherEducationProgramsStatisticalAnalysis,198387 SeniorMeasurementStatistician,SchoolandHigherEducationPrograms
StatisticalAnalysis,19828719811982 LosAngelesCountyDepartmentofPersonnel19781981 EducationalTestingService,Princeton,NJ AssociateMeasurementStatistician19741976 YonkersBoardofEducation,Yonkers,NY ScienceTeacher
Page 2
Neal Kingston CV 2
HONORS2015 NationalAssociationofAssessmentDirectorsAwardforOutstandingContributions
toEducationalAssessmentKUTEACHINGRECORD
A. ListofCoursesTaught(REMS=Research,Evaluation,Measurement,andStatistics)
CourseNumber&Title Sem/Year #Enrolled PRE812,Meta‐analysis Spring2016 15PRE980,AdvancedTopicsinREMS Fall2015 5PRE812,Meta‐analysis Spring2015 27PRE980,AdvancedTopicsinREMS Fall2014 10PRE515,UnderstandingResearch(McNairScholars) Spring2014 19PRE715,EducationalMeasurement Fall2013 28PRE515,UnderstandingResearch(McNairScholars) Spring2013 15PRE715,EducationalMeasurement Fall2012 34PRE812,Meta‐analysis Spring2012 11PRE980,AdvancedTopicsinREMS Spring2012 1PRE725,EducationalMeasurement Fall2011 34PRE980,AdvancedTopicsinREMS Fall2011 5PRE931,SeminarinComputer‐BasedTesting Spring2011 14PRE980,AdvancedTopicsinREMS Spring2011 7PRE725,EducationalMeasurement Fall2010 58PRE980,AdvancedTopicsinREMS Fall2010 11PRE812,Meta‐analysis Spring2010 9PRE725,EducationalMeasurement Fall2009 54PRE598,UnderstandingResearch(McNairScholars) Spring2009 12PRE725,EducationalMeasurement Fall2008 64PRE598,UnderstandingResearch(McNairScholars) Spring2008 19PRE812,Meta‐analysis Spring2008 20PRE725,EducationalMeasurement Fall2007 40PRE918,CurrentIssuesandTrends Fall2007 2PRE725,EducationalMeasurement Spring2007 25PRE998,SeminarinComputerBasedTesting Spring2007 5PRE725,EducationalMeasurement Fall2006 39
B. UndergraduateAdvisingRecord:NotApplicable
C. GraduateandPostgraduateAdvisingRecord
CommitteeChair:Doctoral.(Ph.D.dateisdateoffinaldefense)
Pan,Qianqian,(Research,Evaluation,Measurement,&Statistics),Fall2014‐presentThompson,WilliamJake,(Research,Evaluation,Measurement,&Statistics),Fall2014‐
presentLao,Hongling,(Research,Evaluation,Measurement,&Statistics),Spring2013‐presentScheuring,Sylvia;(Research,Evaluation,Measurement,&Statistics)2009‐present
Page 3
Neal Kingston CV 3
Tiemann,Gail;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2015.AnInvestigationofAnswerChangingonaLarge‐scaleComputer‐basedEducationalAssessment
Loughran,Jessica,(Research,Evaluation,Measurement,&Statistics),Ph.D.December2014.DifferentialItemFunctioningforEnglishLanguageLearnersonMathItems:TheInfluenceofLinguisticComplexityFeatures.
Atalmis,Erkan;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2014.TheImpactofNumberofOptionsofMultiple‐ChoiceQuestionsonItemandTestQuality.
Clark,Amy,(Research,Evaluation,Measurement,&Statistics),Ph.D.August2013.Validationofacognitivediagnosticmodelacrossmultipleformsofareadingcomprehensionassessment.
Zhao,Fei;(Research,Evaluation,Measurement,&Statistics)Ph.D.July2013.UsingNoncompensatoryModelsinCognitiveDiagnosticMathematicsAssessments:AnEvaluationBasedonEmpiricalData
Gu,Fei;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2013.UsingParametricandResidual‐basedBootstraptoAssesstheAbsoluteGoodness‐of‐fitforStateSpaceModel
Zheng,Chunmei;(Research,Evaluation,Measurement,&Statistics)Ph.D.April2013.ExaminationofParameterEstimatesWhenViolatingtheOrthogonalityAssumptionoftheBifactorItemResponseModel.
Chen,Jie;(Research,Evaluation,Measurement,&Statistics)Ph.D.August2012.ImpactofInstructionalSensitivityonHigh‐StakesAchievementTestItems:AComparisonofMethods.
Wang,Wenhao;(Research,Evaluation,Measurement,&Statistics)Ph.D.May2012.AreAllItemResponseFunctionsMonotonicallyIncreasing?
CommitteeChair:Masters.
Clark,Amy;(Research,Evaluation,Measurement,&Statistics)2010‐2011Gu,Fei;(Research,Evaluation,Measurement,&Statistics)2006‐2009
Othergraduatecommitteeservice: Doctoral
Alsheri,Khalid;(EducationalTechnology)2009‐2013Bastion,Susan;(Research,Evaluation,Measurement,&Statistics),2008‐presentCarvajal,Jorge;(Research,Evaluation,Measurement,&Statistics)2007‐2010Cho,Hyun‐jeong;(SpecialEducation)2008‐2009Howarter,Stephani,(Research,Evaluation,Measurement,&Statistics)2012‐2015Kim,MinJung;(Research,Evaluation,Measurement,&Statistics)2010‐2015Kim,Sooji;(MusicTherapy)2007‐2008Lee,JaeHoon;(QuantitativePsychology)2007‐2009Mark,Carolyn;(SpecialEducation)2010‐2011Meiers,Christopher;(Research,Evaluation,Measurement,&Statistics),2009‐presentMerrilat,Linda;(EducationalTechnology)2007‐2008Montgomery,Melinda;(Research,Evaluation,Measurement,&Statistics),2011‐2014Moshirnia,Andrew;(EducationalTechnology)2007‐2008Nash,Brook;(Research,Evaluation,Measurement,&Statistics),2010‐2012O’Brian,Joseph;(Research,Evaluation,Measurement,&Statistics),2014‐presentSalawani,Gita;(QuantitativePsychology)2008
Page 4
Neal Kingston CV 4
Selig,James;(QuantitativePsychology)2009(honors)Stevens,Sheridan;(SpecialEducation)2006Suh,Hong;(Research,Evaluation,Measurement,&Statistics)2007‐2010Theoharris,Rachelle;(SpecialEducation)2007‐2009Wolkowitz,Amanda;(Research,Evaluation,Measurement,&Statistics)2007‐2008(2008
winnerofSOEbestdissertation)
Master’sFolger,Allison;(Research,Evaluation,Measurement,&Statistics)2010‐11Hinojos,Belinda;(CounselingPsychology)2006Moeder,Michelle;(CounselingPsychology)2007‐08Nash,Brooke;(Research,Evaluation,Measurement,&Statistics)2007Wu,YelinaPing;(ClinicalChildPsychology)2006‐07
PostdoctoralFellows:
Cho,Hyun‐jeong,2009‐2011D. HonorsandAwardsforTeaching
None
KUPROFESSIONALPERFORMANCERECORD
A. JobResponsibilities ProgramCoordinator,Research,Evaluation,Measurement,andStatisticstrack2010‐2011 Director,CenterforEducationalTestingandEvaluation,2009‐2012 InterimDepartmentChair,PsychologyandResearchinEducation,Fall2009 Co‐Director,CenterforEducationalTestingandEvaluation,2008‐09 AssociateDepartmentChair,PsychologyandResearchinEducation,2008‐10 AssociateProfessor,PrograminResearch,Evaluation,Measurement,andStatistics2006–
present
B. HonorsandAwardsforProfessionalPerformanceMember,PhiBetaDelta,AlphaPiChapter,UniversityofKansas,2010‐present
RESEARCHRECORD(*indicatesco‐authorwasanadviseeatthetimetheworkwasprepared)
A. ResearchPublicationsand/orCreativeWorks
Books1. Kingston,N.M.&Clark,A.K.(2014).TestFraud:StatisticalDetectionand
Methodology.NewYork:Routledge.MajorPublications(*indicatesstudentwithwhomIhavecollaborated)2. Kingston,N.M.,Karvonen,M.,Bechard,S.,&Erickson,K.(inpress).The
PhilosophicalUnderpinningsandKeyFeaturesoftheDynamicPeerreviewed
Page 5
Neal Kingston CV 5
LearningMapsAlternateAssessment.NationalSocietyfortheStudyofEducationYearbook.
3. Kingston,N.M.,Broaddus,A.,&*Lao,H.(2015).Some Thoughts on “Using Learning Progressions to Design Vertical Scales that Support Coherent Inferences about Student Growth.” Measurement:InterdisciplinaryResearch&Perspectives,13(3‐4),195‐199.
4. Cho,H.J.,&Kingston,N.(2015).Examiningteachers’decisionsontest‐typeassignmentforstatewideassessments.TheJournalofSpecialEducation,49(1),16‐27.(PublishedonlineSeptember2013).
5. Popham,W.J.,Berliner,D.C.,Kingston,N.,Fuhrman,S.H.,Ladd,S.M.,Charbonneau,J.&Chatterji,M.(2014).Cantoday'sstandardizedtestsyieldinstructionallyusefuldata?Challenges,promisesandthestateoftheart,QualityAssuranceinEducation,22(4),300‐316.
6. Adjei,S.,Selent,D.,Heffernan,N.,Pardos,Z.,Broaddus,A.,Kingston,N.(2014)RefiningLearningMapswithDataFittingTechniques:SearchingforBetterFittingLearningMaps.InPardos&Stamper(Eds.)The2014ProceedingsofInternationalEducationalDataMiningSociety.
7. Cho,H.&Kingston,N.M.(2014).UnderstandingTestTypeAssignment:WhyDoSpecialEducatorsMakeUnexpectedTestTypeAssignments?PsychologyintheSchools.
8. Kingston,N.M.&Clark,A.K.(2014).IntroductioninNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
9. Clark,A.K.&Kingston,N.M.(2014).ABriefHistoryofResearchonTestFraudDetectionandPreventioninNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
10. *Tiemann,G.C.&Kingston,N.M.(2014).AnExplorationofAnswerChangingBehavioronaComputer‐BasedHigh‐StakesAchievementTestinNealM.KingstonandAmyK.Clark(Eds.)TestFraud:StatisticalDetectionandMethodology.NewYork:Routledge.
11. Ginsberg,R.&Kingston,N.M.(2014).CaughtinaVise:TheChallengesFacingTeacherPreparationinanEraofAccountability.TeachersCollegeRecordVolume116(1),2014,p.‐http://www.tcrecord.orgIDNumber:17295,DateAccessed:1/14/20149:30:47PM
12. Kingston,N.M.,*Tiemann,G.C.,&*Loughran,J.T.(2013).Commentaryon“ConstructMapsasaFoundationforStandardSetting.”Measurement:InterdisciplinaryResearch&Perspectives,11,181‐184.
13. Cho,H.&Kingston,N.M.(2013).WhyIEPTeamsAssignLowPerformersWithMildDisabilitiestotheAlternateAssessmentBasedonAlternateAchievementStandards.JournalofSpecialEducation,47,162‐174.
14. Cho,H.,Wehmeyer,M.&Kingston,N.M.(2013).FactorsthatPredictElementaryEducators’PerceptionsandPracticeinTeachingSelf‐Determination.PsychologyintheSchools,50:770‐780.
15. Kingston,N.M.&*Anderson,G.(2013)TheEfficacyofUsingStateStandards‐BasedAssessmentsforPredictingStudentSuccessin
InvitedPeerreviewedPeerReviewedPeerreviewedPeerReviewedInvitedInvitedInvitedPeerReviewedInvitedPeerReviewedPeerReviewedPeerReviewed
Page 6
Neal Kingston CV 6
CommunityCollegeClasses.EducationalMeasurement:IssuesandPractice32(3):3‐10.
16. Kingston,N.M.(2013).EducationalTestingCaseStudies.InJamesWollackandJohnFremer(Eds.),HandbookofTestSecurity.NewYork:Routledge.
17. Kingston,N.M.,*Scheuring,S.T.,&Kramer,L.B.(2013).TestDevelopmentStrategies.InKurtGeisinger(Ed.)APAHandbookofTestingandAssessmentinPsychology.Washington,DC:APABooks.
18. Kingston,N.M.&Kramer,L.B.(2013).HighStakesTestConstructionandTestUse.InT.Little(Ed.)OxfordHandbookofQuantitativeMethods.OxfordUniversityPress.
19. *Gu,F.,Little,T.,&Kingston,N.M.(2013)MisestimationofReliabilityUsingCoefficientAlphaandStructuralEquationModelingwhenAssumptionsofTau‐EquivalenceandUncorrelatedErrorsareViolated.Methodology,9,30‐40.(PublishedonlineFebruary2012).
20. *Zheng,C.,Erickson,A.G.,Kingston,N.M.&Noonan,P.(2012).TheRelationshipamongSelf‐Determination,Self‐Concept,andAcademicAchievementforStudentswithLearningDisabilities.JournalofLearningDisabilities,46(2),1‐13.
21. Kingston,N.M.&Nash,B.(2012).HowManyFormativeAssessmentAngelscanDanceontheHeadofaMeta‐AnalyticPin:.2.EducationalMeasurement:IssuesandPractice,31(4):18–19.
22. Cho,H.J.,Lee,J,andKingston,N.M.(2012).ExaminingtheEffectivenessofTestAccommodationUsingDIFandaMixtureIRTModel.AppliedMeasurementinEducation,25(4):281‐304.
23. Cho,H.J.&Kingston,N.M.(2012).WhyIndividualizedEducationProgramTeamsAssignLow‐PerformingStudentswithMildDisabilitiestotheAlternateAssessmentAlternateAchievementStandards.JournalofSpecialEducation.(PublishedonlineFebruary15,2012).
24. Kingston,N.M.,*Tiemann,G.C.,Miller,H.L.,&Foster,D.(2012).AnAnalysisoftheDiscrete‐OptionMultipleChoiceItemType.PsychologicalTestandAssessmentModeling,54,3‐20.
25. Cho,H.,Wehmeyer,M.,&Kingston,N.M.(2012)TheImpactofSocialandClassroomEcologicalFactorsonPromotingSelf‐DeterminationinElementarySchool.PreventingSchoolFailure,56,19‐28.(PublishedonlineDecember15,2011).
26. Kingston,N.M.&*Tiemann,G.C.(2011)SettingPerformanceStandardsonComplexAssessments:TheBodyofWorkMethod.InG.J.Cizek(Ed.)Settingperformancestandards:Concepts,methods,andperspectives,SecondEdition.Mahwah,NJ:LawrenceErlbaum.
27. Kingston,N.M.&*Nash,B.(2011).FormativeAssessment:AMeta‐AnalysisandaCallforResearch.EducationalMeasurement:IssuesandPractice,30:4,28–37.
28. *Gu,F.,Skorupski,W.,Hoyle,L.,&Kingston,N.M.(2011).StandardErrorsandConfidenceIntervalsfromBootstrappingforItemParametersintheTwo‐andThree‐ParameterLogisticRamseyCurve‐IRTModels.AppliedPsychologicalMeasurement,35:568–571.
PeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerReviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Page 7
Neal Kingston CV 7
29. Cho,H.&Kingston,N.M.(2011).CapturingImplicitPolicyfromNCLBTestTypeAssignments:AnalysisofCharacteristicsandPerformanceofStudentsTakingAlternateAssessmentsBasedonModifiedAchievementStandards.ExceptionalChildren78:58‐72.
30. Cho,H.,Wehmeyer,M.&Kingston,N.M.(2011).ElementaryTeachers’KnowledgeandUseofInterventionsandBarrierstoPromotingStudentSelf‐Determination.JournalofSpecialEducation,45:149‐156.(Publishedonline2010)
31. Bechard,S.,Sheinker,J.,Abell,R.,Barton,K.,Burling,K.,Camacho,C.,Cameto,R.,Haertel,G.,Hansen,E.,Johnstone,C.,Kingston,N.,Murray,E.,Parker,C.,Redfield,D.,Rodriquez,J.,andTucker,B.(2010).MeasuringCognitionofStudentswithDisabilitiesUsingTechnology‐EnabledAssessments:RecommendationsforaNationalResearchAgenda.TheJournalofTechnology,Learning,andAssessment,Vol.10,No.4.
32. Kingston,N.M.(2009).Comparabilityofcomputer‐andpaper‐administeredmultiple‐choicetestsforK‐12populations:asynthesis.AppliedMeasurementinEducation22:22‐37.
33. Kingston,N.M.(2007).Futurechallengestopsychometrics:Validity,Validity,Validity.InC.R.RaoandS.Sinharay(Ed.)HandbookofStatistics,26:Psychometrics.Amsterdam,TheNetherlands:Elsevier.
34. Kingston,N.M.andEhringhaus,M.(2005).Useoftechnologyandprinciplesofuniversaldesigntoimprovethevalidityandfairnessoflicensuretests.InJ.LMountyandD.S.Martin(Ed.)AssessingDeafAdults.Washington,DC:GallaudetUniversityPress.
35. Kingston,N.M.,Kahl,S.R.,Sweeney,K.P.,andBay,L.(2001).Settingperformancestandardsusingthebodyofworkmethod.InG.J.Cizek(Ed.)Settingperformancestandards:Concepts,methods,andperspectives.Mahwah,NJ:LawrenceErlbaum,Publishers.
36. Kingston,N.M.andReidy,E.(1997).Kentucky’saccountabilityandassessmentsystems.InJ.Millman(Ed.).Gradingteachers,gradingschools:Isstudentachievementavalidevaluationmeasure?ThousandOaks,CA:CorwinPublishers.
37. Kingston,N.M.andReidy,E.(1997).KIRISmeetsthecritics:Alittlelightandmuchheat.InJ.Millman(Ed.).Gradingteachers,gradingschools:Isstudentachievementavalidevaluationmeasure?ThousandOaks,CA:CorwinPublishers.
38. Kingston,N.M.(1993).Standardsettingincompensatoryversusnon‐compensatorylicensuretestingprograms.CLEARExamReview4:24‐27.
39. Kingston,N.M.andDorans,N.J.(1985).Theanalysisofitem‐abilityregressions:AnexploratoryIRTmodelfittool.AppliedPsychologicalMeasurement9:281‐288.
40. Dorans,N.J.andKingston,N.M.(1985).Theeffectsofviolationsofuni‐dimensionalityontheestimationofitemandabilityparametersandonitemresponsetheoryequatingoftheGREverbalscale.JournalofEducationalMeasurement22:249‐262.
PeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerReviewedInvitedPeerreviewedInvitedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Page 8
Neal Kingston CV 8
41. Kingston,N.M.andDorans,N.J.(1984).ItemlocationeffectsandtheirimplicationsforIRTequatingandadaptivetesting.AppliedPsychologicalMeasurement8:147‐154.
Peerreviewed
UnderSubmission42. Atalmis,E.&Kingston,N.M.(submitted).Three,Four,andNoneoftheAboveOptions
inMultiple‐ChoiceTest.AppliedMeasurementinEducation.43. Atalmis,E.&Kingston,N.M.(submitted).The Impact of Homogeneity of Answer
Choices on Item Difficulty and Discrimination.AppliedMeasurementinEducation.44. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).Motivational
regulationprofilefromSelf‐DeterminationTheory:Theprominenceofqualityofmotivation.JournalofEducationalPsychology.
45. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).BeyondGoalAchievementOrientationTheory:Anotherlookatthequalityofacademicmotivation.JournalofPersonalityandSocialPsychology.
46. Cho,H.J.,Im,S.K.,Deci,E.L.,Kingston,N.M.,&Lee,J.H.(submitted).TheimpactofsocialcontextualfactorsthatpredictKoreanstudents’senseofautonomyself‐regulationandacademicperformance.JournalofPersonalityandSocialPsychology.
47. Kingston,N.M.,Frank,E.&Perkins,K.(submitted).Relationship between Instructional Sensitivity and the Item Characteristics of a Kinesiology Test. Applied Measurement in Education.
Minorworks*indicatesstudentwithwhomIhavecollaborated48. Kingston,N.(2016).ShiftingtheParadigmofLarge‐ScaleAchievement
Assessment.InRice,M.andHaaheim,E.,eds.,MerrillAdvancedStudiesCenterWhitePaperNo.119:ResearchInnovationasaPathwaytotheFuture(page#s).Lawrence,KS:UniversityofKansasMerrillAdvancedStudiesCenter.
49. Kingston,N.M.(2014).Thevalueofstandardsetting:Apersonalmeandering.NCMENewsletter22(4):7.
50. Almond,P.,Kingston,N.,Michaels,H.,Roeber,E.,Warren,S.,Winter,P.,&Mark,C.(2012).Technicalconsiderationsfordevelopingassessmentsthatincludespecialpopulationsandarebasedonorganizedlearningmodels.MenloPark,CA:SRIInternationalandLawrence,KS:CenterforEducationalTestingandEvaluation.
51. Kingston,N.M.(2012).It’s1938:AlookbackatthefirstyearofNCME.NCMENewsletter20(3):2‐3.
52. Kingston,N.,Chin,T.,Geisinger,K.,andMcKinley,R.(2010).FinalReport,ThirdPartyEquatingVerificationoftheNYSGrades3‐8ELAandMathematicsTests,BurosInstituteforAssessmentConsultationandOutreach.
53. Bechard,S.,Sheinker,J.,Abell,R.,Barton,K.,Blackorby,J.,Burling,K.,Camacho,C.,Cameto,R.,Haertel,G.,Hansen,E.,Johnstone,C.,Kingston,N.,Murray,E.,Parker,C.,Redfield,D.,Rodriquez,J.,andTucker,B.(2010).MeasuringCognitionofStudentswithDisabilitiesUsingTechnology‐EnabledAssessments:RecommendationsforaResearch
InvitedInvitedInvitedInvitedInvitedInvited
Page 9
Neal Kingston CV 9
Agenda.Dover,NH:MeasuredProgress,andMenloPark,CA:SRIInternational.
54. Irwin,P.M.,Kingston,N.M.,Skorupski,W.P.,Glasnapp,D.R.,&Poggio,J.P.(2009).TechnicalManualfortheKansasAssessmentsinScience.
55. Peyton,V.,Kingston,N.M.,Skorupski,W.,Glasnapp,D.R.,andPoggio,J.P.(2009).KansasEnglishLanguageProficiencyAssessment(KELPA)TechnicalManual.
56. Irwin,P.M.,Kingston,N.M.,Glasnapp,D.R.,&Poggio,J.P.(2008).TechnicalManualfortheKansasAssessmentsofModifiedMeasures(KAMM)andKansasAlternateAssessments(KAA)inScience.
57. *Tiemann,G.C.andKingston,N.M.(2010).Non‐Directionalhypothesistesting.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
58. Kingston,N.M.(2010).SequentialTestsofStatisticalHypotheses(Wald)[TheAnnalsofMathematicalStatistics,16,2,117].InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
59. Kingston,N.M.(2010).Computerizedadaptivetesting.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
60. Kingston,N.M.and*Tiemann,G.C.(2010).SpearmanBrownprophecyformula.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
61. *Chen,J.,Kingston,N.M.,*Tiemann,G.&*Gu,F.(2010).Hypothesis.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
62. *Gu,F.andKingston,N.M.(2010).Scatterplot.InN.Salkind(Ed.)EncyclopediaofResearchDesign.ThousandOaks,CA:SagePublishing.
63. Kingston,N.M.(2009).SAT.InB.Kerr(Ed.)EncyclopediaofGiftedness,Creativity,andTalent.ThousandOaks,CA:SagePublishing.
64. Kingston,N.M.(2009).ACTCollegeAdmissionsTest.InB.Kerr(Ed.)EncyclopediaofGiftedness,Creativity,andTalent.ThousandOaks,CA:SagePublishing.
65. Kingston,N.M.(2009).Self‐reportinstruments.InS.Lopez(Ed.)EncyclopediaofPositivePsychology.Malden,MA:BlackwellPublishing.
66. Kingston,N.M.(2008).Standardizedtests.InN.Salkind(Ed.)EncyclopediaofEducationalPsychology.ThousandOaks,CA:SagePublishing.
67. Kingston,N.M.(2008).Norm‐Referencedtests.InN.Salkind(Ed.)EncyclopediaofEducationalPsychology.ThousandOaks,CA:SagePublishing.
68. Dings,J.,Childs,R.,andKingston,N.M.(2002).Effectsofmatrixsamplingonstudentscorecomparabilityinconstructedresponseandmultiple‐choiceassessments.Washington,DC:CouncilofChiefStateSchoolOfficers.
InvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedInvitedPeerreviewedPeerreviewed
Page 10
Neal Kingston CV 10
69. Dings,J.,Gong,B.,&Kingston,N.(1995)KIRISAccountabilityCycleITechnicalManual.Frankfort,KY:KentuckyStateDepartmentofEducation.
70. Kingston,N.M.,Leary,L.,andWightman,L.(1988).AnexploratorystudyoftheapplicabilityofitemresponsetheorymethodstotheGraduateManagementAdmissionsTest.LosAngeles:GraduateManagementAdmissionsCouncil.
71. Schaeffer,G.A.andKingston,N.M.(1988).StrengthoftheanalyticalfactoroftheGREGeneralTestinseveralsubgroups:afull‐informationfactoranalysisapproach.RR88‐5.Princeton,N.J.:EducationalTestingService.
72. McKinley,R.L.andKingston,N.M.(1987).ExploringtheuseofIRTequatingfortheGRESubjectTestinMathematics.RR87‐21.Princeton,N.J.:EducationalTestingService.
73. Kingston,N.M.(1986).AssessingthedimensionalityoftheGMATVerbalandQuantitativeMeasuresusingfull‐informationfactoranalysis.RR86‐13.Princeton,N.J.:EducationalTestingService.
74. Kingston,N.M.andHolland,P.W.(1986).AlternativemethodsofequatingtheGREGeneralTest.GREBoardProfessionalReport81‐16P.Princeton,N.J.:EducationalTestingService.
75. Kingston,N.M.,Leary,L.F.,andWightman,L.E.(1985).AnexploratorystudyoftheapplicabilityofitemresponsetheorymethodstotheGraduateManagementAdmissionTest.RR85‐34.Princeton,N.J.:EducationalTestingService.
76. Kingston,N.M.andTurner,N.J.(1984).AnalysisofscorechangepatternsofexamineesrepeatingtheGraduateRecordExaminationsGeneralTest.GREBoardProfessionalReport83‐5P.Princeton,N.J.:EducationalTestingService.
77. Kingston,N.M.(1984).ReanalysisofthepsychometriccharacteristicsoftheGREGeneralTest.Unpublishedmanuscript.Princeton,N.J.:EducationalTestingService.
78. Kingston,N.M.(1983).Choosingaprocedureforselectingasubsetofvariablesthatmaximizescriterion‐relatedcross‐validity.Unpublisheddoctoraldissertation.
79. Kingston,N.M.andDorans,N.J.(1982).ThefeasibilityofusingitemresponsetheoryasapsychometricmodelfortheGREAptitudeTest.GREBoardProfessionalReport79‐12P.Princeton,N.J.:EducationalTestingService.
80. Kingston,N.M.andDorans,N.J.(1982).Theeffectofthepositionofanitemwithinatestonitemrespondingbehavior:ananalysisbasedonitemresponsetheory.GREBoardProfessionalReport79‐12bP.Princeton,N.J.:EducationalTestingService.
81. Kingston,N.M.andLivingston,S.A.(1981).EffectivenessoftheGraduateRecordExaminationsforpredictingfirstyeargrades:1979‐80summaryreportoftheGraduateRecordExaminationsValidityStudyService.Princeton,N.J.:EducationalTestingService.
PeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewedPeerreviewed
Page 11
Neal Kingston CV 11
B. ScholarlyPresentations
MajorPresentations*indicatesstudentwithwhomIhavecollaborated82. Kingston,N.M.(October2015)StayFound:HowMapscanImproveOutcomesin
Education.PresentationatKUElevate,OverlandPark,KS.83. Kingston,N.M.,Broaddus,A.,&Gaylor,C.(August2015).Shifting the Paradigm of
Achievement Assessment or Help!; I’m Lost; Does Anyone Have a Map? Paper presented at the 2015 CRESST Conference, Redondo Beach, CA.
84. Clark,A.,Karvonen,M.,Kingston,N.M.,&*Anderson,G.(April2015).Designing Alternate Assessment Score Reports that Maximize Instructional Impact.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
85. Kingston,N.M.(April2015).StandardSettingandGrowthMeasurementinaLearningMapsEnvironment.Presentedaspartofthesymposium,PsychometricsinaLearningMapsEnvironment,attheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
86. Popham,J.,Kingston,N.M.,Fremer,J.,&Way.D.(April2015).Theimportanceofinstructionalsensitivity:AcolloquyAmongCombatants.DebateattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
87. *Loughran,J.&Kingston,N.M.(April2015).DIFDetectionandPredictionwithDifferentFocalGroupDesignations.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Chicago,IL.
88. Wells‐Moreaux,S.,Karvonen,M.,&Kingston,N.M.(April2015).AccessibilitybyDesign:ImprovingAlternateAssessmentsforStudentswithSignificantCognitiveDisabilities.PaperpresentedattheannualmeetingoftheCouncilforExceptionalChildren,SanDiego,CA.
89. Kingston,N.M.&Broaddus,A.(March2015).LearningMapsastheBasisforEducationalAssessment.PaperpresentedattheannualmeetingoftheAssociationofTestPublishers,RanchoMirage,CA.
90. Kingston,N.M.(March2015).SecurityattheForefront.InvitedSpeakerattheannualmeetingoftheAssociationofTestPublishers,RanchoMirage,CA.
91. Kingston,N.M.(January2015).TheDynamicLearningMapsAlternateAssessmentSystem.PaperpresentedattheannualmeetingoftheNationalAssociationofPrivateSpecialEducationCenters,NewOrleans,LA.
92. *Tiemann,G.C.,Miller,H.,Kingston,N.M.,&Foster,D.(October2014).ProtectingItemContentviatheDiscrete‐OptionMultiple‐ChoiceItemType.PaperpresentedattheannualmeetingoftheConferenceonTestSecurity,IowaCity,IA.
93. Kingston,N.M;Clark,A.K.,Pardos,Z;Lee,S.Y.(April2014).Determiningareasonablestartingplaceforaninstructionallyembeddeddynamicassessment:HeuristicversusBayesianNetworkAnalysis.PaperpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
94. Clark,A.K.&Kingston,N.M.(April2014).Comparisonofattributecodingproceduresforretrofittingcognitivediagnosticmodels.PosterpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
95. Zhao,F.&Kingston,N.M.(April2014).CognitiveDiagnosticModelComparisonsUsingEmpiricalData.PaperpresentedattheannualmeetingoftheNationalCouncilforMeasurementinEducation,Philadelphia,PA.
Page 12
Neal Kingston CV 12
96. Wang,W.&Kingston,N.M.,MichaelF.Hock;GailC.Tiemann;MarciaH.Davis;StephenM.Tonks(April2014).ApplicationoftheHierarchicalItemResponseModeltoaComputerAdaptiveTestofGradedResponseData.PaperpresentedattheannualmeetingoftheAmericanEducationalResearchAssociation,Philadelphia,PA.
97. Chen,J.,Kingston,N.,Wang,X.,Richards,C.,&Meisner,R.(April,2014).Featuresofessayresponsesassociatedwiththeaccuracyofhumanscoring.Paperpresentedatthe76thAnnualMeetingofNationalCouncilonMeasurementinEducation,Philadelphia,PA.
98. Chen,J.&Kingston,N.M.(November2013).AComparisonofEmpiricalandJudgmentalApproachesforDetectingInstructionallySensitiveItems.PaperpresentedattheConferenceonInstructionalSensitivity,Lawrence,KS.
99. Longabach,T.,Chen,J.&Kingston,N.M.(November2013).Relationshipbetweentestitemcognitivecomplexity,content,andinstructionalsensitivity.PaperpresentedattheConferenceonInstructionalSensitivity,Lawrence,KS.
100. Kingston,N.M.(October2013).DevelopmentofanAssessmentforStudentswithSignificantCognitiveDisabilitiesBasedonaVeryLarge,FineGrainedLearningMap.Paperpresentedatthe2013meetingoftheInternationalAssociationforEducationalAssessment,TelAviv,Israel.
101. *Tiemann,G.C.&Kingston,N.M.(2013).Answerchangingandresponsetimeoncomputer‐basedhighstakesachievementtests.Posterpresentedatthe2013ConferenceontheStatisticalDetectionofPotentialTestFraud,Madison,WI.
102. Kingston,N.M.&Nitsch,C.(2013)Howintheworldcananalternateassessmentmeettheneedsofstudentsandparents?Invitedpresentationatthe2013ArcNationalConvention,Seattle,WA.
103. Kingston,N.M.(2013).LearningModelsandLearningAnalytics.Presentedaspartofthesymposium,“It’snotjustforonlineshopping:Usinganalyticsforimprovedlearningandachievement.Invitedpresentationatthe2013OSEPProjectDirectorsMeeting.
104. Davis,M.H.,Tonks,S.M.,Hock,M.F.,Kingston,N.M.,*Tiemann,G.C.&Wang,W.MeasurementofAdolescentReadingMotivation.Posterpresentedatthe2013meetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.
105. Davis,M.H.,Tonks,S.M.,Hock,M.F.,Kingston,N.M.,*Tiemann,G.C.&Wang,W.MeasuringSocialReadingMotivationinAdolescents.(2013).Paperpresentedatthe2013meetingoftheAmericanEducationalResearchAssociation,SanFrancisco,CA.
106. Kingston,N.M.(2013).TheAlternateAssessmentConsortiaforStudentswithSignificantCognitiveDisabilities:ProgresstoDate‐PART2.Paperpresentedatthe2013meetingoftheCouncilforExceptionalChildren,SanAntonio,TX.
107. *Wang,W.andKingston,N.M.(2012).Areallitemresponsefunctionsmonotonicallyincreasing?Posterpresentedatthe2012meetingoftheAmericanPsychologicalAssociation,Orlando,FL.
108. Kingston,N.M.and*Tiemann,G.C.(2012).AnExplorationofAnswer‐ChangingonaComputer‐basedHigh‐StakesAchievementTest:ItemView.PaperpresentedattheJointStatisticalMeeting,SanDiego,CA.
109. *Tiemann,G.C.andKingston,N.M.(2012).AnExplorationofAnswer‐ChangingonaComputer‐basedHigh‐StakesAchievementTest.PaperpresentedattheConferenceonthestatisticaldetectionofpotentialtestfraud,Lawrence,KS.
110. *Anderson,G.andKingston,NM.(2012).ProvidingUsefulInformationtoGuideStudentLearning:AReviewofStateLevelIndividualStudentReports.Paper
Page 13
Neal Kingston CV 13
presentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
111. *Chen,J.,Kingston,N.M.(2012).AComparisonofMantel‐HaenszelTestsandLogisticRegressionforDetectingInstructionallySensitiveItems.Posterpresentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
112. *Zhao,F.,*Wang,W.,&Kingston,N.M.(2012).OntheUseofNonparametricIRTTechniquesforChecking3PLIRTModelFit.Paperpresentedatthe2012AnnualConventionoftheNationalCouncilonMeasurementinEducation(NCME),Vancouver,Canada.
113. *Zheng,C.,Erickson,A.G.,Kingston,N.,&Noonan,P.(April2012).CanSelf‐DeterminationPredictAcademicAchievementforStudentswithDisabilities?PaperpresentedatAmericanEducationalResearchAssociation,Vancouver,Canada.
114. *Zheng,C.,Erickson,A.G.,Kingston,N.,&Noonan,P.(April2012).PsychometricAnalysisoftheArc’sSelf‐DeterminationScaleforStudentswithDisabilities.PaperpresentedatNationalCouncilonMeasurementinEducation,Vancouver,Canada.
115. Cho,H.&Kingston,N.M.(April2012).UnderstandingAlternateAssessmentMisassignmentandHowtoPreventIt.PaperpresentedattheannualmeetingoftheCouncilforExceptionalChildren,Denver,CO.
116. Cho,H.J.,&Kingston,N.(April,2012).ExaminingtheeffectivenessoftestaccommodationusingDIFandamixtureIRTModel.PaperpresentedtoannualmeetingoftheAmericanEducationResearchAssociation:Vancouver,Canada.
117. Templin,J.,Kingston,N.M.,&*Wang,W.(October2011).PsychometricIssuesinFormativeAssessment:MeasuringStudentLearningThroughouttheAcademicYearUsingInterimAssessments.PaperpresentedattheMarylandAssessmentConference,CollegePark,MD.
118. Kingston,N.M.,*Wang,W.,*Broaddus,A.,&Kramer,L.(August2011).KansasInterimAssessmentValidityEvidenceBasedontheRelationshipbetweenInterimandSummativeAssessmentScores.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
119. *Broadus,A.,Kingston,N.M.,&Kramer,L.(August2011).ValidityEvidenceBasedontheConsequencesofInterimAssessments.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
120. Kramer,L.Kingston,N.M.,&*Broadus,A.,(August2011)ValidityEvidenceBasedonInterimAssessmentContent.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
121. *Wang,W.,McKinley,R.,Kingston,N.M.,&*Broaddus,A.(August2011).ValidityEvidenceBasedontheInternalStructureofanInterimAssessment.PaperpresentedattheannualmeetingoftheAmericanPsychologicalAssociation,Washington,DC.
122. Kingston,N.M.(August2011).AlignmentofCommonCoreStandardsandAlternateAssessmentsforStudentswiththeMostSignificantCognitiveDisabilities.OfficeofSpecialEducationProgramsLeadershipMegaConference,Alexandria,VA.
123. Kingston,N.M.(June2011).PreparingALLStudentsforlife,work,andcitizenship:Thenextgenerationofalternateassessments.OfficeofSpecialEducationProgramsProjectDirectors’Conference,Washington,DC.
124. Kingston,N.M.(June2011).PreparingALLStudentsforlife,work,andcitizenship:Thenextgenerationofalternateassessments.NationalConferenceonStudentAssessment,Orlando,FL.
Page 14
Neal Kingston CV 14
125. Cho,H.J.&Kingston,N.M.(April2011).CapturingImplicitPolicyfromNCLBTestTypeAssignments.AnnualmeetingoftheCouncilforExceptionalChildren.Washington,DC.
126. *Zhao,F.&Kingston,N.M.(April2011).TheEffectsofPhonologicalAwarenessonBilingual/ESLStudents'EarlyLiteracyDevelopment.AnnualmeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.
127. *Anderson,G.&Kingston,N.M.(April2011).TheEfficacyofUsingStateStandards‐BasedAssessmentsforPredictingStudentSuccessinCommunityCollegeClasses.AnnualmeetingoftheNationalCouncilonMeasurementinEducation,NewOrleans,LA.
128. *Kim,M.&Kingston,N.M.(April2011).TheEfficacyofCurriculum‐basedmeasurement:AMeta‐Analysis.AnnualmeetingoftheAmericanEducationalResearchAssociation,NewOrleans,LA.
129. *Chiu,P.,Irwin,P.,&Kingston,N.M.(May2010).HowMuchTimedoesaTest‐TakerTakeifaTest‐TakerdoesTakeTime?NationalCouncilonMeasurementinEducation,Denver,CO.
130. Wolkowitz,A.Templin,J.&Kingston,N.M.(May2010).AnAnalysisoftheTimeandDayoftheWeekthatStudentsPerformBestonAssessments.NationalCouncilonMeasurementinEducation,Denver,CO.
131. *Gu,F.Little,T.,Kingston,NM.(May2010)CoefficientAlphaandStructuralEquationModelingBasedReliabilityEstimatesundertheViolationofEssentialTau‐EquivalenceandUncorrelatedErrors:ASimulationStudy.AmericanEducationalResearchAssociation,Denver,CO.
132. Kingston,N.M.,Foster,D.,Miller,H.L.,&*Tiemann,G.(February2010).BuildingaBetterMousetrap:UsingDiscreteOptionstoImprovetheMultiple‐ChoiceQuestion.AssociationofTestPublishers.
133. Kingston,N.M.(June2009).Large‐ScaleFormativeAssessment:Panacea,TransitionalTool,orOxymoron.39thannualNationalConferenceonStudentAssessment,LosAngeles,CA.
134. Kingston,N.M.and*Nash,B.(April2009).TheEfficacyofFormativeAssessment:AMeta‐Analysis.AmericanEducationalResearchAssociation,SanDiego,CA.
135. Kingston,N.M.and*Zhao,F.(April2009).WhatHaveWeLearnedabouttheStructureofLearningfrom30YearsofResearchonIntegratedCognitive‐PsychometricModels?NotMuch.NationalCouncilonMeasurementinEducation,SanDiego,CA.
136. Kingston,N.M.(April2007).ComparabilityofComputer‐andPaper‐AdministeredMultiple‐ChoiceTestsforK‐12Populations:ASynthesisof89Studies.NationalCouncilonMeasurementinEducation,Chicago,IL.
137. Kingston,N.M.(2005).Hottopicsintesting.CASMA‐ACTInvitationalConference,IowaCity,IA.
138. Kingston,N.M.(2004).Alternativeapproachestotheimplementationofcomputerizedstatewideaccountabilitytestingsystems.34thannualLarge‐ScaleAssessmentConferenceoftheChiefCouncilofStateSchoolOfficers,Boston,MA.
139. Kingston,N.M.(2003).K‐12computer‐basedtesting:isthereaplacefordataintheimplementationdecision‐makingprocess?33rdannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,SanAntonio,TX.
140. Kingston,N.M.andEhringhaus,M.(2002).Thefutureofuniversaldesign(orsinceitisalreadytomorrowwhycan’tweuseyesterday’stechnologyyet?).Gallaudet
Page 15
Neal Kingston CV 15
ResearchInstituteConference–HighStakesTesting:AreDeafandHardofHearingStudentsBeingLeftBehind?Washington,DC.
141. Kingston,N.M.(2002).Itemreview101:reviewingitemsandtestsfrommultipleperspectives.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
142. Kingston,N.M.(2002).Comparabilityofscoresfromcomputer‐andpaper‐basedadministrationsforstudentsingradesK‐12.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
143. Kingston,N.M.(2002).GeorgiaCRCT:Thelargest,mostcomprehensiveK‐12web‐basedtestingsystemgoesoperational.32ndannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,PalmDesert,CA.
144. Dings,J.,Childs,R.,andKingston,N.M.(2002).Effectsofmatrixsamplingonstudentscorecomparabilityinconstructedresponseandmultiple‐choiceassessments.NationalCouncilforMeasurementinEducation,Seattle,WA.
145. Kingston,N.M.(2001).Evaluatingthevalidityanddefensibilityofthebodyofworkstandardsettingprocedure.31stannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,Houston,TX.
146. Kingston,N.M.(2001).Implicationsofmatrixsamplingforstatetestingprograms.31stannualLarge‐ScaleAssessmentConferenceoftheCouncilofChiefStateSchoolOfficers,Houston,TX.
147. Kingston,N.M.,(2000).Dodgingbullets:minimizingtheprobabilityofanalysisandreportingproblems.30thannualLarge‐ScaleAssessmentConference,Snowbird,UT.
148. Kingston,N.M.,(2000).Combiningmultiplesourcesofinformationinthesettingofperformancestandards.30thannualLarge‐ScaleAssessmentConference,Snowbird,UT.
149. Kingston,N.M.(2000).Accountabilitythroughschoolreportcards:effortsofseveralstates.30thannualLarge‐ScaleAssessmentconference,Snowbird,UT.
150. Kingston,N.M.,(2000),Bodyofworkstandardsettingmethod:MassachusettsComprehensiveAssessmentSystem.NationalCouncilonMeasurementinEducationAnnualMeeting,NewOrleans,LA.
151. Sweeney,K.,Kahl,S.R.,Kingston,N.M.,Bay,L.(2000)ClassroomTeacherJudgmentandBodyofWorkMethod:WyomingComprehensiveAssessmentSystem(WyCAS).AnnualmeetingoftheAmericanResearchAssociation,NewOrleans,LA.
152. Kingston,N.M.andNellhaus,J.(1999).Standard‐settingfortheMassachusettsComprehensiveAssessmentSystem:thebodyofworkmethod.29thannualLarge‐ScaleAssessmentconference,Snowbird,UT.
153. Kingston,N.M.(1998).Developmentofaprototypeofacomputerizedaccommodationsversionofastandards‐basedassessment.28thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
154. Kingston,N.M.(1998).Assessingadequateyearlyprogressinastandards‐basedcomprehensivetestingenvironment:holygrailorholyterror.28thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
155. Kingston,N.M.(1997).Scoringstudentresponsesthroughimaging:Evidencethatnewtechnologywillsolveamajorconcernofperformanceassessment.27thannualLarge‐ScaleAssessmentConference,ColoradoSprings,CO.
156. Kingston,N.M.(1996).Respondingtocriticismsofperformanceassessment.CouncilofChiefStateSchoolOfficers26thannualLarge‐ScaleAssessmentConference,Phoenix,AZ.
Page 16
Neal Kingston CV 16
157. Dings,J.andKingston,N.M.(1996).Effectsofstudentsandtasksongainscoresusedincomplexschoolaccountabilitydecisions.NationalCouncilforMeasurementandEvaluation,NewYork,NY.
158. Kingston,N.M.andDings,J.(1995).Estimatingtheaccuracyofcomplexschoolaccountabilitydecisions.Symposium:Performanceassessment:therhetoricmeetsthereality(andtheyarebothdoingquitefine,thankyou).NationalCouncilforMeasurementandEvaluation,SanFrancisco,CA.
159. Kehoe,J.F.,Kingston,N.M.,andMcCormick,D.J.(1993).Practicalconsiderationsforlow‐costcomputerizedtesting.Symposium:Computerandmultimediatestingfornewskillsandabilities:Practicalissues.SocietyforIndustrialandOrganizationalPsychology,SanFrancisco,CA.
160. Kingston,N.M.(1993).Increasingopportunityviatechnology‐basedtesting.Symposium:Assessment,diversity,andAmerica2000.AmericanCounselingSociety,Atlanta,GA.
161. Kingston,N.M.(1989).Aninvestigationoftwotypesofselectioneffectsonvaliditycoefficients.Symposium:Alternativeapproachestoproblemsinvolvedinthevalidationofhighereducationadmissiontests.NationalCouncilonMeasurementinEducation,SanFrancisco,CA.
162. Kingston,N.M.,Schneider,L.M.,andBriel,J.B.(1988).OvercomingstatisticaldifficultiesincomparingthepredictiveaccuracyoftheGREGeneralTestandundergraduategradesforsubgroupsbasedongenderandethnicity.Symposium:Solvingperennialmethodologicalproblemsinvalidityresearch.AmericanPsychologicalAssociation,Atlanta,GA.
163. Kingston,N.M.(1988).UsinganEnglishlanguagegraduateadmissionstestfornon‐nativespeakersofEnglish:perilsandpitfalls.NationalAssociationforForeignStudentAffairs,Washington,DC.
164. Kingston,N.M.(1988).UseofGREscoresandtheundergraduategrade‐pointaveragetopredictgraduateschoolsuccess.AmericanAssociationofCollegiateRegistrarsandAdmissionsOfficers,Nashville,TN.
165. Kingston,N.M.andMcKinley,R.L.(1988).AssessingthestructureoftheGREGeneralTestusingconfirmatorymultidimensionalitemresponsetheory.Symposium:Itemresponsetheorymeetsmultidimensionaltests.AmericanEducationalResearchAssociation,NewOrleans,LA.
166. McKinley,R.L.andKingston,N.M.(1988).ConfirmatoryanalysisofteststructureusingmultidimensionalIRT.NationalCouncilonMeasurementinEducation,NewOrleans,LA.
167. Kingston,N.M.andStocking,M.L.(1986).PsychometricissuesforIRT‐basedtestconstruction.Symposium:Itemresponsetheorybasedtestdevelopment.AmericanPsychologicalAssociation,Washington,DC.
168. Kingston,N.M.,Durso,R.V.,andSchneider,L.M.(1986).TheGraduateRecordExam‐inationsValidityStudyService:yesterdayandtomorrow.Symposium:Designingavalidityresearchservice.NationalCouncilonMeasurementinEducation,SanFrancisco,CA.
169. Kingston,N.M.(1985).ComparisonofbiasandrootmeansquarederrorforfourvariantsofIRTtruescoreequating.FourthEuropeanMeetingofthePsychometricSociety,Cambridge,England.
Page 17
Neal Kingston CV 17
170. Kingston,N.M.(1985).Assessingguessingbehaviorusingthethree‐parameterlogisticmodel.Symposium:Dynamicsofguessingbehavior:methodologicalapproaches.NationalCouncilonMeasurementinEducation,Chicago,IL.
171. Kingston,N.M.(1985).TheincrementalvalidityoftheGREanalyticalmeasureforvariousdepartmenttypes.Symposium:TheGREAnalyticalTest:Newmeasureforgraduateschooldecisionmaking.AmericanEducationalResearchAssociation,Chicago,IL.
172. Kingston,N.M.(1984).Analysisofshiftsinscaleandconstructthroughtheuseofrepeaterdata.AmericanEducationalResearchAssociation,NewOrleans,LA.
173. Kingston,N.M.andDorans,N.J.(1983).AssessinglocalindependenceforIRT:factoranalysisofitemintercorrelationsafterpartialingoutestimatedtheta.PsychometricSociety,LosAngeles,CA.
174. Kingston,N.M.andDorans,N.J.(1982).EquatingofGREAptitudeTestscoresusingitemresponsetheory:theeffectofmultidimensionality.Symposium:RecentdevelopmentsinequatingatETS.AmericanPsychologicalAssociation,Washington,DC.
175. Dorans,N.J.andKingston,N.M.(1982).Implicationsofitempoolfungibilityforinnovativetestingmodesandequatingmethods.Symposium:Topicsinitemresponsetheory.PsychometricSociety,Montreal.
176. Kingston,N.M.,Livingston,S.A.,andTurner,N.J.(1982).Predictingsuccessingraduateschool:189validitystudies.Symposium:Interpretingdatathrougheternallysmudgedglasses:thecontinuingsagaofgraduateandprofessionalschoolvalidationresearch.AmericanEducationalResearchAssociation,NewYork,NY.
177. Dorans,N.J.andKingston,N.M.(1981).AssessingthelocalindependenceassumptionofitemresponsetheoryinGREitemtypesandpopulations.PsychometricSociety,ChapelHill,NC.
178. Kingston,N.M.andDorans,N.J.(1981).Theeffectofthepositionofanitemwithinatestonitemrespondingbehavior:ananalysisbasedonitemresponsetheory.Symposium:Practiceeffects:problemsandsolutions.NationalCouncilonMeasurementinEducation,LosAngeles,CA.
179. Kingston,N.M.andDorans,N.J.(1981).Woulditbeadvantageoustousethethree‐parameterlogisticmodelasapsychometricbasefortheGREAptitudeTest?Symposium:Assessingthefeasibilityofusingitemresponsetheoryforoperationaltestingprograms.AmericanEducationalResearchAssociation,LosAngeles,CA.
180. Kingston,N.M.andWhite,E.B.(1980).Itemresponsetheorystatistics,classicaltestanditemstatistics:whatdoesitallmeanwhenyousitdowntoconstructatest?AmericanEducationalResearchAssociation,Boston,MA.
SelectedMinorPresentations
181. Kingston,N.M.(2013)ToolsforEfficientlyEnhancingtheValidityofInferencesBasedonTestScores:LearningMapsandTechnologyEnhancedItemEditors.EducationalTestingService,Princeton,NJ.
182. *Beals‐Erickson,S.&Kingston,N.M.OriginalandAdaptedDialecticalBehaviorTherapyforAdultsversusAdolescents:AMeta‐Analysis.(2012).Paperpresentedatthe2012meetingoftheNationalConferenceonClinicalChildandAdolescentPsychology,Lawrence,KS.
Page 18
Neal Kingston CV 18
183. Kingston,N.M.(2009).Formative,SchmormativeorIjustwanttohelpmystudentslearn(andmaybedobetteronthosedarnstatetests).KansasFallAssessmentConference.
184. Kingston,N.M.(2009).TheRoleofaSharedItemBankintheRe‐inventionoftheModifiedAssessmentinKansas.KansasFallAssessmentConference.
185. Kingston,N.M.(2009).Interimassessmentasanintegralpartofastateassessmentprogram.KansasFallAssessmentConference.
186. Kingston,N.M.(2008).TheAnatomyofaScoring:AForensicAnalysisoftheGradingofanOpen‐EndedTestItem.KingFahdUniversityofPetroleumandMinerals,Dharhan,SaudiArabia.
187. Kingston,N.M.(2008).AdvancesinFormativeAssessment:ABriefBackground.38thannualNationalConferenceonStudentAssessment,Orlando,FL
188. Kingston,N.M.(2008).ConsiderationsfortheDevelopmentandUseofOpen‐EndedTestItems,KingFahdUniversityofPetroleumandMinerals,Dharhan,SaudiArabia.
C. Grantsand/orotherFundedProjects
ExternalFunding
1.FundedProposals(61grantsvaluedat$112.7millionasPIorCo‐PIfrom2009to
present)1. Perie,M.,Kingston,N.M.andKarvonen,M.(Co‐PI).Alaska
MeasuresProgressScienceandScienceAlternateAssessments,AlaskaDepartmentofEducation(2015‐2016,$1,181,802)
2. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessmentforNewYorkState.NewYorkState.(2015‐2020,$13,120,000).
3. Kingston,N.M.(P.I.)andBroaddus,A.UseofLearningMapsasanOrganizingStructureforFormativeAssessment.UnitedStatesDepartmentofEducation(EnhancedAssessmentGrantProgram)(2015‐2019,$5,677,983).
4. KingstonN.M.(P.I.)andKarvonen,M.DesignandDevelopmentofaDynamicLearningMapsAssessment‐SocialStudies,OklahomaStateDepartmentofEducation(2015‐2016,$1,548,534)
5. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.UtahOfficeofStateEducation.(2015‐2020,$2,707,036).
6. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.ColoradoDepartmentofEducation.(2015,$102,760).
7. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.WestVirginiaDepartmentofEducation.(2015‐2016,$224,328).
8. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.NewJerseyDepartmentofEducation.(2015,$206,620).
SoleSourceCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Page 19
Neal Kingston CV 19
9. KingstonN.M.(P.I.)andKarvonen,M.DynamicLearningMapsAlternateAssessment.IllinoisStateBoardofEducation.(2015,$239,240).
10. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,StateofMississippi(2014‐2015,$73,200)
11. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,StateofVermont(2014‐2015,$8,000)
12. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessment,ChoctawTribalSchools(2014‐2015,$2,917)
13. Kingston,N.M.(PI).ImplementationofaDynamicLearningMapsAlternateAssessmentMiccosukeeTribalSchools(2014‐2015,$2,293)
14. Kingston,N.M.(PI).Developmentofalearningmapprototypecompletewithenhancedlearningprogressionsandvisualizations.GatesFoundation(2014‐15,$212,022)
15. Perie,M.andKingston,N.M.(Co‐PI).AlaskaEnglishLanguageArtsandMathematicsAssessments,StateofAlaska(2014‐2020,$25,000,000)
16. Kingston,N.M.(PI)andPerie,M.PsychometricservicesforArizonaDepartmentofEducation,ArizonaDepartmentofEducation(2014‐15,$107,190)
17. Perie,M.andKingston,N.M.(Co‐PI).KansasAssessmentProgram2014‐15,KansasStateDepartmentofEducation(2014‐2015,$5,500,000)
18. Perie,M.andKingston,N.M.(Co‐PI).KansasAssessmentProgramSpecialEducation2014‐15,KansasStateDepartmentofEducation(2014‐2015,$2,000,000)
19. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VirginiaDepartmentofEducation(2014‐2015,$20,000)
20. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,AlaskaDepartmentofEducation(2014‐2015,$15,460)
21. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofNewHampshire(2014‐2015,$16,667)
22. Perie,M.andKingston,N.M.(Co‐PI).DynamicLearningMaps–Science,KansasStateDepartmentofEducation(2014‐2015,$500,000)
23. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,NorthDakotaDepartmentofPublicInstruction(2014‐2015,$11,840)
24. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofWisconsin(2014‐2015,$152,920)
CompetitiveSoleSourceSoleSourceSoleSourceInvitationalandCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Page 20
Neal Kingston CV 20
25. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessmentSystem,Lancaster,PA(2014‐2015,$30,000)
26. Perie,M.andKingston,N.M.(Co‐PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,KansasStateDepartmentofEducation(2014‐2015,$250,000)
27. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofIowa(2014‐2015,$547,040)
28. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment‐Science,OklahomaStateDepartmentofEducation(2014‐2015,$610,000)
29. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,OklahomaStateDepartmentofEducation(2014‐2015,$200,000)
30. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofMissouri(2014‐2015,$687,250)
31. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAssessment,ColoradoDepartmentofEducation(2014‐2015,$20,000)
32. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,IllinoisStateBoardofEducation(2013‐2018,$50,000)
33. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,NorthDakotaDepartmentofPublicInstruction(2013‐2015,$48,333)
34. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,AlaskaDepartmentofEducation(2013‐2015,$45,000)
35. Kingston,N.M.(PI)andPerie,M.KansasAssessmentProgram2013‐14,KansasStateDepartmentofEducation(2013‐2014,$4,620,000).
36. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningsMapsAlternateAssessment,ColoradoDepartmentofEducation(2013‐2014,$16,668)
37. Kingston,N.M.(PI).cPass,MississippiDepartmentofEducation(2013‐2014,$42,000)
38. Perie,Marianne(PI),Kingston,N.M.(Co‐PI).TeacherLeadership,KansasStateDepartmentofEducation(2013‐2014,$47,835)
39. Perie,Marianne(PI),Kingston,N.M.(Co‐PI).CareerCompetencyQualification,KansasDepartmentofEducation(2013,$125,000)
40. Kingston,N.M.(PI).ColoradoPerformanceTasks,ColoradoDepartmentofHigherEducation(2013,$56,695)
SoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoulSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSource
Page 21
Neal Kingston CV 21
41. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VermontDepartmentofEducation(2012‐2014,$34,000)
42. Kingston,N.M.(PI).KansasAssessmentProgram2012‐13TAC,KansasStateDepartmentofEducation(2012‐2013,$70,000)
43. Kingston,N.M.(PI).KansasAssessmentProgram2012‐13KansasStateDepartmentofEducation(2012‐2013,$90,000)
44. Kingston,N.M.(PI).KansasAssessmentProgram,KansasStateDepartmentofEducation(2012‐2013,$4,500,000)
45. Kingston,N.M.(PI).cPass,ColoradoDepartmentofEducation.(2012‐2014,$300,000)
46. Kingston,N.M.(PI).cPass,MississippiDepartmentofEducation.(2012‐2013,$42,000)
47. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,VirginiaDepartmentofEducation(2012‐2013,$51,310)
48. Kingston,N.M.(PI).KansasAssessmentProgram,KansasStateDepartmentofEducation(2011‐2013,$4,325,829)
49. Kingston,N.M.(PI).KansasCareerandTechnicalEducationAssessmentSystem.KansasStateDepartmentofEducation(2011‐2014,$987,460)
50. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment,StateofWashingtonOfficeofSuperintendent(2011‐2014,$75,000)
51. Hock,M.,Kingston,N.M.(Co‐PI),Davis,M.,Tonks,S.&Brasseur,I.,DevelopmentandValidationofOnlineAdaptiveReadingMotivationMeasures,Re‐submitted2010IES,(Co‐PI)(2011‐14,$1,738,808)
52. Kingston,N.M.(PI).DesignandDevelopmentofaDynamicLearningMapsAlternateAssessment.SubmittedJuly2010OSEP,(2010‐2015,$24,875,111requested)Fundedfor$25,026,112
53. Embretsen,S.,Walker,B.,Poggio,J.,Kingston,N.M.(Co‐PI),&Meyen,E.AnAdaptiveTestingSystemforDiagnosingSourcesofMathematicsDifficulties.Submitted2010IES,(2010‐2013,$1,854,393)
54. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2010‐11(GeneralandKAMMAssessments).Submitted2010KansasStateDepartmentofEducation,(2010‐2012$2,270,992)
55. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2010‐11(AlternateAssessment,KELPA,andSpecialProjects)Submitted2010KansasStateDepartmentofEducation.(2010‐2012,$1,358,000)
56. Kingston,N.M.(PI).AlternateAssessmentDesignReadingProject.Submitted2010KansasStateDepartmentofEducation(2010‐2011,EAGpass‐through,$127,200)
SoleSourceSoleSourceSoleSourceSoleSourceSoleSourceSoleSourceCompetitiveCompetitiveCompetitiveCompetitiveSoleSourceSoleSourceSoleSourceSoleSourceSolesourceSoleSourceSoleSource
Page 22
Neal Kingston CV 22
57. Kingston,N.M.(PI).KansasFocalPointAssessments.KansasStateDepartmentofEducation(2010‐11,$54,364)
58. Kingston,N.M.(PI).GMATTechnicalManualDevelopment.Submitted2009GraduateManagementAdmissionsCouncil.(2010,$23,661)
59. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2009‐10(GeneralandKAMMAssessments).Submitted2009KansasStateDepartmentofEducation,(2009‐2011$2,420,000)
60. Kingston,N.M.(PI).KansasReadingandMathematicsAssessments,FY2009‐10(AlternateAssessment,KELPA,andSpecialProjects).Submitted2009KansasStateDepartmentofEducation.(2009‐2011,$1,352,500)
61. Kingston,N.M.(PI).ResearchontheFoster(DOMC)ItemType.Submitted2009BrighamYoungUniversity.(2009‐2010,$2,500)
62. Kingston,N.M.(PI)&McKinley,R.CombiningmultipleIRTparameterestimates,EducationalTestingService
63. Kingston,N.M.(PI),McKinley,R,&Schaeffer,G.ExploringtheUseofIRTEquatingfortheGRESubjectTestinMathematics,GraduateRecordExaminationsBoard
64. Kingston,N.M.(PI).EstimatingEquatingFunctionsonStandardizedTestPopulations,EducationalTestingService
65. Kingston,N.M.(PI),Leary,L.&Wightman,L.AnExploratoryStudyoftheApplicabilityofItemResponseTheorytotheGraduateManagementAdmissionsTest,GraduateManagementAdmissionsCouncil
66. Kingston,N.M.(PI).EvaluationoftheRestructuredGraduateRecordExaminationsGeneralTest:AnalysisofScoreChangePatternsforRepeaters,GraduateRecordExaminationsBoard
67. Kingston,N.M.(PI)andDorans,N.J.FeasibilityofusingItemResponseTheoryasaPsychometricBasisfortheGraduateRecordExaminationsAptitudeTest,GraduateRecordExaminationsBoard
SoleSourceCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitive
2.ProposalsunderReview68. Templin,J.T.,Bradshaw,L.,andKingston,N.M.(SeniorStaff).
EvolvingLearningMaps:StatisticalMethodstoImproveDynamicMap‐BasedPsychometrics.SubmittedtoIESAugust2014(2015‐2017,$899,883).
69. Huan,J.,Hill,M.,Kingston,N.M.(Co‐PI),Davis,R.,Vadlani,P.EstablishingaGraduateTrainingProgramSupportingDataEnabledAnalysisandOptimizationoftheFood‐Energy‐WaterNexus.SubmittedtoNSF(2016‐2020,$2,971,449).
CompetitiveCompetitive
Page 23
Neal Kingston CV 23
3.ProposalsSubmitted,NotFunded70. Perie, M. & Kingston, N.M. (Co-PI) Development and
Implementation of the Connecticut Mastery Test (CMT) and Connecticut Academic Performance Test (CAPT) in Science (2015-2020, $3,998,063).
71. Kingston,N.M.(PI).METAMath:SearchingwithMETAcognitiveAwarenessinMathematics.SubmittedtoNSF(2015‐2019,$197,080)
72. Kingston,N.M.(PI,KUSubcontracttoTexasChristianUniversity)METAMath:SearchingwithMETAcognitiveAwarenessinMathematics.SubmittedtoIESSeptember2014(2015‐2018,$124,372).
73. Huan,J.,Alexander,W.P.,Blumenstiel,J.P.,Ginther,D.K.,&Kuzuczera,K.Kingston,N.M.(SeniorStaff).K‐DEESE:EstablishinganInterdisciplinaryDataEnabledScienceandEngineeringTrainingProgramattheUniversityofKansas.SubmittedtoNSFJuly2014(2015‐20,$2,917,932).
74. Kingston,N.M.(PI),Cho,H.J.(Co‐PI),andDeci,E.(Co‐PI)RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.Re‐submittedtoIESJune2012(2012‐15,$961,719)
75. Kingston,N.M.(PI)andChen,J.(Co‐PI)FactorsInfluencingInstructionalSensitivity.SubmittedSeptember2012IES(2013‐2015,$669,675).
76. Kingston,N.M.(PI),Cho,H.J.andWalsh,T.J.(Co‐PI)CapturingExpertJudgmentstoHelpIEPTeamsmakeBetterAccountabilityTest.SubmittedtoIESSeptember2012(2013‐2015,$1,253,971).
77. Thomas,K.(PI),Broaddus,A.(Co‐PI),andKingston,NM(Co‐PI)UsingCognitiveModelstoInterpretStudentReasoningandGuideMathematicsInstruction:InformingElementaryTeachers'PracticewithaMathematicsLearningMap.SubmittedtoIESSeptember2012(2013‐2015,$1,485,466).
78. Kingston,N.M.(PI,KUSubcontracttoUniversityofOregon)PathwaystoProficiency.SubmittedtoIESSeptember2012(2013‐2017,$300,000).
79. Kingston,N.M.(PI)andCho,H.J.RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.Re‐submittedJune2011IES(2012‐15,$924,208)
80. Kingston,N.M.(PI)ARDMSPsychometricServices.SubmittedSeptember2011toARDMS(2011‐2013,$54,962forCETEcomponent).
81. Kingston,N.M.(PI)andCho,H.J.RelationshipsofSelf‐DeterminationandSchoolEngagementonAcademicPerformanceScoresduringSecondarySchool.SubmittedSeptember2010IES(2011‐14,$573,789)
CompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitiveCompetitive
Page 24
Neal Kingston CV 24
82. Kingston,N.M.(PI)&Skorupski,W.P.(Co‐PI).CollaborativeResearch:BeyondDisciplines:ANationalCollaborationtoBuildCapacityforCross‐DisciplinaryConceptInventoryAssessmentandResearch,Submitted2011NSF(2011‐2015,$968,187)
83. Hock,M.,Kingston,N.M.(Co‐PI),Davis,M.,Tonks,S.&Brasseur,I.,DevelopmentandValidationofOnlineAdaptiveReadingMotivationMeasures,Submitted2009IES,(Co‐PI)Requested2010‐13($1,496,606)
84. Kingston,N.M.(PI)&Skorupski,W.P.TheDevelopment,Validation,andImplementationofIntegratedPsychometric‐CognitiveModelstoSupportBetterInstructionandProduceMoreUsefulTestScores.Submitted2007,IES.(2008‐2011,$760,892).Notfunded.
85. Kingston,N.M.(PI).IntegratingPsychometricandCognitiveModels‐AResearchSynthesis.Submitted2007,NSF.(2007‐2008,$96,994).Notfunded.
86. Ault,M.,Huffman,D.,Kingston,N.M.(Co‐PI),Friedman‐Nimz,R.,Tiemann,G.,Holvoet,J.,RubiStarDI:AssessmenttoSupportDifferentiatedInstructioninMiddleSchoolScience,Submitted2007,IEF.(2008‐2011,$499,274).Notfunded.
CompetitiveCompetitiveCompetitiveCompetitive
InternalFunding87. Kingston,N.M.(PI).Development,Validation,and
ImplementationofIntegratedPsychometricCurricularModelstoBetterSupportInstructionandProducemoreUsefulTestScores.Requested2007‐2009($5,000)
D. HonorsandAwardsforResearch
DistinguishedMentorfortheCommunityofInterestonCareerPaths:AcademiaorIndustry,AERADivisionD,January2011
SERVICERECORD
A. UniversityofKansasServiceActivity Role Dates Category2013StrategicInitiativeTheme(SIT)ResearchSummitPlanningCommitteeKansasUniversityCenterforResearchResearchInvestmentCouncilCRMDA/Assist/Assoc.ProfessorSearchCommitteeJudicialBoardQuantitativePsych.Assist.ProfessorSearchCommitteeQuantitativePsych.Assist.ProfessorSearch
MemberTrusteeMemberMemberMemberMemberMember
20132012‐20162012‐20152009‐20102008‐20102008‐20092007‐2008
University
Page 25
Neal Kingston CV 25
CommitteeAdHocAdvisoryCommitteeonStudentEvaluationofFaculty
Member
2006‐2007
ServiceAwardCommitteePersonnelCommitteeTechnologyCommitteeResearchinMeasurement,Statistics,andEvaluationAwardProgramAdHocCommitteeonTeacherPreparationGraduateStudiesCommitteeSchoolofEducationStrategicPlanningCommitteeCenterforPsychoeducationalServicesAdvisoryCouncil
MemberMemberMemberCo‐chairMemberMemberMemberMember
20132012‐20152011‐20142009‐present2008‐20092007‐20102007‐20092006‐2008
School
Research,Eval.,Measurement,&StatisticsTrackPsychologyandResearchinEducationTollefsonFellowshipCommitteePsychologyandResearchinEducationFacultyEvaluationCommitteeEduc.Psych.andRes.FacultySearchCommittee
CoordinatorInterimChairCo‐chairAssoc.ChairMemberMember
2010‐2011Fall20092008‐20122008‐201020082006‐2007
Department
B. ProfessionalServiceoutsidetheUniversityActivity Role DatesCCSSOStudentswithDisabilitiesAssessmentAdvisoryTaskForce
Member 2013
OnlineAssessmentCross‐ConsortiumTechnologyCollaborationGroup
Member 2013‐
GEDTechnicalAdvisoryCommittee Member 2008‐2015ConferenceonInstructionalSensitivity Chair 2014‐20152015ConferenceontheStatisticalDetectionofPotentialTestFraud
Chair
2014‐2015
InternationalAssociationforEducationalAssessment2015ConferenceCommittee
Chair 2013‐2015
2014ConferenceontheStatisticalDetectionofPotentialTestFraud
PlanningCom.
2013‐2014
2013ConferenceonInstructionalSensitivity Co‐chair 2012‐20132013ConferenceontheStatisticalDetectionofPotentialTestFraud
PlanningCom. 2012‐2013
2012ConferenceontheStatisticalDetectionofPotentialTestFraud
Chair 2011‐2012
2012ColloquiumonOrganizedLearningModels PlanningCom. 2012NationalCouncilonDisabilityExpertPanelonGraduationOutcomesandAssessmentTools
Member 2012
EdvantiaTechnicalAdvisoryGroup Member 2012NCME75thAnniversaryPlanningCommittee Chair 2010‐2013
Page 26
Neal Kingston CV 26
ATP2010AnnualConferenceProgramCommittee ViceChair 2009‐2010NSFREESEPeerReviewPanel Member 20092009ColloquiumonUniversallyDesignedTechnologyEnhancedAssessments
PlanningCom. 2009
KaplanCatalystTechnicalAdvisoryCommittee Member 2008‐2010AERADivisionDEditorialCommittee Member 2008‐2009UnitedStatesDepartmentofEducationWorkshoponFormativeAssessment
Member 2008
UnitedStatesDepartmentofEducationWorkshoponUseofPortfoliosinNCLBAssessmentPrograms
Member 2008
UtahStateOfficeofEducationComputer‐BasedTestingSummit
Member 2007
JointCommitteeonTestingPractices Member 2006‐2007NewHampshireStateDepartmentofEducationAdvisoryCommitteeonScoreReporting
Member 2000
CareerChannelAdvisoryGroup Member 1991NationalResearchCouncilWorkshoponConfidentialityofGraduateData
Member
1988
DefenseAdvisoryCouncilonMilitaryPersonnelTesting Member 1987‐1988NCME1984Conference Co‐chair 1983‐1984
AdhocReviewer(beganrecordkeepingApril2013) DatesEducationalandPsychologicalMeasurement(EPM‐13‐0069)AppliedMeasurementinEducation(108‐040‐3)
April2013April2013