Are Your Schools Ready for the Next Generation Assessments? What You Need to Know from All Six Multi-State Consortia Wes Bruce – PARCC Brandt Redd – Smarter Balanced Scott Elliot – ELPA 21 ASSETS – Carsten Wilmes Neal Kingston – DLM Chris Domaleski - NCSC Philip Olsen – Wisconsin Department of Public Instruction Andy Middlestead – Michigan Department of Education
42
Embed
Wes Bruce – PARCC Brandt Redd – Smarter Balanced Scott Elliot – ELPA 21 ASSETS – Carsten Wilmes Neal Kingston – DLM Chris Domaleski - NCSC Philip Olsen.
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Are Your Schools Ready for the Next Generation Assessments?What You Need to Know from All Six Multi-State Consortia
Wes Bruce – PARCCBrandt Redd – Smarter BalancedScott Elliot – ELPA 21ASSETS – Carsten WilmesNeal Kingston – DLMChris Domaleski - NCSCPhilip Olsen – Wisconsin Department of Public InstructionAndy Middlestead – Michigan Department of Education
Assessment ConsortiaComprehensive
PARCCSmarter Balanced
English Language ProficiencyElpa21ASSETS
AlternateDynamic Learning Maps (DLM)NCSC
SETDA Guide to Technology Readinesshttp://gtr.setda.org
“Get ready cause here we come!”*NCSA – New Orleans
Wes BruceJune 27, 2014
* With apologies to The Temptations
4
PARCC Technology
Specifications
Desktops, Laptops, Tablets, Thin Client/VDI
Minimum Recommended
Operating System
Windows XP–SP3 (with caveats)Mac OS 10.6Linux*: Ubuntu 9-10, Fedora 6*iOS6Android 4.0*Chrome OS
Windows 7 or newerMac OS 10.7 or newerLinux*: Ubuntu 11.10, Fedora 16iOS6 or newerAndroid 4.0 or newer*Chrome OS
Memory By operating system 1 GB RAM
Processor By operating system 1 GHz
Screen Size 9.5 “ 9.5 “ or larger
Screen Resolution
1024 x 768 1024 x 768 or better
Bandwidth 5 kbps/ studentusing local caching
100 kbps/ studentto support instruction and assessment
• Counting devices and checking bandwidth is the tip of the iceberg….– Can schools actually deliver the tests?– Are test administrators ready for the logistics?– Can you provide the data to take advantage of the new
opportunities?– Do teachers and students know what is expected of them?– Are parents and key publics aware of the tests and the
possible results?– Have you addressed Opportunity to Learn?
6
Readiness, “Has Only Just Begun” with the Technical Specifications
• Determine if schools/districts are ready– What is your “due diligence” to validate that schools can
deliver?
• Test administrators– Even if you have been online, these systems are different
and place different expectations on those administering the test
• Data Systems– Can you produce the kind of data needed to take
advantage of these new systems •PNP?
7
Schools, Districts and Systems
8
• Teacher Readiness– Have they taught the content and are they aware of the
tasks that will be used
• Student Readiness– Item types– Test interface
• Parent Readiness– Assessment itself– Results - both item and CCR
•Cite evidence vs. plagiarism
9
Teachers, Students and Parents
• Model Content Frameworks– www.parcconline.org/parcc-model-content-frameworks
• Test Specifications and Blueprints– http://www.parcconline.org/assessment-blueprints-test-specs
• Sample items, tutorials and practice tests (all grades & sub.)– http://www.parcconline.org/practice-tests
National Conference on Student Assessment27 June 2014
• 22 member states and territories representing 39% of K-12 students
• 20 Governing States, 1 Advisory State, 1 Affiliate Member
• Washington state is fiscal agent
• UCLA Graduate School of Education will be permanent home.
A National Consortium of States
12
A Balanced Assessment System
Common Core State Standards
specify K-12
expectations for college and career readiness
All students leave
high school college
and career ready
Teachers and schools have
information and tools they need
to improve teaching and
learningInterim assessments
Flexible, open, used for actionable
feedback
Summative assessments
Benchmarked to college and career
readiness
Teacher resources for formative
assessment practices
to improve instruction
13
SmarterApp.org
• Smarter Balanced: A consortium of states developing common assessments for ELA and Mathematics that are aligned to the Common Core State Standards.
• SmarterApp: A community of organizations devoted to collaboration on an open licensed software suite for the support of educational assessment.
14
Assessment DeliverySystem*
Consortium Hosted
Item Authoring(author, approve,
versions, etc.)
Test Item Bank(test items, test authoring, test packager, etc.)
Data Warehouse
and Reporting
Test Delivery
Item Scoring(Deterministic, AI,
Hand)Test
Administration and Registration
(student reg.,test scheduling)
State Student Data System
Adaptive Engine
Smarter Balanced Assessment Delivery Architecture
Aggregate and student-level‡
reports.
Student responses,item scores,
and test scores.
Student ID, school, grade, ethnicity, etc.
Items
Responses
DistrictSIS
Eligible students, scheduled tests
Test package
Determine next set of items
Operationalitems
*Operated by a State or Smarter Balanced-certified vendor.
District will need to register studentsif no State system is available
‡ Individual Student Reports will be generated by the Consortium for states that allow student identification data to be stored by the Consortium. Other states will host instances of the Data Warehouse and Reporting components.
Students
Test registration will Q/A registration info against previous years’ data in the Data Warehouse.
Extract filewith student-level results
Test Integration,Test Scoring
Parents and Educators
TestAdministrator
(Proctor)
15
Spring 2014 Field Test
• 4.2 Million Students• 16.5 Thousand Schools• 12.2 Million Tests completed
– 4.5 Million with accessibility features
• Up to 4 tests per student. Average: 2.8.• ELA• ELA Performance Task• Math• Math Performance Task
16
A New Generation of Standards & Assessments for ELLs
•11 states funded in September 2012 by the U.S. Department of Education
•Partners• Lead State: Oregon Department of Education• Project Management: Council of Chief State School Officers (CCSSO)
• Understanding Language Initiative (Stanford University), CRESST of the University of California, Los Angeles, and NCEO of the University of Minnesota
•Timeline• Item bank development (ongoing)• Field Test SY 2014-2015 • First Operational Summative SY 2015-2016 • Operational Screener SY 2016-2017 • Platform, Technical Requirements, and Reporting SY 2014-2015
ELPA21 Consortium States
Arkansas, Florida, Iowa, Kansas, Louisiana, Nebraska, Ohio, Oregon, South Carolina, Washington, and West Virginia
ELPA21 Structure
•New English Language Proficiency Standards• With guidance from states, WestEd, Understanding Language Initiative of Stanford University, and CCSSO developed completely new standards• College and career readiness focus
•We are in the unique position of integrating new standards, assessments, technology, and teacher and administrator supports — all leading toward better systems of support and learning for ELLs. •Comprehensive web-based delivery • Innovative technology-enhanced items • Includes teacher-developed items
•Cohesive system •High quality communications and outreach within states
The present publication was developed under grant 84.373X100001 from the U.S. Department of Education, Office of Special Education Programs. The views expressed herein are solely those of the author(s), and no official endorsement by the U.S. Department should be inferred.
National Conference on Student Assessment, June 2014
Chris Domaleski
National Center and State Collaborative
Overview
• Five partner organizations– National Center on Educational Outcomes– edCount, LLC.– National Center for the Improvement of Educational Assessment– University of North Carolina at Charlotte– The University of Kentucky
• 13 partner states and 11 tier 2 states• Long-term goal is to ensure that students with significant cognitive
disabilities achieve increasingly higher academic outcomes and leave high school ready for post-secondary options.
• Theory of Action: a well-designed summative assessment alone is insufficient. To achieve this goal, an AA-AAS system also requires: – Curricular & instructional frameworks – Teacher resources and professional development
NCSC Technology Framework
NCSC Technology Customized Open Source• Compliant with commonly used AT/AAC devices• Paper & pencil alternative delivery• Verify student profile LCI/PNP data • Hand scoring/interaction for teachers• Keyboard only navigation• Adaptive testing features• Accessibility features (e.g., Text to speech, magnification,
high contrast)• Upload evidence for an item feature• PD training, survey, practice tests• Federally funded and open source system/content available
to all schools and states without licensing fees
Assessment Development Timeline
Spring 2014 - Pilot Test 1: Item Tryouts
Summer 2014 – Item Data Review, Finalize Test Specs