Top Banner
Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability [email protected]
25
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Melissa Fincher, Ph.D.Deputy Superintendent, Assessment & Accountability

[email protected]

Page 2: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia Milestones• Grades 3 – 8

– End of Grade (EOG) in language arts, mathematics, science, social studies

• High School– End of Course (EOC) in 9th Grade Literature &

Composition, American Literature & Composition, Coordinate Algebra, Analytic Geometry, Physical Science, Biology, U.S. History, and Economics

Page 3: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia Milestones Resources• Content standards

– frameworks, formative lessons, PARCC evidence statements

• Sample items – formative items/benchmarks via Georgia OAS→GOFAR; – released items via PARCC, SBAC, other states (KY, NY), NAEP– parent’s guide to Georgia’s new assessment developed by the National PTA

[http://www.pta.org/advocacy/content.cfm?ItemNumber=3816 ]

• Georgia Milestones Test Blueprints/Content Weights• Georgia Milestones EOC Assessment Guides• Georgia Milestones EOG Assessment Guides• Introducing Georgia Milestones Video• Experience Online Testing Georgia website• Georgia Milestones Technology Specifications• Georgia Milestones Calculator Policy• Allowable Accommodations• Eliciting Evidence of Student Learning Modules

NOTE: The content weights communicate the REPORTING CATEGORIES and the number of associated points. These are not instructional documents and should not be used to inform instructional time. To do so could place students at a significant disadvantage as the knowledge and skills are not discrete and not bounded by a single domain.

Page 4: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Test Administration ResourcesPosted on GaDOE Testing/Assessment Home Page•Fall Assessment Conference, Georgia Milestones Parts 1 & 2 PowerPoints•Contact Information for Assessment & Accountability Division•2014-2015 Student Assessment Handbook (Under “For Educators” link)

Posted on GaDOE Georgia Milestones Webpage•Contact Information for the Georgia Milestones Team•Winter 2014 Pre-Administration Training PowerPoint•Georgia Milestones Updates & Clarifications PowerPoint•Winter 2014 EOC Online Testing Technical Set-up PowerPoint•Georgia Milestones Calculator Policy•EOC Assessment Guides•EOG Assessment Guides•Technology Specifications •Online Testing Capacity Calculator•Allowable Accommodations Charts (SWD & EL)

Experience Online Testing Georgia website: http://learnoas.ctb.com/GA/

Page 5: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Test Administration ResourcesPosted on GaDOE Georgia Milestones EOC Resources Webpage•Winter 2014 EOC Test Administration Manuals

– Test Coordinator’s Manual– Examiner’s Manual (Paper/Pencil Test Administration)– Examiner's Manual (Online Test Administration)

•Winter 2014 EOC Sample Answer Documents (9th Grade Lit. & Coordinate Algebra)•Formula/Reference Sheets & Quarter Inch Graph Paper

Posted at CTB.com•Contact Information for CTB Georgia Customer Service (Toll-Free Phone & Email)•Technology Coordinator User Guide & Site Network Guidelines•Online Test Readiness Guide•Troubleshooting Tips•Online Practice Test Directions•Winter 2014 Test Administration System (TAS) Training PowerPoint•Test Administration Manuals (also posted on GaDOE EOC Resources Page)

Remember, too, that there is a secure practice testwithin the TAS for students. Students should be given the opportunity to take the practice test BEFORE they take the operational test.

Page 6: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesFeatures include:

– inclusion of constructed-response items in ELA and mathematics, in addition to selected-response items;

– inclusion of a writing component (in response to text) at every grade level and course within the ELA assessment;

– inclusion of norm-referenced items in every grade and content area to complement the criterion-referenced information and to provide a national comparison; and

– transition to online administration over time, with online administration considered the primary mode of administration and paper-pencil back-up until transition is completed.

Addition of technology-enhanced items beginning in 2016-2017.

Page 7: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia Milestones

Transition to Online

– Year 1: minimum of 30% online

– Year 3: minimum of 80% online

– Year 5: minimum of 100% online

Paper/pencil versions will be available for the small number of students who cannot interact with computer due to their disability. Braille forms will be available.

A demo of CTB’s online platform can be accessed at this link –http://learnoas.ctb.com/GA/

•Click on any one of the demonstration tests •Click on “Login”, no credentials are required•Click on “Start the test”

Note – the demonstration tests contain generic items from multiple grade levels and are not designed to be reflective of Georgia Milestones content.

Page 8: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Online Testing ClarificationsGeorgia Milestones will not measure student keyboarding skill.•English Language Arts

– Communication skills (language usage/conventions) are only assessed via writing items (ELA).

– There is a difference between a typo and a lack of understanding of language conventions.

– Student responses from both modes – online and paper/pencil – will be used to train raters.

– Scoring of open-ended items is approached from the point of view of awarding points, not subtracting.

8

Page 9: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Online Testing ClarificationsGeorgia Milestones will not measure student keyboarding skill.•ELA Continued…..

– Given the time allowance, it is understood that the full writing process will not occur

– Expectations for student writing will be developmentally appropriate

•Mathematics– Open-ended items will ask students to provide an answer

and explain, not show their work (similar to the George and Anna pizza question)

9

Students should be given the opportunity to practice responding online in a variety of platforms, including the OAS. It is not necessary that they practice solely in the Georgia Milestones platform. Such practice does not need to be regimented and should serve a purpose other than ‘test-prep’. Student should be given the opportunity to write and explain often.

Page 10: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Grade 3 Student Response: ELAScore 2

10

Part ABeauty was important because the woman thought she didn't have enough beauty and bear liked the beauty of his tail. Part BTe woman was happy and bear was sad. Part C In woman in the sky teached a lesson that no one is beatiful than you in the inside and in how bear lost his tail teached a lesson that bragging isn't beauty.

In Part A, the student basically explains why beauty is important in both stories.

In Part B, the student basically explains how the main characters react when her/his beauty is lost.

In Part C, the student basically explains how both stories teach the lesson that beauty is found on the inside.

The response needs to include more details in all parts to achieve a higher score. The response demonstrates an inconsistent command of the conventions of standard English. There are a few patterns of errors in grammar and usage that occasionally impede understanding.

Page 11: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Grade 3 Student Response: ELAScore 1

part a. because they both think they are beautiful. part b. they are sad because they loved there beauty. part c. it teaches you dont think you are better than others.

In Part A, the student minimally explains why beauty is important in one story. Although there is no evidence that the bear-woman thinks she is beautiful, the student attempts to explain why the idea of beauty is important.

In Part B, the student minimally explains how Bear reacts when he loses his beauty, but the response does not apply to the bear-woman.

In Part C, the response includes a lesson, but does not explain how the story teaches the lesson that beauty is found on the inside.

All parts of the response are incomplete. The response demonstrates an inconsistent command of the conventions of standard English. The directions for the item instructed students to write in complete sentences and to use correct punctuation and grammar.

Page 12: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Grade 5 Student Response: ELAScore 2

The student writes a basic explanation of why the author used the title as well as a basic explanation of why the peacock mantis shrimp does not fit the definition.

Some details from the passage are provided for support.

Insufficient textual support prevents this response from receiving a higher score. The lack of spacing between sentences does not detract from understanding.

The author used the word shrimp to describe the size of the peacock mantis.The title tells the audience besides the size, the peacock mantis can deliver quite a punch to a predator or their prey.The peacock mantis does not fit the definition for shrimp because this creature could change the safety supplies such as football gear to make it even more safe.I think that peacock mantis is not unimportant.

Page 13: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Sample Student Response: SS

Prompt: Explain how the early European settlers in New England depended upon Native Americans for survival.

Student Response:All of them where having trouble surving and they needed the Natives help to live.

Watch that students do not simply restate the question.

Disclaimer: This item is provided as an example. Open-ended items will not be on the Social Studies tests this year.

Page 14: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Sample Student Responses: Writing

‘There are copious amounts of food.’‘There is a copious amount of things that can cause this.’‘A copious amount of schools in Georgia have banned eating in class.’‘A copious amount of people have said eating while studying helps you learn more.’‘Students worry more about what to eat a copious amount more than they actually listen or attention to the teacher.’

Be cautious in teaching students how to respond to open-ended items.

Page 15: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Sample Student Responses: Writing

‘I know that you are having a tenacious time deciding what the answer is.’‘But, when I get sleepy I get tenacious, stubborn, and when I’m stubborn I tend to get frank people.’

‘There is no need to try to be gregarious and let the kids eat whatever they want.’‘Scientists, estimate that 25% of kids fall asleep in cause causing them to lose many well needed edification to finish or pass the class.’

Be cautious in teaching students how to respond to open-ended items.

Page 16: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia Milestones: Rubrics• Rubrics are item specific and therefore cannot be

released.– Generally speaking, rubrics outline the expectations for the answer(s)

along with sufficient justification/explanation • Student cites evidence from the text to support answer in ELA• Student explains reasoning or approach to problem solving in mathematics• Student answers all portions of the item

– Remember the OAS includes rubrics and student exemplars for all formative open-ended items.

• The extended-response analytic writing rubric will be released. Students will be scored on two features:– Idea Development, Organization, & Coherence– Language Usage & Conventions

Page 17: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Administration TimesContent Area/Course Test Section(s) Minimum Time

Per Section(s)Maximum Time Per Section(s)

English Language Arts 1 and 2 60 70

English Language Arts 3 70 90

Mathematics 1 and 2 60 80

Science 1 and 2 50 70

Social Studies 1 and 2 50 70A section may not be stopped until the minimum allotment of time has expired. If students are still productively engaged with the test content, the maximum amount of time, per section, may be given in 10 minute increments.

Note: These time limits do not apply to those students who have the accommodation of extended time.

Page 18: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesGeneral Test Parameters: ELA

Criterion-ReferencedTotal Number of Items: 44 / Total Number of Points: 55

Breakdown by Item Type:–40 Selected Response (worth 1 point each; 10 of which are aligned NRT)–2 Constructed Response (2 points each)

–1 Constructed Response (worth 4 points)–1 Extended Response (worth 7 points)

Norm-Referenced–Total Number of Items: 20 (10 of which contribute to CR score)

Embedded Field Test–Total field test items: 6

Total number of items taken by each student: 60

Page 19: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesWriting at Every Grade

–All students will encounter an extended constructed-response item allowing for narrative prose, in response to text, within first or second section of the test.–Within the writing section of the test, students will read a pair of passages and complete a series of “warm-up” items:

o3 selected-response items asking about the salient features of each passage and comparing/contrasting between the two passageso1 constructed-response item requiring linking the two passageso1 writing prompt (allowing for an extended writing response) in which students must cite evidence to support their conclusions, claims, etc.

GenresWriting prompts will be informative/explanatory or opinion/argumentative depending on the grade level. Students could encounter either genre.

Warning: Students who simply rewrite excerpts from the passage(s) to illustrate their point(s) will not receive favorable scores.

Page 20: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesGeneral Test Parameters: Mathematics

Criterion-ReferencedTotal Number of Items: 53 / Total Number of Points: 58

Breakdown by Item Type:–50 Selected Response (worth 1 point each; 10 of which are aligned NRT)

–2 Constructed Response (worth 2 points each)

–1 Constructed Response (worth 4 points)

Norm-Referenced–Total Number of Items: 20 (10 of which contribute to CR score)

Embedded Field Test–Total field test items: 10

Total number of items taken by each student: 73

Page 21: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia Milestones Calculator Policy

Content Area Grade Level/Course Type of Calculator

Mathematics

Grades 3 – 5 EOG Not Allowed

Grade 6 EOG Basic1

Grades 7 – 8 EOG Scientific2 or Basic1

Coordinate Algebra EOC Graphing3 or Scientific2

Analytic Geometry EOC Graphing3 or Scientific2

Science Physical Science EOC Scientific2 or Basic1

Social Studies Economics EOC Scientific2 or Basic1

21

1Basic four-function calculator with square root and percentage functions.2Scientific calculator with functionalities consistent with TI-30XS MV or similar models.

3Graphing calculator with functionalities consistent with TI-84 Plus SE or similar models.

Calculators are not permitted on certain designated sections of each mathematics test.

Page 22: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Mathematics: No-Calculator Subsection• Please note that calculators are allowed on the

Georgia Milestones Mathematics measures in grades 6 – high school. No item requires a calculator.

• For each of these grades and courses, there will be a small subsection on which a calculator may not be used, even as an accommodation.– No student may use a calculator on this section.

Page 23: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesGeneral Test Parameters: Science

Criterion-ReferencedTotal Number of Items: 55 / Total Number of Points: 55

Breakdown by Item Type:–55 Selected Response (worth 1 point each; approximately 10 of which are aligned NRT)

Norm-Referenced–Total Number of Items: 20 (approximately 10 of which contribute to CR score)

Embedded Field Test–Total field test items: 10

Total number of items taken by each student: 75

Page 24: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesGeneral Test Parameters: Social Studies

Criterion-ReferencedTotal Number of Items: 55 / Total Number of Points: 55

Breakdown by Item Type:–55 Selected Response (worth 1 point each; approximately 10 of which are aligned NRT)

Norm-Referenced–Total Number of Items: 20 (approximately 10 of which contribute to CR score)

Embedded Field Test–Total field test items: 10

Total number of items taken by each student: 75

Page 25: Melissa Fincher, Ph.D. Deputy Superintendent, Assessment & Accountability mfincher@doe.k12.ga.us mfincher@doe.k12.ga.us.

Georgia MilestonesGeorgia Milestones represents a significant change and importantly – an opportunity – for our state.

This opportunity allows us to recalibrate, as a state, and refocus on teaching and learning as a primary emphasis with assessment and accountability serving a supporting role.