2013 Judging Guidelines for Exhibition Updated Feb 18, 2013 Go to and click on [Robofest 2013] link. This PowerPoint file.

2013Judging Guidelines

for Exhibition

Updated Feb 18, 2013

Go to www.robofest.net and click on [Robofest 2013] link.

This PowerPoint file and related materials will be available under “Judging” section.

This presentation is for all volunteers, coaches, mentors, site hosts, and team members

• Maximize Students’ STEM learning• Be Objective

Judging Philosophy

Judge Types and Roles

Chief Judge Judges

About 20% ofteams

Qualify for Regional and WorldChampionships

3

Exhibition Judging

An example of science related autonomous robotics projectSr. Division First Place 2007: Farmington Harrison High School, Michigan GPS guided robotic boat monitoring and measuring ecological data

• Complete freedom to show off any type of creative autonomous robotics project

• Must employ sensors• “Human to Robot,” “Computer to Robot,”

and/or “Robot to Robot” interactions encouraged (see the next slides)

• Hardwired RC (or Joystick) is not allowed• Math and Science components – No. 1 criteria

(25%)

Exhibition Competition

5

• Using Robot Sensors– Claps/Knocks – Sound Sensor– Flash Light – Light Sensor– Color Cards – Color Sensor– Waving Hands – Sonar Sensor– Gesture – On-board camera– Etc.

Examples of “Human to Robot” Interactions (supervised autonomy)

• Host computer / device can be used to control robots• Host computer or device must have program(s) written

by students• Host computer / device may have sensors such as

camera• Host computer / a device may have human interface to

control robots part-time (supervised autonomy)

Examples of“Computer to Robot” Interactions

• IR communication (for example, Lego RCX)• Tactile / Touch sensors• Light/Color sensor; special color jersey• RFID• Bluetooth or ZigBee• On-board camera – Robot gesture / visible

signal• Etc.

Examples ofRobot <-> Robot Interactions

8

• Recommended themes– Interactive kinetic arts (Visual arts)– Interactive robotic music system (Performing arts)

• Fashion & Dance will be an Exhibition entry– Multiple robots are recommended– Teams are supposed to bring their robot dance

stage and music– Contact Site Host for any special requests

Exhibition Competition, 2013

9

Exhibition Competition• Teams are supposed to demonstrate the project

whenever they have visitors • Silent Judges may visit team tables individually, as if

they are spectators• Official presentation when a group of Judges visits the

team table: Teams will have maximum 4 minutes for their team introduction, robot presentation, and demonstration

• After that, judges will ask questions for 1 minute.• Judges will revisit for interviews

• Michigan Regional and World Championship will have People’s Choice award, decided by spectators

• They must inform judges that this is a “continued” project

• They must add new feature(s), or significantly improve or change a feature

If a team is continuing a prior year’s project…

• The application of math and science theories that is appropriate to the team members’ age level is a strong plus for judging.

• Even though the use of advanced level is fine, it may not offer any advantages for the judging.

Math & science theories and appropriate age level

Roles of Exhibition Judges (1)• Before the competition date:

– Visit team web pages– Watch team videos, if any are submitted

• Before the Opening Ceremony: Visit each team table to be familiar with the exhibitions; prepare questions to ask.

• During the official presentations: score the presentations using the Worksheet. Ask questions right after the presentation

Roles of Exhibition Judges (2)• Any time up to one hour before the closing:

– Visit team tables to interview teams– Read their posters– Ask for re-demonstrations, if needed– Inspect program code and robot(s)– Select top 50% teams and submit ranks of them

to the Chief Judge using the Judging Worksheet– Submit comments on ALL teams to the Chief

Judge using the Judging Worksheet

Exhibition Competition Ranking Decision is Based On:

Application of math and science concepts 25%Originality (creativity and imagination; innovation) 20%Wow! factor & public demo performance (reliability) 20%Presentation methods and student attitude for spectators; Information on the team poster; Information on the web such as team video

10%

Source code and robot inspection 10%Complexity, size, and number of functions 5%Usefulness / Practicality 5%Entrepreneurial ideas and mindset, others 5%

• When a Judge is not a technical expert of a field, for example, program code inspection

• Ask other Judges about their opinions before you make final selections and rank teams

Possible problems of this suggested Judging method and

how to solve the problem

Responsibilities of

Chief Exhibition Judge• One hour before the award ceremony

– Meet with all Exhibition Judges (no group discussion needed!)

– Collect Judging worksheets with ranks & comments– Calculate total rank for each team using Excel – Write comments for each team using Excel or paper

• During the closing ceremony– Briefly talk about strength and weakness of each

team– Announce award winners as well as qualified teams

to advance• After the event, submit all the comments, sheets, and

the Excel file to the scorekeeper

Exhibition Judging Worksheet

• A sample worksheet can be found on the web:– http://www.robofest.net/2012/ExhJudgeForm.pdf

• Note that Robofest will *not* post these worksheets from Judges

• Only final Excel file from Chief Judge and Chief Judge’s comments will be posted

An example: 5 Sr. Exhibition teams, 3 Judges, and 2 teams to advance

Chief Judge will decide if there is a tie

team ID Judge1 Judge2 Judge3 Total Award Advance

A 1 2 1 41st

place yes

B 5 5 5 15

C 2 1 2 5 yes

D 5 5 3 13

E 3 3 5 11

Judges' CommentsTeam ID Strength Suggestions to improve

A Excellent Science project Eye contact during the demoB … … C Very creative Need more reliability D E Practical project Employ math/science concepts

Example of Judges’ Comments – To be read before announcing

winners

http://www.robofest.net/2012/ChiefJudgeCommentForm.dochttp://www.robofest.net/2012/ChiefJudgeCommentForm.pdf

Little Robots, Big Missions

Questions?

[email protected]

www.robofest.netRule UpdatesClarificationsFAQsWarm Up Video