Robofest 2009 Judging Guidelines

Feb. 28, 2009

Please go to www.robofest.net and click on >> Enter Robofest 2009 <<link.

Download this PPT, rubric, and Judging forms under Judging section

Robofest Judging Philosophy

• Simple• Objective• Fair

• Maximize Students’ learning

3 Robofest

Judge Types and Roles

Chief Judge Judges

About 25% ofteams

Qualify toWorld Championship

Exhibition Judging

2009 Exhibition Competition• They will have 4 minutes for the team

introduction, robot presentation and demonstration

• Judges: visit the table as a group• Silent Judges: visit the table, individually,

as if you are a spectator

• Please read the official rule at www.robofest.net!

Roles of Exhibition Judges• Before the competition date: Watch team videos, if

any• Before the Opening Ceremony: Visit each team table

to be familiar with the exhibitions• Score the official presentation & demo• Anytime one hour before the closing

– Visit team tables to interview with teams– Read their posters– Ask demonstrations– Inspect program code and robot(s)– Submit your ranks with comments to the Chief

Judge

Responsibilities of Chief Exhibition Judge

• One hour before the closing– Meeting with Exhibition Judges– Collect comments and scoring sheets– Calculate averaged rank for each team using Excel– Write comments (pros/cons of each exhibition) in

the Excel file• During the closing ceremony

– Announce award winners as well as qualified teams to advance

• After the event, submit all the comments, sheets, and the Excel file to scorekeeper

Exhibition Competition Comprehensive Rank is based on:

Public demonstration performance (reliability) 20%

Originality (creativity and imagination; innovation) 20%

Application of math and science concepts learned 20%

Presentation methods and student attitude for spectators; Information on the team poster; Information on the Internet such as team video

10%

Source code and robot inspection 10%

Complexity and number of functions 5%

Usefulness / Practicality 5%

Entrepreneurial ideas and mindset 5%

New technologies used & other factors 5%

Judging score sheet

• A sample sheet can be found on the web: http://admin.robofest.org/2009/Exh09JudgeForm.pdf

• A sample Excel file for Chief Judge can be found on the web (coming soon!): http://admin.robofest.org/2009/Exh09Judge.xls

RoboFashion Show Judging

Judging Criteria for the overall rank• Team Intro (5%)• Presentation delivery (5%)• Demo (15%)• Whole stage usage (10%)• Artistic Choreography & Performance (10%)• Creativity and Innovation (10%)• Applying math & science (10%)• Robot team work & synchronization with other Bot or

human – if one robot, this score should be low (10%)• Code inspection (10%)• Robot mechanical design (10%)• New Tech used (5%)

Rule and Judging Score sheet

• Read the rule at www.robofest.net• A sample sheet can be found on the web:

http://admin.robofest.org/2009/fashionShow09JudgeForm.pdf

• A sample Excel file for Chief Judge can be found on the web (coming soon!): http://admin.robofest.org/2009/fashionShow09Judge.xls

Game:RoboZone

Judging

Robofest 2009 Game Summary• UP (Unknown Problem) Challenge – drawing

unknown shape• Top rank UP teams will select the rest of group

members by raffle• UP results will be the tie breaker to select the

best team for each group• RoboZone Group tournaments in parallel• Semi-Finals / Final

A sample UP drawing

(1) 300mm

(2) 150mm

90o

• One practice paper will be given. • The robot must not be touched by players during

the work. Once touched, the drawing cannot be continued.

• If the pen of the robot goes out of the paper, the robot must be stopped immediately.

• Record and play function (NXTG) cannot be used.• Before the given drawing time is expired, turn in

your robot to the judging table. If not, no game!• Tape/mark your team ID on the robot• Judge will call a team member to test the drawing

UP drawing Rules

How would you rank them?

(1) 300mm

(2) 150mm

90o

35.2 cm

16.4 cm

89o

39.4 cm

22 cm

119o

40cm

21cm 95o

Robot went outside the paper

50cm

119o

25cm

21cm 8cm

Drawing Judging

• Need two or three judges dedicated to this judging to maintain consistency

• First select best n teams, where n is the number of groups for each age division

• Let the best n teams select group members by raffle

• During the RoboZone game, the judging needs to be completed

• How precise the line lengths are. The deduction can be quantified by difference.

• How precise the angle is. Deduction can be quantified by difference.

• How clear/solid the lines are. Deduction can be quantified by the size of the largest gap.

• How straight the lines are. (See next slide)• How sharp the angle is. (See next slide)

How to score drawings

• Draw a rectangle that contains the entire line drawn by the robot. The width of the rectangle is the deduction.

How to quantify line straightness

14 mm

• Draw a box around the angle blip. The deduction is the diagonal distance of the rectangle

How to quantify an angle quality

d = 21mm

d = 42mm

• If the pen of the robot goes out of the paper or is stopped by human, 50% of the sum of the target lines will be deducted

• Any line drawn outside paper will be ignored• If a line is not drawn at all, then the penalty

point is double of the line length in mm• If extra line is drawn, the it is regarded as an

extension of the previous line

Additional Penalties

Example 135.2 cm

16.4 cm

89o

Diagonal of this rectangle is 25mm

Check item Target Actual Difference or penalty

Line (1) 300 352 52

Straightness 8Line (2) 150 164 14

Straightness 5Angle 90 89 1

Angle quality 25Line solidness (the size of the largest gap) 5Went outside or stopped by human? If yes, penalty is 225

0

Total deductions 110

Example 239.4 cm

22 cm

119oDiagonal of this rectangle is 23mm

The gap size is 24mm

Check item Target Actual Difference or penalty

Line (1) 300 394 94Straightness 10

Line (2) 150 220 70Straightness 8

Angle 90 119 29Angle quality 23

Line solidness (the size of the largest gap) 24Went outside or stopped by human? If yes, penalty is 225

0

Total deductions 258

Example 3

Robot went outside the paper

50cm

Check item Target Actual Difference or penalty

Line (1) 300 500 200Straightness 10

Line (2) 150 0 150Straightness* 150

Angle 90 0 90Angle quality 0

Line solidness (the size of the largest gap) 0Went outside or stopped by human? If yes, penalty is 225

225

Total deductions 725

Example 440cm

21cm 95o

Check item Target Actual Difference or penalty

Line (1) 300 400 100Straightness 30

Line (2) 150 210 60Straightness 15

Angle 90 95 5Angle quality 0

Line solidness (the size of the largest gap) 0Went outside or stopped by human? If yes, penalty is 225

0

Total deductions 210

Example 5119o

25cm

21cm 8cm

Check item Target Actual Difference or penalty

Line (1) 300 250 50Straightness 10

Line (2) 150 210 60Straightness 100

Angle 90 119 29Angle quality 40

Line solidness (the size of the largest gap) 0Went outside or stopped by human? If yes, penalty is 225

0

Total deductions 289

• Nothing drawn – infinite penalty

• Read the official RoboZone rule• Read the drawing judging rubric/guideline

Example 6

• Recommended group size is 3 or 4, which will be decided by site host organizer

• Drawing ranking will be based on the penalty score. Tie breaker will be the order of turning in.

• Chief judge need to first select top rank teams to form groups by raffle

Chief Judge’ Role: to form groups

RoboZone Game Video

A YouTube link at www.robofest.net

31 Robofest

Recommend RoboZone ring setup

Chief Judge and Drawing Judges

2 Judges / Group

Timer Score keeper

3 tables covered with black paper

2 Judges / Group

Timer Score keeper

3 tables covered with black paper

Metric ruler (or tape measure), Scale, Protractor

Metric ruler (or tape measure), Scale, Protractor

ready?

Go!

RoboZone Game Rules• A match consists of up to three games. The first

robot to win two games wins the match• Maximum time for each game is 2 minutes• Only one team member is allowed to enter the

competition area to start the robot.• A judge will weigh and measure the robots before

the match

Jr. Division Sr. DivisionMax. length and width 25 cm 25 cmWeight of the robot 1kg (2.2 lbs) 1.3kg (2.9

lbs)

How to start a RoboZone Game• For each game, the judge will designate the

starting location and orientation for each robot

After a Game is Started• Each robot must wait for 5 seconds. If a robot

moves, during this wait-time, the robot loses the game automatically.

• During the 5 second wait time, a judge will place the Zone and bottle at an unknown middle location between the two robots considering the size (width and length) of the two robots.

• The Zone must be taped down on the table• Both players and judges MUST move back out of

the way at least 10 feet

• No human touch is allowed. • Reset of the playing field is not allowed.

• Judges will have discretion in making decisions during the game and the judge’s decision is final.

• The max break time between games is 2 min.• teams should shake hands after the match

Once the game is started/ended

• Occupy the Zone or push the opponent off the ring!

• If both robots survive for 2 minutes without occupying the zone successfully, the game is tie.

• If the match results in a tie (for example: one win, one lose, and one tie) Scorekeeper records tie.

• The drawing rank will be used to determine a winner, if needed

How to win a game/match

• Target center point must be completely covered with any part for 3 continuous seconds. The robot may move.

• A detached part from a robot covering the target center point does not count.

• The counting will continue, even if two minute game time is elapsed.

Definition of the Zone occupation

Target center point of the Zone

Site Hosts needs to prepare a national flag!

UP for Warm UP today (20min given, Please take a paper)

(1) 250mm

(2) 200mm

75o

Robofest Little Robots, Big Missions

Questions?

robofest@LTU.edu

www.robofest.netRule UpdatesClarificationsFAQsWarm Up Video