Analyzing Big Data: The RI Referee Ranking System

Analyzing Big Data: The RI Referee Ranking

SystemSteve Mauricio, SRA

Brian Sperlongano, SYRAMarch 22, 2014

Session ObjectivesLearn how big data can improve your referee

programLearn how standard software can be easily

usedLearn the benefits realized by Rhode Island’s

pilot programTo State Referee AssociationsTo AssignorsTo Referees

Discuss the challenges in developing and maintaining a program

Why We turned to Big Data

Our ChallengesReferee identification

Who do we have?How good are they?Who is next for State Cup, Regional, etc… ?

Change the CultureAssignor barriersReferee motivation & self-improvementAwareness of leagues & tournaments

Solution: Referee RankingsDeveloped an identification committee tasked

with creating a ranking processCreated a “Top 100” ranking database

Specific to Grade 8 referees under age 25Uses weekly assignment dataAssigned numeric values to each League, Age

Group, and Referee positionPublish public list on our web site!Keep internal statistics on all assignments

and all referees

How We Create the ListRegional

Assignments

Adult Assignments

Premier Assignments

Competitive Assignments

Fitness TestResults

Formula Examples

5 points=

663 points=

Final

2x

Travel League

1x1

U10

x5

Assistant Referee

3.9

State Cup

x8.5

U18

x10

Referee

Promoting Fitness at Grade 8!

% bonus for passing the fitness test

Bigger bonus for exceeding minimums

Fitness test used as an identification event

Challenges5 assignment systems in use statewide

Different report formatsThe “John Smith” effect

Pen-and-paper assignorsVolunteers with technical skills

There are engineers & computer scientists in your community

Use standard tools, Microsoft Excel, Access, etc.

Frequent updates are important but require labor

Outcomes

Opportunities to Educate Referees

To: [email protected]

“Brian, ###### is so upset. How is this ranking done? What are the qualifications? He is trying like crazy to be a great ref, but it seems he almost never gets ref assignments, simply ARs. He will be taking the fitness test and the ODP ref class. I understand there is a RI Ref Academy; could you tell us about it?”

Opportunities to Educate Assignors

To: [email protected]

“Could you please give me some info on how the referee raking is compiled? I have some referees that I feel should be able to make the list.

I was looking at the link you sent out to the refs of the top 100 under 25 years old and I see that ranked 47th you have ###### from Pawtucket and I am wondering how he made the ranking seeing how he just got certified for the first time this year and he has never refereed a game until this weekend.”

OutcomesFilling open games / assignment opportunitiesReferee awareness of higher leaguesRemove perception of favoritismCreate competition between refereesReferees more willing to reach out to assignorsLeagues WANT to be included / builds unityFuture GameOfficials & US Soccer

collaboration?Objective annual award decisions

Grade 7 Enrollment2015 Grade 7 class

will double the population of high grade referees!

High Ranking = Motivation to upgrade

2011 2012 2013 2014 20150.0%

1.0%

2.0%

3.0%

4.0%

5.0%

6.0%

7.0%

Referee Population: Grade 7+

Gender / Assignment Disparity

Assignment data can reveal other trends!Below U12, males & females assigned at same

ratioAbove U12, assignments to females decrease

Gender disparity a 2014 focus areaCan’t fix what you don’t know about!

RefereePopulation

AssignmentsBelow U12 U12/U13 U14+

Male 67% 67% 73% 80%Femal

e33% 33% 27% 20%

Questions & Answers

Thank you!