Top Banner
Operator Compliance Risk Score (OCRS)
27

Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Dec 17, 2015

Download

Documents

Maud Stokes
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Operator Compliance Risk Score

(OCRS)

Page 2: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

What is the Operator Compliance Risk Scoring System?• Mechanism for Calculating Likelihood of Operator Non Compliance

• A guidance tool introduced to ensure that effective targeting is carried out

• A fair system - it treats each operator in the same way. There is an incentive for operators to either maintain the standards that are already maintained, or make improvements to procedures. Operators that achieve a good standard are likely to be stopped less often

Page 3: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

How will VOSA use OCRS?OCRS will be used at the roadside to identify which vehicles should be checked.

Red - Full check to be carried out.Amber - Full check to be carried out unless higher scoring vehicles available.Green - No check unless either no other higher scoring vehicle or obvious defect or offence.

VOSA examiners will use a hand-held mobile compliance device into which they will key a registration number or operators licence information, which will display the relevant OCRS.

Page 4: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Each Operator has 2 Scores

Roadworthiness (mechanical)

Traffic (non-mechanical)

Page 5: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

RoadworthinessConcerned with the condition of the vehicle

Two sets of data are used:

• Vehicle Testing data captured at each first test and annual test (HGV’s only)

• Vehicle Enforcement data captured at the roadside or fleet checks at operators premises.

Page 6: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Roadworthiness Scoring Process• For each Test Failure defect and prohibition defect a score is given

• Each vehicle check/test counted as an Event

• Operator scored on total defect score divided by total number of Events

• Score is calculated weekly for a 2-year rolling period

total defect points

number of events

= index score

Page 7: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Example of points allocated for defects Failure item/defect no IM Vehicle

Testing Failure Item Points

Immediate Prohibition points

Delayed Prohibition points

Significant marked failure item/defect no

S Marked immediate prohibition points

S Marked Delayed prohibition points

1 -Seat Belts 2 6 4 3S 12 8

2 - Exhaust Emissions 2 6 4 5S 12 8

6 - Road Wheels and Hub 6 18 12 6S 36 24

7 - Size and Type of Tyres 5 15 10 7S 30 20

8 - Condition of Tyres 6 18 12 8S 36 24

30 - Steering Control 6 18 12 30S 36 24

22 - Mirrors 3 9 6 22S 18 12

20 - Condition of Body 5 15 10 20S 30 20

24 - Glass and view of Road 4 12 8 23S 24 16

25 - Windscreen washers and wipers

2 6 4 25S 12 8

33 - Speed Limiter 6 18 12 33S 36 24

44 - Oil leaks 3 9 6 44S 18 12

Page 8: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Overall Traffic

Concerned with roadside inspections and VOSA prosecutions in relation to non-mechanical infringements.

Including Drivers’ Hours, Tachograph and overloading offences

The OCRS Overall Traffic is further broken down into a Drivers Hours Score and an Other Traffic Score to provide extra information to VOSA examiners.

Page 9: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Traffic Scoring Process• For each traffic offence found at the roadside or at a fleet inspection or as part of a Prosecution an offence score is given.• Each roadside, fleet inspection and prosecution is counted as an event • Operator scored on total defect score divided by total number of Events

• Score is calculated weekly for a 2-year rolling period

total offence points

number of events

= index score

Page 10: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Example of points allocated for offencesPLS Points

Traffic Points DH

Traffic Points OTH

Traffic Points

Offence

Code

Offence Points

Offence Type

Offence Desc

Offence Points

Offence Type

Offence Desc

Offence Points

Offence Type

Offence Desc

Offence Points

1-1 48 C&U TACHO NOT FITTED

39 DH OBSTRUCT EXAMINER

51 OTHER OVERLOAD 40

1-11 57 C&U EXCEED 4.5HRS DRIVE

40 DH FORG & MISUSE DOCS

70 OTHER

1-56 52 C&U FTP CHARTS 36HR PROH

49 DH NO COMMUNITY AUTH

31 OTHER

1-56 48 C&U WEEKLY REST 90 PROH

42 DH EXCEED MAX SEAT CAP

42 OTHER

Page 11: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

How are points decided on for defects and offences?Danger Perceived danger and risk to road safety Range 1-25

Penalty Reflects the maximum statutory penalty set by Parliament

Range 1-25

Priority Value Reflect the public interest and policy objectives, e.g. Exhaust emissions do not make a vehicle unsafe mechanically but have significant effects on the environment

Range 1-10

Commercial Reflects the perceived level of commercial advantage gained

Range 1- 10

Impact Reflects the impact on enforcement investigation e.g. preventing or obstructing into other offences by deception or falsification

Range 1-10

Rating Is the sum of the factors above Maximum 80

Page 12: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Index Score• Operator scores compared with Peers (HGV GB, PSV GB etc)

• Scores converted to Relative Score in League Table format

• Bottom 1 – 10% given score of 1

• 11 – 20% given score of 2 etc

• Scores displayed on Hand-held Device with colour code

Red, Amber and Green (RAG)

• Worst Operators (score 10) given Red indicator

• Best Operators (score 1) given Green

Page 13: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Example of calculation of index score

A one vehicle operator is stopped at a VOSA roadside check and a Drivers Hours Offence (39 points) is found.

The Traffic Index Score is then calculated as number of total offence points (39) divided by number of total events (1) = 39

If the vehicle was then subsequently stopped at the roadside again by VOSA, but was found to be clear of any defects or offences, the operators score would reduce to:

Traffic Index Score 19.5 (39/2)

Page 14: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Percentile Group OCRS – roadworthiness

(mechanical)

OCRS – traffic enforcement

(non-mechanical)

0 (points) 0

1-10% 1

11-20% 2

21-30% 3

31-40% 4

41-50% 5

51-60% 6

61-70% 7

71-80% 8

81-90% 9

91-100% 10

GREEN

GREEN

AMBER

AMBER

RED RED

Page 15: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Historic vs. Predictive• Historic scores use previous data for that operator

• Past roadside encounters• Vehicle test history• PLS cases

• Predictive scores use previous data for operators with similar characteristics

• Type of operator licence• Age of operator licence• Size of fleet

• Predictive score will only be shown when no Historic score is available

Page 16: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Remember:• OCRS Scores are snapshots in time

• They are updated weekly

• The information used goes back for 2 years

• Your score could change even if your points do not – you could compare better or worse as the industry changes

• You can get the following VOSA reports to help improve performance:– OCRS scores– Vehicle test maintenance statement– Vehicle encounter report

Page 17: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Band Encounters

% of Encounters Prohibitions

Prohibition Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 5,876 37.17% 1,239 21.09% 233,960 2.51%

Amber 7,579 47.94% 2,234 29.48% 137,657 5.51%

Red 2,354 14.89% 915 38.87% 29,786 7.90%

Total 15,809 100.00% 4,388 27.76% 401,403 3.94%

OCRS Effectiveness April 08 – July 08Excludes Sifts

Roadside Encounters Only All OCRS Score Types

HGV Roadworthiness

Page 18: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Effectiveness April 08 – July 08HGV Driver’s Hours/Overloads

OCRS Band Encounters

% of Encounters

Drivers Hours

Prohibitions

DH Prohibition

Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 7,770 43.69% 1,025 13.19% 174,226 4.46%

Amber 8,495 47.76% 1,402 16.50% 194,503 4.37%

Red 1,520 8.55% 401 26.38% 32,674 4.65%

Total 17,785 100.00% 2,828 15.90% 401,403 4.43%

OCRS Band Weighed Weighing Prohibitions Weighing Prohibition Rate

Green 1,580 358 22.66%

Amber 1,870 502 26.84%

Red 450 202 44.89%

Total 3,900 1,062 27.23%

Page 19: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Band Encounters

% of Encounters Prohibitions

Prohibition Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 3,002 59.01% 565 18.82% 52,237 5.75%

Amber 1,731 34.03% 514 29.69% 18,899 9.16%

Red 354 6.96% 162 45.76% 2,737 12.93%

Total 5,087 100.00% 1,241 24.40% 73,873 6.89%

PSV Roadworthiness

OCRS Effectiveness April 08 – July 08

Page 20: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Effectiveness April 08 – July 08

OCRS Band Encounters

% of Encounters

Drivers Hours

Prohibitions

DH Prohibition

Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 2,067 54.25% 349 16.88% 40,632 5.09%

Amber 1,619 42.49% 346 21.37% 31,034 5.22%

Red 124 3.25% 57 45.97% 2,207 5.62%

Total 3,810 100.00% 752 19.74% 73,873 5.16%

OCRS Band Weighed Weighing Prohibitions Weighing Prohibition Rate

Green 45 1 2.22%

Amber 50 2 4.00%

Red 3 1 33.33%

Total 98 4 4.08%

PSV Driver’s Hours/Overloads

Page 21: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Effectiveness April 08 – July 08HGV & PSV Roadworthiness

OCRS Band Encounters

% of Encounters Prohibitions

Prohibition Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 8,878 42.49% 1,804 20.32% 286,197 3.10%

Amber 9,310 44.55% 2,748 29.52% 156,556 5.95%

Red 2,708 12.96% 1,077 39.77% 32,523 8.33%

Total 20,896 100.00% 5,629 26.94% 475,276 4.40%

Page 22: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

OCRS Effectiveness April 08 – July 08HGV & PSV Driver’s Hours/Overloads

OCRS Band Encounters

% of Encounters

Drivers Hours

Prohibitions

DH Prohibition

Rate

Number of Vehicles in Band

% Vehicles Encountered

Green 9,83710,114

45.55% 1,374 13.97% 214,858 4.58%

Amber 46.83% 1,748 17.28% 225,537 4.48%

Red 1,644 7.61% 458 27.86% 34,881 4.71%

Total 21,595 100.00% 3,580 16.58% 475,276 4.54%

OCRS Band Weighed Weighing Prohibitions Weighing Prohibition Rate

Green 1,625 359 22.09%

Amber 1,920 504 26.25%

Red 453 203 44.81%

Total 3,998 1,066 26.66%

Page 23: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

• Include data from operator visits by VOSA examiners

• Include data from roadside Dangerous Goods Inspections

• Incorporate Graduated Fixed Penalty data.

• Development of Non GB Vehicle risk scoring using the same scoring system as that used for GB vehicles

Improvements to OCRS 6-12 Months

Improvements to OCRS data areas next 6-12 Months

Page 24: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

• Increase priority area of Scoring Model for Drivers Hours offences

• Possibly decrease priority area of Scoring Model for Weight offences.

Both subject to agreement from Department for Transport

Proposed Changes to Scoring Model

Page 25: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Percentile Group OCRS – roadworthiness

(mechanical)

OCRS – traffic enforcement

(non-mechanical)

0 (points) 0

1-10% 1

11-20% 2

21-30% 3

31-40% 4

41-50% 5

51-60% 6

61-70% 7

71-80% 8

81-90% 9

91-100% 10

GREEN

GREEN

AMBER

AMBER

RED RED

Current OCRS Banding

Page 26: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

Percentile Group OCRS – roadworthiness(mechanical)

OCRS – traffic enforcement(non-mechanical)

0 (points) 0

GREEN GREEN1-10% 1

11-20% 2

21-30% 3

31-40% 4

AMBER AMBER41-50% 5

51-60% 6

61-70% 7

71-80% 8

RED RED81-90% 9

91-100% 10

Proposed OCRS Banding

Page 27: Operator Compliance Risk Score (OCRS). What is the Operator Compliance Risk Scoring System? Mechanism for Calculating Likelihood of Operator Non Compliance.

• OCRS Reports to be made available through portal• OCRS Frequently asked Questions to be updated• Specific article in Moving On to highlight the fact that OCRS is a system used by VOSA to target the most non compliant operators and should not be used on its own to rate an operator.• VOSA will be clarifying the definition of Sifts and depending on the definition be deciding if this should be included as a part of OCRS.

Improvements to OCRS 6-12 Months

Other OCRS developments