About the Performance Indicators
The Vocational Profile displays 5 indicators of vocational provider performance. For each indicator, the definition, sampling parameters, calculation and display are available below. Data is limited to L&I industrial insurance referrals.
The 5 performance indicators are:
- Timeliness of progress reports.
- Training plans approved the first time.
- Eligible recommendations approved the first time.
- Useful outcomes.
- Dispute Results.
Training videos about Vocational Profiles.
Timeliness of progress reports
Starting November 1, 2010, progress reports must be submitted electronically using the correct date link to be counted as "timely." The report due date on the Claim and Account Center (CAC) screens is the date used to calculate timeliness. Each referral type has a different format based on WAC requirements.
Get tips for successfully submitting electronic progress reports (40 KB PDF).
Definition
- Progress reports (PR) communicate progress made, current or potential issues, and action plans.
- PRs are due every 30 calendar days after the date of referral. A PR is "timely" if submitted by the due date or up to 5 days after the due date.
- A PR is "timely" if submitted by the due date or up to 5 days after the due date. To be counted as timely, the PR must be submitted electronically using the correct date-link.
- Weekend or holiday due dates are moved to the next business day. The PR will be considered "timely" if received within 5 days of this due date. The due date for the next month's PR will revert to the original schedule.
- The date a PR is electronically submitted counts as the date received.
- Draft, faxed, or mailed PRs are not counted as "timely."
- All PRs due during the sample period are included in the calculation for both open and closed claims.
Sampling
Minimum sample size: 50.
Length of sample period: 6 months.
Beginning of data collection: November 1, 2010.
Date data will first display: December 1, 2010.
Last modification date: March 22, 2014.
Calculation
The number submitted timely divided by the total number of PRs due during the sample period. This includes both open and closed referrals.
Display
The percent of PRs submitted timely. Example: 97%.
Checking the "needs department action" box sends a notification to the claim manager. Use this feature when timely action is needed.
Training plans approved the first time
Definition
Training plans are reviewed by vocational services specialist (VSS) staff. A plan may be approved the first time, denied, or returned for additional work.
Total plans are plans with an actual outcome code of plan approved (PLN2), plan denied (PLN3), or plan deemed approved (PLN4).
Plans approved the first time have outcome codes of PLN2 or PLN4 and weren't sent back for additional work (i.e. don't receive a P5 letter).
Sampling
Minimum sample size: 10.
Length of sample period: 2 years.
Beginning of data collection: October 1, 2010.
Data will first display: November 1, 2010.
Calculation
Plans approved the first time divided by total plans.
Example: 94 plans approved the first time out of 100 total plans = 94/100.
Results are grouped by decile.
Statistical confidence is defined in statistical tables.
Display
The format on the referral screen is a single digit between 0 and 9.
Bold font indicates high statistical confidence. Normal font indicates moderate statistical confidence.
Examples: A score of "9" is derived from 92 out of 100 plans approved the first time.
9th decile with moderate confidence = 9.
9th decile with strong confidence = 9.
9th decile, with strong confidence and firm as proxy = 9*.
An asterisk indicates the firm score was substituted for the VRC score.
A summary of the data used to generate the score is available from the referral screen.
Eligible recommendations approved the first time
Definition
In an Assessment referral (AWA), VRCs may recommend that an injured worker is eligible and likely to benefit from retraining. These recommendations are reviewed by L&I VSS staff and may be approved, denied, or returned for additional work.
The total number of "eligible recommendations" includes any AWA referral with an outcome code of eligible for plan development (SAS3) or any other AWA outcome returned for additional work with a "V4" letter. V4 letters are used if more information is needed after a recommendation for plan development.
Eligible recommendations approved the first time count the "total" referrals (as defined above) that weren't sent back for additional work (i.e. don't receive a "V4" letter).
Sampling
Minimum sample size: 10.
Length of sample period: 2 years.
Beginning of data collection: October 1, 2010.
Data will first display: November 1, 2010.
Calculation
Eligible recommendations approved the first time divided by total plans.
Example: 94 eligible recommendations approved the first time out of 100 total eligible recommendations = 94/100.
Results are grouped by decile.
Statistical confidence is defined in statistical tables.
Display
The format on the referral screen is a single digit between 0 and 9.
Bold font indicates high statistical confidence. Normal font indicates moderate statistical confidence.
A summary of the data used to generate the score is available from the referral screen.
Examples: A score of "9" is derived from 92 out of 100 eligible recommendations approved the first time.
9th decile with moderate confidence = 9.
9th decile with strong confidence = 9.
9th decile, with strong confidence and firm as proxy = 9*.
An asterisk indicates the firm score was substituted for the VRC score.
Useful outcomes
Definition
Closing codes for vocational referrals are designated as useful, not useful, or neutral.
Useful outcomes generally include return to work, able to work, eligible for further services, and not eligible for further services. Designations of referral closing codes (185 KB PDF) show each vocational closing code and its designation of useful, not useful, or neutral. The indicator relies on the L& closing code.
The RVRS screen in VocLink has a list of referrals that have been closed by L&I under your provider number.
Sampling
Minimum sample size: 25.
Length of sample period: 1 year.
Beginning of data collection: January 1, 2010.
Data will first display: October 1, 2010.
Calculation
Divide the number of "useful" by the total of "useful" plus "not useful" outcomes.
Example: A VRC has 15 referrals closed as "useful" and 3 referrals closed as "not useful."
The number of "useful" outcomes is 15.
The total number of "useful" and "not useful" outcomes is 18 (15 + 3).
The percent useful outcome is 15 ÷ 18 = 83%.
Outcomes designated as "neutral" are excluded to ensure they are truly neutral in the scoring. Otherwise, it creates an incorrect and lower score.
Results are grouped by decile.
Statistical confidence is defined in statistical tables.
Display
The format on the referral screen is a single digit between 0 and 9.
Bold font indicates high statistical confidence. Normal font indicates moderate statistical confidence.
A summary of the data used to generate the score is available from the referral screen.
Examples: A score of "9" is derived from 92 out of 100 eligible recommendations approved the first time.
9th decile with moderate confidence = 9.
9th decile with strong confidence = 9.
9th decile, with strong confidence and firm as proxy = 9*.
An asterisk indicates the firm score was substituted for the VRC score.
Dispute Results
Definition
Only an injured worker or employer or their representative may submit a formal dispute about a vocational determination. These disputes are reviewed by a vocational services specialist (VSS) staff.
Total disputes include any referral type where the vocational determination is disputed by the injured worker or employer.
No applicable findings (NAF) means the vocational provider adequately addressed vocational issues in the closing report. This is not the same as whether the original determination is upheld or not upheld. If new information appears after a closing report is submitted (such as a change in medical), "NAF" can show for the vocational provider, but the original determination may not be upheld.
If vocational issues are not adequately addressed, one of the following codes will identify the findings:
- TSA — transferable skills analysis.
- JA — job analysis.
- LMS — labor market survey.
- MED — medical analysis.
- LTBA — likely to benefit analysis.
- OTHER — other reason such as WAC violation or missing information.
- COMB — more than one finding.
Sampling
Minimum sample size: 10.
Length of sample period: 2 years.
Beginning of data collection: January 1, 2010.
Data will first display: October 1, 2010.
Last modification date: March 22, 2014.
Calculation
NAF disputes divided by total disputes.
Display
The format on the referral screen is a single digit between 0 and 9.
Example:A score of "9" is derived from 92 NAF disputes out of a total of 100 disputes.
Questions
Submit questions or comments through the Vocational Profile Feedback form.
Contact
Jody Witham
Email: Jody.Witham@Lni.wa.gov.
Phone: 360-902-4854
Fax: 360-902-5035
Mail:
Return-to-Work Services
Department of Labor & Industries
P.O. Box 44324
Olympia, Wash. 98504-4324