Measurable Skill Gains Training

Measurable Skill Gains Training

Adult, Dislocated Worker, and Youth Programs 1

• Measurable Skill Gains (MSG) Overview

• Five Types of MSG

• Documenting MSG in the Arizona Job

Connection (AJC) System

• Questions and Answers

• Next Steps

Topics

Copyright © 2015 ARIZONA@WORK |

Which statement is true?

A. Only one MSG per participant, per period of participation, per program year is included in the MSG measure.

B. Service providers may record multiple MSG per participant in a program year in AJC.

C. Both statements are true.

D. Neither statement is true.


Why Capturing MSG Matters

• One of six performance indicators under Sec. 116 of WIOA

• Shows value of program and its services• Facilitates evaluation of participant progress


MSG Overview

• Measures interim progress of participants in education or training leading to a recognized postsecondary credential or employment

• Documented progress defined five ways (types)


Types of MSG

• Educational functioning level (EFL) gain• Attainment of secondary school diploma or

equivalent• Receipt of secondary or postsecondary transcript

or report card• Progress towards training milestone• Exam passage (skills progression)


EFL Gain

● Applies to participants receiving instruction below the postsecondary education level

● May be measured by either:○ Enrollment in postsecondary education or

training○ Comparison of initial EFL (pre-test) and

current EFL (post-test) ■ Test determined appropriate for use in the

National Reporting System for Adult Education


https://www.govinfo.gov/content/pkg/FR-2020-08-07/pdf/2020-17301.pdf

EFL Gain: Pre- & Post Test

TABE 11/12 Pre-Test

Reading: 536Grade Level 6-8

EFL: High Intermediate Basic Education

TABE 11/12 Post-Test

Reading: 576Grade Level 9-10

EFL: Low Adult Secondary Education

Post-test score shows achievement of one EFL:

High Intermediate Basic Education to Low Adult Secondary Education

Reference: Test Benchmarks for NRS Educational Functioning Levels (EFL)


https://nrsweb.org/resources/test-benchmarks-nrs-educational-functioning-levels-efl-updated-august-2019

Secondary School Diploma or Equivalent

• A high school diploma

• A high school equivalency (HSE) diploma through the GED Pathway, the College Credit Pathway, or the HSE PLUS Career Readiness Pathway


https://www.azed.gov/adultedservices/get-your-diploma

Secondary or Postsecondary Transcript or Report Card

●Secondary school transcript or report card:○One semester○D- or above in all classes

●Postsecondary school transcript or report card:○ 12 or more hours per semester

○ or 12 or more hours over two semesters if enrolled part time

○D- or above in all classes


Progress Towards Training Milestone

A report or an evaluation from an employer or training provider showing –

• Skill development or

• Satisfactory progresstowards an established training milestone This Photo by Unknown Author is licensed under CC BY-

NC-ND


http://news.schoolsdo.org/2017/08/expect-more-career-technical-education-in-w-va/

https://creativecommons.org/licenses/by-nc-nd/3.0/

Examples of Documented Progress Towards Training Milestone

● Report showing skills acquired during OJT, customized training, or registered apprenticeship

● Report showing actual completion of OJT or customized training

● Documentation showing successful completion of one year of registered apprenticeship (or any other established timeframe)○ Shows substantive skill development

● Increase in pay as a result of skills gained, as documented by a report from the employer


Example of OJT Progress Report

OJT Progress Report form copied from On-the-Job Training Toolkit https://ion.workforcegps.org/resources/2017/12/01/11/19/On-the-Job-Training-Toolkit


Exam Passage (Skills Progression)

Skills progression documented by the participant’s passage of an examination that –

• Is required for a particular occupation or

• Shows progress in attaining technical or occupational skills.


Examples of Exam Passage (Skills Progression)

● Passing scores in a related instruction exam (registered apprenticeship program)

● Certificate that shows passage of an employer-required knowledge-based exam

● Passing score in a training program’s unit test○ A unit test in a CNA program

● Copy of a credential that is earned after the passage of an exam:○ A nursing assistant certificate○ A commercial driver’s license


Capturing MSG

● DOL reporting: one MSG counted per participant, per period of participation, per program year

● AJC: multiple MSG may be “set and attained”○ MSG with most recent date attained pulled for

DOL report● To be included in each program’s MSG measure,

participants must be in education or training fully or partially funded by each program (Adult, Dislocated Worker, or Youth)● Exception: all in-school-youth are included in the MSG

measure.● Partner-program or other WIOA-funded education or

training must also be entered in AJC.


Out-of-School Youth (OSY) and MSG

● Per TEGL 10-16, Change 1, OSY is included in measure if in occupational skills training, secondary/postsecondary education, Title II adult education, Job Corps, or YouthBuild.

● However, due to DES reporting method and WIPS design, OSY in education or training funded by partner programs will not be included unless also enrolled in education or training funded by the Youth program.


Example: Supplementing Education or Training

Participant is in a two-year nursing program fully paid by Pell Grant. Service provider may help enroll the participant in a medical interpreter training -- fully or partially funded by the program (Adult, Dislocated Worker, or Youth) -- to augment the participant’s nursing training and help the participant develop skills to assist patients who are limited English proficient.


Documenting MSG in Arizona Job Connection (AJC)

1. Bring job seeker into context and select Enrollment2. Select Measurable Skill Gains

3. Select New Goal


Setting MSG in AJC1. Fill Date Set and Program Year (July 1 - June 30)2. Select Measurable Skill Gains type

Note: On this screen, set either an MSG or a goal type, not both.

3. Select appropriate Status


Documenting MSG Attainment1. Change status to Attained2. Enter Date Attained (consistent with

source documentation)


Tracking MSG

After running Tableau reports, get details:


Downloading and Reviewing the Report

1. Upper left of the screen, select Download

2. Select Crosstab


Downloading and Reviewing the Report (cont’d)

3. Select format4. Compare the two detail sheets to determine who is missing from the numerator


Questions?


Next Steps

Share activities or actions you will take as a result of this training.E.g.:Create own MSG tool consistent with State guidance, DOL guidance, and regulationsPeriodically check MSG in AJCCoach staff to ensure MSG is appropriately documentedShare information with peers


Resources

20 C.F.R. § 677.155https://www.govinfo.gov/content/pkg/CFR-2017-title20-vol4/pdf/CFR-2017-title20-vol4-part677.pdf

Training and Employment Guidance Letter 10-16, Change 1https://wdr.doleta.gov/directives/attach/TEGL/TEGL_10-16-Change1.pdf

Measurable Skill Gains Guidehttps://des.az.gov/sites/default/files/media/500A-Measurable-Skill-Gains-Guide.pdf?time=1623686123764

Measurable Skill Gains E-Learning Modulehttps://performancereporting.workforcegps.org/MediaFiles/ws/performancereporting/Folders/%7BBE3097AE-AC83-4E4A-9145-2E5DFE9B93E4%7D/637019963033576068/index.html#/


https://www.govinfo.gov/content/pkg/CFR-2017-title20-vol4/pdf/CFR-2017-title20-vol4-part677.pdf

https://wdr.doleta.gov/directives/attach/TEGL/TEGL_10-16-Change1.pdf

https://des.az.gov/sites/default/files/media/500A-Measurable-Skill-Gains-Guide.pdf?time=1623686123764

https://performancereporting.workforcegps.org/MediaFiles/ws/performancereporting/Folders/%7BBE3097AE-AC83-4E4A-9145-2E5DFE9B93E4%7D/637019963033576068/index.html#/

Contacts

● For additional MSG and other policy-related questions, please email [email protected].

● For AJC-related MSG questions and other system-related questions, please email [email protected].


mailto:[email protected]

mailto:[email protected]

Measurable Skill Gains Training

Documents

Transcript of Measurable Skill Gains Training