11.5 Primary Indicators of Performance

11.5.2 Unsubsidized Employment during the 2nd Quarter after Exit (Adult and Dislocated Worker Programs)

Effective date: August 7, 2017

Definition: The percentage of program participants who are in unsubsidized employment during the second quarter after exit from the program. Employment includes unsubsidized employment, registered apprenticeship and military service.

This indicator includes participants who exit during the report period.

Participants with the following "Other Reasons for Exit" (Exclusions*) are not included:

• Institutionalized
• Health/Medical
• Deceased
• Reserve Forces Called to Active Duty

* See the exclusions portion of this chapter for definitions.

Data Sources:

• Automated System Support for Employment Training, (ASSET)
• DWD Unemployment Insurance (UI) Division Wage Records
• State Wage Interchange System (SWIS)
• Federal Employment Data Exchange System (FEDES)

11.5.3 Unsubsidized Employment or Education during the 2nd Quarter after exit (Youth Program)

Effective date: August 7, 2017

Definition: The percentage of Youth participants who were employed or in education during the Second Quarter after Exit. Employment, education and training activities that count as success include:

• Unsubsidized Employment
• Registered Apprenticeship
• Military
• Occupational Skills Training
• Postsecondary Education
• Secondary Education

This indicator includes participants who exit during the report period.

Participants with the following "Other Reasons for Exit" (Exclusions*) are not included:

• Institutionalized
• Health/Medical
• Deceased
• Reserve Forces Called to Active Duty
• Foster Care

* See the exclusions portion of this chapter for definitions.

Data Sources:

• ASSET
• UI Wage Records
• SWIS
• FEDES
• National Student Clearinghouse (NSCH)

11.5.4 Unsubsidized Employment during the 4th Quarter after Exit (Adult and Dislocated Worker Programs)

Effective date: August 7, 2017

Definition: The percentage of program participants who were in unsubsidized employment during the fourth quarter after exit from the program. Employment includes unsubsidized employment, registered apprenticeship and military service.

This indicator includes participants who exit during the report period.

Participants with the following "Other Reasons for Exit" (Exclusions*) are not included:

• Institutionalized
• Health/Medical
• Deceased
• Reserve Forces Called to Active Duty

* See the exclusions portion of this chapter for definitions.

Data Sources:

• ASSET
• UI Wage Records
• SWIS
• FEDES
• NSCH

Figure 11.5.1: Exits

11.5.5 Unsubsidized Employment or Education during the 4th Quarter after exit (Youth Program)

Effective date: August 7, 2017

Definition: The percentage of Youth participants who were employed or in education during the fourth quarter after exit. Employment, education and training activities that count as placement include:

• Unsubsidized Employment
• Registered Apprenticeship
• Military
• Occupational Skills Training
• Postsecondary Education
• Secondary Education

This indicator includes participants who exit during the report period.

Participants with the following "Other Reasons for Exit" (Exclusions*) are not included:

• Institutionalized
• Health/Medical
• Deceased
• Reserve Forces Called to Active Duty
• Foster Care

* See the exclusions portion of this chapter for definitions.

Data Sources:

• ASSET
• UI Wage Records
• SWIS
• FEDES
• NSCH

11.5.6 Median Earnings

Effective date: August 7, 2017

Definition: The median earnings of program participants who are in unsubsidized employment during the second quarter after exit from the program, as established through direct UI wage record match, Federal or military employment records, or supplemental wage information.

How to calculate: Total quarterly earnings, for all participants employed in the second quarter after exit, are collected by either direct wage record match or supplemental wage information. The collected quarterly wage information values are listed in order, from the lowest to the highest value. The value in the middle of this list is the median earnings value.

This indicator includes participants who exit during the report period.

Participants with the following "Other Reasons for Exit" (Exclusions*) are not included:

• Other Reasons for Exit:
  1. Institutionalized
  2. Health/Medical
  3. Deceased
  4. Reserve Forces Called to Active Duty
  5. Foster Care (Youth program only)
• Participants with Q2 wage values of 0.00 or 999999.99

Data Sources:

• ASSET
• UI Wage Records
• SWIS
• FEDES
• NSCH

For participants who do not have any wages during the 2nd Quarter after Exit, Supplemental data is required to indicate every dollar earned during a quarter.

11.5.7 Credential Attainment Rate

Effective date: February 26, 2019

Definition: The percentage of participants who obtain a recognized postsecondary credential during participation or within one year after exit from the program. Participants who receive a secondary school diploma or equivalent are successful if the participant was also employed or entered postsecondary education within one year of program exit. See the Credential Policy in this chapter for more information on the WIOA Performance Accountability System credential.

Figure 2. Methods for becoming successful in the Credential Attainment Rate

Participants Included in the Denominator:

• Adult and Dislocated Worker Program participants who received a training service other than On-the-Job Training or Customized Training.
• Adult and Dislocated Worker Program participants who received On-the-Job Training or Customized Training and another form of training.
• Youth Program participants who meet any of the following:
  • Enrolled in "Occupational Skills Training" during participation;
  • In secondary education at program entry or during participation;
  • In postsecondary education at program entry or during participation;
  • Dual-enrolled in Job Corps;
  • Dual-enrolled in YouthBuild participation; or
  • Dual-enrolled in Adult Basic Education funded by Title II.

Co-enrollment Impact on the Credential Attainment Rate

Applies to the WIOA Adult, Dislocated Worker, and National Dislocated Worker Grant programs:

Any credential reported during the period of participation and within 365 days of the participant's exit date applies to each program in which the participant is participating. All credentials that meet the criteria in Training and Employment Guidance Letter 10-16 Change 1 (TEGL 10-16 Change 1) must be entered into ASSET.

Participants in the WIOA Adult, Dislocated Worker, and National Dislocated Worker Grant programs are included in the Credential Attainment Rate if the participant received training/education using any amount of funding from:

• WIOA Title I Adult;
• WIOA Title I Dislocated Worker;
• WIOA Title I Youth;
• National Dislocated Worker Grant; or
• Trade Adjustment Assistance.

Adult, Dislocated Worker, and National Dislocated Worker Grant program participants who do not receive funded training from any of the programs in the above list do not qualify for the Credential Attainment Rate denominator.

Participants who receive non-WIOA funded training/education must enter the comparable training service into ASSET with the fund source "Other" to provide the most complete picture of the workforce/education services the participant received.

Applies to the WIOA Youth Program:

All participants in the Youth Program with education/training are included in the Credential Attainment Rate regardless of the education/training service's fund source.

All training/education services must be entered into ASSET regardless of fund source.

Applies to all Programs:

Participants with the following "Other Reasons for Exit" (Exclusions) are not included in the Credential Attainment Rate indicator:

• Institutionalized;
• Health/Medical;
• Deceased;
• Reserve Forces Called to Active Duty; or
• Foster Care. (Youth Program only)

11.5.8 Measurable Skill Gain

Effective date: February 26, 2019

Definition: The percentage of program participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains, defined as documented academic technical, occupational, or other forms of progress, towards such a credential or employment.

Participants Included in the Denominator:

• Adult, Dislocated Worker, and National Dislocated Worker Grant program participants who received a training service during the Program Year.
• Youth Program participants who meet any of the following:
  • Enrolled in "Occupational Skills Training" during participation;
  • In secondary education at program entry or during participation;
  • In postsecondary education at program entry or during participation;
  • Dual-enrolled in Job Corps;
  • Dual-enrolled in YouthBuild participation; or
  • Dual-enrolled in Adult Basic Education funded by Title II.

Co-enrollment impact on the Measurable Skill Gain

Any measurable skill gain reported during the period of participation and within the program year of the participant's exit date applies to each program in which the participant is participating in training and education. (See the Measurable Skill Gain Policy for more details.)

Applies to the WIOA Adult, Dislocated Worker, and National Dislocated Worker Grant programs:

Participants in the WIOA Title I Adult, Dislocated Worker, and National Dislocated Worker Grant programs are included in the Measurable Skill Gain indicator if the participant received training/education funded in any amount from:

• WIOA Title I Adult;
• WIOA Title I Dislocated Worker;
• WIOA Title I Youth;
• National Dislocated Worker Grant; or
• Trade Adjustment Assistance.

Adult, Dislocated Worker, and National Dislocated Worker Grant program participants who do not receive funded training from any of the programs in this list do not qualify for the Measurable Skill Gain denominator.

Participants who receive non-WIOA funded training/education must enter the comparable training service into ASSET with the fund source "Other" to provide the most complete picture of the workforce/education services the participant received.

Applies to the WIOA Youth Program:

All participants in the Youth Program with education/training are included in Measurable Skill Gain indicator regardless of the education/training service's fund source.

All training/education services must be entered into ASSET regardless of fund source.

Applies to all programs:

Participants with the following "Other Reasons for Exit" (Exclusions) are not included in the Measurable Skill Gain indicator:

• Institutionalized;
• Health/Medical;
• Deceased;
• Reserve Forces Called to Active Duty; or
• Foster Care. (Youth Program only)

Methods for Documenting Progress

Depending on the type of education or training program, documented progress is defined as one of the following: (See the Measurable Skill Gain Policy for more details.)

Method #1: Educational Functioning Level (EFL) Gain (The gain may only be made by participants in Secondary Education and basic education.)

• EFL Gain via Pre-Test and Post-Test;
• EFL Gain via entry into postsecondary education; and
• EFL Gain via Carnegie Credit Gain (Wisconsin Title I and II do not use this because Adult High Schools in Wisconsin do not award Carnegie Units. ¹)

Method #2: Attainment of a Secondary School Diploma (Participants who have not completed HS Diploma/Equivalent at program entry)

Method #3: Transcript/Report Card Meeting State's Unit Policy

Method #4: Progress Report from Employer or Training Provider

Method #5: Passage of an exam required for an occupation or progress attaining technical/occupational skills

• ¹ Wisconsin Technical College System, Title II, WIOA Performance Indicator Manual

11.5.9 Effectiveness in Serving Employers

Effective date: October 15, 2018

Background

Effectiveness in Serving Employers is a shared indicator across all six WIOA core programs. States will report the Effectiveness in Serving Employers indicator(s) to US DOL and US DOE as a combined statewide measure annually.¹ The reporting period is the program year.² This policy provides specific procedures Wisconsin DWD will follow when calculating effectiveness in serving employers indicators.

US DOL and DOE established a pilot program in the Information Collection Request (ICR) (OMB Control 1205-0526) approved June 29, 2016.³ States were required to choose at least two of the three indicators for reporting data. Wisconsin selected "Repeat Business Customers" and "Employer Penetration Rate."

DOL and DOE originally expected to identify a permanent, standardized indicator to replace the pilot approaches by the beginning of PY 2019. However, DOL and DOE announced in the federal register from March 6, 2018, they will conduct nationwide surveys and interviews with state WIOA administrators and employers to refine the indicator.⁴ They anticipate this process will require 36 months to complete. Upon selection and notification of a permanent Effectiveness in Serving Employers indicator, this policy will be revised to address reporting of the new indicator.

The three approaches authorized in the pilot were:

1. Participant Retention with Same Employer
   • Number of participants who exited during the reporting period who were employed by the same employer during the 2nd quarter after exit and the 4th quarter after exit DIVIDED BY the number of participants who exited during the reporting period.
2. Employer Penetration (Selected by Wisconsin for Pilot Years)
   • The total number of establishments, as defined by the Bureau of Labor Statistics Quarterly Census of Earnings and Wages (QCEW) program that receives a service or, if it is an ongoing activity, are continuing to receive a service or other assistance during the reporting period DIVIDED BY the number of total establishments, as defined by the QCEW program, located within the state during the final month or quarter of the reporting period.
3. Repeat Business Customers (Selected by Wisconsin for Pilot Years)
   • Number of establishments served during the past three years who have continued to receive a service DIVIDED BY number of establishments served during the past three years.

The Effectiveness in Serving Employers is a shared indicator. All business service activity recorded in JCW Business from all Wisconsin's WIOA Core and Partner programs assist the state in the calculation of this performance indicator. States are to identify an agency that will submit the Effectiveness in Serving Employers report to either US DOL or US DOE on behalf of the state's WIOA programs. Wisconsin DWD Division of Employment Training (DET) will submit annual reports to the Employment Training Administration (ETA) through the Workforce Information Performance System (WIPS) on behalf of all WIOA Core Programs.

Responsibilities

• WIOA Core and Partner Programs (DET WIOA programs, the Division of Vocational Rehabilitation (DVR), Wisconsin Technical College System (WTCS) and local workforce development boards established under WIOA Sec. 106) report business services in the JCW Business application, consistent with DET Admin. Memo dated December 18, 2017 "Official Designation of JCW Business as the System of Record for Reporting WIOA Business Services."
• Wisconsin Department of Workforce Development (DWD) Division of Employment Training (DET): responsible for submission of the annual report for the Effectiveness in Serving Employers indicators on behalf of all of Wisconsin's WIOA Core Programs.
• Director, Bureau of Workforce Training: Approval authority for WIOA state and local performance report submissions to US DOL.

Reporting Employer Penetration Rate denominator using QCEW Data

• Wisconsin will use the establishment count from the website: http://www.bls.gov/cew to determine the denominator for the Employer Penetration Rate.
• The latest available establishment count from the BLS website may not be the last quarter of the report period of the Employer Penetration Rate.⁵ QCEW figures typically have 6 months of lag time prior to release. Wisconsin will use the QCEW's establishment count from the most recent quarter available for the state and when applicable, local areas. The most recent quarter available must have figures populated on the BLS.gov website for each of Wisconsin's counties.
• DWD will indicate on the WIPS submission in the comments section which quarter QCEW establishment count was used in the calculation.
• The latest quarter may be preliminary (denoted with a 'p'). The QCEW notes that any changes from preliminary to final are usually minor.
• The establishment count accessed on September 1st or the first business day following, if September 1st is not a business day, is reported on the annual report. For any ad hoc reports that are not the annual report, the date and quarter that the establishment data was pulled from BLS must be annotated.

Business Services that count for performance indicators

• The Business Services in JCW Business that qualify for an establishment for performance reporting are listed in the Resource Box. These services may change upon approval of the permanent federal indicator of performance.

• ¹ Joint ICR, WIOA Effectiveness in Serving Employers Data Elements: Employer Penetration Rate and Repeat Business Customers
• ² Performance Report Template
• ³ Joint ICR, WIOA Effectiveness in Serving Employers Data Elements: Employer Penetration Rate and Repeat Business Customers
• ⁴ Federal Register, Vol 83, No 44
• ⁵ Performance Report Template

11.5.10 Additional Indicators of Performance

Effective date: August 7, 2017

The state may identify additional indicators of performance in the state plan. Future indictors must be approved by each core program. Additional guidance on new additional indicators of performance including methodologies, negotiations and consequences for not meeting standards shall be published in the state plan which the indicators are approved. In PY 2016 and PY 2017, the State has not identified additional indicators of performance.