TEGL7-99AttachC.pdf

ETA Advisory File Text

ATTACHMENT C GUIDANCE FOR CALCULATING WIA CORE MEASURES ii CONTENTS ChapterPage IINTRODUCTION..........................................................1 IIMATCHING PARTICIPANT FILES TO WAGE RECORDS.........................2 A.MATCHING SOCIAL SECURITY NUMBERS SSNS TO UI WAGE RECORD FILES............................................2 B.CREATING DATA SETS FOR PERFORMING CALCULATIONS...........4 1.Creating Multiple Records for Participants Funded by Dual Funding Streams ......................................................4 2.Cases Where Wage Records Are Not Available or Are Not Found..........6 3.Aggregating Wage Records from Multiple Employers.....................6 4.Removing Erroneous Data.........................................7 IIIADULT PROGRAM.........................................................8 A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE........................................................8 1.Create Files....................................................9 2.Calculate Performance...........................................12 B.EMPLOYMENT AND CREDENTIAL RATE...........................20 IVDISLOCATED WORKER PROGRAM.........................................24 A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE.......................................................24 B.EMPLOYMENT AND CREDENTIAL RATE...........................32 CONTENTS continued ChapterPage iii CONTENTS continued ChapterPage iv VYOUTH PROGRAM OLDER YOUTH AGED 19-21 ............................36 A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE.......................................................36 B.CREDENTIAL RATE..............................................48 VIYOUTH PROGRAM YOUNGER YOUTH 14-18 ...............................52 A.SKILL ATTAINMENT RATE.......................................52 1.Collect the Data................................................52 2.Calculate the Data..............................................54 B.DIPLOMA OR EQUIVALENT ATTAINMENT.........................54 1.Create Files...................................................54 2.Calculate Performance...........................................56 C.YOUNGER YOUTH RETENTION...................................59 1.Create Files...................................................61 2.Calculate Performance...........................................61 APPENDIX A DATA ELEMENT DEFINITIONS...............................A.1 v EXHIBITS ExhibitPage II.1TIMING OF PARTICIPANT PROGRAM ACTIVITIES AND DATA MATCHING ACTIVITIES FOR ENTERED EMPLOYMENT RETENTION AND EARNINGS GAIN REPLACEMENT MEASURES...........................................3 II.2EXAMPLE OF QUARTERS OF WAGES REQUIRED FOR PARTICIPANTS WHO EXIT IN THE FOURTH QUARTER OF 1999..................................................................5 III.1FOURTEEN GROUPS OF ADULT PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE......................................................10 III.2SAMPLE FILE OF ADULT PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE..............13 III.3WORKSHEET TO CALCULATE ADULT ENTERED EMPLOYMENT AND RETENTION RATES..................................................17 III.4WORKSHEET TO CALCULATE ADULT EARNINGS CHANGE...................19 III.5FOUR GROUPS OF ADULT PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE....................................21 III.6SAMPLE FILE OF ADULT PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE....................................22 III.7WORKSHEET TO CALCULATE ADULT EMPLOYMENT AND CREDENTIAL RATE.......................................................23 IV.1SEVEN GROUPS OF DISLOCATED WORKERS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS REPLACEMENT RATE.....................................................26 IV.2SAMPLE FILE OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS REPLACEMENT RATE..........................................28 EXHIBITS continued Exhibit Page vi IV.3WORKSHEET TO CALCULATE DISLOCATED WORKER ENTERED EMPLOYMENT AND RETENTION RATES...........................30 IV.4WORKSHEET TO CALCULATE DISLOCATED WORKER EARNINGS REPLACEMENT RATE..........................................31 IV.5FOUR GROUPS OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE.....................33 IV.6SAMPLE FILE OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE.....................34 IV.7DISLOCATED WORKER WORKSHEET TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE....................................35 V.1NINETEEN GROUPS OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE......................................................38 V.2SAMPLE FILE OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE......................................................41 V.3WORKSHEET TO CALCULATE OLDER YOUTH ENTERED EMPLOYMENT AND RETENTION RATES....................................45 V.4WORKSHEET TO CALCULATE OLDER YOUTH EARNINGS CHANGE................................................................47 V.5SIX GROUPS OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE CREDENTIAL RATE...........................................49 V.6SAMPLE FILE OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE CREDENTIAL RATE...........................................50 V.7WORKSHEET TO CALCULATE OLDER YOUTH CREDENTIAL RATE...................................................................51 EXHIBITS continued Exhibit Page vii VI.1FOUR GROUPS OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE DIPLOMA OR EQUIVALENT ATTAINMENT RATE...................................................................55 VI.2SAMPLE FILE OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE DIPLOMA OR EQUIVALENT ATTAINMENT RATE...................................................................57 VI.3WORKSHEET TO CALCULATE YOUNGER YOUTH DIPLOMA OR EQUIVALENT ATTAINMENT RATE......................................58 VI.4THREE GROUPS OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE RETENTION RATE ........................................60 VI.5SAMPLE FILE OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE RETENTION RATE.........................................62 VI.6WORKSHEET TO CALCULATE YOUNGER YOUTH RETENTION RATE...................................................................63 A.1DATA ELEMENT DEFINITIONS FOR CALCULATING WIA PERFORMANCE.................................................A.2 1 I. INTRODUCTION This attachment provides detailed programming specifications that States can use to calculate the WIA Performance Measures. These specifications are not required but offered as guidance. The programming specifications show in a tabular format how participants get counted in the numerator or denominator based on the operational definitions of the performance measures. In addition to the programming specifications this document also provides worksheets for calculating the measures. Chapter II discusses methods for collecting wage record information and ensuring that it is correct. Chapter III provides detailed specifications for calculating performance for the Adult Program. Chapter IV provides detailed specifications for calculating performance for the Dislocated Worker Program. Chapter V provides detailed specifications for calculating performance for the Youth Program for Older Youth. Chapter VI provides detailed specifications for calculating performance for the Youth Program for Younger Youth. Appendix A contains the definitions for each of the data elements used to calculate WIA performance. 2 II. MATCHING PARTICIPANT FILES TO WAGE RECORDS WIA requires the use of Unemployment Insurance UI wage record data to determine employment outcomes after exit and to calculate earnings change and earnings replacement rates. There are numerous steps that State staff must perform to create a data set which includes wage record information prior to performing the performance calculations. This section provides guidance on how to perform these tasks. There are three key points that States must bear in mind with regard to the use of wage records CStates should obtain access to as many years of historical wage records as possible. Participants who entered JTPA in prior years will have to be excluded from specific measures if wage records for past years are not available. CWage records are the primary source of information for employment after exit and the only source of information for earnings change replacement rates. If a participant does not appear in the wage records supplemental sources may be used to establish employment after exit. Wage records are not however used to determine employment status at registration. CStates must wait two full quarters after the quarter of wage activity before using the wage records or making the decision to use supplemental sources of information about employment if no wage records are located . The reasons for this include wage record submissions to the State Employment Security Agency are due from employers in general 30 days after the end of the quarter in which the wages were earned and the processing of 90 to 95 percent of wage record data normally takes 60 days beyond the report due date. A.MATCHING SOCIAL SECURITY NUMBERS SSNS TO UI WAGE RECORD FILES Matching SSNs of participants who exit WIA to wage record files can occur continuously or can occur at a minimum of twice for each quarter of exiters. States may choose to select wage records for the second and third quarters prior to the registration quarter as soon as someone is registered for WIA services. Exhibit II.1 illustrates the timing of participant program activities compared to data collection matching activities. States may also choose to wait until the end of the third quarter after the exit quarter to select UI wage records for the second and third quarters prior to the registration quarter. At this point States will also be able to calculate the entered employment measure. 3EXHIBIT II.1 TIMING OF PARTICIPANT PROGRAM ACTIVITIES AND DATA MATCHING ACTIVITIES FOR ENTERED EMPLOYMENT RETENTION AND EARNINGS GAIN REPLACEMENT MEASURES QuarterPre-Program Quarters 2-3 Registration QuarterPossible Activity Quarter s Exit QuarterPost-Program Quarter 1Post-Program Quarter 2Post-Program Quarter 3Post-Program Quarter 4Post-Program Quarter 5 Participant Program ActivityPossible Employment Earnings Used to Measure Earnings Gain Register Receive ServicesReceive ServicesExit Date within Quarter or Last Service Received for 90 Days Within QuarterPossible Employment Earnings Used to Measure EERPossible Employment Earnings Used to Measure Earnings GainPossible Employment Earnings Used to Measure Retention and Earnings GainNANA Internal Data Capturing Matching ActivityNoneDecision on Whether to Register or Not Determine Employment Status Capture Earnings for Pre-Program Quarters 2-3 Record Services ProvidedRecord Exit DateCreate Exit Group for Prior Qtr. Using Exit Date OR Not Receive Services for 90 DaysCapture Earnings for Post-Program Quarter 1Capture Lagged Earnings for Post-Program Quarter 1 and Earnings for Quarter 2 Report EERCapture Lagged Earnings for Post-Program Quarter 2 and Earnings for Quarter 3Capture Lagged Earnings for Post-Program Quarter 3 Report Retention and Earnings Gain Re- placement For the dislocated workers earnings retention measure earnings used for measurement are 2nd and 3rd quarter prior to the dislocation quarter. However if the date of dislocation is after registration quarters 2 and 3 prior to registration are used. 4 At the end of the fifth quarter after the exit quarter States will collect the UI wage record data for the third quarter after the exit quarter. At this point States can calculate the retention and earnings change replacement rate measures. To create the exit cohort States must select participants with exit dates in the quarter. States should then follow the guidelines presented in Section 4D of this TEGL for determining exit date. Once a State selects an exit cohort the next step is to divide that cohort into subgroups based on the entry quarter. Defining subgroups is necessary because the participants who exit during a specific quarter will have entered during a range of prior quarters. A State will have to retrieve wage record data for two specific quarters for each subgroup of the exit cohort. Participants who exit from a specific quarter such as October-December 1999 will have entered JTPA during a range of quarters from October- December 1999 back to 1997 and possibly even earlier. The earliest registration date will determine how far back a State must go to find wage records. For example if the earliest registration date for an exiter is January 1997 the earliest quarter of wage records that must be available is the April to June 1996 quarter. That quarter is the third quarter prior to the registration quarter. Each entry subgroup must be matched against a different set of quarters. Exhibit II.2 shows the quarters of wage records required for both the preprogram and post-program earnings for those who exited during the fourth quarter of 1999 and who registered between April 1997 and December 1999. The blank boxes indicate the specific quarters of wage records that are required assuming that at least one participant registered in each quarter between April 1997 and December 1999. Only two quarters of pre-program wage record data is required for each participant. B.CREATING DATA SETS FOR PERFORMING CALCULATIONS Once the correct wage records have been collected and matched to the SSNs there are still several other steps which must be accomplished before the performance calculations can be done. 1.Creating Multiple Records for Participants Funded by Dual Funding Streams If there are not already multiple records for participants funded by dual funding streams in the State s database it is necessary to create multiple records for such participants because they are included in more than one set of measures. For example CA participant who enters a State s program as a youth funded by the youth program and exits the program while being funded by the adult program should be included in both sets of measures. 5EXHIBIT II.2 EXAMPLE OF QUARTERS OF WAGES REQUIRED FOR PARTICIPANTS WHO EXIT IN THE FOURTH QUARTER OF 1999 Preprogram EarningsPost-program Earnings 123456789101112131415 96-396-497-197-297-397-498-198-298-398-499-199-200-100-200-3 99-4 99-3 99-2 99-1 98-4 98-3 98-2 98-1 97-4 97-3 97-2 6 CA participant who is funded by both the adult program and the dislocated worker program or by the dislocated worker program and the youth program should be counted in both sets of measures. This requirement to count a participant twice within a single exit cohort does not apply to youth who turn 19 while in the youth program. They are not included in both the younger youth measures and the older youth measures. They are only counted in the younger youth measures because age at registration defines the group of measures in which a youth is counted. Thus duplicate SSNs are appropriate within a set of records for an exit cohort if the duplicate SSNs are for different funding sources. However there should be no duplicate records with the same SSN funding source and exit date. 2.Cases Where Wage Records Are Not Available or Are Not Found If UI wage records cannot be accessed for preprogram earnings for participants who registered for JTPA in prior years these records should be excluded from earnings change replacement measure. If the wage records for the required quarters are available a zero should be inserted for all quarters where wage records were missing. For example if a participant registered in January 1997 and the State can only access wage records back to 1997 that participant should be excluded from the earnings change replacement measures as described in the calculation specifications. If however a participant registered in January 1999 and the State can access wage records back to 1997 but the participant does not appear in the wage records the participant should be given values of 0 for preprogram earnings. 3.Aggregating Wage Records from Multiple Employers One characteristic of UI wage data is that multiple UI wage records exist for participants who work for more than one employer during a particular wage quarter. These records will have duplicate SSN s but the employer code and earnings amounts will vary. Occasionally the employer code will be unavailable null . In cases where the employer code is unavailable it is appropriate to eliminate records where the SSN and wage value for that particular quarter are identical. Records with multiple values representing participants that work for more than one employer during a particular wage quarter must be added together to arrive at a total earnings for the participant in that quarter. For example if participant A earns 1 000 at job 1 in quarter 3 and 2 000 at job 2 in quarter 3 the total earnings for participant A in quarter 3 should be 3 000. 7 4.Removing Erroneous Data Data entry errors must be identified and excluded. This can be done as an exclusion rule or other method. For example the State should exclude all records with earnings greater than 40 000 in any one quarter. Exact duplicate wage records should be eliminated. For example duplicate wage records for the same SSN the same employer and the same dollar amount should be eliminated. 8 III. ADULT PROGRAM These specifications provide guidance for States to calculate performance for two sets of adults who exited from WIA services during a specific quarter 1.All adult exiters are subject to the entered employment retention and earnings change calculation. 2.Those adults who received training services and exited are also subject to the adult employment and credential rate measure. A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE This section specifies how to calculate the following three measures 1.Adult Entered Employment Rate Of those who are not employed at registration of adults who have entered employment by the end of the first quarter after exit of adults who exit during the quarter 2.Adult Employment Retention Rate Of those who are employed in the first quarter after exit of adults who are employed in third quarter after exit of adults who exit during the quarter 3.Adult Earnings Change in Six Months Of those who are employed in the first quarter after exit Total Post-Program Earnings earnings in quarter 2 quarter 3 after exit - Pre-Program Earnings earnings in quarters 2 3 prior to registration of adults who exit during the quarter 9 The specifications explain how an exit cohort of participants can be logically grouped into separate categories based on their pre- and post-service employment status and their employment retention status see Exhibit III.1 Fourteen Groups of Adult Participants Used to Calculate Entered Employment Retention and Earnings Change . Once States determine the number of participants who fit each category they can easily compute these three measures. Dislocated workers who are co- enrolled in the adult funding stream should be included in both dislocated worker and adult measures. This section also explains how to select the quarters of exiters and wage records to use for simulating WIA performance and for actual WIA reporting. 1.Create Files One way to calculate performance is to create extract files of data elements from the State s workforce development database for sets of participants who exit during a specific quarter and are thus subject to performance measurement. If there is no central database in the State the extract files can be built from data sets provided by local WIA areas. There are two advantages to building files specifically to calculate performance. First that approach is used to specify the calculations in this document. Second these files can serve as a very convenient method to check the accuracy of the calculations because they are a well-organized and easy to understand record of the data used in the calculations. Exhibit III.1 shows the fourteen possible measurement outcomes for WIA participants for the combination of the entered employment retention and earnings change measures. These fourteen outcomes are based on the participant s employment status prior to registration their employment status one quarter and three quarters after exit and the change from their pre-program to their post- program earnings. Wage records are the primary data source for employment in the first and third quarters after exit. Supplemental sources to establish employment are allowed if participants are not found in the wage records. Participants whose employment is established from supplemental sources are excluded from the earnings calculations. If States do not have supplementary information on employment to simulate WIA performance participant groups 1.2 1.3 1.4 1.6 1.9 1.10 1.11 and 1.13 will be blank. In such situations performance level estimates will be based solely on wage record data. For example participants in group 1.3 were determined to be employed in the first quarter after the exit quarter from supplementary data and did not have earnings in the wage records. These participants are excluded from the earnings change measure. Columns 6 through 10 show how the count of participants in each group or the sum of their earnings for the earnings change measure is used to calculate each measure. For example participants in group 1.1 would appear in the numerator and denominator of the entered employment rate the numerator and denominator of the retention rate and would be included in the earnings change measure. 1010EXHIBIT III.1 FOURTEEN GROUPS OF ADULT PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetentionEarnings Change 12345678910 Participant GroupEmployment Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in DenominatorParticipant Earnings Included in Calculation of Measure 1.1Not EmployedYESWage RecordsYESWage RecordsYESYESYESYESYES 1.2Not EmployedYESWage RecordsYESSupplementary SourceYESYESYESYESNO 1.3Not EmployedYESSupplementary SourceYESWage RecordsYESYESYESYESNO 1.4Not EmployedYESSupplementary SourceYESSupplementary SourceYESYESYESYESNO 1.5Not EmployedYESWage RecordsNONAYESYESNOYESYES 1.6Not EmployedYESSupplementary SourceNONAYESYESNOYESNO 1.7Not EmployedNONANANANOYESNONONO 1.8EmployedYESWage RecordsYESWage RecordsNONOYESYESYES 1.9EmployedYESWage RecordsYESSupplementary SourceNONOYESYESNO 1.10EmployedYESSupplementary SourceYESWage RecordsNONOYESYESNO EXHIBIT III.1 continued Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetentionEarnings Change 12345678910 Participant GroupEmployment Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in DenominatorParticipant Earnings Included in Calculation of Measure1.11EmployedYESSupplementary SourceYESSupplementary SourceNONOYESYESNO 1.12EmployedYESWage Records NONANONONOYESYES 1.13EmployedYESSupplementary SourceNONANONONOYESNO 1.14EmployedNONANANANONONONONO 1 States can use the specifications to calculate only the entered employment rate when only wage records for the first quarter after the exit quarter are used. If no wage records for the third quarter after the exit quarter are used participants will only fall into categories 1.5-1.7 and 1.12-1.14 the retention rate will be zero and the earnings worksheet should not be filled in. When the wage record data for the third quarter after the exit quarter are added the specifications can be used to calculate the retention rate and the earnings change. 12 Perform the following steps in order to create the files. Step 1 Select exiters and extract the data elements required for the adult measure as specified in Exhibit III.1. Participants who exit from the program under the following conditions should be excluded from the measures CFor JTPA participant data exclude those who received objective assessment only and Title II 8 funded programs. CParticipants who exit from services because they are incarcerated institutionalized deceased or have a health medical condition that prevent them from participating in services should be excluded from the measures. Step 2 Sort into participant groups based on the criteria in Exhibit III.1. For example If employment status at registration is unemployed earnings are greater than zero in the first quarter after the exit quarter and earnings are greater than zero in the third quarter after the exit quarter assign to participant group 1.1. Step 3 Subtotal the number of participants and any earnings in each group. 2.Calculate Performance Exhibit III.2 Sample File of Adult Participants Used to Calculate Entered Employment Retention and Earnings Change shows a sample file of participants sorted into the fourteen groups with subtotals of the number of participants in each group.1 Step 4 Copy the number of participants in each group onto the worksheet to calculate adult entered employment and retention rates. Copy the number of participants and the dollars for each quarter for each group onto the worksheet to calculate adult earnings change. 13EXHIBIT III.2 SAMPLE FILE OF ADULT PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants and Any Earnings in Each Group 1234567891011 Participant GroupSSNExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other Sources 1.13843402687 15 99AdultNot Employed2 0002 0005 000Wage Records4 0005 000Wage Records 1.11945839438 21 99AdultNot Employed3 0003 0002 000Wage Records5 0002 000Wage Records Subtotal2 Participants5 0005 0007 0009 0007 000 1.26830638589 9 99AdultNot EmployedNANA3 000Wage RecordsNA0Supplementary Source 1.26839457297 15 99AdultNot EmployedNANA2 000Wage RecordsNA0Supplementary Source Subtotal2 ParticipantsNANA5 000NA0 1.33293683748 22 99AdultNot EmployedNANA0Supplementary SourceNA11 000Wage Records 1.32042948357 06 99AdultNot EmployedNANA0Supplementary SourceNA2 000Wage Records Subtotal2 ParticipantsNANA0NA13 000 1.41528965809 9 99AdultNot EmployedNANA0Supplementary SourceNA0Supplementary Source 1.42568710098 15 99AdultNot EmployedNANA0Supplementary SourceNA0Supplementary Source 1.41268597457 15 99AdultNot EmployedNANA0Supplementary SourceNA0Supplementary Source Subtotal3 ParticipantsNANA0NA0 EXHIBIT III.2 continued 1234567891011 Participant GroupSSNExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other Sources141.51396820469 8 99AdultNot Employed6 0002 0002 000Wage Records2 0000NA 1.52659303699 15 99AdultNot Employed01 0003 000Wage Records3 0000NA Subtotal2 Participants6 0003 0005 0005 0000NA 1.61638603457 31 99AdultNot EmployedNANA0Supplementary SourceNA0NA 1.65345933968 15 99AdultNot EmployedNANA0Supplementary SourceNA0NA Subtotal2 ParticipantsNANA0NA0NA 1.71638603457 31 99AdultNot EmployedNANA0NANANANA 1.75345933918 15 99AdultNot EmployedNANA0NANANANA 1.72593406838 12 99AdultNot EmployedNANA0NANANANA Subtotal3 ParticipantsNANA0NANANANA 1.81638603417 31 99AdultEmployed04 0006 000Wage Records10 0006 000Wage Records 1.85345933878 15 99AdultEmployed5 0005 0006 000Wage Records06 000Wage Records Subtotal2 Participants5 0009 00012 00010 00012 000 1.91638603337 31 99AdultEmployedNANA6 000Wage RecordsNA0Supplementary Source Subtotal1 ParticipantNANA6 000NA0 1.103168603457 31 99AdultEmployed01 0002 000Supplementary Source04 000Wage Records 1.103335459968 15 99AdultEmployed5 0001 0003 000Supplementary Source05 000Wage Records Subtotal2 Participants5 0002 0005 00009 000 EXHIBIT III.2 continued 1234567891011 Participant GroupSSNExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other Sources151.110123456787 15 99AdultEmployedNANA2 000Supplementary SourceNA3 000Supplementary Source 1.114876543218 22 99AdultEmployedNANA3 000Supplementary SourceNA4 000Supplementary Source 1.117654321489 9 99AdultEmployedNANA2 000Supplementary SourceNA3 000Supplementary Source Subtotal3 ParticipantsNANA7 000NA10 000 1.128412345677 15 99AdultEmployed4 0001 0005 000Wage Records1 0000NA 1.127656461238 15 99AdultEmployed2 00004 000Wage Records1 0000NA Subtotal2 Participants6 0001 0009 0002 0000NA 1.13461236568 21 99AdultEmployedNANA2 000Supplementary SourceNA0NA Subtotal1 ParticipantNANA2 000NA0NA 1.140612365648 12 99AdultEmployedNANA0NANANANA 1.147898765657 31 99AdultEmployedNANA0NANANANA Subtotal2 ParticipantsNANA0NANANANA 16 Exhibit III.3 Worksheet to Calculate Adult Entered Employment and Retention Rates provides an example of how entered employment and retention rates are calculated. The participant group subtotals have been entered into this spreadsheet by using the data from the sample file Exhibit III.2 . The number of participants in each category are entered into the relevant boxes in the worksheet under numerator and denominator boxes that are not shaded . The total for each column is then calculated. The entered employment and retention rates are calculated by dividing the numerator totals by the denominator totals for each measure. Step 5 Add totals for each column on the worksheet. Step 6 Perform the calculations. Exhibit III.4 Worksheet to Calculate Adult Earnings Change provides an example of how earnings change is calculated. Enter data onto this spreadsheet from the sample data file Exhibit III.2 . Enter pre-program wages for the second and third quarters prior to entry as well as the post-program wages for the second and third quarters after exit. Following the directions indicated on the spreadsheet Exhibit III.4 subtotal the sum of the pre-program wages Column A . Subtotal the sum of the post-program quarters in Column B and derive the net total earnings by subtracting the total of Column A from the total of Column B. Finally calculate the Average Earnings Change by dividing the Net Total Earnings Column D by the total number of participants Column C . Do not complete the earnings worksheet until the wage records from the third quarter after exit are complete. 17EXHIBIT III.3 WORKSHEET TO CALCULATE ADULT ENTERED EMPLOYMENT AND RETENTION RATES Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant Characteristics Use of Each Group in Performance Measures Entered EmploymentRetention 123456789 Employment Status at RegistrationEmployed First Quarter After Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in Denominator 1.1Not EmployedYESWage RecordsYESWage Records2222 1.2Not EmployedYESWage RecordsYESSupplementary Source2222 1.3Not EmployedYESSupplementary SourceYESWage Records2222 1.4Not EmployedYESSupplementary SourceYESSupplementary Source3333 1.5Not EmployedYESWage RecordsNONA22NO2 1.6Not EmployedYESSupplementary SourceNONA22NO2 1.7Not EmployedNONANANANO3NONO 1.8EmployedYESWage RecordsYESWage RecordsNONO22 1.9EmployedYESWage RecordsYESSupplementary SourceNONO11 1.10EmployedYESSupplementary SourceYESWage RecordsNONO22 EXHIBIT III.3 continued Participant GroupParticipant Characteristics Use of Each Group in Performance Measures Entered EmploymentRetention 123456789 Employment Status at RegistrationEmployed First Quarter After Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in Denominator181.11EmployedYESSupplementary SourceYESSupplementary SourceNONO33 1.12EmployedYESWage RecordsNONANONONO2 1.13EmployedYESSupplementary SourceNONANONONO1 1.14EmployedNONANANANONONONO TOTAL13161724 DIVIDE NUMERATOR BY DENOMINATOR81 71 19EXHIBIT III.4 WORKSHEET TO CALCULATE ADULT EARNINGS CHANGE Step 4 Copy the Number of Participants and Dollars in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupQuarters Prior to Entry QuarterAQuarters After Exit QuarterB AdultsNumber of Participants3rd 2nd Sum of Quarters2nd 3rdSum of QuartersB Minus A 1.12 5 000 5 000 10 000 9 000 7 000 16 000 6 000 1.2 1.3 1.4 1.52 6 000 3 000 9 000 5 000 0 5 000 4 000 1.6 1.7 1.82 5 000 9 000 14 000 10 000 12 000 22 000 8 000 1.9 1.10 1.11 1.122 6 000 1 000 7 000 2 000 0 2 000 5 000 1.13 1.14 C Total Participants8D Net Total Earnings 5 000 Average Earnings Change D Divided by C 625 20 21 B.EMPLOYMENT AND CREDENTIAL RATE This section specifies how to calculate the adult employment and credential rate measure Of adults who receive training services of adults who were employed in the 1st quarter after exit and received a credential by the end of the 3rd quarter after exit of adults who exited services during the quarter This section explains how an exit cohort of adults can be logically grouped into four separate categories based on whether they received training services whether they were employed in the first quarter after the exit quarter and whether they received a credential within three quarters after the exit quarter. See Exhibit III.5 Four Groups of Adult Participants Used to Calculate Employment and Credential Rate. Once States determine the number of participants who fit each category they can easily compute this measure. The adult exit cohort which is included in this measure is a subset of participant group 1 the group of adults who exited during the quarter which is used to measure entered employment retention and earnings change. The primary data source for determining employment will be the UI wage records. Supplemental sources will be used if an individual is not found in the UI wage records. The primary source to determine credential is through ongoing contact follow-up with participants to determine that the individual has received a credential and then obtaining written documentation of that credential. In addition record sharing and or automated record matching with administrative other databases may also be used to determine and document that the participant has received a credential. From participant group 1 select those adults who received WIA or WIA partner-funded training services while registered in WIA. If the participant was employed in the first quarter after the exit quarter as determined either through wage records or through a supplementary source record a yes in column 2. This would include all participants in participant groups 1.1 through 1.6 and those participants in groups 1.8 through 1.10 who were employed in the first quarter after exit as determined from wage records or a supplemental source. Exhibits III.6 and III.7 are a sample file of adult participants used to calculate the employment and credential rate and the worksheet used to calculate this measure. 22EXHIBIT III.5 FOUR GROUPS OF ADULT PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Received Training ServicesEmployed First Quarter after Exit QuarterAttained State- Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 2.1YESYESYESYESYES 2.2YESNOYESNOYES 2.3YESNONONOYES 2.4YESYESNONOYES 23EXHIBIT III.6 SAMPLE FILE OF ADULT PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants in Each Group 1234567 Participant GroupSSNRegistration DateReceived Training ServicesExit DateFunding SourceEmployed First Quarter after Exit QuarterAttained State Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters after Exit Quarter 2.13843402681 15 99YES7 15 99AdultYESYES 2.18620434835 31 99YES9 25 99AdultYESYES 2.13943854916 9 99YES9 3 99AdultYESYES 2.11945839434 21 99YES8 21 99AdultYESYES Subtotal4 Participants 2.26830638583 23 99YES9 9 99AdultNOYES 2.26839457294 8 99YES7 15 99AdultNOYES Subtotal2 Participants 2.329754938612 15 98YES7 20 99AdultNONO Subtotal1 Participant 2.40638586839 30 98YES8 15 99AdultYESNO Subtotal1 Participant 24EXHIBIT III.7 WORKSHEET TO CALCULATE ADULT EMPLOYMENT AND CREDENTIAL RATE Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Received Training ServicesEmployed First Quarter after Exit QuarterAttained State-Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 2.1YESYESYES 44 2.2YESNOYESNO2 2.3YESNONONO1 2.4YESYESNONO1 TOTAL48 DIVIDE NUMERATOR BY DENOMINATOR50 25 IV. DISLOCATED WORKER PROGRAM These specifications provide guidance for States to calculate performance for two sets of dislocated workers who exited from WIA services during a specific quarter 1.All dislocated worker exiters are subject to the entered employment retention and earnings replacement rate measures. 2.Those dislocated workers who received training services and exited are also subject to the dislocated worker employment and credential measure. A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE This section specifies how to calculate the following three measures 1.Dislocated Worker Entered Employment Rate of dislocated workers who have entered employment by the first quarter after exit of dislocated workers who exit during the quarter 2.Dislocated Worker Employment Retention Rate Of those who are employed in the first quarter after exit of dislocated workers who are employed in the 3rd quarter after exit of dislocated workers who exit during the quarter 3.Dislocated Worker Earnings Replacement Rate Of those who are employed in the first quarter after exit Total Post-Program Earnings earnings in quarter 2 quarter 3 after exit TABLE 1 continued 2 For dislocated workers with no date of dislocation or if the date of dislocation is after registration quarters 2 and 3 prior to registration will be used. 26 Pre-Dislocation Earnings earnings in quarters 2 and 3 prior to dislocation 2 3 States can use the specifications to calculate only the entered employment rate when only wage records for the first quarter after the exit quarter are used. If no wage records for the third quarter after the exit quarter are used participants will only fall into categories 3.5 to 3.7 the retention rate will be zero and the earnings worksheet should not be filled in. When the wage record data for the third quarter after the exit quarter are added the specifications can be used to calculate the retention rate and the earnings replacement rate. 27 This section explains how an exit cohort of dislocated workers can be logically grouped into seven separate categories based on their pre- and post-service employment status and their employment retention status see Exhibit IV.1 Seven Groups of Dislocated Workers Used to Calculate Entered Employment Retention and Earnings Replacement Rate . Once States determine the number of participants who fit each category they can easily compute these three measures. Dislocated workers who are co-enrolled in the adult funding stream should be included in both dislocated worker and adult measures. The same would be true for dislocated workers who are co-enrolled in the older youth funding stream. The steps to create the files and calculate the measures for dislocated workers are very similar to the steps outlined in Chapter III Section A. There are only two differences between the adult specifications and the dislocated worker specifications 1.First dislocated workers by definition are not employed at registration therefore the participant categories equivalent to the adult categories 1.8 through 1.14 do not apply. 2.Instead of subtracting preprogram earnings from postprogram earnings to calculate earnings change divide postprogram earnings by predislocation earnings to calculate an earnings replacement rate. As in creating the files for adult measures participants who exit from the program under the following conditions should be excluded from the measures CFor JTPA participant data exclude those who received objective assessment only and Title II 8 funded programs. CParticipants who exit from services because they are incarcerated institutionalized deceased or have a health medical condition that prevent them from participating in services should be excluded from the measures. CFor JTPA participant data exclude dislocated workers served exclusively with National Reserve Account NRA funds. For WIA participant data exclude dislocated workers served exclusively with National Emergency Grants. Following are specifications for how the files for dislocated workers should be created as well as sample performance calculation spreadsheets. Exhibit IV.1 shows that there are seven possible measurement outcomes for WIA participants for the combination of the entered employment retention and earnings replacement rate measures. These seven outcomes are based on the participant s employment status one quarter and three quarters after exit.3 28EXHIBIT IV.1 SEVEN GROUPS OF DISLOCATED WORKERS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS REPLACEMENT RATE Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetentionEarnings Replacement Rate 12345678910 Participant GroupEmployment Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in DenominatorParticipant Earnings Included in Calculation of Measure 3.1Dislocated WorkerYESWage RecordsYESWage RecordsYESYESYESYESYES 3.2Dislocated WorkerYESWage RecordsYESSupplementary SourceYESYESYESYESNO 3.3Dislocated WorkerYESSupplementary SourceYESWage RecordsYESYESYESYESNO 3.4Dislocated WorkerYESSupplementary SourceYESSupplementary SourceYESYESYESYESNO 3.5Dislocated WorkerYESWage RecordsNONAYESYESNOYESYES 3.6Dislocated WorkerYESSupplementary SourceNONAYESYESNOYESNO 3.7Dislocated WorkerNONANANANOYESNONONO 29 Columns 6 through 10 show how the count of participants in each group or the sum of their earnings for the earnings replacement rate measure is used to calculate each measure. For example participants in category 3.1 would appear in the numerator and denominator of the entered employment rate the numerator and denominator of the retention rate and would have the earnings replacement measure calculated. Exhibit IV.2 Sample File of Dislocated Worker Participants Used to Calculate Entered Employment Retention and Earnings Replacement Rate shows a sample file of dislocated workers. Exhibit IV.3 Worksheet to Calculate Dislocated Worker Entered Employment and Retention Rates shows how to calculate entered employment and retention and Exhibit IV.4 Worksheet to Calculate Dislocated Worker Earnings Replacement Rate shows how to calculate the earnings replacement rate. 3030EXHIBIT IV.2 SAMPLE FILE OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS REPLACEMENT RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants and Any Earnings in Each Group Participant Group1234567891011 SSNExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to Dislocation or if not available registration Wages 2 Quarters Prior to Dislocation or if not available registration Wages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other Sources 3.13843402687 15 99DWDW3 0003 0004 000Wage Records5 0004 000Wage Records 3.11945839438 21 99DWDW2 0003 0002 000Wage Records2 0002 000Wage Records Subtotal2 Participants5 0006 0006 0007 0006 000 3.26830638589 9 99DWDWNANA3 000Wage RecordsNA0Supplementary Source 3.26839457297 15 99DWDWNANA2 000Wage RecordsNA0Supplementary Source Subtotal2 ParticipantsNANA5 000NA0 3.33293683748 22 99DWDWNANA0Supplementary SourceNA11 000Wage Records 3.32042948357 06 99DWDWNANA0Supplementary SourceNA2 000Wage Records 3.31262161097 1 99DWDWNANA0Supplementary SourceNA4 000Wage Records Subtotal3 ParticipantsNANA0NA17 000 3.41528965809 9 99DWDWNANA0Supplementary SourceNA0Supplementary Source 3.42568710098 15 99DWDWNANA0Supplementary SourceNA0Supplementary Source Subtotal2 ParticipantsNANA0NA0 EXHIBIT IV.2 continued Participant Group1234567891011 SSNExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to Dislocation or if not available registration Wages 2 Quarters Prior to Dislocation or if not available registration Wages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other Sources3.51396820469 8 99DWDW8 0006 0001 000Wage Records1 0000NA Subtotal1 Participant8 0006 0001 0001 0000NA 3.61638603457 31 99DWDWNANA0Supplementary SourceNA0NA 3.65345933968 15 99DWDWNANA0Supplementary SourceNA0NA 3.61278310167 30 99DWDWNANA0Supplementary SourceNA0NA Subtotal3 ParticipantsNANA0NA0NA 3.71638603547 31 99DWDWNANA0NANANANA 3.75345996338 15 99DWDWNANA0NANANANA Subtotal2 ParticipantsNANA0NANANANA 32EXHIBIT IV.3 WORKSHEET TO CALCULATE DISLOCATED WORKER ENTERED EMPLOYMENT AND RETENTION RATES Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetention 123456789 Employment Status at RegistrationEmployed First Quarter After Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourcesEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourcesCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in Denominator 3.1Dislocated Worker YESWage RecordsYESWage Records2222 3.2Dislocated WorkerYESWage RecordsYESSupplementary Source2222 3.3Dislocated WorkerYESSupplementary SourceYESWage Records3333 3.4Dislocated WorkerYESSupplementary SourceYESSupplementary Source2222 3.5Dislocated WorkerYESWage RecordsNONA11NO1 3.6Dislocated WorkerYESSupplementary SourceNONA33NO3 3.7Dislocated WorkerNONANANANO2NONO TOTAL1315913 DIVIDE THE NUMERATOR BY THE DENOMINATOR87 69 33EXHIBIT IV.4 WORKSHEET TO CALCULATE DISLOCATED WORKER EARNINGS REPLACEMENT RATE Step 4 Copy the Total Dollars in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupQuarters Prior to Dislocation QuarterAQuarters After Exit QuarterBReplacement Rate 3rd 2nd Sum of Quarters2nd 3rd Sum of QuartersB Divided by A 3.1 5 000 6 000 11 000 7 000 6 000 13 000118 3.2 3.3 3.4 3.5 8 000 6 000 14 000 1 000 0 1 0007 3.6 3.7 Total 13 000 12 000 25 000 8 000 6 000 14 000 56 REPLACEMENT RATE CALCULATION DIVIDE TOTAL B BY TOTAL A 34 B.EMPLOYMENT AND CREDENTIAL RATE This section specifies how to calculate the dislocated worker employment and credential rate measure Of those who receive training services of dislocated workers who were employed in the 1st quarter after exit and received credential by the end of 3rd quarter after exit of dislocated workers who exit during the quarter This section explains how an exit cohort of dislocated workers can be logically grouped into four separate categories based on whether they received training services whether they were employed in the first quarter after the exit quarter and whether they received a credential within three quarters after the exit quarter. See Exhibit IV.5 Four Groups of Dislocated Worker Participants Used to Calculate Employment and Credential Rate. Once States determine the number of participants who fit each category they can easily compute this measure. The dislocated worker exit cohort which is included in this measure is a subset of participant group 3 the group of dislocated workers who exited during the quarter used to measure entered employment retention and earnings replacement rate. The same data sources described in the adult employment and credential rate specification are used. From participant group 3 select those dislocated workers who received WIA or WIA partner- funded training services while registered in WIA. If the participant was employed in the first quarter after the exit quarter as determined either through wage records or through a supplementary source record a yes in column 2. This would include all participants in participant groups 3.1 through 3.6. Exhibits IV.6 and IV.7 are a sample file of dislocated worker participants used to calculate the employment and credential rate and the worksheet used to calculate this measure. 35EXHIBIT IV.5 FOUR GROUPS OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Received Training ServicesEmployed First Quarter after Exit QuarterAttained State- Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 4.1YESYESYESYESYES 4.2YESNOYESNOYES 4.3YESNONONOYES 4.4YESYESNONOYES 36EXHIBIT IV.6 SAMPLE FILE OF DISLOCATED WORKER PARTICIPANTS USED TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants in Each Group 1234567 Participant GroupSSNRegistration DateReceived Training ServicesExit DateFunding SourceEmployed First Quarter after Exit QuarterAttained State Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters after Exit Quarter 4.13843402681 15 99YES7 15 99Dislocated WorkerYESYES 4.18620434835 31 99YES9 25 99Dislocated WorkerYESYES 4.13943854916 9 99YES9 3 99Dislocated WorkerYESYES 4.11945839434 21 99YES8 21 99Dislocated WorkerYESYES Subtotal4 Participants 4.26830638583 23 99YES9 9 99Dislocated WorkerNOYES 4.26839457294 8 99YES7 15 99Dislocated WorkerNOYES Subtotal2 Participants 4.329754938612 15 98YES7 20 99Dislocated WorkerNONO Subtotal1 Participant 4.40638586839 30 98YES8 15 99Dislocated WorkerYESNO Subtotal1 Participant 37EXHIBIT IV.7 DISLOCATED WORKER WORKSHEET TO CALCULATE EMPLOYMENT AND CREDENTIAL RATE Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Received Training ServicesEmployed First Quarter after Exit QuarterAttained State-Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 4.1YESYESYES 44 4.2YESNOYESNO2 4.3YESNONONO1 4.4YESYESNONO1 TOTAL48 DIVIDE NUMERATOR BY DENOMINATOR50 38 V. YOUTH PROGRAM OLDER YOUTH AGED 19-21 These specifications provide guidance for States to calculate performance for older youth who exited from WIA services during a specific quarter as defined All older youth exiters except those who move into post-secondary are subject to the entered employment retention earnings change and credential rate calculations. Older youth are those aged 19 through 21 on the date that they register for WIA services. A.ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE This section specifies how to calculate the following three measures for older youth 1.Older Youth 19-21 years old Entered Employment Rate Of those who are not employed at registration and do not move on to post-secondary education or advanced training of older youth who have entered employment by the end of the 1st quarter after exit of older youth who exit during the quarter 2.Older Youth Employment Retention Rate Of those who are employed in the first quarter after exit and who do not move on to post- secondary or advanced training of older youth who are employed in the 3rd quarter after exit of older youth who exit during the quarter 3.Older Youth Earnings Change in Six Months Of those who are employed in the first quarter after exit and who do not move on to post- secondary education or advanced training Total Post-Program Earnings earnings in quarter 2 quarter 3 after exit - Pre-Program Earnings earnings in quarters 2 3 prior to registration 39 of older youth who exit during the quarter 40 This section explains how an exit cohort of older youth can be logically grouped into nineteen separate categories based on their pre- and post-service employment status and their employment retention status see Exhibit V.1 Nineteen Groups of Older Youth Participants Used to Calculate Entered Employment Retention and Earnings Change . Once States determine the number of participants who fit each category they can easily compute these three measures. Dislocated workers who are co-enrolled in the older youth funding stream should be included in both dislocated and older youth measures. This section also explains how to select the quarters of exiters and wage records to use for simulating WIA performance and for actual WIA implementation. The methodology for calculating performance for older youth is very similar to that used for calculating performance for adults and dislocated workers. There are five additional outcomes for the older youth measure compared to the adult measure because older youth who are in post secondary education or advanced training in the first quarter after the exit quarter are exempted from the measures. These participants fall into group 5.10. Older youth who are not in post secondary education or advanced training in the first quarter after the exit quarter and are not employed in the third quarter after the exit quarter but are in post secondary education or advanced training in the third quarter after the exit quarter are exempted from the retention and earnings change measures. These participants fall into groups 5.6 5.8 5.16 and 5.18. As with the adult and dislocated worker measures participants who exit from the program under the following conditions should be excluded from the measures CFor JTPA participant data exclude those who received objective assessment only and Title II 8 funded programs. CParticipants who exit from services because they are incarcerated institutionalized deceased or have a health medical condition that prevent them from participating in services should be excluded from the measures. Exhibit V.1 shows the nineteen possible measurement outcomes for older youth participants for the combination of the entered employment retention and earnings change rate measures. These nineteen outcomes are based on the participant s employment status at registration their employment status one quarter and three quarters after exit and whether they were in post-secondary education or advanced training in the first or third quarters after exit. Columns 7 through 11 show how the count of participants in each group or the sum of their earnings for the earnings change measure is used to calculate each measure. For example participants in category 5.1 would appear in the numerator and denominator of the entered employment rate the numerator and denominator of the retention rate and would be included in the earnings change measure. 41EXHIBIT V.1 NINETEEN GROUPS OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetentionEarnings Change 123456789101112 Participa nt GroupEmployme nt Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourceEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourceIn Post Secondary Education or Advanced Training In First Quarter after Exit Quarter Post Secondary Education or Advanced Training In Third Quarter after Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in DenominatorParticipant Earnings Included in Calculation of Measure 5.1Not EmployedYESWage RecordsYESWage RecordsNANAYESYESYESYESYES 5.2Not EmployedYESWage RecordsYESSupplementar y SourceNANAYESYESYESYESNO 5.3Not EmployedYESSupplementary SourceYESWage RecordsNANAYESYESYESYESNO 5.4Not EmployedYESSupplementary SourceYESSupplementar y SourceNANAYESYESYESYESNO 5.5Not EmployedYESWage RecordsNONANANOYESYESNOYESYES 5.6Not EmployedYESWage RecordsNONANAYESYESYESNONONO 5.7Not EmployedYESSupplementary SourceNONANANOYESYESNOYESNO 5.8Not EmployedYESSupplementary SourceNONANAYESYESYESNONONO 5.9Not EmployedNONANANANONANOYESNONONO EXHIBIT V.1 continued Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetentionEarnings Change 123456789101112 Participa nt GroupEmployme nt Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourceEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourceIn Post Secondary Education or Advanced Training In First Quarter after Exit Quarter Post Secondary Education or Advanced Training In Third Quarter after Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in DenominatorParticipant Earnings Included in Calculation of Measure425.10Not EmployedNONANANAYESNANONONONONO 5.11EmployedYESWage RecordsYESWage RecordsNANANONOYESYESYES 5.12EmployedYESWage RecordsYESSupplementar y SourceNANANONOYESYESNO 5.13EmployedYESSupplementary SourceYESWage RecordsNANANONOYESYESNO 5.14EmployedYESSupplementary SourceYESSupplementar y SourceNANANONOYESYESNO 5.15EmployedYESWage RecordsNONANANONONONOYESYES 5.16EmployedYESWage RecordsNONANAYESNONONONONO 5.17EmployedYESSupplementary SourceNONANANONONONOYESNO 5.18EmployedYESSupplementary SourceNONANAYESNONONONONO 5.19EmployedNONANANANANANONONONONO 43 Exhibit V.2 is a sample file of older youth participants used to calculate the three measures. Exhibit V.3 is the worksheet used to calculate the older youth entered employment and retention rates and Exhibit V.4 is the worksheet used to calculate the older youth earnings change rate. These worksheets are similar in function to the adult worksheets. 44EXHIBIT V.2 SAMPLE FILE OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE ENTERED EMPLOYMENT RETENTION AND EARNINGS CHANGE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants and Any Earnings in Each Group 123456789101112131415 Participant GroupSSNBirthdateRegistration DateExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other SourcesIn Post Secondary or Advanced Training in First Quarter After Exit QuarterIn Post Secondary or Advanced Training in Third Quarter After Exit Quarter 5.13843402686 1 796 1 997 15 99 YouthNot Employed2 0002 0005 000Wage Records4 0005 000Wage RecordsNANA 5.11945839438 14 796 15 998 21 99 YouthNot Employed3 0003 0002 000Wage Records5 0002 000Wage RecordsNANA Subtotal2 Participants5 0005 0007 0009 0007 000NANA 5.26830638582 2 793 13 999 9 99 YouthNot EmployedNANA3 000Wage RecordsNA0Supplementary SourceNANA 5.268394572910 10 792 27 997 15 99 YouthNot EmployedNANA2 000Wage RecordsNA0Supplementary SourceNANA Subtotal2 ParticipantsNANA5 000NA0NANA 5.332936837411 8 781 27 998 22 99 YouthNot EmployedNANA0Supplementary SourceNA11 000Wage RecordsNANA 5.32042948356 2 791 28 997 06 99 YouthNot EmployedNANA0Supplementary SourceNA2 000Wage RecordsNANA Subtotal2 ParticipantsNANA0NA13 000NANA EXHIBIT V.2 continued 123456789101112131415 Participant GroupSSNBirthdateRegistration DateExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other SourcesIn Post Secondary or Advanced Training in First Quarter After Exit QuarterIn Post Secondary or Advanced Training in Third Quarter After Exit Quarter455.41528965809 9 794 3 999 9 99 YouthNot EmployedNANA0Supplementary SourceNA0Supplementary SourceNANA 5.42568710098 24 792 18 998 15 99 YouthNot EmployedNANA0Supplementary SourceNA0Supplementary SourceNANA 5.412685974510 17 781 8 997 15 99 YouthNot EmployedNANA0Supplementary SourceNA0Supplementary SourceNANA Subtotal3 ParticipantsNANA0NA0NANA 5.51396820461 29 793 5 999 8 99 YouthNot Employed6 0002 0002 000Wage Records2 0000NANANO 5.52659303694 30 794 2 999 15 99 YouthNot Employed01 0003 000Wage Records4 0000NANANO Subtotal2 Participants6 0003 0005 0006 0000NANA 5.683021478512 21 781 6 999 9 99 YouthNot EmployedNANA4 000Wage RecordsNA0NANAYES 5.60486912715 3 792 14 999 16 99 YouthNot EmployedNANA5 000Wage RecordsNA0NANAYES Subtotal2 ParticipantsNANA9 000NA0NANA 5.716386034512 1 783 3 997 31 99 YouthNot EmployedNANA0Supplementary SourceNA0NANANO 5.753459339611 30 782 18 998 15 99 YouthNot EmployedNANA0Supplementary SourceNA0NANANO Subtotal2 ParticipantsNANA0NA0NANA 5.83396534596 2 791 26 997 31 99 YouthNot EmployedNANA0Supplementary SourceNA0NANAYES 5.803451638611 8 792 21 998 15 99 YouthNot EmployedNANA0Supplementary SourceNA0NANAYES Subtotal2 ParticipantsNANA0NA0NANA EXHIBIT V.2 continued 123456789101112131415 Participant GroupSSNBirthdateRegistration DateExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other SourcesIn Post Secondary or Advanced Training in First Quarter After Exit QuarterIn Post Secondary or Advanced Training in Third Quarter After Exit Quarter465.90453861635 1 799 3 997 31 99 YouthNot EmployedNANA0NANANANANONA 5.91478583023 1 791 18 998 15 99 YouthNot EmployedNANA0NANANANANONA 5.925934068312 24 7812 15 998 12 99 YouthNot EmployedNANA0NANANANANONA Subtotal3 ParticipantsNANA0NANANANANA 5.104068325937 2 798 8 997 31 99 YouthNot EmployedNANA0NANANANAYESNA 5.101009256871 15 792 21 998 15 99 YouthNot EmployedNANA0NANANANAYESNA 5.1038586830612 1 7811 15 998 12 99 YouthNot EmployedNANA0NANANANAYESNA Subtotal3 ParticipantsNANA0NANANANANA 5.114516386037 3 798 1 997 31 99 YouthEmployed04 0004 000Wage Records10 0006 000Wage RecordsNANA 5.110214785831 15 797 17 998 15 99 YouthEmployed5 0005 0005 000Wage Records06 000Wage RecordsNANA Subtotal2 Participants5 0009 0009 00010 00012 000NANA 5.1238587412010 1 782 21 997 31 99 YouthEmployedNANA2 000Wage RecordsNA0Supplementary SourceNANA Subtotal1 ParticipantNANA2 000NA0NANA 5.138620434833 30 7910 9 997 31 99 YouthEmployedNANA0Supplementary SourceNA2 000Wage RecordsNANA 5.1334938549111 15 78 998 15 99 YouthEmployedNANA0Supplementary SourceNA3 000Wage RecordsNANA Subtotal2 ParticipantsNANA0NA5 000NANA 5.144738693234 4 798 14 997 31 99 YouthEmployedNANA0Supplementary SourceNA0Supplementary SourceNANA 5.145384924026 17 796 8 998 15 99 YouthEmployedNANA0Supplementary SourceNA0Supplementary SourceNANA Subtotal2 ParticipantsNANA0NA0NANA 5.151234567898 1 794 14 997 31 99YouthEmployed01 0002 000Wage Records2 0000NANANO 5.1598765432112 10 783 2 998 15 99YouthEmployed5 0002 0002 000Wage Records1 0000NANANO 5.155432198762 14 798 10 998 12 99YouthEmployed4 0001 0004 000Wage Records3 0000NANANO Subtotal3 Participants9 0004 0008 0006 0000NANA EXHIBIT V.2 continued 123456789101112131415 Participant GroupSSNBirthdateRegistration DateExit DateFunding SourceEmployment Status at RegistrationWages 3 Quarters Prior to RegistrationWages 2 Quarters Prior to RegistrationWages 1st Quarter after ExitIf Employed in First Quarter Information from Wage Records or Other SourcesWages 2nd Quarter after ExitWages 3rd Quarter after Exit If Employed in Third Quarter Information from Wage Records or Other SourcesIn Post Secondary or Advanced Training in First Quarter After Exit QuarterIn Post Secondary or Advanced Training in Third Quarter After Exit Quarter475.168235419876 1 798 12 998 12 99YouthEmployedNANA4 000Wage RecordsNA0NANAYES 5.169876541113 2 796 1 998 15 99YouthEmployedNANA3 000Wage RecordsNA0NANAYES 5.161012825456 15 797 15 999 15 99YouthEmployedNANA2 000Wage RecordsNA0NANAYES Subtotal3 ParticipantsNANA9 000NA0NANA 5.1701551028712 15 781 21 999 03 99YouthEmployedNANA0Supplementary SourceNA0NANANO 5.178721054315 2 797 30 999 27 99YouthEmployedNANA0Supplementary SourceNA0NANANO Subtotal2 ParticipantsNANA0NA0NANA 5.181092410104 16 795 17 998 13 99YouthEmployedNANA0Supplementary SourceNA0NANAYES 5.181213141516 2 798 3 997 31 99YouthEmployedNANA0Supplementary SourceNA0NANAYES Subtotal2 ParticipantsNANA0NA0NANA 5.190414216731 5 799 9 997 15 99YouthEmployedNANA0NANA0NANANA 5.190518316748 8 799 3 998 12 99YouthEmployedNANA0NANA0NANANA Subtotal2 ParticipantsNANA0NANA0NANANA 48EXHIBIT V.3 WORKSHEET TO CALCULATE OLDER YOUTH ENTERED EMPLOYMENT AND RETENTION RATES Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetention 1234567891011 Participan t GroupEmployment Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourceEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourceIn Post Secondary Education or Advanced Training Quarter 1In Post Secondary Education or Advanced Training Quarter 3Count of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in Denominator 5.1Not EmployedYESWage RecordsYESWage RecordsNANA2222 5.2Not EmployedYESWage RecordsYESSupplementary SourceNANA2222 5.3Not EmployedYESSupplementary SourceYESWage RecordsNANA2222 5.4Not EmployedYESSupplementary SourceYESSupplementary SourceNANA3333 5.5Not EmployedYESWage RecordsNONANANO22NO2 5.6Not EmployedYESWage RecordsNONANAYES22NONO 5.7Not EmployedYESSupplementary SourceNONANANO22NO2 5.8Not EmployedYESSupplementary SourceNONANAYES22NONO 5.9Not EmployedNONANANANONANO3NONO 5.10Not EmployedNONANANAYESNANONONONO EXHIBIT V.3 continued Participant CharacteristicsUse of Each Group in Performance Measures Entered EmploymentRetention 1234567891011 Participan t GroupEmployment Status at RegistrationEmployed First Quarter after Exit QuarterIf Employed in First Quarter Information from Wage Records or Other SourceEmployed Third Quarter After Exit QuarterIf Employed in Third Quarter Information from Wage Records or Other SourceIn Post Secondary Education or Advanced Training Quarter 1In Post Secondary Education or Advanced Training Quarter 3Count of Participants Included in NumeratorCount of Participants Included in DenominatorCount of Participants Included in NumeratorCount of Participants Included in Denominator495.11EmployedYESWage RecordsYESWage RecordsNANANONO22 5.12EmployedYESWage RecordsYESSupplementary SourceNANANONO11 5.13EmployedYESSupplementary SourceYESWage RecordsNANANONO22 5.14EmployedYESSupplementary SourceYESSupplementary SourceNANANONO22 5.15EmployedYESWage RecordsNONANANONONONO3 5.16EmployedYESWage RecordsNONANAYESNONONONO 5.17EmployedYESSupplementary SourceNONANANONONONO2 5.18EmployedYESSupplementary SourceNONANAYESNONONONO 5.19EmployedNONANANANANANONONONO TOTAL17201625 DIVIDE NUMERATOR BY DENOMINATOR85 64 50EXHIBIT V.4 WORKSHEET TO CALCULATE OLDER YOUTH EARNINGS CHANGE Step 4 Copy the Number of Participants and Dollars in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupQuarters Prior to Entry QuarterAQuarters After Exit QuarterBEarnings Change Older YouthNumber of Participants3rd 2nd Sum of Quarters2nd 3rdSum of QuartersB Minus A 5.12 5 000 5 000 10 000 9 000 7 000 16 000 6 000 5.2 5.3 5.4 5.52 6 000 3 000 9 000 6 000 0 6 000 3 000 5.6 5.7 5.8 5.9 5.10 5.112 5 000 9 000 14 000 10 000 12 000 22 000 8 000 5.12 5.13 5.14 5.153 9 000 4 000 13 000 6 000 0 6 000 7 000 5.16 5.17 5.18 5.19 C Total Participants9D Net Total Earnings 4 000 Average Earnings Change D Divided by C 444 51 B.CREDENTIAL RATE This section specifies how to calculate the older youth credential rate of older youth who were in employment post-secondary education advanced training by the end of the first quarter after exit and received a credential by the end of the third quarter after exit of older youth who exit during the quarter This section explains how an exit cohort of older youth can be logically grouped into four separate categories based on whether they were employed in the first quarter after the exit quarter whether they were in post-secondary education or advanced training in the first quarter after the exit quarter and whether they received a credential within three quarters after the exit quarter. See Exhibit V.5 Six Groups of Older Youth Participants Used to Calculate Credential Rate. Once States determine the number of participants who fit each category they can easily compute this measure. The older youth exit cohort which is included in this measure is identical to participant group 5 the group of older youth who exited during the quarter that is used to measure entered employment retention and earnings change. Whereas in the adult and dislocated worker employment and credential measures the participant had to receive training services all older youth who exit during a quarter are included in this measure. If the participant was employed in the first quarter after the exit quarter as determined either through wage records or through a supplementary source record a yes in column 1. This would include all participants in participant groups 5.1 through 5.8 and those participants in groups 5.11 through 5.18 from the files created to calculate older youth entered employment retention and earnings change. Exhibits V.6 and V.7 are a sample file of older youth participants used to calculate the credential rate and the worksheet used to calculate this measure. 52EXHIBIT V.5 SIX GROUPS OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE CREDENTIAL RATE Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Employed First Quarter after Exit QuarterIn Post-Secondary Education or Advanced Training in Quarter After Exit QuarterAttained State- Recognized Educational Occupation al Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 6.1YESNAYES YESYES 6.2YESNANONOYES 6.3NOYESYESYESYES 6.4NONOYESNOYES 6.5NOYESNONOYES 6.6NONONONOYES 53EXHIBIT V.6 SAMPLE FILE OF OLDER YOUTH PARTICIPANTS USED TO CALCULATE CREDENTIAL RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants in Each Group 12345678 Participant GroupSSNRegistration DateBirthdateExit DateFunding SourceEmployed First Quarter after Exit QuarterIn Post- Secondary Education or Advanced Training in Quarter after Exit QuarterAttained State Recognized Educational Occupational Certificate Credential Diploma Degree Within 3 Quarters after Exit Quarter 6.13843402681 15 991 3 797 15 99YouthYESNAYES 6.116806897412 2 983 30 789 1 99YouthYESNAYES 6.11945839432 19 9912 1 798 21 99YouthYESNAYES Subtotal3 Participants 6.26830638583 20 9911 21 799 9 99YouthYESNANO 6.21839457295 12 994 15 807 15 99YouthYESNANO Subtotal2 Participants 6.323048975112 15 984 8 789 1 99YouthNOYESYES Subtotal1 Participant 6.41305689408 5 9911 20 798 12 99YouthNONOYES Subtotal1 Participant 6.51329876105 6 9911 8 799 11 99YouthNOYESNO Subtotal1 Participant 6.63651059413 13 9912 25 788 11 99YouthNONONO Subtotal1 Participant 5555EXHIBIT V.7 WORKSHEET TO CALCULATE OLDER YOUTH CREDENTIAL RATE Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 12345 Employed First Quarter after Exit QuarterIn Post-Secondary Education or Advanced Training in Quarter After Exit QuarterAttained State-Recognized Educational Occupatio nal Certificate Credential Diploma Degree Within 3 Quarters After Exit QuarterCount of Participants Included in NumeratorCount of Participants Included in Denominator 6.1YESNAYES33 6.2YESNANONO2 6.3NOYESYES11 6.4NONOYESNO1 6.5NOYESNONO1 6.6NONONONO1 TOTAL49 DIVIDE NUMERATOR BY DENOMINATOR44 56 VI. YOUTH PROGRAM YOUNGER YOUTH 14-18 These specifications provide guidance for States to calculate performance for youth aged 14 through 18 at registration who exit from WIA services during a specific quarter for three measures 1.Attainment of basic work readiness or occupational skills 2.Attainment of secondary school diplomas and their recognized equivalents 3.Placement and retention in post secondary education advanced training military service employment or qualified apprenticeships A.SKILL ATTAINMENT RATE This section specifies how to collect and calculate data for the younger youth skill attainment measure. This measure is defined as follows Of all in-school youth and out-of-school youth who are assessed to be in need of basic work readiness and or occupational skills Total of attained basic skills of attained WR skills of attained Occ. skills of basic skills goals of WR skills goals of Occ. skills goals 1.Collect the Data See the definition in the body of the TEGL. a.Specific Data Elements to Collect 42a. Goal 1 1 goal minimum 3 goals maximum 42a1. Date goal 1 was set 57 42a2. Type of goal 1 Basic Skills 2 Occupational Skills 3 Work Readiness Skills 42a3. Attainment of goal 1 1 Attained 2 Set but not attained 3 Set but attainment pending 42a4. Date attained goal 1 42b. Goal 2 42b1. Date goal 2 was set 42b2. Type of goal 1 Basic Skills 2 Occupational Skills 3 Work Readiness Skills 42b3. Attainment of goal 2 1 Attained 2 Set but not attained 3 Set but attainment pending 42b4. Date attained goal 2 42c. Goal 3 42c1. Date goal 3 was set 42c2. Type of goal 1 Basic Skills 2 Occupational Skills 3 Work Readiness Skills 42c3. Attainment of goal 3 1 Attained 2 Set but not attained 3 Set but attainment pending 42c4. Date attained goal 3 58 2.Calculate the Data The formula for calculating younger youth skill attainment is as follows the total number of basic skills attained by younger youth plus the number of work readiness skills goals attained plus the number of occupational skills goals attained divided by the total number of goals basic skills goals plus work readiness skills goals plus occupational skills goals set. B.DIPLOMA OR EQUIVALENT ATTAINMENT This section explains how an exit cohort of younger youth can be logically grouped into four separate categories based on whether they obtained a diploma or equivalent prior to WIA registration whether they received a diploma or equivalent while enrolled and whether they were in secondary education at exit. See Exhibit VI.1 Four Groups of Younger Youth Participants Used to Calculate Diploma or Equivalent Attainment Rate. Once States determine the number of participants who fit each category they can easily compute this measure. This measure is defined as follows Of those who register without a diploma or equivalent of younger youth who attained secondary school diploma or equivalent by the end of the first quarter after exit of younger youth who exit during the quarter except those still in secondary school at exit 1.Create Files Perform the following steps in order to create the files. Step 1 Select the exiters from the report quarter and extract the data elements as specified in Exhibit VI.1. As with other measures participants who exit from the program under the following conditions should be excluded from the measures CFor JTPA participant data exclude those who received objective assessment only and Title II 8 funded programs. CParticipants who exit from services because they are incarcerated institutionalized deceased or have a health medical condition that prevent them from participating in services should be excluded from the measures. 59EXHIBIT VI.1 FOUR GROUPS OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE DIPLOMA OR EQUIVALENT ATTAINMENT RATE Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measures 12345 Entered Program with High School Diploma EquivalentAttained a Secondary School High School GED or High School Equivalency Diploma By the End of the First Quarter after the Exit QuarterIn Secondary School on Exit DateCount of Participants Included in NumeratorCount of Participants Included in Denominator 7.1YESNANANONO 7.2NOYESNAYESYES 7.3NONOYESNONO 7.4NONONONOYES 60 Step 2 Sort the exiters into four groups based on whether the participant received a diploma or equivalent prior to registration or by the end of the first quarter after the exit quarter and whether they were in secondary school on exit date. See Exhibit VI.2 Sample File of Younger Youth Participants Used to Calculate Diploma or Equivalent Attainment Rate. For example If the participant completed high school prior to registration assign to participant group 7.1. Step 3 Subtotal the number of participants in each group. 2.Calculate Performance Step 4 Copy the number of participants in each group onto the worksheet. See Exhibit VI.3 Worksheet to Calculate Younger Youth Diploma or Equivalent Attainment Rate. Step 5 Add totals for each column on the worksheet. Step 6 Perform the calculations divide numerator by denominator . 61EXHIBIT VI.2 SAMPLE FILE OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE DIPLOMA OR EQUIVALENT ATTAINMENT RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants in Each Group 1234567 Participant GroupSSNRegistration DateBirthdateExit DateFunding SourceDiploma Received DateIn Secondary School on Exit Date 7.13843402682 5 991 15 817 15 99Youth6 15 98NA 7.11359026781 6 995 18 819 9 99Youth6 20 98NA 7.119458394312 16 986 06 828 21 99Youth6 28 97NA Subtotal3 Participants 7.26830638581 8 992 5 81NoneYouth9 5 99NA 7.268394572911 15 983 8 829 1 99Youth8 21 99NA Subtotal2 Participants 7.31567845014 6 993 10 828 2 99YouthNoneYES Subtotal1 Participant 7.42368046822 9 992 8 817 30 99YouthNoneNO Subtotal1 Participant 62EXHIBIT VI.3 WORKSHEET TO CALCULATE YOUNGER YOUTH DIPLOMA OR EQUIVALENT ATTAINMENT RATE Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measures 12345 Entered Program with High School Diploma EquivalentAttained a Secondary School High School GED or High School Equivalency Diploma By the End of the First Quarter after the Exit QuarterIn Secondary School on Exit DateCount of Participants Included in NumeratorCount of Participants Included in Denominator 7.1YESNANANONO 7.2NOYESNA22 7.3NONOYESNONO 7.4NONONONO1 TOTAL23 DIVIDE NUMERATOR BY DENOMINATOR67 63 C.YOUNGER YOUTH RETENTION This section explains how an exit cohort of younger youth can be logically grouped into three separate categories based on whether they were in post secondary education advanced training employment military service or qualified apprenticeships in any of the three quarters after exit and whether they were in secondary school at exit. See Exhibit VI.4 Three Groups of Younger Youth Participants Used to Calculate Retention Rate. There are three possible outcomes for younger youth based on whether they were in one of the five activities listed above in the third quarter after exit 1 if the participant is enrolled in secondary school at exit the participant is excluded from the measure 2 if the participant participated in only one of the five activities the participant is included in the numerator or 3 if the participant participated in none of the five the participant is only included in the denominator. This measure is defined as follows of participants found in one of the following in the 3rd quarter after exit post secondary education advanced training employment military service qualified apprenticeships of younger youth during the quarter except those still in secondary school at exit 64EXHIBIT VI.4 THREE GROUPS OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE RETENTION RATE Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 1234 In Secondary School on Exit DateActive in the Third Quarter Following the Exit Quarter in any of the Following Activities Employment Military Service Post-Secondary Education Advanced Training Qualified ApprenticeshipCount of Participants Included in NumeratorCount of Participants Included in Denominator 8.1NOYESYESYES 8.2NONO NOYES 8.3YES NANONO 65 1.Create Files Perform the following steps in order to create the files. Step 1 Select the exiters from the report quarter and extract the data elements as specified in Exhibit VI.4. As with other measures participants who exit from the program under the following conditions should be excluded from the measures CFor JTPA participant data exclude those who received objective assessment only and Title II 8 funded programs. CParticipants who exit from services because they are incarcerated institutionalized deceased or have a health medical condition that prevent them from participating in services should be excluded from the measures. CFor JTPA participant data exclude dislocated workers served exclusively with National Reserve Account NRA funds. For WIA participant data exclude dislocated workers served exclusively with National Emergency Grants. Step 2 Sort the exiters into three groups based on whether the participant was in secondary school on exit date and whether they were active in any of the five activities or by the end of the first quarter after the exit quarter. See Exhibit VI.5 Sample File of Younger Youth Participants Used to Calculate Retention Rate. For example If the participant was not in secondary school at exit and was employed in the third quarter after the exit quarter assign to participant group 8.1. Step 3 Subtotal the number of participants in each group. 2.Calculate Performance Step 4 Copy the number of participants in each group onto the worksheet. See Exhibit VI.6 Worksheet to Calculate Younger Youth Retention Rate. Step 5 Add totals for each column on the worksheet. Step 6 Perform the calculations divide numerator by denominator . 66EXHIBIT VI.5 SAMPLE FILE OF YOUNGER YOUTH PARTICIPANTS USED TO CALCULATE RETENTION RATE Step 1 Select Exiters and Extract Data Elements Step 2 Sort into Participant Groups Step 3 Subtotal Participants in Each Group 1234567891011 Participant GroupSSNRegistration DateBirthdateExit DateFunding SourceIn Secondary School on Exit DateWages in the Third Quarter After ExitEmployed in Third Quarter after Exit as Determined from Supplemental SourcesIn Post- Secondary Education or Advanced Training in the Third Quarter after ExitIn Qualified Apprenticeship in the Third Quarter after ExitIn Military Service in the Third Quarter after Exit 8.13843402682 5 991 15 817 15 99YouthNO 3 000NANONONO 8.11359026781 6 995 18 819 9 99YouthNO0NOYESNONO 8.119458394312 16 986 06 828 21 99YouthNO0NONOYESNO Subtotal3 Participants 8.26830638581 8 992 5 819 5 99YouthNO0NONONONO 8.268394572911 15 983 8 829 1 99YouthNO0NONONONO Subtotal2 Participants 8.31567845014 6 993 10 828 2 99YouthYES0NONONONO Subtotal1 Participant 67EXHIBIT VI.6 WORKSHEET TO CALCULATE YOUNGER YOUTH RETENTION RATE Step 4 Copy the Number of Participants in Each Group onto the Worksheet Step 5 Add Totals for Each Column Step 6 Perform the Calculations Participant GroupParticipant CharacteristicsUse of Each Group in Performance Measure 1234 In Secondary School on Exit DateActive in the Third Quarter Following the Exit Quarter in any of the Following Activities Employment Military Service Post-Secondary Education Advanced Training Qualified ApprenticeshipCount of Participants Included in NumeratorCount of Participants Included in Denominator 8.1NOYES33 8.2NONO NO2 8.3YES NANONO TOTAL35 DIVIDE NUMERATOR BY DENOMINATOR60 APPENDIX A DATA ELEMENT DEFINITIONS A.2EXHIBIT A.1 DATA ELEMENT DEFINITIONS FOR CALCULATING WIA PERFORMANCE Element NumberElement DescriptionDefinition 1SSN.Self-explanatory. 2WIA Title I and Partner Program Participation Fund Sources Adult local --Services to adults age 18 and over provided by funds allocated to local areas under WIA Sec. 133 b 2 A . Dislocated Worker local --Services to dislocated workers provided by funds allocated to local areas under WIA Sec. 133 b 2 B . Youth local --Services to youth provided by funds allocated to local areas under WIA Sec. 128 b . SAn individual served by youth funds who registers between the ages of 14-18 and turns 19 while receiving services is only counted in the younger youth 14-18 measures. SAn individual served by youth funds who registers after age 18 is only counted in the older youth measures. Co-enrollment- - SIndividuals co-registered in multiple funding streams will be counted in each applicable core measure. 3Date of Birth.Self-explanatory. 4Date of Registration.Adults and dislocated workers must be registered when they start to receive core services that are not informational or self-service intensive services or training services. Youth must be registered when they start to receive youth activities. Core services that do not involve a significant amount of staff time or resources and or primarily are for the purpose of providing information should be considered as self-service or informational and registration will not be required. Core services requiring registration include SStaff-assisted job search and placement assistance including career counseling SStaff- assisted job referrals such as testing and background checks SStaff- assisted job development working with employer and job-seeker EXHIBIT A.1 continued Element NumberElement DescriptionDefinitionA.35Date of WIA Exit.The last date on which WIA Title I funded or partner services were received by the individual excluding follow-up services. There are two ways to determine exit date 1.a participant who has a date of case closure completion or known exit from WIA-funded or non-WIA funded partner service within the quarter hard exit or 2.a participant who does not receive any WIA-funded or non-WIA funded partner service for 90 days and is not scheduled for future services except follow-up services soft exit . Participants who have a planned gap in service of greater than 90 days should not be considered as exited if the gap in service is due to a delay before the beginning of training or a health medical condition that prevents an individual from participating in services. The exit date will be the last date of WIA funded or partner service received except follow-up services . Therefore for a soft exit exit cannot be determined until 90 days has elapsed from the last date of service but the exit date recorded is the last date of service. 6Employed at Registration Labor Force Status Employed. An employed individual is one who during the 7 consecutive days prior to registration did any work at all as a paid employee in his or her own business profession or farm worked 15 hours or more as an unpaid worker in an enterprise operated by a member of the family or is one who was not working but has a job or business from which he or she was temporarily absent because of illness bad weather vacation labor- management dispute or personal reasons whether or not paid by the employer for time-off and whether or not seeking another job. Not employed. An individual who does not meet the definition of employed. NOTE This information is to be collected from the registrant at registration not from wage records 7Total Earnings from Wage Records for the Second Quarter Prior to Registration DislocationTotal earnings in the second quarter before registration for adults older youth and dislocated workers without a dislocation date before the registration date. Earnings in the second quarter before dislocation for dislocated workers with a dislocation date before the registration date. 8Total Earnings from Wage Records for the Third Quarter Prior to Registration DislocationTotal earnings in the third quarter before registration for adults older youth and dislocated workers without a dislocation date before the registration date. Earnings in the third quarter before dislocation for dislocated workers with a dislocation date before the registration date. 9Total Earnings from Wage Records in the First Quarter Following the Exit Quarter.Derived from Wage Record Files. EXHIBIT A.1 continued Element NumberElement DescriptionDefinitionA.410Total Earnings from Wage Records in the Second Quarter Following the Exit Quarter.Total earnings from wage records for the quarter. 11Total Earnings from Wage Records in the Third Quarter Following the Exit Quarter.Total earnings from wage records for the quarter. 12Employed in the First Quarter Following the Exit Quarter as Determined by Supplemental Sources.Supplemental sources include information obtained by 1 contacting participant through case management follow-up services or surveys to determine that the individual is employed and written documentation of that employment such as W2 form pay stub 1099 form documented telephone verification with employer or documented telephone verification with major clients contracting entities for self-employed or other written documentation or 2 record sharing and or automated record matching with administrative other databases to determine and document that the participant has received a credential. All data and methods to supplement the wage record data must be documented and are subject to audit. 13Employed in the Third Quarter Following the Exit Quarter as Determined by Supplemental Sources.Supplemental source include information obtained by 1 contacting participant through case management follow-up services or surveys to determine that the individual is employed and written documentation of that employment such as W2 form pay stub 1099 form documented telephone verification with employer or documented telephone verification with major clients contracting entities for self-employed or other written documentation or 2 record sharing and or automated record matching with administrative other databases to determine and document that the participant has received a credential. All data and methods to supplement the wage record data must be documented and are subject to audit. 14Occupation skills training or skills upgrading retraining and or workplace training. Received Training Services Include the receipt of the following types of WIA-Title I funded and non-WIA funded partner training services SOccupational skills training including training for nontraditional employment SOn-the-job training SPrograms that combine workplace training with related instruction which may include cooperative education programs STraining programs operated by the private sector SSkill upgrading and retraining SEntrepreneurial training SJob readiness training SAdult education and literacy activities in combination with other training and SCustomized training conducted with a commitment by an employer or group of employers to employ an individual upon successful completion of the training. EXHIBIT A.1 continued Element NumberElement DescriptionDefinitionA.515Attained Recognized Educational Occupational Certificate Credential Diploma Degree Within the Three Quarters Following the Exit Quarter A credential is defined as any nationally recognized degree or certificate or State locally recognized credential. Credentials will include but are not limited to a high school diploma GED or other recognized equivalents post-secondary degrees certificates recognized skill standards and licensure or industry-recognized certificates. States should include all State Education Agency recognized credentials. In addition States should work with local Workforce Investment Boards to encourage certificates to recognize successful completion of the training services listed above that are designed to equip individuals to enter or re-enter employment retain employment or advance into better employment. Credential must be obtained either during participation or by the end of the third quarter after exit from services other than follow-up services . States and localities will have flexibility in methods used to collect data on credential. Examples of methods include 1 case management follow-up services and surveys of a participant to determine that the individual received a credential and written documentation of that credential or 2 record sharing and or automated record matching with administrative other databases to determine and document that the participant has received a credential. All data and methods to determine achievement of credentials must be documented and are subject to audit. Computer records from automated record matching are considered a valid written record. A telephone response from the participant must be accompanied by written verification with the certification institution entity that a person has attained the credential is acceptable but must also be documented. 16Date of Actual or Projected Qualifying Dislocation.The last day of employment at the dislocation job. If there is no dislocation job e.g. displaced homemakers leave blank. Leave blank for dislocated workers who are registered before layoff. 17In Post-Secondary or Advanced Training Program in the First Quarter After Exit.The individual was in further training in the first quarter after exit including SAdvanced training is an occupational skills employment training program not funded under Title I of the WIA which does not duplicate training received under Title I. Includes only training outside of the one- stop WIA and partner system. Include entry into postsecondary educational programs that lead to an academic degree e.g. AA AS BA BS in advanced training in the postsecondary education category. SPostsecondary education is a program at an accredited degree-granting institution that leads to an academic degree e.g. AA AS BA BS . Do not include programs offered by degree-granting institutions that do not lead to an academic degree as post-secondary education. EXHIBIT A.1 continued Element NumberElement DescriptionDefinitionA.618In Post-Secondary or Advanced Training Program in the Third Quarter After Exit.The individual was in further training in the third quarter after exit including SAdvanced training is an occupational skills employment training program not funded under Title I of the WIA which does not duplicate training received under Title I. Includes only training outside of the one- stop WIA and partner system. Include entry into postsecondary educational programs that lead to an academic degree e.g. AA AS BA BS in advanced training in the postsecondary education category. SPostsecondary education is a program at an accredited degree-granting institution that leads to an academic degree e.g. AA AS BA BS . Do not include programs offered by degree-granting institutions that do not lead to an academic degree as post-secondary education. 19Youth Retention Information For all youth except those still attending secondary school at exit . Was the youth active in the third quarter following the exit quarter in any of the following activities 1 In postsecondary education 2 In advanced trainingRecord the primary activity that the youth was in at any time during the third quarter after exit. See item 64 in the WIASRD for other definitions. 20Date of High School Diploma or GED.The date of attainment should be the date on the diploma or equivalency certificate if available. Otherwise the date may be estimated. 21Attending Secondary School at Exit.The youth exited WIA services but was still attending secondary school at exit. 22In Military Service Third Quarter After Exit .Record yes if the youth was in military service at any time during the third quarter after exit. 23In a Qualified Apprenticeship Third Quarter After Exit .The individual entered a qualified apprenticeship program i.e. a program approved and recorded by the ETA Bureau of Apprenticeship and Training or by a recognized State Apprenticeship Agency. Approval is by certified registration or other appropriate written credential.