TEGL17-05c2acc.pdf

ETA Advisory File Text

CLASSIFICATION ETA Performance Accountability System CORRESPONDENCE SYMBOL PROTECH Employment and Training Administration Advisory System U.S. Department of Labor Washington D.C. 20210 DATE May 20 2005 TRAINING AND EMPLOYMENT GUIDANCE LETTER No. 17 05 Change 2 TO ALL STATE WORKFORCE AGENCIES ALL STATE WORKFORCE LIAISONS FROM DOUGLAS F. SMALL s Deputy Assistant Secretary SUBJECT Common Measures Policy for the Employment and Training Administration s ETA Performance Accountability System and Related Performance Issues 1. Purpose . The intent of this guidance is to further clarify the application of the literacy numeracy measure initially provided in Attachment C Educational Functional Level Descriptors in Training and Employment Guidance Letter TEGL 17 05 issued February 17 2006 and to rescind TEGL 17 05 Change 1 issued August 13 2007. This change TEGL only addresses specific reporting changes for the Workforce Investment Act WIA Youth literacy numeracy measure. 2. References . Training and Employment Guidance Letter TEGL 17 05 Common Measures Policy for the Employment and Training Administration s ETA Performance Accountability System and Related Performance Issues http wdr.doleta.gov directives corr doc.cfm DOCN 2195 Workforce Investment Act Title 1 B Standardized Record Data WIASRD layout http www.doleta.gov performance reporting wiasrd.cfm RESCISSIONS TEGL 17 05 Change 1 EXPIRATION DATE Continuing - 2 - 3. Background . ETA published TEGL 17 05 on February 17 2006. TEGL 17 05 includes guidance on the literacy numeracy measure for youth participants. ETA published TEGL 17 05 Change 1 on August 13 2007 to provide further guidance on the literacy numeracy measure for youth participants. This change TEGL rescinds TEGL 17 05 Change 1 and provides additional clarification on the measure to be consistent with guidance from the Department of Education. 4. Revisions . This change TEGL updates TEGL 17 05 by providing revised guidance and specifications for the literacy numeracy measure and instructions on accessing the revised Educational Functioning Level EFL descriptors table from the Department of Education. ETA is implementing the revised specifications and EFL definitions for Program Year 2008 which began July 1 2008. The Department of Education recently announced that the TABE CLAS E assessment has been approved to test the literacy gains of English as a Second Language ESL students and approved the Wonderlic assessment for the following educational functioning levels low intermediate high intermediate and low adult. Additionally the Department of Education has removed ABLE from its list of approved assessments. The new EFL descriptors table reflecting these changes is available at http www.nrsweb.org pubs . States should be aware that ETA will no longer issue the EFL descriptors table as a TEGL attachment. States should access the latest National Reporting System Test Benchmarks for EFL at the link above which reflects the most up to date guidance from the Department of Education. Attachments A through C include revised guidance on the literacy numeracy measure reporting and specifications. Attachment A provides the following 1 a high level decision path that illustrates the factors determining whether a youth is a success counted only in the denominator or excluded from the measure and 2 detailed specifications for the calculation of the literacy numeracy measure. The specifications address the calculation of the measure for states in their third and subsequent years of implementation. Additionally changes have been made to respond to policy issues and questions raised by states over the past two years. Key changes are specifically outlined in Attachment A. Attachment B provides a description of the participant cohorts for the literacy numeracy measure for Program Years 2008 2009 and 2010. Attachment C provides an excerpt of the Workforce Investment Act Standardized Record Data WIASRD record layout for the literacy numeracy specification which incorporates the changes. - 3 - 5. Action Requested . These modifications to ETA s Youth performance accountability system were effective July 1 2008. Please make this information available to appropriate program and technical staff. 6. Attachments . Attachment A Literacy Numeracy Decision Path and Specifications Attachment B Participant Cohort Table and Description Attachment C WIASRD Layout -1- ATTACHMENT A LITERACY NUMERACY SPECIFICATIONS THIRD AND SUBSEQUENT YEARS AFTER STATE IMPLEMENTS THE MEASURE I. SPECIFICATION CONVENTIONS The Literacy Numeracy specification that follows includes two sections 1. The flowchart illustrates the factors that determine whether a youth is a success only in the denominator or excluded from the literacy numeracy measure. 2. Detailed programmatic specifications follow the flowchart. These specifications have the following structure a. There are three columns for each specification. Column A identifies the component being specified for example the literacy numeracy numerator . Column B provides the technical specification for each component. These components are written in pseudo-code to provide programmers and readers with precise detailed instructions on how to program the measure. Column C describes the specifications in lay terms so that non-technical readers can understand the processes and decisions employed by programmers to calculate each component of the measure. b. The literacy numeracy specifications are divided into three sections. The first section provides the specifications for the numerator and denominator. The second section provides the specifications for the constructed variables used in the numerator and denominator specifications. The third section provides the reporting cohort table for the literacy numeracy measure. To make the specifications easier to read they incorporate several conventions that fall into two categories. 1. Conventions for data elements and constructed variables used in the calculations a. WIASRD data element names are capitalized. b. Constructed variables used in the specifications are capitalized and italicized. c. Constructed variable definitions follow the numerator and denominator specifications. 2. Conventions for logical conditions a. AND statements and OR statements are bolded for readability. b. Corresponding conditions in OR statements are indented equally to show their correspondence. c. AND statements are presented in separate boxes except for compound AND statements that involve a single variable which are joined in a single box. d. Parentheses are used to establish grouping of logical conditions that do not follow the normal order of operations. -2- II. KEY CHANGES IN THE LITERACY NUMERACY SPECIFICATION The following update to the Literacy Numeracy specification addresses the calculation of the measure for states that have been reporting on the measure for three years or more. The changes focus on policy issues and questions that states have raised over the la st two years. More specifically the specification incorporates the following issues The determination of Basic Skills Deficiency has been updated to include all combinations of values in the Basic Literary Skills Deficient WIASRD Element 130 and Pre-test Educational Functioning Level WIASRD 706 720 734 fields. As in the previous specifications Post-test Educational Functioning Level fields WIASRD 709 712 715 723 726 729 737 740 743 are used to determine if the youth remains basic skills deficient. If an out-of-school basic skills deficient youth do not have pre-test data by the end of the first participation year then the youth will be included in the denominator only unless he or she had an exit-based exclusion during the year. If the youth still does not have pre-test data by the end of the second or third participation years the youth will continue to be included in the denominator only unless he or she exited with or without an exclusion during the given participation year. If an out-of-school basic skills deficient youth has a pre-test date after the end of the first participation year the youth will be included in the denominator for the first year. If the youth has a pre-test date after the end of the second participation year he or she will also be included in the denominator for second year. If the pre-test date is after the end of the third participation year the youth will be included in the denominator for all three years. When creating the WIASRD and Data Reporting and Validation Software DRVS files states should leave the post-test data fields blank for participation years in which the youth did not take a post-test. For example if the youth s first post-test was in his or her second participation year the Post-Test Year 1 fields WIASRD 707-709 should be left blank and the youth s results should be recorded in the Post-Test Year 2 fields WIASRD 710-712 . If an out-of-school basic skills deficient youth does not have a post-test date or has a post-test date after the end of a given participation year then the you th will be included in that year s denominator only unless the youth has an exit-based exclusion during the participation year. The definition of Participation Year has been updated. Literacy Numeracy eligible youth who are in the program for more than 3 years are excluded from the measure after their third participation year. Updates have been made to the valid values for the Type of Assessment Test WIASRD 702 field so that states can use the Wonderlic to measure educational functioning levels. -3- This Page Intentionally Left Blank -4- III. LITERACY NUMERACY DECISION PATH Outcomes for the Literacy Numeracy measure are based on multiple criteria including technical definitions of terminology such as out-of-school and basic skills deficient pre- and post-test timing and results reporting cohorts that are determined by the participant s first youth service anniversary dates and various exit considerations. The Literacy Numeracy Decision Path flowchart sequentially illustrates how these criteria are used to determine the Literacy Numeracy outcome for each youth who is potentially eligible for this measure. The following list explains each decision node along the path. 1. Is the individual an out-of-school youth according to the following ETA reporting definition of out-of-school Out-of-school youth A youth who is not attending school even if the youth has a H.S. diploma or its equivalent or is attending post-secondary school and is basic skills deficient. If yes see item 2 below. If no the individual is not in the measure. 2. Is the youth s Date of First Youth Service on or after the date on which the state began reporting Literacy Numeracy data If yes see item 3 below. If no the youth is not in the measure. For most states the Literacy Numeracy start date is 7 1 2006. However some states implemented the Literacy Numeracy reporting requirements on 7 1 2005. 3. Is the youth Basic Skills Deficient BSD Both WIASRD element 130 and the pre-test EFL scores determine whether a youth is BSD. If WIASRD 130 1 yes the youth is initially considered to be BSD. However if when pre-tested all pretest EFL scores are greater than 6 the youth is no longer considered to be BSD for Literacy Numeracy purposes and is excluded from the measure. If yes see item 4 below. If no the youth is not in the measure. 4. Is there an anniversary of the youth s Date of First Youth Service within the report period If yes see item 5 below. If no the youth is not in the measure. Literacy Numeracy outcomes are measured on a yearly basis and are not determined until a full year has elapsed from the youth s Date of First Youth Service. From that point on the youth s Literacy Numeracy outcomes continue to appear in the quarterly and annual reports until the youth is excluded from or exits the measure based on the criteria described below. 5. Is the most recent anniversary of the Date of First Youth Service on or before the Date of First Youth Service plus 3 years If yes see item 6 below. If no the youth is not in the measure. Youth are excluded from the measure after their third participation year even if they are still BSD. -5- 6. Did the youth exit within the current participation year i.e. during the most recent full participation year that the youth has completed If yes see item 7 below. If no see item 11. Literacy Numeracy outcomes for a particular participation year are not measured until the anniversary date for that participation year falls within the reporting period. At that point a determination is made as to whether the youth completed the full year or exited before completing the full year. 7. If the youth exited during the current participation year is the current participation year the youth s first participation year If yes see item 8 below If no the youth is excluded from the measure. Youth are included in the measure for their first participation year whether or not they complete the full participation year. For the second and third participation years youth are excluded from the measure if they exit before completing the full participation year. 8. If the youth exited during the first participation year did he she exit for an exclusion If yes the youth is excluded from the measure. If no see item 9 below. 9. If the youth exited during the first participation year without an exclusion was the youth pre-tested and then later post-tested with an EFL gain over the pre-test If yes see item 10 below. If no the result is a negative outcome and the youth will be counted in the denominator only. In either case the youth will not be included in the measure for future participation years because the youth has exited the program. 10. If the youth exited without an exclusion during the first participation year but had a post-test EFL gain was the post-test date on or before the date of exit If yes the result is a positive outcome and the youth will be counted in both the numerator and denominator. If no the result is a negative outcome and the youth will be counted in the denominator only. In either case the youth will no longer be included in the measure for future participation years. 11. If the youth did not exit during the current participation year did the youth take a pre-test If yes see item 12 below. If no the result is a negative outcome and the youth will be counted in the denominator only. 12. If the youth did not exit during the current participation year and took a pre-test did the youth also take a post-test If yes see item 13 below. If no the result is a negative outcome and the youth will be counted in the denominator only. -6- 13. If the youth took both a pre-test and a post-test was the post-test taken within the current participation year If yes see items 13a-c below. If no the result is a negative outcome and the youth will be counted in the denominator only. 13a. If the youth took a post-test within the current participation year did the youth have an EFL gain and were the EFLs for the most recent post-tests greater than 6 for all functional areas If yes the result is a positive outcome and the youth will be counted in both the numerator and denominator. In addition the youth will not be included in the Literacy Numeracy calculations for future participation years. If no see items 13b-c below. Please note that if the EFL scores for all functional areas are greater than 6 the youth is no longer BSD and will not be included in future participation years. 13b. If the youth took a post-test within the current participation year did the youth have an EFL gain and was the EFL for the most recent post-test s less than or equal to 6 for at least one functional area If yes the result is a positive outcome and the youth will be counted in both the numerator and denominator. If no see item 13c below. 13c. Did the youth post-test within the current participation year with no EFL gain If yes the result is a negative outcome and the youth will be counted in the denominator only. 14. If the youth is still BSD after post-testing he she will continue to be included in the measure for future participation years. Youth with post-test EFL scores less than or equal to 6 for the most recent post-test for at least one of the functional areas is still basic skills deficient and must be processed by the model for the next participation year by returning to item 4 above for the next report period. Youth with No for questions 11 12 or 13 also remain basic skills deficient for the purposes of the Literacy Numeracy measure and must be processed by the model for the next participation year by returning to item 4 above for the next report period. Repeat Process in Next Report Period YES NO YES NO YES YES YES NO NO NO NO YES NO YES NO YES NO NO NO YES 1. Out of School Youth 3. Basic Skills Deficient 13b. EFL Gain EFL 6 7. Exit in First Participation Year Third and Subsequent Years After State Implements the Measure 13c. No EFL Gain 13a. EFL GainEFL 6 13. Is the Post-Test within CurrentPart Year 14. Still Basic Skills Deficient 4. Anniversary Date w in Report Period YES 6. Exit within Current Participation Year 11. Did the YouthPre-Test 12. Did the YouthPost-Test DenominatorOnly DenominatorOnly NO Excluded from Measure Excluded from Measure Excluded from Current Report 5. Anniversary Date DFYS 3 Years 2. Date of First Youth Service DFYS LitNum Start Date Excluded from Measure Excluded from Measure Excluded from Measure No Longer in Measure for Future Participation Years 8. Exit for Exclusion Excluded from Measure No Longer in Measure for Future Participation Years 9. EFL Gain Denominator Only No Longer in Measure for Future Participation Years Numerator and Denominator No Longer in Measure for Future Participation Years DenominatorOnly Numerator and Denominator No Longer Basic Skills Deficient and Not in the Measure for Future Participation Years DenominatorOnly Numerator and Denominator YES YES Legend Green Numerator and Denominator Yellow Denominator Only Blue Exclude 10. Post-Test On orBefore Exit Date YES NO Denominator Only No Longer in Measure for Future Participation Years - 7 - V. LITE bACY NUME bACY NUME bATO b A. Meas bre B. Specification C. Explanation of the Specification Count of un bque RECORDS where YOUTH1 Incl bdes Yo bth Records those with yo bth f bnding who are between 14 and 21 years of age on the Date of First Yo bth Service and SCHOOL STATUS AT PARTICIPATION 3 and BASIC LITERACY SKILLS DEFICIENCY WIASRD Element 130 1 And the yo bth is an o bt-of-school yo bth who is basic skills deficient as determined by WIASRD 130. Note For reporting p brposes an o bt-of-school yo bth is a yo bth who is either not attending school or attending post- secondary school and is basic skills deficient as determined by WIASRD Element 130. WIASRD b30 is required for eligibility purposes only. and DATE OF FIRST YOUTH SERVICE L bT-NUM START DATE The yo bth first received yo bth f bnded services on or after the date when the state first began to report on the literacy- n bmeracy meas bre. and BAS bC SK bLLS DEF bC bENT And basic skills deficient as determined by the appropriate pre- and post-tests. Note Yo bth who meet the above criteria and have not received a pre-test are treated as if they are basic skills deficient for the p brposes of the literacy n bmeracy meas bre. and END OF CURRENT PART bC bPAT bON YEAR bs w bth bn the report bng per bod And the c brrent participation year is within the reporting period. Literacy N bmeracy Gains Yo bth 14-21 N bmerator and END OF CURRENT PART bC bPAT bON YEAR END OF PART bC bPAT bON YEAR 3 And the yo bth has not been in the program for more than 3 years. o o 1 Italicized text refers to constr bcted variables these variables are not in the WIASRD. Definitions for these variables are provided at the end of the literacy n bmeracy specification. - 8 - A. Meas bre B. Specification C. Explanation of the Specification and PRE-TEST EDUCATIONAL FUNCTIONING LEVEL bs not null There m bst be a recorded pre-test EFL score for the f bnctional area. and a SUCCESSFUL POST-TEST COMPLET bON DATE START OF CURRENT PART bC bPAT bON YEAR and SUCCESSFUL POST-TEST COMPLET bON DATE END OF CURRENT PART bC bPAT bON YEAR And there is a s bccessf bl post-test completion date within the c brrent participation year. and DATE OF EXIT bs null or DATE OF EXIT END OF CURRENT PART bC bPAT bON YEAR or DATE OF EXIT END OF PART bC bPAT bON YEAR 1 and END OF PART bC bPAT bON YEAR 1 bs w bth bn the report bng per bod and OTHER REASONS FOR EXIT bs null or OTHER REASONS FOR EXIT 00 or OTHER REASONS FOR EXIT 98 And the participant did not exit exited after the c brrent participation year or exited d bring the yo bth s first participation year witho bt an excl bsion. - 9 - VI. LITE bACY NUME bACY DENOMINATO b A. Meas bre B. Specification C. Explanation of the Specification Count of un bque RECORDS where YOUTH Incl bdes Yo bth Records those with yo bth f bnding who are between 14 and 21 years of age on the Date of First Yo bth Service who are basic skills deficient and o bt-of-school and SCHOOL STATUS AT PARTICIPATION 3 and BASIC LITERACY SKILLS DEFICIENCY WIASRD Element 130 1 And the yo bth is an o bt-of-school yo bth who is basic skills deficient as determined by WIASRD 130. Note For reporting p brposes and o bt-of-school yo bth is a yo bth who is either not attending school or attending post- secondary school and basic skills deficient as determined by WIASRD Element 130. WIASRD b30 is required for eligibility purposes only. and DATE OF FIRST YOUTH SERVICE L bT-NUM START DATE The yo bth first received yo bth f bnded services on or after the date when the state first began to report on the literacy- n bmeracy meas bre. and BAS bC SK bLLS DEF bC bENT And basic skills deficient as determined by the appropriate pre- and post-tests. Note Yo bth who meet the above criteria and have not received a pre-test are treated as if they are basic skills deficient for the p brposes of the literacy n bmeracy meas bre. Literacy N bmeracy Gains Yo bth 14-21 Denominator and END OF CURRENT PART bC bPAT bON YEAR bs w bth bn the report bng per bod And the end of the c brrent participation year is in the report period. Note Yo bth who meet the above criteria and do not pre-test will be in the denominator only on their anniversary date. Yo bth who do not take a post-test or take a post-test after the anniversary date of any participation year will also be in the denominator only for that participation year on their anniversary date. - 10 - A. Meas bre B. Specification C. Explanation of the Specification and END OF CURRENT PART bC bPAT bON YEAR END OF PART bC bPAT bON YEAR 3 And the yo bth has not been in the program for more than 3 years. and DATE OF EXIT bs null or DATE OF EXIT END OF CURRENT PART bC bPAT bON YEAR or DATE OF EXIT END OF PART bC bPAT bON YEAR 1 and END OF PART bC bPAT bON YEAR 1 bs w bth bn the report bng per bod and OTHER REASONS FOR EXIT bs null or OTHER REASONS FOR EXIT 00 or OTHER REASONS FOR EXIT 98 And the participant did not exit exited after the c brrent participation year or exited d bring the yo bth s first participation year witho bt an excl bsion. Note States sho bld incl bde yo bth who exit witho bt an excl bsion d bring the first participation year in the literacy n bmeracy meas bre. Those yo bth who exit d bring the second or third participation years however are excl bded from the meas bre for the participation year in which they exit. - 11 - VII. CONSTRUCTED VARIABLE SPECIFICATIONS The following tables provide specifications to calc blate the constr bcted variables bsed for in literacy n bmeracy specifications. These variables incl bde 1. YOUTH 2. BASIC SKILLS DEFICIENT 3. LIT-NUM START DATE 4. START OF PARTICIPATION YEAR END OF PARTICIPATION YEAR and CURRENT PARTICIPATION YEAR 5. SUCCESSFUL POST-TEST COMPLETION DATE - 12 - A. Constr bcted variable B. Specification C. Explanation of the Specification 1. Yo bth Un bque RECORDS where DATE OF FIRST YOUTH SERVICE bs not null and DATE OF FIRST YOUTH SERVICE DATE OF BIRTH 14 Years and DATE OF FIRST YOUTH SERVICE DATE OF BIRTH 22 Years Yo bth are WIA participants who receive yo bth f bnded services and are 14 years old or older and yo bnger than 22 years old on the date of first yo bth service. EDUCATIONAL FUNCTIONING LEVEL 6 or EDUCATIONAL FUNCTIONING LEVEL 2 6 or EDUCATIONAL FUNCTIONING LEVEL 3 6 or EDUCATIONAL FUNCTIONING LEVEL bs null and EDUCATIONAL FUNCTIONING LEVEL 2 bs null and EDUCATIONAL FUNCTIONING LEVEL 3 bs null O bt-of-school yo bth participants who have not been pre-tested and are basic skills deficient as determined by WIASRD 130 or who have at least 1 pre-test score that is less than or eq bal to 6 WIASRD elements 706 720 and 734 are initially basic skills deficient for the p brposes of this meas bre. 2. Basic Skills Deficient and DATE ADMINISTERED POST-TEST 1 START OF CURRENT PART bC bPAT bON YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 1 0 and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 1 6 And if post-test 1 was administered prior to the start of the c brrent participation year the EFL m bst be 6 or less participants with EFLs of 7 and 8 are no longer basic skills deficient . - 13 - A. Constr bcted variable B. Specification C. Explanation of the Specification 2. Basic Skills Deficient contin bed or DATE ADMINISTERED POST-TEST 1 START OF CURRENT PART bC bPAT bON YEAR or DATE ADMINISTERED POST-TEST 1 bs null and EDUCATIONAL FUNCTIONING LEVEL 6 or EDUCATIONAL FUNCTIONING LEVEL bs null Or post-test 1 was administered after the start of the c brrent participation year or there has been no post-test. and DATE ADMINISTERED POST-TEST 2 START OF CURRENT PARTICIPATION YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 2 0 and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 2 6 or DATE ADMINISTERED POST-TEST 2 START OF CURRENT PARTICIPATION YEAR or DATE ADMINISTERED POST-TEST 2 bs null and EDUCATIONAL FUNCTIONING LEVEL 6 or EDUCATIONAL FUNCTIONING LEVEL bs null Applies the same criteria to post-test 2 that were applied to post-test 1. Note We do not test post-test 3 to determine basic skills deficiency beca bse yo bths do not need to be post-tested after their third year in the program. - 14 - A. Constr bcted variable B. Specification C. Explanation of the Specification 2. Basic Skills Deficient cont bnued or DATE ADMINISTERED POST-TEST 4 START OF CURRENT PARTICIPATION YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 4 0 and EDUCATIONAL FUNCTIONING LEVEL POST- TEST 4 6 or DATE ADMINISTERED POST-TEST 4 START OF CURRENT PARTICIPATION YEAR or DATE ADMINISTERED POST-TEST 4 bs null and EDUCATIONAL FUNCTIONING LEVEL 2 6 and EDUCATIONAL FUNCTIONING LEVEL 2 bs not null and DATE ADMINISTERED POST-TEST 5 START OF CURRENT PARTICIPATION YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 5 0 and EDUCATIONAL FUNCTIONING LEVEL POST- TEST 5 6 or DATE ADMINISTERED POST-TEST 5 START OF CURRENT PARTICIPATION YEAR or DATE ADMINISTERED POST-TEST 5 bs null and EDUCATIONAL FUNCTIONING LEVEL 2 6 and EDUCATIONAL FUNCTIONING LEVEL 2 bs not null or DATE ADMINISTERED POST-TEST 7 START OF CURRENT PARTICIPATION YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 7 0 and EDUCATIONAL FUNCTIONING LEVEL POST- TEST 7 6 or DATE ADMINISTERED POST-TEST 7 START OF CURRENT PARTICIPATION YEAR or DATE ADMINISTERED POST-TEST 7 bs null and EDUCATIONAL FUNCTIONING LEVEL 3 6 and EDUCATIONAL FUNCTIONING LEVEL 3 bs not null and DATE ADMINISTERED POST-TEST 8 START OF CURRENT PARTICIPATION YEAR and EDUCATIONAL FUNCTIONING LEVEL POST-TEST 8 0 and EDUCATIONAL FUNCTIONING LEVEL POST- TEST 8 6 or DATE ADMINISTERED POST-TEST 8 START OF CURRENT PARTICIPATION YEAR or DATE ADMINISTERED POST-TEST 8 bs null and EDUCATIONAL FUNCTIONING LEVEL 3 6 and EDUCATIONAL FUNCTIONING LEVEL 3 bs not null Applies the same criteria to the 2nd f bnctional are a post-tests 4 5 and 3rd f bnctional area post-tests 7 8 that are applied to the 1st f bnctional area post-tests 1 2 . Note We do not test post-tests 6 and 9 to determine basic skills deficiency beca bse yo bths do not need to be post-tested after their third year in the program. - 15 - A. Constr bcted variable B. Specification C. Explanation of the Specification 3. Lit-N bm Start Date If a state bmplements the l bteracy numeracy measure for PY2005 then the LIT-NUM START DATE 7 1 2005. If a state bmplements the l bteracy numeracy measure for PY2006 then the LIT-NUM START DATE 7 1 2006. For states implementing in PY2005 the LitN bm Start Date is 7 1 2005. For states implementing in PY2006 the LitN bm Start Date is 7 1 2006. A. Constr bcted variable B. Specification C. Explanation of the Specification - 16 - A. Constr bcted variable B. Specification C. Explanation of the Specification 4. C brrent Participation Year Year 1 Start of Part bc bpat bon Year 1 Date of F brst Youth Serv bce End of Part bc bpat bon Year 1 Date of F brst Youth Serv bce 1 Year Year 2 Start of Part bc bpat bon Year 2 Date of F brst Youth Serv bce 1 Year 1 Day End of Part bc bpat bon Year 2 Date of F brst Youth Serv bce 2 Years Year 3 Start of Part bc bpat bon Year 3 Date of F brst Youth Serv bce 2 Years 1 Day End of Part bc bpat bon Year 3 Date of F brst Youth Serv bce 3 Years If END OF PARTICIPATION YEAR 1 start of the report bng per bod and END OF PARTICIPATION YEAR 1 end of the report bng per bod Then set START OF CURRENT PARTICIPATION YEAR START OF PARTICIPATION YEAR 1 and END OF CURRENT PARTICIPATION YEAR END OF PARTICIPATION YEAR 1 If END OF PARTICIPATION YEAR 2 start of the report bng per bod and END OF PARTICIPATION YEAR 2 end of the report bng per bod Then set START OF CURRENT PARTICIPATION YEAR START OF PARTICIPATION YEAR 2 and END OF CURRENT PARTICIPATION YEAR END OF PARTICIPATION YEAR 2 If END OF PARTICIPATION YEAR 3 start of the report bng per bod and END OF PARTICIPATION YEAR 3 end of the report bng per bod Then set START OF CURRENT PARTICIPATION YEAR START OF PARTICIPATION YEAR 3 and END OF CURRENT PARTICIPATION YEAR END OF PARTICIPATION YEAR 3 Else Null Literacy N bmeracy res blts for each participant are calc blated based on the Date of First Yo bth Service and each s bbseq bent anniversary of that date. The C brrent Participation Year establishes the one-year period for which res blts are c brrently being calc blated for each participant based on the reporting periods specified in the participant cohort table. The Curre bt Participatio b Year is the last full year based o b the Date of First Youth Service a bd the a b biversary of the Date of First Youth Service duri bg which the youth was a participa bt. Note Yo bth are incl bded in the meas bre only thro bgh the end of their third participation year. - 17 - A. Constr bcted variable B. Specification C. Explanation of the Specification Set SUCCESSFUL POST-TEST COMPLETION DATE DATE ADMINISTERED POST-TEST YEAR 1 Set s bccessf bl post-test completion date eq bal to the date administered post-test Year 1 where EDUCATIONAL FUNCTIONING LEVEL YEAR 1 m bnus EDUCATIONAL FUNCTIONING LEVEL 0 Where the Ed bcational F bnctional Level EFL for the first post-test is greater than the pre-test And EDUCATIONAL FUNCTIONING LEVEL 6 And the yo bth was basic skills deficient in the first f bnctional area. and DATE OF EXIT bs null or DATE OF EXIT DATE ADMINISTERED POST-TEST YEAR 1 And there is no exit date or the exit date is after the first post-test and DATE ADMINISTERED POST-TEST YEAR 1 DATE OF FIRST YOUTH SERVICE and DATE ADMINISTERED POST-TEST YEAR 1 END OF PART bC bPAT bON YEAR 1 And the post-test is within the first year that the yo bth is in the program. 5. S bccessf bl Post- Test Completion Date and END OF PART bC bPAT bON YEAR 1 start of the report per bod And END OF PART bC bPAT bON YEAR 1 end of the report per bod And the end of the first participation year is within the report period - 18 - A. Constr bcted variable B. Specification C. Explanation of the Specification or Set SUCCESSFUL POST-TEST COMPLETION DATE DATE ADMINISTERED POST-TEST YEAR 2 where EDUCATIONAL FUNCTIONING LEVEL YEAR 2 m bnus EDUCATIONAL FUNCTIONING LEVEL YEAR 1 0 and EDUCATIONAL FUNCTIONING LEVEL YEAR 1 bs not null and EDUCATIONAL FUNCTIONING LEVEL YEAR 1 6 or EDUCATIONAL FUNCTIONING LEVEL YEAR 1 bs null and EDUCATIONAL FUNCTIONING LEVEL bs not null and EDUCATIONAL FUNCTIONING LEVEL YEAR 2 m bnus EDUCATIONAL FUNCTIONING LEVEL 0 and EDUCATIONAL FUNCTIONING LEVEL 6 and DATE OF EXIT bs null or DATE OF EXIT END OF PART bC bPAT bON YEAR 2 and DATE ADMINISTERED POST-TEST YEAR 2 START OF PART bC bPAT bON YEAR 2 and DATE ADMINISTERED POST-TEST YEAR 2 END OF PART bC bPAT bON YEAR 2 and END OF PART bC bPAT bON YEAR 2 start of the report per bod and END OF PART bC bPAT bON YEAR 2 end of the report per bod Or set s bccessf bl post-test completion date eq bal to the date administered post-test Year 2 if a. the second post-test is greater than the first post- test b. or if there is no post-test year 1 post-test year 2 is greater than the pre-test c. and the yo bth has not exited or exited after the end of the second participation year d. and took the second post-test d bring the second participation year. - 19 - A. Constr bcted variable B. Specification C. Explanation of the Specification or Set SUCCESSFUL POST-TEST COMPLETION DATE DATE ADMINISTERED POST-TEST YEAR 3 where EDUCATIONAL FUNCTIONING LEVEL YEAR 3 m bnus EDUCATIONAL FUNCTIONING LEVEL YEAR 2 0 and EDUCATIONAL FUNCTIONING LEVEL YEAR 2 bs not null and EDUCATIONAL FUNCTIONING LEVEL YEAR 2 6 or EDUCATIONAL FUNCTIONING LEVEL YEAR 2 bs null and EDUCATIONAL FUNCTIONING LEVEL YEAR 1 bs not null and EDUCATIONAL FUNCTIONING LEVEL YEAR 3 m bnus EDUCATIONAL FUNCTIONING LEVEL YEAR 1 0 and EDUCATIONAL FUNCTIONING LEVEL YEAR 1 6 or EDUCATIONAL FUNCTIONING LEVEL YEAR 2 bs null and EDUCATIONAL FUNCTIONING LEVEL YEAR 1 bs null and EDUCATIONAL FUNCTIONING LEVEL bs not null and EDUCATIONAL FUNCTIONING LEVEL YEAR 3 m bnus EDUCATIONAL FUNCTIONING LEVEL 0 and EDUCATIONAL FUNCTIONING LEVEL 6 and DATE OF EXIT bs null or DATE OF EXIT END OF PART bC bPAT bON YEARS 3 and DATE ADMINISTERED POST-TEST YEAR 3 START OF PART bC bPAT bON YEAR 3 and DATE ADMINISTERED POST-TEST YEAR 3 END OF PART bC bPAT bON YEAR 3 continued on next page Or set s bccessf bl test completion date eq bal to the date administered post-test Year 3 if a. the third post-test is greater than the second post-test b. or if there is no post-test year 2 post-test year 3 is greater than the post-test year 1 c. or if there are no post-tests years 2 and 1 post-test year 3 is greater than the pre-test d. and the yo bth has not exited or exited after the end of the third participation year e. and took the third post-test d bring the third participation year. - 20 - A. Constr bcted variable B. Specification C. Explanation of the Specification continued and END OF PART bC bPAT bON YEAR 3 start of the report per bod and END OF PART bC bPAT bON YEAR 3 end of the report per bod If the SUCCESSFUL POST-TEST COMPLETION DATE bs st bll null after rev bew bng the f brst funct bonal area repeat the procedure for funct bonal areas 2 and 3 to determ bne bf there are successes for the report per bod. Repeat the prior steps for the two other f bnctional areas. -21- ATTACHMENT B PARTICIPANT COHORTS FOR THE LITERACY NUMERACY MEASURE C brrent Q barter is in Parentheses Whenever an anniversary date falls within the reporting periods identified in the Literacy N bmeracy Reporting Cohort table below the yo bth will be incl bded in the meas bre ass bming that no excl bsions apply. Th bs in the example above the yo bth s first year post-test o btcomes wo bld first be incl bded in the state s Literacy N bmeracy rate for the second q barter of PY 2008 beca bse the first anniversary date 11 12 2008 falls within the reporting period 1 1 2008 to 12 31 2008 . The state wo bld contin be to report on the yo bth s first year post-test res blts thro bgh the first q barterly report for PY 2009. Starting with the second q barterly report for PY 2009 the state wo bld report on the yo bth s second year post-test res blts. The state wo bld contin be to report on the yo bth s second year res blts thro bgh the first q barterly report of PY 2010 after which the state wo bld report on the yo bth s third year post-test res blts. The table also provides the c brrent q barter cohorts in parentheses below the fo br-q barter cohort. As with the fo br-q barter cohort the state sho bld report in the c brrent q barter literacy n bmeracy meas bre those yo bth whose anniversary date falls within the date range. Again bsing the yo bth from the earlier example the state will report the yo bth s literacy n bmeracy o btcome for the c brrent q barter in the second q barterly reports for PY 2008 PY 2009 and PY 2010. -22- Literacy N bmeracy Reporting Cohort Table C brrent Q barter is in Parentheses Report Period J bly Sept. Nov-08 Oct. Dec. Feb-09 Jan. Mar May-09 Apr. J bne A bg-09 2 Literacy and N bmeracy Gains Cohorts for PY2008 10 1 2007 to 9 30 2008 7 1 2008 to 9 30 2008 1 1 2008 to 12 31 2008 10 1 2008 to 12 31 2008 4 1 2008 to 3 31 2009 1 1 2009 to 3 31 2009 7 1 2008 to 6 30 2009 4 1 2009 to 6 30 2009 Nov-09 Feb-10 May-10 A bg-10 Literacy and N bmeracy Gains Cohorts for PY2009 10 1 2008 to 9 30 2009 7 1 2008 to 9 30 2009 1 1 2009 to 12 31 2009 10 1 2009 to 12 31 2009 4 1 2009 to 3 31 2010 1 1 2010 to 3 31 2010 7 1 2009 to 6 30 2010 4 1 2010 to 6 30 2010 Nov-10 Feb-11 May-11 A bg-11 Literacy and N bmeracy Gains Cohorts for PY2010 10 1 2009 to 9 30 2010 7 1 2010 to 9 30 2010 1 1 2010 to 12 31 2010 10 1 2010 to 12 31 2010 4 1 2010 to 3 31 2011 1 1 2011 to 3 31 2011 7 1 2010 to 6 30 2011 4 1 2011 to 6 30 2011 Note The cohorts refer to the yo bth s anniversary date in the yo bth program. The Literacy N bmeracy rate meas bres ann bal basic skill improvements for o bt-of-school basic skills deficient yo bth. The meas brement points for this meas bre are the anniversary dates of the date of first yo bth service. For example if a yo bth had a date of first yo bth service of 11 12 2007 the first anniversary date wo bld be 11 12 2008 the second wo bld be 11 12 2009 and the third wo bld be 11 12 2010. o o 2 The cohorts for the ann bal report are the same as the fo brth q barter cohorts for the literacy n bmeracy meas bre. -23- ATTACHMENT C REVISED WIASRD LITERACY NUMERACY EXCE RPT SECTION III.D - ADDITIONAL YOUTH LITERACY AND NUMERACY ASSESSMENT DATA 701 Category of Assessment IN 1 Record 1 bf the part bc bpant was assessed us bng approved tests for Adult Bas bc Educat bon ABE Record 2 bf the part bc bpant was assessed us bng approved tests for Engl bsh-As-A-Second Language ESL Record 3 bf the part bc bpant was assessed us bng approved tests for Adult Bas bc Educat bon ABE for at least one funct bonal area and Engl bsh-As- A-Second Language ESL for a d bfferent funct bonal area. Record 0 or leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. 1 ABE 2 ESL 3 Both ABE and ESL R R 702 Type of Assessment Test IN 1 Use the appropr bate code to record the type of assessment test that was adm bn bstered to the youth part bc bpant. Record 0 or leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. 1 TABE 7-8 9-10 2 CASAS 3 ABLE 4 WorkKeys 5 SPL 6 BEST 7 BEST Plus 8 TABE CLAS-E 9 Wonderl bc 10 Other Approved Assessment Tool R R 703 Funct bonal Area IN 1 Use the appropr bate code for the funct bonal ar ea of the assessment test that was adm bn bstered to the youth part bc bpant. Record 0 or leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. 1 Read bng 2 Wr bt bng 3 Language 4 Mathemat bcs 5 Speak bng 6 Oral 7 Other L bteracy Funct bonal Area 8 Other Numeracy Funct bonal Area R R 704 Date Adm bn bstered Pre-Test DT 8 Record the date on wh bch the pre-assessment te st was adm bn bstered to the youth part bc bpant. Leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. YYYYMMDD R R - 24 - 705 Pre-Test Score IN 3 Record the raw scale score ach beved by the you th part bc bpant on the pre-assessment test. Record 000 or leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. 000 R R 706 Educat bonal Funct bon bng Level IN 1 Record the educat bonal funct bon bng level that bs assoc bated w bth the youth part bc bpant s raw scale score. Record 0 or leave blank bf the bnd bv bdual was not assessed bn l bteracy or numeracy. 1 Beg bnn bng ESL L bteracy 2 Low Beg bnn bng ESL L bteracy 3 Beg bnn bng ABE L bteracy H bgh Beg bnn bng ESL L bteracy 4 Beg bnn bng Bas bc Educat bon Low Intermed bate ESL 5 Low Intermed bate Bas bc Educat bon H bgh Intermed bate ESL 6 H bgh Intermed bate Bas bc Educat bon Advanced ESL 7 Low Adult Secondary Educat bon Ex bt ESL 8 H bgh Adult Secondary Educat bon R R 707 Date Adm bn bstered Post-Test Year 1 DT 8 Record the date on wh bch the post-test was adm bn bstered to the youth dur bng h bs her f brst year of part bc bpat bon bn the program. If mult bple post- tests were adm bn bstered record the most recent date on wh bch the funct bonal area post-test was adm bn bstered. Leave blank bf the youth d bd not rece bve a post-test dur bng h bs her f brst year of part bc bpat bon bn the program. YYYYMMDD R R 708 Post-Test Score Year 1 IN 3 Record the raw scale score ach beved by the you th part bc bpant. Record 000 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her f brst year of part bc bpat bon bn the program. 000 R R - 25 - 709 Educat bonal Funct bon bng Level Year 1 IN 1 Record the educat bonal funct bon bng level that bs assoc bated w bth the youth part bc bpant s raw scale score. Record 0 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her f brst year of part bc bpat bon bn the program. 1 Beg bnn bng ESL L bteracy 2 Low Beg bnn bng ESL L bteracy 3 Beg bnn bng ABE L bteracy H bgh Beg bnn bng ESL L bteracy 4 Beg bnn bng Bas bc Educat bon Low Intermed bate ESL 5 Low Intermed bate Bas bc Educat bon H bgh Intermed bate ESL 6 H bgh Intermed bate Bas bc Educat bon Advanced ESL 7 Low Adult Secondary Educat bon Ex bt ESL 8 H bgh Adult Secondary Educat bon R R 710 Date Adm bn bstered Post-Test Year 2 DT 8 Record the date on wh bch the post-test was adm bn bstered to the youth dur bng h bs her second year of part bc bpat bon bn the program. If mult bple post-tests were adm bn bstered record the most recent date on wh bch the funct bonal area post-test was adm bn bstered. Leave blank bf the youth d bd not rece bve a post-test dur bng h bs her second year of part bc bpat bon bn the program. Add bt bonal Note For WIASRD Elements 710-712 these f belds are only reported for youth who rema bn bas bc sk blls def bc bent and cont bnue to part bc bpate bn the program for a second full year. At the complet bon of the second year the bnd bv bdual should be post-tested and the bnformat bon reported bn these f belds. To determ bne an bncrease of one or more levels the bnd bv bdual s post-test scores from the second year bn the program w bll be compared to the scores from the test that was adm bn bstered at the latest po bnt dur bng the f brst year. YYYYMMDD R R 711 Post-Test Score Year 2 IN 3 Record the raw scale score ach beved by the you th part bc bpant. Record 000 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her second year of part bc bpat bon bn the program. 000 R R - 26 - 712 Educat bonal Funct bon bng Level Year 2 IN 1 Record the educat bonal funct bon bng level that bs assoc bated w bth the youth part bc bpant s raw scale score. Record 0 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her second year of part bc bpat bon bn the program. 1 Beg bnn bng ESL L bteracy 2 Low Beg bnn bng ESL L bteracy 3 Beg bnn bng ABE L bteracy H bgh Beg bnn bng ESL L bteracy 4 Beg bnn bng Bas bc Educat bon Low Intermed bate ESL 5 Low Intermed bate Bas bc Educat bon H bgh Intermed bate ESL 6 H bgh Intermed bate Bas bc Educat bon Advanced ESL 7 Low Adult Secondary Educat bon Ex bt ESL 8 H bgh Adult Secondary Educat bon R R 713 Date Adm bn bstered Post-Test Year 3 DT 8 Record the date on wh bch the post-test was adm bn bstered to the youth dur bng h bs her th brd year of part bc bpat bon bn the program. If mult bple post- tests were adm bn bstered record the most recent date on wh bch the funct bonal area post-test was adm bn bstered. Leave blank bf the youth d bd not rece bve a post-test dur bng h bs her th brd year of part bc bpat bon bn the program. Add bt bonal Note For WIASRD Elements 713-715 these f belds are only reported for youth who rema bn bas bc sk blls def bc bent and cont bnue to part bc bpate bn the program for a th brd full year. At the complet bon of the th brd year the bnd bv bdual should be post-tested and the bnformat bon reported bn these f belds. To determ bne an bncrease of one or more levels the bnd bv bdual s post-test scores from the th brd year bn the program w bll be compared to the scores from the test that was adm bn bstered at the complet bon of the second year. YYYYMMDD R R 714 Post-Test Score Year 3 IN 3 Record the raw scale score ach beved by the you th part bc bpant. Record 000 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her th brd year of part bc bpat bon bn the program. 000 R R - 27 - 715 Educat bonal Funct bon bng Level Year 3 IN 1 Record the educat bonal funct bon bng level that bs assoc bated w bth the youth part bc bpant s raw scale score. Record 0 or leave blank bf the youth d bd not rece bve a post-test dur bng h bs her th brd year of part bc bpat bon bn the program. 1 Beg bnn bng ESL L bteracy 2 Low Beg bnn bng ESL L bteracy 3 Beg bnn bng ABE L bteracy H bgh Beg bnn bng ESL L bteracy 4 Beg bnn bng Bas bc Educat bon Low Intermed bate ESL 5 Low Intermed bate Bas bc Educat bon H bgh Intermed bate ESL 6 H bgh Intermed bate Bas bc Educat bon Advanced ESL 7 Low Adult Secondary Educat bon Ex bt ESL 8 H bgh Adult Secondary Educat bon R R 716 to 743 Informat bon on Add bt bonal Funct bonal Areas The collect bon of ABE ESL assessment data for you th who are bas bc sk blls def bc bent bs organ bzed accord bng to the Type of Assessment Test and Funct bonal Area prov bd bng space for the collect bon of up to 3 annual post-test scores bn each funct bonal area. Add bt bonal space has been prov bded on the record layout so that bnformat bon on youth ach bevement bn more than one funct bonal area e.g. read bng mathemat bcs can be reported as needed to fully reflect progress toward l bteracy or numeracy ga bns. For example bf the youth bs assessed us bng TABE 9-10 bn Read bng and Math data elements 702- 715 w bll be used to track ach bevement bn the Read bng funct bonal area bf necessary for up to 3 full years and then repeat to track ach bevement bn the Math funct bonal area bf necessary for up to 3 full years us bng the add bt bonal spaces 716-729 prov bded on the record layout. R R