UIPL 11-24.pdf

ETA Advisory File Text

EMPLOYMENT AND TRAINING ADMINISTRATION ADVISORY SYSTEM U.S. DEPARTMENT OF LABOR Washington D.C. 20210 CLAS SIFICATION Unemployment Insurance CORR ESPONDENCE SYMBOL OUI DPM DATE May 3 2024 RESCISSIONS None EXPIRATION DATE March 31 2025 ADVISORY TO UNEMPLOYMENT INSURANCE PROGRAM LETTER NO. 11-24 STATE WORKFORCE AGENCIES FROM JOS JAVIER RODR GUEZ Assistant Secretary SUBJECT Procedures f or the Completion and Publication of Unemployment Insurance UI Benef it Accuracy Measurement BAM Data f or Payment Integrity Inf ormation Act PIIA Reporting Year 202 4 1. Purpose . To provide State Workf orce Agencies SWAs guidelines and key dates f or the completion of the 202 4 UI BAM paid and denied claims sample cases and the publication of 202 4 BAM data. 2. Action Requested . The Employment and Training Administration ETA requests that SWA Administrators a. Provide copies of these guidelines to the appropriate staf f b. Send any request s f or a waiver of BAM timeliness requirements to the appropriate ETA Regional Of f ice by close of business COB October 04 202 4 and c. Ensure that ETA and the appropriate ETA Regional Of f ice are 1 Notif ied by November 22 202 4 of any issues that require reconciliation between the SWA s and ETA s BAM data and 2 Provided by January 1 0 202 5 the name address telephone number and email address of the point of contact s f or the SWA s published BAM data. 3. Summary and Background. a. Summary This Unemployment Insurance Program Letter UIPL provides guidelines and key dates f or the completion of the 202 4representative sample cases of UI payments and denials and the publication of 202 4 BAM data. ETA issues these annual guidelines as set out in Employment and Training ET Handbook No. 395 5 th Edition Of f ice of Management and Budget OMB approval number 1205 -0245 . The BAM program is designed to determine the accuracy of paid and denied claims in three major UI programs regular State UI Unemployment Compensation f or Federal Employees and Unemployment Compensation f or Ex -Servicemembers. SWAs select weekly random 2 samples of paid and denied claims. Independent state BAM investigators audit these paid and denied claims to determine whether the claimant was properly paid or properly denied benef its. b. Background Each year ETA publishes BAM program reporting year results BAM Annual Report on its website under Current Data located at https oui.doleta.gov unemploy bqc.asp . U. S. Department of Labor Department also publishes BAM data on its website https www.dol.gov agencies eta unemployment- insurance-payment-accuracy data each quarter. This quarterly data includes the most recent 12 months of data. Historically the BAM program reporting year publication has included an analytical report or a detailed analysis of these results. As part of this process ETA announces the publication cycle with the issuance of a UIPL which provides dates f or case completion verif ication of data contained in the national database and an explanation of data f ootnotes. The present UIPL continues this practice. Additionally this UIPL incorporates the annual f inancial reporting requirement f ound in the PIIA that Federal programs report an annual improper payment rate. The PIIA repeals the Improper Payments Inf ormation Act of 2002 as amended by the Improper Payments Elimination and Recovery Act of 2012. 4. Guidelines and Key Dates. a. Completion of PIIA 2024 BAM Cases. Pursuant to the requirements of the PIIA ETA provides inf ormation on improper payments in the UI program including the improper payment estimate that it provides in its response to OMB s annual Payment Integrity Data Call. To meet the PIIA requirements ETA establishes the PIIA reporting year f or the BAM program which includes payment accuracy estimates f or the period generally beginning in July and continuing through June of the f ollowing year BAM batch range YYYY27 through YYYY 1 26 however dates can dif f er slightly f rom year to year. ETA has established standards that states complete a minimum of 95 percent of sampled cases within 90 days of the week ending date of the batch and complete a minimum of 98 percent of sampled cases within 120 days of the ending date of the above annual reporting period. This July-to-June reporting period provides the most recent BAM data available to meet the PIIA reporting schedule requirements f or the f iscal year. PIIA 2024 will include batch range 202327 through 202426 July 2 2023 to June 29 2024 . Theref ore all published BAM data will be based on PIIA 2024 BAM paid and denied claims cases that the BAM supervisor has signed of f by the date of record. The BAM supervisor must close and submit cases by COB 120 days af ter the end of the reporting year which is COB October 28 2024. Changes to a SWA s database af ter the date of record can result in inconsistencies with the ETA database. A SWA must not close or reopen any PIIA 2024 BAM cases af ter 3 October 28 2024 until the SWA has reviewed the BAM data transmitted to it by ETA and has conf irmed that the data agrees with the BAM paid claims accuracy and denied claims accuracy data produced by the SWA s databases. b. Transmittal of Data and Comment Period. ETA will produce and transmit to each SWA by November 8 2024 paid and denied claims accuracy data f or that SWA based on the PIIA 2024 BAM cases that were submitted by the SWA as of COB October 28 2024. SWAs are required to run the BAM Paid Claims Annual Report Denied Claims Error Rates Report and Improper Denials Rates Report sof tware and to compare the results with the rates and report data. By November 22 2024 SWAs should report any discrepancies or submit questions concerning the BAM paid and denied claims data to ETA. Please send comments electronically to UI-BAM dol.gov with a copy to the appropriate ETA Regional Of f ice. Samples of these reports are available in Attachments I and II. ETA staf f will address and reconcile issues raised by the SWAs by December 6 2024. c. Federal Publication of BAM Data. ETA will publish the PIIA 2024 BAM analytical report on the ETA website https oui.doleta.gov unemploy bqc.asp. If a SWA f ails to f ollow the BAM methodology f or sample selection and completion requirements ETA may not publish a state s data or portion thereof if the state f ailed to f ollow the BAM methodology as outlined in ET Handbook 395 5th Edition f or example methodologies regarding minimum sample sizes population variances case completion percentages and quality of the BAM audits . d. Key Dates. The f ollowing key dates are the latest dates f or completing the task or action 6 29 2024 This date represents the end of the PIIA reporting year. By the end of batch week June 23 2024 through June 29 2024 SWAs must select the minimum number of valid cases to meet annual sample allocation requirements i.e. 480 or 360 paid claim cases and 150 of each of the three types of denied claims . SWAs must complete at least 98 percent of the valid cases sampled in PIIA 2024 by October 28 2024. 10 04 2024 SWAs submit requests f or waivers of BAM paid and denied claims timeliness requirements along with supporting documentation to the appropriate ETA Regional Of f ice. Generally waivers are granted only f or catastrophic events i.e. occurrence by natural causes that could not have been prevented by the exercise of f oresight or caution . 4 10 28 2024 Each SWA checks its UI database to ensure 1 the BAM supervisor has signed of f on all BAM paid and denied claims cases that investigators have completed and 2 reopened cases have been updated and data errors corrected by this date. Cases closed by supervisors af ter COB on October 28 2024 will not be included in the Paid Claims Accuracy PIIA Report or the Denied Claim Accuracy Error Rates and Improper Denials Rates Reports. SWAs must not reopen any PIIA 2024 cases af ter October 28 2024 until they review the BAM data transmitted by ETA and verify the data against their SWA database or reconciled any dif f erences with ETA. For BAM Paid data BAM should compare the highlighted BAM sample and dollars paid section in Attachment I. 11 04 2024 Regional of f ices respond to SWAs on the disposition of SWA requests f or waivers of BAM timeliness requirements. 11 08 2024 ETA transmits the PIIA 2024 BAM data to SWA s BAM supervisors. 11 22 2024 SWAs review BAM paid and denied claims accuracy data and report any discrepancies or submit questions about the BAM data electronically to UI-BAM dol.gov with a copy to the appropriate ETA Regional Of f ice. 12 06 2024 ETA staf f address issues raised by the SWAs and reconcile any dif f erences between SWA and ETA BAM data. 1 10 2025 SWAs provide the name address telephone number and email address of the person s responsible f or public inquiries about BAM paid and denied claims estimation results Note this may be diff erent than the BAM supervisor . SWAs should send this inf ormation electronically to UI-BAM dol.gov with a copy to the appropriate ETA Regional Of f ice. 5. Inquiries. Please direct inquiries to the appropriate ETA regional of f ice. 6. References. Payment Integrity Inf ormation Act of 2019 PIIA Pub. L. 116-117 enacted March 2 2020 https congress.gov 116 plaws publ117 PLAW-116publ117.pdf Of f ice of Management and Budget OMB Circular No. A-123 Appendix C Requirements for Payment Integrity Improvement March 5 2021 . https www.whitehouse.gov wp-content uploads 2021 03 M-21-19.pdf 31 U.S.C. 3515 Financial statements of agencies 20 C.F.R. Part 602 Quality Control in the Federal-State Unemployment Insurance System UIPL No. 09-13 Change 1 Integrity Performance Measure for Unemployment issued on 5 January 27 2015 https www.dol.gov agencies eta advisories unemployment-insurance- program-letter-no-09-13-change-1 UIPL No. 09-23 Additional Planning Guidance for the Fiscal Year FY 2024 Unemployment Insurance UI State Quality Service Plan SQSP issued on June 30 2023 https www.dol.gov agencies eta advisories UIPL0923 UIPL No. 12-23 Procedures for the Completion and Publication of Unemployment Insurance Benefit Accuracy Measurement Data for Payment Integrity Information Act Reporting Year 2023 issued on August 16 2023 https www.dol.gov agencies eta advisories uipl-12-23 and Employment and Training ET Handbook No. 395 5th Edition Benefit Accuracy Measurement State Operations Handbook November 2009 https www.dol.gov agencies eta advisories handbooks et-handbook-no-395. 7. Attachments. Attachment I Benef it Accuracy Measurement BAM Paid Claims Accuracy Annual Report Report Def initions and Report Footnotes Attachment II Benef it Accuracy Measurement BAM Denied Claims Accuracy Error Rates Report and Improper Denials Rates Report Report Def initions and Report Footnotes Attachment I I-1 Benef it Accuracy Measurement BAM Paid Claims Accuracy Annual Report Report Def initions and Report Footnotes BENEFIT ACCURACY MEASUREMENT PAID CLAIMS ACCURACY ANNUAL REPORT Sample STATE ZZ Batch Range 202327 - 202426 Total Dollars Paid in Population 221 830 728 Sample Size 383 Percentage Of Dollars 95 Conf idence Interval - Proper Payments 88.1 3.5 Overpayments 11.6 3.5 Total 100.0 Underpayments 0.3 0.2 Percentages apply to less than a complete year of UI payments the Sta te did not pull a sa m ple f or 3 week s . The Sta te com pleted 83.7 of the ca ses within 90 da ys. The Qua lity Control QC progra m sta nda rd is 95 com pleted within 90 da ys. 15.9 of the sample cases were not completed when this report wa s prepared. This exceeded the QC progra m requirem ent tha t no m ore tha n 2 of the ca ses f or the yea r rem a in incom plete. I-2 BENEFIT ACCURACY MEASUREMENT PAID CLAIMS ACCURACY ANNUAL REPORT Supplemental Data Sample STATE ZZ Batch Range 202327 - 202426 Responsibility f or Overpayments Percent of Dollars Overpaid Cla im a nt Only 51.6 Agency Only 15.6 Cla im a nt Agency 10.6 Cla im a nt Em ployer 10.5 Em ployer Only 8.6 Cla im a nt Em ployer Agency 2.1 Cla im a nt Other 1.7 Em ployer Agency 1.0 Other Only 0.0 Em ployer Other 0.0 Agency Other 0.0 Cla im a nt Em ployer Other 0.0 Cla im a nt Agency Other 0.0 Em ployer Agency Other 0.0 Cla im a nt Em ployer Agency Other 0.0 Responsibility Not Specif ied 0.0 I-3 Cause f or Overpayments Percent of Dollars Overpaid Benef it Yea r Ea rnings I ssues 39.1 Eligibility I ssues Excluding Work Sea rch 25.7 Sepa ra tion I ssues 20.5 Ba se Period Wa ge I ssues 7.4 Other I ssues 5.9 Work Sea rch I ssues 2.9 N O T E The percentages f or the responsibilities or ca use do not sum to 100 percent. You should check f ield h5 to verif y tha t a ll ca ses ha ve been coded correctly within your specif ied ba tch ra nge. I f ca use a nd responsibility percentages do not add up to 100 percent states should check f or ca ses in which the key week a m ount overpaid coded in da ta element h5 in the b master table of the UI database does not equa l the sum of dolla rs overpaid coded in da ta element ei1 f or key week a ctions 10 11 12 13 a nd 15 in the b errisu ta ble. The a m ount overpa id ca nnot exceed the a m ount pa id coded in da ta elem ent f 13 in the b m a ster ta ble. I-4 BAM Annual Report Definitions Total Dollars Paid in Population Total UI benef its paid to the population of UI claimants who constitute the sampling f rames f or all weeks in PIIA 2024 f rom which the State pulled a BAM sample adjusted to exclude UI payments that do not meet the def inition of the BAM population f or example supplemental payments or payments made f or Emergency Unemployment Compensation EUC claims . These excluded cases are coded 8 EUC or 9 all other excluded records in the program code data element c1 in the b master table of the UI database. Sample Size Total number of UI payments selected during PIIA 2024 BAM batches 202327 through 202426 and completed supervisor sign-off by COB October 28 2024 excluding cases that do not meet the BAM population def inition. This is the number of BAM sample cases f rom which the payment accuracy rates and conf idence intervals are estimated. Proper Payments The weighted ratio estimate of total dollars properly paid to total dollars paid expressed as a percentage. Overpayments The weighted ratio estimate of total dollars overpaid to total dollars paid expressed as a percentage. Underpayments The weighted ratio estimate of total dollars underpaid to total dollars paid expressed as a percentage. Weighting Procedures UI benef its properly paid overpaid and underpaid f or each batch with at least two completed paid claims cases are weighted by the batch population adjusted to exclude cases that do not meet the BAM def inition program code 8 or 9 . The accuracy rates are the ratios of these weighted benef its summed f or all batches. Batches with only one completed case are merged to ensure that each batch has a minimum of two completed cases. 95 Percent Conf idence Interval A conf idence interval expressed as - x percentage points is constructed f or each of the three estimated rates. The actual rate is expected to lie within 95 percent of the intervals constructed f rom repeated samples of the same size and selected in the same manner as the BAM sample. I-5 BAM Paid Claims Accuracy Footnotes Footnote 1 Claimants f ailing to conduct required work search were given f ormal warnings and no overpayment was established. The proper payment rate would be lower and the overpayment rate would be higher if these cases were counted as erroneous payments. Condition Any PIIA 2024 BAM case with key week action code 14 in f ield ei2 of the b errisu table of the UI database. Footnote 2 Percentages apply to less than a complete year of UI payments due to the State not pulling a sample f or x weeks. Condition There is no record in the b comparison table of the UI database f or one or more BAM batches 202327 through 202426. Note If the State requested and received permission f rom ETA to suspend BAM sampling temporarily due to a catastrophic event or another approved reason the f ootnote will ref lect that ETA concurred with the suspension. Footnote 3 The State selected samples that were below the minimum prescribed levels f or x weeks. Condition State selected one or more BAM weekly samples below the minimum level prescribed in Benef it Accuracy Measurement State Operations Handbook ET Handbook No. 395 5th Edition chapter VI p. 11. Sampled cases that f ail to meet the BAM population definition are counted toward meeting the minimum weekly sample. The minimum weekly and quarterly samples based on current annual sample allocations are Sample Annual Allocation Normal Weekly Minimum Weekly Normal Quarterly Minimum Quarterly Paid Claims 360 7 5 90 81 Paid Claims 480 9 6 120 108 Denials 150 450 3 2 37-38 32 Allocation f or the ten smallest states in terms of UI workload. 150 cases each of monetary separation and non-separation denials will be selected each year f or a total of 450 Denied Claims Accuracy cases. Note If a state requested and received permission f rom ETA to reduce BAM sample sizes temporarily due to workload contingencies the f ootnote will ref lect that ETA concurred with the reduction. I-6 Footnote 4 Percentages based on data collection procedures that were not completely in accordance with the program methodology prescribed in ET Handbook No. 395 5th Edition. Condition ETA staf f continuously monitors state perf ormance with respect to the BAM administrative requirements established in ET Handbook 395 5th Edition f or example minimum sample sizes population variances case completion percentages and timeliness and quality of the BAM audits . According to UIPL No. 09-23 p. 19 states must address BAM program perf ormance def iciencies in a Corrective Action Plan as a part of the State Quality Service Plan. Footnote 5 The state completed x percent of the cases within 90 days. The program standard is 95 percent completed within 90 days. Condition State f ailed to meet case completion objectives established in ET Handbook No. 395 5th Edition Benef it Accuracy Measurement State Operations Handbook chapter VI p. 11. Cases not meeting the BAM population definition are not counted in calculating state time lapse rates. Footnote 6 X percent of the sample cases were not completed when this report was prepared. This exceeded the program requirement that no more than two 2 percent of the cases f or the year remain incomplete. Condition The percentage is based on the number of BAM cases that were not completed no supervisor sign-of f by COB October 28 2024 divided by the number of valid cases selected for BAM weekly samples during PIIA 2024 BAM batches 202327 through 202426 . Cases that do not meet the BAM population def inition are not counted in calculating state case completion rates. Footnote 7 The annual sample f or state is x cases below the allocated annual sample f or the state. The precision of the data might be reduced due to the f ailure to sample at the prescribed level. Condition The state s annual sample selection is below its allocated annual sample. Cases that do not meet the BAM population def inition are not counted toward meeting the annual sample allocation. Note If a state requested and received permission f rom ETA to reduce BAM sample sizes temporarily due to workload contingencies the f ootnote will ref lect that ETA concurred with the reduction. I-7 Footnote 8 The population f rom which the BAM sample was selected did not include all of the UI benef its paid. This limits the degree to which inf erences about the population can be made f rom BAM data. Condition The dollars paid in the BAM population f or PIIA 2024 vary f rom the dollars paid reported in the state s ETA 5159 Claims and Payment Activities reports by more than the statistical control limit. ATTACHMENT II Benef it Accuracy Measurement BAM Denied Claims Accuracy Error Rates Report and Improper Denials Rates Report Report Def initions and Report Footnotes II-1 BENEFIT ACCURACY MEASUREMENT BAM DENIED CLAIMS ACCURACY DCA ERROR RATES REPORT State ZZ Report Date 11 20 2024 Batch Range 202327 202426 Denial Type Population Cases Completed Monetary 97 029 143 Separation 77 374 140 Nonseparation 24 229 134 Denial Type Total Errors Improper Denial Adjusted Improper Denial Overpayment Proper Denial Monetary 16.52 14.85 8.05 0.00 1.67 Separation 28.59 16.12 15.87 0.00 12.47 Nonseparation 40.74 14.02 14.02 0.00 26.71 Excludes cases not meeting DCA definition f or inclusion in population withdrawn cla ims a nd cla im s f or which m onetary eligibility wa s esta blished upon receipt of combined wa ge claim CWC unem ploym ent com pensation f or f ederal em ployees UCFE a nd or unemployment compensation f or ex-servicemem bers UCX wa ge credits. Adjusted ra te excludes erroneous denia ls tha t were corrected by a gency or reversed on a ppea l prior to DCA ca se com pletion. Properly denied but f or wrong rea son or section of the la w. The sta te completed 76.35 percent of the Monetary denials sample cases within 90 days. The program standa rd is 85 percent com pleted within 90 da ys. The sta te completed 78.43 percent of the Separation denia ls sample ca ses within 90 days. The program standard is 85 percent com pleted within 90 da ys. The sta te completed 79.87 percent of the Nonsepa ra tion denia ls sa m ple ca ses within 90 da ys. The progra m sta nda rd is 85 percent com pleted within 90 da ys. Estim a ted ra tes apply to less than the total population of Monetary denials due to the state not pulling a sa m ple f or 1 week s . Estim a ted ra tes apply to less than the total population of Separation denials due to the state not pulling a sa mple f or 1 week s . Estim a ted ra tes apply to less than the total population of Nonsepa ra tion denia ls due to the sta te not pulling a sa m ple f or 1 week s . II-2 BENEFIT ACCURACY MEASUREMENT DENIED CLAIMS ACCURACY IMPROPER DENIALS RATES REPORT State ZZ Report Date 11 20 2024 Batch Range 202327 202426 Denial Type Population Cases Completed Monetary 97 029 143 Separation 77 374 140 Nonseparation 24 229 134 Denial Type Improper Denial 95 C.I - Adjusted Improper Denial 95 C.I - Monetary 14.85 5.77 8.05 4.51 Separation 16.12 6.45 15.87 6.43 Nonseparation 14.02 6.13 14.02 6.13 Excludes cases not meeting DCA definition f or inclusion in population withdrawn cla im s a nd cla im s f or which m onetary eligibility wa s established upon receipt of CWC UCFE a nd or UCX wa ge credits. Adjusted ra te excludes erroneous denials that were corrected by a gency or reversed on a ppea l prior to DCA ca se com pletion. Note 95 C.I . is the 95 percent confidence interval f or the estimated ra te. The interva l is the ra nge between the ra te m inus the va lue in the 95 C.I . colum n a nd the ra te plus the va lue in the 95 C.I . colum n. For exa mple the interval f or 10.0 - 2.5 is 7.5 to 12.5 . The true ra te is expected to lie within 95 percent of the intervals constructed f rom repeated samples of the same size a nd selected in the sa me m a nner a s the BAM DCA sa m ple. The sta te completed 76.35 percent of the Monetary denials sample cases within 90 days. The program standa rd is 85 percent com pleted within 90 da ys. The sta te completed 78.43 percent of the Separation denia ls sample ca ses within 90 days. The program standard is 85 percent com pleted within 90 da ys. The sta te completed 79.87 percent of the Nonsepa ra tion denia ls sa m ple ca ses within 90 da ys. The progra m sta nda rd is 85 percent com pleted within 90 da ys. Estim a ted ra tes apply to less than the total population of Monetary denials due to the state not pulling a sa m ple f or 1 week s . Estim a ted ra tes apply to less than the total population of Separation denials due to the state not pulling a sa mple f or 1 week s . Estim a ted ra tes apply to less than the total population of Nonsepa ra tion denia ls due to the sta te not pulling a sa m ple f or 1 week s . II-3 BAM Denied Claims Accuracy Rates Report Definitions Population The number of denial determinations that constitute the sampling f rames f or all weeks in PIIA 2024 f or which the state pulled a BAM DCA sample adjusted to exclude agency actions that do not meet the def inition of the BAM DCA population f or example monetary redeterminations nonmonetary determinations that are not reportable on the ETA 207 and 9052 reports and denied emergency unemployment compensation EUC claims . These excluded cases are coded 8 EUC or 9 all other excluded records in the Program code data element in the b dca master table of the UI database. The sof tware also adjusts the DCA populations to exclude two types of cases f or which there is no denial issue to investigate 1 cases in which monetary eligibility was established upon receipt of Combined Wage Claims Alternative Base Period Claims Unemployment Compensation f or Federal Employees and or Unemployment Compensation for Ex-service members wage credits within the two-week sampling lag Action Code Flag 0 and 2 claims withdrawn by the claimant Action Code Flag 8 . Sample Size Total DCA cases selected during PIIA 2024 BAM batches 202327 through 202426 and completed supervisor sign-off by COB October 28 2024 excluding cases that do not meet the BAM DCA population def inition. This is the number of BAM DCA sample cases f rom which the accuracy rates are estimated. Improper Denial Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant should have been eligible f or UI benef its or was underpaid UI benef its Error Issue Action Code 20 21 22 or 23 expressed as a percentage. Adjusted Improper Denial Rate Improper Denial Rate excluding cases in which erroneous denials were corrected by the agency Prior Agency Action 20 to 29 or eligibility was established through appeal Results of Appeal of Initial Determination 1 or 3 prior to DCA case completion. Overpayment Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant should have been ineligible f or UI or should have received a lower benefit amount f or weeks that had been paid Error Issue Action Code 10 11 12 13 14 15 or 16 expressed as a percentage. II-4 Proper Denial Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant was properly denied but f or the wrong or dif f erent reason section of the law Error Issue Action Code 30 expressed as a percentage. Weighting Procedures Accuracy rates are computed separately f or each batch with at least two completed DCA cases and weighted by the batch population adjusted to exclude cases that do not meet the BAM DCA def inition Program code 8 or 9 or cases with Action Codes 0 monetary eligibility established upon receipt of CWC UCFE and or UCX wage credits or 8 withdrawn claims . The accuracy rate equals the sum of the products of the batch rates and weights. Batches with only one completed case are merged to ensure that each batch has a minimum of two completed cases. 95 Percent Conf idence Interval A conf idence interval expressed as - x percentage points is constructed f or each of the estimated accuracy rates. The actual rate is expected to lie within 95 percent of the intervals constructed f rom repeated samples of the same size and selected in the same manner as the BAM sample. II-5 BAM Denied Claims Accuracy Footnotes Footnote 1 Estimated rates apply to less than the total population of sample type denials due to the state not pulling a sample f or x weeks. Condition There is no record in the b dca comparison table of the UI database f or one or more batches specif ied in the batch range f or sample type y where b dca comparison samptype 2 monetary 3 separation or 4 nonseparation . Footnote 2 Estimated rates f or sample type denials are based on data collection procedures that were not completely in accordance with the program methodology prescribed in ET Handbook No. 395 5th edition. Condition Based on program monitoring conducted by ETA s national and regional of fices this f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . Footnote 3 The state completed x percent of the sample type denials sample cases within 90 days. The program standard is 85 percent completed within 90 days. Condition The percentage for sample type y where b dca master.samptype 2 monetary 3 separation or 4 nonseparation will be calculated using the same method used in the BAM DCA Case Completion and Time Lapse report. Cases not meeting the BAM DCA population def inition b dca master.program 8 or 9 or withdrawn claims b dca master.actf lag 8 are not counted in calculating state time lapse rates. Footnote 4 x percent of the sample type denials sample cases were not completed when this report was prepared. This exceeds the program requirement that no more than 2 percent of the cases f or the year are incomplete 120 days af ter the end of the PIIA reporting year. Condition The percentage is based on the number of BAM DCA cases that were not completed b dca master.supcomp is NULL by COB October 28 YYYY 1 divided by the number of valid cases selected f or BAM DCA weekly samples during PIIA YYYY BAM batches YYYY27 through YYYY 1 26 . Cases that do not meet the BAM DCA population def inition b dca master.program 8 or 9 or withdrawn claims b dca master.actf lag 8 are not counted in calculating state case completion rates. A percentage will be calculated f or each sample type y where b dca master.samptype 2 monetary 3 separation or 4 nonseparation . II-6 This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 . Footnote 5 The annual sample of sample type denials is x cases below the allocated annual sample of 150 BAM DCA cases per year. The precision of the data might be reduced due to the f ailure to sample at the prescribed level. Condition The state s annual sample selection is 8 or more cases below its allocated annual sample of 150 cases. Cases that do not meet the BAM population def inition b dca master.program 8 or 9 are not counted toward meeting the annual sample allocation. This f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 . Footnote 6 The sampling f rames f rom which the sample type denials samples were selected may not include all of the determinations that meet the definition f or inclusion in the DCA population or may include records that do not meet the DCA population def inition. This limits the degree to which inf erences about the population can be made f rom BAM DCA data. Condition The size of the DCA population f or PIIA 2024 varies by more than the statistical control limit f rom the benchmark population. The benchmark populations are Monetary Percent of determinations denied in ETA 218 report times number of new initial claims intrastate and interstate liable plus transitional claims in ETA 5159 report. Separation Percent of determinations denied in ETA 207 report times number of separations in ETA 9052 report. Nonseparation Percent of determinations denied in ETA 207 report times number of nonseparations in ETA 9052 report. This f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 .