Attachment II (Accessible PDF).pdf

ETA Advisory File Text

ATTACHMENT II Benef it Accuracy Measurement BAM Denied Claims Accuracy Error Rates Report and Improper Denials Rates Report Report Def initions and Report Footnotes II-1 BENEFIT ACCURACY MEASUREMENT BAM DENIED CLAIMS ACCURACY DCA ERROR RATES REPORT State ZZ Report Date 11 20 2024 Batch Range 202327 202426 Denial Type Population Cases Completed Monetary 97 029 143 Separation 77 374 140 Nonseparation 24 229 134 Denial Type Total Errors Improper Denial Adjusted Improper Denial Overpayment Proper Denial Monetary 16.52 14.85 8.05 0.00 1.67 Separation 28.59 16.12 15.87 0.00 12.47 Nonseparation 40.74 14.02 14.02 0.00 26.71 Excludes cases not meeting DCA definition f or inclusion in population withdrawn cla ims a nd cla im s f or which m onetary eligibility wa s esta blished upon receipt of combined wa ge claim CWC unem ploym ent com pensation f or f ederal em ployees UCFE a nd or unemployment compensation f or ex-servicemem bers UCX wa ge credits. Adjusted ra te excludes erroneous denia ls tha t were corrected by a gency or reversed on a ppea l prior to DCA ca se com pletion. Properly denied but f or wrong rea son or section of the la w. The sta te completed 76.35 percent of the Monetary denials sample cases within 90 days. The program standa rd is 85 percent com pleted within 90 da ys. The sta te completed 78.43 percent of the Separation denia ls sample ca ses within 90 days. The program standard is 85 percent com pleted within 90 da ys. The sta te completed 79.87 percent of the Nonsepa ra tion denia ls sa m ple ca ses within 90 da ys. The progra m sta nda rd is 85 percent com pleted within 90 da ys. Estim a ted ra tes apply to less than the total population of Monetary denials due to the state not pulling a sa m ple f or 1 week s . Estim a ted ra tes apply to less than the total population of Separation denials due to the state not pulling a sa mple f or 1 week s . Estim a ted ra tes apply to less than the total population of Nonsepa ra tion denia ls due to the sta te not pulling a sa m ple f or 1 week s . II-2 BENEFIT ACCURACY MEASUREMENT DENIED CLAIMS ACCURACY IMPROPER DENIALS RATES REPORT State ZZ Report Date 11 20 2024 Batch Range 202327 202426 Denial Type Population Cases Completed Monetary 97 029 143 Separation 77 374 140 Nonseparation 24 229 134 Denial Type Improper Denial 95 C.I - Adjusted Improper Denial 95 C.I - Monetary 14.85 5.77 8.05 4.51 Separation 16.12 6.45 15.87 6.43 Nonseparation 14.02 6.13 14.02 6.13 Excludes cases not meeting DCA definition f or inclusion in population withdrawn cla im s a nd cla im s f or which m onetary eligibility wa s established upon receipt of CWC UCFE a nd or UCX wa ge credits. Adjusted ra te excludes erroneous denials that were corrected by a gency or reversed on a ppea l prior to DCA ca se com pletion. Note 95 C.I . is the 95 percent confidence interval f or the estimated ra te. The interva l is the ra nge between the ra te m inus the va lue in the 95 C.I . colum n a nd the ra te plus the va lue in the 95 C.I . colum n. For exa mple the interval f or 10.0 - 2.5 is 7.5 to 12.5 . The true ra te is expected to lie within 95 percent of the intervals constructed f rom repeated samples of the same size a nd selected in the sa me m a nner a s the BAM DCA sa m ple. The sta te completed 76.35 percent of the Monetary denials sample cases within 90 days. The program standa rd is 85 percent com pleted within 90 da ys. The sta te completed 78.43 percent of the Separation denia ls sample ca ses within 90 days. The program standard is 85 percent com pleted within 90 da ys. The sta te completed 79.87 percent of the Nonsepa ra tion denia ls sa m ple ca ses within 90 da ys. The progra m sta nda rd is 85 percent com pleted within 90 da ys. Estim a ted ra tes apply to less than the total population of Monetary denials due to the state not pulling a sa m ple f or 1 week s . Estim a ted ra tes apply to less than the total population of Separation denials due to the state not pulling a sa mple f or 1 week s . Estim a ted ra tes apply to less than the total population of Nonsepa ra tion denia ls due to the sta te not pulling a sa m ple f or 1 week s . II-3 BAM Denied Claims Accuracy Rates Report Definitions Population The number of denial determinations that constitute the sampling f rames f or all weeks in PIIA 2024 f or which the state pulled a BAM DCA sample adjusted to exclude agency actions that do not meet the def inition of the BAM DCA population f or example monetary redeterminations nonmonetary determinations that are not reportable on the ETA 207 and 9052 reports and denied emergency unemployment compensation EUC claims . These excluded cases are coded 8 EUC or 9 all other excluded records in the Program code data element in the b dca master table of the UI database. The sof tware also adjusts the DCA populations to exclude two types of cases f or which there is no denial issue to investigate 1 cases in which monetary eligibility was established upon receipt of Combined Wage Claims Alternative Base Period Claims Unemployment Compensation f or Federal Employees and or Unemployment Compensation for Ex-service members wage credits within the two-week sampling lag Action Code Flag 0 and 2 claims withdrawn by the claimant Action Code Flag 8 . Sample Size Total DCA cases selected during PIIA 2024 BAM batches 202327 through 202426 and completed supervisor sign-off by COB October 28 2024 excluding cases that do not meet the BAM DCA population def inition. This is the number of BAM DCA sample cases f rom which the accuracy rates are estimated. Improper Denial Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant should have been eligible f or UI benef its or was underpaid UI benef its Error Issue Action Code 20 21 22 or 23 expressed as a percentage. Adjusted Improper Denial Rate Improper Denial Rate excluding cases in which erroneous denials were corrected by the agency Prior Agency Action 20 to 29 or eligibility was established through appeal Results of Appeal of Initial Determination 1 or 3 prior to DCA case completion. Overpayment Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant should have been ineligible f or UI or should have received a lower benefit amount f or weeks that had been paid Error Issue Action Code 10 11 12 13 14 15 or 16 expressed as a percentage. II-4 Proper Denial Rate The weighted proportion of denied claims f or which the DCA investigation concluded that the claimant was properly denied but f or the wrong or dif f erent reason section of the law Error Issue Action Code 30 expressed as a percentage. Weighting Procedures Accuracy rates are computed separately f or each batch with at least two completed DCA cases and weighted by the batch population adjusted to exclude cases that do not meet the BAM DCA def inition Program code 8 or 9 or cases with Action Codes 0 monetary eligibility established upon receipt of CWC UCFE and or UCX wage credits or 8 withdrawn claims . The accuracy rate equals the sum of the products of the batch rates and weights. Batches with only one completed case are merged to ensure that each batch has a minimum of two completed cases. 95 Percent Conf idence Interval A conf idence interval expressed as - x percentage points is constructed f or each of the estimated accuracy rates. The actual rate is expected to lie within 95 percent of the intervals constructed f rom repeated samples of the same size and selected in the same manner as the BAM sample. II-5 BAM Denied Claims Accuracy Footnotes Footnote 1 Estimated rates apply to less than the total population of sample type denials due to the state not pulling a sample f or x weeks. Condition There is no record in the b dca comparison table of the UI database f or one or more batches specif ied in the batch range f or sample type y where b dca comparison samptype 2 monetary 3 separation or 4 nonseparation . Footnote 2 Estimated rates f or sample type denials are based on data collection procedures that were not completely in accordance with the program methodology prescribed in ET Handbook No. 395 5th edition. Condition Based on program monitoring conducted by ETA s national and regional of fices this f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . Footnote 3 The state completed x percent of the sample type denials sample cases within 90 days. The program standard is 85 percent completed within 90 days. Condition The percentage for sample type y where b dca master.samptype 2 monetary 3 separation or 4 nonseparation will be calculated using the same method used in the BAM DCA Case Completion and Time Lapse report. Cases not meeting the BAM DCA population def inition b dca master.program 8 or 9 or withdrawn claims b dca master.actf lag 8 are not counted in calculating state time lapse rates. Footnote 4 x percent of the sample type denials sample cases were not completed when this report was prepared. This exceeds the program requirement that no more than 2 percent of the cases f or the year are incomplete 120 days af ter the end of the PIIA reporting year. Condition The percentage is based on the number of BAM DCA cases that were not completed b dca master.supcomp is NULL by COB October 28 YYYY 1 divided by the number of valid cases selected f or BAM DCA weekly samples during PIIA YYYY BAM batches YYYY27 through YYYY 1 26 . Cases that do not meet the BAM DCA population def inition b dca master.program 8 or 9 or withdrawn claims b dca master.actf lag 8 are not counted in calculating state case completion rates. A percentage will be calculated f or each sample type y where b dca master.samptype 2 monetary 3 separation or 4 nonseparation . II-6 This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 . Footnote 5 The annual sample of sample type denials is x cases below the allocated annual sample of 150 BAM DCA cases per year. The precision of the data might be reduced due to the f ailure to sample at the prescribed level. Condition The state s annual sample selection is 8 or more cases below its allocated annual sample of 150 cases. Cases that do not meet the BAM population def inition b dca master.program 8 or 9 are not counted toward meeting the annual sample allocation. This f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 . Footnote 6 The sampling f rames f rom which the sample type denials samples were selected may not include all of the determinations that meet the definition f or inclusion in the DCA population or may include records that do not meet the DCA population def inition. This limits the degree to which inf erences about the population can be made f rom BAM DCA data. Condition The size of the DCA population f or PIIA 2024 varies by more than the statistical control limit f rom the benchmark population. The benchmark populations are Monetary Percent of determinations denied in ETA 218 report times number of new initial claims intrastate and interstate liable plus transitional claims in ETA 5159 report. Separation Percent of determinations denied in ETA 207 report times number of separations in ETA 9052 report. Nonseparation Percent of determinations denied in ETA 207 report times number of nonseparations in ETA 9052 report. This f ootnote will be generated f rom a f ootnote look-up table f or each sample type 2 monetary 3 separation or 4 nonseparation . This f ootnote will be generated only if the user specifies an annual report when the user specif ies the batch range YYYY27 through YYYY 1 26 .