Overview of ETA Performance Data Integrity

The Department uses a combination of data integrity mechanisms to ensure the quality of programmatic performance data so that data can be effectively relied upon for program monitoring and reporting. WIOA title I and III programs use a three-tier system including:

1. WIPS Edit Checks
2. Quarterly Report Analysis
3. Data Validation

See program-specific guidance to determine what mechanisms apply to individual programs.

1. WIPS (Workforce Integrated Performance System) Edit Checks

• WIPS enforces edit checks on all files submitted into the system. These checks are run in the following sequence, and grantees’ files must pass each step before proceeding to the next.
  • First, WIPS confirms that the file is in the correct format (aka correct number of columns).
  • Second, WIPS runs Valid Value Edit Checks to confirm that the values in each column are allowable values for that element.
  • Third, WIPS runs checks for duplicate records.
  • Finally, WIPS runs Logical Validation checks, which compares related fields within each record to enforce a logical relationship between the reported values.
• The WIPS Resource Page contains several helpful resources, including documentation for all the various edit checks.
• ETA has created a series of video guides to submitting reports in WIPS, including a video on checking and correcting edit check errors. 

2. Quarterly Report Analysis (QRA)

• ETA developed the Quarterly Report Analysis (QRA) technical assistance tool to support grantees’ data integrity efforts by identifying areas in their reported data that may require additional attention or correction.  ETA first piloted the QRA to states in July 2020 with the goal of supporting continuous improvement and accuracy in WIOA reporting. The QRA is currently piloted for WIOA Adult, WIOA Dislocated Worker, WIOA Youth, and Wagner-Peyser programs. The QRA displays states' performance relative to all states quarterly and includes visual indicators to highlight when the state's results fail to meet, meet, or exceed ETA's expectations.
• QRA resources:
  • QRA Overview webinar – Overview from the initial rollout of the QRA Tool
  • QRA WIPS User Guide  -- Guide to reviewing and responding to QRA results in the WIPS system.
  • QRA Metrics specifications – Specifications and details for the current metrics being used in the QRA process.
  • QRA Descriptions – provides the current measures for each program including explanations of measure expectations and information on elements used to calculate each measure.
  • QRA Descriptions (Excel)
  • Data Integrity Technical Assistance Tool: Quarterly Report Analysis for WIOA Titles I and III – this WorkforceGPS webinar provides information for states on the QRA process.

3. Data Validation Requirements

• ETA also requires grantees to implement certain data validation processes and procedures.
  • Joint DV Guidance (TEGL 7-18, Change 1) – Data Validation guidance and requirements issued jointly by the Department of Education and Department of Labor, which applies to the six WIOA Core Programs
  • DOL only DV Guidance (TEGL 23-19, Change 3) – Data Validation guidance and requirements issued by the Department of Labor, which applies to all of the employment and training programs operated by the Department of Labor that report into the WIPS system.
• DOL will not be providing specific statistical validation sampling methodology, or specific data validation software. However, grant recipients are encouraged to incorporate a comprehensive random sampling methodology and procedure for the source documentation review of participant files into their data validation processes.
  • WIOA Joint Data Validation Overview – this WorkforceGPS webinar provides an overview of the WIOA joint data validation requirements in TEGL 7-18, Change 1
  • Overview: Validating Required Performance Data Submitted by DOL Grantees – this WorkforceGPS webinar provides an overview of the DOL-only data validation requirements in TEGL 23-19, Change 3.

Interested in becoming a pilot state?

Reach out to your regional contact to discuss joining the pilot.