About the Study
To help state, local, and tribal entities provide services to disconnected youth more efficiently across multiple federal funding streams, Congress authorized the Performance Partnership Pilots for Disconnected Youth (P3) under the Consolidated Appropriations Act of 2014. The Act allowed grantee organizations and their partners to request to pool funds from different federal discretionary funding streams and receive waivers from these programs’ eligibility, reporting, and other requirements. In 2015, the federal agencies participating in P3 awarded the first cohort of nine pilots. Subsequently, six more pilots were established in two additional cohorts.
- Local Evaluations of the Cohort 1 P3 Pilots: A Synthesis of Their Findings (Final Report, August 2020)
- Insights from Federal Evaluation Technical Assistance Liaisons on the Partnerships Supporting Local Evaluations (Issue Brief, August 2020)
- Performance Partnership Pilots for Disconnected Youth (P3): Four Years After Initial Authorization (Interim Implementation Report, August 2020)
- Early Experiences of the Performance Partnership Pilots for Disconnected Youth (P3): Cohort 1 Pilots (Final Report, August 2020)
- How do the pilots use the flexibility offered by P3 to implement P3 models and interventions to improve the outcomes of disconnected youth?
- How has each pilot structured its P3 system and work across the community’s network of partners to provide effective services to disconnected youth?
- Who are the youth who participate in P3 and what services do they receive?
- What systems and programmatic changes and efficiencies resulted from P3?
- Evaluation-related Technical Assistance (EvalTA): EvalTA assists the grantees and their independent evaluators in designing and conducting their local evaluations.
- Systems and Process Analysis: Through site visits, interviews, and partner surveys, the National Evaluators document and assess implementation of, and changes engendered by, P3 at the national, program, and service delivery levels.
- Collection of Participant Data: Data on P3 participants will inform cross-grantee reports on describing the pilots.
- Synthesis of Local Evaluation Reports: The National Evaluators will synthesize the final local evaluation reports and data.
Local Evaluations of the Cohort 1 P3 Pilots: A Synthesis of Their Findings found that eight of the nine Cohort 1 pilots had local evaluations supporting causal evidence of how one or more aspects of the pilots’ interventions affected education, employment, and other outcomes. The evaluations found that of the six types of interventions implemented, three demonstrated evidence of improving expected youth outcomes—case management services, combined case management and WIOA services, and the Two-Generation education and training program. However, two of the three local evaluations examining case management (only) also found evidence of negative outcomes (reduced family member referrals to adult education and participation in career preparation and subsidized employment).
Insights from Federal Evaluation Technical Assistance Liaisons on the Partnerships Supporting Local Evaluations provides reflections from the evaluation technical assistance (TA) team that assisted Cohort 1 pilots and their third-party evaluators in effectively designing and implementing local evaluations of the pilot interventions. The authors of the brief suggest that technical assistance staff and grantee/pilots staff could form strong partnerships by clearly establishing roles and responsibilities, sharing key information and goals, and establishing orientation policies for new staff, among other tactics.
Performance Partnership Pilots for Disconnected Youth (P3): Four Years After Initial Authorization is part of a series of implementation study papers of the P3 National Evaluation. This report is based on data collected from interviews between 2016 and 2018 with Federal staff, Cohort 1 pilot staff, and youth participants. Key findings include:
- Cohort 1 pilots reported that there were benefits to the approved waivers, specifically in reducing administrative burden and expanding the youth eligibility for the services.
- Federal respondents reported that P3 created a tension between the desire for more extensive waivers and the need for accountability.
- Cohort 1 pilots reported that the P3 process encouraged new connections and referrals across the education and workforce domains and that the waivers increased eligibility for services, decreased reporting requirements, and allowed tailoring of state and federal services.
- Federal respondents reported that P3 interagency systems were unlikely to continue beyond the life of the P3 initiative. They found that P3 required high agency effort and multi-agency approval processes resulted in slow decision-making.
- Youth interviewees reported positive experiences with service strategies that included case management, mentorship, and work experiences.
Project Duration: 66 Months
Contract End Date: February 2021
Contractor: Mathematica Policy Research and Social Policy Research Associates
For More Information: ChiefEvaluationOffice@dol.gov
The Department of Labor's (DOL) Chief Evaluation Office (CEO) sponsors independent evaluations and research, primarily conducted by external, third-party contractors in accordance with the Department of Labor Evaluation Policy. CEO’s research development process includes extensive technical review at the design, data collection and analysis stage, including: external contractor review and OMB review and approval of data collection methods and instruments per the Paperwork Reduction Act (PRA), review by academic peers (e.g., Technical Working Groups), and inputs from relevant DOL agency and program officials and CEO technical staff. Final reports undergo an additional independent expert technical review and a review for Section 508 compliance prior to publication. The resulting reports represent findings from this independent research and do not represent DOL positions or policies.