CEO Library

The brief is part of the the American Apprenticeship Initiative (AAI) evaluation, and is based on site visits and follow up clarification calls to 6 AAI grantees that constituted 7 State or local workforce development boards. The evaluation team talked primarily with staff in management and leadership positions, although some agencies invited direct-service staff, such as career counselors and business services staff, to join the conversation.

The report presents findings from the American Apprenticeship Initiative (AAI) demonstration study that examined the impact of employer engagement efforts on employers’ take-up of registered apprenticeship. The primary data source is data collected by the two grantees (MassHire and Philadelphia Works) in the demonstration on their efforts to research, contact, and subsequently develop apprenticeship programs with employers.

The report presents findings from the outcomes study of the American Apprenticeship Initiative (AAI) evaluation. It examines the characteristics, reasons for enrollment, program experiences, and postprogram outcomes of AAI apprentices and pre-apprentices. The data sources include an AAI Apprentice Survey administered to a sample of approximately 2,600 registered apprentices, program records from grantees, and administrative earnings data from the National Directory of New Hires.

The report presents results from the American Apprenticeship Initiative (AAI) grant employer return-on-investment (ROI) sub-study. The primary data source is an Employer Survey administered to 68 employers that hired apprentices supported by an AAI grant. Each employer was asked to describe one of their apprenticeship programs in detail; all together, these programs represented 2,854 apprentices. The survey was deployed between March 2020 and October 2020, towards the end of the 5-year AAI grant period.

The report presents findings on American Apprenticeship Initiative (AAI) grantee program operations from fall 2017 (approximately two years into the grant when data were first available) through summer 2021, when most grantees had concluded their grant activities and others were close to finishing. The report documents the degree to which grantees collectively met their apprenticeship program registration targets, their apprentice registration targets, and their pre-apprentice program implementation and enrollment targets. It also describes variation on these among grantees.

In 2019, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration, Office of Unemployment Insurance (OUI) to conduct the Behavioral Interventions to Improve Work Search Among Unemployment Insurance Claimants project. The unemployment insurance (UI) program requires claimants to be actively looking for work while they receive benefits to encourage a rapid return to work.

The report of impact evaluations aimed to assess the effectiveness of behaviorally-informed communications – such as a pop-up alert and emails – in increasing unemployment insurance (UI) claimants’ compliance with work search requirements.

The brief is based on lessons from an evaluation: a randomized controlled trial (RCT) of a small subset of the 53 TechHire and Strengthening Working Families Initiative (SWFI) programs—three TechHire programs and two SWFI programs—that explored the implementation and short-term impacts of TechHire and SWFI. In particular, this brief focuses on findings from the implementation analysis that was part of the RCT; data sources for the implementation analysis included observations of TechHire and SWFI programs, interviews with staff members, and a review of program participation data.

The brief describes the challenges associated with helping low-income parents with children under the age of 13 pursuing training and employment to access affordable child care. It also proposes solutions that programs may undertake to increase their effectiveness in assisting parents with accessing and paying for appropriate child care. Further, it identifies barriers that remain to be addressed at the systems level.

The report presents American Apprenticeship Initiative (AAI) implementation study findings. The primary data source is interviews conducted during in-person site visits to 10 AAI grantees in spring 2019 and follow-up telephone calls with grant staff in fall 2020. The report documents the design and operation of grant activities and identifies potentially promising practices, implementation challenges, and lessons for future initiatives.

The report focuses on the implementation and short-term impacts of TechHire and Strengthening Working Families Initiative (SWFI) — capturing between 7 and 14 months of follow-up—in the five programs that participated in a randomized control trial. The implementation analysis explored broad research questions about how the programs were implemented and what factors facilitated or inhibited implementation.

The brief draws on data collected from virtual site visits with 18 of the 23 America’s Promise Job Driven Training (America’s Promise) grant programs as part of a comprehensive implementation study to explore the development of and services provided by regional grant partnerships involving workforce development agencies, institutions of higher education, economic development agencies, employers, and community based organizations.

The report is the first of three to present findings from the American Apprenticeship Initiative (AAI) Evaluation implementation study. This initial report primarily uses data from an online survey completed by all grantees, which documented the planning and implementation of grant-supported programs, including characteristics of grantees and their partners, strategies to engage employers, registering apprenticeship programs, identifying and recruiting apprentices, and the major components of apprenticeship programs, including related technical instruction and on-the-job learning.

The report presents findings from the National Agricultural Workers Survey (NAWS), collected from face-to-face interviews with 2,586 crop workers interviewed between October 1, 2016, and September 30, 2018. It is organized into nine chapters, each beginning with a summary of the chapter’s key findings.

In 2017, the Chief Evaluation Office partnered with the Employment and Training Administration (ETA) to fund contractors Urban Institute, George Washington University, Capital Research Corporation, and the National Association of State Workforce Agencies to conduct an analysis of employer performance measurement approaches required by the Workforce Innovation and Opportunity Act (WIOA).

The summary details the research activities and highlights key findings from all components of the five-year Performance Partnership Pilots for Disconnected Youth (P3) evaluation. First, researchers describe the implementation study, and provide an overview of the study’s findings. Then, they describe the evaluation technical assistance activities provided to grantees and their local evaluators and present findings from the synthesis of Cohort 1 pilots’ local evaluation reports. Lastly, they offer brief considerations of how the lessons learned from P3 can inform future efforts.

In the brief, the Partnership Pilots for Disconnected Youth (P3) study team has placed pilots’ efforts to sustain systems change along a continuum. At one end of this continuum, two pilots approached P3 as a platform to facilitate systems change in their communities. Next along the continuum is a pilot that had taken initial steps toward systems change by the end of its P3 grant. Next, two pilots reported that through P3 they had strengthened partnerships and broken down silos but that the systems for serving disconnected youth did not experience much change as a result of P3.

The Consolidated Appropriation Act of 2014 authorized the Performance Partnership Pilots for Disconnected Youth (P3), which provided awarded pilots the flexibility to use funding from across multiple Federal discretionary programs to support efforts to improve the systems serving youth and youth’s outcomes. The report assesses the 14 awarded pilots’ implementation of the Federal vision for P3. Findings showed that pilots took a variety of approaches to try to improve youth outcomes, which commonly included new or enhanced services.

In 2015, the Chief Evaluation Office partnered with the Employment and Training Administration (ETA) to fund contractors Mathematica, Social Policy Research Associates, and MDRC to design and conduct an evaluation to better understand the implementation and outcomes of the National Guard Youth Challenge (YC) and Job Challenge (JC) program. The implementation study and outcome evaluation of three Job Challenge grants includes an analysis of post-JC outcomes between 2016 and 2018 for justice-involved graduates.

Many youth in America are not on track for labor market success. One factor that increases the risk of poor labor market outcomes among these youth is dropping out of school (Rumberger 2020). Youth who drop out of school are at greater risk for job instability and for lower long-term earnings (Hair et al. 2009). They are also more likely to struggle with mental health and substance abuse issues (Maynard et al. 2015). These challenges are compounded for youth who have early involvement with the juvenile or criminal justice systems.

In 2017, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund contractors Urban Institute, George Washington University, Capital Research Corporation, and the National Association of State Workforce Agencies to conduct an analysis of employer performance measurement approaches required by Workforce Innovation and Opportunity Act (WIOA).

In 2014, the Chief Evaluation Office partnered with the Employment and Training Administration (ETA) to manage an impact evaluation and complementary analysis of Youth CareerConnect and to develop a participant tracking system for the program. These evaluation activities were carried out by contractors Mathematica, and Social Policy Research Associates. The final impact report follows implementation study reports published in 2017 and 2019.

In 2021, the Chief Evaluation Office (CEO) partnered with the Employment Training Administration (ETA) and funded the Urban Institute and its partner Capital Research Corporation to conduct the Older Workers Study.

In 2016, the Chief Evaluation Office partnered with the Employment and Training Administration (ETA) to fund contractors Mathematica and Social Policy Research Associates to conduct the Workforce Innovation and Opportunity Act (WIOA) Implementation Study.

The report provides details on the data, samples, methods, and analyses for the Youth CareerConnect (YCC) impact study. Rigorously evaluating the effects of the YCC program on student outcomes required that multiple technical pieces be put in place, from selecting districts to participate in the evaluation to collecting and processing high-quality data and measuring impacts to conducting rigorous analysis to estimate impacts. This report provides details of these processes.