CEO Library

The report from a Job Corps pilot focused on enrolling students in college to prepare for a career in healthcare or information technology (IT), conducted February 2017 through June 2019 with 488 students from the Pacific Northwest (ages 16-21) with at least a sixth-grade level of competency in reading and math) enrolled in Job Corps’ Cascades College and Career Academy (CCCA). This report describes the pilot vision and the pilot contract, summarizes the findings of the evaluation, and considers some discussion.

Technical appendix to the Evaluation of the Cascades Job Corps College and Career Academy (CCCA) Final Report: Appendix A: Theoretical Roots of the Cascades Job Corps Model, Appendix B: Cascades Pilot Evaluation Data Sources, Appendix C: Survey Methods for the 18-Month Follow-Up Survey, Appendix D: Additional Technical Information on Methodology, Appendix E: Definitions of Outcomes, Appendix F: Definitions of Baseline Measures, Appendix G.

The brief describes how Job Corps and community colleges serve young people, how Job Corps currently works with colleges, and how partnerships between Job Corps and colleges could benefit students, Job Corps, and the colleges. The brief also describes the evaluation’s methods and shares what the Job Corps centers identified as the core principles and practices undergirding their successful college partnerships. These core principles and practices include shared goals, clear roles and responsibilities, constant communication, and accommodating each organization’s different requirements.

In 2022, the Chief Evaluation Office (CEO) partnered with the Employee Benefits Security Administration (EBSA) to fund contractor Manhattan Strategy Group and subcontractor American Institutes of Research to conduct the EBSA Health Outcomes Metrics Study. The study aims to better understand the current landscape, best practices, and data sources related to approaches that federal and state agencies and the insurance industry use to estimate the impacts of their health-related enforcement actions and interventions.

The report presents American Apprenticeship Initiative (AAI) implementation study findings. The primary data source is interviews conducted during in-person site visits to 10 AAI grantees in spring 2019 and follow-up telephone calls with grant staff in fall 2020. The report documents the design and operation of grant activities and identifies potentially promising practices, implementation challenges, and lessons for future initiatives.

In 2022, the Chief Evaluation Office (CEO) funded contractor Urban Institute to conduct the project Advancing Behavioral Interventions in Labor Programs. Advancing Behavioral Interventions in Labor Programs aims to advance the application of behavioral sciences - or understanding how people realistically make and act on decisions - to improve the design of public policies and programs in ways that reflect a deeper understanding of human nature.

In 2022, the Chief Evaluation Office (CEO) partnered with Veterans' Employment and Training Service (VETS) and funded independent contractor Westat and its subcontractors Westat Insight, American Institutes for Research, and Manhattan Strategy Group to conduct an Evaluation of the VETS Employment Navigator and Partnership Program (ENPP). The outcomes study aims to understand and build evidence on the use of VETS employment navigators to improve outcomes for transitioning service members (TSMs) and military spouses.

In 2021, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund contractor Manhattan Strategy Group to conduct the Navigators in Social Service Delivery Settings: A Review of the Literature with Relevance to Workforce Development Programs under the Evaluation Technical Support portfolio of studies.

In 2020, the Chief Evaluation Office (CEO) funded contractors Mathematica and the University of Connecticut Health Center to conduct a study of factors associated with opioid use among U.S. workers.

The first report from this study, Factors Contributing to Variation in Nonmedical Use of Prescription Pain Relievers Among U.S. Workers: 2004-2014, analyzed secondary data to understand how nonmedical use of prescription pain relievers varied across states, industries and occupations, and other worker characteristics.

In 2022, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration (ETA) to fund Trewon Technologies, LLC to conduct the Strengthening Community Colleges (SCC) Training Grants Study. The implementation study and impact evaluability assessment aim to understand the implementation of SCC grantees—community college-based workforce development and career pathways programs in partnership with local employers—as they address disparities in workforce outcomes and build institutional capacity.

In 2022, the Chief Evaluation Office (CEO), in collaboration with the Office for Unemployment Insurance (OUI) in the Employment and Training Administration (ETA), funded independent contractor Abt Associates to conduct the Reemployment Services and Eligibility Assessments (RESEA) Evidence Building Portfolio Project. This portfolio project will provide evaluation technical assistance and conduct evidence-building activities to support and complement states’ evaluations.

In 2022, the Chief Evaluation Office (CEO) partnered with the Employment and Training Administration’s (ETA) Reentry Employment Opportunity (REO) Program to fund Mathematica, Inc. and its subcontractors—RTI International and Abt Associates—to conduct the Partners for Reentry Opportunities in Workforce Development (PROWD) Grants Evaluation. The PROWD grants effort is a first-of-its-kind partnership between DOL and the U.S.

In 2022, the Chief Evaluation Office (CEO) partnered with the Wage and Hour Division to fund contractor Westat to conduct the National Worker Survey project. This survey is intended to gather data to understand the prevalence and nature of violations of workers’ rights under the Fair Labor Standards Act (FLSA), with a focus on wages, pay, and hours worked, as well as other topics.

Graphic highlighting several Career Pathway program milestones and improvements from the 1980's through the 2020's.

The brief summarizes lessons learned from using machine learning to study the implementation of career pathways programs. First, this brief describes the research questions that guided the study and summarizes the machine learning methods designed for the data collection and analysis activities, including study limitations and challenges encountered. It then provides lessons learned on using machine learning methods for social science research.

The datasets compiled for the Career Trajectories and Occupational Transitions (CTOT) Study can be used to inform career pathways and other employment and training programs by (1) identifying launchpad occupations associated with higher than average wage growth, (2) identifying occupational and worker characteristics associated with wage growth, and (3) identifying specific occupational steps associated with wage growth.

The report of the Career Pathways Descriptive and Analytical Project focuses on “mid-level” occupations—occupations that typically require education or experience beyond a high school diploma or equivalent, but less than a four-year college degree. The report presents study findings on the magnitude of the differences between occupations in the career outcomes that entrants go on to experience within 10 years after entering, which occupations are associated with high wage growth, and what traits of occupations predict higher wage growth.

The brief summarizes findings of the Career Pathways Descriptive and Analytical Project’s meta-analysis study, which analyzes research on the impacts of 46 career pathways programs, based on evaluation findings published between 2008 and 2021. The brief first describes the programs and participants in the evaluations included in the meta-analysis. It then discusses the study’s overall impact findings and the findings about which program characteristics were associated with impacts, as well as the implications of each for policymakers, practitioners, and researchers.

The report summarizes 46 impact evaluations that focus on programs that embed elements of the career pathways approach. In the past decade, the career pathways approach to workforce development emerged as a promising strategy to promote long-term earnings advancement and self-sufficiency by helping workers attain in-demand postsecondary credentials (Fein, 2012). The approach involves a combination of rigorous and high-quality education, training, and other services to support participant success (WIOA, 2014).

The literature review aims to examine the roles and activities of navigator programs in workforce development and related fields as well as the outcomes and impacts of such programs. To address these goals, researchers identified and reviewed relevant literature published between 2010 and 2021. They also reviewed the bibliographic references of the identified articles for additional materials.

The report provides the results of an analysis of secondary data to understand how nonmedical use of prescription pain relievers varied across states, industries and occupations, and other worker characteristics.

The report provides the findings of the implementation of a quasi-experimental design to understand how changing labor market conditions associated with the pandemic affect opioid use.

In 2021, the Chief Evaluation Office (CEO) funded contractor Westat Insight and their partner American Institutes for Research to conduct the Explorations in Data Innovations project under the Administrative Data Research and Analysis portfolio of studies. This use case study was designed to explore options around employing machine learning to create and maintain a public-facing, labor-related data catalog.

The report relates to an effort by the U.S. Department of Labor’s (DOL) Chief Evaluation Office (CEO), in collaboration with the Occupational Safety and Health Administration (OSHA), to understand how and why employers adopt voluntary consensus standards for occupational health and safety (OHS) management. This report focuses on the institutions, organizations, and processes that have emerged to support the certification of occupational health and safety management systems (OHSMS), both in the U.S. and globally.

The report describes the National Health Emergency (NHE) Demonstration Grants to Address the Opioid Crisis: Implementation Evaluation findings and considers lessons learned and practices that appear potentially promising for future efforts to provide workforce services and system investments to support people directly and indirectly affected by the opioid crisis.