Based on a recent systematic review of youth employment programs, David Robalino shares how he would design a program from scratch.
After three and half years of work, we have finally completed our systematic review of youth employment programs. Many thanks to the co-authors who did the heavy lifting (Jose Manuel Romero, Jonathan Stöterau, Felix Weidenkaff and Marc Witte). The paper was presented at our recent Jobs and Development Conference. The team went over 40,000 papers to eventually find 103 that reported on credible impact evaluations of youth employment programs.
These were more-or-less equally focused on high and middle/low income countries. These studies were codified in detail, including programs’ design features so that we could understand why some worked and others did not. Because different studies often look at more than one outcome variable (such as employment and earnings) and focus on more than one population group we ended up with a database with over 3,000 observations. We ran thousands of regressions trying to identify how different interventions and program design features affected the outcomes and the probability of success.
For those of you who are fans of youth employment program the results will be disappointing. Only 30 percent of programs in our database were successful; the majority had no positive effect or the effect was most likely the result of chance. Moreover, among the successful programs the effect size was often small. This is dramatic. Most of the programs operating out there have not even been evaluated. But most likely, only a few are achieving what they were set up to do.
The key for success is to be able to respond to the needs of an often very diverse population of beneficiaries. For that you need flexible programs that offer multiple services ranging from counselling and training to job search assistance and stipends. So, there is no one type of intervention that is systematically better than others. We can’t say, for instance, that training programs are better than employment services, or that entrepreneurship programs are better than wage subsidies. It all depends on the population group and the local context. The programs also need to have systems that allow managers and service providers to understand the constraints that individuals face to access jobs and the resources and incentives to address these constraints.
You can read the paper and draw your own policy conclusions. If I had to design a youth employment program from scratch this is what I would do:
But, even if successful, this type of program is likely to have only limited impacts on labor market outcomes. After all, the programs are simply trying to connect young workers to job opportunities that already exist. These programs won’t do much if there arent a lot of opportunities. Thus, these programs need to be connected to interventions that expand job opportunities, for instance, through investments to support SME growth or the development of value chains in specific regions.
A final point to emphasize is that most existing public employment services are not designed in this way. These programs are most likely not making a difference and the resources they use are being wasted. We are working, for instance, with the ANETI in Tunisia that manages a set of dysfunctional active labor market programs. Great, motivated staff but wrong design. I am not suggesting these programs should be shut down because they do have a role to play. But they should be reformed. Once done, they would need to be expanded to be able to reach more vulnerable workers, particularly those living in rural areas.
This post is part of a series of blogs covering key themes from the Jobs and Development Conference, hosted by the World Bank Jobs Group and the Network on Jobs and Development. Related blogs in this series can be found here, here and here.
This expert contribution was originally published at the website of the World Bank.
ADD YOUR COMMENT
L Fox and D Filmer
J Flynn, P Mader, M Oosterom and S Ripoll