Rethinking the skills gap

Better understanding of skills mismatch is essential to finding effective policy options

University of Warwick, UK

University of Warwick, UK, and IZA, Germany

one-pager full article

Elevator pitch

Evidence suggests that productivity would be much higher and unemployment much lower if the supply of and demand for skills were better matched. As a result, skills mismatch between workers (supply) and jobs (demand) commands the ongoing attention of policymakers in many countries. Policies intended to address the persistence of skills mismatch focus on the supply side of the issue by emphasizing worker education and training. However, the role of the demand side, that is, employers’ wage-setting practices, garners comparatively little policy attention.

Decomposition of the potential sources of
                        skills mismatch

Key findings

Pros

Analysis shows that 4% of workers are under-skilled, and 10% are over-skilled for their jobs.

Mismatch is an important determinant of productivity and wages.

The harmful effect on wages of being mismatched early in one’s career is large and persistent.

Joblessness in an economic downturn would affect one-third fewer people if the mismatch problem were resolved.

Cons

Though reliable estimates show that skills mismatch lowers individual workers’ productivity, effects on aggregate productivity remain largely speculative.

Estimates of the effect of skills mismatch on unemployment suffer from serious measurement issues.

Recent literature indicates that focusing on education and training to boost worker skills may be misguided; rather, firms’ actions (e.g. adjusting wages to reflect relative skill shortages) may be a key determinant of skill mismatch.

US evidence shows that geographic mismatch has a negligible effect on productivity and unemployment.

Author's main message

Skills mismatch has large effects on productivity and unemployment, and is therefore an important concern for economic policymakers. Almost all proposed policy interventions suggest reforms of education and training as solutions to perceived shortages of skills, while little attention is paid to wage setting. This is problematic because such reforms, which are often expensive, will be ineffective if wages do not reflect relative skill shortages. If mismatch instead reflects an unresponsiveness of wages, then workers will “sell” their skills where they fetch the best price, rather than where they are most needed.

Motivation

The idea that the labor market suffers from severe imbalances in terms of skills offered by workers and those required by employers is a pervasive one. Skills mismatch is viewed as a structural issue—that is, an issue that is present whether the economy is in good shape or in crisis. However, its salience re-emerges during recessions. During the recent Great Recession, for example, questions arose about whether increased mismatch was the reason that unemployment remained high long after the initial, precipitating events. In government circles, the issue is perceived as independent of business cycles. It is not uncommon for some sectors to complain about the trouble they experience finding workers, while unemployment rates remain stubbornly high.

As shown in the Illustration, three possible reasons could explain why a skills gap persists: (i) workers do not adjust to changes in skills demand by acquiring the new skills needed to find a job; (ii) firms do not adjust to changes in skills supply by creating jobs that utilize the skills available in the labor market; or, (iii) wages do not reflect skills shortages by creating incentives for workers to acquire scarce skills, or to abandon other occupations.

An important component of the EU’s strategic framework for education policy, for example, aims “to better identify and manage the availability of required skills, competences, and qualifications, and to help prevent skills gaps and mismatches.”European countries and other advanced economies worry about the “growing gulf between the skills workers possess today and the skills businesses say they need,” as stressed in the 2014 report of the Economist Intelligence Unit. Concerns often focus on shortages of workers with skills in science, technology, engineering, and mathematics (STEM) subjects, but, increasingly, concerns also extend to “soft skills,” such as communication, team work, and problem solving.

At the same time, many academic economists remain unconvinced of the existence of a skills gap. Accustomed to the idea of the “invisible hand” equating supply and demand, they are naturally skeptical about the idea that large segments of the labor market would persistently be in disequilibrium; that is, they find it hard to believe that employers would not be able to convince workers who have, or could acquire, needed skills to work for them, perhaps in return for a higher wage than they might earn elsewhere.

Discussion of pros and cons

Researchers have begun to examine issues related to skills mismatch in greater detail and in new ways. The availability of large datasets containing information about workers and firms has made it possible to gauge the effect of skills mismatch on workers’ productivity and aggregate unemployment. The literature has also started to explore the causes of mismatch, suggesting policies that may or may not be effective in addressing the issue.

Workers and jobs: Skills mismatch and productivity

The most immediate problem associated with mismatch concerns its effect on productivity. The literature studying this effect looks at existing matches of workers and jobs and tries to determine the extent to which workers have adequate skills to perform their jobs. This issue has two sides. Over- or under-qualification (also called vertical mismatch) occurs when workers have the right type of skills, but are too skilledor not skilled enough. Think of, in the over-skilled category, a linguist teaching a Spanish class, or, in the under-skilled category, a mechanic working as an engineer. Horizontal mismatch (also called field-of-study mismatch) occurs when workers do not have the type of skills required by the job, but they have other skills at a similar level—such as a biology teacher taking over physics classes in a school that fails to recruit a physics teacher.

The early literature on mismatch used self-reported data generated from workers’ responses to questions about whether they felt under- or over-qualified for their job. A limitation of this approach is that self-reported questions capture workers’ under- or over-confidence at the same time as potential mismatch. Beginning in 2011, the OECD’s Programme for the International Assessment of Adult Competencies (PIAAC) began its Survey of Adult Skills, an assessment designed to provide representative data on workers’ skills. The survey delivered an innovation by producing data involving skill proficiencies that are assessed, rather than self-declared. Thus far, the data include skill measurements of 250,000 individuals in 33 countries.

The official OECD measure was introduced by a group of researchers in 2013 [2]. The approach combines declarative measures of job qualification with objective measures of skill proficiency. For each occupation and country included in the PIAAC data, the authors determine a range of skill proficiencies based on the minimum and maximum proficiencies of workers who have defined themselves as being well-matched to their positions. A worker is defined as over-skilled if their skill proficiency is higher than this maximum, under-skilled when their skill proficiency is lower than theminimum. The authors find that 86% of workers are well-matched, 4% are under-skilled, and 10% are over-skilled. Another study using PIAAC data shows that there is a negative correlation between this measure of mismatch and labor productivity at the industry level: industries where there are more under-qualified or over-skilled workers exhibit lower levels of labor productivity [3].

Two studies offer evidence beyond developed countries. The first provides a review of worldwide mismatch research [4]. It finds that over-education affects 30% of workers, and under-education affects 26% of workers, with some variation surfacing across continents. The second study applies the OECD method to measure mismatch in developing countries, using the World Bank’s STEP Household Skills Survey. The authors find that over-education is the most prevalent form of mismatch.

A framework developed in 2015 analyzes worker–occupation matches [5]. If a worker does not possess the abilities that are necessary to learn the skills required by an occupation, then theyare “mismatched.” Estimating a structural model on US data, the study finds that being mismatched early in one’s career harms a worker’s wages in a large and persistent manner.

Quantifying the effect of the overall level of labor market mismatch is much more difficult than measuring the effect of being mismatched on the productivity of individual workers. For example, given the skills workers have and the skills jobs require at some point in time, how much would production increase if it were possible to reallocate mismatched workers to different jobs where their skills are better matched to the requirements, so that production could be maximized? Answering this question convincingly is difficult because it requires assumptions about the functions that link production inputs to outputs. Considering both labor and physical capital, very large effects are shown from misallocation across firms [6]. The analysis claims that mismatch is responsible for a productivity gap of 40–60% between India and the US, and 30–50% between China and the US. These results show that the mismatch of production inputs (labor and capital) is a substantial source of inefficiencies and a large contributor to the differences between developing and developed countries.

Job seekers and vacancies: Skills mismatch and unemployment

If the skills that firms require and the skills that workers possess are sufficiently far apart, then at least some workers will not be hired. Therefore, skills mismatch generates not only a productivity loss, but unemployment as well. Unemployment carries with it huge economic and personal costs. Hence, understanding the effect of skills mismatch on unemployment is important for crafting effective policy.

Labor market mismatch generates unemployment if the unemployed workers looking for jobs and firms with vacant positions looking for workers cannot form a match because the worker and vacancies are “not right” for each other. This idea can be formalized by modeling the labor market as being divided into segments, with workers (and vacancies) unable to move from one labor market segment to another. If there are deviations between the distributions of workers and jobs among the various segments of the labor market, then some workers will remain unemployed, while, at the same time, some firms will not be able to fill all positions.

If unemployment is caused by mismatch, then there is a tight link between the dispersion in labor market conditions across labor market segments and the aggregate unemployment rate. The idea is that, if there are jobs in occupations with certain skill sets while unemployed workers are available with different skill sets, then one should see large differences in the ratio of vacancies over unemployment across occupations with different skill requirements. This prediction allows empirical researchers to quantify the aggregate effect of mismatch on unemployment. The challenge is to measure how much lower the unemployment rate would be if—hypothetically, of course—it was possible to reallocate unemployed workers to those occupations where they are most likely to find jobs.

Despite severe measurement issues, there is remarkable consensus in the literature on some basic facts about unemployment due to labor market mismatch. This consensus can be summarized around three main findings: first, that geographic mismatch is negligibly small; second, that skills mismatch, as measured by mismatch across occupations or industries, is an important contributor to unemployment; and third, that skills mismatch is larger during recessions. These three findings are discussed in the following sections.

The importance of geographic mismatch

A study from 2014 finds that mismatch across US counties and metropolitan statistical areas contributed less than half a percentage point to unemployment—and that this contribution did not rise notably in the Great Recession [7]. The authors thus conclude that “geographic mismatch plays no apparent role [in the unemployment rate].” This finding is confirmed in a subsequent analysis, which accounts for the fact that workers are not stuck in their counties or states: they look for jobs not only where they live but also in surrounding areas [8]. This is also consistent with evidence showing that geographic (inter-state) mobility did not decrease during the Great Recession. Therefore, mismatch is unlikely to have contributed much to the very large increase in unemployment during this recession.

A recent study investigates this phenomenon in greater detail by measuring the impact of local fiscal policy and transport improvements on neighboring areas to assesses “how local” a given labor market is [9]. Specifically, the authors investigate how far a local stimulus propagates thanks to worker mobility. They estimate the extent to which job seekers tend to apply for jobs that are further away by combining data on flows into and out of unemployment in England and Wales at the census ward level, and a structural model of job searching and matching. Overall, they find little mobility and modest ripple effects of local policies.

Another recent study applies a similar approach to measure mismatch in the US [8]. Instead of specifying the level of analysisad hoc (states might be too coarse and zip codes too fine), the researchers allow job seekers to apply everywhere, with different probabilities. They use data from the website CareerBuilder.com to observe the locations (at the zip code level) of job seekers, vacancies, and applications. They estimate a measure of “distaste for distance,” which captures the reluctance of job seekers to apply for vacancies that are far away. They inject this parameter into a model (as in [9]), in which job seekers decide to apply somewhere based on two criteria: (i) the distance to the vacancy, and (ii) how many job seekers compete for a given vacancy. The authors find that ten more miles decreases the probability of applying for a job by around 35%. This information is then used to predict how many matches will result from a given allocation of job seekers across zip codes, and the authors draw conclusions about the gulf between a “perfect” situation—one that would maximize the number of hires—and the situation that occurs when taking into account these geographical and competitive realities. Accordingly, the share of unemployment that is due to geographic mismatch is only around 5%. In other words, reassigning workers over space to maximize hiring would only increase the number of hires by 5%.

Skills mismatch and unemployment

Using Standard Occupational Classification (SOC) codes to categorize the nature of certain kinds of work, a 2014 study finds that increased mismatch across three-digit occupations accounted for around 1.5 percentage points (or about one-third) of the increase in unemployment in the US during the Great Recession [7]. Related research shows similar results for the US and the UK.

The countercyclicality of skills mismatch

It has been shown that US unemployment due to mismatch across industries from 1979 to 2010 evolved over time in a very similar fashion to the overall unemployment rate [1]. A very similar pattern was revealed using the 2001–2012 sample [7]. These results were surprising to many, because early commentators attributed the rise in mismatch unemployment to a structural change in the labor market [10].

The causes of skills mismatch and how to address them

Unexpected events or phenomena may affect occupations in different ways. For instance, a 2003 study illustrates that the emergence of computers and information technologies (IT) reduced the demand for routine jobs, which were to some degree made obsolete by computers, and increased the demand for non-routine jobs, which proved to be relatively complementary to the computer [11]. For example, bank tellers and bank managers have likely been affected in opposite ways by the IT revolution in general, and by automated teller machines (ATMs) in particular. Like technological changes, recessions also change the relative demand of different goods. Sectoral shocks may translate into asymmetric occupational shocks; for example, bakers may be less sensitive to recessions due to the relative inelasticity of baked goods, while the jobs of restaurant waiters may be more sensitive because people eat out less during hard times. Because of these shocks, the fact that mismatch exists is not in itself surprising. The relevant question is: why does it seem to be so persistent?

Workers who work (or look for a job) in an occupation where the number of workers exceeds the number of positions have ways to adjust. They can apply to other higher-demand occupations that require similar skills, or they can acquire new skills through training. Alternatively, employers could adjust to workforce shortages by changing the skill content of occupations, or by training up workers from similar occupations to fit new skill requirements. Some recent empirical literature documents that employers adjust the task and skill content of jobs (for the same occupation) with the business cycle, “upskilling” when workers are more abundant in a recession [12].

Adjustment, whether by workers or employers, may be difficult and costly to achieve in the short term, especially when confronting large skill differences between origin and target occupations. Most policy interventions are based on the implicit assumption that this is the reason for the skills gap. The European Commission, for instance, believes that “Europe needs a radical rethink on how education and training systems can deliver the skills needed by the labor market.”As a result, it set up the Rethinking Education initiative “to reform education systems across the EU so as to meet growing demand for higher skills levels and reduce unemployment.”

A recent analysis uses data on wages and profits across industries in addition to data on job-finding rates to show that it is possible to quantify how much of mismatched unemployment stems from a lack of adjustment by workers or from a lack of adjustment by firms. On the workers’ side, the following scenario is identified: There are industries where workers have a hard time finding jobs, but where they earn high wages if they do; and there are other industries where jobs are plentiful, but wages are low. This is what one would expect to see if workers operate along a “no arbitrage” condition. That is, if they can move between industries, but will only do so if they are given the right incentives. If, on the other hand, there are many industries where both job-finding rates and wages are high, and others where both are low, the logical conclusion would be that mismatch persists because workers lack the skills required to move into better jobs. Using data for the US over the 1979–2010 period, the study finds that mismatch cannot be fully explained by barriers faced by workers and firms in adjusting to changing skills demand and supply, respectively.

This then raises the question: If workers adjust to changes in skills demand, and employers adjust to changes in supply, how can mismatch persist? The answer lies in the way wages are set. If wages reflect the relative abundance or the relative shortage of skilled workers, then workers’ and employers’ capacities to adjust would lead to the elimination of mismatch. However, jobs in industries that generate high profits (such as the retail trade, educational services, mining, and forestry) tend to pay low wages, and are therefore unattractive to workers, while jobs in industries that pay higher wages (like finance, computer and electronics manufacturing, and paper and printing) are not profitable to firms.

Other researchers, based on very different approaches, have also emphasized the role of wage setting. Among the forces suggested to be at work are: automated screening systems that rule out potential candidates who might have surfaced in subjective, human resources screening processes; and a preference for hiring experienced candidates over investing in training for inexperienced but promising candidates. If workers do not move into low-unemployment occupations, the problem may not be that they cannot train or adjust, but that wages are too low to attract them. In the UK, for instance, less than half of STEM graduates work in scientific occupations, and there is no wage premium in other occupations for having a STEM degree. Firms, on the other hand, are more interested in hiring workers with STEM skills because these workers are not only very productive but also relatively cheap—despite widespread public perception that STEM graduates earn high salaries. Thus, companies open lots of vacancies for STEM positions, but then find it very difficult to fill them.

Limitations and gaps

While the literature has progressed in the last decade when it comes to measuring the extent of mismatch and how it affects unemployment and productivity, many measurement-related issues still raise concerns. Potentially, these issues are large enough to affect the qualitative conclusions drawn in this article.

The concept of skills is multi-dimensional, including the amount and quality of education, field of study, and experience in current and previous jobs. Additionally, there are many sorts of skills: technical skills, cognitive skills, soft skills (such as communications, problem solving, the ability to work well in teams), and perhaps even having certain personality traits. Moreover, the extent to which skills are transferable varies. Some skills are general; others are entirely job specific. An ideal dataset would account for this broad range of factors and detail the precise set of skill requirements for the job, as well as the precise skill set of the worker. However, most data sources, particularly the ones that cover a representative sample of the labor force, rely on responses to just a few questions that generate a description of a worker’s skill set. A related issue stems from the difficulty in gathering symmetric information about workers’ skill sets and jobs’ skill requirements.

The studies described in this article differ in the ways they address this measurement issue. As a result, it is difficult to pinpoint a “consensus estimate” of the effect of skills mismatch on productivity. The measurement problem is made even more difficult if one tries to estimate the effect of overall mismatch on aggregate productivity, rather than just the effect of being mismatched on an individual worker’s productivity. Moreover, a substantial amount of uncertainty shrouds the few results discussed here.

In the literature on mismatch and unemployment, the measurement issue takes a different form. Here, researchers think of the labor market as being segmented into submarkets, and the primary difficulty with measuring the effects of mismatch lies in finding the correct partitioning of the labor market. Ideally, the partition satisfies two properties. First, submarkets must be closed: No job seeker should end up finding a vacancy in a different submarket than her own. This means that the empirical definition of a submarket should be coarse enough to accommodate some degree of labormarket mobility. The second property is homogeneity: Two job seekers (or two vacancies) should be close enough that they can be considered identical by employers (or workers). This means that the definition of segments should be sufficiently precise, otherwise the measure of mismatch will underestimate the true phenomenon. If submarkets are too small, mismatch may be overestimated. So, what is the right partitioning of the labor market? This question first arose in the literature on geographic mismatch, where the submarkets are geographic areas. As discussed previously, accounting for the interconnection between geographic areas is crucial to correctly estimating the aggregate effect of mismatch.

Measuring skills mismatch suffers from the same dilemma as geographic mismatch in terms of the difficulty in defining sensible submarkets. The SOC, although a detailed and systematic categorization of the nature of different kinds of work, is an imperfect vessel for this analysis. For instance, one might surmise that workers in the same four-digit occupation codes can move to and from the same positions with relative ease. But, should this be taken to mean that former post-secondary English teachers can fill post-secondary physics teachers’ positions? By contrast, workers slotted into different two-digit occupation codes might seem “unmovable.” Yet it would seem logical that examiners and tax preparers could segue to and from positions in their differently coded jobs. Ideally, a measure of skills mismatch should account for the fact that job seekers move, to some extent, across occupations.

An impressive dataset created recently by the US Department of Labor may help alleviate some of the above issues. It is called O*NET OnLine, and provides a detailed mapping between six-digit SOC occupations and the usual tasks and skill requirements associated with jobs in eachoccupation. A 2013 study motivates this effort by showing that tasks explain a substantial amount of wage heterogeneity within occupations [13]. However, research using these data is just beginning.

Most studies on mismatch use three- or four-digit occupations, or even industries, to operationalize the concept of a skill-based labor market segment. The results of these studies are likely to be revisited, and may very well be overthrown as researchers find ways to use the opportunities provided by the O*Net data.

A separate issue involves the question of what data to use. In the US, job seekers are counted using the Current Population Survey (CPS), which assumes that the industry and occupation of a job seeker are both the same from one job to another. For vacancies, two US data sources are available. The first is the Job Openings and Labor Turnover Survey (JOLTS), which serves as a source of demand-side indicators of labor shortages at the national level, and allows researchers to compute the number of vacancies by industry (at a two-digit SOC level). The second is the Conference Board’s Help Wanted OnLine (HWOL), which is made up of the universe of unique online job vacancies in the US; these are collated into counts of vacancies by occupations. These two sources (JOLTS/HWOL) provide the most straightforward measure of the vacancy–unemployment ratio across industries and occupations. Many papers use these sources at the price of working on a relatively short time window [7], [9]. Other papers have to rely on assumptions about the matching technology to compute the vacancy–unemployment ratio from the job-finding probabilities measured in the CPS [1]. This technique results in a much longer time series. Luckily, findings look very similar in research relying on these different sources, lending additional credibility to the results.

Finally, when it comes to the causes of mismatch, the evidence is very thin indeed. It should be expected that the thinking on this issue will progress substantially as further research sheds light onto the mechanisms and trade-offs behind wage determination.

Summary and policy advice

Skills mismatch is an important cause of productivity loss and unemployment. Thus, policymaking tools that diminish its presence and persistence can benefit economies, firms, and people who are unemployed or underemployed.

However, in the context of the European Commission’s proposed “radical rethink on how education and training systems can deliver the skills needed by the labor market,”a reform of education and training systems may be neither needed nor desired. The most striking conclusion from current research is that worker mobility frictions may not be the main contributor to labor market mismatch. Yet, almost all proposed solutions to the skills gap treat the phenomenon as a problem of the education system. Such interventions in education and training are likely to be expensive, and, at the same time, may not be as effective as expected.

Why would increasing the emphasis on “scarce” skills in schools and universities fail to guarantee that skills mismatch will be reduced? The reason is simply that students choose, first, what skills to acquire in school and university, and then, whether and how to use these skills in the labor market. If wages do not reward certain skills, students will either choose not to pursue such skills, or, will pursue the skills but seek employment in other, higher-paying occupations. The STEM “gap” offers the most obvious example of this problem. While firms complain about a shortage of qualified physicists and engineers in the labor market, a very large number of graduates in these fields work in the financial sector, where they use only a subset of their STEM skills, but earn more money than they would in the shortage niches. Encouraging universities to educate more physicists and engineers will not solve the mismatch problem if these graduates look for—and find—better-paying jobs with investment banks.

These questions underline the need for additional research to understand the forces that foster and perpetuate mismatch. While the message from the current research should not be interpreted as a call to “do nothing,” greater knowledge is needed to guide policymakers in devising effective solutions.

Acknowledgments

The authors thank an anonymous referee and the IZA World of Labor editors for many helpful suggestions on earlier drafts. Previous work of the authors contains a larger number of background references for the material presented here and has been used intensively in all major parts of this article [1], [8].

Competing interests

The IZA World of Labor project is committed to the IZA Guiding Principles of Research Integrity. The author declares to have observed these principles.

© Roland Rathelot and Thijs van Rens

evidence map

Rethinking the skills gap

Full citation

Full citation

Data source(s)

Data type(s)

Method(s)

Countries