Data and methods
Data, and the methods used to analyze them, are the foundation for evidence-based research. Articles in this subject area discuss the value of different types of data collection, and explain important statistical and econometric methods that provide ways to summarize and present information, and to identify and quantify correlation or causality.
Subject Editor
Royal Holloway, University of London, UK, and IZA, Germany
-
The importance of measuring dispersion in firm-level outcomes
Ignoring the large variation in firm-level outcomes can create misunderstandings about the consequences of many policies
Chad Syverson, May 2014Recent research has revealed enormous variation in performance and growth among firms, which both drives and is driven by large reallocations of inputs and outputs across firms (churning) within industries and markets. These differences in firm-level outcomes and the associated turnover of firms affect many economic policies (both labor- and non-labor-oriented), on both a microeconomic and a macroeconomic scale, and are affected by them. Properly evaluating these policies requires familiarity with the sources and consequences of firm-level variation and within-industry reallocation.MoreLess -
Poverty persistence and poverty dynamics
Snapshots of who is poor in one period provide an incomplete picture of poverty
Martin Biewen, November 2014A considerable part of the poverty that is measured in a single period is transitory rather than persistent. In most countries, only a portion of people who are currently poor are persistently poor. People who are persistently poor or who cycle into and out of poverty should be the main focus of anti-poverty policies. Understanding the characteristics of the persistently poor, and the circumstances and mechanisms associated with entry into and exit from poverty, can help to inform governments about options to reduce persistent poverty. Differences in poverty persistence across countries can shed additional light on possible sources of poverty persistence.MoreLess -
Randomized control trials in an imperfect world
How can we assess the policy effectiveness of randomized control trials when people don’t comply?
Zahra Siddique, December 2014Randomized control trials (RCTs) have become increasingly important as an evidence-based method to evaluate interventions such as government programs and policy initiatives. Frequently, however, RCTs are characterized by “imperfect compliance,” in that not all the subjects who are randomly assigned to take a treatment choose to do so. This could result in a failure to identify the treatment effect, or the impact of the treatment on the population. However, useful information on treatment effectiveness can still be recovered by estimating “bounds,” or a range of values in which treatment effectiveness can lie.MoreLess -
Measuring the cost of children
Knowing the real cost of children is important for crafting better economic policy
Olivier Donni, March 2015The cost of children is a critical parameter used in determining many economic policies. For instance, correctly setting the tax deduction for families with children requires assessing the true household cost of children. Evaluating child poverty at the individual level requires making a clear distinction between the share of family resources received by children and that received by parents. The standard ad hoc measures (equivalence scales) used in official publications to measure the cost of children are arbitrary and are not informed by any economic theory. However, economists have developed methods that are grounded in economic theory and can replace ad hoc measures.MoreLess -
Counting on count data models
Quantitative policy evaluation can benefit from a rich set of econometric methods for analyzing count data
Rainer Winkelmann, May 2015Often, economic policies are directed toward outcomes that are measured as counts. Examples of economic variables that use a basic counting scale are number of children as an indicator of fertility, number of doctor visits as an indicator of health care demand, and number of days absent from work as an indicator of employee shirking. Several econometric methods are available for analyzing such data, including the Poisson and negative binomial models. They can provide useful insights that cannot be obtained from standard linear regression models. Estimation and interpretation are illustrated in two empirical examples.MoreLess -
Matching as a regression estimator
Matching avoids making assumptions about the functional form of the regression equation, making analysis more reliable
Dan A. Black, September 2015“Matching” is a statistical technique used to evaluate the effect of a treatment by comparing the treated and non-treated units in an observational study. Matching provides an alternative to older estimation methods, such as ordinary least squares (OLS), which involves strong assumptions that are usually without much justification from economic theory. While the use of simple OLS models may have been appropriate in the early days of computing during the 1970s and 1980s, the remarkable increase in computing power since then has made other methods, in particular matching, very easy to implement.MoreLess -
The use of natural experiments in migration research
Data on rapid, unexpected refugee flows can credibly identify the impact of migration on native workers’ labor market outcomes
Semih Tumen, October 2015Estimating the causal effect of immigration on the labor market outcomes of native workers has been a major concern in the literature. Because immigrants decide whether and where to migrate, immigrant populations generally consist of individuals with characteristics that differ from those of a randomly selected sample. One solution is to focus on events such as civil wars and natural catastrophes that generate rapid and unexpected flows of refugees into a country unrelated to their personal characteristics, location, and employment preferences. These “natural experiments” yield estimates that find small negative effects on native workers’ employment but not on wages.MoreLess -
Evaluating the efficiency of public services
Differences in efficiency in public services can offer clues about good practice
Geraint Johnes, October 2015Efficiency is an important consideration for those who manage public services. Costs vary with output and with a variety of other factors. In the case of higher education, for example, factors include quality, student demographics, the scale and scope of the higher education provider, and the size and character of the real estate. But even when taking all these factors into account, costs vary across providers because of differences in efficiency. Such differences offer clues about good practice that can lead to improvements in the system as a whole. The role of efficiency is illustrated by reference to higher education institutions in England.MoreLess -
Google search activity data and breaking trends
Google search activity data are an unconventional survey full of unbiased, revealed answers in need of the right question
Nikolaos Askitas, November 2015Using Google search activity data can help detect, in real time and at high frequency, a wide spectrum of breaking socio-economic trends around the world. This wealth of data is the result of an ongoing and ever more pervasive digitization of information. Search activity data stand in contrast to more traditional economic measurement approaches, which are still tailored to an earlier era of scarce computing power. Search activity data can be used for more timely, informed, and effective policy making for the benefit of society, particularly in times of crisis. Indeed, having such data shifts the relation between theory and the data to support it.MoreLess -
Measuring disincentives to formal work
Does formal work pay? Synthetic measurements of taxes and benefits can help identify incentives and disincentives to formal work
Michael Weber, December 2015Evidence from transition economies shows that formal work may not pay, particularly for low-wage earners. Synthetic measurements of work disincentives, such as the formalization tax rate or the marginal effective tax rate, confirm a significant positive correlation between these measurements and the probability of informal work. These measures are especially informative for impacts at lower wage levels, where informality is highest. Policymakers who want to increase formal work can use these measurements to determine optimal labor taxation rates for low-wage earners and reform benefit design.MoreLess