The Pre-Program Earnings Dip and the Determinants of Participation in a Social Program: Implications for Simple Program Evaluation Strategies

James J. Heckman, Jeffrey A. Smith

NBER Working Paper No. 6983*
Issued in February 1999
NBER Program(s):   LS    PE

---- Abstract -----

The key to estimating the impact of a program is constructing the counterfactual outcome representing what would have happened in its absence. This problem becomes more complicated when agents self-select into the program rather than being exogenously assigned to it. This paper uses data from a major social experiment to identify what would have happened to the earnings of self-selected participants in a job training program had they not participated in it. We investigate the implications of these earnings patterns for the validity of widely-used before-after and difference-in-differences estimators. Motivated by the failure of these estimators to produce credible estimates, we investigate the determinants of program participation. We find that labor force status dynamics, rather than earnings or employment dynamics, drive the participation process. Our evidence suggests that training programs often function as a form of job search. Methods that control only for earnings dynamics, like the conventional difference-in-differences estimator, do not adequately capture the underlying differences between participants and non-participants. We use the estimated probabilities of participation in both matching estimators and a nonparametric, conditional version of the differences-in-differences estimator and produce large reductions in the selection bias in non-experimental estimates of the effect of training on earnings.

*Published: Economic Journal, Vol. 109, no. 457 (1999): 313-348.

Would you like an annual subscription to NBER Working Papers? Click here for more information.

You may purchase this paper on-line in .pdf format from SSRN.com ($5) for electronic delivery.
Information for subscribers and others expecting no-cost downloads

Machine-readable bibliographic record - MARC, RIS, BibTeX

 

 
Publications:
Main Publications Page
 
New This Week
Working Papers
Books              
Books in Progress
Older Books Online
Digest            
Reporter            
Bulletin on Aging & Health
Historical Bulletins
Free Subscriptions
Paid Subscriptions
 
Research:
Program descriptions and members
 
Working Group Descriptions and Papers
 
Selected Projects:
Conference on Research in Income and Wealth
Conference on Econometrics and Mathematical Economics
Sloan Science and Engineering Workforce Project
Boston Census Research Data Center
 
Call for Papers
Submit to WP Series             
 
Data:
NBER Collection
Business Cycle Dates
Latest Business Cycle Memo
New Economic Releases
Selected Sources
Current Population Survey
Economic Organizations
US Government Agencies
Other Data Collections

Economic Report of the President
Economic Indicators
Congressional Budget Office
OECD Frequently Requested Statistics
 
About
What is the NBER?
NBER Historical Archives
Non-data Links    
Search              
Help              
Contact us
Site Map
Employment              
Fellowships
 
People:
Staff
Researchers
Board
Contact Us
Search
 
Search via Google: