Adjusting Imperfect Data: Overview and Case Studies

Lars Vilhuber

NBER Working Paper No. 12977
Issued in March 2007
NBER Program(s):   LS

---- Abstract -----

Research users of large administrative have to adjust their data for quirks, problems, and issues that are inevitable when working with these kinds of datasets. Not all solutions to these problems are identical, and how they differ may affect how the data is to be interpreted. Some elements of the data, such as the unit of observation, remain fundamentally different, and it is important to keep that in mind when comparing data across countries. In this paper (written for Lazear and Shaw, 2007), we focus on the differences in the underlying data for a selection of country datasets. We describe two data elements that remain fundamentally different across countries -- the sampling or data collection methodology, and the basic unit of analysis (establishment or firm) -- and the extent to which they differ. We then proceed to document some of the problems that affect longitudinally linked administrative data in general, and we describe some of the solutions analysts and statistical agencies have implemented, and explore, through a select set of case studies, how each adjustment or absence thereof might affect the data.

Would you like an annual subscription to NBER Working Papers? Click here for more information.

You may purchase this paper on-line in .pdf format from SSRN.com ($5) for electronic delivery.
Information for subscribers and others expecting no-cost downloads

Machine-readable bibliographic record - MARC, RIS, BibTeX

 

 
Publications:
Main Publications Page
 
New This Week
Working Papers
Books              
Books in Progress
Older Books Online
Digest            
Reporter            
Bulletin on Aging & Health
Historical Bulletins
Free Subscriptions
Paid Subscriptions
 
Research:
Program descriptions and members
 
Working Group Descriptions and Papers
 
Selected Projects:
Conference on Research in Income and Wealth
Conference on Econometrics and Mathematical Economics
Sloan Science and Engineering Workforce Project
Boston Census Research Data Center
 
Call for Papers
Submit to WP Series             
 
Data:
NBER Collection
Business Cycle Dates
Latest Business Cycle Memo
New Economic Releases
Selected Sources
Current Population Survey
Economic Organizations
US Government Agencies
Other Data Collections

Economic Report of the President
Economic Indicators
Congressional Budget Office
OECD Frequently Requested Statistics
 
About
What we are
Contact us
Non-data Links    
Search              
Site Map
Help              
Employment              
Fellowships
Early History
 
People:
Staff
Researchers
Board
Contact Us
Search
 
Search via Google: