SlideShare a Scribd company logo
1 of 14
Download to read offline
An Examination of the Influence of Theory and Individual
Theorists on Empirical Research in Microeconomics
Pierre-Andre Chiappori
University of Chicago
and
Steven D. Levitt
University of Chicago and American Bar Foundation
Acknowledgment: We would like to thank Richard Blundell, James Heckman, Costas
Meghir, Ariel Pakes, Jean-Mark Robin, Bernard Salanié and Steve Tadelis for helpful
comments and suggestions. Carolina Czastkiewicz provided truly exemplary research
assistance. The financial support of the National Science Foundation is gratefully
acknowledged. This research was completed while Levitt was a fellow at the Center for
Advanced Study in Behavioral Sciences, Stanford, CA. Mailing address (both authors):
Department of Economics, University of Chicago, 1126 E. 59th
Street, Chicago, IL
60637.
e-mail addresses: pchiappo@midway.uchicago.edu; slevitt@midway.uchicago.edu.
Most economists would concur that an important role of economic theory is to
influence the direction of empirical research, either by posing new questions or by
suggesting new answers to old questions. Whether or not modern theory should be
judged to be a success on that metric is a frequently debated question, but one on which
there has been little systematic investigation. In this paper, we provide some preliminary
empirical evidence on the extent to which various fields of economic theory, as well as
specific theorists, have succeeded in influencing the path followed by empirical research
in the area of microeconomics.
Based on our analysis of all empirical microeconomics papers published in three
leading journals over a three-year period, we arrive at a number of conclusions
concerning the impact of theory on empirical research. Our first finding is that the set of
theory papers cited as the primary motivation for leading empirical work is surprisingly
dispersed. Very few individual works of theory seem to have exerted a great influence.
In the 149 empirical papers we consider, one author (Gary Becker) is cited fifteen times,
all other authors are cited ten times or less; no single paper is cited more than six times.
A second finding is that empirical researchers behave as if they are heavily influenced by
recent theoretical contributions. Among the theory papers identified as providing the
central motivation for the empirical research, over half of all the citations are to theory
papers published after 1990. The extent to which this pattern of citations is truly
meaningful, however, is called into question by our third finding. Namely, the great
majority of empirical papers test traditional economic ideas (i.e. concepts that were quite
familiar to economists in the 1940s and 1950s), although often these old ideas are applied
in non-traditional settings (e.g. crime, household economics). These papers do not show
much direct influence of the theoretical fields that emerged since that time (e.g. general
equilibrium, game theory, information economics, behavioral economics). Among the
major innovations in theory in recent decades, only information economics has had a
substantial influence on the empirical papers in our data set. Empirical papers testing
game theory, general equilibrium, and behavioral economics are all quite rare in our
sample. This pattern sharply contrasts with the distribution of theoretical contributions in
the same journals in the same period, where the more ‘recent’ fields clearly dominate.
Finally, we examine the influence of particular theorists. Gary Becker stands out as the
theorist who has most greatly influenced current empirical work.
Our empirical approach
In order to better understand how theory has influenced empirical work in recent
years, we constructed a database of all empirical microeconomics papers published in
American Economic Review, Journal of Political Economy, and Quarterly Journal of
Economics between the years of 1999 and 2001. To be classified as empirical, a paper
simply needed to contain original regression analysis. We excluded laboratory
experiments (11 of them), as well as papers in the area of finance, viewing those areas of
research as distinct from mainstream empirical micro. Papers published in AER under the
category of “shorter papers” were also excluded from the analysis, as were comments and
replies, AEA Papers and Proceedings, and special issues. 149 papers remained in the
data set after these exclusions. These papers represent 38 percent of all papers published
in these three journals over this time period.1
For each paper in the data set, we made a judgment regarding the broadly defined
area of theory that the empirical work appeared to be testing.2
The six categories of
theory that we used were as follows: price theory, applications of price theory,
information economics, game theory, behavioral economics, and general equilibrium.
Price theory refers to basic economic principles and techniques used by economists in the
1950s and before, such as consumer theory, production theory or partial equilibrium.
Applications of price theory refer to the testing of simple economic ideas (such as those
just listed as well as externalities or public goods, for instance) in domains outside the
traditional purview of the field (crime, household behavior, etc.). Information economics
encompasses models involving asymmetric information and (complete and incomplete)
contract theory, signaling, and search. Game theory is intended in a broad sense; it
includes both cooperative and non-cooperative game theory, as well as a number of
applications, such as voting, political economy, and auctions. Behavioral economics also
is broadly defined, including for instance non expected utility, bounded rationality, and
addiction. Finally, general equilibrium encompasses standard ‘Walrasian’ theory as well
as more recent developments (incomplete markets, etc.).
In addition to classifying each empirical paper as described above, we also
cataloged the specific theory papers that the authors themselves identify as motivating
their work.3
Using this information, we are able to identify papers and theorists that have
been particularly influential on recent empirical work.
Finally, we cataloged every micro theory paper published in these three journals
over the same period into one of these same six broad categories. This provides the
opportunity to compare the distribution of the current output of theory to the distribution
of theory that is materially influencing empirical research.
The influence of theory on empirics
Figure 1 reports the distribution of theoretical papers according to their area, and
that of empirical papers according to the area of theory that motivates the empirics. The
discrepancy between the two distributions is striking. Among empirical works, price
theory and applications of price theory dominate the output, accounting for almost
seventy percent of all empirical papers. Approximately 20 percent of the papers test an
aspect of information economics.4
Game theory and behavioral economics each account
for about five percent of the papers; finally, tests of general equilibrium are extremely
rare (a total of 2 papers out of 149 total).5
The picture for theory is largely reversed.
Information and game account for more than half of all papers; applications of price
theory represent about 20 percent of the total, price theory and behavioral economics 10
percent each, and while general equilibrium remains scarce, its proportion is still five
times as high as for empirical works.
Such patterns are open to many interpretations. One factor that is no doubt
important in explaining the predominance of price theory in motivating empirical
research is that price theory, whether ‘pure’ or applied to non traditional domains, tends
to yield well defined predictions. In addition, both the positive analysis and the
normative recommendations usually rely on a small number of empirical concepts (e.g.,
elasticities) that are often relatively easy to estimate from available data. In contrast,
more ‘recent’ theories have been largely unsuccessful at deriving general predictions that
can be robustly tested on observable variables – a fact that probably reflects the inherent
nature of the new developments, but also perhaps the lack of interest in such an exercise
from the theorists. Most predictions of information economics are extremely sensitive to
the detailed setting of the model, of which some crucial aspects (e.g., the nature of
contractual incompleteness) can hardly be given a simple empirical translation. Data
requirements are also more stringent; the recent developments in empirical tests of
asymmetric information models, for instance, may be partly due to the increased
availability of high quality data sets.6
The empirical implementation of game theory may
be especially difficult when the equilibrium is indeterminate (hence the theory
inconclusive), as is often the case for repeated games or games with incomplete
information. Moreover, such basic concepts as strategy spaces may be either hard to
observe or excessively complex (or both) in real situations, and available data often raises
thorny issues of aggregation (Pierre-Andre Chiappori, Timothy Groseclose, and Steven
Levitt 2002). Most general equilibrium models do not produce testable predictions, and
their testing may require both specific data sets and strong auxiliary assumptions. Finally,
behavioral economics may suffer, at least for the moment, from the absence of a unified
theoretical corpus (especially for models involving bounded rationality). Even when
some partial agreement exists among theorists, as in the case of behavior under
uncertainty, the empirical distinction between recent advances and standard approaches
(e.g., expected utility) turns out to be extremely delicate.
Based on Figure 1, one could reasonably be led to believe that the theoretical
advances of the last four decades have exerted little influence on the current practice of
empirical research. Citation patterns, however, suggest a very different conclusion.
Figure 2 reports the distribution by decade of the theory papers cited as motivating the
empirical papers in our data set. These citations are overwhelmingly skewed to recent
decades. More than half of all these citations are to theory papers published in the 1990s.
Only 3 percent of all the cites are to papers published prior to the 1960s, despite our
contention above that fully 70 percent of the empirical papers test basic economic ideas
that were well understood half a century ago. This pattern may suggest that the
discrepancy between theory and empirics is less deep than it could be feared. While the
fields recently opened by the theorist may be less prone to empirical applications, applied
work still remains in touch with recent theory, at least to the extent that it is motivated at
all by theory insights.
The influence of individual theorists on empirics
The information we have collected allows us to go beyond the influence of broad
areas of theory to examine the particular contributions of individual theorists. Our
measure of a theorist’s influence on empirical research is the number of different
empirical papers in our data set for which one of his/her papers appears as a key
motivational cite. Self-citations are excluded. No correction is made for co-authorship,
i.e. each author is given full credit. Table 1 provides a ranking of the fifteen theorists
currently exerting the greatest influence on empirical work, subject to the important
caveat that there is a heavy bias in citation behavior towards recently published theory.
Gary Becker leads the list with fifteen citations (out of a possible 149, which is the
number of papers in our data). Remarkably, thirteen different papers are represented
among Becker’s fifteen citations, with no individual work cited more than twice. Papers
published by Becker in every decade since the 1950’s are cited, highlighting both the
longevity of his early scholarship, and his remarkable ability to continually produce
influential theory over a span of more than forty years. Bengt Holmstrom and Paul
Milgrom have ten cites each, five of which are joint. Holmstrom and Milgrom (1991) is
cited three times, as is Milgrom and Weber (1982). Joseph Stiglitz and Roland Benabou
each garner eight citations. A number of different works by Stiglitz are cited, the most
frequent of which is Michael Rothschild and Stiglitz (1976). Benabou’s cites are spread
out over three papers. Robert Lucas, George Stigler, and Sherwin Rosen are next on the
list, giving the University of Chicago economics department four of the top ten theorists
on the list.7
The strong Chicago influence is consistent with the fact that one of the most
successful empirical strategies in recent years has been to apply traditional economic
ideas in new applications, an area in which Chicago’s theorists have been at the forefront.
It is worth noting that neither Lucas nor Hersh Shefrin, whose works are mostly in
finance, would be considered traditional micro theorists. Interestingly, three non-
economists also make the list. Two of these are psychologists who have influenced
behavioral economics (Daniel Kahneman and Amos Tversky). William J. Wilson, a
sociologist, rounds out the list, with all of his citations for his influential book Wilson
(1987).
Although Table 1 emphasizes the fact that there are a handful of theorists who
have exerted a great influence on empirical research, we find it surprising how little
concentration there is among the particular theory papers cited. There are a total of
approximately 550 cites to motivating theory in our data set. Only four papers or books
receive four or more cites (George Baker 1992, Edward Glaeser, Bruce Sacerdote, and
Jose Scheinkman 1996, Lucas 1988, Wilson 1997). There are nine papers that receive
three cites, 37 papers that receive two cites, leaving over 400 papers that are cited exactly
once.
Conclusion
The statistical analysis above, while shedding some light on the issues, can of
course provide only a partial view of the influence of theory on empirical economics.
Empirical models rely on some common economic “culture,” many ingredients of which
are often directly borrowed from theory. Works measuring the return to education may
not quote the source of the notion of human capital; still, this is a purely theoretical
concept, and possibly one of the most important insights of modern economic theory.
Most papers in empirical IO and other fields use such equilibrium concepts as Nash,
subgame perfection or sequentiality without explicitly giving credit to their inventor; and
the main spirit of general equilibrium is present in several empirical contributions which
are not explicitly aimed at testing GE theory. Unusually successful innovations tend to
enter economists’ toolbox without explicit reference to their author. Ironically, not being
cited may thus be the ultimate sign of intellectual influence.
Table 1: Theorists Most Often Cited as Motivating Empirical Microeconomic Research
Among papers published in AER, JPE,and QJE, 1999-2001
Theorist Number of citations
Gary Becker 15
Bengt Holmstrom 10
Paul Milgrom 10
Joseph Stiglitz 8
Roland Benabou 8
Robert Lucas 7
Daniel Kahneman and Amos Tversky 6
Sherwin Rosen 6
George Stigler 6
George Akelof 5
Kenneth Arrow 5
George Baker 5
Boyan Jovanovic 5
Hersh Shefrin 5
William Julius Wilson 5
Notes: Number of citations refers to the total number of empirical microeconomics
papers published in AER, JPE, or QJE during the period 1999-2001 which list the work
of the named author as a key motivating cite in the empirical research. Self-citations and
citations in a single empirical paper to multiple theory papers by the same author are not
included. The total number of empirical microeconomics papers in the data base is 149.
References
Baker, George. “Incentive Contracts and Performance Measurement.” Journal of Political
Economy, 1992, 100 (XXX), pp. 598-614.
Chiappori, Pierre-Andre, Timothy Groseclose, and Steven Levitt. ““A Test of Mixed
Strategy Equilibria: Penalty Kicks in Soccer.” American Economic Review, v92
(September 2002): 1138-1151.
Glaeser, Edward; Sacerdote, Bruce and Scheinkman, Jose. “Crime and Social
Interactions.” Quarterly Journal of Economics, 1996, XXX (2), pp. 507-548.
Holmstrom, Bengt and Milgrom, Paul. “Multitask Principal-Agent Analyses: Incentive
Contracts, Asset Ownership, and Job Design.” Journal of Law, Economics, and
Organization, 1991, 7 (1), pp. 24-52.
Lucas, Robert. “On the Mechanics of Economic Development.” Journal of Monetary
Economics, 1988, 22 (1), pp. 3-42.
Milgrom, Paul and Weber, Robert. “A Theory of Auctions and Competitive Bidding.”
Econometrica, 1982, 50 (September), pp. 1089-1122.
Rothschild, Michael and Stiglitz, Joseph. “Equilibrium in Competitive Insurance
Markets: An Essay on the Economics of Imperfect Information.” Quarterly Journal of
Economics, 1976, 90 (Novermber), pp. 629-649.
Wilson, William Julius. The Truly Disadvantaged: The Inner City, the Underclass, and
Public Policy. Chicago: University of Chicago Press, 1987.
Theoretical and empirical micro papers by field
(%)
0
5
10
15
20
25
30
35
40
45
P
r
i
c
e
t
h
e
o
r
y
A
p
p
l
i
c
a
t
i
o
n
I
n
f
o
r
m
a
t
i
o
n
B
e
h
a
v
i
o
r
a
l
G
a
m
e
G
e
n
e
r
a
l
e
q
u
i
l
i
b
r
i
u
m
Theoretical
Empirical
Figure 1
Number of main cites per decade of publication of cited article
0
50
100
150
200
250
300
350
30 40 50 60 70 80 90
Figure 2
Endnotes
1
Empirical micro papers represent slightly more than half of the papers published in Quarterly Journal of
Economics, 46 percent of papers in Journal of Political Economy, but only 25 percent of the papers in
American Economic Review.
2
As one might imagine, there is a great deal of judgment involved in this categorization. Like sausage-
making, one may prefer not to know precisely what goes into the final product. For those who are
interested, however, the full database and classifications are available on request from the authors.
3
The typical empirical paper in our sample has one paragraph, usually in the introduction, which discusses
the theoretical foundation of the work. Only papers cited in this manner are included.
4
The most common empirical test of information theory addresses issues of contracting within the firm.
There are also papers on auctions (3), insurance markets (2), statistical discrimination (2), as well as single
papers on a number of other topics.
5
Including laboratory experiments would have little impact on the conclusions regarding empirical tests of
game theory. Only one of the eleven laboratory experiments published were explicit tests of game theory.
Five of the lab experiments were classified as behavioral economics, three as information, and two as price
theory.
6
An obvious example is the explosion of empirical works devoted to insurance data: clearly, the
availability of large, high-quality data sets is a recent phenomenon.
7
The heavy representation of Chicago economists is not an artifact of including Journal of Political
Economy in the data base. The leading Chicago economists are only slightly more likely to be cited in
Journal of Political Economy papers than they are in American Economic Review or Quarterly Journal of
Economics.

More Related Content

Similar to An Examination Of The Influence Of Theory And Individual Theorists On Empirical Research In Microeconomics

The Scope And Method Of Economics
The Scope And Method Of EconomicsThe Scope And Method Of Economics
The Scope And Method Of Economics
s.coffey
 
Ak park zak_2007
Ak park zak_2007Ak park zak_2007
Ak park zak_2007
Jang Park
 
Review question 8.Select two editorials on a current issue of publ.docx
Review question 8.Select two editorials on a current issue of publ.docxReview question 8.Select two editorials on a current issue of publ.docx
Review question 8.Select two editorials on a current issue of publ.docx
ronak56
 
Kahneman 2003 psychological perspective on economics
Kahneman 2003 psychological perspective on economicsKahneman 2003 psychological perspective on economics
Kahneman 2003 psychological perspective on economics
Nelsio Abreu
 
Abbott Q Paper0102
Abbott Q Paper0102Abbott Q Paper0102
Abbott Q Paper0102
David Donohue
 
Journal of Business and Behavioral Sciences Vol. 25, No. .docx
Journal of Business and Behavioral Sciences  Vol. 25, No. .docxJournal of Business and Behavioral Sciences  Vol. 25, No. .docx
Journal of Business and Behavioral Sciences Vol. 25, No. .docx
priestmanmable
 
The role of positive and normative economics in scholarly research
The  role  of positive  and  normative  economics  in scholarly  researchThe  role  of positive  and  normative  economics  in scholarly  research
The role of positive and normative economics in scholarly research
Dr. Vignes Gopal
 
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docxBehavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
AASTHA76
 

Similar to An Examination Of The Influence Of Theory And Individual Theorists On Empirical Research In Microeconomics (20)

The Scope And Method Of Economics
The Scope And Method Of EconomicsThe Scope And Method Of Economics
The Scope And Method Of Economics
 
Theory and experiment in the analysis of strategic interaction by Vincent P. ...
Theory and experiment in the analysis of strategic interaction by Vincent P. ...Theory and experiment in the analysis of strategic interaction by Vincent P. ...
Theory and experiment in the analysis of strategic interaction by Vincent P. ...
 
Ak park zak_2007
Ak park zak_2007Ak park zak_2007
Ak park zak_2007
 
Review question 8.Select two editorials on a current issue of publ.docx
Review question 8.Select two editorials on a current issue of publ.docxReview question 8.Select two editorials on a current issue of publ.docx
Review question 8.Select two editorials on a current issue of publ.docx
 
Kahneman 2003 psychological perspective on economics
Kahneman 2003 psychological perspective on economicsKahneman 2003 psychological perspective on economics
Kahneman 2003 psychological perspective on economics
 
02. predicting financial distress logit mode jones
02. predicting financial distress logit mode jones02. predicting financial distress logit mode jones
02. predicting financial distress logit mode jones
 
The nature and future of econophysics
The nature and future of econophysicsThe nature and future of econophysics
The nature and future of econophysics
 
Alex Preda (UCL), Finance as a boundary science. What can social scientists b...
Alex Preda (UCL), Finance as a boundary science. What can social scientists b...Alex Preda (UCL), Finance as a boundary science. What can social scientists b...
Alex Preda (UCL), Finance as a boundary science. What can social scientists b...
 
Philosophical preliminaries in_economics_yohannes mengesha
Philosophical preliminaries in_economics_yohannes mengeshaPhilosophical preliminaries in_economics_yohannes mengesha
Philosophical preliminaries in_economics_yohannes mengesha
 
LECTURA 2: Political Economy in Political Science
LECTURA 2: Political Economy in Political ScienceLECTURA 2: Political Economy in Political Science
LECTURA 2: Political Economy in Political Science
 
There’s No Escape from External Validity – Reporting Habits of Randomized Con...
There’s No Escape from External Validity – Reporting Habits of Randomized Con...There’s No Escape from External Validity – Reporting Habits of Randomized Con...
There’s No Escape from External Validity – Reporting Habits of Randomized Con...
 
Accounting Research Methods SSRN-Id1921192
Accounting Research Methods SSRN-Id1921192Accounting Research Methods SSRN-Id1921192
Accounting Research Methods SSRN-Id1921192
 
Abbott Q Paper0102
Abbott Q Paper0102Abbott Q Paper0102
Abbott Q Paper0102
 
RationalChoicePaper.pdf
RationalChoicePaper.pdfRationalChoicePaper.pdf
RationalChoicePaper.pdf
 
Relevance of statistics sgd-slideshare
Relevance of statistics sgd-slideshareRelevance of statistics sgd-slideshare
Relevance of statistics sgd-slideshare
 
Cooper political economy of acct
Cooper political economy of acctCooper political economy of acct
Cooper political economy of acct
 
Journal of Business and Behavioral Sciences Vol. 25, No. .docx
Journal of Business and Behavioral Sciences  Vol. 25, No. .docxJournal of Business and Behavioral Sciences  Vol. 25, No. .docx
Journal of Business and Behavioral Sciences Vol. 25, No. .docx
 
UNDERSTANDING DECISION/ GAME THEORY FOR BETTER RISK ASSESSMENT.
UNDERSTANDING DECISION/ GAME THEORY FOR BETTER RISK ASSESSMENT.UNDERSTANDING DECISION/ GAME THEORY FOR BETTER RISK ASSESSMENT.
UNDERSTANDING DECISION/ GAME THEORY FOR BETTER RISK ASSESSMENT.
 
The role of positive and normative economics in scholarly research
The  role  of positive  and  normative  economics  in scholarly  researchThe  role  of positive  and  normative  economics  in scholarly  research
The role of positive and normative economics in scholarly research
 
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docxBehavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
Behavior and Social Issues, 19, 24-31 (2011). © Mitch J. Fryli.docx
 

More from Stephen Faucher

More from Stephen Faucher (20)

Unseen Poetry Past Papers
Unseen Poetry Past PapersUnseen Poetry Past Papers
Unseen Poetry Past Papers
 
Top 7 Rules For Writing A Good Analysis Essay
Top 7 Rules For Writing A Good Analysis EssayTop 7 Rules For Writing A Good Analysis Essay
Top 7 Rules For Writing A Good Analysis Essay
 
Is It Okay To Include Quotes In College Essays - GradesHQ
Is It Okay To Include Quotes In College Essays - GradesHQIs It Okay To Include Quotes In College Essays - GradesHQ
Is It Okay To Include Quotes In College Essays - GradesHQ
 
A Manual For Writers Of Term Papers Theses And Dissert
A Manual For Writers Of Term Papers Theses And DissertA Manual For Writers Of Term Papers Theses And Dissert
A Manual For Writers Of Term Papers Theses And Dissert
 
Example Of An Abstract For A Research Report - English La
Example Of An Abstract For A Research Report - English LaExample Of An Abstract For A Research Report - English La
Example Of An Abstract For A Research Report - English La
 
Extended Essay Guide Art
Extended Essay Guide ArtExtended Essay Guide Art
Extended Essay Guide Art
 
Essay Essaywriting How To Do A Research Assignment,
Essay Essaywriting How To Do A Research Assignment,Essay Essaywriting How To Do A Research Assignment,
Essay Essaywriting How To Do A Research Assignment,
 
My New YearS Resolution For 20
My New YearS Resolution For 20My New YearS Resolution For 20
My New YearS Resolution For 20
 
Stunning 600 Word Essay Thatsnotus
Stunning 600 Word Essay ThatsnotusStunning 600 Word Essay Thatsnotus
Stunning 600 Word Essay Thatsnotus
 
Transition Words And Phrases, Detailed List - Le
Transition Words And Phrases, Detailed List - LeTransition Words And Phrases, Detailed List - Le
Transition Words And Phrases, Detailed List - Le
 
Essay Writing Process — W
Essay Writing Process — WEssay Writing Process — W
Essay Writing Process — W
 
College Essay Sample Pdf
College Essay Sample PdfCollege Essay Sample Pdf
College Essay Sample Pdf
 
012 How To Write An Introduction Paragraph For Essay Example That
012 How To Write An Introduction Paragraph For Essay Example That012 How To Write An Introduction Paragraph For Essay Example That
012 How To Write An Introduction Paragraph For Essay Example That
 
Example Of A Research Paper Rationale
Example Of A Research Paper RationaleExample Of A Research Paper Rationale
Example Of A Research Paper Rationale
 
2024 New Year Resolutions G
2024 New Year Resolutions G2024 New Year Resolutions G
2024 New Year Resolutions G
 
Example Of Reflection Paper About Movie Reflection P
Example Of Reflection Paper About Movie Reflection PExample Of Reflection Paper About Movie Reflection P
Example Of Reflection Paper About Movie Reflection P
 
Horse Writing Paper
Horse Writing PaperHorse Writing Paper
Horse Writing Paper
 
Concluding Sentence Generator
Concluding Sentence GeneratorConcluding Sentence Generator
Concluding Sentence Generator
 
Personalized Letter Writing Sheets Floral Personalized Stationery Set
Personalized Letter Writing Sheets Floral Personalized Stationery SetPersonalized Letter Writing Sheets Floral Personalized Stationery Set
Personalized Letter Writing Sheets Floral Personalized Stationery Set
 
Websites To Help Write Essays
Websites To Help Write EssaysWebsites To Help Write Essays
Websites To Help Write Essays
 

Recently uploaded

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Recently uploaded (20)

UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdfUGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
UGC NET Paper 1 Mathematical Reasoning & Aptitude.pdf
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...Kodo Millet  PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
Kodo Millet PPT made by Ghanshyam bairwa college of Agriculture kumher bhara...
 
Tatlong Kwento ni Lola basyang-1.pdf arts
Tatlong Kwento ni Lola basyang-1.pdf artsTatlong Kwento ni Lola basyang-1.pdf arts
Tatlong Kwento ni Lola basyang-1.pdf arts
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)Accessible Digital Futures project (20/03/2024)
Accessible Digital Futures project (20/03/2024)
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptxHMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
HMCS Max Bernays Pre-Deployment Brief (May 2024).pptx
 
80 ĐỀ THI THỏ TUYỂN SINH TIáșŸNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỏ TUYỂN SINH TIáșŸNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỏ TUYỂN SINH TIáșŸNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỏ TUYỂN SINH TIáșŸNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Fostering Friendships - Enhancing Social Bonds in the Classroom
Fostering Friendships - Enhancing Social Bonds  in the ClassroomFostering Friendships - Enhancing Social Bonds  in the Classroom
Fostering Friendships - Enhancing Social Bonds in the Classroom
 

An Examination Of The Influence Of Theory And Individual Theorists On Empirical Research In Microeconomics

  • 1. An Examination of the Influence of Theory and Individual Theorists on Empirical Research in Microeconomics Pierre-Andre Chiappori University of Chicago and Steven D. Levitt University of Chicago and American Bar Foundation Acknowledgment: We would like to thank Richard Blundell, James Heckman, Costas Meghir, Ariel Pakes, Jean-Mark Robin, Bernard SalaniĂ© and Steve Tadelis for helpful comments and suggestions. Carolina Czastkiewicz provided truly exemplary research assistance. The financial support of the National Science Foundation is gratefully acknowledged. This research was completed while Levitt was a fellow at the Center for Advanced Study in Behavioral Sciences, Stanford, CA. Mailing address (both authors): Department of Economics, University of Chicago, 1126 E. 59th Street, Chicago, IL 60637. e-mail addresses: pchiappo@midway.uchicago.edu; slevitt@midway.uchicago.edu.
  • 2. Most economists would concur that an important role of economic theory is to influence the direction of empirical research, either by posing new questions or by suggesting new answers to old questions. Whether or not modern theory should be judged to be a success on that metric is a frequently debated question, but one on which there has been little systematic investigation. In this paper, we provide some preliminary empirical evidence on the extent to which various fields of economic theory, as well as specific theorists, have succeeded in influencing the path followed by empirical research in the area of microeconomics. Based on our analysis of all empirical microeconomics papers published in three leading journals over a three-year period, we arrive at a number of conclusions concerning the impact of theory on empirical research. Our first finding is that the set of theory papers cited as the primary motivation for leading empirical work is surprisingly dispersed. Very few individual works of theory seem to have exerted a great influence. In the 149 empirical papers we consider, one author (Gary Becker) is cited fifteen times, all other authors are cited ten times or less; no single paper is cited more than six times. A second finding is that empirical researchers behave as if they are heavily influenced by recent theoretical contributions. Among the theory papers identified as providing the central motivation for the empirical research, over half of all the citations are to theory papers published after 1990. The extent to which this pattern of citations is truly meaningful, however, is called into question by our third finding. Namely, the great majority of empirical papers test traditional economic ideas (i.e. concepts that were quite familiar to economists in the 1940s and 1950s), although often these old ideas are applied in non-traditional settings (e.g. crime, household economics). These papers do not show
  • 3. much direct influence of the theoretical fields that emerged since that time (e.g. general equilibrium, game theory, information economics, behavioral economics). Among the major innovations in theory in recent decades, only information economics has had a substantial influence on the empirical papers in our data set. Empirical papers testing game theory, general equilibrium, and behavioral economics are all quite rare in our sample. This pattern sharply contrasts with the distribution of theoretical contributions in the same journals in the same period, where the more ‘recent’ fields clearly dominate. Finally, we examine the influence of particular theorists. Gary Becker stands out as the theorist who has most greatly influenced current empirical work. Our empirical approach In order to better understand how theory has influenced empirical work in recent years, we constructed a database of all empirical microeconomics papers published in American Economic Review, Journal of Political Economy, and Quarterly Journal of Economics between the years of 1999 and 2001. To be classified as empirical, a paper simply needed to contain original regression analysis. We excluded laboratory experiments (11 of them), as well as papers in the area of finance, viewing those areas of research as distinct from mainstream empirical micro. Papers published in AER under the category of “shorter papers” were also excluded from the analysis, as were comments and replies, AEA Papers and Proceedings, and special issues. 149 papers remained in the data set after these exclusions. These papers represent 38 percent of all papers published in these three journals over this time period.1
  • 4. For each paper in the data set, we made a judgment regarding the broadly defined area of theory that the empirical work appeared to be testing.2 The six categories of theory that we used were as follows: price theory, applications of price theory, information economics, game theory, behavioral economics, and general equilibrium. Price theory refers to basic economic principles and techniques used by economists in the 1950s and before, such as consumer theory, production theory or partial equilibrium. Applications of price theory refer to the testing of simple economic ideas (such as those just listed as well as externalities or public goods, for instance) in domains outside the traditional purview of the field (crime, household behavior, etc.). Information economics encompasses models involving asymmetric information and (complete and incomplete) contract theory, signaling, and search. Game theory is intended in a broad sense; it includes both cooperative and non-cooperative game theory, as well as a number of applications, such as voting, political economy, and auctions. Behavioral economics also is broadly defined, including for instance non expected utility, bounded rationality, and addiction. Finally, general equilibrium encompasses standard ‘Walrasian’ theory as well as more recent developments (incomplete markets, etc.). In addition to classifying each empirical paper as described above, we also cataloged the specific theory papers that the authors themselves identify as motivating their work.3 Using this information, we are able to identify papers and theorists that have been particularly influential on recent empirical work. Finally, we cataloged every micro theory paper published in these three journals over the same period into one of these same six broad categories. This provides the
  • 5. opportunity to compare the distribution of the current output of theory to the distribution of theory that is materially influencing empirical research. The influence of theory on empirics Figure 1 reports the distribution of theoretical papers according to their area, and that of empirical papers according to the area of theory that motivates the empirics. The discrepancy between the two distributions is striking. Among empirical works, price theory and applications of price theory dominate the output, accounting for almost seventy percent of all empirical papers. Approximately 20 percent of the papers test an aspect of information economics.4 Game theory and behavioral economics each account for about five percent of the papers; finally, tests of general equilibrium are extremely rare (a total of 2 papers out of 149 total).5 The picture for theory is largely reversed. Information and game account for more than half of all papers; applications of price theory represent about 20 percent of the total, price theory and behavioral economics 10 percent each, and while general equilibrium remains scarce, its proportion is still five times as high as for empirical works. Such patterns are open to many interpretations. One factor that is no doubt important in explaining the predominance of price theory in motivating empirical research is that price theory, whether ‘pure’ or applied to non traditional domains, tends to yield well defined predictions. In addition, both the positive analysis and the normative recommendations usually rely on a small number of empirical concepts (e.g., elasticities) that are often relatively easy to estimate from available data. In contrast, more ‘recent’ theories have been largely unsuccessful at deriving general predictions that
  • 6. can be robustly tested on observable variables – a fact that probably reflects the inherent nature of the new developments, but also perhaps the lack of interest in such an exercise from the theorists. Most predictions of information economics are extremely sensitive to the detailed setting of the model, of which some crucial aspects (e.g., the nature of contractual incompleteness) can hardly be given a simple empirical translation. Data requirements are also more stringent; the recent developments in empirical tests of asymmetric information models, for instance, may be partly due to the increased availability of high quality data sets.6 The empirical implementation of game theory may be especially difficult when the equilibrium is indeterminate (hence the theory inconclusive), as is often the case for repeated games or games with incomplete information. Moreover, such basic concepts as strategy spaces may be either hard to observe or excessively complex (or both) in real situations, and available data often raises thorny issues of aggregation (Pierre-Andre Chiappori, Timothy Groseclose, and Steven Levitt 2002). Most general equilibrium models do not produce testable predictions, and their testing may require both specific data sets and strong auxiliary assumptions. Finally, behavioral economics may suffer, at least for the moment, from the absence of a unified theoretical corpus (especially for models involving bounded rationality). Even when some partial agreement exists among theorists, as in the case of behavior under uncertainty, the empirical distinction between recent advances and standard approaches (e.g., expected utility) turns out to be extremely delicate. Based on Figure 1, one could reasonably be led to believe that the theoretical advances of the last four decades have exerted little influence on the current practice of empirical research. Citation patterns, however, suggest a very different conclusion.
  • 7. Figure 2 reports the distribution by decade of the theory papers cited as motivating the empirical papers in our data set. These citations are overwhelmingly skewed to recent decades. More than half of all these citations are to theory papers published in the 1990s. Only 3 percent of all the cites are to papers published prior to the 1960s, despite our contention above that fully 70 percent of the empirical papers test basic economic ideas that were well understood half a century ago. This pattern may suggest that the discrepancy between theory and empirics is less deep than it could be feared. While the fields recently opened by the theorist may be less prone to empirical applications, applied work still remains in touch with recent theory, at least to the extent that it is motivated at all by theory insights. The influence of individual theorists on empirics The information we have collected allows us to go beyond the influence of broad areas of theory to examine the particular contributions of individual theorists. Our measure of a theorist’s influence on empirical research is the number of different empirical papers in our data set for which one of his/her papers appears as a key motivational cite. Self-citations are excluded. No correction is made for co-authorship, i.e. each author is given full credit. Table 1 provides a ranking of the fifteen theorists currently exerting the greatest influence on empirical work, subject to the important caveat that there is a heavy bias in citation behavior towards recently published theory. Gary Becker leads the list with fifteen citations (out of a possible 149, which is the number of papers in our data). Remarkably, thirteen different papers are represented among Becker’s fifteen citations, with no individual work cited more than twice. Papers
  • 8. published by Becker in every decade since the 1950’s are cited, highlighting both the longevity of his early scholarship, and his remarkable ability to continually produce influential theory over a span of more than forty years. Bengt Holmstrom and Paul Milgrom have ten cites each, five of which are joint. Holmstrom and Milgrom (1991) is cited three times, as is Milgrom and Weber (1982). Joseph Stiglitz and Roland Benabou each garner eight citations. A number of different works by Stiglitz are cited, the most frequent of which is Michael Rothschild and Stiglitz (1976). Benabou’s cites are spread out over three papers. Robert Lucas, George Stigler, and Sherwin Rosen are next on the list, giving the University of Chicago economics department four of the top ten theorists on the list.7 The strong Chicago influence is consistent with the fact that one of the most successful empirical strategies in recent years has been to apply traditional economic ideas in new applications, an area in which Chicago’s theorists have been at the forefront. It is worth noting that neither Lucas nor Hersh Shefrin, whose works are mostly in finance, would be considered traditional micro theorists. Interestingly, three non- economists also make the list. Two of these are psychologists who have influenced behavioral economics (Daniel Kahneman and Amos Tversky). William J. Wilson, a sociologist, rounds out the list, with all of his citations for his influential book Wilson (1987). Although Table 1 emphasizes the fact that there are a handful of theorists who have exerted a great influence on empirical research, we find it surprising how little concentration there is among the particular theory papers cited. There are a total of approximately 550 cites to motivating theory in our data set. Only four papers or books receive four or more cites (George Baker 1992, Edward Glaeser, Bruce Sacerdote, and
  • 9. Jose Scheinkman 1996, Lucas 1988, Wilson 1997). There are nine papers that receive three cites, 37 papers that receive two cites, leaving over 400 papers that are cited exactly once. Conclusion The statistical analysis above, while shedding some light on the issues, can of course provide only a partial view of the influence of theory on empirical economics. Empirical models rely on some common economic “culture,” many ingredients of which are often directly borrowed from theory. Works measuring the return to education may not quote the source of the notion of human capital; still, this is a purely theoretical concept, and possibly one of the most important insights of modern economic theory. Most papers in empirical IO and other fields use such equilibrium concepts as Nash, subgame perfection or sequentiality without explicitly giving credit to their inventor; and the main spirit of general equilibrium is present in several empirical contributions which are not explicitly aimed at testing GE theory. Unusually successful innovations tend to enter economists’ toolbox without explicit reference to their author. Ironically, not being cited may thus be the ultimate sign of intellectual influence.
  • 10. Table 1: Theorists Most Often Cited as Motivating Empirical Microeconomic Research Among papers published in AER, JPE,and QJE, 1999-2001 Theorist Number of citations Gary Becker 15 Bengt Holmstrom 10 Paul Milgrom 10 Joseph Stiglitz 8 Roland Benabou 8 Robert Lucas 7 Daniel Kahneman and Amos Tversky 6 Sherwin Rosen 6 George Stigler 6 George Akelof 5 Kenneth Arrow 5 George Baker 5 Boyan Jovanovic 5 Hersh Shefrin 5 William Julius Wilson 5 Notes: Number of citations refers to the total number of empirical microeconomics papers published in AER, JPE, or QJE during the period 1999-2001 which list the work of the named author as a key motivating cite in the empirical research. Self-citations and citations in a single empirical paper to multiple theory papers by the same author are not included. The total number of empirical microeconomics papers in the data base is 149.
  • 11. References Baker, George. “Incentive Contracts and Performance Measurement.” Journal of Political Economy, 1992, 100 (XXX), pp. 598-614. Chiappori, Pierre-Andre, Timothy Groseclose, and Steven Levitt. ““A Test of Mixed Strategy Equilibria: Penalty Kicks in Soccer.” American Economic Review, v92 (September 2002): 1138-1151. Glaeser, Edward; Sacerdote, Bruce and Scheinkman, Jose. “Crime and Social Interactions.” Quarterly Journal of Economics, 1996, XXX (2), pp. 507-548. Holmstrom, Bengt and Milgrom, Paul. “Multitask Principal-Agent Analyses: Incentive Contracts, Asset Ownership, and Job Design.” Journal of Law, Economics, and Organization, 1991, 7 (1), pp. 24-52. Lucas, Robert. “On the Mechanics of Economic Development.” Journal of Monetary Economics, 1988, 22 (1), pp. 3-42. Milgrom, Paul and Weber, Robert. “A Theory of Auctions and Competitive Bidding.” Econometrica, 1982, 50 (September), pp. 1089-1122. Rothschild, Michael and Stiglitz, Joseph. “Equilibrium in Competitive Insurance Markets: An Essay on the Economics of Imperfect Information.” Quarterly Journal of Economics, 1976, 90 (Novermber), pp. 629-649. Wilson, William Julius. The Truly Disadvantaged: The Inner City, the Underclass, and Public Policy. Chicago: University of Chicago Press, 1987.
  • 12. Theoretical and empirical micro papers by field (%) 0 5 10 15 20 25 30 35 40 45 P r i c e t h e o r y A p p l i c a t i o n I n f o r m a t i o n B e h a v i o r a l G a m e G e n e r a l e q u i l i b r i u m Theoretical Empirical Figure 1
  • 13. Number of main cites per decade of publication of cited article 0 50 100 150 200 250 300 350 30 40 50 60 70 80 90 Figure 2
  • 14. Endnotes 1 Empirical micro papers represent slightly more than half of the papers published in Quarterly Journal of Economics, 46 percent of papers in Journal of Political Economy, but only 25 percent of the papers in American Economic Review. 2 As one might imagine, there is a great deal of judgment involved in this categorization. Like sausage- making, one may prefer not to know precisely what goes into the final product. For those who are interested, however, the full database and classifications are available on request from the authors. 3 The typical empirical paper in our sample has one paragraph, usually in the introduction, which discusses the theoretical foundation of the work. Only papers cited in this manner are included. 4 The most common empirical test of information theory addresses issues of contracting within the firm. There are also papers on auctions (3), insurance markets (2), statistical discrimination (2), as well as single papers on a number of other topics. 5 Including laboratory experiments would have little impact on the conclusions regarding empirical tests of game theory. Only one of the eleven laboratory experiments published were explicit tests of game theory. Five of the lab experiments were classified as behavioral economics, three as information, and two as price theory. 6 An obvious example is the explosion of empirical works devoted to insurance data: clearly, the availability of large, high-quality data sets is a recent phenomenon. 7 The heavy representation of Chicago economists is not an artifact of including Journal of Political Economy in the data base. The leading Chicago economists are only slightly more likely to be cited in Journal of Political Economy papers than they are in American Economic Review or Quarterly Journal of Economics.