SlideShare a Scribd company logo
1 of 18
PP 3
STEP TWO: ASSEMBLE SOME EVIDENCE
• All of your time doing a policy analysis is spent on two activities:
thinking and hustling data that can be turned into evidence.
• There is high constraint of time. Therefore, economize on your data
collection activities. The key to economizing is this: try to collect only
those data that can be turned into “information” that, in turn, can be
converted into “evidence” that has some bearing on your problem.
• Some definitions: Data are facts—or, some might say,
representations of facts—about the world. Data include all sorts of
statistics but go well beyond statistics, too.
• Information consists of data that have “meaning,” in the sense that
they can help you sort the world into different logical or empirical
categories.
• Evidence is information that affects the existing beliefs of important
people (including yourself) about significant features of the problem
you are studying and how it might be solved or mitigated.
• You need evidence for three principal purposes.
• One purpose is to assess the nature and extent of the problem(s) you
are trying to define.
• A second is to assess the particular features of the concrete policy
situation you are engaged in studying. For instance, you may need to
know recent budget figures, demographic changes in a service area,
the political ideology of the agency chief
• The third purpose is to assess policies that have been thought, by at
least some people, to have worked effectively in situations apparently
similar to your own, in other jurisdictions, perhaps, or at other times.
• Think Before You Collect:
• Thinking and collecting data are complementary activities.
• The principal—and exceedingly common—mistake made by
beginners and veterans alike is to spend time collecting data that
have little or no potential to be developed into evidence concerning
anything you actually care about. People often do this because
running around collecting data looks and feels productive, whereas
first-rate thinking is hard.
• The value of evidence. Since most evidence is costly to produce, you must
weigh its likely cost against its likely value.
• In general, the value of any piece of evidence depends on these factors:
• • The likelihood that it will cause you to substitute some better decision for
whatever decision you would have made without it
• • The likelihood that the substituted decision will, directly or indirectly,
produce a better policy outcome than the outcome that would have been
produced by the original decision
• • The magnitude of the difference in value between the likely-to-be-
improved outcome and the original outcome
• The utility of an educated guess:
• It is surprising how well you can do in many cases by gathering no
evidence at all but simply by sitting down and thinking something
through and then making some serious educated guesses.
• A helpful check on your thinking, to avoid collecting useless data, is to
ask yourself the following questions before embarking on some data
collection venture:
• • “Suppose the data turn out to look like so-and-so as opposed to
thus-and-such. What implication would that have for my
understanding of how to solve this problem?”
• • “Compared to my best guess about how the data will look once I’ve
got them, how different might they look if I actually took the trouble
to get them?”
• • “How much is it worth to me to confirm the actual difference
between what I can guess and what I can learn about the world by
really getting the data?”
• It is this sort of critical attitude about the value of expensive data
collection (especially ad hoc surveys!) that often leads good and
experienced policy analysts to make do with back-of-the-envelope
estimates. However, none of this reasoning is meant to be an excuse
for shirking the job of getting good data—
• Review the Available Literature
• There hardly exists a problem on whose causes and solutions some
academic discipline or professional association is not doing research.
It is easy to find journals and various professional publications
disseminating research results, theories, case studies, the musings of
experienced practitioners, and so on. The Internet brings much of this
literature to your desktop.
• Survey “Best Practices”
• The chances are good that the problem you are studying is not
unique, and that policymakers and public managers in other
jurisdictions, perhaps not very different from the one you are
studying, have already dealt with it in some fashion. See if you can
track down some of these past solutions and extrapolate them to the
situation you are studying.
• Use Analogies
• Sometimes it pays to gather data about things that, on the surface,
seem quite unlike the problem you are studying but, on a deeper
level, show similarities. For instance, your understanding of how a
merit pay plan for compensating managers in the public sector might
work could perhaps be improved by seeing how similar schemes work
in the private sector.
• As this examples suggests, some analogies are easier to perceive, and
to make sense of, than others. It takes a little imagination to see an
analogy and, occasionally, a little daring to try to convince others to
recognize both its usefulness and its inevitable limitations
• Start Early
• You are often dependent on the very busy schedules of other people
whom you ask to furnish information or to make time for an
interview. It is extremely important to submit requests for
information—and especially for interviews—well in advance of when
you want to have completed the data collection.
• Touch Base, Gain Credibility, Broker Consensus
• The process of assembling evidence inevitably has a political as well
as a purely analytic purpose. Sometimes it entails touching base with
potential critics of your work so that they will not be able to complain
later that you have ignored their perspectives. Conversely, by making
yourself known to potential supporters of your work, you may be able
to create a cadre of defenders.
• A more complex objective, where appropriate, might be to blend
policy analysis with the process of improving a policy idea or decision
during the course of implementation. This objective entails obtaining
feedback from participants, usually in an iterative process, and
sharing some of your own reactions with them. You thereby become
more of a partner in the process than an outside observer and
diagnostician. An even more complex and challenging role would be
for you to become a particular type of “partner,” a facilitator and
broker, whether by acting as a conduit from one person to another or
by convening meetings and other gatherings.
• Free the Captive Mind
• In exchange for access to data and a ready-made worldview,
researchers sometimes uncritically accept problem definitions and
preferred solutions from kindly informants (not to mention from
paying clients or employers). To counter such temptations, be sure to
make contact with individuals or factions whom you would expect to
disagree—the more sharply the better—with those informants. A
time-saving, but only partial, substitute is to ask your kindly
informants, “Who might object strongly to your point of view about
this, and why might they do so?”

More Related Content

What's hot

Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?Michael McKeon
 
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...Edmund Chattoe-Brown
 
Towards Institutional System Farming
Towards Institutional System FarmingTowards Institutional System Farming
Towards Institutional System FarmingBruce Edmonds
 
Behavioural economics in Financial Services: Perspectives and Prospects
Behavioural economics in Financial Services: Perspectives and Prospects Behavioural economics in Financial Services: Perspectives and Prospects
Behavioural economics in Financial Services: Perspectives and Prospects Eversheds Sutherland
 
Automated decision making with predictive applications – Big Data Frankfurt
Automated decision making with predictive applications – Big Data FrankfurtAutomated decision making with predictive applications – Big Data Frankfurt
Automated decision making with predictive applications – Big Data FrankfurtLars Trieloff
 
Automated decision making using Predictive Applications – Big Data Paris
Automated decision making using Predictive Applications – Big Data ParisAutomated decision making using Predictive Applications – Big Data Paris
Automated decision making using Predictive Applications – Big Data ParisLars Trieloff
 
Automated Decision making with Predictive Applications – Big Data Hamburg
Automated Decision making with Predictive Applications – Big Data HamburgAutomated Decision making with Predictive Applications – Big Data Hamburg
Automated Decision making with Predictive Applications – Big Data HamburgLars Trieloff
 
Heuristics, Anchoring & Narrowing Choice
Heuristics, Anchoring & Narrowing ChoiceHeuristics, Anchoring & Narrowing Choice
Heuristics, Anchoring & Narrowing Choicemilfamln
 
Personal Finance for Engineers (AirBnB 2013)
Personal Finance for Engineers (AirBnB 2013)Personal Finance for Engineers (AirBnB 2013)
Personal Finance for Engineers (AirBnB 2013)Adam Nash
 
Heuristics, bias and critical thinking in testing distribution
Heuristics, bias and critical thinking in testing   distributionHeuristics, bias and critical thinking in testing   distribution
Heuristics, bias and critical thinking in testing distributionMatt Mansell
 
Max Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science MeetupMax Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science Meetupmortardata
 
anchoring-heuristic Decision Making
anchoring-heuristic Decision Makinganchoring-heuristic Decision Making
anchoring-heuristic Decision MakingÖzkan Özer
 
Personal Finance for Engineers (Github 2014)
Personal Finance for Engineers (Github 2014)Personal Finance for Engineers (Github 2014)
Personal Finance for Engineers (Github 2014)Adam Nash
 
Week 12 - Public Policy
Week 12 - Public PolicyWeek 12 - Public Policy
Week 12 - Public PolicyRyan Lee
 

What's hot (20)

Pp 4(a)
Pp 4(a)Pp 4(a)
Pp 4(a)
 
Relationship Forecasting
Relationship ForecastingRelationship Forecasting
Relationship Forecasting
 
Production operations management
Production operations managementProduction operations management
Production operations management
 
Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?Maximising Capital Investments - is guesswork eroding your bottomline?
Maximising Capital Investments - is guesswork eroding your bottomline?
 
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...
The Social Transmission of Choice: An Exploratory Computer Simulation with Ap...
 
Stephen cresswell risk are we missing a trick - 25th june
Stephen cresswell   risk are we missing a trick - 25th juneStephen cresswell   risk are we missing a trick - 25th june
Stephen cresswell risk are we missing a trick - 25th june
 
Towards Institutional System Farming
Towards Institutional System FarmingTowards Institutional System Farming
Towards Institutional System Farming
 
Behavioural economics in Financial Services: Perspectives and Prospects
Behavioural economics in Financial Services: Perspectives and Prospects Behavioural economics in Financial Services: Perspectives and Prospects
Behavioural economics in Financial Services: Perspectives and Prospects
 
Automated decision making with predictive applications – Big Data Frankfurt
Automated decision making with predictive applications – Big Data FrankfurtAutomated decision making with predictive applications – Big Data Frankfurt
Automated decision making with predictive applications – Big Data Frankfurt
 
Automated decision making using Predictive Applications – Big Data Paris
Automated decision making using Predictive Applications – Big Data ParisAutomated decision making using Predictive Applications – Big Data Paris
Automated decision making using Predictive Applications – Big Data Paris
 
Automated Decision making with Predictive Applications – Big Data Hamburg
Automated Decision making with Predictive Applications – Big Data HamburgAutomated Decision making with Predictive Applications – Big Data Hamburg
Automated Decision making with Predictive Applications – Big Data Hamburg
 
Heuristics, Anchoring & Narrowing Choice
Heuristics, Anchoring & Narrowing ChoiceHeuristics, Anchoring & Narrowing Choice
Heuristics, Anchoring & Narrowing Choice
 
Personal Finance for Engineers (AirBnB 2013)
Personal Finance for Engineers (AirBnB 2013)Personal Finance for Engineers (AirBnB 2013)
Personal Finance for Engineers (AirBnB 2013)
 
Heuristics, bias and critical thinking in testing distribution
Heuristics, bias and critical thinking in testing   distributionHeuristics, bias and critical thinking in testing   distribution
Heuristics, bias and critical thinking in testing distribution
 
Max Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science MeetupMax Shron, Thinking with Data at the NYC Data Science Meetup
Max Shron, Thinking with Data at the NYC Data Science Meetup
 
anchoring-heuristic Decision Making
anchoring-heuristic Decision Makinganchoring-heuristic Decision Making
anchoring-heuristic Decision Making
 
Signal and noise
Signal and noiseSignal and noise
Signal and noise
 
Personal Finance for Engineers (Github 2014)
Personal Finance for Engineers (Github 2014)Personal Finance for Engineers (Github 2014)
Personal Finance for Engineers (Github 2014)
 
Week 12 - Public Policy
Week 12 - Public PolicyWeek 12 - Public Policy
Week 12 - Public Policy
 
Presentation heuristics
Presentation heuristicsPresentation heuristics
Presentation heuristics
 

Similar to Pp 3

Research Theory Pro-Forma (1).pptx
Research Theory Pro-Forma (1).pptxResearch Theory Pro-Forma (1).pptx
Research Theory Pro-Forma (1).pptxAlexBaron17
 
Methods and techniques of data collection
Methods and techniques of data collection Methods and techniques of data collection
Methods and techniques of data collection ShibinSanal
 
Theory research pro-forma updated
Theory  research pro-forma updatedTheory  research pro-forma updated
Theory research pro-forma updatedLouis Dowson
 
Decision seminar slides dave litwiller - dec 2013
Decision seminar slides   dave litwiller - dec 2013Decision seminar slides   dave litwiller - dec 2013
Decision seminar slides dave litwiller - dec 2013Dave Litwiller
 
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Matt Stubbs
 
Analyzing Qualitative Data for_ Research
Analyzing Qualitative Data for_ ResearchAnalyzing Qualitative Data for_ Research
Analyzing Qualitative Data for_ ResearchNirmalPoudel4
 
Research Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxResearch Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxAlexBaron17
 
Research Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxResearch Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxAlexBaron17
 
Consumer research and in depth interview
Consumer research and in depth interviewConsumer research and in depth interview
Consumer research and in depth interviewYeshoda Bhargava
 
Theory research pro-forma
Theory  research pro-formaTheory  research pro-forma
Theory research pro-formabrettcollins26
 
Research Theory Pro-Forma-2 (1).pptx
Research Theory Pro-Forma-2 (1).pptxResearch Theory Pro-Forma-2 (1).pptx
Research Theory Pro-Forma-2 (1).pptxArchieDurham
 
Proposal & bibliography
Proposal & bibliographyProposal & bibliography
Proposal & bibliographyAmanda Preston
 
Theory research pro-forma
Theory  research pro-formaTheory  research pro-forma
Theory research pro-formaMedia Studies
 
Chapter 4&5 mr
Chapter 4&5   mrChapter 4&5   mr
Chapter 4&5 mrr2sa
 
Research questions and research design
Research questions and research design Research questions and research design
Research questions and research design Normative
 
What makes good research
What makes good research What makes good research
What makes good research CharityComms
 
Researching and Responding to Labour Relation Issues - October 21, 2013
Researching and Responding to Labour Relation Issues - October 21, 2013Researching and Responding to Labour Relation Issues - October 21, 2013
Researching and Responding to Labour Relation Issues - October 21, 2013Mireille Khoraych
 

Similar to Pp 3 (20)

Research Theory Pro-Forma (1).pptx
Research Theory Pro-Forma (1).pptxResearch Theory Pro-Forma (1).pptx
Research Theory Pro-Forma (1).pptx
 
Unit 2: Research.
Unit 2: Research.Unit 2: Research.
Unit 2: Research.
 
Methods and techniques of data collection
Methods and techniques of data collection Methods and techniques of data collection
Methods and techniques of data collection
 
Theory research pro-forma updated
Theory  research pro-forma updatedTheory  research pro-forma updated
Theory research pro-forma updated
 
Decision seminar slides dave litwiller - dec 2013
Decision seminar slides   dave litwiller - dec 2013Decision seminar slides   dave litwiller - dec 2013
Decision seminar slides dave litwiller - dec 2013
 
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
Big Data LDN 2017: Preserving The Key Principles Of Academic Research In A Bu...
 
Analyzing Qualitative Data for_ Research
Analyzing Qualitative Data for_ ResearchAnalyzing Qualitative Data for_ Research
Analyzing Qualitative Data for_ Research
 
Research Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxResearch Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptx
 
Research Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptxResearch Theory Pro-Forma (1) (1).pptx
Research Theory Pro-Forma (1) (1).pptx
 
Consumer Behavior Chapter 2
Consumer Behavior Chapter 2Consumer Behavior Chapter 2
Consumer Behavior Chapter 2
 
Consumer research and in depth interview
Consumer research and in depth interviewConsumer research and in depth interview
Consumer research and in depth interview
 
Theory research pro-forma
Theory  research pro-formaTheory  research pro-forma
Theory research pro-forma
 
Research Theory Pro-Forma-2 (1).pptx
Research Theory Pro-Forma-2 (1).pptxResearch Theory Pro-Forma-2 (1).pptx
Research Theory Pro-Forma-2 (1).pptx
 
Ch # 2 brm
Ch # 2 brmCh # 2 brm
Ch # 2 brm
 
Proposal & bibliography
Proposal & bibliographyProposal & bibliography
Proposal & bibliography
 
Theory research pro-forma
Theory  research pro-formaTheory  research pro-forma
Theory research pro-forma
 
Chapter 4&5 mr
Chapter 4&5   mrChapter 4&5   mr
Chapter 4&5 mr
 
Research questions and research design
Research questions and research design Research questions and research design
Research questions and research design
 
What makes good research
What makes good research What makes good research
What makes good research
 
Researching and Responding to Labour Relation Issues - October 21, 2013
Researching and Responding to Labour Relation Issues - October 21, 2013Researching and Responding to Labour Relation Issues - October 21, 2013
Researching and Responding to Labour Relation Issues - October 21, 2013
 

More from Zeeshan Murtaza Ali

Strategic management in the public sector
Strategic management in the public sectorStrategic management in the public sector
Strategic management in the public sectorZeeshan Murtaza Ali
 
Strategic planning and its methods and tools
Strategic planning and its methods and toolsStrategic planning and its methods and tools
Strategic planning and its methods and toolsZeeshan Murtaza Ali
 
Federal Structure of Pakistan Government
Federal Structure of Pakistan GovernmentFederal Structure of Pakistan Government
Federal Structure of Pakistan GovernmentZeeshan Murtaza Ali
 
Contitutional development in Pakistan
Contitutional development in PakistanContitutional development in Pakistan
Contitutional development in PakistanZeeshan Murtaza Ali
 
Why constitution is so important
Why constitution is so importantWhy constitution is so important
Why constitution is so importantZeeshan Murtaza Ali
 
effective communication ,Seven cs
effective communication ,Seven cseffective communication ,Seven cs
effective communication ,Seven csZeeshan Murtaza Ali
 
History of public administration in pakistan
History of public administration in pakistanHistory of public administration in pakistan
History of public administration in pakistanZeeshan Murtaza Ali
 
Public Administration in Pakistan
Public Administration in PakistanPublic Administration in Pakistan
Public Administration in PakistanZeeshan Murtaza Ali
 
Failure of Succession Planning by Zeeshan Khan
Failure of Succession Planning by Zeeshan KhanFailure of Succession Planning by Zeeshan Khan
Failure of Succession Planning by Zeeshan KhanZeeshan Murtaza Ali
 
Financial Reporting Quality and Investment Efficiency
Financial Reporting Quality and Investment EfficiencyFinancial Reporting Quality and Investment Efficiency
Financial Reporting Quality and Investment EfficiencyZeeshan Murtaza Ali
 

More from Zeeshan Murtaza Ali (18)

Pp 1
Pp  1Pp  1
Pp 1
 
Strategic management in the public sector
Strategic management in the public sectorStrategic management in the public sector
Strategic management in the public sector
 
Strategic planning and its methods and tools
Strategic planning and its methods and toolsStrategic planning and its methods and tools
Strategic planning and its methods and tools
 
Practice of Public Relation
Practice of Public RelationPractice of Public Relation
Practice of Public Relation
 
Market forces supply and demand
Market forces supply and demandMarket forces supply and demand
Market forces supply and demand
 
Economics and its Principles
Economics and its PrinciplesEconomics and its Principles
Economics and its Principles
 
Federal Structure of Pakistan Government
Federal Structure of Pakistan GovernmentFederal Structure of Pakistan Government
Federal Structure of Pakistan Government
 
Contitutional development in Pakistan
Contitutional development in PakistanContitutional development in Pakistan
Contitutional development in Pakistan
 
Why constitution is so important
Why constitution is so importantWhy constitution is so important
Why constitution is so important
 
The judicial system of Pakistan
The judicial system of PakistanThe judicial system of Pakistan
The judicial system of Pakistan
 
Writing a memorandum
Writing a memorandumWriting a memorandum
Writing a memorandum
 
Business Letter writing
Business Letter writingBusiness Letter writing
Business Letter writing
 
effective communication ,Seven cs
effective communication ,Seven cseffective communication ,Seven cs
effective communication ,Seven cs
 
History of public administration in pakistan
History of public administration in pakistanHistory of public administration in pakistan
History of public administration in pakistan
 
Public Administration
Public AdministrationPublic Administration
Public Administration
 
Public Administration in Pakistan
Public Administration in PakistanPublic Administration in Pakistan
Public Administration in Pakistan
 
Failure of Succession Planning by Zeeshan Khan
Failure of Succession Planning by Zeeshan KhanFailure of Succession Planning by Zeeshan Khan
Failure of Succession Planning by Zeeshan Khan
 
Financial Reporting Quality and Investment Efficiency
Financial Reporting Quality and Investment EfficiencyFinancial Reporting Quality and Investment Efficiency
Financial Reporting Quality and Investment Efficiency
 

Recently uploaded

VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...
VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...
VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...Garima Khatri
 
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...Suhani Kapoor
 
Panet vs.Plastics - Earth Day 2024 - 22 APRIL
Panet vs.Plastics - Earth Day 2024 - 22 APRILPanet vs.Plastics - Earth Day 2024 - 22 APRIL
Panet vs.Plastics - Earth Day 2024 - 22 APRILChristina Parmionova
 
Action Toolkit - Earth Day 2024 - April 22nd.
Action Toolkit - Earth Day 2024 - April 22nd.Action Toolkit - Earth Day 2024 - April 22nd.
Action Toolkit - Earth Day 2024 - April 22nd.Christina Parmionova
 
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...ResolutionFoundation
 
Earth Day 2024 - AMC "COMMON GROUND'' movie night.
Earth Day 2024 - AMC "COMMON GROUND'' movie night.Earth Day 2024 - AMC "COMMON GROUND'' movie night.
Earth Day 2024 - AMC "COMMON GROUND'' movie night.Christina Parmionova
 
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urges
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual UrgesCall Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urges
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urgesnarwatsonia7
 
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...“Exploring the world: One page turn at a time.” World Book and Copyright Day ...
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...Christina Parmionova
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfyalehistoricalreview
 
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...ankitnayak356677
 
Precarious profits? Why firms use insecure contracts, and what would change t...
Precarious profits? Why firms use insecure contracts, and what would change t...Precarious profits? Why firms use insecure contracts, and what would change t...
Precarious profits? Why firms use insecure contracts, and what would change t...ResolutionFoundation
 
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service BangaloreCall Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalorenarwatsonia7
 
DNV publication: China Energy Transition Outlook 2024
DNV publication: China Energy Transition Outlook 2024DNV publication: China Energy Transition Outlook 2024
DNV publication: China Energy Transition Outlook 2024Energy for One World
 
Club of Rome: Eco-nomics for an Ecological Civilization
Club of Rome: Eco-nomics for an Ecological CivilizationClub of Rome: Eco-nomics for an Ecological Civilization
Club of Rome: Eco-nomics for an Ecological CivilizationEnergy for One World
 
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile Service
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile ServiceCunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile Service
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile ServiceHigh Profile Call Girls
 
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012rehmti665
 
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...narwatsonia7
 

Recently uploaded (20)

VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...
VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...
VIP Mumbai Call Girls Andheri West Just Call 9920874524 with A/C Room Cash on...
 
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...
VIP High Profile Call Girls Gorakhpur Aarushi 8250192130 Independent Escort S...
 
Panet vs.Plastics - Earth Day 2024 - 22 APRIL
Panet vs.Plastics - Earth Day 2024 - 22 APRILPanet vs.Plastics - Earth Day 2024 - 22 APRIL
Panet vs.Plastics - Earth Day 2024 - 22 APRIL
 
Action Toolkit - Earth Day 2024 - April 22nd.
Action Toolkit - Earth Day 2024 - April 22nd.Action Toolkit - Earth Day 2024 - April 22nd.
Action Toolkit - Earth Day 2024 - April 22nd.
 
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...Powering Britain: Can we decarbonise electricity without disadvantaging poore...
Powering Britain: Can we decarbonise electricity without disadvantaging poore...
 
Earth Day 2024 - AMC "COMMON GROUND'' movie night.
Earth Day 2024 - AMC "COMMON GROUND'' movie night.Earth Day 2024 - AMC "COMMON GROUND'' movie night.
Earth Day 2024 - AMC "COMMON GROUND'' movie night.
 
Call Girls Service Connaught Place @9999965857 Delhi 🫦 No Advance VVIP 🍎 SER...
Call Girls Service Connaught Place @9999965857 Delhi 🫦 No Advance  VVIP 🍎 SER...Call Girls Service Connaught Place @9999965857 Delhi 🫦 No Advance  VVIP 🍎 SER...
Call Girls Service Connaught Place @9999965857 Delhi 🫦 No Advance VVIP 🍎 SER...
 
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service
(ANIKA) Call Girls Wadki ( 7001035870 ) HI-Fi Pune Escorts Service
 
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urges
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual UrgesCall Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urges
Call Girl Benson Town - Phone No 7001305949 For Ultimate Sexual Urges
 
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...“Exploring the world: One page turn at a time.” World Book and Copyright Day ...
“Exploring the world: One page turn at a time.” World Book and Copyright Day ...
 
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdfYHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
YHR Fall 2023 Issue (Joseph Manning Interview) (2).pdf
 
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...
Greater Noida Call Girls 9711199012 WhatsApp No 24x7 Vip Escorts in Greater N...
 
Precarious profits? Why firms use insecure contracts, and what would change t...
Precarious profits? Why firms use insecure contracts, and what would change t...Precarious profits? Why firms use insecure contracts, and what would change t...
Precarious profits? Why firms use insecure contracts, and what would change t...
 
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service BangaloreCall Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
Call Girls Bangalore Saanvi 7001305949 Independent Escort Service Bangalore
 
DNV publication: China Energy Transition Outlook 2024
DNV publication: China Energy Transition Outlook 2024DNV publication: China Energy Transition Outlook 2024
DNV publication: China Energy Transition Outlook 2024
 
Club of Rome: Eco-nomics for an Ecological Civilization
Club of Rome: Eco-nomics for an Ecological CivilizationClub of Rome: Eco-nomics for an Ecological Civilization
Club of Rome: Eco-nomics for an Ecological Civilization
 
Call Girls In Rohini ꧁❤ 🔝 9953056974🔝❤꧂ Escort ServiCe
Call Girls In  Rohini ꧁❤ 🔝 9953056974🔝❤꧂ Escort ServiCeCall Girls In  Rohini ꧁❤ 🔝 9953056974🔝❤꧂ Escort ServiCe
Call Girls In Rohini ꧁❤ 🔝 9953056974🔝❤꧂ Escort ServiCe
 
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile Service
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile ServiceCunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile Service
Cunningham Road Call Girls Bangalore WhatsApp 8250192130 High Profile Service
 
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
Call Girls Connaught Place Delhi reach out to us at ☎ 9711199012
 
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
Premium Call Girls Btm Layout - 7001305949 Escorts Service with Real Photos a...
 

Pp 3

  • 1.
  • 3. STEP TWO: ASSEMBLE SOME EVIDENCE • All of your time doing a policy analysis is spent on two activities: thinking and hustling data that can be turned into evidence. • There is high constraint of time. Therefore, economize on your data collection activities. The key to economizing is this: try to collect only those data that can be turned into “information” that, in turn, can be converted into “evidence” that has some bearing on your problem.
  • 4. • Some definitions: Data are facts—or, some might say, representations of facts—about the world. Data include all sorts of statistics but go well beyond statistics, too. • Information consists of data that have “meaning,” in the sense that they can help you sort the world into different logical or empirical categories.
  • 5. • Evidence is information that affects the existing beliefs of important people (including yourself) about significant features of the problem you are studying and how it might be solved or mitigated.
  • 6. • You need evidence for three principal purposes. • One purpose is to assess the nature and extent of the problem(s) you are trying to define. • A second is to assess the particular features of the concrete policy situation you are engaged in studying. For instance, you may need to know recent budget figures, demographic changes in a service area, the political ideology of the agency chief • The third purpose is to assess policies that have been thought, by at least some people, to have worked effectively in situations apparently similar to your own, in other jurisdictions, perhaps, or at other times.
  • 7. • Think Before You Collect: • Thinking and collecting data are complementary activities. • The principal—and exceedingly common—mistake made by beginners and veterans alike is to spend time collecting data that have little or no potential to be developed into evidence concerning anything you actually care about. People often do this because running around collecting data looks and feels productive, whereas first-rate thinking is hard.
  • 8. • The value of evidence. Since most evidence is costly to produce, you must weigh its likely cost against its likely value. • In general, the value of any piece of evidence depends on these factors: • • The likelihood that it will cause you to substitute some better decision for whatever decision you would have made without it • • The likelihood that the substituted decision will, directly or indirectly, produce a better policy outcome than the outcome that would have been produced by the original decision • • The magnitude of the difference in value between the likely-to-be- improved outcome and the original outcome
  • 9. • The utility of an educated guess: • It is surprising how well you can do in many cases by gathering no evidence at all but simply by sitting down and thinking something through and then making some serious educated guesses. • A helpful check on your thinking, to avoid collecting useless data, is to ask yourself the following questions before embarking on some data collection venture: • • “Suppose the data turn out to look like so-and-so as opposed to thus-and-such. What implication would that have for my understanding of how to solve this problem?”
  • 10. • • “Compared to my best guess about how the data will look once I’ve got them, how different might they look if I actually took the trouble to get them?” • • “How much is it worth to me to confirm the actual difference between what I can guess and what I can learn about the world by really getting the data?”
  • 11. • It is this sort of critical attitude about the value of expensive data collection (especially ad hoc surveys!) that often leads good and experienced policy analysts to make do with back-of-the-envelope estimates. However, none of this reasoning is meant to be an excuse for shirking the job of getting good data—
  • 12. • Review the Available Literature • There hardly exists a problem on whose causes and solutions some academic discipline or professional association is not doing research. It is easy to find journals and various professional publications disseminating research results, theories, case studies, the musings of experienced practitioners, and so on. The Internet brings much of this literature to your desktop.
  • 13. • Survey “Best Practices” • The chances are good that the problem you are studying is not unique, and that policymakers and public managers in other jurisdictions, perhaps not very different from the one you are studying, have already dealt with it in some fashion. See if you can track down some of these past solutions and extrapolate them to the situation you are studying.
  • 14. • Use Analogies • Sometimes it pays to gather data about things that, on the surface, seem quite unlike the problem you are studying but, on a deeper level, show similarities. For instance, your understanding of how a merit pay plan for compensating managers in the public sector might work could perhaps be improved by seeing how similar schemes work in the private sector. • As this examples suggests, some analogies are easier to perceive, and to make sense of, than others. It takes a little imagination to see an analogy and, occasionally, a little daring to try to convince others to recognize both its usefulness and its inevitable limitations
  • 15. • Start Early • You are often dependent on the very busy schedules of other people whom you ask to furnish information or to make time for an interview. It is extremely important to submit requests for information—and especially for interviews—well in advance of when you want to have completed the data collection.
  • 16. • Touch Base, Gain Credibility, Broker Consensus • The process of assembling evidence inevitably has a political as well as a purely analytic purpose. Sometimes it entails touching base with potential critics of your work so that they will not be able to complain later that you have ignored their perspectives. Conversely, by making yourself known to potential supporters of your work, you may be able to create a cadre of defenders.
  • 17. • A more complex objective, where appropriate, might be to blend policy analysis with the process of improving a policy idea or decision during the course of implementation. This objective entails obtaining feedback from participants, usually in an iterative process, and sharing some of your own reactions with them. You thereby become more of a partner in the process than an outside observer and diagnostician. An even more complex and challenging role would be for you to become a particular type of “partner,” a facilitator and broker, whether by acting as a conduit from one person to another or by convening meetings and other gatherings.
  • 18. • Free the Captive Mind • In exchange for access to data and a ready-made worldview, researchers sometimes uncritically accept problem definitions and preferred solutions from kindly informants (not to mention from paying clients or employers). To counter such temptations, be sure to make contact with individuals or factions whom you would expect to disagree—the more sharply the better—with those informants. A time-saving, but only partial, substitute is to ask your kindly informants, “Who might object strongly to your point of view about this, and why might they do so?”