SlideShare a Scribd company logo
1 of 20
Download to read offline
Statistics in the Newsroom
(Part Deux)

Steven Rich
The Washington Post
@dataeditor
P-values
• Statistical significance
• Probability
• Significance levels
– .05
– .01

• Observed result no impossible
– Just highly unlikely
T-tests
• The t-test is used to test hypotheses
about means when the population
variance is unknown (the usual case).
• Developed by Gossett for the quality
control of beer.
• Comes in 3 varieties:
• Single sample, independent samples,
and dependent samples.
T-tests
• Single sample t – we have only 1
group; want to test against a
hypothetical mean.
• Independent samples t – we have 2
means, 2 groups; no relation between
groups, e.g., people randomly
assigned to a single group.
• Dependent t – we have two means.
Either same people in both groups, or
people are related, e.g., husband-
ANOVA
• Collection of methods
• Analyze differences between group
means
• Generalizes the T-test to more than
two groups
• Within vs. Between groups
ANOVA
Fisher’s Exact Test
Fisher’s Exact Test
• Gives exact P-value
• Great for categorical data
• Great for small sample sizes
Linear Regression
y=mx+b
• x – independent variable
• y – dependent variable
• m – slope
• b – y intercept
R-Square
R-Square tells you how much the IV predicts
the DV

86.5 percent of the variation in hat
size is explained by arrival order
Logistic Regression
• Your variable isn’t always continuous
• Gender
• Race
• “Binary” data
Pearson’s Chi-Squared
• Osbserved vs. Expected
• Example: Tax lien auctions in DC
• Determine what a “regular” auction
might look like

– Consulted experts
– Looked at collusive and non-collusive
auctions in other jurisdictions
Regular
Irregular
What to do?
• We felt it would be lazy to just
describe the patterns
• We wanted to look how frequently the
irregular patterns occurred between
bidders
• Leader vs. Follower analysis
• Pearson’s Chi-Squared Test
Results
How to avoid mistakes
• Try to prove yourself wrong
• Run it by your targets
• Ask someone smarter than you
• Make sure you’re doing the correct
test
http://www.ats.ucla.edu/stat/sas/whats
tat/
Questions?
Rob Barry
Wall Street Journal
@rob_barry
Steven Rich
The Washington Post
@dataeditor

More Related Content

Similar to #NICAR14 Stats in the Newsroom Part Deux

7- Quantitative Research- Part 3.pdf
7- Quantitative Research- Part 3.pdf7- Quantitative Research- Part 3.pdf
7- Quantitative Research- Part 3.pdf
ezaldeen2013
 
Research method ch07 statistical methods 1
Research method ch07 statistical methods 1Research method ch07 statistical methods 1
Research method ch07 statistical methods 1
naranbatn
 

Similar to #NICAR14 Stats in the Newsroom Part Deux (20)

7- Quantitative Research- Part 3.pdf
7- Quantitative Research- Part 3.pdf7- Quantitative Research- Part 3.pdf
7- Quantitative Research- Part 3.pdf
 
Qm 0809
Qm 0809 Qm 0809
Qm 0809
 
Analysis 101
Analysis 101Analysis 101
Analysis 101
 
Stats - Intro to Quantitative
Stats -  Intro to Quantitative Stats -  Intro to Quantitative
Stats - Intro to Quantitative
 
Statistics using SPSS
Statistics using SPSSStatistics using SPSS
Statistics using SPSS
 
Some statistical concepts relevant to proteomics data analysis
Some statistical concepts relevant to proteomics data analysisSome statistical concepts relevant to proteomics data analysis
Some statistical concepts relevant to proteomics data analysis
 
BIOSTATISTICS.pptx
BIOSTATISTICS.pptxBIOSTATISTICS.pptx
BIOSTATISTICS.pptx
 
Summary of statistical tools used in spss
Summary of statistical tools used in spssSummary of statistical tools used in spss
Summary of statistical tools used in spss
 
Measurement
MeasurementMeasurement
Measurement
 
IV STATISTICS I.pdf
IV STATISTICS I.pdfIV STATISTICS I.pdf
IV STATISTICS I.pdf
 
Basic Statistical Concepts.pdf
Basic Statistical Concepts.pdfBasic Statistical Concepts.pdf
Basic Statistical Concepts.pdf
 
Lecture 2 What is Statistics, Anyway
Lecture 2 What is Statistics, AnywayLecture 2 What is Statistics, Anyway
Lecture 2 What is Statistics, Anyway
 
Inferential Statistics
Inferential StatisticsInferential Statistics
Inferential Statistics
 
Introduction to basics of bio statistics.
Introduction to basics of bio statistics.Introduction to basics of bio statistics.
Introduction to basics of bio statistics.
 
Introduction to Data Management in Human Ecology
Introduction to Data Management in Human EcologyIntroduction to Data Management in Human Ecology
Introduction to Data Management in Human Ecology
 
Survey Methods - OIISDP 2015
Survey Methods - OIISDP 2015Survey Methods - OIISDP 2015
Survey Methods - OIISDP 2015
 
20151120221133 how to analyze survey research data
20151120221133 how to analyze survey research data20151120221133 how to analyze survey research data
20151120221133 how to analyze survey research data
 
Common Statistical Terms - Biostatistics - Ravinandan A P.pdf
Common Statistical Terms - Biostatistics - Ravinandan A P.pdfCommon Statistical Terms - Biostatistics - Ravinandan A P.pdf
Common Statistical Terms - Biostatistics - Ravinandan A P.pdf
 
chi_square test.pptx
chi_square test.pptxchi_square test.pptx
chi_square test.pptx
 
Research method ch07 statistical methods 1
Research method ch07 statistical methods 1Research method ch07 statistical methods 1
Research method ch07 statistical methods 1
 

Recently uploaded

call girls inMahavir Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls inMahavir Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7call girls inMahavir Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls inMahavir Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
The political system of the united kingdom
The political system of the united kingdomThe political system of the united kingdom
The political system of the united kingdom
lunadelior
 

Recently uploaded (17)

America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
America Is the Target; Israel Is the Front Line _ Andy Blumenthal _ The Blogs...
 
06052024_First India Newspaper Jaipur.pdf
06052024_First India Newspaper Jaipur.pdf06052024_First India Newspaper Jaipur.pdf
06052024_First India Newspaper Jaipur.pdf
 
422524114-Patriarchy-Kamla-Bhasin gg.pdf
422524114-Patriarchy-Kamla-Bhasin gg.pdf422524114-Patriarchy-Kamla-Bhasin gg.pdf
422524114-Patriarchy-Kamla-Bhasin gg.pdf
 
Politician uddhav thackeray biography- Full Details
Politician uddhav thackeray biography- Full DetailsPolitician uddhav thackeray biography- Full Details
Politician uddhav thackeray biography- Full Details
 
10052024_First India Newspaper Jaipur.pdf
10052024_First India Newspaper Jaipur.pdf10052024_First India Newspaper Jaipur.pdf
10052024_First India Newspaper Jaipur.pdf
 
Dubai Call Girls Pinky O525547819 Call Girl's In Dubai
Dubai Call Girls Pinky O525547819 Call Girl's In DubaiDubai Call Girls Pinky O525547819 Call Girl's In Dubai
Dubai Call Girls Pinky O525547819 Call Girl's In Dubai
 
call girls inMahavir Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls inMahavir Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7call girls inMahavir Nagar  (delhi) call me [🔝9953056974🔝] escort service 24X7
call girls inMahavir Nagar (delhi) call me [🔝9953056974🔝] escort service 24X7
 
Job-Oriеntеd Courses That Will Boost Your Career in 2024
Job-Oriеntеd Courses That Will Boost Your Career in 2024Job-Oriеntеd Courses That Will Boost Your Career in 2024
Job-Oriеntеd Courses That Will Boost Your Career in 2024
 
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
9953056974 Call Girls In Pratap Nagar, Escorts (Delhi) NCR
 
Unveiling the Characteristics of Political Institutions_ A Comprehensive Anal...
Unveiling the Characteristics of Political Institutions_ A Comprehensive Anal...Unveiling the Characteristics of Political Institutions_ A Comprehensive Anal...
Unveiling the Characteristics of Political Institutions_ A Comprehensive Anal...
 
declarationleaders_sd_re_greens_theleft_5.pdf
declarationleaders_sd_re_greens_theleft_5.pdfdeclarationleaders_sd_re_greens_theleft_5.pdf
declarationleaders_sd_re_greens_theleft_5.pdf
 
05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdf05052024_First India Newspaper Jaipur.pdf
05052024_First India Newspaper Jaipur.pdf
 
11052024_First India Newspaper Jaipur.pdf
11052024_First India Newspaper Jaipur.pdf11052024_First India Newspaper Jaipur.pdf
11052024_First India Newspaper Jaipur.pdf
 
The political system of the united kingdom
The political system of the united kingdomThe political system of the united kingdom
The political system of the united kingdom
 
KING VISHNU BHAGWANON KA BHAGWAN PARAMATMONKA PARATOMIC PARAMANU KASARVAMANVA...
KING VISHNU BHAGWANON KA BHAGWAN PARAMATMONKA PARATOMIC PARAMANU KASARVAMANVA...KING VISHNU BHAGWANON KA BHAGWAN PARAMATMONKA PARATOMIC PARAMANU KASARVAMANVA...
KING VISHNU BHAGWANON KA BHAGWAN PARAMATMONKA PARATOMIC PARAMANU KASARVAMANVA...
 
China's soft power in 21st century .pptx
China's soft power in 21st century   .pptxChina's soft power in 21st century   .pptx
China's soft power in 21st century .pptx
 
Indegene Limited IPO Detail - Divadhvik
Indegene Limited IPO Detail  - DivadhvikIndegene Limited IPO Detail  - Divadhvik
Indegene Limited IPO Detail - Divadhvik
 

#NICAR14 Stats in the Newsroom Part Deux

  • 1. Statistics in the Newsroom (Part Deux) Steven Rich The Washington Post @dataeditor
  • 2. P-values • Statistical significance • Probability • Significance levels – .05 – .01 • Observed result no impossible – Just highly unlikely
  • 3. T-tests • The t-test is used to test hypotheses about means when the population variance is unknown (the usual case). • Developed by Gossett for the quality control of beer. • Comes in 3 varieties: • Single sample, independent samples, and dependent samples.
  • 4. T-tests • Single sample t – we have only 1 group; want to test against a hypothetical mean. • Independent samples t – we have 2 means, 2 groups; no relation between groups, e.g., people randomly assigned to a single group. • Dependent t – we have two means. Either same people in both groups, or people are related, e.g., husband-
  • 5. ANOVA • Collection of methods • Analyze differences between group means • Generalizes the T-test to more than two groups • Within vs. Between groups
  • 8. Fisher’s Exact Test • Gives exact P-value • Great for categorical data • Great for small sample sizes
  • 10. y=mx+b • x – independent variable • y – dependent variable • m – slope • b – y intercept
  • 11. R-Square R-Square tells you how much the IV predicts the DV 86.5 percent of the variation in hat size is explained by arrival order
  • 12. Logistic Regression • Your variable isn’t always continuous • Gender • Race • “Binary” data
  • 13. Pearson’s Chi-Squared • Osbserved vs. Expected • Example: Tax lien auctions in DC • Determine what a “regular” auction might look like – Consulted experts – Looked at collusive and non-collusive auctions in other jurisdictions
  • 16. What to do? • We felt it would be lazy to just describe the patterns • We wanted to look how frequently the irregular patterns occurred between bidders • Leader vs. Follower analysis • Pearson’s Chi-Squared Test
  • 18. How to avoid mistakes • Try to prove yourself wrong • Run it by your targets • Ask someone smarter than you • Make sure you’re doing the correct test
  • 20. Questions? Rob Barry Wall Street Journal @rob_barry Steven Rich The Washington Post @dataeditor