More Statistics Andrew Martin PS 372 University of Kentucky
Inference Inference  refers to reasoning from available information or facts to reach a conclusion. However, there is no g...
Inference In statistical inference the estimated values of unknown population parameters are sometimes incorrect. Concerni...
Type I Error <ul><ul><li>Type I error  occurs whenever one rejects a true null hypothesis.  </li></ul></ul><ul><ul><li>Sup...
Type II Error <ul><li>Type II  error occurs whenever one fails to reject a false null hypothesis.  </li></ul><ul><li>Suppo...
What are the chances? <ul><ul><li>The probability of committing a type I error is the “size” of the critical region. It is...
 
Standard Error Imagine taking an endless number of independent samples of size N from a fixed population that has a mean o...
Standard Error The standard deviation of the sampling distribution is called the standard error of the mean, or  standard ...
Standard Error The expression implies that as the sample size gets larger and lagers, the standard error decreases in nume...
Binomial Distributions Binomial distributions can be used to show how probabilities can be used to assess the likelihood t...
Binomial Distribution Coin tosses are a perfect example, because you can specify tossing heads or tossing heads as an even...
 
Critical Regions and Values If we have established a critical region such that we will reject the null hypothesis at 0, 1,...
Critical Regions and Values On a practical level, the only way one would reject the null hypothesis (H 0 :  P  = .5) is if...
Critical Regions and Values In political science, the critical regions are typically referred to as levels. In other words...
Statistical Significance <ul><li>The three most common levels of significance in political science are .05, .01 and .001. ...
One- or Two-Sided Tests <ul><li>What if you suspect the null hypothesis is false? How would you go about formulating an al...
One- or Two-Sided Tests <ul><li>If testing a hypothesis theoretically suggests only upper or only lower values are relevan...
 
One-Tail Test (High Values)
One-tail Test (Low Values)
One- or Two-Sided Tests <ul><li>However, if I have to no reason to suspect large or small values of  P , then I should use...
 
What about real-world outcomes? <ul><li>We obviously do not live in a binomial world.  </li></ul><ul><li>Usually we have t...
Types of Distributions <ul><ul><li>Discrete probability distribution </li></ul></ul><ul><ul><li>Continuous probability dis...
Discrete vs. Continuous Distributions (Kmenta 1986) <ul><li>In  discrete probability distributions  the elements of sample...
Discrete Distribution
Continuous Distribution
Observed Test Statistic <ul><li>Observed test statistic =  </li></ul><ul><li>Sample estimate – hypothesized pop. parameter...
Observed Test Statistic <ul><ul><li>1. If the observed statistic's value is greater than or equal to the critical value, r...
Example of hypothesis testing Example: Someone tells you “The average American has left the middle of the road and now ten...
Example of hypothesis testing Suppose you and your opponent decide to test these competing claims by examining mean voter ...
Example of hypothesis testing 1 – Extremely liberal 2 – Very liberal 3 – Somewhat liberal 4 – Moderate  5 – Somewhat conse...
Example of hypothesis testing <ul><li>Before we start, we must decide on the size of the critical region. Let's set  α = ....
The  t  distribution <ul><li>The  t  distribution resembles a normal distribution but is a bit “fatter” in that it has mor...
t Normal
 
To use a  t  distribution ... <ul><ul><li>1. Determine the size of the sample to be collected (rule of 30). </li></ul></ul...
To use a  t  distribution ... At this point you would now collect the sample data, find the sample mean and compute the ob...
To use a  t  distribution ... If the absolute value of the t-score for the observations is greater than the t-score for th...
To use a  t  distribution ... is the sample mean is the hypothesized population mean is the sample standard deviation is t...
To use a  t  distribution ... 1. Sample size:  N  = 25.  2. Degrees of freedom (N-1) = 25 – 1 = 24. 3. One-tailed test;  α...
 
To use a  t  distribution ... Now calculate the t-score for the observations. In order to make the calculation we need the...
 
To use a  t  distribution ... The observed t-score is -2.28. The critical value t-score is 1.711. Again, if |t obs |  ≥ t ...
P-Values The p-value tells you the probability of getting a t statistic at least as large as the one actually observed if ...
 
What about large samples? Large samples rely on the standard or normal distribution, but how is the test statistic calcula...
How is a z-score calculated? <ul><li>Z scores are calculated the the same way as t scores.  </li></ul><ul><li>However, one...
Example in Practice <ul><li>Let's return to the ideology example. Let's assume we want to test the assumption that the Uni...
Example in Practice <ul><li>Suppose we wanted a higher level of confidence. This time, we set the size of the critical reg...
Example in Practice <ul><li>Two-tail test. </li></ul><ul><li>Whenever looking up the corresponding z score for a critical ...
To recap .... <ul><li>If |z obs |  ≥ z crit reject H 0 </li></ul><ul><li>If |z obs | < z crit do not reject H 0 </li></ul>
 
 
To use the z-score table .... <ul><li>Notice how the values are arranged from largest to smallest, descending as you go ac...
Since | -15.21 | > 2.58 we can reject the null hypothesis with 99 percent confidence. In other words, there's only a 1 % c...
So what does this tell us? <ul><li>The sample mean is 4.27, which is still in a slightly conservative direction. </li></ul...
Difference between t and z scores <ul><li>t  scores are used for samples of 30 or less;  z  scores for samples of more tha...
 
Example in Practice
Upcoming SlideShare
Loading in …5
×

More Statistics

1,587 views

Published on

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,587
On SlideShare
0
From Embeds
0
Number of Embeds
23
Actions
Shares
0
Downloads
57
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

More Statistics

  1. 1. More Statistics Andrew Martin PS 372 University of Kentucky
  2. 2. Inference Inference refers to reasoning from available information or facts to reach a conclusion. However, there is no guarantee the inference is correct. In fact, inferences are sometimes incorrect.
  3. 3. Inference In statistical inference the estimated values of unknown population parameters are sometimes incorrect. Concerning hypothesis testing, there are two types of mistakes we can make: a Type I error and a Type II error.
  4. 4. Type I Error <ul><ul><li>Type I error occurs whenever one rejects a true null hypothesis. </li></ul></ul><ul><ul><li>Suppose: </li></ul></ul><ul><ul><li>(1) in reality, the coin is fair (that is, H 0 : P = .5) </li></ul></ul><ul><ul><li>(2) You decide to reject H 0 if 0,1,9 or 10 heads occurs. </li></ul></ul><ul><ul><li>(3) your opponent obtains 9 heads in 10 tosses. </li></ul></ul><ul><ul><li>(4) You reject the hypothesis and accuse the person of being unfair. </li></ul></ul>
  5. 5. Type II Error <ul><li>Type II error occurs whenever one fails to reject a false null hypothesis. </li></ul><ul><li>Suppose: </li></ul><ul><li>(1) in reality, the coin is unfair (that is, H 0 : P = .9) </li></ul><ul><li>(2) You decide to reject H 0 only if 10 heads occurs. </li></ul><ul><li>(3) Your opponent obtains 9 heads in 10 tosses. </li></ul><ul><li>(4) You do not reject the null hypothesis (H 0 : P = .5) even though it is false. </li></ul>
  6. 6. What are the chances? <ul><ul><li>The probability of committing a type I error is the “size” of the critical region. It is designated by small Greek letter alpha (α). </li></ul></ul><ul><ul><li>The probability of committing a type II error ( β) depends on : </li></ul></ul><ul><ul><li>1) how far the true value of the population parameter is from the hypothesized one </li></ul></ul><ul><ul><li>2) the sample size – the larger the sample size, the lower the probability of committing a type II error. </li></ul></ul>
  7. 8. Standard Error Imagine taking an endless number of independent samples of size N from a fixed population that has a mean of μ and a standard deviation σ. For each sample, you calculate Y and the standard deviation
  8. 9. Standard Error The standard deviation of the sampling distribution is called the standard error of the mean, or standard error . Where is the sample standard deviation and N is the sample size.
  9. 10. Standard Error The expression implies that as the sample size gets larger and lagers, the standard error decreases in numerical value. As a result, as the sample increases we expect Y to get closer and closer to the true value ( μ)
  10. 11. Binomial Distributions Binomial distributions can be used to show how probabilities can be used to assess the likelihood that an event will or will not occur given N observations. Sometimes an event happening or not happening is referred to in terms of successes and failures.
  11. 12. Binomial Distribution Coin tosses are a perfect example, because you can specify tossing heads or tossing heads as an event. Sticking with heads as the event, it either happens or fails to happen.
  12. 14. Critical Regions and Values If we have established a critical region such that we will reject the null hypothesis at 0, 1, 9 or 10 heads, then the size of the critical region would be calculated as follows: p 0 + p 1 + p 9 + p 10 = α (Critical region) .001 + .01 + .01 + .001 = .022 So we have .022, or just a little more than 2 out of 100 chances of incorrectly rejecting the null hypothesis.
  13. 15. Critical Regions and Values On a practical level, the only way one would reject the null hypothesis (H 0 : P = .5) is if in 10 tosses only 1,2,9 or 10 came up heads – none of which is likely with a fair coin.
  14. 16. Critical Regions and Values In political science, the critical regions are typically referred to as levels. In other words, if α = .05 one would typically say “The null hypothesis can be rejected at the .05 level.” This measure specifies the probability of making a Type I error (rejecting a true null hypothesis). This concept is also known as statistical significance .
  15. 17. Statistical Significance <ul><li>The three most common levels of significance in political science are .05, .01 and .001. </li></ul><ul><li>Sometimes scholars use a looser standard of .10, .05 and .01. </li></ul><ul><li>Are these levels appropriate for the discipline? </li></ul>
  16. 18. One- or Two-Sided Tests <ul><li>What if you suspect the null hypothesis is false? How would you go about formulating an alternative hypothesis? </li></ul><ul><li>Let's return to the coin tossing example. If I notice a coin tends to come up heads more likely than tails, I might propose H A : P > .5 as an alternative. This is different than merely assuming H A : P ≠ .5 because prior observation tells me there is a directional assumption that can be made. I'm not too worried that H A : P < .5 </li></ul>
  17. 19. One- or Two-Sided Tests <ul><li>If testing a hypothesis theoretically suggests only upper or only lower values are relevant, a one-tail test will suffice. </li></ul><ul><li>In other words, a one-tail test requires only one critical region or value. </li></ul><ul><li>To return to the coin tossing example, if my H A : P > .5 I will only be interested in the critical region where I get 9 or 10 heads out of 10 tosses, and therefore only interested in the critical value for the upper tail of the distribution. </li></ul>
  18. 21. One-Tail Test (High Values)
  19. 22. One-tail Test (Low Values)
  20. 23. One- or Two-Sided Tests <ul><li>However, if I have to no reason to suspect large or small values of P , then I should use a two-tail test. . </li></ul><ul><li>In other words, if H A : P ≠ .5, I have no intuition about whether the probability is higher or lower than .5, so I use a two-tail test. </li></ul>
  21. 25. What about real-world outcomes? <ul><li>We obviously do not live in a binomial world. </li></ul><ul><li>Usually we have to accept more than two possible outcomes. As a result, a probability distribution would be increasingly difficult to tabulate. </li></ul><ul><li>Therefore, we cannot compare sample value to some critical value obtained from some distribution (such as the binomial distribution). </li></ul>
  22. 26. Types of Distributions <ul><ul><li>Discrete probability distribution </li></ul></ul><ul><ul><li>Continuous probability distribution </li></ul></ul>
  23. 27. Discrete vs. Continuous Distributions (Kmenta 1986) <ul><li>In discrete probability distributions the elements of sample space are represented by points that are separated by finite distances. </li></ul><ul><li>To each point we can ascribe a numerical value and to each value we can ascribe a given probability. (Ex: Coin toss (or binomial distribution), playing cards, lottery) </li></ul><ul><li>However, there are many distributions for which the sample space does not consist of countable points but covers and entire interval (or collection of intervals). These are known as continuous probability distributions . </li></ul>
  24. 28. Discrete Distribution
  25. 29. Continuous Distribution
  26. 30. Observed Test Statistic <ul><li>Observed test statistic = </li></ul><ul><li>Sample estimate – hypothesized pop. parameter </li></ul><ul><li>Standard error </li></ul><ul><ul><li>The observed test statistic is compared to a critical value, and the decision to reject or not reject the null hypothesis depends on the outcome of the comparison. </li></ul></ul>
  27. 31. Observed Test Statistic <ul><ul><li>1. If the observed statistic's value is greater than or equal to the critical value, reject the null hypothesis in favor of the alternative. </li></ul></ul><ul><ul><li>2. Otherwise, do not reject the null hypothesis. </li></ul></ul>
  28. 32. Example of hypothesis testing Example: Someone tells you “The average American has left the middle of the road and now tends to be somewhat conservative.” (H 0 : μ = 5) You, however, are not so sure. In light of Obama's recent election, you think America is not conservative. You believe it to be at least middle of the road. (H A : μ < 5)
  29. 33. Example of hypothesis testing Suppose you and your opponent decide to test these competing claims by examining mean voter ideology from the National Election Study (NES), which uses the following scale: 1 – Extremely liberal 2 – Very liberal 3 – Somewhat liberal 4 – Moderate 5 – Somewhat conservative 6 – Very conservative 7 – Extremely conservative
  30. 34. Example of hypothesis testing 1 – Extremely liberal 2 – Very liberal 3 – Somewhat liberal 4 – Moderate 5 – Somewhat conservative (opponent's claim) 6 – Very conservative 7 – Extremely conservative H 0 : μ = 5 – opponent's claim H A : μ < 5 – your claim (μ is between 1 and 4)
  31. 35. Example of hypothesis testing <ul><li>Before we start, we must decide on the size of the critical region. Let's set α = .05 (level of significance). </li></ul><ul><li>Next, we must specify the appropriate sampling distribution. </li></ul><ul><li>In a small sample (less than 25 observations) statistical theory asserts the appropriate sampling distribution fir a test about the mean is the t distribution. </li></ul>
  32. 36. The t distribution <ul><li>The t distribution resembles a normal distribution but is a bit “fatter” in that it has more area in its tails. </li></ul><ul><li>The t distribution depends on the size of the sample ( N ). As N gets larger, the t distribution approaches the shape of the normal distribution; at N = 30 or N = 40 they are essentially indistinguishable. </li></ul><ul><li>In other words, use the t distribution if the sample is smaller than 30 or 40; use the normal distribution if N > 40. </li></ul>
  33. 37. t Normal
  34. 39. To use a t distribution ... <ul><ul><li>1. Determine the size of the sample to be collected (rule of 30). </li></ul></ul><ul><ul><li>2. Find the degrees of freedom ( df ) by calculating N -1. Will explain df later. </li></ul></ul><ul><ul><li>3. Choose level of significance and directionality of the test, a one- or two-tailed test at the α level. </li></ul></ul><ul><ul><li>4. Given these choices, find the critical values located in Appendix B (for t distribution) in JRM pp. 576. </li></ul></ul>
  35. 40. To use a t distribution ... At this point you would now collect the sample data, find the sample mean and compute the observed test statistic (which in this case is a t-score ). The calculated t-score for the observations is then compared to a critical value t-score.
  36. 41. To use a t distribution ... If the absolute value of the t-score for the observations is greater than the t-score for the critical values, reject H0. Otherwise, do not reject. If |t obs | ≥ t crit reject H 0 If |t obs | < t crit do not reject H 0
  37. 42. To use a t distribution ... is the sample mean is the hypothesized population mean is the sample standard deviation is the sample size
  38. 43. To use a t distribution ... 1. Sample size: N = 25. 2. Degrees of freedom (N-1) = 25 – 1 = 24. 3. One-tailed test; α = .05 (level of significance). 4. Look up the corresponding row for degrees of freedom and column for level of significance in Appendix B for t distributions on page 576 to get the corresponding critical value.
  39. 45. To use a t distribution ... Now calculate the t-score for the observations. In order to make the calculation we need the four following pieces of information: the sample mean, hypothesized population mean, sample standard deviation and sample size. 4.44 is the sample mean 5 is the hypothesized population mean 1.23 is the sample standard deviation 25 is the sample size
  40. 47. To use a t distribution ... The observed t-score is -2.28. The critical value t-score is 1.711. Again, if |t obs | ≥ t crit reject H 0 Since |-2.28| ≥ 1.711, H 0 is rejected.
  41. 48. P-Values The p-value tells you the probability of getting a t statistic at least as large as the one actually observed if the null hypothesis is true. In this sample, the p-value is .016, which tells you the probability of getting a t statistic at least as large as the one actually observed if the null hypothesis is true. In this sample there is only 1.6 percent chance of observing a as large as 4.44 if the population parameter is 5.
  42. 50. What about large samples? Large samples rely on the standard or normal distribution, but how is the test statistic calculated? The test statistic for a normal distribution is known as a z score , which is the number of standard deviations by which a score deviates from the mean score. For example, z = 1.96 means 1.96 standard deviations above the mean.
  43. 51. How is a z-score calculated? <ul><li>Z scores are calculated the the same way as t scores. </li></ul><ul><li>However, one has to use a different table to identify the appropriate critical value. The table for normal distributions (z scores) is Appendix A (JRM p. 575) </li></ul>
  44. 52. Example in Practice <ul><li>Let's return to the ideology example. Let's assume we want to test the assumption that the United States has become a slightly conservative country according to the mean response in the NES (H 0 : μ = 5). </li></ul><ul><li>This time, however, you have no inclination about whether the null hypothesis is too conservative or too liberal. On the one hand, a fairly liberal presidential candidate just won the election, but on the other the United States has always been more conservative than most advanced industrial democracies (H A : μ ≠ 5) </li></ul>
  45. 53. Example in Practice <ul><li>Suppose we wanted a higher level of confidence. This time, we set the size of the critical region or probability to .01 (or α = .01) </li></ul><ul><li>Remember, the alternative hypothesis does not specify a relationship (that is, no less than or greater than). </li></ul><ul><li>Do we need a one- or two-tail test? </li></ul>
  46. 54. Example in Practice <ul><li>Two-tail test. </li></ul><ul><li>Whenever looking up the corresponding z score for a critical region with a two-tail test, one has to divide the size of the critical region (here, .01) by 2. </li></ul><ul><li>So, .01/2 = .005. </li></ul><ul><li>.005 is the size of the critical region in each tail. </li></ul><ul><li>In total, the critical region is .01, giving us a 99 percent level of confidence. </li></ul><ul><li>There is only a 1 % chance of committing a Type I error. </li></ul>
  47. 55. To recap .... <ul><li>If |z obs | ≥ z crit reject H 0 </li></ul><ul><li>If |z obs | < z crit do not reject H 0 </li></ul>
  48. 58. To use the z-score table .... <ul><li>Notice how the values are arranged from largest to smallest, descending as you go across each row and continuing in descending order as you go down a row. </li></ul><ul><li>Find the value closest to .005 (Hint: It's .0049 on the table) </li></ul><ul><li>Add the number in the corresponding far left end of the row to the “second decimal place of Z” number at the top of the critical value's column. </li></ul><ul><li>For .0049, these numbers are 2.5 + .08, so 2.58 is the critical value of Z. </li></ul>
  49. 59. Since | -15.21 | > 2.58 we can reject the null hypothesis with 99 percent confidence. In other words, there's only a 1 % chance the null hypothesis is true. Put yet another way, the chance that the true population parameter for ideology being 5 is very small.
  50. 60. So what does this tell us? <ul><li>The sample mean is 4.27, which is still in a slightly conservative direction. </li></ul><ul><li>In interpreting this statistic, a political scientist may conclude the United States is middle the road or perhaps slightly conservative, but not somewhat conservative ( μ = 5). </li></ul>
  51. 61. Difference between t and z scores <ul><li>t scores are used for samples of 30 or less; z scores for samples of more than 30. </li></ul><ul><li>t scores require us to calculate degrees of freedom; z scores do not require such a calculation. </li></ul><ul><li>The bigger the sample size, the smaller the size of the critical region for both t and z scores. </li></ul>
  52. 63. Example in Practice

×