1. Critical Thinking, Self-Efficacy, and Self-Regulated Learning in University Students Cheryl Reining & Sarah Thelen Thesis Supervisor: Catherine Arnold, MS, EdD, RD, LDN
33. Participants Profile: Gender & Age Distribution Total participants= 88 79 females = 90% 9 males = 10% Females age: 63 = 23 and under 16 = 24 and over Males age: 9 = 23 and under 0 = 24 and over
38. MAI Scale Scale: MAI A high value for Cronbach’s Alpha (> .9), indicates an excellent internal consistency Reliability Statistics Cronbach's Alpha Cronbach's Alpha Based on Standardized Items N of Items .976 .977 52 Item Statistics Mean Std. Deviation Score Interpretation Stop and reread 89.55 18.630 Good Use strategies from past 88.75 18.304 Good Good judge of understanding 87.78 15.863 Good Consider all options 68.58 29.483 Questionable Learned as much as could have 67.89 29.188 Questionable Question material prior 60.24 32.666 Questionable
39. Cronbach Alpha: Reliability A high value for Cronbach’s Alpha (> .9), indicates an excellent internal consistency of the items in the scale. Factor N Alpha Score Score Interpretation Critical thinking 5 .902 Excellent Self-efficacy 8 .944 Excellent MSLQ 13 .933 Excellent MAI 52 .977 Excellent
41. H08: There is No Difference Between Majors in Self-efficacy Null H0 is rejected Majors http://www.clker.com/clipart-thumb-up.html t = 2.125 df = 86 Self-efficacy N Mean Education 53 6.2382 Nutrition 35 5.8607 sig. .036
42. H09a : There is No Difference in Self-efficacy Between Academic Years for Nutrition Majors Null H0 is accepted Nutrition f = 1.833 df = 3, 31 Self-efficacy N Mean Freshman 7 5.6964 Sophomore 3 5.4583 Junior 11 5.5341 Senior 14 6.2857 Total 35 5.8607 sig. .162
43. H09b : There is No Difference in Self-efficacy Between Academic Years for Education Majors Education f = 3.919 df = 3, 49 Null H0 is rejected Self-efficacy N Mean Freshman 6 5.8958 Sophomore 8 5.5938 Junior 17 6.4779 Senior 22 6.3807 Total 53 6.2382 sig. .014
44. H010a: There is No Difference in Self-efficacy Between Age Categories for Nutrition Majors Nutrition f = 2.770 df = 1, 33 Null H0 is accepted Self-efficacy N Mean 23 and under 26 5.7115 24 and over 9 6.2917 Total 35 75.860 sig. .106
45. H010b: There is No Difference in Self-efficacy Between Age Categories in Education Majors Education f = 2.068 df = 1, 51 Null H0 is accepted Self-efficacy N Mean 23 and under 46 6.1821 24 and over 7 6.6071 Total 53 6.2382 sig. .156
46. H011a: There is No Difference in Self-efficacy Between Ethnicity Groups in Nutrition Majors Nutrition Null H0 is accepted t = 1.555 df = 33 Self-efficacy N Mean White 23 6.0326 Non-white 12 5.5313 sig. .130
47. H011b: There is No Difference in Self-efficacy Between Ethnicity Groups in Education Majors Null H0 is accepted Education t = 1.665 df = 50 Self-efficacy N Mean White 36 6.3403 Non-white 16 5.9766 sig. (2-tailed) .102
48. H012a: There is No Relationship Between Self-efficacy and Cumulative GPA in Nutrition Majors Null H0 is accepted Correlations Nutrition gpa self-efficacy gpa Pearson Correlation 1 .308 Sig. (2-tailed) .076 N 34 34 self-efficacy Pearson Correlation .308 1 Sig. (2-tailed) .076 N 34 35 Correlation is significant at the 0.01 level (2-tailed).
49. H012b: There is No Relationship Between Self-efficacy and Cumulative GPA in Education Majors Null H0 is rejected Correlations Education gpa self-efficacy gpa Pearson Correlation 1 .449 ** Sig. (2-tailed) .001 N 53 53 self-efficacy Pearson Correlation .449 ** 1 Sig. (2-tailed) .001 N 53 53 Correlation is significant at the 0.01 level (2-tailed).
50. Results of Self-efficacy Analyses Hypotheses for Self-efficacy Null H0 for Self-efficacy & … Sig. H08 Majors .036 H09a Academic year for NUTR. majors .162 H09b Academic year for Ed. majors .014 H010a Age categories for NUTR. Majors .106 H010b Age categories for Ed. majors .156 H011a Ethnicities for NUTR majors .130 H011b Ethnicities for Ed. majors .102 H012a Cumulative GPA for NUTR. majors .076 H012b Cumulative GPA for Ed. majors .001
52. H013: There is No Difference in Critical Thinking Between Majors Null H0 is accepted Majors t = 1.509 df = 86 Critical thinking N Mean Education 53 5.5283 Nutrition 35 5.1657 sig. .135
53. H014: There is No Difference in Critical Thinking Across Academic Years f = 1.973 df = 3, 84 Null H0 is accepted Academic Year Critical Thinking N Mean Freshman 13 5.1077 Sophomore 11 4.7636 Junior 28 5.4929 Senior 36 5.5889 Total 88 5.3841 sig. .124
54. H015: There is No Difference in Critical Thinking Across Ethnicity Groups Null H0 is accepted t = .343 df = 85 Critical Thinking N Mean White 59 5.4169 Other 28 5.32876 sig. .732
55. H016: There is No Relationship Between Critical Thinking and Cumulative GPA Correlation is significant at the 0.01 level (2-tailed). Null H0 is accepted Correlations gpa critical_thinking gpa Pearson Correlation 1 .071 Sig. (2-tailed) .516 N 87 87 Critical thinking Pearson Correlation .071 1 Sig. (2-tailed) .516 N 87 88
56. H017: There is No Difference in Critical Thinking Across Age Groups Age Null H0 is rejected f = 4.840 df = 1, 86 Critical Thinking N Mean 23 and under 72 5.2639 24 and over 16 5.9250 Total 88 5.3841 sig. .030
57. H017a: There is No Relationship Between Critical Thinking and Cumulative GPA in Students Aged 23 and Under Null H0 is accepted Correlations 23 and under gpa critical_thinking gpa Pearson Correlation 1 .140 Sig. (2-tailed) .241 N 72 72 Critical thinking Pearson Correlation .140 1 Sig. (2-tailed) .241 N 72 72 Correlation is significant at the 0.01 level (2-tailed).
58. H017b: There is No Relationship Between Critical Thinking and Cumulative GPA in Students Aged 24 and Over Null H0 is accepted Correlations 24 and over gpa critical_thinking gpa Pearson Correlation 1 -.278 Sig. (2-tailed) .316 N 15 15 Critical thinking Pearson Correlation -.278 1 Sig. (2-tailed) .316 N 15 16 Correlation is significant at the 0.01 level (2-tailed).
59. Results for Critical Thinking Analyses Hypotheses for Critical Thinking Null H0 for Critical Thinking & … Sig. H013 Majors .013 H014 Academic year .124 H015 Ethnicity groups .732 H016 Cumulative GPA .516 H017 Age groups .030 H017a Cumulative GPA in 23 years and under .241 H017b Cumulative GPA in 24 years and over .316
61. H018: There is No Difference in MAI/SRL Between Majors Null H0 is accepted Majors t = .261 df = 86 MAI/SRL N Mean Education 53 80.0708 Nutrition 35 79.1797 sig. .795
62. H019: There is No Difference in MAI/SRL Between Academic Years f = 3.84 df = 3, 84 Null H0 is accepted MAI/SRL N Mean Freshman 13 76.0740 Sophomore 11 70.6818 Junior 28 83.1408 Senior 36 81.1287 Total 88 79.7163 sig. .107
63. H020: There is No Relationship Between MAI/SRL and Ethnicity Null H0 is accepted t = 1.026 df = 85 MAI/SRL N Mean White 59 80.6750 Other 28 77.0165 sig. (2-tailed) .308
64. H021: There is No Difference Between MAI/SRL and Age Groups Null H0 is rejected t = - 2.365 df = 86 MAI/SRL N Mean 23 and under 72 77.9111 24 and over 16 87.8401 sig. .020
65. H022a: There is No Relationship Between MAI/SRL and Cumulative GPA in Students Aged 23 and Under Null H0 is accepted Correlations 23 and under gpa MAI gpa Pearson Correlation 1 -.070 Sig. (2-tailed) .558 N 72 72 MAI Pearson Correlation -.070 1 Sig. (2-tailed) .558 N 72 72 Correlation is significant at the 0.01 level (2-tailed).
66. H022b: There is No Relationship Between MAI/SRL and Cumulative GPA in Students Aged 24 and Over Null H0 is rejected Correlations 24 and over gpa MAI gpa Pearson Correlation 1 .651 ** Sig. (2-tailed) .009 N 15 15 MAI Pearson Correlation .651 ** 1 Sig. (2-tailed) .009 N 15 16 Correlation is significant at the 0.01 level (2-tailed)
67. H023: There is No Relationship Between MAI/SRL, Critical Thinking & Self-efficacy MAI/SRL, Critical Thinking & Self-efficacy Null H0 is rejected Correlations MAI Critical thinking self-efficacy MAI/SRL Pearson Correlation 1 .340 ** .312 ** Sig. (2-tailed) .001 .003 N 88 88 88 Critical thinking Pearson Correlation .340 ** 1 .524 ** Sig. (2-tailed) .001 .000 N 88 88 88 self-efficacy Pearson Correlation .312 ** .524 ** 1 Sig. (2-tailed) .003 .000 N 88 88 88 **Correlation is significant at the 0.01 level (2-tailed).
68. Results for MAI/SRL Analyses Hypotheses for MAI/SRL Null H0 for MAI/SRL & … Sig. H018 Majors .795 H019 Academic year .107 H020 Ethnicity groups .308 H021 Age groups .020 H022a Cumulative GPA in 23 yrs and under .558 H022b Cumulative GPA in 24 yrs and over .009 H023 Critical thinking & self-efficacy .003
Self-efficacy is the cornerstone of the Social Cognitive Theory.
Talk about how we got subject, then talk about subjects.
For the online participant recruitment, invitations were sent to Benedictine University students enrolled in the Spring 2011 semester/quarter via e-mail. 3 separate e-mails were sent out between April 28 th and May 10 th of this year. As an incentive, $100 would be awarded via a random drawing. A written invitation for the online survey was also included in the In-Class survey packets. ** Show pink slip for online survey handed out in class
The online survey consisted of both the MSLQ survey, as Sarah just explained, and the Metacognitive Awareness Inventory survey, or MAI. The MAI is a 52 item self-report inventory tool that measures adults’ metacognitive awareness one’s “thinking about thinking” These statements are used to gauge knowledge of cognition & regulation of cognition .
Participants completed the online surveys via SurveyMonkey, a web-based survey service. Completed surveys were linked to Benedictine’s website (all information was kept confidential). Survey responses were entered into an Excel doc and then exported into IBM SPSS 19 to analyze the data.
To run the data analyses we used: Frequencies and Descriptives (to check for errors) Factor Analyses (to extract factors) Cronbach Alpha (for reliability) One Way ANOVAs (for analysis of variance) Independent t-tests (for comparing means) Pearson r (for correlations) … and we used these variables for the analyses
Self efficacy statements included: I believe I will receive an excellent grade in this class I’m certain I can understand the most difficult material presented in the readings for this course I’m confident I can understand the basic concepts taught in this course I’m confident I can understand the most complex material presented by the instructor in this course I’m confident I can do an excellent job on the assignments and tests in this course I expect to do well in this class I’m certain I can master the skills being taught in this class Considering the difficulty of this course, the teacher, and my skills, I think I will do well in this class Critical thinking : I often find myself questioning things I hear or read in this course to decide if I find them convincing When a theory, interpretation, or conclusion is presented in class or in the readings, I try to decide if there is good supporting evidence I treat the course material as a starting point and try to develop my own ideas about it I try to play around with ideas of my own related to what I am learning in the course Whenever I read or hear an assertion or conclusion in this class, I think about possible alternatives.
>.9 = Excellent .9->.8 = Good .8- >.7 = Acceptable
No significance for critical thinking state range verbally Sig for self eff = .029 which is less than .05, so use equal variance not assumed, no significant difference (sig 2 tailed) = .567 Sig for critical think = .999, so equal variance is assumed no significant difference (sig 2 tailed) = .494, t-value = .686, and df = 76.024, no significance b/t majors and critical thinking, mean diff = .14999
Self eff 23 and under (nutrition) N = 101 Mean = 5.9480 SD = .75462 24 and over N = 43, Mean = 5.8459, SD = 1.05498 Other 23 – N = 24, mean = 6.3646, SD = .13500 24 + N = 0
Anova
Self efficacy increased with every grade – address why no “f’s”
There is a significant relationship between self efficacy and nutrition majors (despite their tendency to report lower levels of self efficacy)
The ttest shows significance, hypothesis rejected. .011 less than .05, shows significance between critical thinking and course outcome
There is not a significant correlation between critical thinking and course grade
As already mentioned, the online survey consisted of both the MSLQ and the MAI questionnaire.
This graph depicts age and gender distribution for the online study. Out of 88 participants, 90% were female and 10% were male. Age is categorized into 2 groups: 23 yrs of age & under and 24 yrs of age and & over. Of these there were 63 females 23 yrs of age & under and 16 females 24 yrs of age & over. Males were all in the 23 and under category.
The ethnicity distribution was 67% white and 33% non-white.
The distribution by majors was 60% Education and 40% Nutrition.
We ran a PCA to determine the factors of the MSLQ online survey questions. As with the In-Class survey, the MSLQ separated into 2 factors: Critical Thinking and Expectancy, but only for the Nutrition and Education majors. Because there was a significant mismatch between all other majors, only the results from Nutrition and Education courses were retained
We ran a PCA to determine the factors of the MAI online survey questions. The MAI (Metacognitive Awareness Inventory) consists of 2 broad categories containing multiple factors Knowledge of cognition Regulation of cognition Declarative knowledge Planning/goal setting Procedural knowledge Information management Conditional knowledge Monitoring Debugging Evaluation Because there was a significant mismatch between ‘all majors’ and the MAI PCA results originally reported by the researchers who developed the scale, Shraw & Dennison, the factors could not be used in the data analyses. There was also a definite mismatch between Nutrition and Education and all the other majors, which suggests there are different SRL skills utilized by other groups.
A Cronbach Alpha was run to determine internal consistency between the 52 survey questions of the MAI. The top table demonstrates an ‘excellent’ internal consistency D/T it being > .9. The bottom table is a sample representation of the 3 highest (in yellow) and 3 lowest (in blue) of the MAI means. The scores in yellow demonstrate a ‘good’ internal consistency D/T their being > 8. The scores in blue demonstrate ‘ questionable’ internal consistency D/T their being > 6. Cronbach's alpha is the most common measure of internal consistency (&quot;reliability&quot;). It is most commonly used when you have multiple Likert questions in a survey/questionnaire that form a scale and you wish to determine if the scale is reliable. Note: George and Mallery (2003) provide the following rules of thumb when interpreting Cronbach alpha: “_ > .9 – Excellent , _ > .8 – Good, _ > .7 – Acceptable, _ > .6 – Questionable, _ > .5 – Poor, and _ < .5 – Unacceptable” (p. 231). George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Boston: Allyn & Bacon.
A Cronbach Alpha was also run to determine internal consistency between critical thinking, self-efficacy, the MSLQ and MAI surveys. Because each factor is > .9, they all demonstrate an excellent internal consistency. Cronbach's alpha is the most common measure of internal consistency (&quot;reliability&quot;). It is most commonly used when you have multiple Likert questions in a survey/questionnaire that form a scale and you wish to determine if the scale is reliable. Item Total Statistics table - good table for reliability, supports inclusion of all items - shows elimination of any item will decrease the reliability. All 4 variables have great reliability. Note: George and Mallery (2003) provide the following rules of thumb when interpreting Cronbach alpha: “_ > .9 – Excellent, _ > .8 – Good, _ > .7 – Acceptable, _ > .6 – Questionable, _ > .5 – Poor, and _ < .5 – Unacceptable” (p. 231). While increasing the value of alpha is partially dependent upon the number of items in the scale, it should be noted that this has diminishing returns. It should also be noted that an alpha of .8 is probably a reasonable goal. It should also be noted that while a high value for Cronbach’s alpha indicates good internal consistency of the items in the scale , it does not mean that the scale is unidimensional. Factor analysis is a method to determine the dimensionality of a scale George, D., & Mallery, P. (2003). SPSS for Windows step by step: A simple guide and reference. 11.0 update (4th ed.). Boston: Allyn & Bacon.
As you can see in your handout booklet, there are quite a few slides of all of the hypotheses tested for the online survey. There are three broad categories within these hypotheses: Self-efficacy, Critical Thinking and MAI/SRL In the interest of time and to better describe the results, instead of going through each slide separately, I will use comparison tables, one for each category. These three tables are not in your handout, but the information in each one has been taken from the slides that are in your handout booklet. I will begin with the Null H0s 8 thru 12b for self-efficacy.
After determining the internal consistencies, the hypotheses were then tested. I began with a t-test to prove there in no difference between majors in self-efficacy. Because the p value is < 0.05, it demonstrates there is a sig. difference between majors and self-efficacy . The null hypothesis is rejected. T-test The sig (2-tailed) is less than .05 (.036) which demonstrates there is a significant difference between majors and self-efficacy. The null hypothesis is rejected.
A One Way ANOVA was then run to test the relationship between academic year and self-efficacy in nutrition majors. There is an inverse relationship between the f value and the p value. The p value is greater than 0.05, which shows there is no sig. difference in self-efficacy between the academic year groups.
One Way ANOVA There is a definite relationship between academic year and self-efficacy in education majors. There is an inverse relationship between the f value and the p value. In this case, the f value is large and the p value is small. Because the p value is < 0.05, there is a sig. difference in self-efficacy between the academic year groups. The null hypothesis is rejected, therefore the f value is further from 1.0.
One Way ANOVA There is no relationship between self-efficacy and age in nutrition majors. The null hypothesis is accepted. There is an inverse relationship between the f value and the p value. The p value is greater than 0.05, which shows there is no sig. difference in self-efficacy between the age groups of nutrition majors. The null hypothesis is accepted, therefore the f value is closer to 1.0.
ANOVA There is no relationship between self-efficacy and age in education Majors. The null hypothesis is accepted. There is an inverse relationship between the f value and the p value. The p value is greater than 0.05, which shows there is no sig. difference in self-efficacy between the age groups of education majors. The null hypothesis is accepted, therefore the f value is closer to 1.0.
T-test (split file) The sig (2-tailed) is greater than .05 (.130) so there is no significant difference between self-efficacy and ethnicities in nutrition majors. The null hypothesis is accepted.
T-test (split file) The sig (2-tailed) is greater than .05 (.102) so there is no significant difference between self-efficacy and ethnicities in education majors. The null hypothesis is accepted.
Pearson r There is no significant relationship between self-efficacy and cumulative GPA in nutrition majors. The null hypothesis is accepted.
Pearson r There is a defined relationship between GPA and self-efficacy in education majors. The higher the self-efficacy, the higher the GPA and vice versa. The null hypothesis is rejected.
As you can see, there was a significant difference between self-efficacy and majors, at .036, so the null hypothesis was rejected. Between self-efficacy and the academic year, there was no sig. difference for nutrition majors, so the null H0 was accepted, but for the education majors, there was a sig. difference, at .014 in self-efficacy. With self-efficacy and the age categories and ethnicity groups, there was no sig. difference in both nutrition and education majors, so these 4 null h0s were accepted. But with self-efficacy and cumulative GPA, whereas there was no sig. difference in nutrition majors, causing the acceptance of the null H0, there was a sig. difference in the education majors causing the rejection of the null H0.
These are the null hypotheses 13 thru 17b for critical thinking
T-test The sig (2-tailed) is greater than 0.05 (.135) so there is no significant difference in critical thinking between education and nutrition majors. The null hypothesis is accepted.
One way ANOVA The null hypothesis is true, therefore the f value is closer to 1.0. The p value is greater than 0.05, which shows there is no sig. difference in critical thinking between the academic year groups.
T-test The sig (2-tailed) is greater than .05 (.732) so there is no significant difference between critical thinking between ethnicities. The null hypothesis is accepted.
Pearson r There is no relationship b etween critical thinking and cumulative GPA . The null hypothesis is accepted.
One Way ANOVA There is an inverse relationship between the f value and the p value. In this case, the f value is large and the p value is small. Because the p value is < 0.05, there is a sig. difference in critical thinking between the two age groups.
Pearson r There is no relationship b etween critical thinking and cumulative GPA in students aged 23 and under . The null hypothesis is accepted.
Pearson r There is no relationship b etween critical thinking and cumulative GPA in students aged 24 and over . The null hypothesis is accepted.
This table demonstrates the analysis results for critical thinking. As you can see, all null hypotheses were accepted except for the age groups, which demonstrates that there was a sig. difference in critical thinking across the two age groups at .030. Because of the sig. difference, the files were split to test the two age groups separately in order to determine which group was responsible for the significance. But as you can see, once split, there was no sig. difference.
These are the null hypotheses 18 thru 23 for MAI/SRL
T-test The sig (2-tailed) is greater than .05 (.795) so there is no significant difference in SRL between nutrition and education majors. The null hypothesis is accepted.
One Way ANOVA When the null hypothesis is true, the f value is closer to 1.0. The p value is greater than 0.05, which demonstrates there is no sig. difference in SRL between the academic year groups.
T-test The sig (2-tailed) is less than .05 (.020) so there is a significant difference in SRL between students 23 and under and students 24 and over. The null hypothesis is rejected.
Correlation is significant at the 0.01 level (2-tailed).
Correlation is significant at the 0.01 level (2-tailed).
A Pearson r was done for this analysis. There is a defined relationship between SRL, critical thinking and self-efficacy. So the higher the self-efficacy, the higher the self-regulatory behaviors (MAI score), and vice versa. The higher the critical thinking, the higher the self-regulatory behaviors (MAI score), and vice versa. The higher the self-efficacy, the higher the critical thinking scores reported, and vice versa. Because all three demonstrate significant differences, the null hypothesis is rejected.
For the d ifferences in MAI/SRL between majors, academic year and ethnicity groups, there were no sig. differences, so these 3 null hypotheses were accepted. But for differences between MAI/SRL and age groups there was a sig. difference, at .020, so the null hypothesis was rejected. For the r elationships between MAI/SRL and cumulative GPA across the age groups, there was no sig. difference in students 23 yrs and under, so this null H0 was accepted. There was, however, a sig. difference for those students 24 yrs and over, at .009, so this null H0 was rejected. The final hypothesis questioned whether there was a r elationship between MAI/SRL, critical thinking & self-efficacy. (go back to prev. slide)
Should I include his findings? Report findings about course GPA for SE & CT Report findings about cumulative GPA for SE, CT & SRL