1. Big Data, Little Data: A story behind
the numbers
Whitney Kilgore, Maha Al Freih, Katie Bradford
2. Data Sets
1. The Big Data
a. Canvas Network de-identified data compiled from 238 Massive Open Online Courses
(MOOCs)
1. The Little Data
a. HumanMOOC data from 51 participants on the Canvas Open Network
This presentation examines two data sets; the first set is a de-identified open data set released by the Canvas Network MOOC platform. (add a little information about CN here, plus info about Hilary’s session). The second data set comes from one of the MOOCs offered on Canvas Network - data from the 51 surveyed participants of the HumanMOOC. By comparing a large and small data set, we hoped to make comparisons and learn a few things. One - does the larger data set represent this subset accurately? Two - what are we missing from the larger data set? What quantitative and anecdotal information should we use to supplement the existing “big data?”
How the HumanMOOC came to be. It’s all very META - A Community about Community… Learning experience for educators who want to facilitate more Humanized experiences. We explore tools/methods that support “PRESENCE”
Lives on the Canvas open network.
? No the facilitators aren’t paid or receive any compensation.
Has run three times since 2013.
5 peer review publications and one dissertation thus far from the facilitators - other publications pop up on my Google Alerts from time to time too, so participants are publishing and sharing too.
HumanMOOC book coming out in 2 weeks - chapters authored by the participants. Pressbooks OPEN Access
IRB’s at UNT & George Mason
Google Hangouts to share the research study and their rights to participants
Research into:
To explore whether there is a difference in motivational beliefs and SRL processes between participants who persist and those who do not persist in the Human MOOC.
Understand the relationship between self-regulated learning and the instructional design of dual-layer Massive Open Online Courses
The data was queried, organized, and de-identified using a process similar to the one used for the HarvardX-MITx Person-Course data release of 2014, and then the data was made available to researchers on Harvard’s Dataverse service. Instructure has opened access to this data (Canvas Network, 2016) to create opportunities for identifying and solving educational challenges in online learning. The dataset includes over 325,000 aggregate records, with each record representing one individual's activity in one of 238 Canvas Network courses.
Total number of records: 65,535
Number of courses: 233
Number and percent of total records that did not receive survey: 28,455 out of 65,535, or 43.42% - this data was excluded from all subsequent findings
Viewed (>1)
Explored (>50% of course modules)
Viewed (<=1)
44,238=67.5% accessed the course once or never! (window shoppers?) https://www.class-central.com/report/moocs-course-completion-wrong-measure/
Viewed =21,297. Only viewed=(viewed-explored)=20,270
Consistent with general findings in the literature. MOOC learners are mainly older (60.7% are 34 years or older) with at least a four year college degree or higher (67.3%).
Consistent with general findings in the literature. MOOC learners are mainly older (60.7% are 34 years or older) with at least a four year college degree or higher (67.3%).
Those who primary reason to join related to professional reason on average completed more of the MOOC
The minimum completed was higher for Passive participants than Active participants
Unweighted averages - did not take into account the numbers in each group - preliminary analysis
Just because passive participants aren’t submitting assignments doesn’t mean they aren’t interacting with the content.
Mirrors findings from Big Data set:
Educational levels and age of participants
Similar to the Big Data Set:
The participants were active and enjoy learning
Persistence as “the fraction of individuals who enroll in a MOOC and successfully finish a course to the standards specified by the instructor”
2.8% of total registrants earned the Community of Inquiry Badge
Persistence as it relates to participants goals of earning badges
18.4% of all pre course survey participants who indicated their intention for earning a badge(s) went on to achieve their goal in the MOOC
Post-course survey
75% of post course survey participants participants who indicated their intention for earning a badge(s) went on to achieve their goal in the MOOC
Achievement of goals vs. completion or certification
Move beyond behavioral and interaction data
Similar demographics
Consistent with general findings in the literature. MOOC learners are mainly older with at least a four year college degree or higher (67.3%).
Similar Learner Types & Primary Reasons
Active participants (42.7%) and join because they enjoy learning (53.8%)
It is not about completion
Completion is not the right measure https://www.class-central.com/report/moocs-course-completion-wrong-measure/
What’s Next?
Qualitative study will explore the why behind the patterns...