In this talk I'll introduce the audience to the issues of predictive modelling and identify how it is poised to enable personalized learning at scale. I'll contrast predictive analytic techniques with descriptive inferential techniques, and identify some specific opportunities in higher education for predictive modelling to have significant impact. I'll share some of my own experiments in the area, and conclude with some of the challenges facing educational technology researchers as we move towards more personalized learning ecosystems.
These are the slides for a tutorial talk about "multilayer networks" that I gave at NetSci 2014.
I walk people through a review article that I wrote with my PLEXMATH collaborators: http://comnet.oxfordjournals.org/content/2/3/203
These are the slides for a tutorial talk about "multilayer networks" that I gave at NetSci 2014.
I walk people through a review article that I wrote with my PLEXMATH collaborators: http://comnet.oxfordjournals.org/content/2/3/203
If MOOCs are the answer, did we ask the right questions? Implications for the...Marco Kalz
Kalz, M. (2013). If MOOCs are the answer, did we ask the right questions? Implications for the design of large-scale online courses. Presentation given at the 3rd Annual Research Conference of the Maastricht School of Management. Revolutions in Education: New Opportunities for Development? 6 September 2013, Maastricht, The Netherlands.
To download this presentation please see http://dspace.ou.nl
MOOC Dropout Prediction Using Machine Learning Techniques: Review and Researc...Fisnik Dalipi
MOOC represents an ultimate way to deliver educational content in higher education settings by providing high-quality educational material to the students throughout the world. Considering the differences between traditional learning paradigm and MOOCs, a new research agenda focusing on
predicting and explaining dropout of students and low completion rates in MOOCs has emerged. However, due to different problem specifications and evaluation metrics, performing a comparative analysis of state-of-the-art machine learning architectures is a challenging task. In this paper, we provide an overview of the MOOC student dropout prediction phenomenon where machine learning techniques have been utilized. Furthermore, we highlight some solutions being used to tackle with dropout problem, provide an analysis about the challenges of prediction models, and propose some valuable insights and recommendations that might lead to developing useful and effective machine learning solutions to solve the MOOC dropout problem.
[DSC Europe 22] Machine learning algorithms as tools for student success pred...DataScienceConferenc1
The goal of higher education institutions is to provide quality education to students. Predicting academic success and early intervention to help at-risk students is an important task for this purpose. This talk explores the possibilities of applying machine learning in developing predictive models of academic performance. What factors lead to success at university? Are there differences between students of different generations? Answers are given by applying machine learning algorithms to a data set of 400 students of three generations of IT studies. The results show differences between students with regard to student responsibility and regularity of class attendance and great potential of applying machine learning in developing predictive models.
Social Network Analysis: applications for education researchChristian Bokhove
What is your talk about?
This seminar will illustrate various social network analysis (SNA) techniques and measures and their applications to research problems in education. These applications will be illustrated from our own research utilising a range of SNA techniques.
What are the key messages of your talk?
We will cover some of the ways in which network data can be collected and utilised with other research data to examine the relationships between network measures and other attributes of individuals and organisations, and how it can be linked to other approaches in multiple methods studies.
What are the implications for practice or research from your talk?
SNA is an approach that draws from theories of social capital to study the relational ties that exist between actors or institutions in a specific context. Such ties might include learning exchanges or advice-seeking interactions. SNA techniques allow researchers to incorporate the interdependence of participants within their research questions, whereas many traditional techniques assume our participants, and their responses to our questions, are independent of one another.
Application of Significance Tests to Massive Open Online Courses (MOOCs)FutureLearn FLAN
Presented by Simon Coton and Steve Cayzer of the University of Bath at The Open University, Milton Keynes, UK on 15 June 2017. This presentation formed part of the FutureLearn Academic Network section (FLAN Day) of the 38th Computers and Learning Research Group (CALRG) conference. For full details, see http://cloudworks.ac.uk/cloudscape/view/3004
Massive open online courses or MOOCs were predicted to achieve world domination and completely transformation of higher education. Today, these predictions are seen to have been overblown. But with several years of experience now behind them, MOOC providers and users are adjusting both their perceptions about online learning and the courses themselves. Mainly based on empirical research articles and reports and interviews with K-MOOC providers, this paper examines impacts of MOOCs on higher education and analyze K-MOOC as an illustrative case. For this, it asks such questions as: 1) have MOOCs expanded higher education and provided access for all, especially for the socially marginalized groups? 2) have MOOCs improved the quality of campus-based higher education? 3) have MOOCs reduced the costs to the providers and users? It will conclude with discussion of the emerging issues and future directions.
Methodological innovation for mathematics education researchChristian Bokhove
In this talk I will highlight how innovative research methods can help us in answering research questions for mathematics education. Some examples will be:
The use of social network analysis for communication networks of trainee mathematics teachers, as well as interactions in the mathematics classroom.
The use of sequence analysis for analysing data from an online mathematics tool.
The usefulness of open approaches to improve research transparency.
I will draw these projects together to sketch some interesting directions for mathematics education research.
A Query Routing Model to Rank Expertcandidates on TwitterJonathas Magalhães
Online Social Networks (OSNs) have become very popular and new ways of use their virtual environment have emerged. One of these new ways is a method to obtain information online called Social Query that consists of sharing a question on an OSN and waiting for answers come from contacts. The usual strategy is sharing a question that will be visible to everyone (public). However, this way there is no guarantee that an answer will be received neither about the quality of the answer. Directing the question to an expert about its subject (Query Routing) is a better strategy, but decides to whom direct the question is not always an easy task. In this work, we propose and evaluate a model to decide who user is the most able to receive a question and answer it correctly and quickly. The differential of our research is that we focused in OSNs context and leaded with the recommendation as multi-criteria decision making problem. Our evaluation shows promising results and confirms the great performance of our proposal.
VII Jornadas eMadrid "Education in exponential times". Mesa redonda eMadrid L...eMadrid network
VII Jornadas eMadrid "Education in exponential times". Mesa redonda eMadrid Learning Analytics. "The contributions of Data Visualization & Learning Analytics for Online Courses". Ruth Cobos Pérez. 04/07/2017.
If MOOCs are the answer, did we ask the right questions? Implications for the...Marco Kalz
Kalz, M. (2013). If MOOCs are the answer, did we ask the right questions? Implications for the design of large-scale online courses. Presentation given at the 3rd Annual Research Conference of the Maastricht School of Management. Revolutions in Education: New Opportunities for Development? 6 September 2013, Maastricht, The Netherlands.
To download this presentation please see http://dspace.ou.nl
MOOC Dropout Prediction Using Machine Learning Techniques: Review and Researc...Fisnik Dalipi
MOOC represents an ultimate way to deliver educational content in higher education settings by providing high-quality educational material to the students throughout the world. Considering the differences between traditional learning paradigm and MOOCs, a new research agenda focusing on
predicting and explaining dropout of students and low completion rates in MOOCs has emerged. However, due to different problem specifications and evaluation metrics, performing a comparative analysis of state-of-the-art machine learning architectures is a challenging task. In this paper, we provide an overview of the MOOC student dropout prediction phenomenon where machine learning techniques have been utilized. Furthermore, we highlight some solutions being used to tackle with dropout problem, provide an analysis about the challenges of prediction models, and propose some valuable insights and recommendations that might lead to developing useful and effective machine learning solutions to solve the MOOC dropout problem.
[DSC Europe 22] Machine learning algorithms as tools for student success pred...DataScienceConferenc1
The goal of higher education institutions is to provide quality education to students. Predicting academic success and early intervention to help at-risk students is an important task for this purpose. This talk explores the possibilities of applying machine learning in developing predictive models of academic performance. What factors lead to success at university? Are there differences between students of different generations? Answers are given by applying machine learning algorithms to a data set of 400 students of three generations of IT studies. The results show differences between students with regard to student responsibility and regularity of class attendance and great potential of applying machine learning in developing predictive models.
Social Network Analysis: applications for education researchChristian Bokhove
What is your talk about?
This seminar will illustrate various social network analysis (SNA) techniques and measures and their applications to research problems in education. These applications will be illustrated from our own research utilising a range of SNA techniques.
What are the key messages of your talk?
We will cover some of the ways in which network data can be collected and utilised with other research data to examine the relationships between network measures and other attributes of individuals and organisations, and how it can be linked to other approaches in multiple methods studies.
What are the implications for practice or research from your talk?
SNA is an approach that draws from theories of social capital to study the relational ties that exist between actors or institutions in a specific context. Such ties might include learning exchanges or advice-seeking interactions. SNA techniques allow researchers to incorporate the interdependence of participants within their research questions, whereas many traditional techniques assume our participants, and their responses to our questions, are independent of one another.
Application of Significance Tests to Massive Open Online Courses (MOOCs)FutureLearn FLAN
Presented by Simon Coton and Steve Cayzer of the University of Bath at The Open University, Milton Keynes, UK on 15 June 2017. This presentation formed part of the FutureLearn Academic Network section (FLAN Day) of the 38th Computers and Learning Research Group (CALRG) conference. For full details, see http://cloudworks.ac.uk/cloudscape/view/3004
Massive open online courses or MOOCs were predicted to achieve world domination and completely transformation of higher education. Today, these predictions are seen to have been overblown. But with several years of experience now behind them, MOOC providers and users are adjusting both their perceptions about online learning and the courses themselves. Mainly based on empirical research articles and reports and interviews with K-MOOC providers, this paper examines impacts of MOOCs on higher education and analyze K-MOOC as an illustrative case. For this, it asks such questions as: 1) have MOOCs expanded higher education and provided access for all, especially for the socially marginalized groups? 2) have MOOCs improved the quality of campus-based higher education? 3) have MOOCs reduced the costs to the providers and users? It will conclude with discussion of the emerging issues and future directions.
Methodological innovation for mathematics education researchChristian Bokhove
In this talk I will highlight how innovative research methods can help us in answering research questions for mathematics education. Some examples will be:
The use of social network analysis for communication networks of trainee mathematics teachers, as well as interactions in the mathematics classroom.
The use of sequence analysis for analysing data from an online mathematics tool.
The usefulness of open approaches to improve research transparency.
I will draw these projects together to sketch some interesting directions for mathematics education research.
A Query Routing Model to Rank Expertcandidates on TwitterJonathas Magalhães
Online Social Networks (OSNs) have become very popular and new ways of use their virtual environment have emerged. One of these new ways is a method to obtain information online called Social Query that consists of sharing a question on an OSN and waiting for answers come from contacts. The usual strategy is sharing a question that will be visible to everyone (public). However, this way there is no guarantee that an answer will be received neither about the quality of the answer. Directing the question to an expert about its subject (Query Routing) is a better strategy, but decides to whom direct the question is not always an easy task. In this work, we propose and evaluate a model to decide who user is the most able to receive a question and answer it correctly and quickly. The differential of our research is that we focused in OSNs context and leaded with the recommendation as multi-criteria decision making problem. Our evaluation shows promising results and confirms the great performance of our proposal.
VII Jornadas eMadrid "Education in exponential times". Mesa redonda eMadrid L...eMadrid network
VII Jornadas eMadrid "Education in exponential times". Mesa redonda eMadrid Learning Analytics. "The contributions of Data Visualization & Learning Analytics for Online Courses". Ruth Cobos Pérez. 04/07/2017.
These are sldies from keynote at TCC2013, the 18th annual online conference hosted from Hawaii. These are mostly a remix of ideas from my 3 Generations of Online pedagogy and EQiv theories with examples from MOOCs
Multimodal Course Design and Implementation using LEML and LMS for Instructio...IJMIT JOURNAL
Traditionally, teaching has been centered around classroom delivery. However, the onslaught of the
COVID-19 pandemic has cultivated usage of technology, teaching, and learning methodologies for course
delivery. We investigate and describe different modes of course delivery that maintain the integrity of
teaching and learning. This paper answers to the research questions: 1) What course delivery method our
academic institutions use and why? 2) How can instructors validate the guidelines of the institutions? 3)
How courses should be taught to provide student learning outcomes? Using the Learning Environment
Modeling Language (LEML), we investigate the design and implementation of courses for delivery in the
following environments: face-to-face, online synchronous, asynchronous, hybrid, and hyflex. A good
course design and implementation are key components of instructional alignment. Furthermore, we
demonstrate how to design, implement, and deliver courses in synchronous, asynchronous, and hybrid
modes and describe our proposed enhancements to LEML.
MULTIMODAL COURSE DESIGN AND IMPLEMENTATION USING LEML AND LMS FOR INSTRUCTIO...IJMIT JOURNAL
Traditionally, teaching has been centered around classroom delivery. However, the onslaught of the
COVID-19 pandemic has cultivated usage of technology, teaching, and learning methodologies for course
delivery. We investigate and describe different modes of course delivery that maintain the integrity of
teaching and learning. This paper answers to the research questions: 1) What course delivery method our
academic institutions use and why? 2) How can instructors validate the guidelines of the institutions? 3)
How courses should be taught to provide student learning outcomes? Using the Learning Environment
Modeling Language (LEML), we investigate the design and implementation of courses for delivery in the
following environments: face-to-face, online synchronous, asynchronous, hybrid, and hyflex. A good
course design and implementation are key components of instructional alignment. Furthermore, we
demonstrate how to design, implement, and deliver courses in synchronous, asynchronous, and hybrid
modes and describe our proposed enhancements to LEML.
MULTIMODAL COURSE DESIGN AND IMPLEMENTATION USING LEML AND LMS FOR INSTRUCTIO...IJMIT JOURNAL
Traditionally, teaching has been centered around classroom delivery. However, the onslaught of the
COVID-19 pandemic has cultivated usage of technology, teaching, and learning methodologies for course
delivery. We investigate and describe different modes of course delivery that maintain the integrity of
teaching and learning. This paper answers to the research questions: 1) What course delivery method our
academic institutions use and why? 2) How can instructors validate the guidelines of the institutions? 3)
How courses should be taught to provide student learning outcomes? Using the Learning Environment
Modeling Language (LEML), we investigate the design and implementation of courses for delivery in the
following environments: face-to-face, online synchronous, asynchronous, hybrid, and hyflex. A good
course design and implementation are key components of instructional alignment. Furthermore, we
demonstrate how to design, implement, and deliver courses in synchronous, asynchronous, and hybrid
modes and describe our proposed enhancements to LEML.
Personalized learning is one of the main ideals that many educational institutions strive to provide for their students. Learning analytics with its promise to help understand and optimize learning and the environments in which learning happens has eagerly been received in this context. Existing research in learning analytics has dedicated much attention to studies that aimed at identifying factors predicting different learning outcomes based on learners’ interaction with technology. Existing research indicates that learning is a dynamic process that is driven by feedback loops. If those feedback loops are not accounted for comprehensively, opportunities for creating personalized learning experiences are limited. However, there is the dearth of research that focuses on understanding how learning unfolds over a certain period of time under different conditions. This talk will describe different factors that influence students’ feedback loops and decision making. The talk will also discuss insights gained in several case studies that looked at dynamic models of learning.
Videos are used extensively in cyber learning. Analyzing video data and using interactive videos in cyberlearning are emerging areas in learning technologies and big data analytics.
Novel video analytics tools can transform traditional (linear) videos into interactive learning objects; therefore improve the classroom interactions and students’ engagements. Data from cybersecurity program at University of Maryland show that students’ engagements improved six times after a video analytics tool (inVideo) was introduced.
The presenter will discuss the latest development of inVideo, a video analytics tool that is able to analyze video content automatically in both language and frames. In addition, the presenter will discuss correlations between low accuracy in automatic transcripts with early recording methods that produce huge ambient noises and echo. The research finding is helpful for curricula developments in cyberlearning so that newly produced videos can be indexed, searched and annotated.
Using the video data analytics technologies, long videos can be easily “cropped” and annotated so that learners can easily focus on important concepts during their study. Though tested in cybersecurity education, this technology can be easily applied to math and other STEM subjects in cyberlearning setting.
In this presentation we describe computer aided assessment methods used in online Calculus courses and the data they produce. The online learning environment collects also a lot of timestamped data about every action a student makes. Furthermore, information about students’ learning styles, motivation and perception of self efficacy is collected by questionnaires.
Mika Seppälä started intensive work at the University of Helsinki to develop online materials and tools for learning mathematics since 2001. He worked also as a professor at the Florida State University where he utilized these methods in Calculus teaching. The open online course “Single Variable Calculus” was held in Helsinki 2004. This seminal work evolved into a complete online English Calculus curriculum starting from the Fall 2013 and soon recognized as an alternative route for taking traditional university Calculus courses in Helsinki.
Automatic assessment systems of mathematical competencies, such as STACK and WeBWorK, can take student’s answer as a mathematical object, e.g. a function or an equation, and check whether it satisfies the requirements set for a correct answer as well as give immediate and meaningful feedback. That is a powerful tool especially for formative assessment: log data shows that many students prefer to start with quizzes and when necessary, consult lecturing materials. Automated diagnostic tests give students information where they stand before starting to study Calculus and feedback about how to rehearse for that. Peer assessment is also used in online Calculus courses. There students evaluate and give constructive feedback to other students’ work, which should be a complete and clear presentation of a solution to a problem with correct argumentation.
The first requirement for an online mathematics homework engine is to encourage students to practice and reinforce their mathematics skills in ways that are as good or better than traditional paper homework. The use of the computer and the internet should not limit the kind or quality of the mathematics that we teach and if possible it should expand it.
Now that much of the homework practice takes place online we have the potential of a new and much better window into how students learn mathematics but we must continue to ensure that students are studying the mathematics we want to have learned and not just mathematics that is easily gradable. Several of the open source mathematics engines that do this well are represented at this conference.
The WeBWorK mathematics rendering engine started twenty years ago as a stand alone application. Since then homework questions contributed by many, many mathematicians to the OpenProblemLibrary (OPL) have created a collection of over 30,000 Creative Commons licensed problems primarily directed toward calculus but ranging from basic algebra through matrix linear algebra.
I’ll present one of the adaptations of WeBWorK which allows it to render mathematics questions for a standard Moodle quiz in much the same way that STACK functions. Both STACK and WeBWorK vastly increase Moodle’s ability to handle mathematics. Using the Moodle quiz format will make the OPL available to many more educators and allows utilization of Moodle’s facility at collecting student data.
If there is time I’ll show a second adaptation which allows WeBWorK to serve as an assignment type within Moodle. These same mechanisms allow active WeBWorK questions to be embedded in other learning management systems, in interactive textbooks and even HTML pages. This capability fits well with an emerging trend to use smaller, more specialized, inter-operating components for online education.
We examined predictors of Calculus II final grades within a sample of 84 college students enrolled in a hybrid course through WEPS. Predictors included “typical” psychological correlates, including math confidence, math anxiety, spatial skills and numerosity ability, as well as clickstream data from the students’ activity in the online course. Results showed the clickstream data were the best predictors of course performance, in that students who spent more time grading other students’ assignments, and students who took fewer quiz attempts, did better in the course. Math confidence and then math anxiety were the next best predictors, in that students with higher confidence and lower math anxiety performed better in the course. We will discuss how results might be dependent on the particular content of this course, and how we might use easy to collect psychological variables along with clickstream data to better understand, and potentially predict, course performance in online courses.
How to Create Map Views in the Odoo 17 ERPCeline George
The map views are useful for providing a geographical representation of data. They allow users to visualize and analyze the data in a more intuitive manner.
Students, digital devices and success - Andreas Schleicher - 27 May 2024..pptxEduSkills OECD
Andreas Schleicher presents at the OECD webinar ‘Digital devices in schools: detrimental distraction or secret to success?’ on 27 May 2024. The presentation was based on findings from PISA 2022 results and the webinar helped launch the PISA in Focus ‘Managing screen time: How to protect and equip students against distraction’ https://www.oecd-ilibrary.org/education/managing-screen-time_7c225af4-en and the OECD Education Policy Perspective ‘Students, digital devices and success’ can be found here - https://oe.cd/il/5yV
How to Make a Field invisible in Odoo 17Celine George
It is possible to hide or invisible some fields in odoo. Commonly using “invisible” attribute in the field definition to invisible the fields. This slide will show how to make a field invisible in odoo 17.
Operation “Blue Star” is the only event in the history of Independent India where the state went into war with its own people. Even after about 40 years it is not clear if it was culmination of states anger over people of the region, a political game of power or start of dictatorial chapter in the democratic setup.
The people of Punjab felt alienated from main stream due to denial of their just demands during a long democratic struggle since independence. As it happen all over the word, it led to militant struggle with great loss of lives of military, police and civilian personnel. Killing of Indira Gandhi and massacre of innocent Sikhs in Delhi and other India cities was also associated with this movement.
Instructions for Submissions thorugh G- Classroom.pptxJheel Barad
This presentation provides a briefing on how to upload submissions and documents in Google Classroom. It was prepared as part of an orientation for new Sainik School in-service teacher trainees. As a training officer, my goal is to ensure that you are comfortable and proficient with this essential tool for managing assignments and fostering student engagement.
The Indian economy is classified into different sectors to simplify the analysis and understanding of economic activities. For Class 10, it's essential to grasp the sectors of the Indian economy, understand their characteristics, and recognize their importance. This guide will provide detailed notes on the Sectors of the Indian Economy Class 10, using specific long-tail keywords to enhance comprehension.
For more information, visit-www.vavaclasses.com
2024.06.01 Introducing a competency framework for languag learning materials ...Sandy Millin
http://sandymillin.wordpress.com/iateflwebinar2024
Published classroom materials form the basis of syllabuses, drive teacher professional development, and have a potentially huge influence on learners, teachers and education systems. All teachers also create their own materials, whether a few sentences on a blackboard, a highly-structured fully-realised online course, or anything in between. Despite this, the knowledge and skills needed to create effective language learning materials are rarely part of teacher training, and are mostly learnt by trial and error.
Knowledge and skills frameworks, generally called competency frameworks, for ELT teachers, trainers and managers have existed for a few years now. However, until I created one for my MA dissertation, there wasn’t one drawing together what we need to know and do to be able to effectively produce language learning materials.
This webinar will introduce you to my framework, highlighting the key competencies I identified from my research. It will also show how anybody involved in language teaching (any language, not just English!), teacher training, managing schools or developing language learning materials can benefit from using the framework.
The Roman Empire A Historical Colossus.pdfkaushalkr1407
The Roman Empire, a vast and enduring power, stands as one of history's most remarkable civilizations, leaving an indelible imprint on the world. It emerged from the Roman Republic, transitioning into an imperial powerhouse under the leadership of Augustus Caesar in 27 BCE. This transformation marked the beginning of an era defined by unprecedented territorial expansion, architectural marvels, and profound cultural influence.
The empire's roots lie in the city of Rome, founded, according to legend, by Romulus in 753 BCE. Over centuries, Rome evolved from a small settlement to a formidable republic, characterized by a complex political system with elected officials and checks on power. However, internal strife, class conflicts, and military ambitions paved the way for the end of the Republic. Julius Caesar’s dictatorship and subsequent assassination in 44 BCE created a power vacuum, leading to a civil war. Octavian, later Augustus, emerged victorious, heralding the Roman Empire’s birth.
Under Augustus, the empire experienced the Pax Romana, a 200-year period of relative peace and stability. Augustus reformed the military, established efficient administrative systems, and initiated grand construction projects. The empire's borders expanded, encompassing territories from Britain to Egypt and from Spain to the Euphrates. Roman legions, renowned for their discipline and engineering prowess, secured and maintained these vast territories, building roads, fortifications, and cities that facilitated control and integration.
The Roman Empire’s society was hierarchical, with a rigid class system. At the top were the patricians, wealthy elites who held significant political power. Below them were the plebeians, free citizens with limited political influence, and the vast numbers of slaves who formed the backbone of the economy. The family unit was central, governed by the paterfamilias, the male head who held absolute authority.
Culturally, the Romans were eclectic, absorbing and adapting elements from the civilizations they encountered, particularly the Greeks. Roman art, literature, and philosophy reflected this synthesis, creating a rich cultural tapestry. Latin, the Roman language, became the lingua franca of the Western world, influencing numerous modern languages.
Roman architecture and engineering achievements were monumental. They perfected the arch, vault, and dome, constructing enduring structures like the Colosseum, Pantheon, and aqueducts. These engineering marvels not only showcased Roman ingenuity but also served practical purposes, from public entertainment to water supply.
1.4 modern child centered education - mahatma gandhi-2.pptx
Christopher Brooks SOED 2016
1. brooksch@umich.edu @cab938
Shape of Educational Data:
Predictive Modeling as an Enabler of
Personalized Learning
Christopher Brooks
Research Assistant Professor, School of Information
Director of Learning Analytics and Research
Digital Education and Innovation
University of Michigan
2. brooksch@umich.edu @cab938
Psychohistory
“…[it] combined history, psychology and
mathematical statistics to create a (nearly)
exact science of the behavior of very large
populations of people…Asimov used the analogy
of a gas: in a gas, the motion of a single
molecule is very difficult to predict, but the mass
action of the gas can be predicted to a high level
of accuracy. Asimov applied this concept to the
population of the fictional Galactic Empire, which
numbered in the quadrillions.”
http://asimov.wikia.com/wiki/Psychohistory
3. brooksch@umich.edu @cab938
• "Averaginarianism"
• Regression towards a mean that
doesn't actually naturally exist
• There is a gulf between the
predictive modeling perspectives,
and the explanatory modeling
ones
4. brooksch@umich.edu @cab938
Research Perspective
• Learners are individuals
• There is nuance in data that is
important and being missed by
studying populations vs.
individuals
• Computational modelling (esp.
predictive modelling) has
opportunity to help
6. brooksch@umich.edu @cab938
Lecture Capture
• How do students integrate educational technologies into their study habits?
– (and do those technologies have any effect?)
• A need for insight
– Studies largely show only student satisfaction benefits from lecture capture
– Several studies show no effect to the use of lecture capture on performance
• Data mining for usage patterns
– Apply unsupervised machine learning methods (k-means clustering) to viewership data by
week
– Then built general model from prototypes and apply to new datasets and determine fit
(replication)
7. brooksch@umich.edu @cab938
Results (Chemistry 2xx 2010)
• 5 groups found, each pedagogically labelled (by investigators!)
• Error and size of groups ranges considerably
• The final exam period is not indicative of activity throughout semester
10. brooksch@umich.edu @cab938
Results
• Not a predictive model,
but a more discriminate
descriptive model
– Showed an effect not for general use of lecture
capture, but for specific ways of using lecture capture
• Replication suggests there is merit to the model, but
that it is highly contextualized (theme of course)
• Data from more sources could add further detail to the
model as to causal effects
Brooks, C. A., Erickson, G., Greer, J. E.,
Gutwin, C. (2014) Modelling and Quantifying
the Behaviours of Students in Lecture Capture
Environments. In Computers & Education. Vol
75 June. pages 282-292.
12. brooksch@umich.edu @cab938
Massive Open Online Courses
• As of the end of 2014, MOOCs at Michigan have attracted
1.9 million enrollees and nearly 1 million participants
• Of these participants, ~ 300K attempt some assessment
task, ~80K end up passing the course (certificate)
• Can we do better in understanding student success in this
environment?
• Could we predict who is at-risk for students who want to
obtain a certificate?
13. brooksch@umich.edu @cab938
• MOOCs lack the diversity of data we have about residential students
– Previous achievement (SAT/ACT, last years course)
– Socioeconomic status (distance from university, first in family,
wealth)
– Gender
– Ethnicity
– Motivation
• Building predictive models of student achievement in learning
analytics is largely done on these entry-level features
• Both frustrating and refreshing
– Want accurate models, but want actionable data
14. brooksch@umich.edu @cab938
• Built a novel feature selection algorithm inspired by
work in the text-mining community
• It looks at the pattern of engagement that a student
has with course resources
• Build of historical data (last years course) to create
day-by-day multilevel models (C4.5)
• Initial work is based on student certificate
achievement (pass/fail)
–(not the only valuable outcome variable to try and
predict!)
15. brooksch@umich.edu @cab938
Resour
ce
Day of Course
1 2 3 4 5 6 7 8 9
Video
Daily Accesses
Day 1: Yes
Day 2: No
Day 3: Yes
Day 4: No
Day 5: No
Day 6: No
Day 7: No
Day 8: Yes
Day 9: No
3-Day counts
Day 1-3: Yes
Day 4-6: No
Day 7-9: Yes
Weekly counts
Week 1: Yes
Week 2: Yes
Monthly counts
Month 1: Yes
For a 104 day long course,
with three resources
(videos, forums, quizzes)
this gives us 408 features
for the modelling activity.
16. brooksch@umich.edu @cab938
Text Mining Inspiration
• Text mining often uses n-grams as features in a document
– A bigram (cat, good) is the number of pairs of these two words in a document, a
trigam (cat, was not good), etc.
– We build engagement n-grams up to 5 gram
Daily Accesses
Day 1: Yes
Day 2: No
Day 3: Yes
Day 4: No
Day 5: No
Day 6: No
Day 7: No
Day 8: Yes
Day 9: No
Possible bigrams
[yes, yes]: 0
[no, no]: 3
[yes, no]: 3
[no, yes]: 2
Possible trigrams:
[yes, yes, yes]: 0
[yes, yes, no]: 0
[yes, no, yes]: 1
…
For a 104 day long course,
with three resources
(videos, forums, quizzes)
this gives us 717 more
features for the modelling
activity.
17. brooksch@umich.edu @cab938
In a nutshell
• We do not have diverse set of data, but
we do have a detailed set of data
• And there is a lot of it (200 million+
clickstream events)
• By pulling out patterns of resource
access, we can use supervised machine
learning (C4.5) techniques to build
predictive models
• But what if we did have entry data
from students?
– Gender & Ethnicity, certification
status, country of origin, etc.
18. brooksch@umich.edu @cab938
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49 51 53 55 57 59 61 63 65 67 69 71 73 75
Fliess'κ
Day of Course Offering
Fliess' κ versus Time in Days
Activity Features Only
Demographics Features Only
Activity and Demographics Features
19. brooksch@umich.edu @cab938
Results
• It is possible to create predictive models on clickstream data for MOOCs
• 3 weeks into the MOOC seems to be an interesting point for some courses
• It is computationally intensive to create these models (daily!)
• MOOC entry/demographics information does not seem to add value
C. Brooks, C. Thompson, S. Teasley. (2015) A Time Series Interaction Analysis Method for Building Predictive
Models of Learners using Log Data. 5th International Conference on Learning Analytics and Knowledge 2015
(LAK'15)
C. Brooks, C. Thompson, S. Teasley. (2015) Who You Are or What You Do: Comparing the Predictive Power of
Demographics vs. Activity Patterns in Massive Open Online Courses (MOOCs). The second annual conference on
Learning At Scale 2015 (L@S2015), Works in Progress track. Vancouver BC, March 14-15, 2015. Vancouver, BC.
21. brooksch@umich.edu @cab938
No Particular Night or Morning
“I looked at the page with my name under the
title…it was some other man…the story was
familiar – I knew I had written it – but that name
on the paper still was not me. It was a symbol, a
name.”
“I’ve always figured it that you die each day, and
each day is a box…but you never go back and lift
the lids...each is a different you, somebody you
do not know or understand or want to
understand.
”
22. brooksch@umich.edu @cab938
Questions? Comments?
Christopher Brooks
Research Assistant Professor, School of Information
Director of Learning Analytics and Research
in Digital Education and Innovation
University of Michigan
brooksch@umich.edu
@cab938
Editor's Notes
Generalize the model to some theoretical constructs
Some statistical significance in the chemistry courses
Biomolecules class has less statistical rigor, but it seems like there might be an effect
Reminder: BMSC course was half the size of the chemistry 2011 course, and students can use any other study aid, these are field studies
Recently, predictive models were used by a University President to pressure students to unenroll with the aim of increasing student success measures.
Predictive models will allow us to target individuals, but we need to remember that models are not necessarily causal, and tend to have huge accuracy challenges.
There are ethical obligations we have as the creators of models, especially as models become more complex and difficult to interpret.