Barbour, M. K. (2011, November). What do we really know? Examining research into K-12 online learning. An invited presentation in the Doctoral Speaker Series in the Faculty of Education at Memorial University of Newfoundland, St. John’s, NL.

1. What Do We Really Know?
Examining Research into
K-12 Online Learning
Michael K. Barbour
Assistant Professor
Wayne State University

2. 2

3. Literature Reviews
1. Rice (2006)
– Journal of Research on Technology in
Education
1. Barbour & Reeves (2009)
– Computers and Education
1. Cavanaugh, Barbour, & Clark (2009)
– International Review of Research in Open

4. What does the literature say?
• “based upon the personal experiences of
those involved in the practice of virtual
schooling” (Cavanaugh et al., 2009)
• described the literature as generally falling
into one of two general categories: the
potential benefits of and challenges facing K-
12 online learning (Barbour & Reeves, 2009)

5. What about research?
• “a paucity of research exists when
examining high school students enrolled
in virtual schools, and the research base
is smaller still when the population of
students is further narrowed to the
elementary grades”
(Rice, 2006)

6. What does the research say?
1. Comparisons of student performance based upon
delivery model (i.e., classroom vs. online)
2. Studies examining the qualities and characteristics
of the teaching/learning experience
– characteristics of
– supports provided to
– issues related to isolation of online learners (Rice, 2006)
1. Effectiveness of virtual schooling
2. Student readiness and retention issues (Cavanaugh
et al., 2009)

7. So, what does the student
performance research say?

8. Student Performance
• performance of virtual
and classroom students
in Alberta were similar
in English and Social
Studies courses, but
that classroom students
performed better
overall in all other
subject areas (Ballas &
Belyk, 2000)

9. Student Performance
• over half of the students who
completed FLVS courses
scored an A in their course and
only 7% received a failing
grade (Bigbie & McCarroll,
2000)
• students in the six virtual
schools in three different
provinces performed no worse
than the students from the
three conventional schools
(Barker & Wendel, 2001)

10. Student Performance
• FLVS students performed
better on a non-mandatory
assessment tool than students
from the traditional classroom
(Cavanaugh et al., 2005)
• FLVS students performed
better on an assessment of
algebraic understanding than
their classroom counterparts
(McLeod et al., 2005)

11. Barbour & Mulcahy (2008)

12. Barbour & Mulcahy (2009)

13. Let’s look a little closer...

14. Students and Student Performance
Ballas & performance of virtual and participation rate in the
Belyk, 2000 classroom students similar assessment among virtual
in English & Social Studies students ranged from 65% to
courses, but classroom 75% compared to 90% to
students performed better 96% for the classroom-based
in all other subject areas students
Bigbie & over half of the students between 25% and 50% of
McCarroll, who completed FLVS students had dropped out
2000 courses scored an A in of their FLVS courses over
their course and only 7% the previous two-year
received a failing grade period

15. Students and Student Performance
Cavanaugh et FLVS students performed speculated that the virtual
al., 2005 better on a non- school students who did
mandatory assessment take the assessment may
tool than students from have been more
the traditional classroom academically motivated and
naturally higher achieving
students
McLeod et FLVS students performed results of the student
al., 2005 better on an assessment performance were due to
of algebraic understanding the high dropout rate in
than their classroom virtual school courses
counterparts

16. Student Performance and Students
So are we really
comparing apples to
apples?

17. The Students
• the vast majority of VHS
Global Consortium students
in their courses were
planning to attend a
four-year college (Kozma,
Zucker & Espinoza, 1998)
• “VHS courses are
predominantly designated as
‘honors,’ and students
enrolled are mostly college
bound” (Espinoza et al., 1999)

18. The Students
The preferred characteristics
include the highly motivated,
self-directed, self-disciplined,
independent learner who
could read and write well,
and who also had a strong
interest in or ability with
technology (Haughey &
Muirhead, 1999)

19. The Students
• “only students with a high
need to control and structure
their own learning may
choose distance formats
freely” (Roblyer & Elbaum,
2000)
• IVHS students were “highly
motivated, high achieving,
self-directed and/or who liked
to work independently” (Clark
et al., 2002)

20. The Students
• the typical online student
was an A or B student
(Mills, 2003)
• 45% of the students who
participated in e-learning
opportunities in Michigan
were “either advanced
placement or
academically advanced”
students (Watkins, 2005)

21. But does this represent all of
our online students?

22. Student Reality???
• two courses with the highest enrollment of online
students in the US are Algebra I & Algebra II
(Patrick, 2007)
• largest proportion of growth in K–12 online
learning enrollment is with full-time cyber schools
(Watson et al., 2008)
• many cyber schools have a higher percentage of
students classified as “at-risk” (Klein, 2006)
• at-risk students are as those who might otherwise
drop out of traditional schools (Rapp, Eckes &
Plurker, 2006)

23. Literature
indicates K-12
online learning
students are...

24. Reality of most or
a large segment
K-12 online
learning
students?

25. Mulcahy, Dibbon and Norberg (2008)
• study of rural schooling in
three schools on the south
coast of the Labrador
• found two had a higher
percentage of students
enrolled in basic-level courses
• speculated because the only
way students could do
academic course at their
school was online, some
students specifically chose the
basic stream to avoid taking an
online course

26. Enrollment - English Language Arts

27. Enrollment - Mathematics

28. Problem With Student
Performance Studies

29. Cavanaugh (2001)
• Allen & Thompson (1995) • Libler (1991)
• Blanton et al. (1997) • Martin & Rainey (1993)
• Burkman (1994) • McBride (1990)
• Center for Applied Special • Riel (1990)
• Rudolf (1986)
Technology (1996)
• Ryan (1996)
• Erickson (1992)
• Sisung (1992)
• Gray (1996)
• Smith (1990)
• Hinnant (1994)
• Wick (1997)

30. Problem of Effect Sizes
Reverse
Effects

31. Problem of Effect Sizes
Developmental
Effects

32. Problem of Effect Sizes
Teacher
Effects

33. Problem of Effect Sizes
Zone of
Desired Effects

34. Synthesis of Meta-Analysis
• Cavanaugh (2001) - 16 studies
– +0.147 in favor of K-12 distance education
• Cavanaugh et al. (2004) - 14 studies
– -0.028 for K-12 distance education
• Means et al. (2009) - 46 studies (5 on K-12)
– +0.24 favoring online over face-to-face
– +0.35 favoring blended over face-to-face*

35. Results of Interest
• Second and third chance programs (d=0.50)
• Matching style of learning (d=0.40)
• Computer assisted instruction (d=0.37)
• Decreasing disruptive behavior (d=0.34)
• Programmed instruction (d=0.24)
• Individualized instruction (d=0.23)
• Class size (d=0.21)
• Charter schools (d=0.20)
• Web-based learning (d=0.18)
• Home-school programs (d=0.16)
• Teacher training (d=0.11)
• Teacher subject matter knowledge (d=0.09)
• Distance education (d=0.09)
• Student control over learning (d=0.04)
35

36. Results to Consider
• Self-reported grades (d=1.44)
• Piagetian programs (d=1.28)
• Providing formative evaluation (d=0.90)
• Micro teaching (d=0.88)
• Acceleration (d=0.88)
• Classroom behavioral (d=0.80)
• Comprehensive interventions for learning disabled students (d=0.78)
• Teacher clarity (d=0.75)
• Reciprocal teaching (d=0.74)
• Providing feedback (d=0.73)
• Teacher-student relationships (d=0.72)
• Spaced vs. mass practice (d=0.71)
• Meta-cognitive strategies (d=0.69)
• Prior achievement (d=0.67)
• Vocabulary programs (d=0.67

37. What about the other research?

38. Problematic Research
Online 7 principles of Interviews with teachers and course
Course effective online developers at a single virtual school,
Design course content with no verification of whether the
for adolescent interviewees’ perceptions were actually
Barbour learners effective or any student input at all for
(2005; 2007) that matter.
Online 37 best Interviews with teachers at a single
Teaching practices in virtual school selected by the virtual
asynchronous school itself. Their teachers’ beliefs
DiPietro et online teaching were not validated through observation
al. (2008) of the teaching or student performance.

39. Is there a better way?

40. Design-Based Research
Reeves (2006)

42. Virtual High School Global Consortium
• first annual evaluation
– Kozma, Zucker &
Espinoza, 1998
• focused specifically on
the seven goals set by
VHS
• identified five areas to
focus on for future
practice

43. Virtual High School Global Consortium
• second annual
evaluation
– Espinoza, Dove, Zucker
& Kozma, 1999
• again focused
specifically on the
seven goals set by VHS
• identified three areas
to focus on for future
practice

44. Virtual High School Global Consortium
• third annual evaluation
– Kozma, Zucker,
Espinoza, McGhee,
Yarnall & Zalles, 2000
• re-examined status of
last year’s evaluation
finding
• focused upon only one
of the seven goals set
by VHS

45. Virtual High School Global Consortium
• content-specific
investigations
– Yamashiro & Zucker, 1999
• examined quality of
netcourses offered by
VHS
• developed standards for
future course
development

46. Virtual High School Global Consortium
• content-specific
investigations
– Elbaum, McIntyre &
Smith, 2002
• seventeen essential
elements for online
teaching
• written by VHS staff

47. Virtual High School Global Consortium
• final evaluation
– Zucker & Kozma, 2003
• examined students,
teachers,
administrators
perceptions of the
program
• outlined successes and
areas to focus on for
future years

48. The Challenge
Whether online
learning can
be suitable for
all K-12
students?
(Mulcahy, 2002)

49. United States
• 40,000 - 50,000 in 2001
• ~4,000,000 in 2010
Canada
• 10,000 - 15,000 in 1999
• ~185,000 in 2010

50. United States - 7.2% of all
students
Canada - 4.2% of all
students

51. Your
Questions
and
Comments

52. Assistant Professor
Wayne State University, USA
mkbarbour@gmail.com
http://www.michaelbarbour.com
http://virtualschooling.wordpress.com