Factors Influencing Instructor Success in Online CoursesPhil Ice, Ed.D.SALT, Washington Interactive Technologies Conference2009

What Factors Influence Instructor Success in Online Courses?

Using the Community of Inquiry Framework to Measure Successproposed in 2000 by Garrison, Anderson and Archera process model of learning in online and blended educational environmentsgrounded in a collaborative constructivist view of higher educationassumes effective online learning requires the development of a community of learners that supports meaningful inquiry and deep learning

proposed in 2000 by Garrison, Anderson and Archer

a process model of learning in online and blended educational environments

grounded in a collaborative constructivist view of higher education

assumes effective online learning requires the development of a community of learners that supports meaningful inquiry and deep learning

social presencecognitive presenceLEARNINGteaching presence

Social Presencethe ability of participants in a community of inquiry to project themselves socially and emotionally -- as ‘real’ peoplethe degree to which participants in computer mediated communication feel socially and emotionally connected

the ability of participants in a community of inquiry to project themselves socially and emotionally -- as ‘real’ people

the degree to which participants in computer mediated communication feel socially and emotionally connected

Social Presence - Elementsaffective expression (expressing emotion, self-projection)open communication (learning climate, risk free expression)group cohesion (group identity, collaboration)

affective expression (expressing emotion, self-projection)

open communication (learning climate, risk free expression)

group cohesion (group identity, collaboration)

Cognitive Presencethe extent to which learners are able to construct and confirm meaning through sustained reflection and discourse in a critical community of inquiry

the extent to which learners are able to construct and confirm meaning through sustained reflection and discourse in a critical community of inquiry

Cognitive Presence - Elementstriggering event (sense of puzzlement)exploration (sharing information & ideas)integration (connecting ideas)resolution (synthesizing & applying new ideas)

triggering event (sense of puzzlement)

exploration (sharing information & ideas)

integration (connecting ideas)

resolution (synthesizing & applying new ideas)

Teaching Presencethe design, facilitation and direction of cognitive and social processes for the purpose of realizing personally meaningful and educationally worthwhile learning outcomes

the design, facilitation and direction of cognitive and social processes for the purpose of realizing personally meaningful and educationally worthwhile learning outcomes

Teaching Presence - Elementsdesign and organization (setting curriculum & activities) facilitation (shaping constructive discourse) direct instruction (focusing & resolving issues)

design and organization (setting curriculum & activities)

facilitation (shaping constructive discourse)

direct instruction (focusing & resolving issues)

Community of Inquiry Survey9 social presence items (3 affective expression, 3 open communication, 3 group cohesion) 12 cognitive presence items (3 triggering, 3 exploration, 3 integration, 3 resolution)13 teaching presence items (4 design & facilitation, 6 facilitation of discourse, 3 direct instruction)

9 social presence items (3 affective expression, 3 open communication, 3 group cohesion)

12 cognitive presence items (3 triggering, 3 exploration, 3 integration, 3 resolution)

13 teaching presence items (4 design & facilitation, 6 facilitation of discourse, 3 direct instruction)

CoI Survey Validationtested in graduate courses at four institutions in the US and Canadaprincipal component factor analysisthree factor model predicted by CoI framework confirmedArbaugh, Cleveland-Innes, Diaz, Garrison, Ice, Richardson, Shea & Swan – 2008now the most frequently cited process model in the literature (over 350 citations – Google Scholar)

tested in graduate courses at four institutions in the US and Canada

principal component factor analysis

three factor model predicted by CoI framework confirmed

Arbaugh, Cleveland-Innes, Diaz, Garrison, Ice, Richardson, Shea & Swan – 2008

now the most frequently cited process model in the literature (over 350 citations – Google Scholar)

Commonly Accepted FactorsCourses Previously TaughtInstitutional TrainingTechnical Support Pedagogical Guidance Origin of DegreeDegree Level

Study 1West Virginia UniversityImpact of Pedagogical Training and Technical Support (n = 18 instructor and 512 students)Training and Support hours regressed on Teaching Presence Subscales of Facilitation of Discourse and Direct InstructionNumber of courses previously taught was treated as a co-variable

West Virginia University

Impact of Pedagogical Training and Technical Support (n = 18 instructor and 512 students)

Training and Support hours regressed on Teaching Presence Subscales of Facilitation of Discourse and Direct Instruction

Number of courses previously taught was treated as a co-variable

Study 1The equation was significant - HOWEVERPedagogical Guidance accounted for 2.1% of varianceTechnical Support accounted for 1.9% of variancePrevious online teaching experience was not a significant predictor – in fact some of the highest scores came from first time instructorsIce, 2007

The equation was significant - HOWEVER

Pedagogical Guidance accounted for 2.1% of variance

Technical Support accounted for 1.9% of variance

Previous online teaching experience was not a significant predictor – in fact some of the highest scores came from first time instructors

Study 2American Public University SystemModality for last degree earned – online vs. face to faceDegree LevelCo-variables – age, gender, courses previously taught, completion of additional pedagogical trainingRegressed on Teaching Presence, Social Presence and Cognitive Presence and Facilitation of Discourse and Direct Instruction Subscales (n = 94 instructors and 4219 students)

American Public University System

Modality for last degree earned – online vs. face to face

Degree Level

Co-variables – age, gender, courses previously taught, completion of additional pedagogical training

Regressed on Teaching Presence, Social Presence and Cognitive Presence and Facilitation of Discourse and Direct Instruction Subscales (n = 94 instructors and 4219 students)

Study 2The equation was significant, HOWEVERGender was the only significant predictorBeing female accounted for 4% of the variance in Teaching Presence, Cognitive Presence and Facilitation of Discourse subscalePatrizi and Ice, 2009

The equation was significant, HOWEVER

Gender was the only significant predictor

Being female accounted for 4% of the variance in Teaching Presence, Cognitive Presence and Facilitation of Discourse subscale

So, what does matter?Research shows that commonly accepted factors have no impact.Is it all a matter of one’s outlook toward learning?

Social Basis of LearningTheory and research suggest that collaborative learning is the most effective means of facilitating learning in online environments.Based on Vygotsky’s concept of social mediated practiceCollaborative learning posits that individuals construct knowledge through dialogue, group discussion and peer modification.The success of collaborative learning is dependent upon the ability of group members to assist peers in diagnosing and modifying misconceptions.

Theory and research suggest that collaborative learning is the most effective means of facilitating learning in online environments.

Based on Vygotsky’s concept of social mediated practice

Collaborative learning posits that individuals construct knowledge through dialogue, group discussion and peer modification.

The success of collaborative learning is dependent upon the ability of group members to assist peers in diagnosing and modifying misconceptions.

Epistemology - ConstructivismProponents of constructivism argue that knowledge is created through a process of inquiry and discovery in which external stimuli are interpreted in a unique manner by each learner.A multitude of realities situated within each learner. Dependent upon learners ability to analyze, synthesize and evaluate information.Creation of meaningful, personalized knowledge.

Proponents of constructivism argue that knowledge is created through a process of inquiry and discovery in which external stimuli are interpreted in a unique manner by each learner.

A multitude of realities situated within each learner.

Dependent upon learners ability to analyze, synthesize and evaluate information.

Creation of meaningful, personalized knowledge.

Epistemology - ObjectivismLearning is a sequential process in which individual units of declarative knowledge are assembled into larger declarative, procedural and conditional constructs to define reality.Learners display an understanding of a single reality through declarative, procedural and conditional knowledge.Premised on the instructor having complete control over the materials, pace and direction of learning.Not dependent on how individuals internalize or interpret such information

Learning is a sequential process in which individual units of declarative knowledge are assembled into larger declarative, procedural and conditional constructs to define reality.

Learners display an understanding of a single reality through declarative, procedural and conditional knowledge.

Premised on the instructor having complete control over the materials, pace and direction of learning.

Not dependent on how individuals internalize or interpret such information

(Arbaugh & Benbunan-Fich, 2006, p. 438)

MethodologyAn exploratory sequential design with data transformation was implemented. Priority was given to the transformed qualitative components. 11 instructors interviewed – probing for understanding of technology.Syllabi and learning activities placed within socio-epistemological framework.Ethnographic reporting from instructional designers.

An exploratory sequential design with data transformation was implemented. Priority was given to the transformed qualitative components.

11 instructors interviewed – probing for understanding of technology.

Syllabi and learning activities placed within socio-epistemological framework.

Ethnographic reporting from instructional designers.

AnalysisTriangulation of data with correlation emphasized. Iterative, interpretive process to assess faculty understanding of application of technology.Qualitative data used to support relationshiops from analysis of transformed data – understanding of technology & relationships to socio-epistemological orientationsEstablishment of grounded theory was an objective.Later confirmatory samplings.

Triangulation of data with correlation emphasized.

Iterative, interpretive process to assess faculty understanding of application of technology.

Qualitative data used to support relationshiops from analysis of transformed data – understanding of technology & relationships to socio-epistemological orientations

Establishment of grounded theory was an objective.

Later confirmatory samplings.

Socio-epistemological classification of course activities by instructor.Activity type means for subgroup B versus all other instructors.

Interview DataFour instructors (Sharon, Stan, Linda & Monica) did not differentiate between technologies and pedagogical applications of technologies. Viewed technological tools as a replacement for pedagogy in online courses.Believed various technologies would dictate how learning activities are structured.Believed technologies had singular uses.Beliefs not altered by significant training and support.Perception not detected among other faculty.

Four instructors (Sharon, Stan, Linda & Monica) did not differentiate between technologies and pedagogical applications of technologies.

Viewed technological tools as a replacement for pedagogy in online courses.

Believed various technologies would dictate how learning activities are structured.

Believed technologies had singular uses.

Beliefs not altered by significant training and support.

Perception not detected among other faculty.

RelationshipsOf all course activities, an average of 88.10% of those developed by the 4 instructor subgroup were individual. In contrast, the means for all other instructors were relatively balanced between individual (52.57%) and collaborative (47.43%) activities. With respect to Arbaugh and Benbunan-Fich’s (2006) Teaching Approaches Framework, an average of 76.19% of subgroup B’s activities were classified as objectivist-individual as compared to a mean of 27.02% for all other instructors. Constructivist – Group oriented instructors had statistically significant higher scores across all TP, SP, CP and all subscales

Of all course activities, an average of 88.10% of those developed by the 4 instructor subgroup were individual. In contrast, the means for all other instructors were relatively balanced between individual (52.57%) and collaborative (47.43%) activities.

With respect to Arbaugh and Benbunan-Fich’s (2006) Teaching Approaches Framework, an average of 76.19% of subgroup B’s activities were classified as objectivist-individual as compared to a mean of 27.02% for all other instructors.

Constructivist – Group oriented instructors had statistically significant higher scores across all TP, SP, CP and all subscales

ImplicationsSocio-epistemological orientations may impact instructors’ ability to construct and facilitate effective online learning experiences. The potential to screen potential instructors on the basis of socio-epistemological orientations may be of benefit to administrators.Training and support structures may be needed to address paradigmatic orientations of faculty.More research is needed to validate this study and the hypotheses developed.

Socio-epistemological orientations may impact instructors’ ability to construct and facilitate effective online learning experiences.

The potential to screen potential instructors on the basis of socio-epistemological orientations may be of benefit to administrators.

Training and support structures may be needed to address paradigmatic orientations of faculty.

More research is needed to validate this study and the hypotheses developed.

Director of Course Design, Research & DevelopmentAmerican Public University Systempice@apus.eduThank You!Phil Ice, Ed.D.Director of Course Design, Research & DevelopmentAmerican Public University Systempice@apus.edu