Towards Defining the Competencies for Online TeachingLilly 2010Washington D.C.Conference1
Research TeamPrincipal Investigator:	Lawrence C. RaganCo-Investigators:	Paula Bigatel, Janet May, Shannon KennanStatistics Consultant:	Brian Redmond2
The Study – The Beginning3
DefinitionsInventory items – statements that reflect a behavior, attitude, or beliefDefinition of competency: a theoretical construct that represents a constellation of behaviors, attitudes, and beliefs, not just one behavior, attitude, or belief.4
Data Collection5
DemographicsCurrent academic position    Professor (55)
    Adjunct (46)
    Instructor (34)
    Other (33)
    Instructional Designer (18)
    Administrator (30)
    Lecturer (21)
    Staff (21)
    Affiliate (2)Disciplines    Professions (83)
    Humanities (36)
    Social Sciences (33)
    Applied Sciences (16)
    Formal Sciences (20)
    Natural Sciences (13)
    Other (15)Sample Size: N = 197 SexFemale (113)Male (64)Not reporting (15)ExperienceNo teaching responsibilities (17)Less than 1 (16)1 to 3 (57)4 to 5 (40)6 to 9 (40)10 to 15 (23)16 to 20 (2)More than 20 (1)6
Factor AnalysisWay to statistically organize data (questions) into categories (competencies)Reduce number of questions to manageable amount ExploratoryProduced 7 reliable factors* Note that several factors have only 2 items7
Active LearningThe instructor encourages students to interact with each other by assigning team tasks and projects, where appropriate. (r=.819)The instructor includes group/team assignments where appropriate. (r=.766) The instructor encourages students to share their knowledge and expertise with the learning community. (r=.721)The instructor encourages students to participate in discussion forums, where appropriate. (r=.682)The instructor provides opportunities for hands-on practice so that students can apply learned knowledge to the real-world. (r=.582)The instructor provides additional resources that encourage students to go deeper into the content of the course. (r=.574)The instructor encourages student-generated content as appropriate. (r=.531) The instructor facilitates learning activities that help students construct explanations/solutions. (r=.506)The instructor uses peer assessment in his/her assessment of student work, where appropriate. (r=.472) The instructor shows respect to students in his/her communications with them. (r=.427)8

Cots Presentation Lilly Conference

  • 1.
    Towards Defining theCompetencies for Online TeachingLilly 2010Washington D.C.Conference1
  • 2.
    Research TeamPrincipal Investigator: LawrenceC. RaganCo-Investigators: Paula Bigatel, Janet May, Shannon KennanStatistics Consultant: Brian Redmond2
  • 3.
    The Study –The Beginning3
  • 4.
    DefinitionsInventory items –statements that reflect a behavior, attitude, or beliefDefinition of competency: a theoretical construct that represents a constellation of behaviors, attitudes, and beliefs, not just one behavior, attitude, or belief.4
  • 5.
  • 6.
  • 7.
    Adjunct (46)
  • 8.
    Instructor (34)
  • 9.
    Other (33)
  • 10.
    Instructional Designer (18)
  • 11.
    Administrator (30)
  • 12.
    Lecturer (21)
  • 13.
    Staff (21)
  • 14.
    Affiliate (2)Disciplines Professions (83)
  • 15.
    Humanities (36)
  • 16.
    Social Sciences (33)
  • 17.
    Applied Sciences (16)
  • 18.
    Formal Sciences (20)
  • 19.
    Natural Sciences (13)
  • 20.
    Other (15)Sample Size: N = 197 SexFemale (113)Male (64)Not reporting (15)ExperienceNo teaching responsibilities (17)Less than 1 (16)1 to 3 (57)4 to 5 (40)6 to 9 (40)10 to 15 (23)16 to 20 (2)More than 20 (1)6
  • 21.
    Factor AnalysisWay tostatistically organize data (questions) into categories (competencies)Reduce number of questions to manageable amount ExploratoryProduced 7 reliable factors* Note that several factors have only 2 items7
  • 22.
    Active LearningThe instructorencourages students to interact with each other by assigning team tasks and projects, where appropriate. (r=.819)The instructor includes group/team assignments where appropriate. (r=.766) The instructor encourages students to share their knowledge and expertise with the learning community. (r=.721)The instructor encourages students to participate in discussion forums, where appropriate. (r=.682)The instructor provides opportunities for hands-on practice so that students can apply learned knowledge to the real-world. (r=.582)The instructor provides additional resources that encourage students to go deeper into the content of the course. (r=.574)The instructor encourages student-generated content as appropriate. (r=.531) The instructor facilitates learning activities that help students construct explanations/solutions. (r=.506)The instructor uses peer assessment in his/her assessment of student work, where appropriate. (r=.472) The instructor shows respect to students in his/her communications with them. (r=.427)8

Editor's Notes

  • #2 Larry
  • #3 Larry
  • #4 Larry– Methodology rework Guiding Research Question….. Can you move the Guiding Research Question box to the left side, which is more intuitively read. Question might be: What are the perceptions of subject matter experts on what constitutes the necessary competencies for online teaching success? We might want to keep the other box which states our BIG overarching research question.
  • #5 Shannon Behavior:The instructor uses a variety of multimedia technologies to achieve course objectives.Attitude: The instructor shows caring and concern that students are learning the course content.Belief: Analogy needed: fishing,
  • #6 Shannon - Recruitment (email listservs) and survey delivery (collection of data)
  • #7 Shannon– preliminary results
  • #8 Brian – preliminary resultsVarimaxcombination of several standard cut-off rules (eigen higher than 1, scree, r greater than .40) -- basically took a conservative approachmany items valid, but not particularly usefulall items had high means, factor analysis sorts the important ones out 
  • #9 Brian– preliminary results
  • #10 Brian– preliminary results
  • #11 Brian– preliminary results
  • #12 Brian– preliminary results
  • #13 The WOMEN – preliminary results
  • #14 The WOMEN – preliminary results
  • #15 The WOMEN – preliminary results
  • #20 Larry, will redo slide and present this slide
  • #21 Larry?
  • #22 Larry – Recruitment for collecting further data – Ning site
  • #23 Shannon - contacts