Your SlideShare is downloading. ×

Cots Presentation Lilly Conference


Published on

Presentation on status of COTS (Competencies for Online Teaching Success) research project by Penn State's World Campus Faculty Development.

Presentation on status of COTS (Competencies for Online Teaching Success) research project by Penn State's World Campus Faculty Development.

Published in: Education, Technology
  • Be the first to comment

  • Be the first to like this

No Downloads
Total Views
On Slideshare
From Embeds
Number of Embeds
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

No notes for slide
  • Larry
  • Larry
  • Larry– Methodology rework Guiding Research Question….. Can you move the Guiding Research Question box to the left side, which is more intuitively read. Question might be: What are the perceptions of subject matter experts on what constitutes the necessary competencies for online teaching success? We might want to keep the other box which states our BIG overarching research question.
  • Shannon Behavior:The instructor uses a variety of multimedia technologies to achieve course objectives.Attitude: The instructor shows caring and concern that students are learning the course content.Belief: Analogy needed: fishing,
  • Shannon - Recruitment (email listservs) and survey delivery (collection of data)
  • Shannon– preliminary results
  • Brian – preliminary resultsVarimaxcombination of several standard cut-off rules (eigen higher than 1, scree, r greater than .40) -- basically took a conservative approachmany items valid, but not particularly usefulall items had high means, factor analysis sorts the important ones out 
  • Brian– preliminary results
  • Brian– preliminary results
  • Brian– preliminary results
  • Brian– preliminary results
  • The WOMEN – preliminary results
  • The WOMEN – preliminary results
  • The WOMEN – preliminary results
  • Larry, will redo slide and present this slide
  • Larry?
  • Larry – Recruitment for collecting further data – Ning site
  • Shannon - contacts
  • Transcript

    • 1. Towards Defining the Competencies for Online Teaching
      Lilly 2010
      Washington D.C.Conference
    • 2. Research Team
      Principal Investigator:
      Lawrence C. Ragan
      Paula Bigatel, Janet May, Shannon Kennan
      Statistics Consultant:
      Brian Redmond
    • 3. The Study – The Beginning
    • 4. Definitions
      Inventory items – statements that reflect a behavior, attitude, or belief
      Definition of competency: a theoretical construct that represents a constellation of behaviors, attitudes, and beliefs, not just one behavior, attitude, or belief.
    • 5. Data Collection
    • 6. Demographics
      Current academic position
      • Professions (83)
      • 15. Humanities (36)
      • 16. Social Sciences (33)
      • 17. Applied Sciences (16)
      • 18. Formal Sciences (20)
      • 19. Natural Sciences (13)
      • 20. Other (15)
      Sample Size: N = 197
      Female (113)
      Male (64)
      Not reporting (15)
      No teaching responsibilities (17)
      Less than 1 (16)
      1 to 3 (57)
      4 to 5 (40)
      6 to 9 (40)
      10 to 15 (23)
      16 to 20 (2)
      More than 20 (1)
    • 21. Factor Analysis
      Way to statistically organize data (questions) into categories (competencies)
      Reduce number of questions to manageable amount
      Produced 7 reliable factors
      * Note that several factors have only 2 items
    • 22. Active Learning
      The instructor encourages students to interact with each other by assigning team tasks and projects, where appropriate. (r=.819)
      The instructor includes group/team assignments where appropriate. (r=.766)
      The instructor encourages students to share their knowledge and expertise with the learning community. (r=.721)
      The instructor encourages students to participate in discussion forums, where appropriate. (r=.682)
      The instructor provides opportunities for hands-on practice so that students can apply learned knowledge to the real-world. (r=.582)
      The instructor provides additional resources that encourage students to go deeper into the content of the course. (r=.574)
      The instructor encourages student-generated content as appropriate. (r=.531)
       The instructor facilitates learning activities that help students construct explanations/solutions. (r=.506)
      The instructor uses peer assessment in his/her assessment of student work, where appropriate. (r=.472)
      The instructor shows respect to students in his/her communications with them. (r=.427)
    • 23. Administration/Leadership
      The instructor makes grading visible for student tracking purposes. (r=.683)
      The instructor clearly communicates expected student behaviors. (r=.682)
      The instructor is proficient in the chosen course management system (CMS). (r=.591)
      The instructor adheres to the university's policies regarding the Federal Educational Rights & Privacy Act (FERPA). (r=.509)
      The instructor integrates the use of technology that is meaningful and relevant to students. (r=.454)
    • 24. Active Teaching/Responsiveness
      The instructor provides prompt, helpful feedback on assignments and exams that enhances learning. (r=.741)
      The instructor provides clear, detailed feedback on assignments and exams that enhances the learning experience. (r=.714)
      The instructor shows caring and concern that students are learning the course content. (r=.514)
      The instructor helps keep the course participants on task. (r=.429) 
      The instructor uses appropriate strategies to manage the online workload. (r=.426)  
    • 25. Multimedia Technology
      The instructor uses a variety of multimedia technologies to achieve course objectives. (r=.788)
      The instructor uses multimedia technologies that are appropriate for the learning activities. (r=.749)
    • 26. Classroom Decorum
      The instructor helps students resolve conflicts that arise in collaborative teamwork. (r=.761)
      The instructor resolves conflicts when they arise in teamwork/group assignments. (r=.680)
      The instructor can effectively manage the course communications by providing a good model of expected behavior for all course communication. (r=.533)  
      The instructor identifies areas of potential conflict within the course. (r=.431)
    • 27. Technological Competence
      The instructor is proficient with the technologies used in the online classroom. (r=.884)
      The instructor is confident with the technology used in the course. (r=.724)
    • 28. Policy Enforcement
      The instructor monitors students' adherence to policies on plagiarism. (r=.847)
      The instructor monitors students' adherence to Academic Integrity policies and procedures. (r=.803)
    • 29. Other Behavioral Statements
      The instructor creates a learning environment that is safe and inviting.
      The instructor adheres to instructional policies related to syllabus development.
      The instructor is familiar with resources that relate to academic advising.
      The instructor provides meaningful examples that help students understand course content.
      The instructor clearly communicates course content.
      The instructor is helpful in guiding the class towards understanding course topics in a way that helps students clarify their thinking.
      The instructor demonstrates flexibility in efforts to accommodate different student needs/circumstances.
      The instructor provides choices for graded projects so students can choose topics based on interest.
      The instructor gathers data on students' background, interests, and experiences in order to relate them to course content.
    • 30. Other Behavioral Statements
      The instructor acknowledges the receipt of assignments within two days of submission.
      The instructor conducts office hours that accommodate students' schedules.
      The instructor returns graded assignments within 48 hrs. of the due date of the assignment.
      The instructor clearly communicates course goals.
      The instructor communicates with students about course changes, reminders of due assignments, relevant additional resources through announcements/emails.
      The instructor shows enthusiasm when interacting with students in the learning environment.
      The instructor plays an active role in online discussions when appropriate.
      The instructor provides guidance on how students can link new information to their existing knowledge.
      The instructor logs into the course daily in order to monitor and engage students in the course content.
      The instructor responds to student questions within 24 hours.
    • 31. Other Behavioral Statements
      The instructor uses various assessment methods to evaluate student performance.
      The instructor is actively involved in monitoring student progress.
      The instructor communicates to students the required technological equipment and software for the course.
      The instructor has an understanding of the course technologies sufficient to help students with basic technical issues.
      The instructor monitors students' adherence to copyright policies.
      The instructor teaches students the code of ethics relevant to their discipline.
      The instructor communicates accessibility of resources to students with disabilities.
      The instructor provides students with clear grading criteria ( e.g. rubrics, description of how assignments will be graded).
      The instructor's communication demonstrates a sensitivity to disabilities and diversities including: cultural, cognitive, emotional and physical.
      The instructor is the expert and directs the learning process.
      The instructor promotes student reflection by providing students with opportunities to evaluate their work.
      The instructor is a facilitator of the learning process and does not direct the students' learning process.
      The instructor communicates course expectations regarding classroom behavior (netiquette guidelines).
      The instructor varies their use of teaching methods to accommodate students' different learning styles.
      The instructor is open to students' ideas and incorporates students' ideas for improving the course.
    • 32. Other Potential Analysis
      What relationships are present between our control variables (see below) and perceptions about online teaching behaviors?
      Looking for differences between groups to help tailor the training model to specific populations
      Amount of online teaching experience
      Academic position (e.g. administrator, instructor, instructional designer)
      Academic Discipline
    • 33. 19
      Next Question: Are certain competencies or behaviors needed at different levels of experience?
      OL 1000
      OL 1200
      Create & distribute instrument.
      Rank behavioral statements.
      What competencies or behaviors are needed at the NOVICE, INTERMEDIATE or EXPERT levels?
      Do competency groupings remain the same?
      Use results to inform faculty development plans.
      OL 1500
      OL 1700
      OL 2000
      OL 2700
      OL 3000
      OL 4000
    • 34. 20
    • 35. Recruitment for Stage 2
      I am interested in participating in the COTS survey.
      Please send me a passcode to this email address so that I can have access to the survey.
    • 36. Contact Information
      Larry Ragan –
      Janet May –
      Paula Bigatel –
      Shannon Kennan –
      Brian Redmond –