SlideShare a Scribd company logo
Developing and delivering video feedback
                Simon Davis – University of York, UK
                          Simon.davis@york.ac.uk
Outline


•   Feedback; written vs video
•   Case study 1 – student presentations
•   Case study 2 – student work
•   Learning points
(Assessment &) feedback in HE


• Key to learning – constructive alignment (Biggs)
• Weakest area for student satisfaction (NSS)
• Feedback = “Any part of the learning process
  which is designed to guide student progress”
    – Adequacy, timeliness, usefulness, fairness*
• Significant issues around timeliness,
  individualisation, engagement, impact, staff
  workload…

* University of York guide to Assessment, Standards, Marking and Feedback
Written feedback : the problem
Lack of engagement with written feedback is related to
  its limitations:
• Discourse of wfb - tacit knowledge making criteria
  explicit (Chanock, 2000)
• Lack of shared understanding of criteria (Sadler,
  1989, 2010)
• Reinforces the distance between tutor expert and
  novice student
• (Mis) interpretation of feedback
• Disconnect between commentary and subject
• Lack of depth
Enhanced feedback


• Audio – “soundsgood” project
• Screencast feedback (McLaughlin 2009,
  Stannard 2007)
• Video feedback (Thiissen 2012, Lightfoot 2010)
Case study 1: Video feedback to develop
 student presentation skills (Physics)
•   Students n=125
•   Students give a presentation in term 1
•   These are recorded and uploaded onto the VLE
•   Feedback is given by staff, self reflection and peers
•   Students give a 2nd presentation in term 3 which
    builds on comments
Case study: Video feedback
2010/11– Learning objects blog


•   Students record presentations > batch converted
•   Batch allocate students to groups (*16)
•   Folders restricted to groups containing LO blogs
•   Multiple videos embedded within the blogs
    – Individual tutor feedback
    – Peer feedback
    – Personal reflection
2011/12 – Blackboard blog


• Blogs restricted to groups with Adaptive Release
  – Could use the My Groups area
• Multiple videos embedded within the blogs
  – Peer feedback
  – Personal reflection
  – Staff feedback provided later
Impact: comparing marks 2009 - 2010
Impact: student evaluation (n=40)

Select from the list below, anything that you feel helped you
to develop your presentation skills:

•   Watching own presentation (94%)
•   Feedback from staff (83%)
•   Feedback from peers (83%)
•   Reflecting on my own presentation performance (76%)
•   Assessing the performance of other students against a
    provided set of criteria (64%)
Impact: student comments

• “Watching the video was most useful. Several things I felt went wrong
  during the talk weren't noticeable at all, while some things I didn't notice
  were”.
• “The videos are especially good, and the fact that you can watch as many
  times as you like is very good. The ability to provide/ receive instant
  feedback is very helpful”.
• “Highlighted my weaknesses more effectively”.
• “It was useful having to analyse my own presentation rather than just
  forgetting about it. I was able to find faults myself which is more likely to
  help me improve next time. This wouldn’t have been possible without the
  talks being recorded”.
• “The VLE provided an interactive source of feedback which helped me
  improve my speaking skills. The videos also helped me to see where I was
  going wrong with my presentation”.
Case study 2: Screencast feedback on
     Academic Writing (Dept Education)
•   Masters ESOL classroom practice
•   ~20 international students
•   Mid term formative task – short academic essay
•   Written feedback after 1 week
•   Screencast feedback 1 week later
    – Via e-mail, VLE “too clunky”
Designing and delivering feedback /
                feedforward
• Review work and make notes / highlighting
• Prepare positive and development bullet points
• Prepare workspace and deliver feedback
    –   Greet student by name and introduce yourself
    –   State what feedback is on and how it is structured
    –   Comment on positive aspects
    –   Expand in detail on highlighted points
    –   Give brief summary with feedforward
(adapted from Cullen
http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf)
Impact: Student Survey (n=15/20 )
1)attention to both types of fb
2) evaluating wfb versus sfb
Students read wfb three times+ 9/15
Students viewed sfb three times+ 12/ 15
  Q:If you were only able to receive one form of
  feedback, either written feedback comments or
  screen cast feedback, which of these two forms of
  feedback would you choose?
  9 chose sfb       4 chose wfb
(Kerr & McLaughlin study- three quarters chose sfb)
Impact: Student responses, strengths of
screencast fb (12)
• “I think the most obvious advantage is that
  students can feel engaged as if their tutor is
  talking to them face to face”
• “More straightforward and personal. It's like the
  tutor is talking to you in person. And the
  comments are directed to the parts of your
  article clearly.”
• “More memorable because it‟s like the teacher is
  talking to you and giving instructions to you.
  Sometimes I can't recognize teachers' writing
  in the written feedback.”
Learning from written feedback(12)
• Strengths of written feedback
  •   “I think the written feedback is more clear and specific about
    some small mistakes that I made (like some printing mistakes)
    while the screen cast tends to be focused mainly on the
    structure or some other macro aspects.
  • “You can read it anywhere you like (3) and it's easy to go
    back to check whereas the screen cast can only be read on
    your computer. Also, the information is more memorable to
    visual learners.”
• Meeting this with screencast feedback
  • Ask students to respond to feedback with action points
  • Provide bullet pointed scripts along with
Use of screencasts - reflections
• Benefits – “over the shoulder intimacy”
  – „quick and dirty‟ helps develop trust and authenticity
  – personal style / nuance
  – any innovation that shows tutor commitment engenders
    positive attitude towards tutors (France & Ribchester, 2008)
  – Sfb has all the benefits of audio fb -depth of explanation,
    personalisation etc. but with added visual element
  – Most appropriate for formative feedback
• Challenges
  – Production workload (rendering, distribution to students
    through VLE)
  – Getting “best of both” (written / screencast)
vGuidance Pilot project: online
  screencast creation & access control
• Bespoke system for (non-technical) careers
  advisers creating rich feedback (efficient, easy...)
• Respond to student CV submissions (username)
• Record feedback online (server side production)
   – Screencast-o-matic
• Generic E-mail with advice and link to students
• Students log in to access all feedback provided
• Opportunity for face to face follow up
Impact: student survey (n=12)


• vGuidance is:
  –   Convenient: 5
  –   Easy to use: 4.8
  –   Personal: 4.5
  –   Easy to understand feedback: 4.4
  –   Saves me time: 4.3
  –   Is engaging: 4.4
  –   Want future vGuidance feedback: 4.8
Impact: student comments

• “…the video was much more engaging”
• “I think it is good that I will be able to keep viewing it
  whilst I update my CV with the suggestions that
  were made rather than leaving an appointment and
  maybe not remembering what was said.”
• “Going through the CV in a visual manner helps to
  understand not only where to modify it, but also how
  in terms of spacial and lay-out aspects”
• “It is easier to apply to the document you are
  working on. It creates extensive feedback so you
  are not confused by notes made.”
Impact: staff response


• Careers advisers:
  – Saves time (10-15 mins cf.30-60 for text equivalent)
  – Less fear of getting tone right / misinterpretation
• Bill Soden
  – Removes production overheads
  – Removes access control issues
Potential for integration with Blackboard

Opportunities
• Single sign on potential for simpler integration with
  VLE
• Feedback could be organised by course,
  assignment etc.
Challenges
• Concerns over 3rd party API – funding
• Scalability
• Integration with Gradecentre
• Room for human error (username)
Final questions / comments


• How can the ability to create and provide
  feedback through Blackboard be improved?
References

•   Biggs, J.B. (2003). Teaching for quality learning at university. Buckingham: Open University
    Press/Society for Research into Higher Education. (Second edition)
• Channock, K, (2000) Comments on Essays: do students understand what tutors write?
    Teaching in Higher Education, 5: 1, 95-105.
• Cullen, R. Screencast feedback. Last accessed 2nd June 2011 from
http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf
• France, D., & Ribchester, C. (2008). Podcasts and feedback. In G. Salmon & P.
    Edirisingha, (Eds.), Podcasting for learning in universities (pp 70-79). Berkshire: Open
    University Press.
• Kerr, W., & McLaughlin, P. (2009). The benefit of screen recorded summaries in feedback
    for work submitted electronically. Last accessed 15th May 2011 from
    http://ebookbrowse.com/kerr-w-mclaughlin-p-formatted-b1-pdf-d116387872
• Lunt, T, & Curran, J. (2010) „Are you listening please?‟ The advantages of electronic audio
    feedback compared to written feedback. Assessment and Evaluation in Higher Education,
    35: 7, 759-769.
• Sadler, R. (2010) Beyond Feedback: developing student capability in complex appraisal.
    Assessment and Evaluation in Higher Education, 35: 5, 535-550.
• Stannard (2007) Using screen capture software in student feedback: A case study from the
    HEA English Subject Centre. Last accessed 15th May, 2011
    http://www.english.heacademy.ac.uk/explore/publications/casestudies/technology/camtasia
    .php)
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback
S davis bblteurpoe2012_videofeedback

More Related Content

What's hot

Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Dan Randall
 
Maisie Finalv2.0
Maisie Finalv2.0Maisie Finalv2.0
Maisie Finalv2.0
annwarm
 
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom ModelVoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
Michelle Pacansky-Brock
 
Moving Student Presentations Online
Moving Student Presentations OnlineMoving Student Presentations Online
Moving Student Presentations Online
Kim Kenward
 
Academic Integrity in Online Courses
Academic Integrity in Online CoursesAcademic Integrity in Online Courses
Academic Integrity in Online Courses
Foothill College
 
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary ReportChallenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
engedukamall
 
Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?
UK Centre for Legal Education
 
Flipped education csm_2014_robertson
Flipped education csm_2014_robertsonFlipped education csm_2014_robertson
Flipped education csm_2014_robertsonEric Robertson
 
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
Juho Kim
 
Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...
Inge de Waard
 
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
BCcampus
 
Using Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional DevelopmentUsing Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional Development
Jason Rhode
 
Lessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual ClassroomLessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual Classroom
ahornton
 
Durham 2018 from pilot to service kelly hall
Durham 2018 from pilot to service  kelly hallDurham 2018 from pilot to service  kelly hall
Durham 2018 from pilot to service kelly hall
Kelly Hall
 
Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.
Candace Nolan-Grant
 
Using the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment designUsing the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment design
LearningandTeaching
 
Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...
Tania Lee
 
Lecture Capture for NTU
Lecture Capture for NTULecture Capture for NTU
Lecture Capture for NTU
witthaus
 
The Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online EnvironmentThe Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online Environment
D2L Barry
 

What's hot (20)

Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
Undergrad but Not Under-experienced: Employing Undergraduates as Instructiona...
 
Maisie Finalv2.0
Maisie Finalv2.0Maisie Finalv2.0
Maisie Finalv2.0
 
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom ModelVoiceThread for Improving Deep Learning: a Flipped Classroom Model
VoiceThread for Improving Deep Learning: a Flipped Classroom Model
 
Moving Student Presentations Online
Moving Student Presentations OnlineMoving Student Presentations Online
Moving Student Presentations Online
 
Academic Integrity in Online Courses
Academic Integrity in Online CoursesAcademic Integrity in Online Courses
Academic Integrity in Online Courses
 
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary ReportChallenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
Challenges and Opportunities in Flipped Writing Classrooms: A Preliminary Report
 
Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?Will video kill the manuscript scrawl?
Will video kill the manuscript scrawl?
 
Flipped education csm_2014_robertson
Flipped education csm_2014_robertsonFlipped education csm_2014_robertson
Flipped education csm_2014_robertson
 
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
CHI2014 Workshop - Leveraging Video Interaction Data and Content Analysis to ...
 
Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...Online evaluations: using proctoring tools, Open book assessments and Group E...
Online evaluations: using proctoring tools, Open book assessments and Group E...
 
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
ETUG Spring 2014 - My Toolbox is Full - How Why and When to use Digital Tools...
 
Using Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional DevelopmentUsing Twitter for Teaching, Learning, and Professional Development
Using Twitter for Teaching, Learning, and Professional Development
 
Lessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual ClassroomLessons Learned: Implementation of a Virtual Classroom
Lessons Learned: Implementation of a Virtual Classroom
 
Durham 2018 from pilot to service kelly hall
Durham 2018 from pilot to service  kelly hallDurham 2018 from pilot to service  kelly hall
Durham 2018 from pilot to service kelly hall
 
Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.Want to know how to use Blackboard? Use Blackboard.
Want to know how to use Blackboard? Use Blackboard.
 
Podcasting ppp 08 - Derek France - Chester 08
Podcasting   ppp 08 - Derek France - Chester 08Podcasting   ppp 08 - Derek France - Chester 08
Podcasting ppp 08 - Derek France - Chester 08
 
Using the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment designUsing the SAMR model to innovate assessment design
Using the SAMR model to innovate assessment design
 
Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...Celebrating accents: Using technologies to build student confidence in pronun...
Celebrating accents: Using technologies to build student confidence in pronun...
 
Lecture Capture for NTU
Lecture Capture for NTULecture Capture for NTU
Lecture Capture for NTU
 
The Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online EnvironmentThe Instructor is In: Sustaining Presence in the Online Environment
The Instructor is In: Sustaining Presence in the Online Environment
 

Viewers also liked

Hello world
Hello worldHello world
Hello worldhemi46h
 
The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...Mis T Masiapeto
 
Lesson 2
Lesson 2 Lesson 2
Lesson 2
AMSimpson
 
Clp 1040 what is a documentary
Clp 1040   what is a documentaryClp 1040   what is a documentary
Clp 1040 what is a documentary
Civic Life Project
 
íDolos
íDolosíDolos
íDolos
juliana_arce
 
Ancient Civilization
Ancient CivilizationAncient Civilization
Ancient Civilizationnoctor
 
Clp keynote presentation 090113
Clp keynote presentation 090113Clp keynote presentation 090113
Clp keynote presentation 090113
Civic Life Project
 
46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world
hemi46h
 
Civic Life Project School presentation 090313
Civic Life Project School presentation 090313Civic Life Project School presentation 090313
Civic Life Project School presentation 090313
Civic Life Project
 

Viewers also liked (9)

Hello world
Hello worldHello world
Hello world
 
The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...The way gender is constructed for an individual depend on gendered interactio...
The way gender is constructed for an individual depend on gendered interactio...
 
Lesson 2
Lesson 2 Lesson 2
Lesson 2
 
Clp 1040 what is a documentary
Clp 1040   what is a documentaryClp 1040   what is a documentary
Clp 1040 what is a documentary
 
íDolos
íDolosíDolos
íDolos
 
Ancient Civilization
Ancient CivilizationAncient Civilization
Ancient Civilization
 
Clp keynote presentation 090113
Clp keynote presentation 090113Clp keynote presentation 090113
Clp keynote presentation 090113
 
46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world46h interaction 1.lesson Hello world
46h interaction 1.lesson Hello world
 
Civic Life Project School presentation 090313
Civic Life Project School presentation 090313Civic Life Project School presentation 090313
Civic Life Project School presentation 090313
 

Similar to S davis bblteurpoe2012_videofeedback

Group project topic 3
Group project topic 3Group project topic 3
Group project topic 3
Shelly Pinner
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
Kristen Sosulski
 
Badging Study - within a Graduate Course
Badging Study - within a Graduate CourseBadging Study - within a Graduate Course
Badging Study - within a Graduate Course
Eileen O'Connor
 
Online assessment
Online assessmentOnline assessment
Online assessment
Nisha Singh
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & Curriculum
Christopher Rice
 
Explain Everything & Plickers
Explain Everything & PlickersExplain Everything & Plickers
Explain Everything & Plickers
telshef
 
Nc fslt15 virtual conference
Nc fslt15 virtual conferenceNc fslt15 virtual conference
Nc fslt15 virtual conference
Neil Currant
 
Judy Stern
Judy Stern Judy Stern
Judy Stern
ccnmtl
 
A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction: A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction:
John Morrison
 
Russell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learningRussell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learning
eaquals
 
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Blackboard APAC
 
EMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: ViewbricsEMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: Viewbrics
EADTU
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
BlackboardEMEA
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching online
Ally Kimmel
 
CIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for LearningCIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for Learning
Eileen O'Connor
 
Getting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSUGetting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSU
Tanya Joosten
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Diogo Casanova
 
Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?
Y1Feedback
 
What's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and ChallengesWhat's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and Challenges
Terry Anderson
 
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Kim Kenward
 

Similar to S davis bblteurpoe2012_videofeedback (20)

Group project topic 3
Group project topic 3Group project topic 3
Group project topic 3
 
Online Teaching Best Practices
Online Teaching Best PracticesOnline Teaching Best Practices
Online Teaching Best Practices
 
Badging Study - within a Graduate Course
Badging Study - within a Graduate CourseBadging Study - within a Graduate Course
Badging Study - within a Graduate Course
 
Online assessment
Online assessmentOnline assessment
Online assessment
 
Hybrid Courses & Curriculum
Hybrid Courses & CurriculumHybrid Courses & Curriculum
Hybrid Courses & Curriculum
 
Explain Everything & Plickers
Explain Everything & PlickersExplain Everything & Plickers
Explain Everything & Plickers
 
Nc fslt15 virtual conference
Nc fslt15 virtual conferenceNc fslt15 virtual conference
Nc fslt15 virtual conference
 
Judy Stern
Judy Stern Judy Stern
Judy Stern
 
A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction: A Technology Enhanced Approach to Improving Feedback Satisfaction:
A Technology Enhanced Approach to Improving Feedback Satisfaction:
 
Russell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learningRussell Stannard_ Key Technologies that can impact on teaching and learning
Russell Stannard_ Key Technologies that can impact on teaching and learning
 
Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...Bringing together internal and external students on Blackboard - Brett Fyfiel...
Bringing together internal and external students on Blackboard - Brett Fyfiel...
 
EMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: ViewbricsEMPOWER E-Assessment week: Viewbrics
EMPOWER E-Assessment week: Viewbrics
 
Forward thinking feedback at UEA
Forward thinking feedback at UEAForward thinking feedback at UEA
Forward thinking feedback at UEA
 
Best practices for teaching online
Best practices for teaching onlineBest practices for teaching online
Best practices for teaching online
 
CIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for LearningCIT2017 - Virtual Reality & Student-Created Video for Learning
CIT2017 - Virtual Reality & Student-Created Video for Learning
 
Getting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSUGetting started with blended, a presentation for NMSU
Getting started with blended, a presentation for NMSU
 
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
Feedback, Agency and Analytics in Virtual Learning Environments – Creating a ...
 
Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?Technology Enhanced Feedback Approaches: What Works & Why?
Technology Enhanced Feedback Approaches: What Works & Why?
 
What's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and ChallengesWhat's the big deal about Blended Learning - Models, Results and Challenges
What's the big deal about Blended Learning - Models, Results and Challenges
 
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...Moving Student Presentations Online - Online Learning Consortium Blended Lear...
Moving Student Presentations Online - Online Learning Consortium Blended Lear...
 

Recently uploaded

Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
rosedainty
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
BhavyaRajput3
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
Thiyagu K
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
bennyroshan06
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
EugeneSaldivar
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
Special education needs
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
Col Mukteshwar Prasad
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
MysoreMuleSoftMeetup
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
AzmatAli747758
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
EverAndrsGuerraGuerr
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
Jheel Barad
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
Celine George
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
Atul Kumar Singh
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
siemaillard
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Thiyagu K
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
GeoBlogs
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
Ashokrao Mane college of Pharmacy Peth-Vadgaon
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
Vivekanand Anglo Vedic Academy
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
RaedMohamed3
 

Recently uploaded (20)

Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)Template Jadual Bertugas Kelas (Boleh Edit)
Template Jadual Bertugas Kelas (Boleh Edit)
 
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCECLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
CLASS 11 CBSE B.St Project AIDS TO TRADE - INSURANCE
 
Unit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdfUnit 8 - Information and Communication Technology (Paper I).pdf
Unit 8 - Information and Communication Technology (Paper I).pdf
 
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptxMARUTI SUZUKI- A Successful Joint Venture in India.pptx
MARUTI SUZUKI- A Successful Joint Venture in India.pptx
 
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...TESDA TM1 REVIEWER  FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
TESDA TM1 REVIEWER FOR NATIONAL ASSESSMENT WRITTEN AND ORAL QUESTIONS WITH A...
 
special B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdfspecial B.ed 2nd year old paper_20240531.pdf
special B.ed 2nd year old paper_20240531.pdf
 
How to Break the cycle of negative Thoughts
How to Break the cycle of negative ThoughtsHow to Break the cycle of negative Thoughts
How to Break the cycle of negative Thoughts
 
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
Mule 4.6 & Java 17 Upgrade | MuleSoft Mysore Meetup #46
 
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...Cambridge International AS  A Level Biology Coursebook - EBook (MaryFosbery J...
Cambridge International AS A Level Biology Coursebook - EBook (MaryFosbery J...
 
Chapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptxChapter 3 - Islamic Banking Products and Services.pptx
Chapter 3 - Islamic Banking Products and Services.pptx
 
Thesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.pptThesis Statement for students diagnonsed withADHD.ppt
Thesis Statement for students diagnonsed withADHD.ppt
 
Instructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptxInstructions for Submissions thorugh G- Classroom.pptx
Instructions for Submissions thorugh G- Classroom.pptx
 
How to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS ModuleHow to Split Bills in the Odoo 17 POS Module
How to Split Bills in the Odoo 17 POS Module
 
Language Across the Curriculm LAC B.Ed.
Language Across the  Curriculm LAC B.Ed.Language Across the  Curriculm LAC B.Ed.
Language Across the Curriculm LAC B.Ed.
 
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa
 
Unit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdfUnit 2- Research Aptitude (UGC NET Paper I).pdf
Unit 2- Research Aptitude (UGC NET Paper I).pdf
 
The geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideasThe geography of Taylor Swift - some ideas
The geography of Taylor Swift - some ideas
 
Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......Ethnobotany and Ethnopharmacology ......
Ethnobotany and Ethnopharmacology ......
 
The French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free downloadThe French Revolution Class 9 Study Material pdf free download
The French Revolution Class 9 Study Material pdf free download
 
Palestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptxPalestine last event orientationfvgnh .pptx
Palestine last event orientationfvgnh .pptx
 

S davis bblteurpoe2012_videofeedback

  • 1. Developing and delivering video feedback Simon Davis – University of York, UK Simon.davis@york.ac.uk
  • 2. Outline • Feedback; written vs video • Case study 1 – student presentations • Case study 2 – student work • Learning points
  • 3. (Assessment &) feedback in HE • Key to learning – constructive alignment (Biggs) • Weakest area for student satisfaction (NSS) • Feedback = “Any part of the learning process which is designed to guide student progress” – Adequacy, timeliness, usefulness, fairness* • Significant issues around timeliness, individualisation, engagement, impact, staff workload… * University of York guide to Assessment, Standards, Marking and Feedback
  • 4. Written feedback : the problem Lack of engagement with written feedback is related to its limitations: • Discourse of wfb - tacit knowledge making criteria explicit (Chanock, 2000) • Lack of shared understanding of criteria (Sadler, 1989, 2010) • Reinforces the distance between tutor expert and novice student • (Mis) interpretation of feedback • Disconnect between commentary and subject • Lack of depth
  • 5. Enhanced feedback • Audio – “soundsgood” project • Screencast feedback (McLaughlin 2009, Stannard 2007) • Video feedback (Thiissen 2012, Lightfoot 2010)
  • 6. Case study 1: Video feedback to develop student presentation skills (Physics) • Students n=125 • Students give a presentation in term 1 • These are recorded and uploaded onto the VLE • Feedback is given by staff, self reflection and peers • Students give a 2nd presentation in term 3 which builds on comments
  • 7. Case study: Video feedback
  • 8. 2010/11– Learning objects blog • Students record presentations > batch converted • Batch allocate students to groups (*16) • Folders restricted to groups containing LO blogs • Multiple videos embedded within the blogs – Individual tutor feedback – Peer feedback – Personal reflection
  • 9. 2011/12 – Blackboard blog • Blogs restricted to groups with Adaptive Release – Could use the My Groups area • Multiple videos embedded within the blogs – Peer feedback – Personal reflection – Staff feedback provided later
  • 10. Impact: comparing marks 2009 - 2010
  • 11. Impact: student evaluation (n=40) Select from the list below, anything that you feel helped you to develop your presentation skills: • Watching own presentation (94%) • Feedback from staff (83%) • Feedback from peers (83%) • Reflecting on my own presentation performance (76%) • Assessing the performance of other students against a provided set of criteria (64%)
  • 12. Impact: student comments • “Watching the video was most useful. Several things I felt went wrong during the talk weren't noticeable at all, while some things I didn't notice were”. • “The videos are especially good, and the fact that you can watch as many times as you like is very good. The ability to provide/ receive instant feedback is very helpful”. • “Highlighted my weaknesses more effectively”. • “It was useful having to analyse my own presentation rather than just forgetting about it. I was able to find faults myself which is more likely to help me improve next time. This wouldn’t have been possible without the talks being recorded”. • “The VLE provided an interactive source of feedback which helped me improve my speaking skills. The videos also helped me to see where I was going wrong with my presentation”.
  • 13. Case study 2: Screencast feedback on Academic Writing (Dept Education) • Masters ESOL classroom practice • ~20 international students • Mid term formative task – short academic essay • Written feedback after 1 week • Screencast feedback 1 week later – Via e-mail, VLE “too clunky”
  • 14. Designing and delivering feedback / feedforward • Review work and make notes / highlighting • Prepare positive and development bullet points • Prepare workspace and deliver feedback – Greet student by name and introduce yourself – State what feedback is on and how it is structured – Comment on positive aspects – Expand in detail on highlighted points – Give brief summary with feedforward (adapted from Cullen http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf)
  • 15. Impact: Student Survey (n=15/20 ) 1)attention to both types of fb 2) evaluating wfb versus sfb Students read wfb three times+ 9/15 Students viewed sfb three times+ 12/ 15 Q:If you were only able to receive one form of feedback, either written feedback comments or screen cast feedback, which of these two forms of feedback would you choose? 9 chose sfb 4 chose wfb (Kerr & McLaughlin study- three quarters chose sfb)
  • 16. Impact: Student responses, strengths of screencast fb (12) • “I think the most obvious advantage is that students can feel engaged as if their tutor is talking to them face to face” • “More straightforward and personal. It's like the tutor is talking to you in person. And the comments are directed to the parts of your article clearly.” • “More memorable because it‟s like the teacher is talking to you and giving instructions to you. Sometimes I can't recognize teachers' writing in the written feedback.”
  • 17. Learning from written feedback(12) • Strengths of written feedback • “I think the written feedback is more clear and specific about some small mistakes that I made (like some printing mistakes) while the screen cast tends to be focused mainly on the structure or some other macro aspects. • “You can read it anywhere you like (3) and it's easy to go back to check whereas the screen cast can only be read on your computer. Also, the information is more memorable to visual learners.” • Meeting this with screencast feedback • Ask students to respond to feedback with action points • Provide bullet pointed scripts along with
  • 18. Use of screencasts - reflections • Benefits – “over the shoulder intimacy” – „quick and dirty‟ helps develop trust and authenticity – personal style / nuance – any innovation that shows tutor commitment engenders positive attitude towards tutors (France & Ribchester, 2008) – Sfb has all the benefits of audio fb -depth of explanation, personalisation etc. but with added visual element – Most appropriate for formative feedback • Challenges – Production workload (rendering, distribution to students through VLE) – Getting “best of both” (written / screencast)
  • 19. vGuidance Pilot project: online screencast creation & access control • Bespoke system for (non-technical) careers advisers creating rich feedback (efficient, easy...) • Respond to student CV submissions (username) • Record feedback online (server side production) – Screencast-o-matic • Generic E-mail with advice and link to students • Students log in to access all feedback provided • Opportunity for face to face follow up
  • 20. Impact: student survey (n=12) • vGuidance is: – Convenient: 5 – Easy to use: 4.8 – Personal: 4.5 – Easy to understand feedback: 4.4 – Saves me time: 4.3 – Is engaging: 4.4 – Want future vGuidance feedback: 4.8
  • 21. Impact: student comments • “…the video was much more engaging” • “I think it is good that I will be able to keep viewing it whilst I update my CV with the suggestions that were made rather than leaving an appointment and maybe not remembering what was said.” • “Going through the CV in a visual manner helps to understand not only where to modify it, but also how in terms of spacial and lay-out aspects” • “It is easier to apply to the document you are working on. It creates extensive feedback so you are not confused by notes made.”
  • 22. Impact: staff response • Careers advisers: – Saves time (10-15 mins cf.30-60 for text equivalent) – Less fear of getting tone right / misinterpretation • Bill Soden – Removes production overheads – Removes access control issues
  • 23. Potential for integration with Blackboard Opportunities • Single sign on potential for simpler integration with VLE • Feedback could be organised by course, assignment etc. Challenges • Concerns over 3rd party API – funding • Scalability • Integration with Gradecentre • Room for human error (username)
  • 24. Final questions / comments • How can the ability to create and provide feedback through Blackboard be improved?
  • 25. References • Biggs, J.B. (2003). Teaching for quality learning at university. Buckingham: Open University Press/Society for Research into Higher Education. (Second edition) • Channock, K, (2000) Comments on Essays: do students understand what tutors write? Teaching in Higher Education, 5: 1, 95-105. • Cullen, R. Screencast feedback. Last accessed 2nd June 2011 from http://www.bioscience.heacademy.ac.uk/ftp/events/roehampton/screencast.pdf • France, D., & Ribchester, C. (2008). Podcasts and feedback. In G. Salmon & P. Edirisingha, (Eds.), Podcasting for learning in universities (pp 70-79). Berkshire: Open University Press. • Kerr, W., & McLaughlin, P. (2009). The benefit of screen recorded summaries in feedback for work submitted electronically. Last accessed 15th May 2011 from http://ebookbrowse.com/kerr-w-mclaughlin-p-formatted-b1-pdf-d116387872 • Lunt, T, & Curran, J. (2010) „Are you listening please?‟ The advantages of electronic audio feedback compared to written feedback. Assessment and Evaluation in Higher Education, 35: 7, 759-769. • Sadler, R. (2010) Beyond Feedback: developing student capability in complex appraisal. Assessment and Evaluation in Higher Education, 35: 5, 535-550. • Stannard (2007) Using screen capture software in student feedback: A case study from the HEA English Subject Centre. Last accessed 15th May, 2011 http://www.english.heacademy.ac.uk/explore/publications/casestudies/technology/camtasia .php)