SlideShare a Scribd company logo
1 of 24
Download to read offline
The SpokenMedia Project: Toward Rich Media Notebooks for  Teaching and Learning Brandon Muramatsu [email_address] MIT, Office of Educational Innovation and Technology Andrew McKinney, MIT OEIT Phillip Long and John Zornig, University of Queensland Citation: Muramatsu, B., McKinney, A., Long, P. D., & Zornig, J. (2009). The SpokenMedia Project: Toward Rich Media Notebooks for Teaching and Learning. Presented at the Technology 4 Education Workshop: Bangalore, India, August 4, 2009. Unless otherwise specified, this work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License
Why are we doing this? ,[object Object],[object Object],[object Object],MIT OCW 8.01 : Professor Lewin puts his life on the line in  Lecture 11  by demonstrating his faith in the Conservation of Mechanical Energy.
What are the challenges? ,[object Object],[object Object],[object Object],[object Object],Google Search for  “ angular momentum” Performed April 2009
What are the challenges? ,[object Object],[object Object],[object Object],Ghosh, A. (2008). Module 2–Lecture 2–Inertia Tensor & Angular Momentum. Retrieved August 1, 2009 from YouTube Website:  http://www.youtube.com/watch?v=a9n2Ztp1Oic
What about Bing? Bing Search for “angular momentum” Performed August 2009
Why do we want these tools? MIT OpenCourseWare Lectures ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
What can we do today? ,[object Object],[object Object],[object Object]
Spoken Lecture Browser ,[object Object]
How do we do it? Lecture Transcription ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],James Glass [email_address]
Spoken Lecture Project ,[object Object],[object Object],[object Object],[object Object],[object Object],James Glass [email_address]
How Does it Work? Lecture Transcription Workflow
Recognizer Accuracy ~85% ,[object Object],[object Object],[object Object],[object Object]
Transcript “Errors” ,[object Object],[object Object],[object Object],[object Object],[object Object]
That’s what we have today… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Where are we heading? ,[object Object],[object Object]
Transition: Research to Production A Lecture Transcription Service ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
A Lecture Transcription Service? Caveats ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Toward Rich Media Notebooks Improving the User Experience ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Alternate Representations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Microsoft Project Tuva research.microsoft.com/apps/tools/tuva/
MIT OCW Highlights for High School http://ocw.mit.edu/ans7870/hs/physics/8.01/8.01-f99-vl20.ram
Look Listen Learn Interface www.looklistenlearn.info/math/mit/
Google Audio Indexing labs.google.com/gaudi
Thanks!   oeit.mit.edu/spokenmedia Brandon Muramatsu [email_address] MIT, Office of Educational Innovation and Technology Andrew McKinney, MIT OEIT Phillip Long and John Zornig, University of Queensland Citation: Muramatsu, B., McKinney, A., Long, P. D., & Zornig, J. (2009). The SpokenMedia Project: Toward Rich Media Notebooks for Teaching and Learning. Presented at the Technology 4 Education Workshop: Bangalore, India, August 4, 2009. Unless otherwise specified, this work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License

More Related Content

What's hot

Podcasting In Higher Education002
Podcasting In Higher Education002Podcasting In Higher Education002
Podcasting In Higher Education002Dan Cabrera
 
Call - How to use chat
Call - How to use chatCall - How to use chat
Call - How to use chatayu_melati01
 
Chat in language teaching
Chat in language teachingChat in language teaching
Chat in language teachingsarymuz
 
Design Production Delivery Of Social Media Content for EMS Instructors
Design Production Delivery Of Social Media Content for EMS InstructorsDesign Production Delivery Of Social Media Content for EMS Instructors
Design Production Delivery Of Social Media Content for EMS InstructorsGreg Friese
 

What's hot (10)

Podcasting In Higher Education002
Podcasting In Higher Education002Podcasting In Higher Education002
Podcasting In Higher Education002
 
I am voki 2 !
I am voki  2 !I am voki  2 !
I am voki 2 !
 
I am voki !
I am voki !I am voki !
I am voki !
 
I am voki 2 !
I am voki  2 !I am voki  2 !
I am voki 2 !
 
Podcast Workshop Staff Development Sept09
Podcast Workshop Staff Development Sept09Podcast Workshop Staff Development Sept09
Podcast Workshop Staff Development Sept09
 
Shawn Severson
Shawn SeversonShawn Severson
Shawn Severson
 
Chat language
Chat languageChat language
Chat language
 
Call - How to use chat
Call - How to use chatCall - How to use chat
Call - How to use chat
 
Chat in language teaching
Chat in language teachingChat in language teaching
Chat in language teaching
 
Design Production Delivery Of Social Media Content for EMS Instructors
Design Production Delivery Of Social Media Content for EMS InstructorsDesign Production Delivery Of Social Media Content for EMS Instructors
Design Production Delivery Of Social Media Content for EMS Instructors
 

Similar to SpokenMedia Project: Media-Linked Transcripts and Rich Media Notebooks for Learning and Teaching at T4E 2009

SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009
SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009
SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009Brandon Muramatsu
 
IIHS Open Framework-SpokenMedia
IIHS Open Framework-SpokenMediaIIHS Open Framework-SpokenMedia
IIHS Open Framework-SpokenMediaBrandon Muramatsu
 
Video Sharing In The Online Classroom
Video Sharing In The Online ClassroomVideo Sharing In The Online Classroom
Video Sharing In The Online Classroommpstenson
 
Video Captioning for Accessibility: University of Florida and Regis Universit...
Video Captioning for Accessibility: University of Florida and Regis Universit...Video Captioning for Accessibility: University of Florida and Regis Universit...
Video Captioning for Accessibility: University of Florida and Regis Universit...3Play Media
 
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...University of Wisconsin: Captioning and Transcription Policies, Uses and Work...
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...3Play Media
 
Tech 571 taylor mounts design principals module 3
Tech 571 taylor mounts design principals module 3Tech 571 taylor mounts design principals module 3
Tech 571 taylor mounts design principals module 3taylormounts
 
Choosing Ed Tech- Presentations
Choosing Ed Tech- PresentationsChoosing Ed Tech- Presentations
Choosing Ed Tech- Presentationsjason toal
 
MCC Emerging Technology
MCC Emerging TechnologyMCC Emerging Technology
MCC Emerging Technologydrvdiazbus
 
Final Ttt Technology Powerpoint
Final Ttt Technology PowerpointFinal Ttt Technology Powerpoint
Final Ttt Technology PowerpointDavid Lisa
 
Tools for Designing Distance Learning Instruction
Tools for Designing Distance Learning InstructionTools for Designing Distance Learning Instruction
Tools for Designing Distance Learning InstructionMarsha J. Chan
 
Low-Cost, High-Gain Technologies for Teaching
Low-Cost, High-Gain Technologies for TeachingLow-Cost, High-Gain Technologies for Teaching
Low-Cost, High-Gain Technologies for Teachingbrettssu
 
Accessibility online courses-trends tips tools
Accessibility online courses-trends tips toolsAccessibility online courses-trends tips tools
Accessibility online courses-trends tips toolsFelicia Cruz
 
Final Ttt Technology Ppt 020909
Final Ttt Technology Ppt 020909Final Ttt Technology Ppt 020909
Final Ttt Technology Ppt 020909David Lisa
 
Do It Yourself Tutorials Adobe Captivate
Do It Yourself Tutorials Adobe CaptivateDo It Yourself Tutorials Adobe Captivate
Do It Yourself Tutorials Adobe Captivatellrath5
 
Free Educational Technology Tools
Free Educational Technology ToolsFree Educational Technology Tools
Free Educational Technology ToolsCheryl Wissick
 
Alternate Methods for Delivering In-Service Training
Alternate Methods for Delivering In-Service TrainingAlternate Methods for Delivering In-Service Training
Alternate Methods for Delivering In-Service TrainingVideoguy
 

Similar to SpokenMedia Project: Media-Linked Transcripts and Rich Media Notebooks for Learning and Teaching at T4E 2009 (20)

SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009
SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009
SpokenMedia: Content, Content Everywhere...What video? Where? at OpenEd 2009
 
IIHS Open Framework-SpokenMedia
IIHS Open Framework-SpokenMediaIIHS Open Framework-SpokenMedia
IIHS Open Framework-SpokenMedia
 
Ttt Techfinal
Ttt TechfinalTtt Techfinal
Ttt Techfinal
 
Video Sharing In The Online Classroom
Video Sharing In The Online ClassroomVideo Sharing In The Online Classroom
Video Sharing In The Online Classroom
 
Video Captioning for Accessibility: University of Florida and Regis Universit...
Video Captioning for Accessibility: University of Florida and Regis Universit...Video Captioning for Accessibility: University of Florida and Regis Universit...
Video Captioning for Accessibility: University of Florida and Regis Universit...
 
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...University of Wisconsin: Captioning and Transcription Policies, Uses and Work...
University of Wisconsin: Captioning and Transcription Policies, Uses and Work...
 
Tech 571 taylor mounts design principals module 3
Tech 571 taylor mounts design principals module 3Tech 571 taylor mounts design principals module 3
Tech 571 taylor mounts design principals module 3
 
Choosing Ed Tech- Presentations
Choosing Ed Tech- PresentationsChoosing Ed Tech- Presentations
Choosing Ed Tech- Presentations
 
MCC Emerging Technology
MCC Emerging TechnologyMCC Emerging Technology
MCC Emerging Technology
 
Final Ttt Technology Powerpoint
Final Ttt Technology PowerpointFinal Ttt Technology Powerpoint
Final Ttt Technology Powerpoint
 
Tools for Designing Distance Learning Instruction
Tools for Designing Distance Learning InstructionTools for Designing Distance Learning Instruction
Tools for Designing Distance Learning Instruction
 
Low-Cost, High-Gain Technologies for Teaching
Low-Cost, High-Gain Technologies for TeachingLow-Cost, High-Gain Technologies for Teaching
Low-Cost, High-Gain Technologies for Teaching
 
Accessibility online courses-trends tips tools
Accessibility online courses-trends tips toolsAccessibility online courses-trends tips tools
Accessibility online courses-trends tips tools
 
12 04
12 0412 04
12 04
 
Final Ttt Technology Ppt 020909
Final Ttt Technology Ppt 020909Final Ttt Technology Ppt 020909
Final Ttt Technology Ppt 020909
 
Do It Yourself Tutorials Adobe Captivate
Do It Yourself Tutorials Adobe CaptivateDo It Yourself Tutorials Adobe Captivate
Do It Yourself Tutorials Adobe Captivate
 
A Survey of Web 2.0 Technologies Pang
A Survey of Web 2.0 Technologies PangA Survey of Web 2.0 Technologies Pang
A Survey of Web 2.0 Technologies Pang
 
Free Educational Technology Tools
Free Educational Technology ToolsFree Educational Technology Tools
Free Educational Technology Tools
 
Alternate Methods for Delivering In-Service Training
Alternate Methods for Delivering In-Service TrainingAlternate Methods for Delivering In-Service Training
Alternate Methods for Delivering In-Service Training
 
UDL 2.0
UDL 2.0UDL 2.0
UDL 2.0
 

More from Brandon Muramatsu

Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Brandon Muramatsu
 
Sustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive DiscussionSustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive DiscussionBrandon Muramatsu
 
Bridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college studentsBridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college studentsBrandon Muramatsu
 
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureFederations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureBrandon Muramatsu
 
The Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaBrandon Muramatsu
 
The Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaBrandon Muramatsu
 
Strategic Education Initiatives , MIT Open Learning
Strategic Education Initiatives, MIT Open LearningStrategic Education Initiatives, MIT Open Learning
Strategic Education Initiatives , MIT Open LearningBrandon Muramatsu
 
Open Embedded Assessments: Play, Author; Anywhere, Anytime
Open Embedded Assessments:Play, Author; Anywhere, AnytimeOpen Embedded Assessments:Play, Author; Anywhere, Anytime
Open Embedded Assessments: Play, Author; Anywhere, AnytimeBrandon Muramatsu
 
DXtera Enabling Digital Exchange
DXtera Enabling Digital ExchangeDXtera Enabling Digital Exchange
DXtera Enabling Digital ExchangeBrandon Muramatsu
 
Evaluating and Selecting Digital Learning Resources
Evaluating and Selecting Digital Learning ResourcesEvaluating and Selecting Digital Learning Resources
Evaluating and Selecting Digital Learning ResourcesBrandon Muramatsu
 
Connected Learning Initiative: Learning at Scale
Connected Learning Initiative: Learning at ScaleConnected Learning Initiative: Learning at Scale
Connected Learning Initiative: Learning at ScaleBrandon Muramatsu
 
CLIx-Connected Learning Intiative
CLIx-Connected Learning IntiativeCLIx-Connected Learning Intiative
CLIx-Connected Learning IntiativeBrandon Muramatsu
 
The Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
The Best of Both Worlds: Transforming OpenCourseWare in an age of InteractivityThe Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
The Best of Both Worlds: Transforming OpenCourseWare in an age of InteractivityBrandon Muramatsu
 
Innovative Educational Technology and Educational Infrastructure at MIT
Innovative Educational Technologyand Educational Infrastructureat MITInnovative Educational Technologyand Educational Infrastructureat MIT
Innovative Educational Technology and Educational Infrastructure at MITBrandon Muramatsu
 
Strategic Education Initiatives
Strategic Education InitiativesStrategic Education Initiatives
Strategic Education InitiativesBrandon Muramatsu
 
Workshop: Emerging Possibilities and Takeaways for KFUPM
Workshop: Emerging Possibilities and Takeaways for KFUPMWorkshop: Emerging Possibilities and Takeaways for KFUPM
Workshop: Emerging Possibilities and Takeaways for KFUPMBrandon Muramatsu
 
Workshop: Lessons from Online and edX / MITx Courses
Workshop: Lessons from Online and edX / MITx CoursesWorkshop: Lessons from Online and edX / MITx Courses
Workshop: Lessons from Online and edX / MITx CoursesBrandon Muramatsu
 
Workshop: Design Considerations for Online / Digital Courses
Workshop: Design Considerations for Online / Digital CoursesWorkshop: Design Considerations for Online / Digital Courses
Workshop: Design Considerations for Online / Digital CoursesBrandon Muramatsu
 
Workshop: Educational Technology Opportunities for KFUPM
Workshop: Educational Technology Opportunities for KFUPMWorkshop: Educational Technology Opportunities for KFUPM
Workshop: Educational Technology Opportunities for KFUPMBrandon Muramatsu
 

More from Brandon Muramatsu (20)

Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...Digital Credentials Enabling Mobility and Verification of Educational Achieve...
Digital Credentials Enabling Mobility and Verification of Educational Achieve...
 
Sustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive DiscussionSustainability of OER Initiatives: An Interactive Discussion
Sustainability of OER Initiatives: An Interactive Discussion
 
Bridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college studentsBridging the Gap: Mixing approaches, content and tools to help college students
Bridging the Gap: Mixing approaches, content and tools to help college students
 
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education InfrastructureFederations & Backstage: Thoughts for a Geoscience Education Infrastructure
Federations & Backstage: Thoughts for a Geoscience Education Infrastructure
 
The Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in India
 
The Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in IndiaThe Connected Learning Initiative Quality at Scale in India
The Connected Learning Initiative Quality at Scale in India
 
Strategic Education Initiatives , MIT Open Learning
Strategic Education Initiatives, MIT Open LearningStrategic Education Initiatives, MIT Open Learning
Strategic Education Initiatives , MIT Open Learning
 
Open Embedded Assessments: Play, Author; Anywhere, Anytime
Open Embedded Assessments:Play, Author; Anywhere, AnytimeOpen Embedded Assessments:Play, Author; Anywhere, Anytime
Open Embedded Assessments: Play, Author; Anywhere, Anytime
 
DXtera Enabling Digital Exchange
DXtera Enabling Digital ExchangeDXtera Enabling Digital Exchange
DXtera Enabling Digital Exchange
 
Evaluating and Selecting Digital Learning Resources
Evaluating and Selecting Digital Learning ResourcesEvaluating and Selecting Digital Learning Resources
Evaluating and Selecting Digital Learning Resources
 
Online Recitation Sessions
Online Recitation SessionsOnline Recitation Sessions
Online Recitation Sessions
 
Connected Learning Initiative: Learning at Scale
Connected Learning Initiative: Learning at ScaleConnected Learning Initiative: Learning at Scale
Connected Learning Initiative: Learning at Scale
 
CLIx-Connected Learning Intiative
CLIx-Connected Learning IntiativeCLIx-Connected Learning Intiative
CLIx-Connected Learning Intiative
 
The Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
The Best of Both Worlds: Transforming OpenCourseWare in an age of InteractivityThe Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
The Best of Both Worlds: Transforming OpenCourseWare in an age of Interactivity
 
Innovative Educational Technology and Educational Infrastructure at MIT
Innovative Educational Technologyand Educational Infrastructureat MITInnovative Educational Technologyand Educational Infrastructureat MIT
Innovative Educational Technology and Educational Infrastructure at MIT
 
Strategic Education Initiatives
Strategic Education InitiativesStrategic Education Initiatives
Strategic Education Initiatives
 
Workshop: Emerging Possibilities and Takeaways for KFUPM
Workshop: Emerging Possibilities and Takeaways for KFUPMWorkshop: Emerging Possibilities and Takeaways for KFUPM
Workshop: Emerging Possibilities and Takeaways for KFUPM
 
Workshop: Lessons from Online and edX / MITx Courses
Workshop: Lessons from Online and edX / MITx CoursesWorkshop: Lessons from Online and edX / MITx Courses
Workshop: Lessons from Online and edX / MITx Courses
 
Workshop: Design Considerations for Online / Digital Courses
Workshop: Design Considerations for Online / Digital CoursesWorkshop: Design Considerations for Online / Digital Courses
Workshop: Design Considerations for Online / Digital Courses
 
Workshop: Educational Technology Opportunities for KFUPM
Workshop: Educational Technology Opportunities for KFUPMWorkshop: Educational Technology Opportunities for KFUPM
Workshop: Educational Technology Opportunities for KFUPM
 

Recently uploaded

BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...Nguyen Thanh Tu Collection
 
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQuiz Club NITW
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWQuiz Club NITW
 
4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptxmary850239
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Celine George
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroomSamsung Business USA
 
Employablity presentation and Future Career Plan.pptx
Employablity presentation and Future Career Plan.pptxEmployablity presentation and Future Career Plan.pptx
Employablity presentation and Future Career Plan.pptxryandux83rd
 
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxBIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxSayali Powar
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...DhatriParmar
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationdeepaannamalai16
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Projectjordimapav
 
Scientific Writing :Research Discourse
Scientific  Writing :Research  DiscourseScientific  Writing :Research  Discourse
Scientific Writing :Research DiscourseAnita GoswamiGiri
 
Comparative Literature in India by Amiya dev.pptx
Comparative Literature in India by Amiya dev.pptxComparative Literature in India by Amiya dev.pptx
Comparative Literature in India by Amiya dev.pptxAvaniJani1
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...Nguyen Thanh Tu Collection
 
4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptxmary850239
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 

Recently uploaded (20)

BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...
BÀI TẬP BỔ TRỢ TIẾNG ANH 11 THEO ĐƠN VỊ BÀI HỌC - CẢ NĂM - CÓ FILE NGHE (GLOB...
 
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITWQ-Factor General Quiz-7th April 2024, Quiz Club NITW
Q-Factor General Quiz-7th April 2024, Quiz Club NITW
 
Chi-Square Test Non Parametric Test Categorical Variable
Chi-Square Test Non Parametric Test Categorical VariableChi-Square Test Non Parametric Test Categorical Variable
Chi-Square Test Non Parametric Test Categorical Variable
 
Mythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITWMythology Quiz-4th April 2024, Quiz Club NITW
Mythology Quiz-4th April 2024, Quiz Club NITW
 
4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx4.9.24 Social Capital and Social Exclusion.pptx
4.9.24 Social Capital and Social Exclusion.pptx
 
Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17Tree View Decoration Attribute in the Odoo 17
Tree View Decoration Attribute in the Odoo 17
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom6 ways Samsung’s Interactive Display powered by Android changes the classroom
6 ways Samsung’s Interactive Display powered by Android changes the classroom
 
Employablity presentation and Future Career Plan.pptx
Employablity presentation and Future Career Plan.pptxEmployablity presentation and Future Career Plan.pptx
Employablity presentation and Future Career Plan.pptx
 
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptxBIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
BIOCHEMISTRY-CARBOHYDRATE METABOLISM CHAPTER 2.pptx
 
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
Beauty Amidst the Bytes_ Unearthing Unexpected Advantages of the Digital Wast...
 
Congestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentationCongestive Cardiac Failure..presentation
Congestive Cardiac Failure..presentation
 
ClimART Action | eTwinning Project
ClimART Action    |    eTwinning ProjectClimART Action    |    eTwinning Project
ClimART Action | eTwinning Project
 
Scientific Writing :Research Discourse
Scientific  Writing :Research  DiscourseScientific  Writing :Research  Discourse
Scientific Writing :Research Discourse
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
Comparative Literature in India by Amiya dev.pptx
Comparative Literature in India by Amiya dev.pptxComparative Literature in India by Amiya dev.pptx
Comparative Literature in India by Amiya dev.pptx
 
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...
BÀI TẬP BỔ TRỢ TIẾNG ANH 8 - I-LEARN SMART WORLD - CẢ NĂM - CÓ FILE NGHE (BẢN...
 
4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx4.9.24 School Desegregation in Boston.pptx
4.9.24 School Desegregation in Boston.pptx
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 

SpokenMedia Project: Media-Linked Transcripts and Rich Media Notebooks for Learning and Teaching at T4E 2009

  • 1. The SpokenMedia Project: Toward Rich Media Notebooks for Teaching and Learning Brandon Muramatsu [email_address] MIT, Office of Educational Innovation and Technology Andrew McKinney, MIT OEIT Phillip Long and John Zornig, University of Queensland Citation: Muramatsu, B., McKinney, A., Long, P. D., & Zornig, J. (2009). The SpokenMedia Project: Toward Rich Media Notebooks for Teaching and Learning. Presented at the Technology 4 Education Workshop: Bangalore, India, August 4, 2009. Unless otherwise specified, this work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License
  • 2.
  • 3.
  • 4.
  • 5. What about Bing? Bing Search for “angular momentum” Performed August 2009
  • 6.
  • 7.
  • 8.
  • 9.
  • 10.
  • 11. How Does it Work? Lecture Transcription Workflow
  • 12.
  • 13.
  • 14.
  • 15.
  • 16.
  • 17.
  • 18.
  • 19.
  • 20. Microsoft Project Tuva research.microsoft.com/apps/tools/tuva/
  • 21. MIT OCW Highlights for High School http://ocw.mit.edu/ans7870/hs/physics/8.01/8.01-f99-vl20.ram
  • 22. Look Listen Learn Interface www.looklistenlearn.info/math/mit/
  • 23. Google Audio Indexing labs.google.com/gaudi
  • 24. Thanks! oeit.mit.edu/spokenmedia Brandon Muramatsu [email_address] MIT, Office of Educational Innovation and Technology Andrew McKinney, MIT OEIT Phillip Long and John Zornig, University of Queensland Citation: Muramatsu, B., McKinney, A., Long, P. D., & Zornig, J. (2009). The SpokenMedia Project: Toward Rich Media Notebooks for Teaching and Learning. Presented at the Technology 4 Education Workshop: Bangalore, India, August 4, 2009. Unless otherwise specified, this work is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 United States License

Editor's Notes

  1. Why are we doing this? In the last few years, we’ve seen an explosion of videos on the web. Self publishing by millions on YouTube. Universities recording course lectures and putting them on the web. Students are relying upon web video for learning. Common statistic mentioned by folks like UC Berkeley (which has been doing course webcasts since 1999) is that usage spikes as students prepare for tests, and that they tend to focus on small segments of the video Also, cultural organizations (museums, foundations, non-profit organizations) sharing their interviews on the web. Other similar single speaker web video, cost of technology has come down.
  2. What are the challenges? Large volume of material to search through! Search results—approximately 3 Million in Google (April 2009): Wikipedia, Angular and Conservation of Angular Momentum links might be useful Quantum mechanics link is probably too advanced Angular Momentum (company) probably not useful But no videos Oh, there’s a way of just doing a video search at Google, search is segmented by media type Google Video Search results—only 400 (April 2009), that’s better: All appear to be relevant Two are lecture length (i.e. 20+ minutes or longer): Mechanical Universe, and Lecture 21 from MIT OCW Four are probably demos relating angular momentum to physical examples (tennis, ice skating) Search results are based on: Metadata Title of video/link Text description of video (typically short), or the text surrounding an embedded video
  3. Additional Challenges Interaction and Use Get the full length video, over 50 minutes There may or may not be a transcript, which may or may not be displayed as captioning for accessibility Policy Implications Technology allows for bookmarking and comments, they aren’t enabled
  4. What about Bing? Fewer Web search results, only 1 Million (August 2009) Three of top six are for companies (two for watchmaker, one for other) Still segmented searching (web, video) Much less Video search results, only 2,400 (August 2009) Video search results much less relevant, First five are for watches, Next three are educational, Does not include Mechanical Universe or MIT OCW videos in first 20 results, NPTEL video is result 19
  5. Why do we want these tools? MIT as the customer Lots of materials, 1900+ OCW courses, some with video/audio Opportunities for positive change: improving presentation and user experience, advocate for new methods of interaction
  6. What can we do today? Demo of Spoken Lecture Browser
  7. Spoken Lecture Browser Demo Search of video library Search results show search query in context, query highlighted in yellow Results show “conceptual chunks” Player controls video and bouncing ball in the transcript Uses 2006 technology, Real Player – needs to get updated for current technlogy Much of the work for the Spoken Lecture browser and player completed in 2006 (though recognizer research continues) In 2006, Real could allow within movie bookmarks and playback In 2006, Real was the preferred high-quality video playback mechanism on the Web (lots has changed since then)
  8. Lecture Transcription Jim Glass and his group have years of research experience for spoken languages Lectures are a different type of spoken language Much of the speech recognition research has focused on real time transcription of news broadcasts, or interactive voice response systems (telephone) Broadcast news has something like 300 unique words in an hour long broadcast Broadcast news is well structured, prepared copy (in studio via teleprompters), clear transitions between speakers, etc. Lectures are conversational and spontaneous Can use highly specialized vocabularies, engineering, physical sciences, mathematics
  9. Spoken Lecture Project Supported by iCampus Includes the browser (which was just demo’d) the processor (back end lecture transcription) and a hand workflow to do the processing Approximately 400 hours of video indexed
  10. How does it work? Audio System only needs audio (waveform), extracts from video Domain Model (base is generic domain model) System needs to know what words it can expect to find in the audio Syllabus, lecture notes, index from text book, research papers Build library of domains Separate sub-process for text for domain model Speaker model (base is generic speaker model) If multiple lectures by the same author, best to create a speaker model Separate sub-process for speaker model Process—With audio, domain and speaker models Output Time coded transcript (standard formats) Links media and transcript Applications Search/retrieval Player
  11. Recognizer Accuracy Base accuracy is approximately 50% (generic domain and speaker models) Increase accuracy with speaker model up to 80-85%, and specific domain model This approach is good for courses with multiple lectures by the same speaker Domain models get more useful as more relevant text documents are indexed (keyword/noun phrase extraction) Initial results indicate that doing one 99% accurate (by hand/manual) transcript can help immensely for additional lectures by the same speaker Better use of limited resources Search accuracy is closer to 90%, searches tend to be for unique words which the processor is better at recognizing
  12. Transcript “Errors” Recall, processor has 85% accuracy Here are two examples of recognizer errors… In the first case, looking at the transcript, it’s hard to say what the speaker (Lewin) might have said Continuing … it’s unlikely that he used the word “fork” twice Let’s listen…ok. It’s torque not fork Recognizer can recognize when it’s guessing—that’s not exposed in a public interface, but could be
  13. What we have today It’s not perfect, but a pretty good start Prototype has a number of useful features that demonstrate search interfaces and interaction interfaces
  14. Where are we heading? Transition from research project to service Explore new interactions—what we’re calling Rich Media Notebooks
  15. Towards a Lecture Transcription Service OEIT at MIT’s goal is to transition from research to production First priority to get running on our servers Prototype a transcript production service—second priority For MIT Automate a mostly hand process Considering integration with local Podcast Producer workflow engine (Apple) Integrate into media production workflow, as a plugin Partner with other content producers to test service—tied for third priority See how it meets needs of other content producers See how it plays with Opencast Matterhorn, distributed service
  16. A Lecture Transcription Service? Caveats Full disclosure, limitations we know about or think are important We’ve been asked about other languages Should be possible Jim Glass is experimenting with Chinese Would have to create a language model, not sure what’s involved with that Current plan to host a web service from MIT Contribution will be important aspect of participation
  17. Toward Rich Media Notebooks Updating the playback—third priority Flash and H.264 encoded video Implement other common video features (e.g., from YouTube and other commercial video sites) Bookmarking, annotations and comments (timestamp, text fields) Clip creation (ala XMAS cross media annotation system) Down the road Social editing to improve transcripts, wiki interfaces, trust systems Concept and semantic searching—current system breaks text up into “logical” chunks, and lets users search for a term or phrase, but doesn’t really get to concepts.
  18. OCW Highlights for High School Links MIT OCW course materials to Advanced Placement tests Created by undergrads and high school students Hand-created link between topics in AP Physics and existing course resources Links concepts to specific video segments
  19. Look Listen Learn Hand crafted from MIT OCW video Created equations that are written on the board (in LaTeX) Displays equations as they are written Displays transcripts as well Must have taken quite a bit of time to do this Probably a really good interface for the material
  20. Google Audio Indexing Google Labs Project Indexed CSPAN on economy and 2008 U.S. Presidential elections Similar search results and display of segments (though less text for context) Takes advantage of playback from within Flash at YouTube (which they haven’t made available to the general public as far as I know yet)