SlideShare a Scribd company logo
Turning video content into text with
embedded translation, dictionary, and
karaoke-style of narration tracing
BubbleReader
Executive summary
Boredom, friction, and procrastination are usually the main barrier when studying any complex content (foreign,
technical, abstract) for learning or studying purposes. 



The bubble reader is for anyone who needs to overcome those barriers: 

- from authentic materials taken from YouTube 

- by being able to repeat wherever they want with automatic follow-up of words 

- with inline words and expression translation

The platform addresses 3 specifics requirement for anyone who wants to make progress in the target language they
wish to learn (either language learning or technical learning):

- Vocabulary learning 

- speaking practices (Karaoke style)

- Listening practices
Project background
There are 3 sources of frustration when learning Japanese
ZZZZzzzzzzz….
1.Friction because of
swapping between multiple
Content sources and types
2.Boredom because of
“ping-pong” type of dialog
content creating “no hook”
3.Procrastination
because there’s no
“incentive” to be active
VS
A new hope is necessary
1.Friction
2.Boredom
3. Procrastination
1.Integrated content
2.Engaging content
3. Hooks the mind
COMMUNITY CONTENT TECHNOLOGY
DESIGN
Bubble Reader
Finding the magic trinity is the key
1. Community Content is what will
keep the motivation high (fresher
content all the time
2. Technology is what will make this
content accessible
3. Design is what will make the user
hooked
www.bubblereader.com: 

Overview and current state
The platform os a web application, runnable pretty much on all OS, browsers and
devices
Current implementation: breakdown of the features 1 / 3
1. The content isYouTube embedded
videos.
2. The narration from the video is
synched with a “Bubble” (a
rounded cursor).
3. On screen text turns from grey to
white as the narration progresses.
4. Furigana for Kanjis are displayed
5. A translation is displayed inline.
1
2 3
4
5
Current implementation: breakdown of the features 2 / 3
1
2
3
From an overlaid word:
1. Inline dictionary
2. Text to Speech to repeat the selected
word
3. add the selected word to a personal
word bank
Current implementation: breakdown of the features 3 / 3
1
2
3
1. Youtube’s features such as playback spee
2. Auto-scroll on/off (screen re-center
automatically when the bubble reaches a
certain distance from the bottom of the
screen)
3. Translation ON/OFF
Current implementation: breakdown of the features 3 / 3
1
2
3
1. Youtube’s features such as playback spee
2. Auto-scroll on/off (screen re-center
automatically when the bubble reaches a
certain distance from the bottom of the
screen)
3. Translation ON/OFF
Marc-Alexandre Cartiant Lixil (Michael) He
Thank you!

More Related Content

Similar to Passive Japanese learning: BubbleReader

Presentation final
Presentation finalPresentation final
Presentation final
Shuvra Debnath
 
Part one
Part onePart one
Part one
islanders363
 
Ltad3240 multimediatoolspresentation
Ltad3240 multimediatoolspresentationLtad3240 multimediatoolspresentation
Ltad3240 multimediatoolspresentation
Gary Kokaisel
 
Using screencasts to teach undergraduate programming
Using screencasts to teach undergraduate programmingUsing screencasts to teach undergraduate programming
Using screencasts to teach undergraduate programming
Martin Chapman
 
Presentation on ShotCut - How to edit video and audio
Presentation on ShotCut - How to edit video and audioPresentation on ShotCut - How to edit video and audio
Presentation on ShotCut - How to edit video and audio
LeenaRamduth2
 
Talking Technologies
Talking TechnologiesTalking Technologies
Talking Technologies
Jisc Scotland
 
Screencasting in the cloud
Screencasting in the cloudScreencasting in the cloud
Screencasting in the cloud
Caroline Conlon
 
Jisc RSC Eastern eFair 2012 'Free enabling technologies'
Jisc RSC Eastern eFair 2012 'Free enabling technologies'Jisc RSC Eastern eFair 2012 'Free enabling technologies'
Jisc RSC Eastern eFair 2012 'Free enabling technologies'
JISC RSC Eastern
 
Video Accessibility
Video Accessibility Video Accessibility
Video Accessibility
Kenneth Ronkowitz
 
Using Screencasts in Chat Reference
Using Screencasts in Chat ReferenceUsing Screencasts in Chat Reference
Using Screencasts in Chat Reference
Lauren Ray
 
Creating+Publishing 4 Learning Platform
Creating+Publishing 4 Learning PlatformCreating+Publishing 4 Learning Platform
Creating+Publishing 4 Learning Platform
juliancoultas
 
INTERACTIVE_MULTIMEDIA.pptx
INTERACTIVE_MULTIMEDIA.pptxINTERACTIVE_MULTIMEDIA.pptx
INTERACTIVE_MULTIMEDIA.pptx
jessemaguiya1
 
Bryan J. Hogan
Bryan J. HoganBryan J. Hogan
Bryan J. Hogan
Videoguy
 
Email Templates_1.docx
Email Templates_1.docxEmail Templates_1.docx
Email Templates_1.docx
AniketGaikwad91
 
Email Templates_1.docx
Email Templates_1.docxEmail Templates_1.docx
Email Templates_1.docx
AniketGaikwad91
 
Towards A Spoken Version of Google
Towards A Spoken Version of GoogleTowards A Spoken Version of Google
Towards A Spoken Version of Google
linshanleearchive
 
How to make an audio powerpoint presentation
How to make an audio powerpoint presentationHow to make an audio powerpoint presentation
How to make an audio powerpoint presentation
flabs84
 
Inclusive E-Learning good practice becoming general practice
Inclusive E-Learning good practice becoming general practiceInclusive E-Learning good practice becoming general practice
Inclusive E-Learning good practice becoming general practice
Staff Development
 
Free tools for the classroom webinar
Free tools for the classroom webinarFree tools for the classroom webinar
Free tools for the classroom webinar
Karen Brooks
 
L10 Interactive Multimedia.pptx
L10 Interactive Multimedia.pptxL10 Interactive Multimedia.pptx
L10 Interactive Multimedia.pptx
MICHAELAKRISTELLESAN1
 

Similar to Passive Japanese learning: BubbleReader (20)

Presentation final
Presentation finalPresentation final
Presentation final
 
Part one
Part onePart one
Part one
 
Ltad3240 multimediatoolspresentation
Ltad3240 multimediatoolspresentationLtad3240 multimediatoolspresentation
Ltad3240 multimediatoolspresentation
 
Using screencasts to teach undergraduate programming
Using screencasts to teach undergraduate programmingUsing screencasts to teach undergraduate programming
Using screencasts to teach undergraduate programming
 
Presentation on ShotCut - How to edit video and audio
Presentation on ShotCut - How to edit video and audioPresentation on ShotCut - How to edit video and audio
Presentation on ShotCut - How to edit video and audio
 
Talking Technologies
Talking TechnologiesTalking Technologies
Talking Technologies
 
Screencasting in the cloud
Screencasting in the cloudScreencasting in the cloud
Screencasting in the cloud
 
Jisc RSC Eastern eFair 2012 'Free enabling technologies'
Jisc RSC Eastern eFair 2012 'Free enabling technologies'Jisc RSC Eastern eFair 2012 'Free enabling technologies'
Jisc RSC Eastern eFair 2012 'Free enabling technologies'
 
Video Accessibility
Video Accessibility Video Accessibility
Video Accessibility
 
Using Screencasts in Chat Reference
Using Screencasts in Chat ReferenceUsing Screencasts in Chat Reference
Using Screencasts in Chat Reference
 
Creating+Publishing 4 Learning Platform
Creating+Publishing 4 Learning PlatformCreating+Publishing 4 Learning Platform
Creating+Publishing 4 Learning Platform
 
INTERACTIVE_MULTIMEDIA.pptx
INTERACTIVE_MULTIMEDIA.pptxINTERACTIVE_MULTIMEDIA.pptx
INTERACTIVE_MULTIMEDIA.pptx
 
Bryan J. Hogan
Bryan J. HoganBryan J. Hogan
Bryan J. Hogan
 
Email Templates_1.docx
Email Templates_1.docxEmail Templates_1.docx
Email Templates_1.docx
 
Email Templates_1.docx
Email Templates_1.docxEmail Templates_1.docx
Email Templates_1.docx
 
Towards A Spoken Version of Google
Towards A Spoken Version of GoogleTowards A Spoken Version of Google
Towards A Spoken Version of Google
 
How to make an audio powerpoint presentation
How to make an audio powerpoint presentationHow to make an audio powerpoint presentation
How to make an audio powerpoint presentation
 
Inclusive E-Learning good practice becoming general practice
Inclusive E-Learning good practice becoming general practiceInclusive E-Learning good practice becoming general practice
Inclusive E-Learning good practice becoming general practice
 
Free tools for the classroom webinar
Free tools for the classroom webinarFree tools for the classroom webinar
Free tools for the classroom webinar
 
L10 Interactive Multimedia.pptx
L10 Interactive Multimedia.pptxL10 Interactive Multimedia.pptx
L10 Interactive Multimedia.pptx
 

Recently uploaded

Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
amberjdewit93
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
David Douglas School District
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
Celine George
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
Katrina Pritchard
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
Nicholas Montgomery
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
Academy of Science of South Africa
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Mohd Adib Abd Muin, Senior Lecturer at Universiti Utara Malaysia
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
GeorgeMilliken2
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Fajar Baskoro
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
sayalidalavi006
 
Advanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docxAdvanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docx
adhitya5119
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
Dr. Shivangi Singh Parihar
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
eBook.com.bd (প্রয়োজনীয় বাংলা বই)
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
AyyanKhan40
 
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptxC1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
mulvey2
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
tarandeep35
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
Celine George
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
National Information Standards Organization (NISO)
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
Dr. Mulla Adam Ali
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
TechSoup
 

Recently uploaded (20)

Digital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental DesignDigital Artefact 1 - Tiny Home Environmental Design
Digital Artefact 1 - Tiny Home Environmental Design
 
Pride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School DistrictPride Month Slides 2024 David Douglas School District
Pride Month Slides 2024 David Douglas School District
 
How to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRMHow to Manage Your Lost Opportunities in Odoo 17 CRM
How to Manage Your Lost Opportunities in Odoo 17 CRM
 
BBR 2024 Summer Sessions Interview Training
BBR  2024 Summer Sessions Interview TrainingBBR  2024 Summer Sessions Interview Training
BBR 2024 Summer Sessions Interview Training
 
writing about opinions about Australia the movie
writing about opinions about Australia the moviewriting about opinions about Australia the movie
writing about opinions about Australia the movie
 
South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)South African Journal of Science: Writing with integrity workshop (2024)
South African Journal of Science: Writing with integrity workshop (2024)
 
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptxChapter 4 - Islamic Financial Institutions in Malaysia.pptx
Chapter 4 - Islamic Financial Institutions in Malaysia.pptx
 
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
What is Digital Literacy? A guest blog from Andy McLaughlin, University of Ab...
 
Pengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptxPengantar Penggunaan Flutter - Dart programming language1.pptx
Pengantar Penggunaan Flutter - Dart programming language1.pptx
 
Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5Community pharmacy- Social and preventive pharmacy UNIT 5
Community pharmacy- Social and preventive pharmacy UNIT 5
 
Advanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docxAdvanced Java[Extra Concepts, Not Difficult].docx
Advanced Java[Extra Concepts, Not Difficult].docx
 
PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.PCOS corelations and management through Ayurveda.
PCOS corelations and management through Ayurveda.
 
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdfবাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
বাংলাদেশ অর্থনৈতিক সমীক্ষা (Economic Review) ২০২৪ UJS App.pdf
 
PIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf IslamabadPIMS Job Advertisement 2024.pdf Islamabad
PIMS Job Advertisement 2024.pdf Islamabad
 
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptxC1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
C1 Rubenstein AP HuG xxxxxxxxxxxxxx.pptx
 
S1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptxS1-Introduction-Biopesticides in ICM.pptx
S1-Introduction-Biopesticides in ICM.pptx
 
How to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold MethodHow to Build a Module in Odoo 17 Using the Scaffold Method
How to Build a Module in Odoo 17 Using the Scaffold Method
 
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
Pollock and Snow "DEIA in the Scholarly Landscape, Session One: Setting Expec...
 
Hindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdfHindi varnamala | hindi alphabet PPT.pdf
Hindi varnamala | hindi alphabet PPT.pdf
 
Walmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdfWalmart Business+ and Spark Good for Nonprofits.pdf
Walmart Business+ and Spark Good for Nonprofits.pdf
 

Passive Japanese learning: BubbleReader

  • 1. Turning video content into text with embedded translation, dictionary, and karaoke-style of narration tracing BubbleReader
  • 2. Executive summary Boredom, friction, and procrastination are usually the main barrier when studying any complex content (foreign, technical, abstract) for learning or studying purposes. The bubble reader is for anyone who needs to overcome those barriers: - from authentic materials taken from YouTube - by being able to repeat wherever they want with automatic follow-up of words - with inline words and expression translation The platform addresses 3 specifics requirement for anyone who wants to make progress in the target language they wish to learn (either language learning or technical learning): - Vocabulary learning - speaking practices (Karaoke style) - Listening practices
  • 4. There are 3 sources of frustration when learning Japanese ZZZZzzzzzzz…. 1.Friction because of swapping between multiple Content sources and types 2.Boredom because of “ping-pong” type of dialog content creating “no hook” 3.Procrastination because there’s no “incentive” to be active
  • 5. VS A new hope is necessary 1.Friction 2.Boredom 3. Procrastination 1.Integrated content 2.Engaging content 3. Hooks the mind
  • 6. COMMUNITY CONTENT TECHNOLOGY DESIGN Bubble Reader Finding the magic trinity is the key 1. Community Content is what will keep the motivation high (fresher content all the time 2. Technology is what will make this content accessible 3. Design is what will make the user hooked
  • 8. The platform os a web application, runnable pretty much on all OS, browsers and devices
  • 9. Current implementation: breakdown of the features 1 / 3 1. The content isYouTube embedded videos. 2. The narration from the video is synched with a “Bubble” (a rounded cursor). 3. On screen text turns from grey to white as the narration progresses. 4. Furigana for Kanjis are displayed 5. A translation is displayed inline. 1 2 3 4 5
  • 10. Current implementation: breakdown of the features 2 / 3 1 2 3 From an overlaid word: 1. Inline dictionary 2. Text to Speech to repeat the selected word 3. add the selected word to a personal word bank
  • 11. Current implementation: breakdown of the features 3 / 3 1 2 3 1. Youtube’s features such as playback spee 2. Auto-scroll on/off (screen re-center automatically when the bubble reaches a certain distance from the bottom of the screen) 3. Translation ON/OFF
  • 12. Current implementation: breakdown of the features 3 / 3 1 2 3 1. Youtube’s features such as playback spee 2. Auto-scroll on/off (screen re-center automatically when the bubble reaches a certain distance from the bottom of the screen) 3. Translation ON/OFF
  • 13. Marc-Alexandre Cartiant Lixil (Michael) He Thank you!