The BubbleReader platform turns YouTube videos into an interactive learning experience for studying foreign, technical, or complex content. It addresses barriers to learning like boredom and procrastination by allowing users to repeat words and expressions, see in-line translations, and get dictionary definitions. The current web application syncs highlighted text with narration in videos, displays furigana for kanji, and supports features like playback speed control, auto-scrolling, and translation toggling to enhance the learning process.
1. Turning video content into text with
embedded translation, dictionary, and
karaoke-style of narration tracing
BubbleReader
2. Executive summary
Boredom, friction, and procrastination are usually the main barrier when studying any complex content (foreign,
technical, abstract) for learning or studying purposes.
The bubble reader is for anyone who needs to overcome those barriers:
- from authentic materials taken from YouTube
- by being able to repeat wherever they want with automatic follow-up of words
- with inline words and expression translation
The platform addresses 3 specifics requirement for anyone who wants to make progress in the target language they
wish to learn (either language learning or technical learning):
- Vocabulary learning
- speaking practices (Karaoke style)
- Listening practices
4. There are 3 sources of frustration when learning Japanese
ZZZZzzzzzzz….
1.Friction because of
swapping between multiple
Content sources and types
2.Boredom because of
“ping-pong” type of dialog
content creating “no hook”
3.Procrastination
because there’s no
“incentive” to be active
5. VS
A new hope is necessary
1.Friction
2.Boredom
3. Procrastination
1.Integrated content
2.Engaging content
3. Hooks the mind
6. COMMUNITY CONTENT TECHNOLOGY
DESIGN
Bubble Reader
Finding the magic trinity is the key
1. Community Content is what will
keep the motivation high (fresher
content all the time
2. Technology is what will make this
content accessible
3. Design is what will make the user
hooked
8. The platform os a web application, runnable pretty much on all OS, browsers and
devices
9. Current implementation: breakdown of the features 1 / 3
1. The content isYouTube embedded
videos.
2. The narration from the video is
synched with a “Bubble” (a
rounded cursor).
3. On screen text turns from grey to
white as the narration progresses.
4. Furigana for Kanjis are displayed
5. A translation is displayed inline.
1
2 3
4
5
10. Current implementation: breakdown of the features 2 / 3
1
2
3
From an overlaid word:
1. Inline dictionary
2. Text to Speech to repeat the selected
word
3. add the selected word to a personal
word bank
11. Current implementation: breakdown of the features 3 / 3
1
2
3
1. Youtube’s features such as playback spee
2. Auto-scroll on/off (screen re-center
automatically when the bubble reaches a
certain distance from the bottom of the
screen)
3. Translation ON/OFF
12. Current implementation: breakdown of the features 3 / 3
1
2
3
1. Youtube’s features such as playback spee
2. Auto-scroll on/off (screen re-center
automatically when the bubble reaches a
certain distance from the bottom of the
screen)
3. Translation ON/OFF