1. Audiobook player on mobile
platform
Enabling audio book towards vocabulary acquisition.
Mentor: Dr. S.P. Kishore
Co-mentors: Dr. Radhika Mamidi, Dr. Priyanka Srivastava, and Lavanya Prahallad
- Chandan Singh (201101194)
- Harsh Vardhan Shukla (201101173)

2. Problem Statement
● The objective is to build an audio book player on android platform.
● The novelty of the work lies in developing a framework where it enables
an audio book towards vocabulary acquisition.

3. Work so far
● Implemented a basic audio book player with play/pause controls and
chapter navigation.
● Library scanner.
● Not successful with aligning text with audio so far.
● Works with Daisy 2.02 books.

4. Progress with Chapter tests
● Built a summarizing tool which summarizes an entire block of text into
few sentences which is an user defined parameter.
● We plan to use this summarizer to extract important facts from the
chapter and then frame questions based on these sentences to make
questions for comprehensive testing.
● We’ve come up with two summarizers based on two concepts:
○ tf-idf weighting
○ scores of a sentence based on

5. Tasks Remaining
● Incorporate the format specified by the other team instead of Daisy
2.02.
● Incorporate dictionary and chapter tests.

6. Milestones
● 1st Release:
○ Understand existing softwares and decide features & milestones.
○ Come up with a basic design of the application.
● 2nd Release (before summers) :
○ A working audiobook player with dictionary.
○ English will be the only supported language.
○ First report.
● During summers:
○ Application will be tested on a small audience and results will be
collected as how it helps in vocabulary acquisition.

7. Milestones (contd.)
● 3rd Release :
○ Modify application based on feedback.
○ Brush up UI.
○ Add chapter tests.
● 4th Release (Final release):
○ Make the application multilingual, with special focus on Indian native
languages.
○ Fix any issues and incorporate any suggested feature if possible
(based on feedback)
○ Final Report.

8. Sample Designs

9. References
1. Vocabulary Acquisition: The Research and Its Pedagogical Implications - Peter Duppenthaler
2. Lightly supervised recognition for automatic alignment of large coherent speech recordings -
Norbert Braunschweiler , M.J.F. Gales , Sabine Buchholz
3. Towards Fully Automatic Annotation of Audiobooks for TTS - Olivier Boeffard, Laure
Charonnat, Sébastien Le Maguer, Damien Lolive, Gaëlle Vidal
4. Using Audio Books to Improve Reading and Academic Performance - Joel R. Montgomery,
EdD
5. An Educator’s Guide to Utilizing Audiobooks in the Classroom - By Dr. Frank Serafini
6. Natural Language Processing techniques in Text-To-Speech synthesis and Automatic Speech
Recognition - Alexandre Trilla
7. A GRAPHEME-BASED METHOD FOR AUTOMATIC ALIGNMENT OF SPEECH AND TEXT DATA
- Adriana Stan
8. Improving English Pronunciation: An Automated Instructional Approach - Sugata Mitra,a
James Tooley,b Parimala Inamdar
9. A Vocabulary Acquisition Framework using Audio Books - Meena Vundela, Swetha A.V.S.L.G
and Kishore Prahallad

10. Thank You!!
Any queries/suggestions are most welcome.