This document describes a proposed system for creating interactive mashups of television news and related web information. The system would use optical character recognition to extract text from TV video frames, search the internet or RSS feeds for related contextual information, and blend the internet content with the TV video for display. Currently the solution is demonstrated on a PC with recorded TV video, but is proposed to eventually run on TCS' Home Infotainment Platform. The value proposition is that it would enrich the TV viewing experience by providing additional related online content informed by the TV program context.

1. May 17, 2015 TCS Public
A Novel Service for Interactive
Television by mashups of TV news
and related Web Information
Innovation Lab, Kolkata

2. 2
May 17, 2015
• Market Requirement
• Deployment Scenario
• System Description
• Value Proposition
• Demo
Presentation Roadmap

3. 3
May 17, 2015
• Currently TV is a dumb device
• Connected TV or Widget-based TVs are slowly coming into Market
• Current Connected TV does not understand TV Video Context
• Infinite Possibilities of Intelligent Mash-ups from Internet possible if
TV Video Context is automatically understood
Market Requirement

4. 4
May 17, 2015
Deployment Scenario
DTH /
CAS
Set Top
Box
DTH operator
Base station
Broadband
Connection
Cable operator
Browser
Media
Player
Drivers/Adaptors
for keyboard & mouse
IR Remote
Ethernet &
PPPoE driver
USB modem
driver
Drivers &
adaptors
for multiple
storage drives
(extensible to WiMAX)
USB Pen Drive
USB Devices viz.
webcam,
keyboard
USB Modem
ADSL Modem
Composite
A/V out to TV
HIP
Composite
A/V in

5. May 17, 2015
OCR based Breaking News Mash-up
EXCLUSIVE
ITALKING WITH THE TALIBAN?
Pakistan pizchus Atghan cuawfero option
Hnd mom un mn situation in Afqhanhtan on the mv
Afghan, Afghanistan, Pakistan, Taliban
Search for
RSS feed
containing
related
information
OCR
Image
Super-resolution
Keyword
spotting
Text
Localization
Search
through any
Engine for
related
information
Display
Related
Information
on TV
USA response to Afghan CrisisUSA response to Afghan Crisis

6. 6
May 17, 2015
Description of the tool
• Analog TV signal with video and audio
• Extraction of highlighted or important texts that are displayed on the video frames
• Browser based application for fetch information related to the highlighted texts
from internet or RSS feeds
• Blended display module for mashing up the internet information with the TV video
Video Frame
Text Extraction
Fetch contextual
information from internet
Blending of Video
and graphics TV Display

7. 7
May 17, 2015
• Proposed solution would finally run on the TCS Home Infotainment Platform
• Current Demo is a PC based one that works on recorded TV Video
Demo

8. 8
May 17, 2015
Value Proposition
• Enriches the user's experience while watching the TV
• News on TV gets enriched with related Internet Content
• A whole new way for TV Viewer’s to experience Internet / News
• Understanding TV context from embedded Text in it can have a whole new areas
of application

9. May 17, 2015 TCS Public
Any Question?

10. May 17, 2015 TCS Public
Thank You

11. 11
May 17, 2015
HIP Interfaces

12. 12
May 17, 2015
Existing Value-added Services enabled through HIP
Photo - Viewer Video - Player
Internet Browsing Video - Chat
SMS Music-Player

13. 13
May 17, 2015
USB Ethernet
CDMA GSM 3G
EVDO HSDPA HSUPA
Connectivity
PPPoE LAN
(Static)
LAN
(DHCP)
HIP - Connectivity Options

14. 14
May 17, 2015
• In Philippines it is launched through Smart
Communications under the brand name of
“SmartBro SurfTV”.
• Order commited for 100K units and current
production is 25K
HIP Deployment Status
• Tata Teleservices Ltd. launched HIP under
the brand name of “Dialog” in Tamil Nadu
and West Bengal.
• Order Received for 100K units and current
production is 5K
TCS’ Home Infotainment Platform launched successfully in India and Philippines.
Good Traction received in Malaysia, Thailand and Indonesia