Internet of Things, IoT

1. 0
Intelligent Infrastructure using Internet-of-Things
Arpan Pal
Head, Innovation Lab Kolkata
Confidential Information, Disclosed under NDA

2. 1
Intelligent Infrastructure
BANKING
INSURANCE
AGRICULTURE
HEALTHCARE
GOVERNMENT
UTILITY
MANUFACTUR
ING
TRANSPORT
APPLICATION SERVICES
INFRASTRUCTURE PLATFORM
INTERNET
GATEWAY
RESPONDSENSEANALYZEEXTRACT
“Intelligent”
• Context-aware
• Sense the environment
• Extract meaningful information
• Analyze to make inferences
• Respond through value-added
information
Intelligent
Infra
@Home
@Building
@Vehicle
@Utility
@Mobile
@Store
@Road
Target Verticals
• Transportation / Govt. Authorities / Healthcare / Education /
Energy / Water
“Infrastructure”

3. 2
Mobile Phones and Set top Box as Gateway
Internet
WiFi, 2G/GPRS, 3G
On-board sensors
Accelerometer, GPS,
Compass
Camera, Microphone
Internet
Sensors
(Location, Audio , Camera, …)
Gateway (Stand-alone
Device / Mobile Phones)
Backend
Server & database
Portal
USB, CAN, Zigbee, BT,
NFC, WiFi
GSM/GPRS, 3G
Other Interfaces
Bluetooth and USB
Internet
2G/GPRS
On-board sensors
Microphone, Camera
Basic Phone
Smart PhoneMobile
Phones
Television / Set top
Box

4. Relevant Use Cases – Mobile Phone as Gateway

5. 4
Sensor Penetration in Indian Mobile Phones
0 0.1 0.2 0.3 0.4 0.5 0.6 0.7
Bluetooth
USB
Edge
GPRS
Wif i
3G
Camera
GPS
Accelarometer
Digital Compass
Basic Phones
0 0.2 0.4 0.6 0.8 1
Bluetooth
USB
Edge
GPRS
Wif i
3G
Camera
GPS
Accelarometer
Digital Compass
Smart Phones

6. 5
Intelligent City Transportation
Technology
Sense
• Accelerometer in the Smart Phone in Car
• Car OBD port for Diagnostic Data (over BT)
Extract
• Phone-orientation Correction
• Vehicular Noise Cancellation
• Feature Extraction
• Anomaly Detection
Analyze
• Learning-based Classification
• Multi-user Fusion
Respond
• Road Condition Map to municipal authority
• Pothole alert to end-user
• Driving Behavior to Insurance Company
• Road Condition and Driving Behavior assisted Car Prognosis
to Automotive Manufacturer
Use Case
• Pothole Detection, Road Condition Monitoring,
Driving Behavior Analysis,
Key Value-add
• Low-power Mobile Phone Accelerometer Analytics
MIT Labs, MobiSys 2008, Colorado, USA
Accepted in PERCOM 2012

7. 6
Automated Car Insurance Claim Registration
Technology
Sense
• Mobile phone camera and microphone
Extract
• Denoising/De-skewing
• Binarizarion and Segmentation
Analyze
• OCR
• Vehicle contour matching for damage detection
• Speaker / spoken word identification
Respond
• Automatic claim registration to Insurance company
Use Case
• VIN number detection from mobile phones, Vehicle
damage detection from mobile phones
Key Value-add
• OCR Pre-processing and low power OCR
• Contour matching
• Speech processing for speaker identification / VIN correction
Accepted in DAS-2012 Australia

8. 7
Ultrasound based Localization
Technology
Sense
• Microphone in Smart Phone
• Camera in Smart Phone
Extract
• Store ID
• Location ID in the Store
• Authorization Code
Analyze
• User Location
• User Authorization
Respond
• User presence for Loyalty Apps
• Rack Location based Promotion
• Buying and Checking out without Cashier Intervention
Use Case
Ultrasound beacon transmission in the store and
location decoding by app on mobile
Key Value-add
• Two-way ultrasound communication with high
range and low response time

9. Relevant Use Cases – Set top Box as Gateway

10. 9
Context-aware Connected TV
Current Widget List
Social Networking
Facebook, Twitter, Gmail
Multimedia
Youtube, Shoutcast, Flickr
Others
Personal Finance Management, Interactive Hotel
Service
App Genre Context Extracted Deployed To
News Mash-up News News tickers, breaking news (using OCR) iPhone, TV
Multi-lingual
Movie sub-titles
Movie Movie Details TV
Song Download Music ID3 Info (using OCR, embedded QR) iPhone
Reference
Knowledge
Education Program topic information (embedded QR) Android Galaxy Tab
Comic Book
Download
Animation Comic information (EPG from Internet) iPad
Sports Player
and Team trivia
Sports Game broadcast information (EPG from
Internet and OCR)
Android Galaxy Tab
Interactive Ad Advertisement Ad Information (Ultrasound) iPhone
Internet
QR Code
OCR Ultrasound
Internet
OCR
EuroITV 2011 Portugal, ICDAR 2011 China,
IBC 2011 Amsterdam, ISCE 2011 Singapore,
TENCON 2011 Indonesia

11. 10
Home Monitoring Gateway
Technology
Sense
• Energy (Water) Meter / Sub-meter
• Water leakage sensor and Thermal Camera
Extract
• Noise Cancellation
Analyze
• Demand-supply response
• Anomaly detection
Respond
• Aggregated demand forecast to utility company
• Historical Consumption / Analytics view to consumer
• Water Leakage / Electrical Problem alert to Insurance
company
• Electrical Appliance on-off Control remotely
Use Case
• Monitor Electricity Consumption, Control Electrical
Appliances, Monitor Water Leakage, Monitor Faulty
Electrical Wires
Key Value-add
• Real-time Utility Usage Monitoring and Control
ISMS 2011, Malaysia

12. 11
Distance Education on TV
Features
• Teacher’s Workbench for creating courseware
• Courseware broadcast as videos to the rural
student group.
• Interactivity through QA sessions – textual and
audio
• Instant marking on multiple choice
questionnaire
internet
Differentiators
• Increases Teacher’s Bandwidth
• Scalable cost-effective solution
• Hybrid DTH-Internet Model
• Novel Channel Multiplexing
Key Value-add
• Audio and Meta-data insertion within TV Video
feed
ACM MM2011 Arizona, USA
Accepted in IC4E 2012 Hong Kong.

13. A Generic Platform for IoT

14. 13
Platform Interfaces
Internet
Internet
Sensor
Services
Analytics
Storage
Services
RIPSAC Platform
App Developers
PaaS Provider
End User
Sensors
Sensor Providers
Goals
• Build a platform with common framework – requirements drawn from use cases
• Service level interfaces on top of the Platform for Application Developers
Visualization
Real-time Integrated Platform for Services and Analytics (RIPSAC)

15. 14
Platform Features
• Stream processing
• CEP
• Map reduce
• Stream Reasoning
• Planning
• Statistical processing
• Social n/w Analytics
Middleware & Integration Layer
AnalyticsData Collection
Security / Privacy
• Device Discovery
• Identity Management
• Lightweight yet Reliable
Protocols over Internet
• Access Control Framework
• Identity Management and
Authentication
• Identity Masking
• Device
Management &
Monitoring
• Sensor
Observation, Event
and Management
Services
Storage Services
• RDBMS
• Key Value Stores
• Graph Databases
• Document databases
• Distributed Cache
User Interfaces & Visualization
• Portals
• Graphical Visualizations
• Heat Maps
• Geo-Mashups

16. Thank You
arpan.pal@tcs.com