We already know that the Internet of Things is big. It isn't something that's coming. It's already here. From manufacturing to healthcare, retail and hospitality, transportation, utilities and energy, the shift from Information Technology to Operational Technology and the value that this massive explosion of data can provide is taking the world by storm. But IoT isn't a product. It's not something you can buy. As with any gold rush, snake oil abounds. The potential is massive and the good news is that the technology and platforms are already here! But how do you get started? What are the application and networking protocols at play? How do you handle the ingestion of massive, real-time streams of data? Where do you land the data? What kind of insights does the data at scale provide? How do you make sense of it and/or take action on the data in real time scaling to hundreds if not hundreds of thousands of devices per deployment? In this session, Rick G. Garibay will share a pragmatic reference architecture based on his experience working with dozens of customers in the field and provide an insider’s view on some real-world IoT solutions he's led. He'll demystify what IoT is and what it isn't, discuss patterns for addressing the challenges inherent in IoT projects and how the most popular public cloud vendors are already providing the capabilities you need to build real-world IoT solutions today.

1. A Pragmatic Reference
Architecture for the Internet
of Things
Rick G. Garibay
Senior SDM,
Amazon.com
Level: Beginner

2. Agenda
• What is the Internet of Things?
• IoT Problem Space
• IoT Value Chain (A Pragmatic Reference Architecture)
• Wrap Up

3. About Me
• Senior Manager, Software Development @ Amazon.com
• Distributed Systems Nerd
• Published author and frequent contributor to CODE Magazine
• 8X Microsoft MVP
• Co-Author, “Windows Server AppFabric Cookbook” by Packt Pub.
• twitter: @rickggaribay
• blog: http://rickgaribay.net
• email: rickgari@amazon.com
We’re hiring!

4. The Internet of Things: By the
Numbers
B5075212

5. This change is happening more rapidly than
anyone imagined.

6. This change could bring tremendous opportunity
to your employer, customers, industry and you as a
technologist.

7. The Internet of Things is the network of physical
objects that contain embedded technology to
communicate and interact with their internal states
or the external environment.

8. OEM Revenue Opportunity |
Market Forecast CY17
Source: IDC Sept 2013 and Microsoft
Auto & Trans Retail Manufacturing Healthcare Energy Computing Telecom Consumer
$7 B $16 B $197 B $3 B $27 B $908 B $179 B $356 B System Revenue
Intelligent
Systems
1.7T$

9. Smart
Products
Grid
Renewables
Oil/Gas/Coal
Recovery and
Distribution
Points
of Sale
Restaurants
Hotels
Fuel
Stations
Patients
Clinics
Hospitals
Nursing
Homes
Mobile
Care
Safety
Security
Comfort
Lighting
Automation
Manufacturing
Integration and
Automation
Remote
Servicing
Predictive and
Reactive
Maintenance
Water
Waste
Pollution
Control
Fire
Emergency
Public
Safety
Law
Enforcement
Letters
Packages
Containers
Tanks Bulkware
Games
Events
Sports
Television
Streaming
Traffic Buses
Cars
Trucks
Trains
Vessels
Aircraft
Bikes
Smart
Energy
Smart
Retail
Smart
Mobility
Smart
Logistics
Smart
Factory
Smart
Cities
Smart
Entertain-
ment
Smart
Health-
care
Smart
Building
Home

11. 11
LA Express Park

12. CGM in the Cloud

13. What is IoT About?
Things
(Devices)
Connectivity Data Analytics

14. IoT Device Taxonomy
Large
Mobile
Micro
Small
POS terminal, ATM, MRI
x86, PC-like, apps
Industry handheld, POS tablet
ARM and x86, shell experience, apps
Gateways, wearables, panels, cars
ARM and x86, diverse hardware, no shell
Controllers, fixed-use, sensors, actuators
ARM, constrained hardware, headless

15. Raspberry Pi

16. Intel Galileo

17. Gadgeteer Fez Spider

18. Arduino Uno

19. Netduino Plus 2

20. Spark

21. 5mm 5mm

22. Pebble Smart Watch

24. What is the Internet of
Things?
Things
(Devices)
Connectivity Data Analytics

25. Various Protocols

26. Canonical Message Types
Voluntary
information flow
from device to
another system.
Telemetry
Requests for
information from
device to other
systems.
Inquires
Instructions from
other systems to
a device.
Commands
Information flow
from other
systems to the
device.
Notifications

27. Cloud Gateways
Connections are
device-initiated and
outbound
NAT/Firewall
Device (Router)
IP NAT
Cloud GatewaySource
Port mapping is
automatic, outbound
Device does not listen
for unsolicited traffic
No inbound ports open,
attack surface is
minimized
Access-controlled
command API
Secure, managed hosting
platform
DNS
myapp.cloudapp.net

28. What is the Internet of
Things?
Things
(Devices)
Connectivity Data Analytics

29. Event Velocity
Device telemetry
• Thermostats report data
every 15 minutes
• Cars send telemetry data every minute
Application telemetry
• Application perf counters are measured
every second per server
• Mobile app telemetry is captured for
every action on your app!
App and operational events
• Halo game engine estimate 1,000,000
messages/second

30. What is the Internet of
Things?
Things
(Devices)
Connectivity Data Analytics

31. The true significance of IoT is the
foundation it provides for enabling new
insights and unlocking new
opportunities.

32. The Vs of Big Data
Volume: Scale of Data
• 40 Zettabytes (43
Trillion Gigabytes) of
data will be created by
2020. 300 Times
increase from 2005
• 6B people have mobile
phones
• Most companies in the
U.S have at least 100Tb
of data
Velocity: Streams of Data
• NYSE captures 1TB of
trade information every
day
• The average modern car
has over 100 sensors
• 18.9 billion network
connections by 2016
Variety: Endless forms of
Data
• Nearly 420 Million
wearable health
monitors
• Over 4 Billion hours of
video watched on
YouTube everyday
Source: McKinsey Global, Twitter, Cisco, Gartner

33. IoT Value Pipeline
Ingest Staging Insight Action

34. Reference Architecture
Ingest & Staging Insight & Action
+

35. Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
Staging
Blob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security,Management,Monitoring

36. Brokered Communication
• Each device has a dedicated
Inbox/Outbox on the Gateway
– Device sends telemetry/alerts and routes
service invocations via its Outbox
– Device receives commands and queries from
its Inbox
– Correlated request/reply patterns can be
implemented on top of these two messaging
channels
– The device knows, and has access to, only its
own specific inbox/outbox endpoints (URI’s)
Backend
Components
Cloud Gateway
Inbox
Outbox
CommandAPI
ProtocolHead

37. Streamed Communication
• Read (forward) and Rewind (go back)
data access
– Partition/shard-based
– Sequence of events, akin to a commit log
– Designed for high volume, high density ingest
– Typically (but not always) real-time use cases

38. Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
Staging
Blob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security,Management,Monitoring

39. Staging
Blob
• Any binary
data
• Images,
streams, big
text files, etc.
KVP
• Any string
• JSON, XML
Document
• Typically
JSON

40. Staging Considerations
Commands & Inquiries
• The capability provides
transient staging typically
tied to a retention period
and/or TTL
• A worker typically
consumes and processes
work message by message
Telemetry & Notifications
• The capability provides
high-throughput backing to
be consumed by either
durable or stream-based
consumers
• Typically bulk writes or
stream based readers

41. Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
Staging
Blob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security,Management,Monitoring

42. Insight
OLTP
• Structured
queries
ETL
• Moving
data from
one
staging
area to
another
CEP
• Reading
and
analyzing
streams in
real-time
Big Data
• Analyzing
large
amounts
of data at
rest

43. Reference Architecture
Ingest
HTTP MQTT AMQP CoAP …
Brokered Streamed
Staging
Blob KVP Document
Insight
OLTP ETL CEP Big Data
Action
Custom APIs Brokered 3rd Party APIs
Security,Management,Monitoring

44. Action
Your APIs
• Commands &
Notifications
• Business Scenarios
• Cloud hosted
• Behind the firewall
• Synchronous &
Asynchronous
Brokered
• Commands &
Notifications
• Devices you own,
control
• Asynchronous by
design
3rd Party APIs
• Commands &
Notifications
• Typically
commercial devices
or devices
supported by a
vendor

45. Wrapping Up
• Model your solution across the four stages
• Evaluate the capability that’s right for you
based on your needs, team skills and
perhaps most important, the cost.
• Cloud providers are competing vigorously
which is great for customers!

46. A Pragmatic Reference
Architecture for the Internet
of Things
Rick G. Garibay
Senior SDM,
Amazon.com
Level: Beginner