AI At The Edge
Intelligence in the Fog
Adrian Bowles, PhD
Founder, STORM Insights, Inc.
Lead Analyst, AI, Aragon Research
info@storminsights.com
JANUARY 11, 2018
Context & Definitions
Architecture Choices
Business Implications
Getting Started: Creating Business Value
with Distributed Intelligence
Recommendations
AGENDA
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
COMPLEMENTARY TECHNOLOGIES Context
Applications & Appliances
Connected to the Internet…
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
THE IOT
It Starts With Sensors…and Ends With Insights Actions
A sensor is a device that detects the presence of a signal
and reports/signals data about that signal/event
Sensors are Event-driven
May be Stationary or Mobile
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
MOBILE VS STATIC SENSORS
Vehicles
Individuals
Military: Troops to Tanks
Manufacturing - Machines
Retail - Spaces
Smart Cities
Mobile
Connecto
rs
Mostly Mobile Mostly Static
Systems
Controls
LearnReason
Understand
Model
Data Mgmt
Human
Machine
Input Output
Gestures
Emotions
Language
Narrative Generation
Visualization
Reports
Haptics
Sensors
(IOT)
Systems
Controls
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
COGNITIVE SYSTEMS: COMMUNICATIONS & CONTROL
LearnReason
Understand
Model
Data Mgmt
Human
Machine
Input Output
Gestures
Emotions
Language
Narrative Generation
Visualization
Reports
Haptics
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
COGNITIVE SYSTEMS: COMMUNICATIONS & CONTROL
Sensors
(IOT)
Systems
Controls
Systems
Controls
Fog:
FOG/EDGE COMPUTING
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
A Cloud that can’t get off the ground
Fog:
The Edge:
FOG/EDGE COMPUTING
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
A Cloud that can’t get off the ground
Lead Guitarist for U2
Device Outside the Data Center
Terminal Network Node
The Edge. (2018, January 4). In Wikipedia, The Free Encyclopedia.
Retrieved 03:20, January 11, 2018, from
https://en.wikipedia.org/w/index.php?title=The_Edge&oldid=818580195
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
Autonomous
Intelligent
AUTONOMY VS INTELLIGENCE
Abstract
Generalize
Learn
Understand
Reason
Independent
Decisions
&
Actions
Alex Coppel / Herald Sun/Getty Images
Fernando Alonso Walks Away from a 46G Impact
Will F1 become fully autonomous?
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
FROM INFORM/ADVISE TO AUTOMATE
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
The SourceFog Cloud
Data CenterGateway
MOVE THE COMPUTATION TO THE DATA, OR DATA TO THE PROCESSOR? Architecture
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
WHAT/WHEN TO MOVE/DISTRIBUTE? Design
DS1 P1
Data Processing
Element
Intelligent
Element
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
WHAT/WHEN TO MOVE/DISTRIBUTE?
DS4
DS1 DS2
P1
P1 P2
P4P3
DS3 DS4
DS1 DS2
DS3
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
WHAT/WHEN TO MOVE/DISTRIBUTE?
DS4
DS1 DS2
P1
P1 P2
P4P3
DS3 DS4
DS1 DS2
DS3
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
DISTRIBUTE INTELLIGENCE Design
DS4
DS1 DS2
P1
P1 P2
P4P3
DS3 DS4
DS1 DS2
DS3
2-TIER IOT ARCHITECTURE
Sensors/
Devices Compute Engine
Data Center
Cloud
Cluster
Network
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
Sensors/
Devices
Compute EngineGateways
(Process, Aggregate & Package)
Data Center
Cloud
Cluster
Network
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
3-TIER IOT ARCHITECTURE ENABLES DISTRIBUTED INTELLIGENCE & ANALYTICS
3-TIER IOT ARCHITECTURE ENABLES DISTRIBUTED INTELLIGENCE & ANALYTICS
Sensors/
Devices
Train the Deep Learning Model
Data Center
Cloud
Cluster
Network
Compress & Run
The DL Model
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
OrientAct
Observe
Decide
Small
Model
OrientAct
Observe
Decide
Small
Model
Feedback
Sensor
Sensor
Effector
Effector
COLLABORATIVE AUTONOMY - MULTIPLE SENSORS & EFFECTORS (DISTRIBUTED)
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
COMPLEXITY VS MOBILITY
CCTV SmartPhone
Traffic
Counter Fitbit
Data
Complexity
Static Mobile
Low
High
Weather
Station
Telematic
Device
DATA ATTRIBUTES DICTATE ARCHITECTURE CHOICES
Speed
Streaming
Structure/Complexity
Surface_Shallow Dense_Deep
Static
Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
IT’S A COMPLEX, DATA-RICH WORLD: SENSORS ARE EVERYWHERE
Market data
Competitive data
News
Smart grid
Traffic data
Crime data
Weather data
Geo-tagged supply chain data
Electronic health records
Mobile sources
Video (Closed Circuit)
...
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
Copyright (c) 2014 by Umbrellium Ltd.
Business
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
IMPACT OF THE IOT AND #MODERNAI/COGNITIVE COMPUTING ON STRATEGY
IOT/#ModernAI enable
New technologies
New models
New ecosystems
Intelligence can be
Local to the device
Distributed
Aggregated
When everything is connected…
New sources of data emerge
New sources of value emerge
Old assumptions must be challenged
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
CREATING BUSINESS VALUE WITH DISTRIBUTED INTELLIGENCE
Know Where Your Customers Are - And Where They Will Be
Know What Your Customers Want
Know When Your Customers’ Wants Change
Know Your Customers
Anticipate Opportunities
For Each Rule:
Do you have or can you capture streaming data that can increase your value proposition?
Data about your product, supply chain, or customer that can improve performance, reliability, predictability…
Can you create value from new analysis of open data?
Adding your own data/algorithms to open data creates value.
Tip: Choose an infrastructure that allows you to evaluate live streaming data in the context of relevant historical data.
Getting Started
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
KNOW YOUR CUSTOMERS
Collect/Track:
Demographics
Psychographics
Emotions
Technologies:
NLP
Analytics
Machine Learning
Captured/Enabled By:
Sensors
Active
Passive
Systems
Profile-Driven
Interactive Interfaces
Profiles
Opt-In
Generated
Purchased
Derived
Current
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
KNOW WHAT YOUR CUSTOMERS WANT
Collect/Track:
Behavioral History
Captured/Enabled By:
Sensors
Active
Passive
Systems
Profiles
Opt-In
Generated
Purchased
Derived
Peer Profiles
Product/Service Trends
Current
Technologies:
NLP
Analytics
Machine Learning
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
KNOW WHEN YOUR CUSTOMERS’ WANTS CHANGE
Collect/Track:
Behavioral History
Environmental Factors
Technologies:
Analytics
Machine Learning
Current
Captured/Enabled By:
Sensors
Active
Passive
Systems
Profiles
Opt-In
Generated
Purchased
Derived
Peer Profiles
Product/Service Trends
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
KNOW WHERE YOUR CUSTOMERS ARE - AND WHERE THEY WILL BE
Collect/Track:
Geo Track/History
Technologies:
Mobile
WiFi
Beacons
Facial Recognition
Analytics
Machine Learning
Captured/Enabled By:
Sensors
Active
Passive
Systems
Profiles
Opt-In
Generated
Purchased
Derived
Current
Future
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
ANTICIPATE OPPORTUNITIES
Technologies:
Analytics
NLG
Machine Learning
Current
Captured/Enabled By:
Sensors
Active
Passive
Systems
Profiles
Opt-In
Generated
Purchased
Derived
Peer Profiles
Product/Service Trends
Collect/Track:
Demographics
Psychographics
Emotions
Copyright (c) 2014-18 by STORM Insights Inc. All Rights Reserved.
MAKE YOUR APPLICATIONS AWARE EVERYWHERE
Aware Everywhere
Mobility
Analytics/
Big Data
Cloud
Social
Enabling
Technologies
Everywhere indicates that services and data are generally available to customers on-demand
regardless of their physical location (except where prohibited by law or technology constraints).
Aware indicates that the enterprise has adopted tools and techniques that permit it
to access and leverage data from a broad range of IP-enabled devices to identify opportunities
for new or improved services. An aware business process or device can make real time pricing and
service offering decisions based on this data, interpreted in context.
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
WHAT SENSOR DATA DO YOUR CUSTOMERS ALREADY PRODUCE?
Type Typical Current Use Potential Use
Accelerometer/motion
Rotate screen, Switch screen to
landscape/portrait
Ambient Light Adjust screen brightness
Barometer Measure altitude
Geo-Location (wifi/cellular) Location/Alerts
3-Axis Gyroscope Rotation rate for games, VR…
Proximity
Turn off screen when phone is by
your head
Touch ID fingerprint, Facial
Recognition
Security
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
FIND NEW USES FOR EXISTING DATA SOURCES
Copyright (c) 2014 by Umbrellium Ltd.
No Shortage of Data
How will you
create value?
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
INSIGHTS & RECOMMENDATIONS
It’s the sensors, stupid
If you’re not predicting, you’re just reporting
Own the insight, not the data
Process/Analyze As Close to the Source as Possible
Move Intelligence To The Edge (Fog)
Parallelism in Algorithms? Exploit it with hardware at the edge
Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
OPPORTUNITIES ARE EMERGING EVERY DAY…
adrian@storminsights.com
Twitter @ajbowles
Skype ajbowles
KEEP IN TOUCH
Upcoming SmartData Webinar Dates & Topics
Feb. 8 A Pragmatic AI Maturity Model:
Choosing the Right AI Technologies Based on
Application Requirements and User Attributes
March 8 Machine Learning Update:
An Overview of Technology Maturity and Product Vendors
April 12 Knowledge as a Service:
An Introduction to the Emerging Pre-Built Knowledge Market
AGEOFREASONING.COM
BOOK, VIDEOS, PROFESSIONAL SERVICES
COMING SOON…

AI at the Edge

  • 1.
    AI At TheEdge Intelligence in the Fog Adrian Bowles, PhD Founder, STORM Insights, Inc. Lead Analyst, AI, Aragon Research info@storminsights.com JANUARY 11, 2018
  • 2.
    Context & Definitions ArchitectureChoices Business Implications Getting Started: Creating Business Value with Distributed Intelligence Recommendations AGENDA Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved.
  • 3.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. COMPLEMENTARY TECHNOLOGIES Context
  • 4.
    Applications & Appliances Connectedto the Internet… Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved. THE IOT It Starts With Sensors…and Ends With Insights Actions A sensor is a device that detects the presence of a signal and reports/signals data about that signal/event Sensors are Event-driven May be Stationary or Mobile
  • 5.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. MOBILE VS STATIC SENSORS Vehicles Individuals Military: Troops to Tanks Manufacturing - Machines Retail - Spaces Smart Cities Mobile Connecto rs Mostly Mobile Mostly Static
  • 6.
    Systems Controls LearnReason Understand Model Data Mgmt Human Machine Input Output Gestures Emotions Language NarrativeGeneration Visualization Reports Haptics Sensors (IOT) Systems Controls Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved. COGNITIVE SYSTEMS: COMMUNICATIONS & CONTROL
  • 7.
    LearnReason Understand Model Data Mgmt Human Machine Input Output Gestures Emotions Language NarrativeGeneration Visualization Reports Haptics Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved. COGNITIVE SYSTEMS: COMMUNICATIONS & CONTROL Sensors (IOT) Systems Controls Systems Controls
  • 8.
    Fog: FOG/EDGE COMPUTING Copyright (c)2018 by STORM Insights Inc. All Rights Reserved. A Cloud that can’t get off the ground
  • 9.
    Fog: The Edge: FOG/EDGE COMPUTING Copyright(c) 2018 by STORM Insights Inc. All Rights Reserved. A Cloud that can’t get off the ground Lead Guitarist for U2 Device Outside the Data Center Terminal Network Node The Edge. (2018, January 4). In Wikipedia, The Free Encyclopedia. Retrieved 03:20, January 11, 2018, from https://en.wikipedia.org/w/index.php?title=The_Edge&oldid=818580195
  • 10.
    Copyright (c) 2017by STORM Insights Inc. All Rights Reserved. Autonomous Intelligent AUTONOMY VS INTELLIGENCE Abstract Generalize Learn Understand Reason Independent Decisions & Actions
  • 11.
    Alex Coppel /Herald Sun/Getty Images Fernando Alonso Walks Away from a 46G Impact Will F1 become fully autonomous? Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved. FROM INFORM/ADVISE TO AUTOMATE
  • 12.
    Copyright (c) 2017by STORM Insights Inc. All Rights Reserved. The SourceFog Cloud Data CenterGateway MOVE THE COMPUTATION TO THE DATA, OR DATA TO THE PROCESSOR? Architecture
  • 13.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. WHAT/WHEN TO MOVE/DISTRIBUTE? Design DS1 P1 Data Processing Element Intelligent Element
  • 14.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. WHAT/WHEN TO MOVE/DISTRIBUTE? DS4 DS1 DS2 P1 P1 P2 P4P3 DS3 DS4 DS1 DS2 DS3
  • 15.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. WHAT/WHEN TO MOVE/DISTRIBUTE? DS4 DS1 DS2 P1 P1 P2 P4P3 DS3 DS4 DS1 DS2 DS3
  • 16.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. DISTRIBUTE INTELLIGENCE Design DS4 DS1 DS2 P1 P1 P2 P4P3 DS3 DS4 DS1 DS2 DS3
  • 17.
    2-TIER IOT ARCHITECTURE Sensors/ DevicesCompute Engine Data Center Cloud Cluster Network Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
  • 18.
    Sensors/ Devices Compute EngineGateways (Process, Aggregate& Package) Data Center Cloud Cluster Network Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved. 3-TIER IOT ARCHITECTURE ENABLES DISTRIBUTED INTELLIGENCE & ANALYTICS
  • 19.
    3-TIER IOT ARCHITECTUREENABLES DISTRIBUTED INTELLIGENCE & ANALYTICS Sensors/ Devices Train the Deep Learning Model Data Center Cloud Cluster Network Compress & Run The DL Model Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
  • 20.
    OrientAct Observe Decide Small Model OrientAct Observe Decide Small Model Feedback Sensor Sensor Effector Effector COLLABORATIVE AUTONOMY -MULTIPLE SENSORS & EFFECTORS (DISTRIBUTED) Copyright (c) 2017-18 by STORM Insights Inc. All Rights Reserved.
  • 21.
    Copyright (c) 2017-18by STORM Insights Inc. All Rights Reserved. COMPLEXITY VS MOBILITY CCTV SmartPhone Traffic Counter Fitbit Data Complexity Static Mobile Low High Weather Station Telematic Device
  • 22.
    DATA ATTRIBUTES DICTATEARCHITECTURE CHOICES Speed Streaming Structure/Complexity Surface_Shallow Dense_Deep Static Copyright (c) 2017 by STORM Insights Inc. All Rights Reserved.
  • 23.
    IT’S A COMPLEX,DATA-RICH WORLD: SENSORS ARE EVERYWHERE Market data Competitive data News Smart grid Traffic data Crime data Weather data Geo-tagged supply chain data Electronic health records Mobile sources Video (Closed Circuit) ... Copyright (c) 2018 by STORM Insights Inc. All Rights Reserved. Copyright (c) 2014 by Umbrellium Ltd. Business
  • 24.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. IMPACT OF THE IOT AND #MODERNAI/COGNITIVE COMPUTING ON STRATEGY IOT/#ModernAI enable New technologies New models New ecosystems Intelligence can be Local to the device Distributed Aggregated When everything is connected… New sources of data emerge New sources of value emerge Old assumptions must be challenged
  • 25.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. CREATING BUSINESS VALUE WITH DISTRIBUTED INTELLIGENCE Know Where Your Customers Are - And Where They Will Be Know What Your Customers Want Know When Your Customers’ Wants Change Know Your Customers Anticipate Opportunities For Each Rule: Do you have or can you capture streaming data that can increase your value proposition? Data about your product, supply chain, or customer that can improve performance, reliability, predictability… Can you create value from new analysis of open data? Adding your own data/algorithms to open data creates value. Tip: Choose an infrastructure that allows you to evaluate live streaming data in the context of relevant historical data. Getting Started
  • 26.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. KNOW YOUR CUSTOMERS Collect/Track: Demographics Psychographics Emotions Technologies: NLP Analytics Machine Learning Captured/Enabled By: Sensors Active Passive Systems Profile-Driven Interactive Interfaces Profiles Opt-In Generated Purchased Derived Current
  • 27.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. KNOW WHAT YOUR CUSTOMERS WANT Collect/Track: Behavioral History Captured/Enabled By: Sensors Active Passive Systems Profiles Opt-In Generated Purchased Derived Peer Profiles Product/Service Trends Current Technologies: NLP Analytics Machine Learning
  • 28.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. KNOW WHEN YOUR CUSTOMERS’ WANTS CHANGE Collect/Track: Behavioral History Environmental Factors Technologies: Analytics Machine Learning Current Captured/Enabled By: Sensors Active Passive Systems Profiles Opt-In Generated Purchased Derived Peer Profiles Product/Service Trends
  • 29.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. KNOW WHERE YOUR CUSTOMERS ARE - AND WHERE THEY WILL BE Collect/Track: Geo Track/History Technologies: Mobile WiFi Beacons Facial Recognition Analytics Machine Learning Captured/Enabled By: Sensors Active Passive Systems Profiles Opt-In Generated Purchased Derived Current Future
  • 30.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. ANTICIPATE OPPORTUNITIES Technologies: Analytics NLG Machine Learning Current Captured/Enabled By: Sensors Active Passive Systems Profiles Opt-In Generated Purchased Derived Peer Profiles Product/Service Trends Collect/Track: Demographics Psychographics Emotions
  • 31.
    Copyright (c) 2014-18by STORM Insights Inc. All Rights Reserved. MAKE YOUR APPLICATIONS AWARE EVERYWHERE Aware Everywhere Mobility Analytics/ Big Data Cloud Social Enabling Technologies Everywhere indicates that services and data are generally available to customers on-demand regardless of their physical location (except where prohibited by law or technology constraints). Aware indicates that the enterprise has adopted tools and techniques that permit it to access and leverage data from a broad range of IP-enabled devices to identify opportunities for new or improved services. An aware business process or device can make real time pricing and service offering decisions based on this data, interpreted in context.
  • 32.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. WHAT SENSOR DATA DO YOUR CUSTOMERS ALREADY PRODUCE? Type Typical Current Use Potential Use Accelerometer/motion Rotate screen, Switch screen to landscape/portrait Ambient Light Adjust screen brightness Barometer Measure altitude Geo-Location (wifi/cellular) Location/Alerts 3-Axis Gyroscope Rotation rate for games, VR… Proximity Turn off screen when phone is by your head Touch ID fingerprint, Facial Recognition Security
  • 33.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. FIND NEW USES FOR EXISTING DATA SOURCES Copyright (c) 2014 by Umbrellium Ltd. No Shortage of Data How will you create value?
  • 34.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. INSIGHTS & RECOMMENDATIONS It’s the sensors, stupid If you’re not predicting, you’re just reporting Own the insight, not the data Process/Analyze As Close to the Source as Possible Move Intelligence To The Edge (Fog) Parallelism in Algorithms? Exploit it with hardware at the edge
  • 35.
    Copyright (c) 2018by STORM Insights Inc. All Rights Reserved. OPPORTUNITIES ARE EMERGING EVERY DAY…
  • 36.
    adrian@storminsights.com Twitter @ajbowles Skype ajbowles KEEPIN TOUCH Upcoming SmartData Webinar Dates & Topics Feb. 8 A Pragmatic AI Maturity Model: Choosing the Right AI Technologies Based on Application Requirements and User Attributes March 8 Machine Learning Update: An Overview of Technology Maturity and Product Vendors April 12 Knowledge as a Service: An Introduction to the Emerging Pre-Built Knowledge Market AGEOFREASONING.COM BOOK, VIDEOS, PROFESSIONAL SERVICES COMING SOON…