As devices and systems connected to the Internet of Things generate streaming data on a global scale, firms need effective strategies for identifying and leveraging this data in new applications. That may require the integration and analysis of data from internal legacy sources, current customer-generated data, and external sources from partners and data service providers. The data management and analytics tools of the last decade may be able to handle the volume of data, but they simply can’t keep up with the speed at which it must be processed.
A variety of vendors are racing to meet this challenges with a new generation of data management and analytics tools. From query optimization solutions to integration techniques to new platforms for IoT device interoperability, there is no shortage of innovation in this space today.
In this webinar, participants will learn:
•How the data management vendor market is re-aligning to support streaming analytics,
•Why enterprises need an open-source analytics strategy, and
•How real businesses are competing today with streaming analytics (short case studies from a variety of industries)
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Smart Data Webinar: Getting Started with Streaming Analytics and the IoT
1. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
April 14, 2016
Adrian Bowles, PhD
Founder, STORM Insights, Inc.
info@storminsights.com
2. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands
Streaming Analytics - What, and Why Now?
Open Source Strategies
Vendor Solutions
3. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands
Streaming Analytics - What, and Why Now?
Open Source Strategies
Vendor Solutions
4. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
“The Internet of Things
is the new Industrial Revolution.”
Dr. John Bates, 11/17/2015
5. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
When everything is connected…
New sources of data emerge
New sources of value emerge
Old assumptions must be challenged
The Impact of the IOT
6. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
IOT enables
New technologies
New models
New ecosystems
7. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Intelligence can be
Local to the device
Distributed
Aggregated
8. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
9. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
10. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
11. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
12. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Solutions:
On-Demand Access
Images courtesy of Wikipedia
13. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
New Data, New Demands, New Opportunities!
14. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Copyright (c) 2014 by Umbrellium Ltd.
The data are there…
15. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands
Streaming Analytics - What, and Why Now?
Open Source Strategies
Vendor Solutions
16. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Attributes of a Stream
“You could not step twice into the same river.”
Heraclitus 535BC-474BC
To understand the contents (analyze)…
Divert the flow?
Pool the data?
Evaluate everything without changing the flow?
(ask Heisenberg about that one)
Sample? (catch and release?)
17. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Evolution of Data Management Solutions
Images courtesy of Wikipedia
Today:
Delta Airlines processes 5,000,000 business events per day
Pratt & Whitney jet engine: 5,000 sensors producing 10GB/s/per engine.
Formula 1 car sensors produce about 1.2GB/s
and we need to predict the future…
Perform Operations on Data at Rest
18. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Speed
Volume
Low
High
High
Streaming
Data
19. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Conventional Data ArchitectureDataSources
Store
Process/Transform
Key
Data Flows on the Edges, Queries on the Vertices
20. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Streaming Data ArchitectureDataSources
Store
Process/Transform
Observe
Key
Data Flows on the Edges, Queries Everywhere
Sampling vs Monitoring Everything…
21. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
The Problem With Sampling…
440
880
440
880
22. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
The Problem With Sampling…
440
880
440
880
440
880
23. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands
Streaming Analytics - What, and Why Now?
Open Source Strategies
Vendor Solutions
24. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Courtesy of STRIIM
The Open Source Ecosystem for Analytics Infrastructure
25. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
A Role for Collaboration and Standards
26. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Getting Started with Streaming Analytics and the IoT
Context - New Data, New Demands
Streaming Analytics - What, and Why Now?
Open Source Strategies
Vendor Solutions
27. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
IoT Platforms
Predix
Jasper Control Center
Watson IoT
38. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Data Sharpening (Zoomdata)
39. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
Do you have or can you capture streaming data that can increase your value
proposition?
Data about your product that can improve performance, reliability, predictability…
Can you create value from new analysis of open data?
Adding your own data/algorithms to open data creates value.
Tip: Choose an infrastructure that allows you to evaluate live streaming data in the
context of relevant historical data.
Getting Started…
It’s All About the Data
40. Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
What will you do with it
to create value?
41. For more information:
Copyright (c) 2016 by STORM Insights Inc. All Rights reserved.
adrian@storminsights.com
Twitter @ajbowles
Skype ajbowles
If you would like to connect on LinkedIn, please let me know that
you that you found me via the Smart Data webinar series.
Upcoming Webinar Dates & Topics
May 12 Emerging Data Management Options: Graph Databases
June 9 Advances in Natural Language Processing (NLP)
July Modern AI and The Future of Work (With Steve Ardire)
Editor's Notes
Thanks, Shannon, and welcome to the second installment of our 2016 webinar series.
Event stream processing, complex event processing
GE: “Predix is the foundation for all of GE’s Industrial Internet applications, providing powerful, consistent, secure, and scalable support for the solutions you rely on to optimize your business.”
Cisco: “Jasper Control Center is the only IoT platform that intelligently adapts to your business needs, providing a vast array of flexible ways to automate your IoT services. Our proprietary automation engine makes it easy to launch new services, optimize performance on the fly, lower operational costs, and continuously deliver exceptional customer experiences.”
ATT: “Connecting more IoT devices than any other provider in North America with a global network that reaches over 200 countries and territories, AT&T is your leader in the Internet of Things.”
Intel: IoT Developers Resources
Find everything you need to start building IoT applications, from documentation, tools, and support to a community of like-minded developers.
When the user interacts with a chart, Zoomdata takes that single logical query defined by the chart and turns it into a set of micro-queries. Micro-queries are smaller queries sent to the source and executed in parallel. Each of them executes in much less time than would the original large query.
When the results from the first micro-query return from the source, Zoomdata immediately displays that result data to the user as an approximation of the final visualization. As the rest of the micro-queries complete, Zoomdata’s streaming architecture updates the visualization with new data, revealing increasingly better and more accurate approximations of the final result until the full result set comes into focus. Zoomdata assembles the multiple result streams from the micro-queries to answer the user’s question, while giving accelerated query response time to the user.
we’re going to open it up for questions now, so I’ll turn it back to Shannon and leave you with my contact info and information about upcoming webinars in this series