This document discusses streaming analytics for analyzing real-time big data with IBM's Infosphere Streams product. It describes how streaming analytics analyzes data as it is created in motion without storing it, using a push approach rather than pulling data from a repository. Infosphere Streams allows defining analytics apps as flow graphs to analyze data at millions of events per second with low latency microseconds. It can handle a variety of data types and volumes and its distributed runtime scales to analyze data at the speed it is created.

1. It's not just the size, it's the motion Streaming analytics for real time
big data with Infosphere Streams
Stephan Reimann – IT Specialist Big Data - stephan.reimann@de.ibm.com
@stereimann
de.linkedin.com/in/stephanreimann/
www.xing.com/profiles/Stephan_Reimann2
© 2013 IBM Corporation

2. Streaming analytics is a paradigm shift from pull to push analytics in
real time, directly „on the wire“, data does not need to be persisted
Traditional approach
Streaming analytics
– Historical fact finding
– Analyze the current moment / the now
– Analyze persisted data
– Analyze data directly “in Motion” – without
storing it
– (Micro-) Batch philosophy
– Analyze data at the speed it is created
– PULL approach
– PUSH approach
Data
Repository
Analysis
Insight
Data
Analysis
Insight
© 2013 IBM Corporation

3. How it works
InfoSphere Streams
Capabilities
InfoSphere Streams is the result of an IBM research project, designed
for high-throughput, low latency and to make streaming analytics easy
Volume
Millions of Events per Second
+
Variety
All kinds of data
+
Velocity
Analyzes data at the speed it is
created
Latencies down to µs
Complex analytics: Everything you
can express via an algorithm
Immediate action in real time
– Define apps as flow graphs consisting of
sources (inputs), operators & sinks (outputs)
– Extend the functionality with your code if
required for full flexibility
– The clustered, distributed runtime on
commodity HW scales nearly limitless
– GUIs for rapid development and
operations make streaming analytics easy
© 2013 IBM Corporation

4. Streaming analytics is about analyzing all the data, continously, just
in time, it enables a completely new generation of big data apps
... and is a key component
of many innovations
Streaming Analytics is already reality
Transport
TelCo
Healthcare
Radio astronomy
IoT
...
Smart Grid
...
Start here!!
Stop just dreaming of real time big data
Start with streaming analytics!!!
Free Quickstart Edition
+
Developer Community
Tutorials, Labs,
Forum, ...
www.ibm.com/software/data/infosphere/streams/quick-start/
www.ibmdw.net/streamsdev/
© 2013 IBM Corporation