Active Insight - Event Stream Processing In The Cloud

ACTIVE INSIGHT
Event Stream Processing in the Cloud
Mike Telem
Business Development

Table of Contents
Background: The Digital Era
Processing, Correlating and Aggregating Events
Use Cases: From Behavioral Targeting to Electrical Smart Grids
ESP in the Cloud
Roadmap: Where is ActiveInsight headed

The Digital Era
Our world is becoming digital…
Cell phones, web sites, GPS devices, cars, ads, Financial transactions,…
RFID, industrial eq., security sensors, border controls, medical eq.,…
Utilities, pipelines, meters, digital signage, home appliances, entertainment devices, cars, …
Applications, infrastructure, web-services, customer data,…
Markets, stocks, currencies, news, wiki’s, blogs, tweets,…
…
Multiple events share various perspectives
Event stream quantity and frequency will fluctuate
Effective time window for reactions is minimal
Reaction channels may vary
Events should be correlated with historical data

Event Stream Processing (ESP)
Event Stream Processing:
Processing application level events in a distributed environment
Event Correlation – Directing multiple event streams based on their context to the corresponding ESP containers
Complex Event Processing:
Processing multiple events to detect meaningful patterns using correlation, aggregation and time-frames
Pattern detection: Detecting specific event combinations and patterns in contexts
Cross-Context Correlation: Processing multiple streams into multiple contexts / perspectives (fraud / marketing)
Aggregation: Accumulating correlated events into time-based contexts, support for “event state machine” aggregation.
Data Integration: Caching data sources as “reference data” for processing
Reaction: Invoking an action after a successful event or pattern match

Different Use-cases > Similar Challenges
Online Gaming : Real-time BI, money laundering, local compliance, application offload
Online Advertisement: Behavioral targeting, multiple site click-stream correlation
Ecommerce : Identifying customer interests (up-sell/cross—sell) , Improving conversion rates, anonymous user hooking, campaign management
Online Self-Service : Identifying customer turnover or dissatisfaction, Monitor user experience and assist in transaction completion
Algo-Trading : performance and availability improvements and HW cost reduction
Auditing: Feeding “Who” did “What” and “When” to auditing and SIEM systems
Fraud detection: Fraudulent behavior pattern detection, Bot detection, alongside fraud detection systems
Electrical smart-grid: Detecting misuse, mal-functions, on-demand supply
Home Land Security: Enhance airport and border security, correlate multiple events, intelligence data and incoming alerts
Traffic management: Vehicle location management for Insurers, authorities and drivers
…Similar Challenges

Different Use-cases > Similar Challenges
Process
Correlate
Aggregate
Match
React

ESP in the Cloud
Elastic ESP
On-demand usage
Scaling up and out to varying event frequencies
ESP as a service
Offloading event processing
Dynamic Stream Sources
Dynamic event sources
Handling remote event sources
SaaS Enabler
Porting event-oriented applications to the cloud
SaaScomponent
Enhance SaaS applications
Offload the core application
Comply to regional regulations
Provide SaaS Application integration
IaaS/Hosting
Value Added Services (Security, Auditing, BI)
Customer Experience Management

ActiveInsight.org
Distributed Event Stream Processing Framework
Real-time event processing
Multi-source event stream processing
Event correlation and aggregation
Pattern matching
Integrated data caching
Embeddable framework
Scalable, elastic cloud run-time

Typical Architecture
Mobile Device
Web App
Distributed Cache
Distributed Cache
Distributed Cache
Reference Data
Reference Data
Reference Data
Context
Context
Context
Context
Context
Context
Car GPS
AI Server Node
AI Server Node
AI Server Node
Process
Process
Process
Match
React
Match
React
Match
React
Contexts
Marketing
Security

Roadmap
Cloud ESP
Amazon Public Image, Devpay
SaaSconnectivity (Sales Force, etc.)
First SaaS OEM’s
AI in additional IaaS
Enhanced ESP
Integrating mathematical/statistical engines (R-server)
In-memory data-grid integration
Clustered ESP container
Pattern Recognition

Q&A
Thank you!
http://www.activeinsight.org
mike.telem@activeinsight.net

http://www.israelexporter.com	91
http://www.activeinsight.net	42
http://www.slideshare.net	17
http://activeinsight.net	3
http://www.activeinsight.net:80	1
http://translate.googleusercontent.com	1

Active Insight - Event Stream Processing In The Cloud

by ActiveInsight on Dec 02, 2009

Accessibility

Categories

Tags

Upload Details

Usage Rights

6 Embeds 155

Statistics

Active Insight - Event Stream Processing In The Cloud — Presentation Transcript