Wrong confirmation ID

Email
Favorite
Favorited ×
Download
Embed
Private Content
Copy and paste this code into your blog or website Copy Customize… Close
We have emailed the verification/download link to "".
Login to your email and click the link to download the file directly.

To request the link at a different email address, update it here. Close
Validation messages. Success message. Fail message.

Check your bulk/spam folders if you can't find our mail.

Loading…

Flash Player 9 (or above) is needed to view presentations.
We have detected that you do not have it on your computer. To install it, go here.

+ Follow

Complex Event Processing with Esper

by Matthew McCullough on Jun 12, 2010

2,969 views

Nathan Reese's presentation to DOSUG on Esper's complex event processing engine.

More…

Nathan Reese's presentation to DOSUG on Esper's complex event processing engine.

Less

2 Embeds 4

http://vrmtechnologies.jira.com	3
http://www.slideshare.net	1

Statistics

Favorites: 6
Downloads: 0
Comments: 3
Embed Views: 4
Views on SlideShare: 2,965
Total Views: 2,969

1–3 of 3 previous next Post a comment

wingchin I see, and thank you for your help, online should be good enough. 1 year ago Reply
Are you sure you want to Yes No
Matthew McCullough , Open Source Architect at Ambient Ideas, LLC Wingchin: Sorry, I didn't have authorization from this presenter to make them available for download, only online. But I will ask him again. 1 year ago Reply
Are you sure you want to Yes No
wingchin I want to download! 1 year ago Reply
Are you sure you want to Yes No

Distributed systems span across the boundaries between enterprises Examples Financial trading systems Same structure: dispersed set of applications communicating with one another by messages transmitted over an IT layer
Distributed Information Systems aka global communications spaghetti pot Activities are driven by events flowing through IT layers No technology to enable humans to understand what is going on Tools to see events No tools to make sense of events
Need tools to unravel the communication spaghetti, to be able to understand it at a human level and derive instant insights. Need to be able to determine the following from the event cloud
New suite of technologies have been created to answer these questions
A good way to visualize ESP and CEP is to think of an upside down database. A traditional databases or distributed caches are passive data structures that create frozen and slow assets which require explicit querying to make sense of.
DB model turned upside down. Store your queries and continuously flow data over queries, constantly detecting patterns among events (event correlation), filtering events, aggregate time or length windows of events, join event streams, trigger based on absence of events
Real time data mining: Query results returned in real time when conditions occur that match queries Continuous execution model: In CEP, the event stream is constantly being examined for query matches and patterns. Database only searches while a query is running. If your application needs data 10 times per second it must query 10 times per second. Disparate data streams: CEP can have any/all enterprise data streams flowing over queries. Break free from data silos Tiny footprint: Do not need large hardware investment. Benchmark tests running 1000 to 100000 messages per second on a laptop.
Not meant to replace traditional databases, which will always be needed for historical data and adhoc queries. This is meant as another cog in the wheel that will greatly reduce the burden placed on databases while provided much needed real time capabilities.
CEP nodes can placed into a hierarchy to model target system’s logical layers
Esper engine is an Open Source java CEP library that makes building CEP applications possible Esper is a lightweight kernel written in Java which is fully embeddable into any Java process, JEE application server or Java-based Enterprise Service Bus. It enables rapid development of applications that process large volumes of incoming messages or events. Esper is actively developed with quarterly releases
The EPServiceProvider interface represents an engine instance. Each instance of an Esper engine is completely independent of other engine instances and has its own administrative and runtime interface. Create events Set up query statements Specify Engine result consumers (Listener or subscriber) Esper configuration options
The Event Processing Language (EPL) is a SQL-like language. Streams (and views) replace tables as the source of data with events replacing rows as the basic unit of data. Views represent the different operations needed to structure data in an event stream and to derive data from an event stream Views define the data available for querying and filtering. Some views represent windows over a stream of events. Other views derive statistics from event properties, group events or handle unique event property values. Lots of built in views
Diagram taken from “Esper Reference Documentation” version 3.4 produced by EsperTech
Diagram taken from “Esper Reference Documentation” version 3.4 produced by EsperTech
Diagram taken from “Esper Reference Documentation” version 3.4 produced by EsperTech
Resources and further reading

6 Favorites

Yansong Liu , Architect at Primeton Tags cep 2 months ago
Александр Соколов , Главный по Provisioning at Вымпелком Tags cep 1 year ago
Kee Ong , CTO at Versant Corp. Tags cep 1 year ago
chaoh Tags cep 1 year ago
wingchin Tags esper 1 year ago
jiayouyuliang 1 year ago

Complex Event Processing with Esper — Presentation Transcript

Complex Event Processing with Esper Turn your database upside down DB Nathan Reese [email_address]
“ Information processing using computer systems on a global scale has become the foundation of the twenty-first-century” David Luckham – The Power of Events
Distributed Information Systems SOA
Global Communications Spaghetti
horizontal/vertical causality detect patterns filter aggregate correlate
Event Driven Architecture (EDA) Complex Event Processing (CEP) Event Stream Processing (ESP)
Store Now Query Later
Query Continuously
- Real Time Data Mining
- Continuous Execution Model
- Disparate Data Streams
- Tiny Footprint
- Not Database Replacement
Event Streams App1 AppX … CEP
Event Streams App1 AppX … CEP CEP CEP Derived Event Streams
- CEP
Esper Open Source Java library ESP
Esper Engine Open Source SOA – Jeff Davis EPServiceProvider Event Objects EPL Statements Listeners Subscribers Configuration JDBC Adapter
- SQL
- Tables
- Rows
EPL Event Streams Views Events
select * from Withdrawal.win:length(5) Esper Reference Documentation Ch. 3
select * from Withdrawal(amount>=200).win:length(5) Esper Reference Documentation Ch. 3
select * from Withdrawal.win:length(5) where amount >= 200 Esper Reference Documentation Ch. 3
- Demo
- http://www.espertech.com/
- http://esper.codehaus.org/
- http://esper.codehaus.org/esper-3.4.0/doc/reference/en/pdf/esper_reference.pdf
- http://www.flickr.com/photos/wwworks/2222523978/sizes/o/
- http://www.flickr.com/photos/aptmetaphor/4260444057/
- http://www.flickr.com/photos/kevl/280501517/sizes/o/
- http://www.flickr.com/photos/kylemay/1800897737/sizes/l/
- http://www.flickr.com/photos/14055560@N04/1429994326/sizes/o/
- http://www.flickr.com/photos/dullspork/1023523252/sizes/l/
- http://www.flickr.com/photos/storm-crypt/2055237530/sizes/o/
- http://www.flickr.com/photos/clockwerx/9267076/

Complex Event Processing with Esper

by Matthew McCullough on Jun 12, 2010

Accessibility

Categories

Tags

Upload Details

Usage Rights

2 Embeds 4

Statistics

Complex Event Processing with Esper — Presentation Transcript