Siddhi CEP 1st presentation

1,150 views

Published on

The sideshow used at the 1st presentation of the project Siddhi CEP

Published in: Technology, Business
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,150
On SlideShare
0
From Embeds
0
Number of Embeds
2
Actions
Shares
0
Downloads
55
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Siddhi CEP 1st presentation

  1. 1. A HIGH PERFORMANCE COMPLEX EVENT PROCESSING ENGINE<br />http://siddhi.sourceforge.net/<br />
  2. 2. INTRODUCTION<br /><ul><li>What is CEP?
  3. 3. Why Siddhi?</li></ul> <br /><ul><li>Our project</li></ul>What have we done?<br />What are yet to come?<br />
  4. 4. WHATISCEP ?<br /> <br />
  5. 5. WHATIS CEP<br />In abstract, the tasks of the CEP is to identify meaningful patterns, relationships and data abstractions among unrelated events and fire an immediate response such as an Alert message.<br />
  6. 6. WHY SIDDHI?<br /> <br />
  7. 7. WHY SIDDHI?<br /><ul><li>Current CEP solutions and their Cons
  8. 8. Project objectives
  9. 9. Improvements from Research</li></li></ul><li>CURRENT CEP SOLUTIONS<br /><ul><li>S4 
  10. 10. STREAM
  11. 11. Esper
  12. 12. SASE
  13. 13. Cayuga
  14. 14. TelegraphCQ
  15. 15. HiFi
  16. 16. Aurora
  17. 17. CompAS.
  18. 18. Niagara</li></li></ul><li>WHATARETHEPROBLEMSWITHTHEM?<br /><ul><li>Proprietary
  19. 19. Not enough support for complex queries
  20. 20. Less efficient </li></ul>High latency and  High memory consumption<br />
  21. 21. PROJECTOBJECTIVES<br />Primary Objective<br /><ul><li>Carrying out research to come up with effective algorithms approaches to implement A High Performing CEP engine.
  22. 22. Coming up with an effective architecture for a CEP Engine which can detect events in a computationally</li></ul> efficient way.<br />
  23. 23. PROJECTOBJECTIVESCONT'D...<br />Secondary Objective<br /><ul><li>Finding out a query language that will be sufficient to express the full set of pattern queries.
  24. 24. Provide additional features, such as out of order arrival of events.(Optional)</li></li></ul><li>From Research<br />For State Machine<br /> SASE: High-Performance Complex Event Processing over Streams<br />For Pipeline Architecture<br /> Aurora: a new model and architecture for data stream management <br />For Query Plan Management<br /> Query Processing, Resource Management, <br /> and Approximation in a Data Stream <br /> Management<br />
  25. 25. Siddhi Architecture<br /> <br />
  26. 26. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />User Input a Query<br />
  27. 27. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Compiling the query<br />
  28. 28. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Query get compiled into an object model<br />
  29. 29. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Query Object Model is parsed to the Siddhi Manager<br />
  30. 30. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Event arrives to the Input Adapter<br />
  31. 31. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Convert the Event to a tuple and place it to the input event queue<br />
  32. 32. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Processor takes the tuple from the queue <br />
  33. 33. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Executing the queries…Other Events arrives at the same time<br />
  34. 34. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Non matching event thrown away<br />
  35. 35. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />
  36. 36. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Matching Event creates the output Event<br />
  37. 37. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Pushing generated Events to the output queue<br />
  38. 38. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />User get notified through output Adapter<br />
  39. 39. User<br />Output Adapters<br />Input Adapters<br />Compiler<br />Siddhi Manager<br />Same procedure happens again and again…<br />
  40. 40. SIDDHICORE<br />
  41. 41. PROGRESSSOFAR...<br /> <br />
  42. 42. PROGRESSSOFAR...<br /><ul><li>Initial research √
  43. 43. System Design √
  44. 44. Web site
  45. 45. 1stiteration
  46. 46. Improved Siddhi API
  47. 47. 2nditeration
  48. 48. Done up to Simple Query processing </li></li></ul><li>Web Site<br />http://siddhi.sourceforge.net/<br />
  49. 49. Demo<br /> <br />
  50. 50. QUESTIONS?<br /> <br />
  51. 51. Where can Siddhi be used?<br />"Los Angeles Smart Grid Demonstration Project"<br />- It forecasts electricity demand, respond to peak load events, and improves sustainable use of energy by consumers.http://ceng.usc.edu/~simmhan/pubs/simmhan-usctr2011-smartgridinformatics.pdf<br />
  52. 52. Los Angeles Smart Grid Demonstration Project<br />
  53. 53. THANK YOU!<br /> <br />

×