StreamInsight Breakthrough

449 views
304 views

Published on

Unobtrusive introduction to basic Complex Event Processing principles and building blocks. Review of the Microsoft StreamInsight.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
449
On SlideShare
0
From Embeds
0
Number of Embeds
11
Actions
Shares
0
Downloads
6
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

StreamInsight Breakthrough

  1. 1. MICROSOFT STREAMINSIGHT Yulian Slobodyan L’viv, 2011 Breakthrough Guide
  2. 2. Introduction to CEP
  3. 3. recap(Strategic, Tactical) strategic tactical
  4. 4. scenarioA Tokyo Metro
  5. 5. scenarioA.Info        Anno 1927 #1 annual passenger rides 3,160,000,000 passengers/year avg 6,330,000 passengers/day 24/7 mode 203.4 km system length 2009 profit ¥63,500,000,000
  6. 6. scenarioA.Issues.Take(1) Pushers 押し屋 oshiya
  7. 7. scenarioA.Strategic      Reporting Planning Data Mining Constraints Detection Forecasting
  8. 8. scenarioA.Tactical      Real-time Statistics & Monitoring On a Fly Analysis Traffic Optimization Systems Management Emergency Response
  9. 9. scenarioA.Solutions[“RDBMS”] Humans Request Data Services RDBMS Presentation tactical Sensors strategic
  10. 10. scenarioA.Solutions[“CEP”] CEP System Humans Services Presentation tactical Sensors strategic
  11. 11. Google(“CEP”)  Complex event processing (CEP) consists of      processing many events happening across all the layers of an organization identifying the most meaningful events within the event cloud analyzing their impact taking subsequent action in real time. CEP Products  Sybase CEP, StreamBase  Microsoft StreamInsight
  12. 12. Compare(RDBMS, CEP) RDBMS Request Paradigm Latency Throughput CEP On-Demand Continuous ~ sec * n ~ ms * n ~ 100 * n/sec ~ 10,000 * n/sec
  13. 13. Microsoft StreamInsight
  14. 14. StreamInsight.Info     CEP engine from Microsoft Part of MS SQL Server 2008/2008R2 Distributive Uses SQL Server license key to activate Two Editions:  Standard ( SQL Server Standard/Enterprise/Web)  Premium ( SQL Server Datacenter/Developer/Eval)  Current version: 1.1
  15. 15. StreamInsight.Architecture
  16. 16. StreamInsight.EventStream.Tra ce() Stream Insight Runtime Event Source Input Adapter Standin g Queries Output Adapter Event Sink
  17. 17. Data Event Model Event Event Kind Payload Timestamp Header StreamInsight.Event.Structure
  18. 18. StreamInsight.EventKind Average Average time - INSERT event - CTI (Current Time Increment) event
  19. 19. StreamInsight.EventModel  Point   Interval   “10:42:56.052 - item #123 passed the gate” “01:12:00-01:35:00 - active sensor #17” Edge   “12:00:00-∞ - temperature 17˚C” “13:00:00-∞ - temperature 18.5˚C”
  20. 20. payloa d StreamInsight.EventModel.Edg e C B A time
  21. 21. StreamInsight.InputAdapters
  22. 22. StreamInsight.OutputAdapters
  23. 23. StreamInsight.Queries  Standard LINQ operations  Projection  Filtering  Joins  Unions  Grouping  Event Windows
  24. 24. StreamInsight.EventWindows
  25. 25. StreamInsight.EventWindows

×