Keynote at Depsa07 - architectural view of event processing

1,056 views

Published on

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,056
On SlideShare
0
From Embeds
0
Number of Embeds
12
Actions
Shares
0
Downloads
75
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Keynote at Depsa07 - architectural view of event processing

  1. 1. IBM Software Group – Event Processing technologies ! quot; ! # $ © 2007 IBM Corporation
  2. 2. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation
  3. 3. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation
  4. 4. Event Processing Event Event Producer Consumer Generate and Consume and may publish perform operations react to either events on events raw or complex events !
  5. 5. EDA Reference Architecture Overview Event Event Business State Services Producer Sensors Processes Machines Event Monitoring and Analytic Infrastructure Event Consolidator Event Security Services Event Flow Event Event Bus Processing Network Event Operator (Facilitator) Event Event Business State Services Consumer Actuators Processes Machines © 2003 IBM Corporation 5
  6. 6. IBM Software Group – Event Processing Technologies and Architecture Consumers Producers Agents g Event-Driven Processing in IBM © 2007 IBM Corporation
  7. 7. IBM Software Group – Event Processing Technologies and Architecture Consumers Producers Agents Transform validate g Retrospective pattern if the customer has breached his credit limit the second time within the last 48 hours then divert the workflow based on policies that relate to the history of credit violations in the last year. Event-Driven Processing in IBM © 2007 IBM Corporation
  8. 8. IBM Software Group – Event Processing Technologies and Architecture !quot; Consumers Producers Agents Detect Pattern Enrich g If a customer sends three requests over the last hour on the same topic and the requests have been handled, notify immediately to the “unhappy customers officer” and include count of “unhappy” detections for this customer in the last year Event-Driven Processing in IBM © 2007 IBM Corporation
  9. 9. IBM Software Group – Event Processing Technologies and Architecture $ !% Consumers Producers Agents Detect Pattern Dynamic Subscribe g I am interested to know whenever my investment portfolio is down 2 percent within the last couple of hours Event-Driven Processing in IBM © 2007 IBM Corporation #
  10. 10. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation &'
  11. 11. IBM Software Group – Event Processing Technologies and Architecture ( ) * ) + ( , -. - * .* / 01 2( 3 $ quot; 2 + , - ,4 5 ( 6 ) 78 + ) 6 - ,9 6 6 9 7 quot; $ ! 8 7 ': 6 ' * ,9 / 1 2( 6( % +/ 6! 8 76 ' ; ' $ ,9 / *( , $ / 6 < 7 ': 6 '; Event-Driven Processing in IBM © 2007 IBM Corporation &&
  12. 12. IBM Software Group – Event Processing Technologies and Architecture 8( = * ! *( Event-Driven Processing in IBM © 2007 IBM Corporation &
  13. 13. IBM Software Group – Event Processing Technologies and Architecture $ - ! Event-Driven Processing in IBM © 2007 IBM Corporation &
  14. 14. IBM Software Group – Event Processing Technologies and Architecture * +7 ( Event-Driven Processing in IBM © 2007 IBM Corporation &:
  15. 15. IBM Software Group – Event Processing Technologies and Architecture *( ( , / , ) ) ? 6 @; / - A B C Event-Driven Processing in IBM © 2007 IBM Corporation &>
  16. 16. IBM Software Group – Event Processing Technologies and Architecture 8( . / + ( 7 + ( ( 2 A B ( + Event-Driven Processing in IBM © 2007 IBM Corporation &
  17. 17. IBM Software Group – Event Processing Technologies and Architecture 8( 0 ! = 3 D / 0 3 D- ,/ 0 3! ! A / E B D ,/ 0 3 D , D- / 7%( ) % ( % , ( / ( + + ! Event-Driven Processing in IBM © 2007 IBM Corporation &
  18. 18. IBM Software Group – Event Processing Technologies and Architecture Processor examples: ! 7 +! Validate, transform, detect pattern, derive, enrich Selector Processor Router Event-Driven Processing in IBM © 2007 IBM Corporation &
  19. 19. IBM Software Group – Event Processing Technologies and Architecture ! * F $ ( Event-Driven Processing in IBM © 2007 IBM Corporation &#
  20. 20. IBM Software Group – Event Processing Technologies and Architecture + $ + , ( + % + + 0 - 3; ( + 7 % ( ) )7 70 ; ; ) 3 ; $ ( (7 ) / $ ( ( ) 7 / 7 ) 7 $ 7% 7 / G ( + %6 +( (/ ; Event-Driven Processing in IBM © 2007 IBM Corporation '
  21. 21. Event Processing Reference Architecture EVENT SOURCES EVENT PRE- Event Processing (EP/CEP) EXTERNAL PROCESSING DISTRIBUTED LEVEL ONE LEVEL TWO LEVEL THREE LOCAL EVENT SITUATION IMPACT EVENT REFINEMENT REFINEMENT ASSESSMENT SERVICES . . USER EVENT . INTERFACE PROFILES . . . . DB MANAGEMENT DATA BASES . Historical Profiles & LEVEL FOUR Data Patterns . OTHER PROCESS DATA REFINEMENT Adapted from JDL: Steinberg, A., & Bowman, C., Handbook of Multisensor Data Fusion, CRC Press, 2001 21 © 2006 TIBCO Software Inc. All Rights Reserved. Confidential and Proprietary. 24
  22. 22. Summary of Event Processing (Event-Decision) User Interface Human visualization, interaction and situation management Level 4 - Process Refinement Decide on control feedback, for example resource allocation, event source and state management, parametric and algorithmic adjustments Level of Level 3 - Impact Assessment Inference Impact assessment, i.e. assess impact on the basis of situation development, recognition and prediction Level 2 – Situation Refinement High Identify situations based on events relations, relational state estimation, etc. Level 1 – Event Refinement Identify and track events based on association, filtering, joins, correlation etc. Med Level 0 – Event Preprocessing Cleansing of event-stream to produce semantically understandable data Event Sources Low Reference: Bass, T., Processing Patterns for PredictiveBusiness™, March 2006. 22 © 2006 TIBCO Software Inc. All Rights Reserved. Confidential and Proprietary.
  23. 23. Overview Event Data publish Processing consume Publication Consumption (Publishers) Selection (Consumers*) Correlation Distribution Applications Files/DBs Sensor Data Feeds Propagations * Consumers can act as publishers 23
  24. 24. Event Data Processing Event Data Processing Stream Stream Select Process Compose Stream Retain Deliver/propagate Stream Stream Single or multiple steps Local or distributed 24
  25. 25. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation >
  26. 26. IBM Software Group – Event Processing Technologies and Architecture / ! ( . ( ) / 7 / 17 / -+ 17 17 * 17 $7 5 % Event-Driven Processing in IBM © 2007 IBM Corporation
  27. 27. IBM Software Group – Event Processing Technologies and Architecture -* , ! ( ( + +/ +% + ( ( 0 7+ / 3 + ( . , ( C ( 6( / ++ + ; H 6( ) + +2 ( 6( + * + % ( Event-Driven Processing in IBM © 2007 IBM Corporation
  28. 28. IBM Software Group – Event Processing Technologies and Architecture -,$ - 2 ( ( , + - quot; 9 / . ) , $ 1 I $ 1 ( +, 7 + ! )7 + Event-Driven Processing in IBM © 2007 IBM Corporation
  29. 29. IBM Software Group – Event Processing Technologies and Architecture -- J -, ( ( , % 2 +/ -quot; % + % 2, 6 ) 6 / 6 + % 2; ! ( A ( (B () ) ( )7 0 quot; 3; / 7 % (( ++ + % 2 (7 ( ( 5% / . ( + , K 5 6 ! F / ;; F ( + % 2 * ) + ( )7 ( + % 2 Event-Driven Processing in IBM © 2007 IBM Corporation #
  30. 30. IBM Software Group – Event Processing Technologies and Architecture -, / J F % ( D5 ( 7 L D* * % ( 9 Event-Driven Processing in IBM © 2007 IBM Corporation '
  31. 31. IBM Software Group – Event Processing Technologies and Architecture J, / / %, / ( +( / / / , * 7 / , ! 7 % ( / 6+ ( 7 + (/ , ( 7( / ( +/ ! ( ( / 6 M ; quot; 7( / 0 ( % ( / + + + ( +3 ! * 7 ) + 6 ) / 0 3 ; 4 G 69 / / 7 ( + Event-Driven Processing in IBM © 2007 IBM Corporation &
  32. 32. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation
  33. 33. IBM Software Group – Event Processing Technologies and Architecture 7 ! ? 9 quot; / ) / 9 $ $ Event-Driven Processing in IBM © 2007 IBM Corporation
  34. 34. IBM Software Group – Event Processing Technologies and Architecture / , ( ( / / ( )7 % / , ( ( A B ) / 7 9 ,! ( + ( ; Event-Driven Processing in IBM © 2007 IBM Corporation :
  35. 35. IBM Software Group – Event Processing Technologies and Architecture 9 ) - ( / ) 6 ( ) / ( 0 ; ;*-% 2 ( 3 ; * ) (0 6 3 0 ; ;C 7( ) 3 - ( ( ) / 12 % . / ) ; Event-Driven Processing in IBM © 2007 IBM Corporation >
  36. 36. IBM Software Group – Event Processing Technologies and Architecture 7 +* - / + 9 $ ! 9 () 8 2 % + $ / ? Event-Driven Processing in IBM © 2007 IBM Corporation
  37. 37. IBM Software Group – Event Processing Technologies and Architecture / ( / 7 % (% 2 % 0 + 2 ( 7 3 / % 7 0( % / 6 ( + 7 C ) + ( % 2 % + 3 ; %% 2 % + $ ; quot; + 7 ; G/ M ( ) / ) A / B; Event-Driven Processing in IBM © 2007 IBM Corporation
  38. 38. IBM Software Group – Event Processing Technologies and Architecture - ( ( / 7. ( % ( ( ( ) + / ; 0 3 Event-Driven Processing in IBM © 2007 IBM Corporation
  39. 39. IBM Software Group – Event Processing Technologies and Architecture ( - / ) 7 6 ( ; ; +( % / A B A + + B ( +( ) ( ( ( 7 ) ( + A B /; A / B %( ( $ ; ( %( ( ( / ( 7 7 ( 7 / 7 / / (% / 6 7 (7 ) A ( B %( ( 7( 6 ( ( ) 0 ; ; 6 6 7;3 + - ( ( 6 ( / ( . ( ( 2 ) 7 ( G 0 / / 3 ; Event-Driven Processing in IBM © 2007 IBM Corporation #
  40. 40. IBM Software Group – Event Processing Technologies and Architecture + ( C quot; . ( )+ + ( C , ! ,( 7 6) 7 6 7/ 7 ( ( / 7 ( ( ; $ , ( / )+ )+ + ( ) 7 ) ( 6% 6%( ( . ( / / + L / ( (/ ) / ( ; ) , - ( 70 / 73 / ( 7 ) ! /? . / , * + / )7 A B A B+ ; * ) C ; Event-Driven Processing in IBM © 2007 IBM Corporation :'
  41. 41. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation :&
  42. 42. IBM Software Group – Event Processing Technologies and Architecture / ! (% % ( + = 9 ( ( +, + . 7 (% ( ; * ) % ; *( , + + ; Event-Driven Processing in IBM © 2007 IBM Corporation :
  43. 43. IBM Software Group – Event Processing Technologies and Architecture $ ( / / . ( + ,J ! $ ,! + + ,$ + Event-Driven Processing in IBM © 2007 IBM Corporation :
  44. 44. IBM Software Group – Event Processing Technologies and Architecture / + , ( + ! , / 6 ) / ; quot; 7) % 2 ; $ ,$ / / Event-Driven Processing in IBM © 2007 IBM Corporation ::
  45. 45. IBM Software Group – Event Processing Technologies and Architecture / ( ( , ( ( + / + + ) 6 ( 6 6 + ;; Event-Driven Processing in IBM © 2007 IBM Corporation :>
  46. 46. IBM Software Group – Event Processing Technologies and Architecture / F F ( + / ;- ( 6 + ( ) C ) 77 ; $ / ,N ! 5 + Nquot;1 / L $ 18( I + + / ; quot; 7) ) / 6 % 2 ;; Event-Driven Processing in IBM © 2007 IBM Corporation :
  47. 47. IBM Software Group – Event Processing Technologies and Architecture / A / B , . / +( A$ B ; / ( ( , + + ; !/ , / 2 + 6 ; Event-Driven Processing in IBM © 2007 IBM Corporation :
  48. 48. IBM Software Group – Event Processing Technologies and Architecture / 9 / $ 9 / ,* / + / / ) / ; $ 9 / ,9 / + / / ,9 / % (+ 0 )7 )) 3 ; Event-Driven Processing in IBM © 2007 IBM Corporation :
  49. 49. IBM Software Group – Event Processing Technologies and Architecture %( ( / J + + 7 ; * +A/ B . 7 ! ) 2 / ! / Event-Driven Processing in IBM © 2007 IBM Corporation / :#
  50. 50. IBM Software Group – Event Processing Technologies and Architecture / - 7) $) ) - Event-Driven Processing in IBM © 2007 IBM Corporation >'
  51. 51. IBM Software Group – Event Processing Technologies and Architecture / ( ) / ! / % ( , 7 0 3$ 1 I / , F 9 quot;$ F 7 ) Event-Driven Processing in IBM © 2007 IBM Corporation >&
  52. 52. IBM Software Group – Event Processing Technologies and Architecture / F / ( / , $ , / % ( + ; , / ( quot; , / ( ( + ; ( $quot; ! . ) + / . ; ;+ / 7 7% ( ( (. + ; Event-Driven Processing in IBM © 2007 IBM Corporation >
  53. 53. IBM Software Group – Event Processing Technologies and Architecture -+ + / / 7, ) / 6 6 + * ? ,4 ) 0 3 ( 7 * , / / / 9 7 , ) ( + 0 9; 3 Event-Driven Processing in IBM © 2007 IBM Corporation >
  54. 54. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation >:
  55. 55. IBM Software Group – Event Processing Technologies and Architecture ! / % 20 ) 3 7( / 7. + ( % (( ( ; 8( ( + ) 2= Event-Driven Processing in IBM © 2007 IBM Corporation >>
  56. 56. IBM Software Group – Event Processing Technologies and Architecture I $ + I $ 7 7+ , ! ! ( ( ! ! ( ( + + 1 7 ( ( F Event-Driven Processing in IBM © 2007 IBM Corporation >
  57. 57. IBM Software Group – Event Processing Technologies and Architecture $ ) 7 $ ) 7 , ) +/ ) + 0C 6 3 ) + ) + 2 !) 7 ( Event-Driven Processing in IBM © 2007 IBM Corporation >
  58. 58. IBM Software Group – Event Processing Technologies and Architecture ! < ( ) . ; ; ( + ( 7( ( ( $ + , ! C ( + ( ! A / B / 6 + ( ( / * % ( ) / , * * / / Event-Driven Processing in IBM © 2007 IBM Corporation >
  59. 59. IBM Software Group – Event Processing Technologies and Architecture Event Processing in a nutshell Event Processing Network – as main abstraction Architectural Principles Producing and consuming the events Processing the events Some Non-Functional Issues Concluding Remarks Event-Driven Processing in IBM © 2007 IBM Corporation >#
  60. 60. IBM Software Group – Event Processing Technologies and Architecture 8( % (/ ( 1 + 9 ) 8(7 = 0A ! B6 ) J 5 3 -( ( 7) ( ; $+% / ( ( 70% @ 3 6 / ( % ) 2 ( C 7 ( 6 ( 7 ( ) + 6 ( 76 ( - 7 / ( + ; 0 7 3 $ 1 , I ) 7 ; 0 7 3 ! , + O -/ 9 / ( 0 6C 7 G 6 7 3 @ Event-Driven Processing in IBM © 2007 IBM Corporation '
  61. 61. IBM Software Group – Event Processing Technologies and Architecture ! +% % ) 1 2 + () ( $ / $. / ( $ 7. ) $ 1 I $ , 7 + - ) 7 1 + Event-Driven Processing in IBM © 2007 IBM Corporation &

×