Support for Human Users in Scientific Workflows            Diploma Thesis            Dimitrios Dentsas Institute of Archit...
Contents              Motivation                     Properties of Scientific Workflows                     Automation ...
Motivation© Dimitrios Dentsas
Motivation              Numerical simulations have become the third pillar of               science              Analyzi...
Motivation – Automation boundaries              Simulation steps cannot be fully automated if:                     The r...
Motivation – Current needs              There is demand for a smooth integration of human users               in SWfMS   ...
Motivation                      [2]© Dimitrios Dentsas         7
Integration of Humans© Dimitrios Dentsas
Basics              Cloud-based integration of applications              Special requirements for integrating human user...
Communication participants© Dimitrios Dentsas        [3]   10
Message structure              We distinguish between two types of communication               parameters:               ...
Message structure              Messages consist of:                     Communication Request Message                  ...
Communication Flows – User Notification                          [3]© Dimitrios Dentsas                           13
Communication Flows – Response Required                                        [3]© Dimitrios Dentsas                     ...
Communication Flows – Response Optional                                         [3]© Dimitrios Dentsas                    ...
SW4H - Message structure              Structure of all input and output XML messages of the               WSDL operations...
SW4H - Message structure              Structure of all input and output XML messages of the               WSDL operations...
SW4H - Message structure              Structure of all input and output XML messages of the               WSDL operations...
SW4H - Message structure              Structure of all input and output XML messages of the               WSDL operations...
SW4H - Message structure              Structure of all input and output XML messages of the WSDL               operations...
Outline                      Solutions© Dimitrios Dentsas
Approach – The communication flow              A multitude of different technical realization possibilities.             ...
Approach – The communication flow              Requirements for EAI-Frameworks:                     Fault tolerance     ...
Approach– Data model              Don‘t reinvent the wheel!              What similar solutions are there for the data m...
Project Bangkok              An embedded Human Task Manager for Java              APIs for client applications         ...
SW4H              Scientific-Workflows-for-Humans (SW4H)              Human Communication Manager              What it ...
SW4H – Abstract Architecture© Dimitrios Dentsas                27
Integration of new services              Using a uniform Service Endpoint Interface (SEI)              Service Integrati...
Human Interaction Activity              Implemented as a process               fragment              Asynchronous commun...
SW4H – Communication Manager© Dimitrios Dentsas                30
Task-loop – A command interpreter        The message body of coupled         devices is analyzed:        #<command>( [-h...
Task-loop – Parsing of XSD documents        XML-Schema for describing tasks is analyzed with a XSD-Parser        A prope...
SW4H – Messaging© Dimitrios Dentsas    33
Implementation of the Communication Flows              EIP-Diagram – The constituents are:© Dimitrios Dentsas            ...
Implementation of the Communication Flows              User Notification: The constituents are :                        ...
Transactional behavior              Local transactions of the messaging layer              Cooperation of the Spring Jms...
Transactional behavior              Persistent Queues act as „Safe Havens“              Reaching atomic behavior between...
SW4H – Presentation Layer© Dimitrios Dentsas             38
SW4H Frontend – Use cases© Dimitrios Dentsas             39
SW4H Frontend – Login window© Dimitrios Dentsas                40
SW4H Frontend – Task window© Dimitrios Dentsas               41
SW4H Frontend – Invitation dialog© Dimitrios Dentsas                     42
SW4H Frontend – Registration invitation© Dimitrios Dentsas                           43
SW4H Frontend – My Devices© Dimitrios Dentsas              44
SW4H Frontend – My Services© Dimitrios Dentsas               45
SW4H Frontend – Registration form© Dimitrios Dentsas                     46
SW4H Frontend – Eclipse integration© Dimitrios Dentsas                       47
Editing a task© Dimitrios Dentsas
Communication Request Message                                     Communication                                      Param...
Demo Run – Contacting the HCM        Using XMPP (Google GTALK)© Dimitrios Dentsas                  50
Demo Run – Editing© Dimitrios Dentsas         51
Demo Run – The resulting response message           The XSD-Parser processes all inputs and produces a            valid X...
Thank you for your attention                          Questions?…              http://code.google.com/p/sw4h-2012/© Dimitr...
List of references       (1)     M.Sonntag,D.Karastoyanova: (2010) Next Generation Interactive Scientific               Ex...
End Of Document© Dimitrios Dentsas
Upcoming SlideShare
Loading in …5
×

Support for Human Users in Scientific Workflows

602 views
541 views

Published on

Development of a (standalone) Human Communication Assistance Manager for Scientific Workflows, otherwise known as the Scientific-Workflows-for-Humans Project (SW4H) for allowing human influence and integration into large scale data-centric scientific workflow management systems (SWfMSs) through pluggable communication devices.

Published in: Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
602
On SlideShare
0
From Embeds
0
Number of Embeds
223
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Support for Human Users in Scientific Workflows

  1. 1. Support for Human Users in Scientific Workflows Diploma Thesis Dimitrios Dentsas Institute of Architecture of Application Systems d.dentsas@googlemail.com
  2. 2. Contents  Motivation  Properties of Scientific Workflows  Automation boundaries  Roles of WS-HT and BPEL4People  Integration of Humans  Basics  Message Structures & Communication Flows  Outline Solutions  Research Design  SW4H – Scientific Workflows for Humans  Abstract Architecture  Using transactions  Message-based Routing  Demo – Editing a task© Dimitrios Dentsas 2
  3. 3. Motivation© Dimitrios Dentsas
  4. 4. Motivation  Numerical simulations have become the third pillar of science  Analyzing and visualizing data-centric simulation results is a highly repetitive process but nevertheless necessary  Automation and orchestration of work units in scientific simulations are needed  Workflow-Management-Systems (WfMS) are an established tool in the business domain for such challenges  Scientific Workflow Management Systems (SWfMS)© Dimitrios Dentsas 4
  5. 5. Motivation – Automation boundaries  Simulation steps cannot be fully automated if:  The requirements for automation are too difficult to meet  The „decision making process“ can only be executed by „cognitive entities“  e.g. Quality assurance of simulation results  Smart allocation of resources  Controlling and manipulating critical parameters  Scenario: Simulation executions over the weekend© Dimitrios Dentsas
  6. 6. Motivation – Current needs  There is demand for a smooth integration of human users in SWfMS  Network-based communication channels are hardly ever used  Efficient management of simulation-related tasks  Web service standards like WS-HumanTask and BPEL4People are used in the business domain.  As specifications they are part of the WS-*  They determine how to integrate human users into business processes  The WS-BPEL language has to be extended© Dimitrios Dentsas 6
  7. 7. Motivation [2]© Dimitrios Dentsas 7
  8. 8. Integration of Humans© Dimitrios Dentsas
  9. 9. Basics  Cloud-based integration of applications  Special requirements for integrating human users have to be considered and managed  Human Communication Flows are introduced in order to reach these objectives  In this paradigm all participants hold one of the following roles:  Communication Initiator  Human Communication Manager  Communication Services  Communication Devices© Dimitrios Dentsas
  10. 10. Communication participants© Dimitrios Dentsas [3] 10
  11. 11. Message structure  We distinguish between two types of communication parameters:  Communication Parameters:  Communication type (Notification, Response required/optional)  List of all message receivers  Communication channels (Skype, Chat, etc.)  Further options (response schema, attachments, default responses)  Communication Message Properties:  subject  body  Importance level  etc.© Dimitrios Dentsas 11
  12. 12. Message structure  Messages consist of:  Communication Request Message  Communication Message  Channel-Specific Message [3]© Dimitrios Dentsas 12
  13. 13. Communication Flows – User Notification [3]© Dimitrios Dentsas 13
  14. 14. Communication Flows – Response Required [3]© Dimitrios Dentsas 14
  15. 15. Communication Flows – Response Optional [3]© Dimitrios Dentsas 15
  16. 16. SW4H - Message structure  Structure of all input and output XML messages of the WSDL operations© Dimitrios Dentsas
  17. 17. SW4H - Message structure  Structure of all input and output XML messages of the WSDL operations© Dimitrios Dentsas
  18. 18. SW4H - Message structure  Structure of all input and output XML messages of the WSDL operations© Dimitrios Dentsas
  19. 19. SW4H - Message structure  Structure of all input and output XML messages of the WSDL operations© Dimitrios Dentsas
  20. 20. SW4H - Message structure  Structure of all input and output XML messages of the WSDL operations© Dimitrios Dentsas
  21. 21. Outline Solutions© Dimitrios Dentsas
  22. 22. Approach – The communication flow  A multitude of different technical realization possibilities. Two very popular ones are: 1. BPEL-Process 2. Message-oriented Middleware (MOM)  EAI through Enterprise Integration Patterns BPEL MOM Pros • uniform modeling • Large open source environment community • Easier integration with process fragments Cons • Tight coupling with • Introduction of new workflows dependencies by using EAI- Frameworks© Dimitrios Dentsas 22
  23. 23. Approach – The communication flow  Requirements for EAI-Frameworks:  Fault tolerance  Guaranteed deliveries  Scalability  Support for popular protocols of the ISO/OSI application layer Apache Camel [4] Apache ActiveMQ [5]© Dimitrios Dentsas
  24. 24. Approach– Data model  Don‘t reinvent the wheel!  What similar solutions are there for the data model?  Project Bangkok (Uni Stuttgart )   Tempo (Intalio)  Apache HISE (Incubator Project)  Project Bangkok and Apache HISE are open source implementations of the WS-Human Task specification.  Tempo implements BPEL4People (REST APIs).© Dimitrios Dentsas
  25. 25. Project Bangkok  An embedded Human Task Manager for Java  APIs for client applications  Support for:  HumanTaskModel vs HumanTaskInstance  People queries (logical people groups, literals)  Task presentation  User management© Dimitrios Dentsas 25
  26. 26. SW4H  Scientific-Workflows-for-Humans (SW4H)  Human Communication Manager  What it is based on:  Project Bangkok  Apache Camel (Routing Engine)  Apache ActiveMQ (Embedded Message Broker)  What it offers:  Web-frontend with a task worklist  Easily integratable into the Eclipse platform  A multitude of integrated Messaging Endpoints  Exchangable Back-End systems for persistency (currently MySQL)© Dimitrios Dentsas 26
  27. 27. SW4H – Abstract Architecture© Dimitrios Dentsas 27
  28. 28. Integration of new services  Using a uniform Service Endpoint Interface (SEI)  Service Integration API© Dimitrios Dentsas 28
  29. 29. Human Interaction Activity  Implemented as a process fragment  Asynchronous communication  One <invoke> activity  One <pick> activity  Conditional constructs with a <if> activity  Invoking the Communication Inititation API (sendMessage, onMessage)© Dimitrios Dentsas 29
  30. 30. SW4H – Communication Manager© Dimitrios Dentsas 30
  31. 31. Task-loop – A command interpreter The message body of coupled devices is analyzed: #<command>( [-h] -p1 foo –p2 bar)  forward  resend  useChannel  stop  fail  claim  start  getUsers  help  release  …© Dimitrios Dentsas 31
  32. 32. Task-loop – Parsing of XSD documents XML-Schema for describing tasks is analyzed with a XSD-Parser A proper subset of the XML-Schema spezification Simple types :  Explicit and anonymous type definitions  Primitive data types:  string, decimal, integer, boolean, date, time  Restrictions and facets:  enumeration, maxinclusive, mininclusive, maxexclusive, length, maxlength, minl ength, pattern, totaldigits Complex types:  Explicit and anonymous type definitions  Recursive complex types  Child elements:  sequence, choice, all  Attributes:  maxoccurs, minoccurs, required, optional© Dimitrios Dentsas 32
  33. 33. SW4H – Messaging© Dimitrios Dentsas 33
  34. 34. Implementation of the Communication Flows  EIP-Diagram – The constituents are:© Dimitrios Dentsas 34
  35. 35. Implementation of the Communication Flows  User Notification: The constituents are :  Message: Header and body  Recipient List: Content-based Routing  Persistent Queues  Endpoints: User-Devices© Dimitrios Dentsas 35
  36. 36. Transactional behavior  Local transactions of the messaging layer  Cooperation of the Spring JmsTransaction Manager with the JMS Broker (ActiveMQ) [6]© Dimitrios Dentsas 36
  37. 37. Transactional behavior  Persistent Queues act as „Safe Havens“  Reaching atomic behavior between queues [7]© Dimitrios Dentsas 37
  38. 38. SW4H – Presentation Layer© Dimitrios Dentsas 38
  39. 39. SW4H Frontend – Use cases© Dimitrios Dentsas 39
  40. 40. SW4H Frontend – Login window© Dimitrios Dentsas 40
  41. 41. SW4H Frontend – Task window© Dimitrios Dentsas 41
  42. 42. SW4H Frontend – Invitation dialog© Dimitrios Dentsas 42
  43. 43. SW4H Frontend – Registration invitation© Dimitrios Dentsas 43
  44. 44. SW4H Frontend – My Devices© Dimitrios Dentsas 44
  45. 45. SW4H Frontend – My Services© Dimitrios Dentsas 45
  46. 46. SW4H Frontend – Registration form© Dimitrios Dentsas 46
  47. 47. SW4H Frontend – Eclipse integration© Dimitrios Dentsas 47
  48. 48. Editing a task© Dimitrios Dentsas
  49. 49. Communication Request Message Communication Parameters XML-Schema of the task static user list© Dimitrios Dentsas 49
  50. 50. Demo Run – Contacting the HCM Using XMPP (Google GTALK)© Dimitrios Dentsas 50
  51. 51. Demo Run – Editing© Dimitrios Dentsas  51
  52. 52. Demo Run – The resulting response message  The XSD-Parser processes all inputs and produces a valid XML document  Callback – The task is finished successfully and sends a response message back to the workflow© Dimitrios Dentsas 52
  53. 53. Thank you for your attention Questions?… http://code.google.com/p/sw4h-2012/© Dimitrios Dentsas 53
  54. 54. List of references (1) M.Sonntag,D.Karastoyanova: (2010) Next Generation Interactive Scientific Experimenting Based On The Workflow Technology. 21st IASTED International Conference on Modelling and Simulation. (2) Schumm, David; Karastoyanova, Dimka: Integrating Humans in Scientific Workflows: Integrate, Register & Communicate. In: The 4th SimTech Status Seminar, 2011 (3) Schumm, David; Fehling, Christoph; Karastoyanova, Dimka; Leymann, Frank; Rütschlin, Jochen: Processes for Human Integration in Automated Cloud Application Management, Universität Stuttgart, Technischer Bericht Nr. 2012/02, 2012. (4) http://camel.apache.org/ (5) http://activemq.apache.org/ (6) Ian J. Taylor, Ewa Deelman, Dennis B. Gannon, and Matthew Shields. 2006. Workflows for E-Science: Scientific Workflows for Grids. Springer- Verlag New York, Inc., Secaucus, NJ, USA.© Dimitrios Dentsas 54
  55. 55. End Of Document© Dimitrios Dentsas

×