This document discusses data integration techniques like cleansing, transformation, and master data management. It also discusses business processes and how they can be managed in different phases. Business process management suites focus on building platforms to support the full business process lifecycle. The document then discusses how data integration can be combined with business process workflow technology by implementing data integration scenarios using a sequence of data services and workflow. It provides an overview of the WSO2 Business Process Server and Data Services Server and how they can be used together in a reference architecture for data integration.

1. Data Integration and
Business Processes
Anjana Fernando
Senior Technical Lead

2. Agenda
● Data Integration Techniques
● Business Process Management
● Data Integration meets Business Processes
● WSO2 BPS / DSS Product Overview
● WSO2 Data Integration Reference Architecture

3. Data Integration - What is it?
● Cleansing
● Transformation
● MDM
● Profiling
Combining data from various heterogeneous data sources to
create a unified view, with the following operations:-

4. Data Integration - Cleansing

5. Data Integration - Transformation

6. Data Integration - Master Data
Management (MDM)

7. Data Integration - Profiling

8. Business Processes
Collection of related tasks to achieve a
business goal
Any organization has processes:
● Sales order handling process
● Inquiry handling process
● Materials procurement process
● Recruitment process
● Travel application process
● Subcontracting process
Review
procurement
request
Select suppliers
Get quotations
Assess
suppliers
Submit purchase
order
Update inventory

9. Business Process Management
Processes are key assets of an organization
that can be managed in multiple phases

10. BPM Suite
Focuses on building a BPM platform to
support complete BPM lifecycle
Process
center
Business
Process server
(BPS)
Business Rules
server (BRS)
Process
center
DAS / CEP
Process center
BPS
CEP / DAS / ML
Process
center

11. Data Integration with Business
Process Workflow Technology
● Data Integration requires a repeatable sequence of
actions -> Business Process Workflow
● Combination of CRUD Data Services with a
Workflow technology provides a toolkit to
implement Data Integration scenarios

12. WSO2 Business Process Server
● Executes business processes written using WS-BPEL
2.0/BPEL4WS 1.1
○ Long running stateful processes
○ Short running stateless or stateful processes
○ In memory process execution for short running
processes
● Powered by Apache ODE
● Support WS-Human Tasks 1.1 and BPEL4People 1.1.
● Support for BPMN 2.0 (>=WSO2 BPS v3.5.0)

13. WSO2 Data Services Server
● Data Virtualization with simultaneous connection to
multiple data sources
● Services exposed via SOAP or a RESTful interface
● High performance streaming, batching and
transactional execution support
● Declarative language for rapid data service creation

14. Data Service Description Language
● WSO2's declarative language for defining data services
● Maps service requests to queries operating on data
store
● Maps query result sets to XML / JSON responses
● Transactions, Validators, Eventing configurations etc..
● Available online @
https://docs.wso2.org/display/DSS322/User+Guide

15. Multiple Data Sources /
Nested Queries

16. Custom Data Sources
● Custom Tabular Data Sources
● Custom Query Data Sources

17. Server-side Batch Processing
(Boxcarring)

18. Client-side Batch Processing

19. REST Support

20. Federation

21. WSO2 Data Integration Reference
Architecture

22. WSO2 Data Integration Reference
Architecture
● Long running or short lived complex logic can be
defined in Business Process Server
● CRUD data operations delegated to the data services
layer
● User interaction to be defined with HumanTasks,
e.g. data cleansing operations which needs user
input
● External systems can be accessed using extensive
connector support in WSO2 ESB
● Data integration process monitoring/profiling
facilitated with the WSO2 Data Analytics Server

23. Questions?

24. Thank You