SlideShare a Scribd company logo
Next-Generation BPM –
How to create intelligent Business Processes
thanks to Big Data
Talend,	
  Global	
  Leader	
  in	
  Open	
  Source	
  Integra7on	
  Solu7ons	
  
Kai Wähner
kwaehner@talend.com
@KaiWaehner
Xing / LinkedIn
www.kai-waehner.de
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Consulting
Developing
Coaching
Speaking
Writing
Main Tasks
Requirements Engineering
Enterprise Architecture Management
Business Process Management
Architecture and Development of Applications
Service-oriented Architecture
Integration of Legacy Applications
Cloud Computing
Big Data
Contact
Email: kontakt@kai-waehner.de
Blog: www.kai-waehner.de/blog
Twitter: @KaiWaehner
Social Networks: Xing, LinkedIn
Kai Wähner
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Key messages
BPM should be used (just) for optimizing business processes!
Intelligent business processes need big data and integration!
Big data will reduce human interactions in BPM further!
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
William	
  Edwards	
  Deming	
  	
  
(1900	
  –1993)	
  	
  
American	
  sta7s7cian,	
  professor,	
  	
  
author,	
  lecturer	
  and	
  consultant	
  
“If	
  you	
  can't	
  measure	
  it,	
  	
  
you	
  can't	
  manage	
  it.”	
  
Why should you care about big data?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
è  „Silence	
  the	
  HiPPOs“	
  (highest-­‐paid	
  person‘s	
  opinion)	
  
è  Being	
  able	
  to	
  interpret	
  unimaginable	
  large	
  data	
  
stream,	
  the	
  gut	
  feeling	
  is	
  no	
  longer	
  jus7fied!	
  
	
  
Why should you care about big data?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Why should you care about big data?
“Accessing	
  data	
  is	
  now	
  [again]	
  the	
  cri7cal	
  path	
  in	
  making	
  good	
  decisions!”	
  
h`p://www.inforbix.com/friday-­‐data-­‐stories-­‐big-­‐data-­‐driven-­‐decision-­‐making/	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Why does big data exist?
Changing Interactions
Changing Scale
Changing Expectations
Cloud
Sensors
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
The Vs of big data
Volume	
  	
  
(terabytes,	
  
petabytes)	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
	
  
Variety	
  	
  
(social	
  networks,	
  
blog	
  posts,	
  logs,	
  
sensors,	
  etc.)	
  
	
  	
  	
  	
  	
  Velocity	
  	
  
	
  	
  	
  	
  	
  	
  (real7me	
  or	
  near-­‐
real7me)	
  
	
  
	
  
	
  
	
  
Value	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Big	
  Data	
  Integra3on	
  
–  Land	
  data	
  in	
  a	
  Big	
  Data	
  cluster	
  
–  Implement	
  or	
  generate	
  parallel	
  processes	
  
	
  
	
  Big	
  Data	
  Manipula3on	
  
–  Simplify	
  manipula7on,	
  such	
  as	
  sort	
  and	
  filter	
  
–  Computa7onal	
  expensive	
  func7ons	
  
	
  
Big	
  Data	
  Quality	
  &	
  Governance	
  
–  Iden7fy	
  linkages	
  and	
  duplicates,	
  validate	
  big	
  data	
  
–  Match	
  component,	
  execute	
  basic	
  quality	
  features	
  
	
  
Big	
  Data	
  Project	
  Management	
  
–  Place	
  frameworks	
  around	
  big	
  data	
  projects	
  
–  Common	
  Repository,	
  scheduling,	
  monitoring	
  	
  
Big data tasks to solve - before analysis
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
h`p://www.slideshare.net/brocknoland/common-­‐and-­‐unique-­‐use-­‐cases-­‐for-­‐apache-­‐hadoop	
  
Replacing ETL jobs: Binary files
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
h`p://hkotadia.com/archives/5021	
  
Deduce	
  
Customer	
  	
  
Defec7ons	
  
Forecast: Risk management
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  With	
  revenue	
  of	
  almost	
  USD	
  30	
  billion	
  and	
  a	
  network	
  of	
  
800	
  loca7ons,	
  Macy's	
  is	
  considered	
  the	
  largest	
  store	
  operator	
  in	
  the	
  
USA	
  
➜  Daily	
  price	
  check	
  analysis	
  of	
  its	
  10,000	
  ar7cles	
  in	
  less	
  than	
  two	
  hours	
  
➜  Whenever	
  a	
  neighboring	
  compe7tor	
  anywhere	
  between	
  New	
  York	
  
and	
  Los	
  Angeles	
  goes	
  for	
  aggressive	
  price	
  reduc7ons,	
  Macy's	
  follows	
  
its	
  example	
  
➜  If	
  there	
  is	
  no	
  market	
  compe7tor,	
  the	
  prices	
  remain	
  unchanged	
  
h`p://www.t-­‐systems.com/about-­‐t-­‐systems/examples-­‐of-­‐successes-­‐companies-­‐analyze-­‐big-­‐data-­‐in-­‐record-­‐7me-­‐l-­‐t-­‐systems/1029702	
  
Logistics: Flexible pricing
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Content	
  manipula7on	
  	
  
at	
  a	
  traveling	
  portal	
  –	
  	
  
Which	
  customer	
  reviews	
  	
  
are	
  trustworthy?	
  
	
  
	
  
	
  
Jean-­‐Paul	
  Schmetz,	
  Harvard	
  Business	
  Manager,	
  November	
  2012	
  
Fraud detection: Fraud mining
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  A	
  lot	
  of	
  data	
  must	
  be	
  stored	
  „forever“	
  
➜  Numbers	
  increase	
  exponen7ally	
  
➜  Goal:	
  As	
  cheap	
  as	
  possible	
  
➜  Problem:	
  (Fast)	
  queries	
  must	
  s7ll	
  be	
  possible	
  
➜  Solu7on:	
  Commodity	
  servers	
  and	
  „Hadoop	
  querying“	
  
Global	
  Parcel	
  Service	
  
h`p://archive.org/stream/BigDataImPraxiseinsatz-­‐SzenarienBeispieleEffekte/Big_Data_BITKOM-­‐Leisaden_Sept.2012#page/n0/mode/2up	
  
Storage: Compliance
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  How	
  do	
  you	
  put	
  this	
  big	
  data	
  easily	
  in	
  the	
  hands	
  of	
  the	
  people	
  that	
  
need	
  it?	
  
➜  Making	
  the	
  data	
  “ac7onable”	
  is	
  the	
  real	
  challenge.	
  	
  
➜  Seeing	
  the	
  informa7on	
  that	
  helps	
  make	
  a	
  decision	
  on	
  a	
  composite	
  
dashboard	
  is	
  just	
  the	
  first	
  step	
  and	
  where	
  too	
  many	
  companies	
  stop.	
  	
  
➜  A	
  business	
  must	
  be	
  able	
  to	
  fire	
  off	
  the	
  business	
  process	
  to	
  execute	
  the	
  
decision	
  made	
  regarding	
  the	
  data.	
  
Great big data use cases, but ...
Kai Wähner
h`p://smartdatacollec7ve.com/ma`-­‐davies/104576/data-­‐driven-­‐bpm-­‐making-­‐big-­‐data-­‐ac7onable	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  Humans	
  have	
  to	
  interpret	
  large	
  data	
  to	
  make	
  decision.	
  
Using	
  gut	
  feeling	
  is	
  nothing	
  but	
  gambling.	
  
➜  Just	
  doing	
  big	
  data	
  analy7cs	
  is	
  not	
  enough.	
  Systema7c	
  
and	
  monitored	
  human	
  interac7ons	
  are	
  as	
  important	
  to	
  
get	
  best	
  outcomes.	
  
➜  An	
  intelligent	
  business	
  process	
  	
  
	
  	
  	
  	
  combines	
  big	
  data	
  and	
  BPM.	
  This	
  	
  
	
  	
  	
  	
  enables	
  humans	
  to	
  make	
  data-­‐driven	
  	
  
	
  	
  	
  	
  decisions	
  based	
  on	
  big	
  data	
  analy7cs.	
  
Intelligent business processes
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  Process	
  starts	
  ac7on	
  (Big	
  Data	
  PULL)	
  
•  Manual	
  or	
  automated	
  
•  Faster	
  responses	
  (e.g.	
  „catching	
  Osama“)	
  
•  Be`er	
  outcomes	
  (e.g.	
  „recommenda7on	
  engine“)	
  
	
  
➜  Data	
  starts	
  ac7on	
  (Big	
  Data	
  PUSH)	
  
•  (Usually)	
  automated	
  
•  Predic7ve	
  processes	
  (e.g.	
  „preven7ng	
  flu	
  epidemic“)	
  
•  Handle	
  before	
  it	
  happens	
  (e.g.	
  „customer	
  deduc7on“)	
  
Intelligent business processes
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
➜  How	
  are	
  they	
  related?	
  
➜  How	
  to	
  combine?	
  
➜  How	
  to	
  realize	
  this	
  technically?	
  	
  
	
  
Combination of big data and BPM
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
increase efficiency
better quality
reduce costs
increase flexibility
enable new business models
Why BPM?
Kai Wähner
Business-IT-Alignment
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
•  long-running stateful workflows
•  frequently changing processes
•  human interaction
When BPM?
Kai Wähner
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
How BPM?
Kai Wähner
Script Task Service Task
Groovy
JavaScript
etc.
SOAP Web Service
Everything
from Cobol
to Ruby...
... or a
„big data
service“
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Challenge
Kai Wähner
Separation of Concerns	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Separation of Concerns
Kai Wähner
Integration
• ETL
• Connectivity / adaptors to connect to external
systems using a variety of different protocols 
• Predefined EIP for message routing
Big Data
• Processing
• Analytics
BPM
• Do queries to make decisions
• Human or machine
C	
  
R	
  
E	
  
A	
  
T	
  
E	
  
U	
  
S	
  
E	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
   Kai Wähner
Integration
• ETL
• Connectivity / adaptors to connect to external
systems using a variety of different protocols 
• Predefined EIP for message routing
Big Data
• Processing
• Analytics
BPM
• Do queries to make decisions
• Human or machine
Technical / product perspective
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Enterprise Integration Patterns
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Enterprise Integration Patterns
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
AmazonS3	
  s3	
  =	
  new	
  AmazonS3Client(new	
  Proper7esCreden7als(	
  
	
  	
  	
  	
  	
  	
  	
  	
  S3Sample.class.getResourceAsStream("AwsCreden7als.proper7es")));	
  
	
  
String	
  bucketName	
  =	
  "my-­‐first-­‐s3-­‐bucket-­‐"	
  +	
  UUID.randomUUID();	
  
String	
  key	
  =	
  "MyObjectKey";	
  
	
  
try	
  {	
  
	
  	
  	
  	
  	
  
	
  	
  	
  	
  s3.createBucket(bucketName);	
  
	
  	
  	
  	
  s3.putObject(new	
  PutObjectRequest(bucketName,	
  key,	
  createSampleFile()));	
  
	
  
	
  	
  	
  	
  S3Object	
  object	
  =	
  s3.getObject(new	
  GetObjectRequest(bucketName,	
  key));	
  
	
  	
  	
  	
  	
  
	
  	
  	
  	
  ObjectLis7ng	
  objectLis7ng	
  =	
  s3.listObjects(new	
  ListObjectsRequest()	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  .withBucketName(bucketName)	
  
	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  	
  .withPrefix("My"));	
  
	
  	
  	
  	
  	
  
	
  	
  	
  	
  s3.deleteObject(bucketName,	
  key);	
  	
  	
  
	
  	
  	
  	
  s3.deleteBucket(bucketName);	
  
	
  
}	
  catch	
  (AmazonServiceExcep7on	
  ase)	
  {	
  
	
  	
  	
  //	
  error	
  handling...	
  
}	
  catch	
  (AmazonClientExcep7on	
  ace)	
  {	
  
	
  	
  	
  //	
  error	
  handling...	
  	
  	
  	
  
}	
  
Integration framework
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
// Producer
from(“ftp:toS3")
.setHeader(S3Constants.KEY, simple(“order.txt"))
.to("aws-s3://myBucket?accessKey=" + a+ "&secretKey= " + s)
// Consumer
from(„salesforce://orders__c?user=dummy1“)
.filter(„customer == ${dummyCustomer})
.to(“ibm-database:orderData")
Integration framework (e.g. Apache Camel)
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Enterprise Service Bus (e.g. Talend ESB)
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Connectivity
Routing
Transformation
Complexity
of Integration
Enterprise	
  
Service	
  Bus	
  
Integra7on	
  Suite	
  
Low High
Integration
Framework
INTEGRATION
Tooling
Monitoring
Support+
BUSINESS PROCESS MGT.
BIG DATA / MDM
REGISTRY / REPOSITORY
RULES ENGINE
„YOU NAME IT“
Alternatives for integration
+
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
   Kai Wähner
Integration
• ETL
• Connectivity / adaptors to connect to external
systems using a variety of different protocols 
• Predefined EIP for message routing
Big Data
• Processing
• Analytics
BPM
• Do queries to make decisions
• Human or machine
Technical / product perspective
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Technology perspective
How	
  to	
  process	
  big	
  data?	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Slides:	
  h`p://www.slideshare.net/pavlobaron/100-­‐big-­‐data-­‐0-­‐hadoop-­‐0-­‐java	
  
	
  
Video:	
  h`p://www.infoq.com/presenta7ons/Big-­‐Data-­‐Hadoop-­‐Java	
  
How to process big data?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
The	
  defacto	
  standard	
  for	
  big	
  data	
  processing	
  
How to process big data?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Even	
  MicrosoL	
  (the	
  .NET	
  house)	
  relies	
  on	
  Hadoop	
  since	
  2011	
  
How to process big data?
“A	
  big	
  part	
  of	
  [the	
  
company’s	
  strategy]	
  
includes	
  wiring	
  SQL	
  Server	
  
2012	
  (formerly	
  known	
  by	
  
the	
  codename	
  “Denali”)	
  to	
  
the	
  Hadoop	
  distributed	
  
compu7ng	
  plasorm,	
  and	
  
bringing	
  Hadoop	
  to	
  
Windows	
  Server	
  and	
  Azure”	
  
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Apache	
  Hadoop,	
  an	
  open-­‐source	
  soLware	
  library,	
  is	
  a	
  
framework	
  that	
  allows	
  for	
  the	
  distributed	
  processing	
  of	
  
large	
  data	
  sets	
  across	
  clusters	
  of	
  commodity	
  hardware	
  
using	
  simple	
  programming	
  models.	
  It	
  is	
  designed	
  to	
  scale	
  
up	
  from	
  single	
  servers	
  to	
  thousands	
  of	
  machines,	
  each	
  
offering	
  local	
  computa7on	
  and	
  storage.	
  	
  
	
  
What is Hadoop?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
How to process big data?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
MapReduce
HDFS
Ecosystem
Features
included
Hadoop	
  
Distribu7on	
  
Integra7on	
  Suite	
  
few many
Apache
Hadoop
Packaging
Deployment-Tooling
Support
+
Tooling / Modeling
Code Generation
Scheduling
Other Tools (ESB, BPM, ...)
+
Hadoop alternatives
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
   Kai Wähner
Integration
• ETL
• Connectivity / adaptors to connect to external
systems using a variety of different protocols 
• Predefined EIP for message routing
Big Data
• Processing
• Analytics
BPM
• Do queries to make decisions
• Human or machine
Technical / product perspective
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Standards
Kai Wähner
BPM
BPEL BPMN
XPDL
WF-XML
BPEL4People
jPDL
ARIS EPC
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
BPMN
Kai Wähner
„Business Process Model and Notation (BPMN) is a graphical
representation for specifying business processes in a business process
model.“
Wikipedia
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• BPMN is a standard notation for designing business processes
(versus: UML is a standard modeling language best suited for designing and
implementing software)
• not just flow charts! sufficient restrictions / constraints => executable!
• standardized XML format
• orchestration and choreography
• extension points => add specific needs without breaking interoperability
• optional mapping of a BPMN subset to BPEL
(restricted to block-structured flows without cycles)
BPMN 2.0
Kai Wähner
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Alternatives for BPM (technology perspective)
Kai Wähner
Complexity of
Orchestration
Low High
BPM	
  
Framework	
  
BPM	
  Suite	
  
Integra7on	
  Suite	
  
Coding
Service Tasks
Human Interaction
GUI
BPM
Tooling
Monitoring
Support
+
ESB
BIG DATA / MDM
REGISTRY / REPOSITORY
RULES ENGINE
„YOU NAME IT“
+
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
   Kai Wähner
Integration
• ETL
• Connectivity / adaptors to connect to external
systems using a variety of different protocols 
• Predefined EIP for message routing
Big Data
• Processing
• Analytics
BPM
• Do queries to make decisions
• Human or machine
Let‘s	
  	
  
realize	
  	
  
it	
  !!!	
  
Technical / product perspective
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Alternatives for creating intelligent BPs
Kai Wähner
Complexity of
Orchestration
Low High
Frameworks	
  
Specific	
  Tools	
  
Suite	
  of	
  Tools	
  
e.g.
Talend Unified Platform
i.e ALL-IN-ONE
(Integration, Big Data, BPM)
e.g.
Camel (Integration)
Hadoop (Big Data)
Activiti (BPM)
e.g.
Mule ESB (Integration)
MapR (Big Data)
Camunda (BPM)
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Custom combination of integration, big data and BPM?
Kai Wähner
•  A lot of glue code
•  Testing
•  Bugfixing
•  No support
Some other people already had
the problems you would have!
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
• Big	
  data	
  paradigm	
  shiL	
  	
  
• Use	
  cases	
  for	
  big	
  data	
  
• Intelligent	
  business	
  processes	
  
• Technology	
  and	
  product	
  perspec7ve	
  
• Live	
  demo	
  
Agenda
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Live demo
Complexity of
Orchestration
Low High
Frameworks	
  
Specific	
  Tools	
  
Suite	
  of	
  Tools	
  
e.g.
Talend Unified Platform
i.e ALL-IN-ONE
(Integration, Big Data, BPM)
e.g.
Camel (Integration)
Hadoop (Big Data)
Activiti (BPM)
e.g.
Mule ESB (Integration)
MapR (Big Data)
Camunda (BPM)
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Data
Quality
Data
Integration MDM ESB
Big
Data
Big Data
¾  Open	
  source	
  license	
  
¾  Free	
  of	
  charge	
  
¾  OpDonal	
  support	
  
¾  Based	
  on	
  open	
  source	
  
projects	
  such	
  as	
  Eclipse	
  
or	
  Apache	
  Camel,	
  CXF,	
  
Hadoop	
  
¾  Commercial	
  license	
  
¾  SubscripDon	
  model	
  
¾  Support	
  included	
  
Data
Quality
Data
Integration MDM ESB BPM
Talend Unified Platform
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
„Talend	
  Integra7on	
  Suite“	
  in	
  ac7on...	
  
Live demo
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Example (Talend): Integration
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Example (Talend): Big Data Processing
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Example (Talend): Business Process
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Example (Talend): Big Data Web Service
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Did you get the key message?
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Key messages
BPM should be used (just) for optimizing business processes!
Intelligent business processes need big data and integration!
Big data will reduce human interactions in BPM further!
©	
  Talend	
  2013	
   	
   	
   	
  “How	
  to	
  create	
  intelligent	
  Business	
  Processes	
  thanks	
  to	
  Big	
  Data”	
  by	
  Kai	
  Wähner	
  
	
  
Did you get the key message?
Thank you for your attention.
Questions?
KAI WÄHNER
kwaehner@talend.com
www.kai-waehner.de
LinkedIn / Xing
@KaiWaehner

More Related Content

What's hot

Webinar: Attaining Excellence in Big Data Integration
Webinar: Attaining Excellence in Big Data IntegrationWebinar: Attaining Excellence in Big Data Integration
Webinar: Attaining Excellence in Big Data Integration
SnapLogic
 
Best Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyBest Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse Quickly
WhereScape
 
Cloud Digital Transformation
Cloud Digital TransformationCloud Digital Transformation
Cloud Digital Transformation
Raul Goycoolea Seoane
 
Business Data Lake Best Practices
Business Data Lake Best PracticesBusiness Data Lake Best Practices
Business Data Lake Best Practices
Capgemini
 
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
SnapLogic
 
Webinar: The Death of Traditional Data Integration
Webinar: The Death of Traditional Data IntegrationWebinar: The Death of Traditional Data Integration
Webinar: The Death of Traditional Data Integration
SnapLogic
 
Operationalizing Data Analytics
Operationalizing Data AnalyticsOperationalizing Data Analytics
Operationalizing Data Analytics
VMware Tanzu
 
[Infographic] Cloud Integration Drivers and Requirements in 2015
[Infographic] Cloud Integration Drivers and Requirements in 2015[Infographic] Cloud Integration Drivers and Requirements in 2015
[Infographic] Cloud Integration Drivers and Requirements in 2015
SnapLogic
 
Driving Real Insights Through Data Science
Driving Real Insights Through Data ScienceDriving Real Insights Through Data Science
Driving Real Insights Through Data Science
VMware Tanzu
 
What is A Cloud Stack in 2017
What is A Cloud Stack in 2017What is A Cloud Stack in 2017
What is A Cloud Stack in 2017
Gaurav Roy
 
The SnapLogic Integration Cloud for ServiceNow
The SnapLogic Integration Cloud for ServiceNowThe SnapLogic Integration Cloud for ServiceNow
The SnapLogic Integration Cloud for ServiceNow
SnapLogic
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
Cloudera, Inc.
 
5 Pillars of API Management
5 Pillars of API Management5 Pillars of API Management
5 Pillars of API Management
Rich Graham
 
Deliver World Class Customer Experience with Big Data and Analytics
Deliver World Class Customer Experience with Big Data and AnalyticsDeliver World Class Customer Experience with Big Data and Analytics
Deliver World Class Customer Experience with Big Data and Analytics
Raul Goycoolea Seoane
 
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
Impetus Technologies
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Raul Goycoolea Seoane
 
Understand the What, Why & How of Digital Transformation Featuring 451 Research
Understand the What, Why & How of Digital Transformation Featuring 451 ResearchUnderstand the What, Why & How of Digital Transformation Featuring 451 Research
Understand the What, Why & How of Digital Transformation Featuring 451 Research
VMware Tanzu
 
A modern, flexible approach to Hadoop implementation incorporating innovation...
A modern, flexible approach to Hadoop implementation incorporating innovation...A modern, flexible approach to Hadoop implementation incorporating innovation...
A modern, flexible approach to Hadoop implementation incorporating innovation...
DataWorks Summit
 
Client approaches to successfully navigate through the big data storm
Client approaches to successfully navigate through the big data stormClient approaches to successfully navigate through the big data storm
Client approaches to successfully navigate through the big data storm
IBM Analytics
 
Traditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonTraditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A Comparison
Capgemini
 

What's hot (20)

Webinar: Attaining Excellence in Big Data Integration
Webinar: Attaining Excellence in Big Data IntegrationWebinar: Attaining Excellence in Big Data Integration
Webinar: Attaining Excellence in Big Data Integration
 
Best Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse QuicklyBest Practices for Building a Warehouse Quickly
Best Practices for Building a Warehouse Quickly
 
Cloud Digital Transformation
Cloud Digital TransformationCloud Digital Transformation
Cloud Digital Transformation
 
Business Data Lake Best Practices
Business Data Lake Best PracticesBusiness Data Lake Best Practices
Business Data Lake Best Practices
 
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
Webinar: It's the 21st Century - Why Isn't Your Data Integration Loosely Coup...
 
Webinar: The Death of Traditional Data Integration
Webinar: The Death of Traditional Data IntegrationWebinar: The Death of Traditional Data Integration
Webinar: The Death of Traditional Data Integration
 
Operationalizing Data Analytics
Operationalizing Data AnalyticsOperationalizing Data Analytics
Operationalizing Data Analytics
 
[Infographic] Cloud Integration Drivers and Requirements in 2015
[Infographic] Cloud Integration Drivers and Requirements in 2015[Infographic] Cloud Integration Drivers and Requirements in 2015
[Infographic] Cloud Integration Drivers and Requirements in 2015
 
Driving Real Insights Through Data Science
Driving Real Insights Through Data ScienceDriving Real Insights Through Data Science
Driving Real Insights Through Data Science
 
What is A Cloud Stack in 2017
What is A Cloud Stack in 2017What is A Cloud Stack in 2017
What is A Cloud Stack in 2017
 
The SnapLogic Integration Cloud for ServiceNow
The SnapLogic Integration Cloud for ServiceNowThe SnapLogic Integration Cloud for ServiceNow
The SnapLogic Integration Cloud for ServiceNow
 
Optimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analyticsOptimize your cloud strategy for machine learning and analytics
Optimize your cloud strategy for machine learning and analytics
 
5 Pillars of API Management
5 Pillars of API Management5 Pillars of API Management
5 Pillars of API Management
 
Deliver World Class Customer Experience with Big Data and Analytics
Deliver World Class Customer Experience with Big Data and AnalyticsDeliver World Class Customer Experience with Big Data and Analytics
Deliver World Class Customer Experience with Big Data and Analytics
 
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
Big Data Use Cases for Different Verticals and Adoption Patterns - Impetus We...
 
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias CloudTransformacion del Negocio Financiero por medio de Tecnologias Cloud
Transformacion del Negocio Financiero por medio de Tecnologias Cloud
 
Understand the What, Why & How of Digital Transformation Featuring 451 Research
Understand the What, Why & How of Digital Transformation Featuring 451 ResearchUnderstand the What, Why & How of Digital Transformation Featuring 451 Research
Understand the What, Why & How of Digital Transformation Featuring 451 Research
 
A modern, flexible approach to Hadoop implementation incorporating innovation...
A modern, flexible approach to Hadoop implementation incorporating innovation...A modern, flexible approach to Hadoop implementation incorporating innovation...
A modern, flexible approach to Hadoop implementation incorporating innovation...
 
Client approaches to successfully navigate through the big data storm
Client approaches to successfully navigate through the big data stormClient approaches to successfully navigate through the big data storm
Client approaches to successfully navigate through the big data storm
 
Traditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A ComparisonTraditional BI vs. Business Data Lake – A Comparison
Traditional BI vs. Business Data Lake – A Comparison
 

Viewers also liked

Talend Big Data Capabilities Overview
Talend Big Data Capabilities OverviewTalend Big Data Capabilities Overview
Talend Big Data Capabilities Overview
Rajan Kanitkar
 
ETL using Big Data Talend
ETL using Big Data Talend  ETL using Big Data Talend
ETL using Big Data Talend
Edureka!
 
Evaluating Software Architectures
Evaluating Software ArchitecturesEvaluating Software Architectures
Evaluating Software Architectures
jew Kevin
 
Talend AS A Product
Talend AS A ProductTalend AS A Product
Talend AS A Product
Abdul Manaf
 
Sybase To Oracle Migration for DBAs
Sybase To Oracle Migration for DBAsSybase To Oracle Migration for DBAs
Sybase To Oracle Migration for DBAs
Clearwater Technical Group Inc
 
Application retirement road_map_for_legacy_applications
Application retirement road_map_for_legacy_applicationsApplication retirement road_map_for_legacy_applications
Application retirement road_map_for_legacy_applications
Frank Morris
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
SlideCentral
 
Simplifying Big Data ETL with Talend
Simplifying Big Data ETL with TalendSimplifying Big Data ETL with Talend
Simplifying Big Data ETL with Talend
Edureka!
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSI
Remain Software
 
Simplify the complexity of your business processes
Simplify the complexity of your business processesSimplify the complexity of your business processes
Simplify the complexity of your business processes
Kris Verlaenen
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Caserta
 
Morning at Lohika
Morning at LohikaMorning at Lohika
Morning at Lohika
Taras Matyashovsky
 
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Gabriele Baldassarre
 
Intro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data IntegrationIntro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data Integration
Philip Yurchuk
 
jBPM v7 Roadmap
jBPM v7 RoadmapjBPM v7 Roadmap
jBPM v7 Roadmap
Kris Verlaenen
 
Real-Time Big Data at In-Memory Speed, Using Storm
Real-Time Big Data at In-Memory Speed, Using StormReal-Time Big Data at In-Memory Speed, Using Storm
Real-Time Big Data at In-Memory Speed, Using Storm
Nati Shalom
 
Security of DNS
Security of DNSSecurity of DNS
Security of DNS
Philippe Camacho, Ph.D.
 
Process-driven applications: let BPM do (some of) your work
Process-driven applications: let BPM do (some of) your workProcess-driven applications: let BPM do (some of) your work
Process-driven applications: let BPM do (some of) your work
Kris Verlaenen
 
Data migration
Data migrationData migration
Data migration
Vatsala Chauhan
 
Deep Dive on Amazon Redshift
Deep Dive on Amazon RedshiftDeep Dive on Amazon Redshift
Deep Dive on Amazon Redshift
Amazon Web Services
 

Viewers also liked (20)

Talend Big Data Capabilities Overview
Talend Big Data Capabilities OverviewTalend Big Data Capabilities Overview
Talend Big Data Capabilities Overview
 
ETL using Big Data Talend
ETL using Big Data Talend  ETL using Big Data Talend
ETL using Big Data Talend
 
Evaluating Software Architectures
Evaluating Software ArchitecturesEvaluating Software Architectures
Evaluating Software Architectures
 
Talend AS A Product
Talend AS A ProductTalend AS A Product
Talend AS A Product
 
Sybase To Oracle Migration for DBAs
Sybase To Oracle Migration for DBAsSybase To Oracle Migration for DBAs
Sybase To Oracle Migration for DBAs
 
Application retirement road_map_for_legacy_applications
Application retirement road_map_for_legacy_applicationsApplication retirement road_map_for_legacy_applications
Application retirement road_map_for_legacy_applications
 
Big data ecosystem
Big data ecosystemBig data ecosystem
Big data ecosystem
 
Simplifying Big Data ETL with Talend
Simplifying Big Data ETL with TalendSimplifying Big Data ETL with Talend
Simplifying Big Data ETL with Talend
 
Talend Introduction by TSI
Talend Introduction by TSITalend Introduction by TSI
Talend Introduction by TSI
 
Simplify the complexity of your business processes
Simplify the complexity of your business processesSimplify the complexity of your business processes
Simplify the complexity of your business processes
 
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & TalendIntroducing the Big Data Ecosystem with Caserta Concepts & Talend
Introducing the Big Data Ecosystem with Caserta Concepts & Talend
 
Morning at Lohika
Morning at LohikaMorning at Lohika
Morning at Lohika
 
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
Talend Open Studio Fundamentals #1: Workspaces, Jobs, Metadata and Trips & Tr...
 
Intro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data IntegrationIntro to Talend Open Studio for Data Integration
Intro to Talend Open Studio for Data Integration
 
jBPM v7 Roadmap
jBPM v7 RoadmapjBPM v7 Roadmap
jBPM v7 Roadmap
 
Real-Time Big Data at In-Memory Speed, Using Storm
Real-Time Big Data at In-Memory Speed, Using StormReal-Time Big Data at In-Memory Speed, Using Storm
Real-Time Big Data at In-Memory Speed, Using Storm
 
Security of DNS
Security of DNSSecurity of DNS
Security of DNS
 
Process-driven applications: let BPM do (some of) your work
Process-driven applications: let BPM do (some of) your workProcess-driven applications: let BPM do (some of) your work
Process-driven applications: let BPM do (some of) your work
 
Data migration
Data migrationData migration
Data migration
 
Deep Dive on Amazon Redshift
Deep Dive on Amazon RedshiftDeep Dive on Amazon Redshift
Deep Dive on Amazon Redshift
 

Similar to How to create intelligent Business Processes thanks to Big Data (BPM, Apache Hadoop, Talend, Open Source)

"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
Kai Wähner
 
Why Everything You Know About bigdata Is A Lie
Why Everything You Know About bigdata Is A LieWhy Everything You Know About bigdata Is A Lie
Why Everything You Know About bigdata Is A Lie
Sunil Ranka
 
The value of our data
The value of our dataThe value of our data
The value of our data
EnterpriseGRC Solutions, Inc.
 
Transforming Big Data into business value
Transforming Big Data into business valueTransforming Big Data into business value
Transforming Big Data into business value
The Marketing Distillery
 
Why Big Data is Really about Small Data
Why Big Data is Really about Small DataWhy Big Data is Really about Small Data
Why Big Data is Really about Small Data
Hurwitz & Associates
 
Taming Big Data With Modern Software Architecture
Taming Big Data  With Modern Software ArchitectureTaming Big Data  With Modern Software Architecture
Taming Big Data With Modern Software Architecture
Big Data User Group Karlsruhe/Stuttgart
 
Bidata
BidataBidata
Bidata
Tamojit Das
 
Tangenz big data
Tangenz big dataTangenz big data
Tangenz big data
emmajones88
 
Practical analytics john enoch white paper
Practical analytics john enoch white paperPractical analytics john enoch white paper
Practical analytics john enoch white paper
John Enoch
 
BIG DATA, small workforce
BIG DATA, small workforceBIG DATA, small workforce
BIG DATA, small workforce
Newton Day Uploads
 
Expert Big Data Tips
Expert Big Data TipsExpert Big Data Tips
Expert Big Data Tips
Qubole
 
EMA Analyst Slides: 2013 Big Data Research Results
EMA Analyst Slides: 2013 Big Data Research ResultsEMA Analyst Slides: 2013 Big Data Research Results
EMA Analyst Slides: 2013 Big Data Research Results
Enterprise Management Associates
 
From Customer Insights to Action
From Customer Insights to ActionFrom Customer Insights to Action
From Customer Insights to Action
Capgemini
 
The 10 best performing big data & business analytics companies july 2017
The 10 best performing big data & business analytics companies july 2017The 10 best performing big data & business analytics companies july 2017
The 10 best performing big data & business analytics companies july 2017
Insights success media and technology pvt ltd
 
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
Kai Wähner
 
JAZOON'13 - Kai Waehner - Hadoop Integration
JAZOON'13 - Kai Waehner - Hadoop IntegrationJAZOON'13 - Kai Waehner - Hadoop Integration
JAZOON'13 - Kai Waehner - Hadoop Integration
jazoon13
 
ZEDventures-highres
ZEDventures-highresZEDventures-highres
ZEDventures-highres
Jeremy Stierwalt
 
Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business Managers
Datameer
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentation
Doug Denton
 
"Big Data Dreams"
"Big Data Dreams""Big Data Dreams"
"Big Data Dreams"
Michael DeAloia
 

Similar to How to create intelligent Business Processes thanks to Big Data (BPM, Apache Hadoop, Talend, Open Source) (20)

"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
"Big Data beyond Apache Hadoop - How to Integrate ALL your Data" - JavaOne 2013
 
Why Everything You Know About bigdata Is A Lie
Why Everything You Know About bigdata Is A LieWhy Everything You Know About bigdata Is A Lie
Why Everything You Know About bigdata Is A Lie
 
The value of our data
The value of our dataThe value of our data
The value of our data
 
Transforming Big Data into business value
Transforming Big Data into business valueTransforming Big Data into business value
Transforming Big Data into business value
 
Why Big Data is Really about Small Data
Why Big Data is Really about Small DataWhy Big Data is Really about Small Data
Why Big Data is Really about Small Data
 
Taming Big Data With Modern Software Architecture
Taming Big Data  With Modern Software ArchitectureTaming Big Data  With Modern Software Architecture
Taming Big Data With Modern Software Architecture
 
Bidata
BidataBidata
Bidata
 
Tangenz big data
Tangenz big dataTangenz big data
Tangenz big data
 
Practical analytics john enoch white paper
Practical analytics john enoch white paperPractical analytics john enoch white paper
Practical analytics john enoch white paper
 
BIG DATA, small workforce
BIG DATA, small workforceBIG DATA, small workforce
BIG DATA, small workforce
 
Expert Big Data Tips
Expert Big Data TipsExpert Big Data Tips
Expert Big Data Tips
 
EMA Analyst Slides: 2013 Big Data Research Results
EMA Analyst Slides: 2013 Big Data Research ResultsEMA Analyst Slides: 2013 Big Data Research Results
EMA Analyst Slides: 2013 Big Data Research Results
 
From Customer Insights to Action
From Customer Insights to ActionFrom Customer Insights to Action
From Customer Insights to Action
 
The 10 best performing big data & business analytics companies july 2017
The 10 best performing big data & business analytics companies july 2017The 10 best performing big data & business analytics companies july 2017
The 10 best performing big data & business analytics companies july 2017
 
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
WJAX 2013 Slides online: Big Data beyond Apache Hadoop - How to integrate ALL...
 
JAZOON'13 - Kai Waehner - Hadoop Integration
JAZOON'13 - Kai Waehner - Hadoop IntegrationJAZOON'13 - Kai Waehner - Hadoop Integration
JAZOON'13 - Kai Waehner - Hadoop Integration
 
ZEDventures-highres
ZEDventures-highresZEDventures-highres
ZEDventures-highres
 
Getting Started with Big Data for Business Managers
Getting Started with Big Data for Business ManagersGetting Started with Big Data for Business Managers
Getting Started with Big Data for Business Managers
 
Level Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentationLevel Seven - Expedient Big Data presentation
Level Seven - Expedient Big Data presentation
 
"Big Data Dreams"
"Big Data Dreams""Big Data Dreams"
"Big Data Dreams"
 

More from Kai Wähner

Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Kai Wähner
 
When NOT to use Apache Kafka?
When NOT to use Apache Kafka?When NOT to use Apache Kafka?
When NOT to use Apache Kafka?
Kai Wähner
 
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping MetaverseKafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kai Wähner
 
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
The Heart of the Data Mesh Beats in Real-Time with Apache KafkaThe Heart of the Data Mesh Beats in Real-Time with Apache Kafka
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
Kai Wähner
 
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Apache Kafka vs. Cloud-native iPaaS Integration Platform MiddlewareApache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Kai Wähner
 
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Kai Wähner
 
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureServerless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Kai Wähner
 
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Kai Wähner
 
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryData Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Kai Wähner
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
Kai Wähner
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
Kai Wähner
 
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Apache Kafka for Real-time Supply Chainin the Food and Retail IndustryApache Kafka for Real-time Supply Chainin the Food and Retail Industry
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Kai Wähner
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kai Wähner
 
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Kai Wähner
 
Apache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and ManufacturingApache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and Manufacturing
Kai Wähner
 
Kappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology ComparisonKappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology Comparison
Kai Wähner
 
The Top 5 Apache Kafka Use Cases and Architectures in 2022
The Top 5 Apache Kafka Use Cases and Architectures in 2022The Top 5 Apache Kafka Use Cases and Architectures in 2022
The Top 5 Apache Kafka Use Cases and Architectures in 2022
Kai Wähner
 
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesEvent Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Kai Wähner
 
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Kai Wähner
 
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Kai Wähner
 

More from Kai Wähner (20)

Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
Apache Kafka as Data Hub for Crypto, NFT, Metaverse (Beyond the Buzz!)
 
When NOT to use Apache Kafka?
When NOT to use Apache Kafka?When NOT to use Apache Kafka?
When NOT to use Apache Kafka?
 
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping MetaverseKafka for Live Commerce to Transform the Retail and Shopping Metaverse
Kafka for Live Commerce to Transform the Retail and Shopping Metaverse
 
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
The Heart of the Data Mesh Beats in Real-Time with Apache KafkaThe Heart of the Data Mesh Beats in Real-Time with Apache Kafka
The Heart of the Data Mesh Beats in Real-Time with Apache Kafka
 
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Apache Kafka vs. Cloud-native iPaaS Integration Platform MiddlewareApache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
Apache Kafka vs. Cloud-native iPaaS Integration Platform Middleware
 
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
Data Warehouse vs. Data Lake vs. Data Streaming – Friends, Enemies, Frenemies?
 
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse ArchitectureServerless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
Serverless Kafka and Spark in a Multi-Cloud Lakehouse Architecture
 
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
Resilient Real-time Data Streaming across the Edge and Hybrid Cloud with Apac...
 
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity IndustryData Streaming with Apache Kafka in the Defence and Cybersecurity Industry
Data Streaming with Apache Kafka in the Defence and Cybersecurity Industry
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
 
Apache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare IndustryApache Kafka in the Healthcare Industry
Apache Kafka in the Healthcare Industry
 
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
Apache Kafka for Real-time Supply Chainin the Food and Retail IndustryApache Kafka for Real-time Supply Chainin the Food and Retail Industry
Apache Kafka for Real-time Supply Chain in the Food and Retail Industry
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid Cloud
 
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
Apache Kafka for Predictive Maintenance in Industrial IoT / Industry 4.0
 
Apache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and ManufacturingApache Kafka Landscape for Automotive and Manufacturing
Apache Kafka Landscape for Automotive and Manufacturing
 
Kappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology ComparisonKappa vs Lambda Architectures and Technology Comparison
Kappa vs Lambda Architectures and Technology Comparison
 
The Top 5 Apache Kafka Use Cases and Architectures in 2022
The Top 5 Apache Kafka Use Cases and Architectures in 2022The Top 5 Apache Kafka Use Cases and Architectures in 2022
The Top 5 Apache Kafka Use Cases and Architectures in 2022
 
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka ArchitecturesEvent Streaming CTO Roundtable for Cloud-native Kafka Architectures
Event Streaming CTO Roundtable for Cloud-native Kafka Architectures
 
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
Apache Kafka in the Public Sector (Government, National Security, Citizen Ser...
 
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
Telco 4.0 - Payment and FinServ Integration for Data in Motion with 5G and Ap...
 

Recently uploaded

Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
Ivo Velitchkov
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
Neo4j
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
Zilliz
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Alpen-Adria-Universität
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
Jason Packer
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
akankshawande
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
Antonios Katsarakis
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
DianaGray10
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
panagenda
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
Tatiana Kojar
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
Fwdays
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
DanBrown980551
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
Data Hops
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
Zilliz
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
ScyllaDB
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
Brandon Minnick, MBA
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
saastr
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
ssuserfac0301
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
Edge AI and Vision Alliance
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
operationspcvita
 

Recently uploaded (20)

Apps Break Data
Apps Break DataApps Break Data
Apps Break Data
 
Leveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and StandardsLeveraging the Graph for Clinical Trials and Standards
Leveraging the Graph for Clinical Trials and Standards
 
Fueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte WebinarFueling AI with Great Data with Airbyte Webinar
Fueling AI with Great Data with Airbyte Webinar
 
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing InstancesEnergy Efficient Video Encoding for Cloud and Edge Computing Instances
Energy Efficient Video Encoding for Cloud and Edge Computing Instances
 
Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024Columbus Data & Analytics Wednesdays - June 2024
Columbus Data & Analytics Wednesdays - June 2024
 
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development ProvidersYour One-Stop Shop for Python Success: Top 10 US Python Development Providers
Your One-Stop Shop for Python Success: Top 10 US Python Development Providers
 
Dandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity serverDandelion Hashtable: beyond billion requests per second on a commodity server
Dandelion Hashtable: beyond billion requests per second on a commodity server
 
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectorsConnector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
Connector Corner: Seamlessly power UiPath Apps, GenAI with prebuilt connectors
 
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAUHCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
HCL Notes und Domino Lizenzkostenreduzierung in der Welt von DLAU
 
Skybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoptionSkybuffer SAM4U tool for SAP license adoption
Skybuffer SAM4U tool for SAP license adoption
 
"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota"Choosing proper type of scaling", Olena Syrota
"Choosing proper type of scaling", Olena Syrota
 
5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides5th LF Energy Power Grid Model Meet-up Slides
5th LF Energy Power Grid Model Meet-up Slides
 
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3FREE A4 Cyber Security Awareness  Posters-Social Engineering part 3
FREE A4 Cyber Security Awareness Posters-Social Engineering part 3
 
Programming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup SlidesProgramming Foundation Models with DSPy - Meetup Slides
Programming Foundation Models with DSPy - Meetup Slides
 
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-EfficiencyFreshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
Freshworks Rethinks NoSQL for Rapid Scaling & Cost-Efficiency
 
Choosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptxChoosing The Best AWS Service For Your Website + API.pptx
Choosing The Best AWS Service For Your Website + API.pptx
 
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
9 CEO's who hit $100m ARR Share Their Top Growth Tactics Nathan Latka, Founde...
 
Taking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdfTaking AI to the Next Level in Manufacturing.pdf
Taking AI to the Next Level in Manufacturing.pdf
 
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
“How Axelera AI Uses Digital Compute-in-memory to Deliver Fast and Energy-eff...
 
The Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptxThe Microsoft 365 Migration Tutorial For Beginner.pptx
The Microsoft 365 Migration Tutorial For Beginner.pptx
 

How to create intelligent Business Processes thanks to Big Data (BPM, Apache Hadoop, Talend, Open Source)

  • 1. Next-Generation BPM – How to create intelligent Business Processes thanks to Big Data Talend,  Global  Leader  in  Open  Source  Integra7on  Solu7ons   Kai Wähner kwaehner@talend.com @KaiWaehner Xing / LinkedIn www.kai-waehner.de
  • 2. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Consulting Developing Coaching Speaking Writing Main Tasks Requirements Engineering Enterprise Architecture Management Business Process Management Architecture and Development of Applications Service-oriented Architecture Integration of Legacy Applications Cloud Computing Big Data Contact Email: kontakt@kai-waehner.de Blog: www.kai-waehner.de/blog Twitter: @KaiWaehner Social Networks: Xing, LinkedIn Kai Wähner
  • 3. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Key messages BPM should be used (just) for optimizing business processes! Intelligent business processes need big data and integration! Big data will reduce human interactions in BPM further!
  • 4. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 5. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 6. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     William  Edwards  Deming     (1900  –1993)     American  sta7s7cian,  professor,     author,  lecturer  and  consultant   “If  you  can't  measure  it,     you  can't  manage  it.”   Why should you care about big data?
  • 7. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     è  „Silence  the  HiPPOs“  (highest-­‐paid  person‘s  opinion)   è  Being  able  to  interpret  unimaginable  large  data   stream,  the  gut  feeling  is  no  longer  jus7fied!     Why should you care about big data?
  • 8. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Why should you care about big data? “Accessing  data  is  now  [again]  the  cri7cal  path  in  making  good  decisions!”   h`p://www.inforbix.com/friday-­‐data-­‐stories-­‐big-­‐data-­‐driven-­‐decision-­‐making/  
  • 9. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Why does big data exist? Changing Interactions Changing Scale Changing Expectations Cloud Sensors
  • 10. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     The Vs of big data Volume     (terabytes,   petabytes)                     Variety     (social  networks,   blog  posts,  logs,   sensors,  etc.)            Velocity                (real7me  or  near-­‐ real7me)           Value  
  • 11. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Big  Data  Integra3on   –  Land  data  in  a  Big  Data  cluster   –  Implement  or  generate  parallel  processes      Big  Data  Manipula3on   –  Simplify  manipula7on,  such  as  sort  and  filter   –  Computa7onal  expensive  func7ons     Big  Data  Quality  &  Governance   –  Iden7fy  linkages  and  duplicates,  validate  big  data   –  Match  component,  execute  basic  quality  features     Big  Data  Project  Management   –  Place  frameworks  around  big  data  projects   –  Common  Repository,  scheduling,  monitoring     Big data tasks to solve - before analysis
  • 12. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 13. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     h`p://www.slideshare.net/brocknoland/common-­‐and-­‐unique-­‐use-­‐cases-­‐for-­‐apache-­‐hadoop   Replacing ETL jobs: Binary files
  • 14. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     h`p://hkotadia.com/archives/5021   Deduce   Customer     Defec7ons   Forecast: Risk management
  • 15. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  With  revenue  of  almost  USD  30  billion  and  a  network  of   800  loca7ons,  Macy's  is  considered  the  largest  store  operator  in  the   USA   ➜  Daily  price  check  analysis  of  its  10,000  ar7cles  in  less  than  two  hours   ➜  Whenever  a  neighboring  compe7tor  anywhere  between  New  York   and  Los  Angeles  goes  for  aggressive  price  reduc7ons,  Macy's  follows   its  example   ➜  If  there  is  no  market  compe7tor,  the  prices  remain  unchanged   h`p://www.t-­‐systems.com/about-­‐t-­‐systems/examples-­‐of-­‐successes-­‐companies-­‐analyze-­‐big-­‐data-­‐in-­‐record-­‐7me-­‐l-­‐t-­‐systems/1029702   Logistics: Flexible pricing
  • 16. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Content  manipula7on     at  a  traveling  portal  –     Which  customer  reviews     are  trustworthy?         Jean-­‐Paul  Schmetz,  Harvard  Business  Manager,  November  2012   Fraud detection: Fraud mining
  • 17. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  A  lot  of  data  must  be  stored  „forever“   ➜  Numbers  increase  exponen7ally   ➜  Goal:  As  cheap  as  possible   ➜  Problem:  (Fast)  queries  must  s7ll  be  possible   ➜  Solu7on:  Commodity  servers  and  „Hadoop  querying“   Global  Parcel  Service   h`p://archive.org/stream/BigDataImPraxiseinsatz-­‐SzenarienBeispieleEffekte/Big_Data_BITKOM-­‐Leisaden_Sept.2012#page/n0/mode/2up   Storage: Compliance
  • 18. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  How  do  you  put  this  big  data  easily  in  the  hands  of  the  people  that   need  it?   ➜  Making  the  data  “ac7onable”  is  the  real  challenge.     ➜  Seeing  the  informa7on  that  helps  make  a  decision  on  a  composite   dashboard  is  just  the  first  step  and  where  too  many  companies  stop.     ➜  A  business  must  be  able  to  fire  off  the  business  process  to  execute  the   decision  made  regarding  the  data.   Great big data use cases, but ... Kai Wähner h`p://smartdatacollec7ve.com/ma`-­‐davies/104576/data-­‐driven-­‐bpm-­‐making-­‐big-­‐data-­‐ac7onable  
  • 19. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 20. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  Humans  have  to  interpret  large  data  to  make  decision.   Using  gut  feeling  is  nothing  but  gambling.   ➜  Just  doing  big  data  analy7cs  is  not  enough.  Systema7c   and  monitored  human  interac7ons  are  as  important  to   get  best  outcomes.   ➜  An  intelligent  business  process            combines  big  data  and  BPM.  This            enables  humans  to  make  data-­‐driven            decisions  based  on  big  data  analy7cs.   Intelligent business processes
  • 21. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  Process  starts  ac7on  (Big  Data  PULL)   •  Manual  or  automated   •  Faster  responses  (e.g.  „catching  Osama“)   •  Be`er  outcomes  (e.g.  „recommenda7on  engine“)     ➜  Data  starts  ac7on  (Big  Data  PUSH)   •  (Usually)  automated   •  Predic7ve  processes  (e.g.  „preven7ng  flu  epidemic“)   •  Handle  before  it  happens  (e.g.  „customer  deduc7on“)   Intelligent business processes
  • 22. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     ➜  How  are  they  related?   ➜  How  to  combine?   ➜  How  to  realize  this  technically?       Combination of big data and BPM
  • 23. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     increase efficiency better quality reduce costs increase flexibility enable new business models Why BPM? Kai Wähner Business-IT-Alignment
  • 24. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     •  long-running stateful workflows •  frequently changing processes •  human interaction When BPM? Kai Wähner
  • 25. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     How BPM? Kai Wähner Script Task Service Task Groovy JavaScript etc. SOAP Web Service Everything from Cobol to Ruby... ... or a „big data service“
  • 26. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Challenge Kai Wähner Separation of Concerns  
  • 27. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Separation of Concerns Kai Wähner Integration • ETL • Connectivity / adaptors to connect to external systems using a variety of different protocols  • Predefined EIP for message routing Big Data • Processing • Analytics BPM • Do queries to make decisions • Human or machine C   R   E   A   T   E   U   S   E  
  • 28. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 29. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Kai Wähner Integration • ETL • Connectivity / adaptors to connect to external systems using a variety of different protocols  • Predefined EIP for message routing Big Data • Processing • Analytics BPM • Do queries to make decisions • Human or machine Technical / product perspective
  • 30. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Enterprise Integration Patterns
  • 31. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Enterprise Integration Patterns
  • 32. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     AmazonS3  s3  =  new  AmazonS3Client(new  Proper7esCreden7als(                  S3Sample.class.getResourceAsStream("AwsCreden7als.proper7es")));     String  bucketName  =  "my-­‐first-­‐s3-­‐bucket-­‐"  +  UUID.randomUUID();   String  key  =  "MyObjectKey";     try  {                    s3.createBucket(bucketName);          s3.putObject(new  PutObjectRequest(bucketName,  key,  createSampleFile()));            S3Object  object  =  s3.getObject(new  GetObjectRequest(bucketName,  key));                    ObjectLis7ng  objectLis7ng  =  s3.listObjects(new  ListObjectsRequest()                          .withBucketName(bucketName)                          .withPrefix("My"));                    s3.deleteObject(bucketName,  key);              s3.deleteBucket(bucketName);     }  catch  (AmazonServiceExcep7on  ase)  {        //  error  handling...   }  catch  (AmazonClientExcep7on  ace)  {        //  error  handling...         }   Integration framework
  • 33. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     // Producer from(“ftp:toS3") .setHeader(S3Constants.KEY, simple(“order.txt")) .to("aws-s3://myBucket?accessKey=" + a+ "&secretKey= " + s) // Consumer from(„salesforce://orders__c?user=dummy1“) .filter(„customer == ${dummyCustomer}) .to(“ibm-database:orderData") Integration framework (e.g. Apache Camel)
  • 34. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Enterprise Service Bus (e.g. Talend ESB)
  • 35. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Connectivity Routing Transformation Complexity of Integration Enterprise   Service  Bus   Integra7on  Suite   Low High Integration Framework INTEGRATION Tooling Monitoring Support+ BUSINESS PROCESS MGT. BIG DATA / MDM REGISTRY / REPOSITORY RULES ENGINE „YOU NAME IT“ Alternatives for integration +
  • 36. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Kai Wähner Integration • ETL • Connectivity / adaptors to connect to external systems using a variety of different protocols  • Predefined EIP for message routing Big Data • Processing • Analytics BPM • Do queries to make decisions • Human or machine Technical / product perspective
  • 37. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Technology perspective How  to  process  big  data?  
  • 38. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Slides:  h`p://www.slideshare.net/pavlobaron/100-­‐big-­‐data-­‐0-­‐hadoop-­‐0-­‐java     Video:  h`p://www.infoq.com/presenta7ons/Big-­‐Data-­‐Hadoop-­‐Java   How to process big data?
  • 39. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     The  defacto  standard  for  big  data  processing   How to process big data?
  • 40. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Even  MicrosoL  (the  .NET  house)  relies  on  Hadoop  since  2011   How to process big data? “A  big  part  of  [the   company’s  strategy]   includes  wiring  SQL  Server   2012  (formerly  known  by   the  codename  “Denali”)  to   the  Hadoop  distributed   compu7ng  plasorm,  and   bringing  Hadoop  to   Windows  Server  and  Azure”  
  • 41. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Apache  Hadoop,  an  open-­‐source  soLware  library,  is  a   framework  that  allows  for  the  distributed  processing  of   large  data  sets  across  clusters  of  commodity  hardware   using  simple  programming  models.  It  is  designed  to  scale   up  from  single  servers  to  thousands  of  machines,  each   offering  local  computa7on  and  storage.       What is Hadoop?
  • 42. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     How to process big data?
  • 43. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     MapReduce HDFS Ecosystem Features included Hadoop   Distribu7on   Integra7on  Suite   few many Apache Hadoop Packaging Deployment-Tooling Support + Tooling / Modeling Code Generation Scheduling Other Tools (ESB, BPM, ...) + Hadoop alternatives
  • 44. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Kai Wähner Integration • ETL • Connectivity / adaptors to connect to external systems using a variety of different protocols  • Predefined EIP for message routing Big Data • Processing • Analytics BPM • Do queries to make decisions • Human or machine Technical / product perspective
  • 45. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Standards Kai Wähner BPM BPEL BPMN XPDL WF-XML BPEL4People jPDL ARIS EPC
  • 46. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     BPMN Kai Wähner „Business Process Model and Notation (BPMN) is a graphical representation for specifying business processes in a business process model.“ Wikipedia
  • 47. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • BPMN is a standard notation for designing business processes (versus: UML is a standard modeling language best suited for designing and implementing software) • not just flow charts! sufficient restrictions / constraints => executable! • standardized XML format • orchestration and choreography • extension points => add specific needs without breaking interoperability • optional mapping of a BPMN subset to BPEL (restricted to block-structured flows without cycles) BPMN 2.0 Kai Wähner
  • 48. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Alternatives for BPM (technology perspective) Kai Wähner Complexity of Orchestration Low High BPM   Framework   BPM  Suite   Integra7on  Suite   Coding Service Tasks Human Interaction GUI BPM Tooling Monitoring Support + ESB BIG DATA / MDM REGISTRY / REPOSITORY RULES ENGINE „YOU NAME IT“ +
  • 49. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Kai Wähner Integration • ETL • Connectivity / adaptors to connect to external systems using a variety of different protocols  • Predefined EIP for message routing Big Data • Processing • Analytics BPM • Do queries to make decisions • Human or machine Let‘s     realize     it  !!!   Technical / product perspective
  • 50. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Alternatives for creating intelligent BPs Kai Wähner Complexity of Orchestration Low High Frameworks   Specific  Tools   Suite  of  Tools   e.g. Talend Unified Platform i.e ALL-IN-ONE (Integration, Big Data, BPM) e.g. Camel (Integration) Hadoop (Big Data) Activiti (BPM) e.g. Mule ESB (Integration) MapR (Big Data) Camunda (BPM)
  • 51. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Custom combination of integration, big data and BPM? Kai Wähner •  A lot of glue code •  Testing •  Bugfixing •  No support Some other people already had the problems you would have!
  • 52. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     • Big  data  paradigm  shiL     • Use  cases  for  big  data   • Intelligent  business  processes   • Technology  and  product  perspec7ve   • Live  demo   Agenda
  • 53. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Live demo Complexity of Orchestration Low High Frameworks   Specific  Tools   Suite  of  Tools   e.g. Talend Unified Platform i.e ALL-IN-ONE (Integration, Big Data, BPM) e.g. Camel (Integration) Hadoop (Big Data) Activiti (BPM) e.g. Mule ESB (Integration) MapR (Big Data) Camunda (BPM)
  • 54. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Data Quality Data Integration MDM ESB Big Data Big Data ¾  Open  source  license   ¾  Free  of  charge   ¾  OpDonal  support   ¾  Based  on  open  source   projects  such  as  Eclipse   or  Apache  Camel,  CXF,   Hadoop   ¾  Commercial  license   ¾  SubscripDon  model   ¾  Support  included   Data Quality Data Integration MDM ESB BPM Talend Unified Platform
  • 55. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     „Talend  Integra7on  Suite“  in  ac7on...   Live demo
  • 56. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Example (Talend): Integration
  • 57. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Example (Talend): Big Data Processing
  • 58. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Example (Talend): Business Process
  • 59. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Example (Talend): Big Data Web Service
  • 60. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Did you get the key message?
  • 61. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Key messages BPM should be used (just) for optimizing business processes! Intelligent business processes need big data and integration! Big data will reduce human interactions in BPM further!
  • 62. ©  Talend  2013        “How  to  create  intelligent  Business  Processes  thanks  to  Big  Data”  by  Kai  Wähner     Did you get the key message?
  • 63. Thank you for your attention. Questions? KAI WÄHNER kwaehner@talend.com www.kai-waehner.de LinkedIn / Xing @KaiWaehner