SlideShare a Scribd company logo
1 of 16
Technology Division
Case study: Goldman Sachs
An enterprise-scale Workflow and Decision platform
June 26, 2018
Disclaimer:
Views and opinions expressed are for informational purposes only. They do not constitute a recommendation by Goldman Sachs to buy, sell
or hold any security. No part of this material may, without Goldman Sachs’s prior written consent, be (i) copied, photocopied or duplicated in
any form, by any means, or (ii) distributed to any person that is an employee, officer, director, or authorized agent of the recipient
Copyright Note: 2018 Goldman Sachs. All rights reserved.
2Technology Division
Agenda
• Workflow Elements
• Building an enterprise-wide Workflow Engine platform on Camunda
• Decentralizing the platform through Workflow Elements
• Decision Modeling
• Orchestrating a Decision Services Platform using Camunda
• New developments in Decision Modeling
Agenda
Case study: Goldman Sachs
3
Workflow Elements
Enterprise-scale Workflow Engine capabilities
4Technology Division
Workflow at an enterprise scale
Case study: Goldman Sachs
40,000 5,000 2,000,000 1,000 14,000
TOTAL USERS
(100% OF
THE FIRM)
DAILY USERS NEW ACTIVITIES
DAILY
PLATFORM
DEVELOPERS
UNIQUE
ACTIVE
WORKFLOWS
5Technology Division
Evolution of workflow at GS (Then)
Case study: Goldman Sachs
1. Operations task service
Central
Task Service
GS Operations
Division
External
System
External
System
…
Create
tasks
Create
tasks
External
BPM
execution
server
Workflow
jBPM
library
…
2. jBPM library for deploying BPM execution servers
…
External
BPM
execution
server
Workflow
jBPM
library
Central
Task Service
GS Operations
Division
 Central task service for Operations
 Challenges:
 Volume
 Management
 Support
• Core team built jBPM Library
 BPMN used to standardize workflows
• Appdev teams run own BPM server
 must understand jBPM services
6Technology Division
Evolution of workflow at GS (Now)
Case study: Goldman Sachs
Workflow Engine
(Business 1)
Camunda process
engine
Workflow Engine
(Business 2)
Camunda process
engine
3. Hosted Workflow Engine service built upon Camunda
…
Aggregation Service
Web UI
… …
Workflow Engine
(Business 1)
Camunda process
engine
Central Task Service
(Business 1)
Central Task
Service
(Business 2)
Workflow Engine
(Business N)
Camunda process
engine
Central Task
Service
(Business N)
…
7Technology Division
Model Driven Development Focus
Case study: Goldman Sachs
We Promote Model-Driven Development
Why?
• Scalable Orchestration
• Self Documenting
• Promotes Business Partnerships
• Available to whole Firm
• Leverages Camunda capabilities
Built an Integrated Design Tool
• Workflow Designer Built on BPMN.IO
• Integrates with SDLC
• Bespoke Forms Designer / UI Builder
• Coming: DMN Integration
Above: Workflow Designer for BPMN modelling,
BPMN.IO courtesy of Courtesy of camunda Services GmbH
Above: Custom forms design integrated to the Workflow Designer
8Technology Division
Workflow Elements
• Containerized version of Workflow Engine
• Deployable by appdev teams
• No core team needed
Scaling to the cloud with Camunda
Case study: Goldman Sachs
Workflow Control Centre
• UI to support engine provisioning
• Metrics, logs, configuration
• Appdev teams can self-manage engines
Above: Self-service order for a new Workflow Elements instance
Above: Teams are able to configure and manage their Elements instance independently
9Technology Division
Evolution of workflow at GS (Soon)
Case study: Goldman Sachs
Workflow Engine
(Business 1)
Camunda
process engine
Workflow Engine
Camunda process
engine and
embedded task
service
4. Workflow Elements Engine running with embedded Task Service
Aggregation Service
Web UI
… …
Workflow Engine
(Business 1)
Camunda
process engine
…
Workflow Engine
Camunda process
engine and
embedded task
service
Central Task Service
(Business 1)
10
Decision Modelling
Orchestration of decisions using Camunda, and new developments
11Technology Division
A firm-wide Decision Services Platform
Case study: Goldman Sachs
REST
endpoint
Regional
HAProxy
routing
Asia
CN …CN CN
… … …
CN …CN CN
EMEA
CN …CN CN
… … …
CN …CN CN
Americas
CN …CN
… … …
CN …CN CN
Apache Zookeeper
Common decision repository
Elasticsearch
Audit Store
Modelling
Application
CN = Compute Node
DSP Compute Node
Rules Engine 1
…
Rules Engine N
Orchestration
External Data
Integration
Local repository
REST
I/face
Summary
• The GS Decision Services Platform (DSP) is a firm-wide execution
platform for Decision Models
• Models are stateless & declarative representations of business logic
• Globally-distributed, horizontally-scalable and highly resilient
• Approx. 160 million executions across ~2600 decision models per day
• Rapid growth from 100k (2015)  2m (2016)  50m (2017)  160m
(2018) daily executions
• Leveraging Camunda process execution engine for orchestration
CN
12Technology Division
Decision orchestration with Camunda
Case study: Goldman Sachs
Decision Orchestration with Camunda
• Driven by increasing complexity of solutions and limitations of a purely declarative representation
• E.g. Calculate X  Then use X to retrieve data Y from external source  Then continue execution using Y
• But we have no concept of “before” or “after”
• Manual coordination of these steps by the user would be unreliable and introduce back-and-forth latency
• We required a solution to orchestrate these scenarios and chose to adopt the Camunda process engine
Key considerations
• Highly performant
• Ease of integration
• Intuitive design environment
• Lightweight implementation
• Doesn’t require the full expressive power of BPMN
• Can be stateless; no persistence required
• All executions can be considered atomic
• Potential for customisation
13Technology Division
Decision orchestration with Camunda
Case study: Goldman Sachs
The GS “Decision Flow” implementation
• We implemented a lightweight and restricted version of the Camunda process engine for orchestrating these decisions
• Customisation was achieved through Camunda configuration and implementation against standard interfaces
• Limited components – restricted to a subset of BPMN, all stateless components
• In-memory H2 database – no stateful components so no need for communication with shared database
• Custom stubbed components – for example, no object serialization required given lack of persistence
• Integrated with existing Camunda-based design environment
BPMN.IO courtesy of Courtesy of camunda Services GmbH
14Technology Division
An open-source Java execution library for DMN
Case study: Goldman Sachs
Native Java execution for DMN
• We have been executing decisions within powerful & general-purpose rules engines
• Scope of decision modelling expanding to other use cases, in particular very high-volume, low-latency scenarios
• This drove the development of a purpose-built library for native Java code-generation and execution of DMN decision models
• We are releasing this as an open-source library under the name “jDMN”
Decision Modelling1 DMN XML2 Code-generated Java3
15Technology Division
An open-source Java execution library for DMN
Case study: Goldman Sachs
Camunda DMN design environment
• We have adopted the Camunda DMN.js library to allow (initial, basic)
rendering of these DMN models inside our own designer
• Integrated with the execution platform; users can open their decision
models and execute in bulk against the platform directly
• Decision modelling still takes place within an external application
• However we are exploring the capabilities of the DMN.js library and
considering extensions to modelling support in the future
BPMN.IO courtesy of Courtesy of camunda Services GmbH
16Technology Division
An open-source Java execution library for DMN
Case study: Goldman Sachs
Performance of jDMN-generated Java
• Runtime of these generated Java models is 10-40x faster than our existing (and optimised) rules engine implementation
Open-sourcing
• We have released jDMN as an open-source library: https://github.com/goldmansachs/jdmn
• jDMN has full support for DMN 1.1 and the soon-to-be-finalised DMN 1.2 standard, and we fully intend to support DMN 2.0 as it
develops
• Please feel free to use or contribute, and get in touch if you’d like to understand more about the project
Existing rules engine
jDMN
Averageexecutiontime(ms)

More Related Content

What's hot

Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017
Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017
Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017Amazon Web Services
 
The Future Scope of AWS
The Future Scope of AWSThe Future Scope of AWS
The Future Scope of AWSAWS Guide
 
Introduction to AWS VPC, Guidelines, and Best Practices
Introduction to AWS VPC, Guidelines, and Best PracticesIntroduction to AWS VPC, Guidelines, and Best Practices
Introduction to AWS VPC, Guidelines, and Best PracticesGary Silverman
 
Design of Diesel Engine by Prof. Sagar Dhotare
Design of Diesel Engine by Prof. Sagar DhotareDesign of Diesel Engine by Prof. Sagar Dhotare
Design of Diesel Engine by Prof. Sagar DhotareSagar Dhotare
 
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...camunda services GmbH
 
Rapid Application Development on AWS
Rapid Application Development on AWSRapid Application Development on AWS
Rapid Application Development on AWSAmazon Web Services
 
Beyond the Scrum Master - Becoming an Agile Coach
Beyond the Scrum Master - Becoming an Agile CoachBeyond the Scrum Master - Becoming an Agile Coach
Beyond the Scrum Master - Becoming an Agile CoachCprime
 
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...Amazon Web Services
 
Statik, Kanban's hidden gem
Statik, Kanban's hidden gemStatik, Kanban's hidden gem
Statik, Kanban's hidden gemMike Burrows
 
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽Amazon Web Services Korea
 
Getting Started with Serverless Architectures
Getting Started with Serverless ArchitecturesGetting Started with Serverless Architectures
Getting Started with Serverless ArchitecturesAmazon Web Services
 
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015Amazon Web Services Korea
 

What's hot (20)

Professional Scrum Master I (PSM-I)
Professional Scrum Master I (PSM-I)Professional Scrum Master I (PSM-I)
Professional Scrum Master I (PSM-I)
 
Intro to AWS Lambda
Intro to AWS Lambda Intro to AWS Lambda
Intro to AWS Lambda
 
Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017
Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017
Introduction to AWS and Cloud Computing - Module 1 Part 1 - AWSome Day 2017
 
The Future Scope of AWS
The Future Scope of AWSThe Future Scope of AWS
The Future Scope of AWS
 
Aws landing zone. journey to the cloud
Aws landing zone. journey to the cloudAws landing zone. journey to the cloud
Aws landing zone. journey to the cloud
 
Introduction to AWS VPC, Guidelines, and Best Practices
Introduction to AWS VPC, Guidelines, and Best PracticesIntroduction to AWS VPC, Guidelines, and Best Practices
Introduction to AWS VPC, Guidelines, and Best Practices
 
Design of Diesel Engine by Prof. Sagar Dhotare
Design of Diesel Engine by Prof. Sagar DhotareDesign of Diesel Engine by Prof. Sagar Dhotare
Design of Diesel Engine by Prof. Sagar Dhotare
 
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...
Camunda Day Amsterdam 2019: Workflow Automation in Microservices Architecture...
 
Rapid Application Development on AWS
Rapid Application Development on AWSRapid Application Development on AWS
Rapid Application Development on AWS
 
AWS Basics .pdf
AWS Basics .pdfAWS Basics .pdf
AWS Basics .pdf
 
Beyond the Scrum Master - Becoming an Agile Coach
Beyond the Scrum Master - Becoming an Agile CoachBeyond the Scrum Master - Becoming an Agile Coach
Beyond the Scrum Master - Becoming an Agile Coach
 
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...
[NEW LAUNCH!] Introduction to AWS Global Accelerator (NET330) - AWS re:Invent...
 
Serverless
ServerlessServerless
Serverless
 
Statik, Kanban's hidden gem
Statik, Kanban's hidden gemStatik, Kanban's hidden gem
Statik, Kanban's hidden gem
 
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽
20분안에 스타트업이 알아야하는 AWS의 모든것 - 윤석찬 :: 스타트업얼라이언스 런치클럽
 
Getting Started with Serverless Architectures
Getting Started with Serverless ArchitecturesGetting Started with Serverless Architectures
Getting Started with Serverless Architectures
 
Scrumban
ScrumbanScrumban
Scrumban
 
Amazon CloudFront 101
Amazon CloudFront 101Amazon CloudFront 101
Amazon CloudFront 101
 
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015
AWS 비용 최적화 기법 (윤석찬) - AWS 웨비나 시리즈 2015
 
BPMN 1.1 Poster EN
BPMN 1.1 Poster ENBPMN 1.1 Poster EN
BPMN 1.1 Poster EN
 

Similar to Richard Tarling, Managing Director and Randall Graebner, Senior Engineer from Goldman Sachs - Camunda Day NYC 2018

CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)
CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)
CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)camunda services GmbH
 
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...camunda services GmbH
 
What Is Your PLM Challenge - Decrease downtime and minimize production problems
What Is Your PLM Challenge - Decrease downtime and minimize production problemsWhat Is Your PLM Challenge - Decrease downtime and minimize production problems
What Is Your PLM Challenge - Decrease downtime and minimize production problemsDawn Collins
 
Daimler’s Community Approach to TAS Platform Monitoring
Daimler’s Community Approach to TAS Platform MonitoringDaimler’s Community Approach to TAS Platform Monitoring
Daimler’s Community Approach to TAS Platform MonitoringVMware Tanzu
 
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...VMworld
 
Plastic Scm 4 0 For Game Developers March 2012 V2
Plastic Scm  4 0 For Game Developers  March 2012 V2Plastic Scm  4 0 For Game Developers  March 2012 V2
Plastic Scm 4 0 For Game Developers March 2012 V2Kiko Monteverde
 
Introduction to Adaptive and 3DEXPERIENCE Cloud
Introduction to Adaptive and 3DEXPERIENCE CloudIntroduction to Adaptive and 3DEXPERIENCE Cloud
Introduction to Adaptive and 3DEXPERIENCE CloudAdaptive Corporation
 
70% Improvement in Service and Product Delivery on Implementing DevOps
70% Improvement in Service and Product Delivery on Implementing DevOps70% Improvement in Service and Product Delivery on Implementing DevOps
70% Improvement in Service and Product Delivery on Implementing DevOpsCygnet Infotech
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Dayscamunda services GmbH
 
Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Dynatrace
 
Software effort estimation
Software effort estimationSoftware effort estimation
Software effort estimationtumetr1
 
Zen tao introduction
Zen tao introductionZen tao introduction
Zen tao introductionSpotline mart
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented ArchitectureAmazon Web Services
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management ServicesNeev Technologies
 
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)camunda services GmbH
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented ArchitectureAmazon Web Services
 
Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Amazon Web Services
 
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On KubernetesHow To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On KubernetesLightbend
 

Similar to Richard Tarling, Managing Director and Randall Graebner, Senior Engineer from Goldman Sachs - Camunda Day NYC 2018 (20)

CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)
CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)
CamundaCon 2018: A Global Workflow Infrastructure (Goldman Sachs)
 
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...
Camunda Day Amsterdam 2019: Best Practices for successfully introducing Camun...
 
Camunda BPM 7.2 - English
Camunda BPM 7.2 - EnglishCamunda BPM 7.2 - English
Camunda BPM 7.2 - English
 
What Is Your PLM Challenge - Decrease downtime and minimize production problems
What Is Your PLM Challenge - Decrease downtime and minimize production problemsWhat Is Your PLM Challenge - Decrease downtime and minimize production problems
What Is Your PLM Challenge - Decrease downtime and minimize production problems
 
Daimler’s Community Approach to TAS Platform Monitoring
Daimler’s Community Approach to TAS Platform MonitoringDaimler’s Community Approach to TAS Platform Monitoring
Daimler’s Community Approach to TAS Platform Monitoring
 
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...
VMworld 2013: Building the Management Stack for Your Software Defined Data Ce...
 
Plastic Scm 4 0 For Game Developers March 2012 V2
Plastic Scm  4 0 For Game Developers  March 2012 V2Plastic Scm  4 0 For Game Developers  March 2012 V2
Plastic Scm 4 0 For Game Developers March 2012 V2
 
Introduction to ActOnMagic
Introduction to ActOnMagicIntroduction to ActOnMagic
Introduction to ActOnMagic
 
Introduction to Adaptive and 3DEXPERIENCE Cloud
Introduction to Adaptive and 3DEXPERIENCE CloudIntroduction to Adaptive and 3DEXPERIENCE Cloud
Introduction to Adaptive and 3DEXPERIENCE Cloud
 
70% Improvement in Service and Product Delivery on Implementing DevOps
70% Improvement in Service and Product Delivery on Implementing DevOps70% Improvement in Service and Product Delivery on Implementing DevOps
70% Improvement in Service and Product Delivery on Implementing DevOps
 
Jakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda DaysJakob Freund: Camunda for IT Executives - Camunda Days
Jakob Freund: Camunda for IT Executives - Camunda Days
 
Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]Accelerate User Driven Innovation [Webinar]
Accelerate User Driven Innovation [Webinar]
 
Software effort estimation
Software effort estimationSoftware effort estimation
Software effort estimation
 
Zen tao introduction
Zen tao introductionZen tao introduction
Zen tao introduction
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
Neev Application Performance Management Services
Neev Application Performance Management ServicesNeev Application Performance Management Services
Neev Application Performance Management Services
 
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)
CamundaCon 2018: The Camunda Stack: Status Quo and Further Roadmap (Camunda)
 
Implementing Service Oriented Architecture
Implementing Service Oriented ArchitectureImplementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
Implementing Service Oriented Architecture
Implementing Service Oriented Architecture Implementing Service Oriented Architecture
Implementing Service Oriented Architecture
 
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On KubernetesHow To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes
How To Build, Integrate, and Deploy Real-Time Streaming Pipelines On Kubernetes
 

More from camunda services GmbH

Using Camunda on Kubernetes through Operators
Using Camunda on Kubernetes through OperatorsUsing Camunda on Kubernetes through Operators
Using Camunda on Kubernetes through Operatorscamunda services GmbH
 
Predictive Process Monitoring in Camunda
Predictive Process Monitoring in CamundaPredictive Process Monitoring in Camunda
Predictive Process Monitoring in Camundacamunda services GmbH
 
Camunda Product Update – The present and the future of Process Automation
Camunda Product Update – The present and the future of Process AutomationCamunda Product Update – The present and the future of Process Automation
Camunda Product Update – The present and the future of Process Automationcamunda services GmbH
 
Tips on how to build Camunda Run for production
Tips on how to build Camunda Run for productionTips on how to build Camunda Run for production
Tips on how to build Camunda Run for productioncamunda services GmbH
 
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmen
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in UnternehmenBlitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmen
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmencamunda services GmbH
 
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...camunda services GmbH
 
Extending human workflow preparing people and processes for the digital era w...
Extending human workflow preparing people and processes for the digital era w...Extending human workflow preparing people and processes for the digital era w...
Extending human workflow preparing people and processes for the digital era w...camunda services GmbH
 
[Webinar] Camunda Optimize Release 3.0
[Webinar] Camunda Optimize Release 3.0[Webinar] Camunda Optimize Release 3.0
[Webinar] Camunda Optimize Release 3.0camunda services GmbH
 
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...camunda services GmbH
 
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...Process Automation Forum, Processautomatisierung neu gedacht für das digitale...
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...camunda services GmbH
 
Process Automation Forum Zurich, finnova AG Bankware
Process Automation Forum Zurich, finnova AG BankwareProcess Automation Forum Zurich, finnova AG Bankware
Process Automation Forum Zurich, finnova AG Bankwarecamunda services GmbH
 
Process Automation Forum Munich, Swiss Life
Process Automation Forum Munich, Swiss LifeProcess Automation Forum Munich, Swiss Life
Process Automation Forum Munich, Swiss Lifecamunda services GmbH
 
Process Automation Forum Vienna, A1 & J-IT
Process Automation Forum Vienna, A1 & J-ITProcess Automation Forum Vienna, A1 & J-IT
Process Automation Forum Vienna, A1 & J-ITcamunda services GmbH
 
Process Automation Forum Vienna, Raiffeisen
Process Automation Forum Vienna, RaiffeisenProcess Automation Forum Vienna, Raiffeisen
Process Automation Forum Vienna, Raiffeisencamunda services GmbH
 
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AG
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AGProcess Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AG
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AGcamunda services GmbH
 
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native Worldcamunda services GmbH
 

More from camunda services GmbH (20)

Using Camunda on Kubernetes through Operators
Using Camunda on Kubernetes through OperatorsUsing Camunda on Kubernetes through Operators
Using Camunda on Kubernetes through Operators
 
Predictive Process Monitoring in Camunda
Predictive Process Monitoring in CamundaPredictive Process Monitoring in Camunda
Predictive Process Monitoring in Camunda
 
Camunda Product Update – The present and the future of Process Automation
Camunda Product Update – The present and the future of Process AutomationCamunda Product Update – The present and the future of Process Automation
Camunda Product Update – The present and the future of Process Automation
 
Tips on how to build Camunda Run for production
Tips on how to build Camunda Run for productionTips on how to build Camunda Run for production
Tips on how to build Camunda Run for production
 
Process Driven Customer Interaction
Process Driven Customer InteractionProcess Driven Customer Interaction
Process Driven Customer Interaction
 
Exploring Automation in Government
Exploring Automation in GovernmentExploring Automation in Government
Exploring Automation in Government
 
The Pulse of Process Automation
The Pulse of Process AutomationThe Pulse of Process Automation
The Pulse of Process Automation
 
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmen
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in UnternehmenBlitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmen
Blitzumfrage zur aktuellen Nutzung von Prozessautomatisierung in Unternehmen
 
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...
Webinar - A Developer's Quick Start Guide to Open Source Process Automation U...
 
Extending human workflow preparing people and processes for the digital era w...
Extending human workflow preparing people and processes for the digital era w...Extending human workflow preparing people and processes for the digital era w...
Extending human workflow preparing people and processes for the digital era w...
 
Camunda BPM 7.13 Webinar
Camunda BPM 7.13 WebinarCamunda BPM 7.13 Webinar
Camunda BPM 7.13 Webinar
 
[Webinar] Camunda Optimize Release 3.0
[Webinar] Camunda Optimize Release 3.0[Webinar] Camunda Optimize Release 3.0
[Webinar] Camunda Optimize Release 3.0
 
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...
Webinar: Monitoring & Orchestrating Your Microservices Landscape using Workfl...
 
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...Process Automation Forum, Processautomatisierung neu gedacht für das digitale...
Process Automation Forum, Processautomatisierung neu gedacht für das digitale...
 
Process Automation Forum Zurich, finnova AG Bankware
Process Automation Forum Zurich, finnova AG BankwareProcess Automation Forum Zurich, finnova AG Bankware
Process Automation Forum Zurich, finnova AG Bankware
 
Process Automation Forum Munich, Swiss Life
Process Automation Forum Munich, Swiss LifeProcess Automation Forum Munich, Swiss Life
Process Automation Forum Munich, Swiss Life
 
Process Automation Forum Vienna, A1 & J-IT
Process Automation Forum Vienna, A1 & J-ITProcess Automation Forum Vienna, A1 & J-IT
Process Automation Forum Vienna, A1 & J-IT
 
Process Automation Forum Vienna, Raiffeisen
Process Automation Forum Vienna, RaiffeisenProcess Automation Forum Vienna, Raiffeisen
Process Automation Forum Vienna, Raiffeisen
 
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AG
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AGProcess Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AG
Process Automation Forum Düsseldorf, Provinzial Rheinland Versicherung AG
 
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World
[Webinar] BPM Renaissance: 5 Tips to Thrive in a Cloud-Native World
 

Recently uploaded

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxLoriGlavin3
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionDilum Bandara
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxLoriGlavin3
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptxUse of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
Use of FIDO in the Payments and Identity Landscape: FIDO Paris Seminar.pptx
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 
Advanced Computer Architecture – An Introduction
Advanced Computer Architecture – An IntroductionAdvanced Computer Architecture – An Introduction
Advanced Computer Architecture – An Introduction
 
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptxA Deep Dive on Passkeys: FIDO Paris Seminar.pptx
A Deep Dive on Passkeys: FIDO Paris Seminar.pptx
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 

Richard Tarling, Managing Director and Randall Graebner, Senior Engineer from Goldman Sachs - Camunda Day NYC 2018

  • 1. Technology Division Case study: Goldman Sachs An enterprise-scale Workflow and Decision platform June 26, 2018 Disclaimer: Views and opinions expressed are for informational purposes only. They do not constitute a recommendation by Goldman Sachs to buy, sell or hold any security. No part of this material may, without Goldman Sachs’s prior written consent, be (i) copied, photocopied or duplicated in any form, by any means, or (ii) distributed to any person that is an employee, officer, director, or authorized agent of the recipient Copyright Note: 2018 Goldman Sachs. All rights reserved.
  • 2. 2Technology Division Agenda • Workflow Elements • Building an enterprise-wide Workflow Engine platform on Camunda • Decentralizing the platform through Workflow Elements • Decision Modeling • Orchestrating a Decision Services Platform using Camunda • New developments in Decision Modeling Agenda Case study: Goldman Sachs
  • 4. 4Technology Division Workflow at an enterprise scale Case study: Goldman Sachs 40,000 5,000 2,000,000 1,000 14,000 TOTAL USERS (100% OF THE FIRM) DAILY USERS NEW ACTIVITIES DAILY PLATFORM DEVELOPERS UNIQUE ACTIVE WORKFLOWS
  • 5. 5Technology Division Evolution of workflow at GS (Then) Case study: Goldman Sachs 1. Operations task service Central Task Service GS Operations Division External System External System … Create tasks Create tasks External BPM execution server Workflow jBPM library … 2. jBPM library for deploying BPM execution servers … External BPM execution server Workflow jBPM library Central Task Service GS Operations Division  Central task service for Operations  Challenges:  Volume  Management  Support • Core team built jBPM Library  BPMN used to standardize workflows • Appdev teams run own BPM server  must understand jBPM services
  • 6. 6Technology Division Evolution of workflow at GS (Now) Case study: Goldman Sachs Workflow Engine (Business 1) Camunda process engine Workflow Engine (Business 2) Camunda process engine 3. Hosted Workflow Engine service built upon Camunda … Aggregation Service Web UI … … Workflow Engine (Business 1) Camunda process engine Central Task Service (Business 1) Central Task Service (Business 2) Workflow Engine (Business N) Camunda process engine Central Task Service (Business N) …
  • 7. 7Technology Division Model Driven Development Focus Case study: Goldman Sachs We Promote Model-Driven Development Why? • Scalable Orchestration • Self Documenting • Promotes Business Partnerships • Available to whole Firm • Leverages Camunda capabilities Built an Integrated Design Tool • Workflow Designer Built on BPMN.IO • Integrates with SDLC • Bespoke Forms Designer / UI Builder • Coming: DMN Integration Above: Workflow Designer for BPMN modelling, BPMN.IO courtesy of Courtesy of camunda Services GmbH Above: Custom forms design integrated to the Workflow Designer
  • 8. 8Technology Division Workflow Elements • Containerized version of Workflow Engine • Deployable by appdev teams • No core team needed Scaling to the cloud with Camunda Case study: Goldman Sachs Workflow Control Centre • UI to support engine provisioning • Metrics, logs, configuration • Appdev teams can self-manage engines Above: Self-service order for a new Workflow Elements instance Above: Teams are able to configure and manage their Elements instance independently
  • 9. 9Technology Division Evolution of workflow at GS (Soon) Case study: Goldman Sachs Workflow Engine (Business 1) Camunda process engine Workflow Engine Camunda process engine and embedded task service 4. Workflow Elements Engine running with embedded Task Service Aggregation Service Web UI … … Workflow Engine (Business 1) Camunda process engine … Workflow Engine Camunda process engine and embedded task service Central Task Service (Business 1)
  • 10. 10 Decision Modelling Orchestration of decisions using Camunda, and new developments
  • 11. 11Technology Division A firm-wide Decision Services Platform Case study: Goldman Sachs REST endpoint Regional HAProxy routing Asia CN …CN CN … … … CN …CN CN EMEA CN …CN CN … … … CN …CN CN Americas CN …CN … … … CN …CN CN Apache Zookeeper Common decision repository Elasticsearch Audit Store Modelling Application CN = Compute Node DSP Compute Node Rules Engine 1 … Rules Engine N Orchestration External Data Integration Local repository REST I/face Summary • The GS Decision Services Platform (DSP) is a firm-wide execution platform for Decision Models • Models are stateless & declarative representations of business logic • Globally-distributed, horizontally-scalable and highly resilient • Approx. 160 million executions across ~2600 decision models per day • Rapid growth from 100k (2015)  2m (2016)  50m (2017)  160m (2018) daily executions • Leveraging Camunda process execution engine for orchestration CN
  • 12. 12Technology Division Decision orchestration with Camunda Case study: Goldman Sachs Decision Orchestration with Camunda • Driven by increasing complexity of solutions and limitations of a purely declarative representation • E.g. Calculate X  Then use X to retrieve data Y from external source  Then continue execution using Y • But we have no concept of “before” or “after” • Manual coordination of these steps by the user would be unreliable and introduce back-and-forth latency • We required a solution to orchestrate these scenarios and chose to adopt the Camunda process engine Key considerations • Highly performant • Ease of integration • Intuitive design environment • Lightweight implementation • Doesn’t require the full expressive power of BPMN • Can be stateless; no persistence required • All executions can be considered atomic • Potential for customisation
  • 13. 13Technology Division Decision orchestration with Camunda Case study: Goldman Sachs The GS “Decision Flow” implementation • We implemented a lightweight and restricted version of the Camunda process engine for orchestrating these decisions • Customisation was achieved through Camunda configuration and implementation against standard interfaces • Limited components – restricted to a subset of BPMN, all stateless components • In-memory H2 database – no stateful components so no need for communication with shared database • Custom stubbed components – for example, no object serialization required given lack of persistence • Integrated with existing Camunda-based design environment BPMN.IO courtesy of Courtesy of camunda Services GmbH
  • 14. 14Technology Division An open-source Java execution library for DMN Case study: Goldman Sachs Native Java execution for DMN • We have been executing decisions within powerful & general-purpose rules engines • Scope of decision modelling expanding to other use cases, in particular very high-volume, low-latency scenarios • This drove the development of a purpose-built library for native Java code-generation and execution of DMN decision models • We are releasing this as an open-source library under the name “jDMN” Decision Modelling1 DMN XML2 Code-generated Java3
  • 15. 15Technology Division An open-source Java execution library for DMN Case study: Goldman Sachs Camunda DMN design environment • We have adopted the Camunda DMN.js library to allow (initial, basic) rendering of these DMN models inside our own designer • Integrated with the execution platform; users can open their decision models and execute in bulk against the platform directly • Decision modelling still takes place within an external application • However we are exploring the capabilities of the DMN.js library and considering extensions to modelling support in the future BPMN.IO courtesy of Courtesy of camunda Services GmbH
  • 16. 16Technology Division An open-source Java execution library for DMN Case study: Goldman Sachs Performance of jDMN-generated Java • Runtime of these generated Java models is 10-40x faster than our existing (and optimised) rules engine implementation Open-sourcing • We have released jDMN as an open-source library: https://github.com/goldmansachs/jdmn • jDMN has full support for DMN 1.1 and the soon-to-be-finalised DMN 1.2 standard, and we fully intend to support DMN 2.0 as it develops • Please feel free to use or contribute, and get in touch if you’d like to understand more about the project Existing rules engine jDMN Averageexecutiontime(ms)