SlideShare a Scribd company logo
1 of 88
© Wil van der Aalst (use only with permission & acknowledgements)
prof.dr.ir. Wil van der Aalst
RWTH Aachen University
W: vdaalst.com T:@wvdaalst
20 Years of Process Mining Research
Accomplishments, Challenges, and Open Problems
© Wil van der Aalst (use only with permission & acknowledgements)
Positioning
“bridging gaps”
© Wil van der Aalst (use only with permission & acknowledgements)
< 1999
 1999
“process management by modeling”
Process mining
Process discovery
Conformance checking
Predictive analytics
“process management by mining”
Petri nets
Concurrency theory
BPM, WFM, etc.
Simulation
Formal methods
© Wil van der Aalst (use only with permission & acknowledgements)
Starting point: Event data
event
71,043 events
12,666 cases
7 activities
Case ID Activity Resource Timestamp product prod-price quantity address
… … …. … …. … … …
6350 place order Aiden 2018/02/13 14:29:45.000 APPLE iPhone 6 16 GB 639,00 € 5 NL-7751DG-21
6283 pay Lily 2018/02/13 14:39:25.000 SAMSUNG Galaxy S6 32 GB 543.99 3 NL-7828AM-11a
6253 prepare delivery Sophia 2018/02/13 15:01:33.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7887AC-13
6257 prepare delivery Aiden 2018/02/13 15:03:43.000 SAMSUNG Galaxy S6 32 GB 543.99 1 NL-9521KJ-34
6185 confirm payment Emily 2018/02/13 15:05:36.000 SAMSUNG Galaxy S4 329,00 € 1 NL-9521GC-32
6218 confirm payment Emily 2018/02/13 15:08:11.000 APPLE iPhone 6s Plus 64 GB 969,00 € 2 NL-7948BX-10
6245 make delivery Michael 2018/02/13 15:14:04.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7905AX-38
6272 pay Emily 2018/02/13 15:20:36.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7821AC-3
6269 pay Charlotte 2018/02/13 15:25:21.000 SAMSUNG Galaxy S4 329,00 € 1 NL-7907EJ-42
6212 prepare delivery Sophia 2018/02/13 15:43:39.000 HUAWEI P8 Lite 234,00 € 1 NL-7905AX-38
6323 send invoice Alexander 2018/02/13 15:46:08.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7833HT-15
6246 confirm payment Jack 2018/02/13 15:56:03.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7833HT-15
6347 send invoice Jack 2018/02/13 15:57:42.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7905AX-38
6351 place order Zoe 2018/02/13 16:17:37.000 APPLE iPhone 5s 16 GB 449,00 € 3 NL-9521GC-32
6204 prepare delivery Sophia 2018/02/13 16:31:28.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a
6204 make delivery Kaylee 2018/02/13 16:51:54.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a
6265 confirm payment Lily 2018/02/13 16:55:55.000 SAMSUNG Galaxy S4 329,00 € 4 NL-9521GC-32
6250 confirm payment Jack 2018/02/13 17:03:26.000 MOTOROLA Moto G 199,00 € 4 NL-7942GT-2
6328 send invoice Lily 2018/02/13 17:30:16.000 APPLE iPhone 6s 64 GB 858,00 € 4 NL-9514BV-16
6352 place order Aiden 2018/02/13 17:53:22.000 APPLE iPhone 6 16 GB 639,00 € 2 NL-9514BV-16
6317 send invoice Jack 2018/02/13 18:45:30.000 APPLE iPhone 6s 64 GB 858,00 € 5 NL-7907EJ-42
6353 place order Sophia 2018/02/13 20:16:20.000 APPLE iPhone 5s 16 GB 449,00 € 4 NL-7751AR-19
… … …. … … … … …
© Wil van der Aalst (use only with permission & acknowledgements)
Starting point: Event data
Case ID Activity Resource Timestamp product prod-price quantity address
… … …. … …. … … …
6350 place order Aiden 2018/02/13 14:29:45.000 APPLE iPhone 6 16 GB 639,00 € 5 NL-7751DG-21
6283 pay Lily 2018/02/13 14:39:25.000 SAMSUNG Galaxy S6 32 GB 543.99 3 NL-7828AM-11a
6253 prepare delivery Sophia 2018/02/13 15:01:33.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7887AC-13
6257 prepare delivery Aiden 2018/02/13 15:03:43.000 SAMSUNG Galaxy S6 32 GB 543.99 1 NL-9521KJ-34
6185 confirm payment Emily 2018/02/13 15:05:36.000 SAMSUNG Galaxy S4 329,00 € 1 NL-9521GC-32
6218 confirm payment Emily 2018/02/13 15:08:11.000 APPLE iPhone 6s Plus 64 GB 969,00 € 2 NL-7948BX-10
6245 make delivery Michael 2018/02/13 15:14:04.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7905AX-38
6272 pay Emily 2018/02/13 15:20:36.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7821AC-3
6269 pay Charlotte 2018/02/13 15:25:21.000 SAMSUNG Galaxy S4 329,00 € 1 NL-7907EJ-42
6212 prepare delivery Sophia 2018/02/13 15:43:39.000 HUAWEI P8 Lite 234,00 € 1 NL-7905AX-38
6323 send invoice Alexander 2018/02/13 15:46:08.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7833HT-15
6246 confirm payment Jack 2018/02/13 15:56:03.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7833HT-15
6347 send invoice Jack 2018/02/13 15:57:42.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7905AX-38
6351 place order Zoe 2018/02/13 16:17:37.000 APPLE iPhone 5s 16 GB 449,00 € 3 NL-9521GC-32
6204 prepare delivery Sophia 2018/02/13 16:31:28.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a
6204 make delivery Kaylee 2018/02/13 16:51:54.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a
6265 confirm payment Lily 2018/02/13 16:55:55.000 SAMSUNG Galaxy S4 329,00 € 4 NL-9521GC-32
6250 confirm payment Jack 2018/02/13 17:03:26.000 MOTOROLA Moto G 199,00 € 4 NL-7942GT-2
6328 send invoice Lily 2018/02/13 17:30:16.000 APPLE iPhone 6s 64 GB 858,00 € 4 NL-9514BV-16
6352 place order Aiden 2018/02/13 17:53:22.000 APPLE iPhone 6 16 GB 639,00 € 2 NL-9514BV-16
6317 send invoice Jack 2018/02/13 18:45:30.000 APPLE iPhone 6s 64 GB 858,00 € 5 NL-7907EJ-42
6353 place order Sophia 2018/02/13 20:16:20.000 APPLE iPhone 5s 16 GB 449,00 € 4 NL-7751AR-19
… … …. … … … … …
event =
case +
activity +
timestamp +
…
© Wil van der Aalst (use only with permission & acknowledgements)
Let’s look at orders 6350, 6351, and 6352
Case ID Activity Timestamp
6350 place order 2018/02/13 14:29:45.000
6351 place order 2018/02/13 16:17:37.000
6352 place order 2018/02/13 17:53:22.000
6352 send invoice 2018/02/19 09:20:28.000
6351 send invoice 2018/02/19 16:08:07.000
6350 send invoice 2018/02/21 09:38:16.000
6350 pay 2018/03/02 12:39:37.000
6352 pay 2018/03/05 15:46:47.000
6351 cancel order 2018/03/06 10:17:01.000
6350 prepare delivery 2018/03/07 13:50:35.000
6350 make delivery 2018/03/07 16:41:01.000
6350 confirm payment 2018/03/07 16:53:00.000
6352 prepare delivery 2018/03/07 17:05:59.000
6352 confirm payment 2018/03/07 17:59:55.000
6352 make delivery 2018/03/08 09:54:36.000
© Wil van der Aalst (use only with permission & acknowledgements)
Let’s look at orders 6350, 6351, and 6352
Case ID Activity Timestamp
6350 place order 2018/02/13 14:29:45.000
6351 place order 2018/02/13 16:17:37.000
6352 place order 2018/02/13 17:53:22.000
6352 send invoice 2018/02/19 09:20:28.000
6351 send invoice 2018/02/19 16:08:07.000
6350 send invoice 2018/02/21 09:38:16.000
6350 pay 2018/03/02 12:39:37.000
6352 pay 2018/03/05 15:46:47.000
6351 cancel order 2018/03/06 10:17:01.000
6350 prepare delivery 2018/03/07 13:50:35.000
6350 make delivery 2018/03/07 16:41:01.000
6350 confirm payment 2018/03/07 16:53:00.000
6352 prepare delivery 2018/03/07 17:05:59.000
6352 confirm payment 2018/03/07 17:59:55.000
6352 make delivery 2018/03/08 09:54:36.000
place order
send invoice
pay
prepare delivery
make delivery
confirm payment
place order
send invoice
cancel order
place order
send invoice
pay
prepare delivery
confirm payment
make delivery
order 6350 order 6351 order 6352
© Wil van der Aalst (use only with permission & acknowledgements)
Using the whole event log
Case ID Activity Timestamp
6350 place order 2018/02/13 14:29:45.000
6351 place order 2018/02/13 16:17:37.000
6352 place order 2018/02/13 17:53:22.000
6352 send invoice 2018/02/19 09:20:28.000
6351 send invoice 2018/02/19 16:08:07.000
6350 send invoice 2018/02/21 09:38:16.000
6350 pay 2018/03/02 12:39:37.000
6352 pay 2018/03/05 15:46:47.000
6351 cancel order 2018/03/06 10:17:01.000
6350 prepare delivery 2018/03/07 13:50:35.000
6350 make delivery 2018/03/07 16:41:01.000
6350 confirm payment 2018/03/07 16:53:00.000
6352 prepare delivery 2018/03/07 17:05:59.000
6352 confirm payment 2018/03/07 17:59:55.000
6352 make delivery 2018/03/08 09:54:36.000
place order
send invoice
pay
prepare delivery
make delivery
confirm payment
place order
send invoice
cancel order
place order
send invoice
pay
prepare delivery
confirm payment
make delivery
8016 x
1651 x
2962 x
place order
pay
send invoice
prepare delivery
make delivery
confirm payment
place order
pay
send invoice
prepare delivery
confirm payment
make delivery
30 x 7 x
© Wil van der Aalst (use only with permission & acknowledgements)
Using the whole event log
place order
send invoice
pay
prepare delivery
make delivery
confirm payment
place order
send invoice
cancel order
place order
send invoice
pay
prepare delivery
confirm payment
make delivery
8016 x
1651 x
2962 x
place order
pay
send invoice
prepare delivery
make delivery
confirm payment
place order
pay
send invoice
prepare delivery
confirm payment
make delivery
30 x 7 x
© Wil van der Aalst (use only with permission & acknowledgements)
Performance and Compliance
What happens?
Where are the bottlenecks?
Where do we deviate from the happy path?
© Wil van der Aalst (use only with permission & acknowledgements)
control-flow discovery
conformance checking
root-cause analysis
performance analysis
predictive process analytics
decision mining
organization/social network mining
automated process improvement
responsible process mining
full process discovery
© Wil van der Aalst (use only with permission & acknowledgements)
Control-flow: Backbone of any process
time/frequencies
data/decisions
resources/organization
costs etc.
© Wil van der Aalst (use only with permission & acknowledgements)
Initial focus academia
Classical Petri nets
© Wil van der Aalst (use only with permission & acknowledgements)
Initial focus industry
Directly Follows Graphs
time/frequencies
© Wil van der Aalst (use only with permission & acknowledgements)
Towards a more complete picture
time/frequencies
data/decisions
resources/organization
costs etc.
conformance checking
discovery
descriptive process models
predictive process models
prescriptive process models
© Wil van der Aalst (use only with permission & acknowledgements)
Towards a more complete picture
time/frequencies
data/decisions
resources/organization
costs etc.
from offline to online
from insights to action
© Wil van der Aalst (use only with permission & acknowledgements)
Why should I care?
© Wil van der Aalst (use only with permission & acknowledgements)
One year to get “Kindergeld”
and “Kinderzuschläge”
having 0,1,3, 4 children and
dealing with friction within
and between four
organizations.
>25 letters, >35 phone calls
Example
© Wil van der Aalst (use only with permission & acknowledgements)
80 / 20Good news: 80% of the cases are described by 20% of the variants
Bad news: the remaining 20% of the cases account for 80% of the variants
and these may take 80% of the time (operational friction)
© Wil van der Aalst (use only with permission & acknowledgements)
Example: Process Mining @ Siemens
(thanks to Lars Reinkemeyer, head of process mining Siemens)
• > 6000 active Celonis users
(P2P, O2C, etc.)
• Millions of savings by reducing
rework, process unification, etc.
• Improved reliability and
responsiveness.
• At an amazing scale, e.g., Order
to Cash (O2C) process with
>30M cases, >300M events, and
>900K variants.
© Wil van der Aalst (use only with permission & acknowledgements)
data process
process mining
© Wil van der Aalst (use only with permission & acknowledgements)
BPM reality
process mining
© Wil van der Aalst (use only with permission & acknowledgements)
IT business
process mining
© Wil van der Aalst (use only with permission & acknowledgements)
• 1999 start of process mining research at TU/e
• 2000-2002 Alpha and Heuristic miner
• 2004 first version of ProM
• 2004-2006 token-based conformance checking,
organization mining, decision mining, etc.
• 2007 first process mining company (Futura PI)
• 2009 IEEE Task Force on Process Mining created
• 2010 alignment-based conformance checking
• 2011 first process mining book
• 2011 Process Mining Manifesto published
• 2014 Coursera process mining MOOC
• 2016 “Process mining: data science in action” book
• 2018 Market Guide for Process Mining by Gartner
• 2018 25+ process mining companies
• 2018 Celonis becomes a Unicorn
• 2019 First ICPM conference
Milestones
20 years of process mining
© Wil van der Aalst (use only with permission & acknowledgements)
Accomplishments
“from an academic puzzle to something that works in the real world”
© Wil van der Aalst (use only with permission & acknowledgements)
Scientific publications on process mining
(Scopus, June 2019)
© Wil van der Aalst (use only with permission & acknowledgements)
Scientific publications on process mining
(Scopus, June 2019)
start
process
mining
at TU/e
Alpha
miner
and
Heuristic
miner
first
version
of ProM
first
process
mining
company
(Futura PI)
Celonis
Fluxicon
first
process
mining
book
second
process
mining
book
many new
process
mining
companies
created
ProcessGold
PM
manifesto
IEEE
Task
Force
Examples of progress in:
- process discovery
- conformance checking
- tooling
© Wil van der Aalst (use only with permission & acknowledgements)
Progress in Process Discovery
(Disclaimer: not intended to be complete, but to illustrate the steps towards maturity.)
© Wil van der Aalst (use only with permission & acknowledgements)
Alpha Algorithm in Action (2001)
© Wil van der Aalst (use only with permission & acknowledgements)
Alpha Algorithm in Action (2001)
b
p({a},{e})
oLaiL
c
e
f
d
p({e},{f})
p({b},{c,f})p({a,d},{b})
p({c},{d})
© Wil van der Aalst (use only with permission & acknowledgements)
Problems Alpha Algorithm and the Like
• Inability to distinguish frequent from infrequent
behavior 
• May yield unsound process models 
• Representational bias that is too narrow 
a b
start endp1
c
p1
© Wil van der Aalst (use only with permission & acknowledgements)
Problems Alpha Algorithm and the Like
• Inability to distinguish frequent from infrequent
behavior 
• May yield unsound process models 
• Representational bias that is too narrow 
a b
start endp1
c
τ
p1
© Wil van der Aalst (use only with permission & acknowledgements)
Heuristic Miner (2002-2011 Ton Weijters, 2017-2019 Felix Mannhardt)
filtered causal graph C-net Petri net
Able to filter out infrequent behavior 
Able to discover inclusive splits/joins and skips 
Models may be unsound 
unfiltered DFG
© Wil van der Aalst (use only with permission & acknowledgements)
Inductive Miner (2013-2019 Sander Leemans)
all paths and all activities
only the most frequent paths and activities
Able to filter out infrequent behavior 
Able to discover inclusive splits/joins and skips 
Models are guaranteed to be sound 
© Wil van der Aalst (use only with permission & acknowledgements)
Not a solved problem!
• Many other approaches (state-based regions,
language-based regions, split miner, etc.).
• Human is still able to outperform algorithms.
• Representational bias is still problematic (e.g.,
multiple instances, label splitting, and non-local
dependencies).
• Performance issues for more advanced approaches.
• Most commercial tools still use simple DFGs 
© Wil van der Aalst (use only with permission & acknowledgements)
Progress in Conformance Checking
(Disclaimer: not intended to be complete, but to illustrate the steps towards maturity.)
© Wil van der Aalst (use only with permission & acknowledgements)
Naïve approaches based on comparing
process graphs / footprint matrices (2003)
Log represented by a DFG
or footprint matrix
Process model is a graph and can
be used to create a footprint matrix
Very sensitive to the abstraction used 
Very different behaviors can have similar graphs/matrices 
Similar behaviors can lead to different graphs/matrices 
No reliable diagnostics and not linked directly to events/cases 
© Wil van der Aalst (use only with permission & acknowledgements)
Token-based replay (Anne Rozinat 2005-2010, Alessandro Berti 2019)
p=2654 r=0
c=2654 m=0
p=2654 r=0
c=2654 m=0
p=2338 r=492
c=2066 m=220
p=2654 r=91
c=2563 m=0
p=2563 r=225
c=2338 m=0
p=2066 r=428
c=1638 m=0
Fitness example = 0.9102382
© Wil van der Aalst (use only with permission & acknowledgements)
Token-based replay (Anne Rozinat 2005-2010, Alessandro Berti 2019)
Fitness = 0.9102382
220 times the activity happened when it
was impossible (according to the model)
492 times the activity did not happen when
it was supposed to happen
Addresses all the problems mentioned for the naïve approaches 
Does not provide valid paths through the model 
Diagnostics tend to be misleading (token flooding) 
© Wil van der Aalst (use only with permission & acknowledgements)
Alignments (2010-2013 Arya Adriansyah)
1849 synchronous moves
805 move in model only
2651 synchronous moves
3 moves in model only
many moves on log
Addresses the problems of token-based replay
and yields paths though the model 
Still time consuming 
Diagnostics tend to be rather arbitrary 
Fitness = 0.7964
© Wil van der Aalst (use only with permission & acknowledgements)
Not a solved problem!
• Fitness is well understood, but there are multiple measures
possible.
• There is no consensus on the other three quality
dimensions (precision, simplicity, and generalization).
• Alignments are very powerful but also still time-consuming.
• Less than half of the commercial tools support
conformance checking (and rarely alignments) 
• Still a gap between BPMN modeling tools and process
mining 
© Wil van der Aalst (use only with permission & acknowledgements)
Two examples covering 20 years of research
Alpha
algorithm
Heuristic
miner
Inductive
miner
Matrix/graph
comparison
Token-based
replay
Alignments
process discovery
conformance checking
1999 2019
© Wil van der Aalst (use only with permission & acknowledgements)
Process Mining Books
© Wil van der Aalst (use only with permission & acknowledgements)
Progress in Tooling
© Wil van der Aalst (use only with permission & acknowledgements)
ProM 6.X (>1500 plugins)
(2010-now)
Open-Source Process Mining Software
(far from complete)
ProM 1.1-5.2 (>286 plugins)
(2004-2010)
MiMo
(2001-2002)
EMiT
(2002-2004)
Thumb
(2002-2004)
InWolvE
(2000-2004)
RapidProM
(2014-now)
Apromore
(2015*-now)
PM4Py
(2018-now)
bupaR
(2016-now)
convergence divergence
© Wil van der Aalst (use only with permission & acknowledgements)
Futura Process Intelligence
(Peter van den Brand, started 2007, Gartner Cool Vendor 2009)
PM vendors in 2009
© Wil van der Aalst (use only with permission & acknowledgements)
Disco - Lowering the threshold to do process mining
(Anne Rozinat & Christian Günther, Fluxicon started in 2009 )
600+
© Wil van der Aalst (use only with permission & acknowledgements)
Over 30 process mining vendors today
Etc.
© Wil van der Aalst (use only with permission & acknowledgements)
Trend: From Ad-Hoc to Continuous PM
(e.g., Celonis and ProcessGold)
From data scientists to process managers and from insights to actions.
© Wil van der Aalst (use only with permission & acknowledgements)
Terminology: Avoid the temptation …
(process mining is broad, but also specific: event data & process models)
• Process mining
• Workflow mining (my mistake)
• Automated business process discovery (Gartner)
• Business process intelligence
• Process intelligence
• Business intelligence
• Process analytics
• Business process analytics
• …
© Wil van der Aalst (use only with permission & acknowledgements)
Challenges
“towards better processes”
© Wil van der Aalst (use only with permission & acknowledgements)
Process Mining Manifesto (2011)
Six guiding principles and 11 challenges:
1. Finding, Merging, and Cleaning Event Data
2. Dealing with Complex Event Logs Having Diverse Characteristics
3. Creating Representative Benchmarks
4. Dealing with Concept Drift
5. Improving the Representational Bias Used for Process Discovery
6. Balancing Between Quality Criteria
7. Cross-Organizational Mining
8. Providing Operational Support
9. Combining Process Mining With Other Types of Analysis
10. Improving Usability for Non-Experts
11. Improving Understandability for Non-Experts
© Wil van der Aalst (use only with permission & acknowledgements)
Process Mining Manifesto (2011)
Six guiding principles and 11 challenges:
1. Finding, Merging, and Cleaning Event Data
2. Dealing with Complex Event Logs Having Diverse Characteristics
3. Creating Representative Benchmarks
4. Dealing with Concept Drift
5. Improving the Representational Bias Used for Process Discovery
6. Balancing Between Quality Criteria
7. Cross-Organizational Mining
8. Providing Operational Support
9. Combining Process Mining With Other Types of Analysis
10. Improving Usability for Non-Experts
11. Improving Understandability for Non-Experts
* green = addressed to some degree, red=still open, orange = less imported as expected
© Wil van der Aalst (use only with permission & acknowledgements)
“Old” Challenges
© Wil van der Aalst (use only with permission & acknowledgements)
process discovery
conformance checking
measuring model quality
data extraction
© Wil van der Aalst (use only with permission & acknowledgements)
From backward looking
to forward looking
© Wil van der Aalst (use only with permission & acknowledgements)
From backward to forward looking
historic current tomorrow
© Wil van der Aalst (use only with permission & acknowledgements)
From backward to forward looking
quality of predictions needs to improve
predictions need to be turned into actions
© Wil van der Aalst (use only with permission & acknowledgements)
Context matters!
© Wil van der Aalst (use only with permission & acknowledgements)
Better integration of
process discovery,
conformance checking,
and process modeling
© Wil van der Aalst (use only with permission & acknowledgements)
Hybrid process models are needed showing both
the “sure/formal” and the “unsure/informal” parts.
© Wil van der Aalst (use only with permission & acknowledgements)
Process modeling with “haptic
feedback” based on data
Interactive process modeling still outperforms
fully automated discovery techniques.
© Wil van der Aalst (use only with permission & acknowledgements)
Better support for
comparative process
mining
© Wil van der Aalst (use only with permission & acknowledgements)
© Wil van der Aalst (use only with permission & acknowledgements)
© Wil van der Aalst (use only with permission & acknowledgements)
What are the differences?
(different periods, departments, customer groups)
Recall comment on
just comparing graphs.
© Wil van der Aalst (use only with permission & acknowledgements)
What are the differences?
(different periods, departments, customer groups)
More difficult are differences in frequencies, times, etc.
© Wil van der Aalst (use only with permission & acknowledgements)
Considering causality and
fairness to suggest more
meaningful improvements
© Wil van der Aalst (use only with permission & acknowledgements)
Process mining can be used to identify
compliance and performance problems
• mandatory activity is skipped
• activity is performed too late
• wrong order
• unauthorized resource
• bottlenecks and delays
• unnecessary rework
• waste
• overproduction
Process mining can be used to show the root causes of such problems, but …
If Wil works on a case,
check activities are more
likely to be skipped.
Cases for this supplier
tend to have many
price changes.
In this department,
checks are performed
after the legal deadline.
There are often
delays in the back
office on Fridays.
© Wil van der Aalst (use only with permission & acknowledgements)
Root case analysis?
flowtime
deviations 
crimerate
ice cream sales 
© Wil van der Aalst (use only with permission & acknowledgements)
Correlation ≠ Causality
crimerate
ice cream sales 
crimerate
temperature
icecreamsales
temperature 
© Wil van der Aalst (use only with permission & acknowledgements)
Fairness
• Don’t blame overloaded resources for causing
bottlenecks.
• Don’t blame the most experienced resources taking
the most difficult cases for deviating.
• Discrimination-aware data/process mining aims to
avoid such errors.
• Trade-off between fairness and accuracy.
© Wil van der Aalst (use only with permission & acknowledgements)
Making process mining
results actionable
(e.g., the RPA connection)
© Wil van der Aalst (use only with permission & acknowledgements)
diagnosis action
operational support
(alerting, prediction,
recommendations)
process
reengineering
© Wil van der Aalst (use only with permission & acknowledgements)
Process-mining-informed automation (RPA)
case
frequency
(number of similar
cases in a given
period)
different
types of cases
(sorted by
frequency)
traditional
process
automation
Robotic Process Automation
(RPA)
candidates
work that can
only be done by
humans
© Wil van der Aalst (use only with permission & acknowledgements)
Ensuring
confidentiality in
process mining
© Wil van der Aalst (use only with permission & acknowledgements)
Name Activity Date Time From To
WvdA check-in 30-8-19 8:20 CGN VIE
WvdA drop-bag 1-9-19 9:20 CGN VIE
WvdA board 1-9-19 9:40 CGN VIE
… … … … … …
WvdA check-in 15-9-19 22:58 DUS OSL
WvdA drop-bag 17-9-19 18:38 DUS OSL
WvdA board 17-9-19 19:10 DUS OSL
… … … … … …
WvdA check-in 23-9-19 22:46 DUS NRT
WvdA drop-bag 24-9-19 16:18 DUS NRT
WvdA board 24-9-19 17:12 DUS NRTEvent data are
very sensitive!
© Wil van der Aalst (use only with permission & acknowledgements)
Name Activity Date Time From To
#6@7 check-in 30-8-19 8:20 CGN VIE
#6@7 drop-bag 1-9-19 9:20 CGN VIE
#6@7 board 1-9-19 9:40 CGN VIE
… … … … … …
#6@7 check-in 15-9-19 22:58 DUS OSL
#6@7 drop-bag 17-9-19 18:38 DUS OSL
#6@7 board 17-9-19 19:10 DUS OSL
… … … … … …
#6@7 check-in 23-9-19 22:46 DUS NRT
#6@7 drop-bag 24-9-19 16:18 DUS NRT
#6@7 board 24-9-19 17:12 DUS NRT
© Wil van der Aalst (use only with permission & acknowledgements)
Name Activity Date Time From To
#6@7 check-in 30-8-19 VIE
#6@7 drop-bag 1-9-19 VIE
#6@7 board 1-9-19 VIE
… … … …
#6@7 check-in 15-9-19 OSL
#6@7 drop-bag 17-9-19 OSL
#6@7 board 17-9-19 OSL
… … … …
#6@7 check-in 23-9-19 NRT
#6@7 drop-bag 24-9-19 NRT
#6@7 board 24-9-19 NRT
© Wil van der Aalst (use only with permission & acknowledgements)
event
data
encrypted
data
desired
result
Minimal information
needed to get the
result, e.g. a DFG.
© Wil van der Aalst (use only with permission & acknowledgements)
Many open challenges and
opportunities …
Therefore, we are looking for PhDs and
Postdocs that would like make a
difference!
© Wil van der Aalst (use only with permission & acknowledgements)
Conclusion
“recommendations”
© Wil van der Aalst (use only with permission & acknowledgements)
From event report:
, but the speed is accelerating!!
Adoption is slow …
© Wil van der Aalst (use only with permission & acknowledgements)
Free Advice
© Wil van der Aalst (use only with permission & acknowledgements)
For process mining users …
• You get the tools you deserve. If you do not ask for it, you
will not get it.
• You need: Domain/business expertise, knowledge of the
information systems, and data science skills (i.e., different
people). If one element is missing, you will fail.
• You can only make a business case if you are able to apply
process mining continuously (when 80% is spent on data
extraction, you want to use this multiple times).
• But, the business case is typically much better than most
BPM, process modeling, Six Sigma, etc. initiatives.
© Wil van der Aalst (use only with permission & acknowledgements)
For process mining vendors …
• Try to better adopt ideas from academia and provide
feedback (even when you still need to do the engineering).
• Going beyond DFGs is unavoidable if you want to stay in
business.
• Advanced features will only be used if they are usable and
made scalable (adding conformance half-heartedly will not
help your customers).
• Riding the AI/ML wave may backfire.
• Initiatives like XES will not help you sell more licenses, but
help to establish process mining as a discipline.
© Wil van der Aalst (use only with permission & acknowledgements)
For academics …
• Good news: Many open problems!
• But:
− Get your own case studies (“eat your own dog food”).
− Avoid working on techniques that do slightly better on
selected data sets using well selected criteria (even when
these papers still get accepted).
− Work on original problems or use truly original approaches
(even when your paper gets rejected at first).
− Understand why vendors are still using simple DFGs.
− In the end, we would like improve processes, right?
© Wil van der Aalst (use only with permission & acknowledgements)
Enjoy

More Related Content

What's hot

Introduction au big data
Introduction au big dataIntroduction au big data
Introduction au big dataAbdelghani Azri
 
Protect your Database with Data Masking & Enforced Version Control
Protect your Database with Data Masking & Enforced Version Control	Protect your Database with Data Masking & Enforced Version Control
Protect your Database with Data Masking & Enforced Version Control DBmaestro - Database DevOps
 
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéen
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéenMMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéen
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéenInstitut de l'Elevage - Idele
 
La Business Intelligence
La Business Intelligence La Business Intelligence
La Business Intelligence Khchaf Mouna
 
Data Governance PowerPoint Presentation Slides
Data Governance PowerPoint Presentation Slides Data Governance PowerPoint Presentation Slides
Data Governance PowerPoint Presentation Slides SlideTeam
 
Free Sample : Le RGPD-GDPR les fondamentaux
Free Sample : Le RGPD-GDPR les fondamentauxFree Sample : Le RGPD-GDPR les fondamentaux
Free Sample : Le RGPD-GDPR les fondamentauxMichael DI ROCCO
 
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...Jordano Santos Cerqueira
 
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...Institut de l'Elevage - Idele
 
Data Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsData Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsAT Internet
 
Transforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyTransforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyDatabricks
 
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...DATAVERSITY
 
Process Mining - Chapter 1 - Introduction
Process Mining - Chapter 1 - IntroductionProcess Mining - Chapter 1 - Introduction
Process Mining - Chapter 1 - IntroductionWil van der Aalst
 
Stammdaten als Erfolgsfaktor moderner Unternehmen
Stammdaten als Erfolgsfaktor moderner UnternehmenStammdaten als Erfolgsfaktor moderner Unternehmen
Stammdaten als Erfolgsfaktor moderner UnternehmenBoris Otto
 
Was tun bei einer Datenpanne? Das verlangt die DSGVO
Was tun bei einer Datenpanne? Das verlangt die DSGVOWas tun bei einer Datenpanne? Das verlangt die DSGVO
Was tun bei einer Datenpanne? Das verlangt die DSGVOMichael Rohrlich
 
Process Mining - Chapter 7 - Conformance Checking
Process Mining - Chapter 7 - Conformance CheckingProcess Mining - Chapter 7 - Conformance Checking
Process Mining - Chapter 7 - Conformance CheckingWil van der Aalst
 
Measurecamp Brussels - Synthetic data.pdf
Measurecamp Brussels - Synthetic data.pdfMeasurecamp Brussels - Synthetic data.pdf
Measurecamp Brussels - Synthetic data.pdfHuman37
 

What's hot (20)

Introduction au big data
Introduction au big dataIntroduction au big data
Introduction au big data
 
Protect your Database with Data Masking & Enforced Version Control
Protect your Database with Data Masking & Enforced Version Control	Protect your Database with Data Masking & Enforced Version Control
Protect your Database with Data Masking & Enforced Version Control
 
Die 5 häufigsten Irrtümer zu BPMN
Die 5 häufigsten Irrtümer zu BPMNDie 5 häufigsten Irrtümer zu BPMN
Die 5 häufigsten Irrtümer zu BPMN
 
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéen
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéenMMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéen
MMX2023 Viande - Les échanges d'animaux vivants dans le bassin méditerranéen
 
Data mining - Associativité
Data mining - AssociativitéData mining - Associativité
Data mining - Associativité
 
La Business Intelligence
La Business Intelligence La Business Intelligence
La Business Intelligence
 
Data Governance PowerPoint Presentation Slides
Data Governance PowerPoint Presentation Slides Data Governance PowerPoint Presentation Slides
Data Governance PowerPoint Presentation Slides
 
Free Sample : Le RGPD-GDPR les fondamentaux
Free Sample : Le RGPD-GDPR les fondamentauxFree Sample : Le RGPD-GDPR les fondamentaux
Free Sample : Le RGPD-GDPR les fondamentaux
 
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...
Direito das Sucessões - Faceli - Unidade II - Casos concretos de sucessão leg...
 
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...
MMX2023 Lait - Marchés des ingrédients laitiers : nouvelle source de valeur p...
 
chap3.pdf
chap3.pdfchap3.pdf
chap3.pdf
 
Data Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethicsData Privacy: What you need to know about privacy, from compliance to ethics
Data Privacy: What you need to know about privacy, from compliance to ethics
 
Transforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform StrategyTransforming GE Healthcare with Data Platform Strategy
Transforming GE Healthcare with Data Platform Strategy
 
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...
Conformed Dimensions of Data Quality – An Organized Approach to Data Quality ...
 
Process Mining - Chapter 1 - Introduction
Process Mining - Chapter 1 - IntroductionProcess Mining - Chapter 1 - Introduction
Process Mining - Chapter 1 - Introduction
 
Stammdaten als Erfolgsfaktor moderner Unternehmen
Stammdaten als Erfolgsfaktor moderner UnternehmenStammdaten als Erfolgsfaktor moderner Unternehmen
Stammdaten als Erfolgsfaktor moderner Unternehmen
 
Was tun bei einer Datenpanne? Das verlangt die DSGVO
Was tun bei einer Datenpanne? Das verlangt die DSGVOWas tun bei einer Datenpanne? Das verlangt die DSGVO
Was tun bei einer Datenpanne? Das verlangt die DSGVO
 
Chapitre i-intro
Chapitre i-introChapitre i-intro
Chapitre i-intro
 
Process Mining - Chapter 7 - Conformance Checking
Process Mining - Chapter 7 - Conformance CheckingProcess Mining - Chapter 7 - Conformance Checking
Process Mining - Chapter 7 - Conformance Checking
 
Measurecamp Brussels - Synthetic data.pdf
Measurecamp Brussels - Synthetic data.pdfMeasurecamp Brussels - Synthetic data.pdf
Measurecamp Brussels - Synthetic data.pdf
 

Similar to 20 years of Process Mining Research (ICPM 2019 keynote)

Process Mining: Past, Present, and Future
Process Mining: Past, Present, and FutureProcess Mining: Past, Present, and Future
Process Mining: Past, Present, and FutureCelonis
 
Using Process Mining to Remove Operational Friction in Shared Services
Using Process Mining to Remove Operational Friction in Shared ServicesUsing Process Mining to Remove Operational Friction in Shared Services
Using Process Mining to Remove Operational Friction in Shared ServicesWil van der Aalst
 
New winning combination lp and finance belk sally beauty and profitect present
New winning combination lp and finance belk sally beauty and profitect presentNew winning combination lp and finance belk sally beauty and profitect present
New winning combination lp and finance belk sally beauty and profitect presentNational Retail Federation
 
Financial analysis edf sa (electricite de france) produces, transmits, dist...
Financial analysis   edf sa (electricite de france) produces, transmits, dist...Financial analysis   edf sa (electricite de france) produces, transmits, dist...
Financial analysis edf sa (electricite de france) produces, transmits, dist...BCV
 
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...confluent
 
viability-presentation-se-98b.pptx
viability-presentation-se-98b.pptxviability-presentation-se-98b.pptx
viability-presentation-se-98b.pptxSAYKEATTAN
 

Similar to 20 years of Process Mining Research (ICPM 2019 keynote) (8)

Process Mining: Past, Present, and Future
Process Mining: Past, Present, and FutureProcess Mining: Past, Present, and Future
Process Mining: Past, Present, and Future
 
Using Process Mining to Remove Operational Friction in Shared Services
Using Process Mining to Remove Operational Friction in Shared ServicesUsing Process Mining to Remove Operational Friction in Shared Services
Using Process Mining to Remove Operational Friction in Shared Services
 
2047.pdf
2047.pdf2047.pdf
2047.pdf
 
New winning combination lp and finance belk sally beauty and profitect present
New winning combination lp and finance belk sally beauty and profitect presentNew winning combination lp and finance belk sally beauty and profitect present
New winning combination lp and finance belk sally beauty and profitect present
 
Financial analysis edf sa (electricite de france) produces, transmits, dist...
Financial analysis   edf sa (electricite de france) produces, transmits, dist...Financial analysis   edf sa (electricite de france) produces, transmits, dist...
Financial analysis edf sa (electricite de france) produces, transmits, dist...
 
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...
Privacy Engineering for the World of Kafka (Alexander Cook, Privitar) Kafka S...
 
viability-presentation-se-98b.pptx
viability-presentation-se-98b.pptxviability-presentation-se-98b.pptx
viability-presentation-se-98b.pptx
 
Guias anuladas
Guias anuladasGuias anuladas
Guias anuladas
 

More from Wil van der Aalst

Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)
Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)
Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)Wil van der Aalst
 
Earth Movers’ Stochastic Conformance Checking
Earth Movers’ Stochastic Conformance CheckingEarth Movers’ Stochastic Conformance Checking
Earth Movers’ Stochastic Conformance CheckingWil van der Aalst
 
Event Logs: What kind of data does process mining require?
Event Logs: What kind of data does process mining require?Event Logs: What kind of data does process mining require?
Event Logs: What kind of data does process mining require?Wil van der Aalst
 
Configurable Declare: Designing Customizable Flexible Models
Configurable Declare: Designing Customizable Flexible ModelsConfigurable Declare: Designing Customizable Flexible Models
Configurable Declare: Designing Customizable Flexible ModelsWil van der Aalst
 
A Decade of Business Process Management Conferences: Reflections on a Develop...
A Decade of Business Process Management Conferences: Reflections on a Develop...A Decade of Business Process Management Conferences: Reflections on a Develop...
A Decade of Business Process Management Conferences: Reflections on a Develop...Wil van der Aalst
 
Business Process Configuration in the Cloud: How to Support and Analyze Multi...
Business Process Configuration in the Cloud: How to Support and Analyze Multi...Business Process Configuration in the Cloud: How to Support and Analyze Multi...
Business Process Configuration in the Cloud: How to Support and Analyze Multi...Wil van der Aalst
 
Discovering Concurrency: Learning (Business) Process Models from Examples
Discovering Concurrency: Learning (Business) Process Models from ExamplesDiscovering Concurrency: Learning (Business) Process Models from Examples
Discovering Concurrency: Learning (Business) Process Models from ExamplesWil van der Aalst
 
Distributed Process Discovery and Conformance Checking
Distributed Process Discovery and Conformance CheckingDistributed Process Discovery and Conformance Checking
Distributed Process Discovery and Conformance CheckingWil van der Aalst
 
Service Interaction: Patterns, Formalization, and Analysis
Service Interaction: Patterns, Formalization, and AnalysisService Interaction: Patterns, Formalization, and Analysis
Service Interaction: Patterns, Formalization, and AnalysisWil van der Aalst
 
Keynote Gartner Business Process Management Summit, February 2009, London
Keynote Gartner Business Process Management Summit, February 2009, London Keynote Gartner Business Process Management Summit, February 2009, London
Keynote Gartner Business Process Management Summit, February 2009, London Wil van der Aalst
 
Keynote on Process Mining at SSCI 2010 / CIDM 2011
Keynote on Process Mining at SSCI 2010 / CIDM 2011Keynote on Process Mining at SSCI 2010 / CIDM 2011
Keynote on Process Mining at SSCI 2010 / CIDM 2011Wil van der Aalst
 
Discovering Petri Nets: Evidence-Based Business Process Management
Discovering Petri Nets: Evidence-Based Business Process ManagementDiscovering Petri Nets: Evidence-Based Business Process Management
Discovering Petri Nets: Evidence-Based Business Process ManagementWil van der Aalst
 
TomTom for Business Process Managment (TomTom4BPM)
TomTom for Business Process Managment (TomTom4BPM)TomTom for Business Process Managment (TomTom4BPM)
TomTom for Business Process Managment (TomTom4BPM)Wil van der Aalst
 
Keynote at 18th International Conference on Cooperative Information Systems (...
Keynote at 18th International Conference on Cooperative Information Systems (...Keynote at 18th International Conference on Cooperative Information Systems (...
Keynote at 18th International Conference on Cooperative Information Systems (...Wil van der Aalst
 
Process Mining - Chapter 14 - Epilogue
Process Mining - Chapter 14 - EpilogueProcess Mining - Chapter 14 - Epilogue
Process Mining - Chapter 14 - EpilogueWil van der Aalst
 
Process Mining - Chapter 12 - Analyzing Spaghetti Processes
Process Mining - Chapter 12 - Analyzing Spaghetti ProcessesProcess Mining - Chapter 12 - Analyzing Spaghetti Processes
Process Mining - Chapter 12 - Analyzing Spaghetti ProcessesWil van der Aalst
 
Process Mining - Chapter 11 - Analyzing Lasagna Processes
Process Mining - Chapter 11 - Analyzing Lasagna ProcessesProcess Mining - Chapter 11 - Analyzing Lasagna Processes
Process Mining - Chapter 11 - Analyzing Lasagna ProcessesWil van der Aalst
 
Process Mining - Chapter 10 - Tool Support
Process Mining - Chapter 10 - Tool SupportProcess Mining - Chapter 10 - Tool Support
Process Mining - Chapter 10 - Tool SupportWil van der Aalst
 
Process Mining - Chapter 9 - Operational Support
Process Mining - Chapter 9 - Operational SupportProcess Mining - Chapter 9 - Operational Support
Process Mining - Chapter 9 - Operational SupportWil van der Aalst
 
Process Mining - Chapter 8 - Mining Additional Perspectives
Process Mining - Chapter 8 - Mining Additional PerspectivesProcess Mining - Chapter 8 - Mining Additional Perspectives
Process Mining - Chapter 8 - Mining Additional PerspectivesWil van der Aalst
 

More from Wil van der Aalst (20)

Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)
Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)
Process Mining: BPM on Steroids (CPOs@BPM&O 2019 Keynote)
 
Earth Movers’ Stochastic Conformance Checking
Earth Movers’ Stochastic Conformance CheckingEarth Movers’ Stochastic Conformance Checking
Earth Movers’ Stochastic Conformance Checking
 
Event Logs: What kind of data does process mining require?
Event Logs: What kind of data does process mining require?Event Logs: What kind of data does process mining require?
Event Logs: What kind of data does process mining require?
 
Configurable Declare: Designing Customizable Flexible Models
Configurable Declare: Designing Customizable Flexible ModelsConfigurable Declare: Designing Customizable Flexible Models
Configurable Declare: Designing Customizable Flexible Models
 
A Decade of Business Process Management Conferences: Reflections on a Develop...
A Decade of Business Process Management Conferences: Reflections on a Develop...A Decade of Business Process Management Conferences: Reflections on a Develop...
A Decade of Business Process Management Conferences: Reflections on a Develop...
 
Business Process Configuration in the Cloud: How to Support and Analyze Multi...
Business Process Configuration in the Cloud: How to Support and Analyze Multi...Business Process Configuration in the Cloud: How to Support and Analyze Multi...
Business Process Configuration in the Cloud: How to Support and Analyze Multi...
 
Discovering Concurrency: Learning (Business) Process Models from Examples
Discovering Concurrency: Learning (Business) Process Models from ExamplesDiscovering Concurrency: Learning (Business) Process Models from Examples
Discovering Concurrency: Learning (Business) Process Models from Examples
 
Distributed Process Discovery and Conformance Checking
Distributed Process Discovery and Conformance CheckingDistributed Process Discovery and Conformance Checking
Distributed Process Discovery and Conformance Checking
 
Service Interaction: Patterns, Formalization, and Analysis
Service Interaction: Patterns, Formalization, and AnalysisService Interaction: Patterns, Formalization, and Analysis
Service Interaction: Patterns, Formalization, and Analysis
 
Keynote Gartner Business Process Management Summit, February 2009, London
Keynote Gartner Business Process Management Summit, February 2009, London Keynote Gartner Business Process Management Summit, February 2009, London
Keynote Gartner Business Process Management Summit, February 2009, London
 
Keynote on Process Mining at SSCI 2010 / CIDM 2011
Keynote on Process Mining at SSCI 2010 / CIDM 2011Keynote on Process Mining at SSCI 2010 / CIDM 2011
Keynote on Process Mining at SSCI 2010 / CIDM 2011
 
Discovering Petri Nets: Evidence-Based Business Process Management
Discovering Petri Nets: Evidence-Based Business Process ManagementDiscovering Petri Nets: Evidence-Based Business Process Management
Discovering Petri Nets: Evidence-Based Business Process Management
 
TomTom for Business Process Managment (TomTom4BPM)
TomTom for Business Process Managment (TomTom4BPM)TomTom for Business Process Managment (TomTom4BPM)
TomTom for Business Process Managment (TomTom4BPM)
 
Keynote at 18th International Conference on Cooperative Information Systems (...
Keynote at 18th International Conference on Cooperative Information Systems (...Keynote at 18th International Conference on Cooperative Information Systems (...
Keynote at 18th International Conference on Cooperative Information Systems (...
 
Process Mining - Chapter 14 - Epilogue
Process Mining - Chapter 14 - EpilogueProcess Mining - Chapter 14 - Epilogue
Process Mining - Chapter 14 - Epilogue
 
Process Mining - Chapter 12 - Analyzing Spaghetti Processes
Process Mining - Chapter 12 - Analyzing Spaghetti ProcessesProcess Mining - Chapter 12 - Analyzing Spaghetti Processes
Process Mining - Chapter 12 - Analyzing Spaghetti Processes
 
Process Mining - Chapter 11 - Analyzing Lasagna Processes
Process Mining - Chapter 11 - Analyzing Lasagna ProcessesProcess Mining - Chapter 11 - Analyzing Lasagna Processes
Process Mining - Chapter 11 - Analyzing Lasagna Processes
 
Process Mining - Chapter 10 - Tool Support
Process Mining - Chapter 10 - Tool SupportProcess Mining - Chapter 10 - Tool Support
Process Mining - Chapter 10 - Tool Support
 
Process Mining - Chapter 9 - Operational Support
Process Mining - Chapter 9 - Operational SupportProcess Mining - Chapter 9 - Operational Support
Process Mining - Chapter 9 - Operational Support
 
Process Mining - Chapter 8 - Mining Additional Perspectives
Process Mining - Chapter 8 - Mining Additional PerspectivesProcess Mining - Chapter 8 - Mining Additional Perspectives
Process Mining - Chapter 8 - Mining Additional Perspectives
 

Recently uploaded

100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptxAnupama Kate
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfMarinCaroMartnezBerg
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsappssapnasaifi408
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝soniya singh
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxJohnnyPlasten
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一ffjhghh
 
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...Suhani Kapoor
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Delhi Call girls
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...Florian Roscheck
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls DubaiDubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls Dubaihf8803863
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiSuhani Kapoor
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...dajasot375
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改atducpo
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Sapana Sha
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Callshivangimorya083
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPramod Kumar Srivastava
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...Suhani Kapoor
 

Recently uploaded (20)

Decoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in ActionDecoding Loan Approval: Predictive Modeling in Action
Decoding Loan Approval: Predictive Modeling in Action
 
100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx100-Concepts-of-AI by Anupama Kate .pptx
100-Concepts-of-AI by Anupama Kate .pptx
 
FESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdfFESE Capital Markets Fact Sheet 2024 Q1.pdf
FESE Capital Markets Fact Sheet 2024 Q1.pdf
 
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /WhatsappsBeautiful Sapna Vip  Call Girls Hauz Khas 9711199012 Call /Whatsapps
Beautiful Sapna Vip Call Girls Hauz Khas 9711199012 Call /Whatsapps
 
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
Call Girls in Defence Colony Delhi 💯Call Us 🔝8264348440🔝
 
E-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptxE-Commerce Order PredictionShraddha Kamble.pptx
E-Commerce Order PredictionShraddha Kamble.pptx
 
Log Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptxLog Analysis using OSSEC sasoasasasas.pptx
Log Analysis using OSSEC sasoasasasas.pptx
 
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一定制英国白金汉大学毕业证(UCB毕业证书)																			成绩单原版一比一
定制英国白金汉大学毕业证(UCB毕业证书) 成绩单原版一比一
 
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...
VIP High Class Call Girls Bikaner Anushka 8250192130 Independent Escort Servi...
 
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
Best VIP Call Girls Noida Sector 39 Call Me: 8448380779
 
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...From idea to production in a day – Leveraging Azure ML and Streamlit to build...
From idea to production in a day – Leveraging Azure ML and Streamlit to build...
 
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
(PARI) Call Girls Wanowrie ( 7001035870 ) HI-Fi Pune Escorts Service
 
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls DubaiDubai Call Girls Wifey O52&786472 Call Girls Dubai
Dubai Call Girls Wifey O52&786472 Call Girls Dubai
 
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service BhilaiLow Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
Low Rate Call Girls Bhilai Anika 8250192130 Independent Escort Service Bhilai
 
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
Indian Call Girls in Abu Dhabi O5286O24O8 Call Girls in Abu Dhabi By Independ...
 
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
代办国外大学文凭《原版美国UCLA文凭证书》加州大学洛杉矶分校毕业证制作成绩单修改
 
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
Saket, (-DELHI )+91-9654467111-(=)CHEAP Call Girls in Escorts Service Saket C...
 
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip CallDelhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
Delhi Call Girls CP 9711199171 ☎✔👌✔ Whatsapp Hard And Sexy Vip Call
 
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptxPKS-TGC-1084-630 - Stage 1 Proposal.pptx
PKS-TGC-1084-630 - Stage 1 Proposal.pptx
 
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
VIP High Class Call Girls Jamshedpur Anushka 8250192130 Independent Escort Se...
 

20 years of Process Mining Research (ICPM 2019 keynote)

  • 1. © Wil van der Aalst (use only with permission & acknowledgements) prof.dr.ir. Wil van der Aalst RWTH Aachen University W: vdaalst.com T:@wvdaalst 20 Years of Process Mining Research Accomplishments, Challenges, and Open Problems
  • 2. © Wil van der Aalst (use only with permission & acknowledgements) Positioning “bridging gaps”
  • 3. © Wil van der Aalst (use only with permission & acknowledgements) < 1999  1999 “process management by modeling” Process mining Process discovery Conformance checking Predictive analytics “process management by mining” Petri nets Concurrency theory BPM, WFM, etc. Simulation Formal methods
  • 4. © Wil van der Aalst (use only with permission & acknowledgements) Starting point: Event data event 71,043 events 12,666 cases 7 activities Case ID Activity Resource Timestamp product prod-price quantity address … … …. … …. … … … 6350 place order Aiden 2018/02/13 14:29:45.000 APPLE iPhone 6 16 GB 639,00 € 5 NL-7751DG-21 6283 pay Lily 2018/02/13 14:39:25.000 SAMSUNG Galaxy S6 32 GB 543.99 3 NL-7828AM-11a 6253 prepare delivery Sophia 2018/02/13 15:01:33.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7887AC-13 6257 prepare delivery Aiden 2018/02/13 15:03:43.000 SAMSUNG Galaxy S6 32 GB 543.99 1 NL-9521KJ-34 6185 confirm payment Emily 2018/02/13 15:05:36.000 SAMSUNG Galaxy S4 329,00 € 1 NL-9521GC-32 6218 confirm payment Emily 2018/02/13 15:08:11.000 APPLE iPhone 6s Plus 64 GB 969,00 € 2 NL-7948BX-10 6245 make delivery Michael 2018/02/13 15:14:04.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7905AX-38 6272 pay Emily 2018/02/13 15:20:36.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7821AC-3 6269 pay Charlotte 2018/02/13 15:25:21.000 SAMSUNG Galaxy S4 329,00 € 1 NL-7907EJ-42 6212 prepare delivery Sophia 2018/02/13 15:43:39.000 HUAWEI P8 Lite 234,00 € 1 NL-7905AX-38 6323 send invoice Alexander 2018/02/13 15:46:08.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7833HT-15 6246 confirm payment Jack 2018/02/13 15:56:03.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7833HT-15 6347 send invoice Jack 2018/02/13 15:57:42.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7905AX-38 6351 place order Zoe 2018/02/13 16:17:37.000 APPLE iPhone 5s 16 GB 449,00 € 3 NL-9521GC-32 6204 prepare delivery Sophia 2018/02/13 16:31:28.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a 6204 make delivery Kaylee 2018/02/13 16:51:54.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a 6265 confirm payment Lily 2018/02/13 16:55:55.000 SAMSUNG Galaxy S4 329,00 € 4 NL-9521GC-32 6250 confirm payment Jack 2018/02/13 17:03:26.000 MOTOROLA Moto G 199,00 € 4 NL-7942GT-2 6328 send invoice Lily 2018/02/13 17:30:16.000 APPLE iPhone 6s 64 GB 858,00 € 4 NL-9514BV-16 6352 place order Aiden 2018/02/13 17:53:22.000 APPLE iPhone 6 16 GB 639,00 € 2 NL-9514BV-16 6317 send invoice Jack 2018/02/13 18:45:30.000 APPLE iPhone 6s 64 GB 858,00 € 5 NL-7907EJ-42 6353 place order Sophia 2018/02/13 20:16:20.000 APPLE iPhone 5s 16 GB 449,00 € 4 NL-7751AR-19 … … …. … … … … …
  • 5. © Wil van der Aalst (use only with permission & acknowledgements) Starting point: Event data Case ID Activity Resource Timestamp product prod-price quantity address … … …. … …. … … … 6350 place order Aiden 2018/02/13 14:29:45.000 APPLE iPhone 6 16 GB 639,00 € 5 NL-7751DG-21 6283 pay Lily 2018/02/13 14:39:25.000 SAMSUNG Galaxy S6 32 GB 543.99 3 NL-7828AM-11a 6253 prepare delivery Sophia 2018/02/13 15:01:33.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7887AC-13 6257 prepare delivery Aiden 2018/02/13 15:03:43.000 SAMSUNG Galaxy S6 32 GB 543.99 1 NL-9521KJ-34 6185 confirm payment Emily 2018/02/13 15:05:36.000 SAMSUNG Galaxy S4 329,00 € 1 NL-9521GC-32 6218 confirm payment Emily 2018/02/13 15:08:11.000 APPLE iPhone 6s Plus 64 GB 969,00 € 2 NL-7948BX-10 6245 make delivery Michael 2018/02/13 15:14:04.000 APPLE iPhone 6 16 GB 639,00 € 3 NL-7905AX-38 6272 pay Emily 2018/02/13 15:20:36.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7821AC-3 6269 pay Charlotte 2018/02/13 15:25:21.000 SAMSUNG Galaxy S4 329,00 € 1 NL-7907EJ-42 6212 prepare delivery Sophia 2018/02/13 15:43:39.000 HUAWEI P8 Lite 234,00 € 1 NL-7905AX-38 6323 send invoice Alexander 2018/02/13 15:46:08.000 APPLE iPhone 6 16 GB 639,00 € 1 NL-7833HT-15 6246 confirm payment Jack 2018/02/13 15:56:03.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7833HT-15 6347 send invoice Jack 2018/02/13 15:57:42.000 SAMSUNG Galaxy S4 329,00 € 3 NL-7905AX-38 6351 place order Zoe 2018/02/13 16:17:37.000 APPLE iPhone 5s 16 GB 449,00 € 3 NL-9521GC-32 6204 prepare delivery Sophia 2018/02/13 16:31:28.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a 6204 make delivery Kaylee 2018/02/13 16:51:54.000 SAMSUNG Core Prime G361 135,00 € 1 NL-7828AM-11a 6265 confirm payment Lily 2018/02/13 16:55:55.000 SAMSUNG Galaxy S4 329,00 € 4 NL-9521GC-32 6250 confirm payment Jack 2018/02/13 17:03:26.000 MOTOROLA Moto G 199,00 € 4 NL-7942GT-2 6328 send invoice Lily 2018/02/13 17:30:16.000 APPLE iPhone 6s 64 GB 858,00 € 4 NL-9514BV-16 6352 place order Aiden 2018/02/13 17:53:22.000 APPLE iPhone 6 16 GB 639,00 € 2 NL-9514BV-16 6317 send invoice Jack 2018/02/13 18:45:30.000 APPLE iPhone 6s 64 GB 858,00 € 5 NL-7907EJ-42 6353 place order Sophia 2018/02/13 20:16:20.000 APPLE iPhone 5s 16 GB 449,00 € 4 NL-7751AR-19 … … …. … … … … … event = case + activity + timestamp + …
  • 6. © Wil van der Aalst (use only with permission & acknowledgements) Let’s look at orders 6350, 6351, and 6352 Case ID Activity Timestamp 6350 place order 2018/02/13 14:29:45.000 6351 place order 2018/02/13 16:17:37.000 6352 place order 2018/02/13 17:53:22.000 6352 send invoice 2018/02/19 09:20:28.000 6351 send invoice 2018/02/19 16:08:07.000 6350 send invoice 2018/02/21 09:38:16.000 6350 pay 2018/03/02 12:39:37.000 6352 pay 2018/03/05 15:46:47.000 6351 cancel order 2018/03/06 10:17:01.000 6350 prepare delivery 2018/03/07 13:50:35.000 6350 make delivery 2018/03/07 16:41:01.000 6350 confirm payment 2018/03/07 16:53:00.000 6352 prepare delivery 2018/03/07 17:05:59.000 6352 confirm payment 2018/03/07 17:59:55.000 6352 make delivery 2018/03/08 09:54:36.000
  • 7. © Wil van der Aalst (use only with permission & acknowledgements) Let’s look at orders 6350, 6351, and 6352 Case ID Activity Timestamp 6350 place order 2018/02/13 14:29:45.000 6351 place order 2018/02/13 16:17:37.000 6352 place order 2018/02/13 17:53:22.000 6352 send invoice 2018/02/19 09:20:28.000 6351 send invoice 2018/02/19 16:08:07.000 6350 send invoice 2018/02/21 09:38:16.000 6350 pay 2018/03/02 12:39:37.000 6352 pay 2018/03/05 15:46:47.000 6351 cancel order 2018/03/06 10:17:01.000 6350 prepare delivery 2018/03/07 13:50:35.000 6350 make delivery 2018/03/07 16:41:01.000 6350 confirm payment 2018/03/07 16:53:00.000 6352 prepare delivery 2018/03/07 17:05:59.000 6352 confirm payment 2018/03/07 17:59:55.000 6352 make delivery 2018/03/08 09:54:36.000 place order send invoice pay prepare delivery make delivery confirm payment place order send invoice cancel order place order send invoice pay prepare delivery confirm payment make delivery order 6350 order 6351 order 6352
  • 8. © Wil van der Aalst (use only with permission & acknowledgements) Using the whole event log Case ID Activity Timestamp 6350 place order 2018/02/13 14:29:45.000 6351 place order 2018/02/13 16:17:37.000 6352 place order 2018/02/13 17:53:22.000 6352 send invoice 2018/02/19 09:20:28.000 6351 send invoice 2018/02/19 16:08:07.000 6350 send invoice 2018/02/21 09:38:16.000 6350 pay 2018/03/02 12:39:37.000 6352 pay 2018/03/05 15:46:47.000 6351 cancel order 2018/03/06 10:17:01.000 6350 prepare delivery 2018/03/07 13:50:35.000 6350 make delivery 2018/03/07 16:41:01.000 6350 confirm payment 2018/03/07 16:53:00.000 6352 prepare delivery 2018/03/07 17:05:59.000 6352 confirm payment 2018/03/07 17:59:55.000 6352 make delivery 2018/03/08 09:54:36.000 place order send invoice pay prepare delivery make delivery confirm payment place order send invoice cancel order place order send invoice pay prepare delivery confirm payment make delivery 8016 x 1651 x 2962 x place order pay send invoice prepare delivery make delivery confirm payment place order pay send invoice prepare delivery confirm payment make delivery 30 x 7 x
  • 9. © Wil van der Aalst (use only with permission & acknowledgements) Using the whole event log place order send invoice pay prepare delivery make delivery confirm payment place order send invoice cancel order place order send invoice pay prepare delivery confirm payment make delivery 8016 x 1651 x 2962 x place order pay send invoice prepare delivery make delivery confirm payment place order pay send invoice prepare delivery confirm payment make delivery 30 x 7 x
  • 10. © Wil van der Aalst (use only with permission & acknowledgements) Performance and Compliance What happens? Where are the bottlenecks? Where do we deviate from the happy path?
  • 11. © Wil van der Aalst (use only with permission & acknowledgements) control-flow discovery conformance checking root-cause analysis performance analysis predictive process analytics decision mining organization/social network mining automated process improvement responsible process mining full process discovery
  • 12. © Wil van der Aalst (use only with permission & acknowledgements) Control-flow: Backbone of any process time/frequencies data/decisions resources/organization costs etc.
  • 13. © Wil van der Aalst (use only with permission & acknowledgements) Initial focus academia Classical Petri nets
  • 14. © Wil van der Aalst (use only with permission & acknowledgements) Initial focus industry Directly Follows Graphs time/frequencies
  • 15. © Wil van der Aalst (use only with permission & acknowledgements) Towards a more complete picture time/frequencies data/decisions resources/organization costs etc. conformance checking discovery descriptive process models predictive process models prescriptive process models
  • 16. © Wil van der Aalst (use only with permission & acknowledgements) Towards a more complete picture time/frequencies data/decisions resources/organization costs etc. from offline to online from insights to action
  • 17. © Wil van der Aalst (use only with permission & acknowledgements) Why should I care?
  • 18. © Wil van der Aalst (use only with permission & acknowledgements) One year to get “Kindergeld” and “Kinderzuschläge” having 0,1,3, 4 children and dealing with friction within and between four organizations. >25 letters, >35 phone calls Example
  • 19. © Wil van der Aalst (use only with permission & acknowledgements) 80 / 20Good news: 80% of the cases are described by 20% of the variants Bad news: the remaining 20% of the cases account for 80% of the variants and these may take 80% of the time (operational friction)
  • 20. © Wil van der Aalst (use only with permission & acknowledgements) Example: Process Mining @ Siemens (thanks to Lars Reinkemeyer, head of process mining Siemens) • > 6000 active Celonis users (P2P, O2C, etc.) • Millions of savings by reducing rework, process unification, etc. • Improved reliability and responsiveness. • At an amazing scale, e.g., Order to Cash (O2C) process with >30M cases, >300M events, and >900K variants.
  • 21. © Wil van der Aalst (use only with permission & acknowledgements) data process process mining
  • 22. © Wil van der Aalst (use only with permission & acknowledgements) BPM reality process mining
  • 23. © Wil van der Aalst (use only with permission & acknowledgements) IT business process mining
  • 24. © Wil van der Aalst (use only with permission & acknowledgements) • 1999 start of process mining research at TU/e • 2000-2002 Alpha and Heuristic miner • 2004 first version of ProM • 2004-2006 token-based conformance checking, organization mining, decision mining, etc. • 2007 first process mining company (Futura PI) • 2009 IEEE Task Force on Process Mining created • 2010 alignment-based conformance checking • 2011 first process mining book • 2011 Process Mining Manifesto published • 2014 Coursera process mining MOOC • 2016 “Process mining: data science in action” book • 2018 Market Guide for Process Mining by Gartner • 2018 25+ process mining companies • 2018 Celonis becomes a Unicorn • 2019 First ICPM conference Milestones 20 years of process mining
  • 25. © Wil van der Aalst (use only with permission & acknowledgements) Accomplishments “from an academic puzzle to something that works in the real world”
  • 26. © Wil van der Aalst (use only with permission & acknowledgements) Scientific publications on process mining (Scopus, June 2019)
  • 27. © Wil van der Aalst (use only with permission & acknowledgements) Scientific publications on process mining (Scopus, June 2019) start process mining at TU/e Alpha miner and Heuristic miner first version of ProM first process mining company (Futura PI) Celonis Fluxicon first process mining book second process mining book many new process mining companies created ProcessGold PM manifesto IEEE Task Force Examples of progress in: - process discovery - conformance checking - tooling
  • 28. © Wil van der Aalst (use only with permission & acknowledgements) Progress in Process Discovery (Disclaimer: not intended to be complete, but to illustrate the steps towards maturity.)
  • 29. © Wil van der Aalst (use only with permission & acknowledgements) Alpha Algorithm in Action (2001)
  • 30. © Wil van der Aalst (use only with permission & acknowledgements) Alpha Algorithm in Action (2001) b p({a},{e}) oLaiL c e f d p({e},{f}) p({b},{c,f})p({a,d},{b}) p({c},{d})
  • 31. © Wil van der Aalst (use only with permission & acknowledgements) Problems Alpha Algorithm and the Like • Inability to distinguish frequent from infrequent behavior  • May yield unsound process models  • Representational bias that is too narrow  a b start endp1 c p1
  • 32. © Wil van der Aalst (use only with permission & acknowledgements) Problems Alpha Algorithm and the Like • Inability to distinguish frequent from infrequent behavior  • May yield unsound process models  • Representational bias that is too narrow  a b start endp1 c τ p1
  • 33. © Wil van der Aalst (use only with permission & acknowledgements) Heuristic Miner (2002-2011 Ton Weijters, 2017-2019 Felix Mannhardt) filtered causal graph C-net Petri net Able to filter out infrequent behavior  Able to discover inclusive splits/joins and skips  Models may be unsound  unfiltered DFG
  • 34. © Wil van der Aalst (use only with permission & acknowledgements) Inductive Miner (2013-2019 Sander Leemans) all paths and all activities only the most frequent paths and activities Able to filter out infrequent behavior  Able to discover inclusive splits/joins and skips  Models are guaranteed to be sound 
  • 35. © Wil van der Aalst (use only with permission & acknowledgements) Not a solved problem! • Many other approaches (state-based regions, language-based regions, split miner, etc.). • Human is still able to outperform algorithms. • Representational bias is still problematic (e.g., multiple instances, label splitting, and non-local dependencies). • Performance issues for more advanced approaches. • Most commercial tools still use simple DFGs 
  • 36. © Wil van der Aalst (use only with permission & acknowledgements) Progress in Conformance Checking (Disclaimer: not intended to be complete, but to illustrate the steps towards maturity.)
  • 37. © Wil van der Aalst (use only with permission & acknowledgements) Naïve approaches based on comparing process graphs / footprint matrices (2003) Log represented by a DFG or footprint matrix Process model is a graph and can be used to create a footprint matrix Very sensitive to the abstraction used  Very different behaviors can have similar graphs/matrices  Similar behaviors can lead to different graphs/matrices  No reliable diagnostics and not linked directly to events/cases 
  • 38. © Wil van der Aalst (use only with permission & acknowledgements) Token-based replay (Anne Rozinat 2005-2010, Alessandro Berti 2019) p=2654 r=0 c=2654 m=0 p=2654 r=0 c=2654 m=0 p=2338 r=492 c=2066 m=220 p=2654 r=91 c=2563 m=0 p=2563 r=225 c=2338 m=0 p=2066 r=428 c=1638 m=0 Fitness example = 0.9102382
  • 39. © Wil van der Aalst (use only with permission & acknowledgements) Token-based replay (Anne Rozinat 2005-2010, Alessandro Berti 2019) Fitness = 0.9102382 220 times the activity happened when it was impossible (according to the model) 492 times the activity did not happen when it was supposed to happen Addresses all the problems mentioned for the naïve approaches  Does not provide valid paths through the model  Diagnostics tend to be misleading (token flooding) 
  • 40. © Wil van der Aalst (use only with permission & acknowledgements) Alignments (2010-2013 Arya Adriansyah) 1849 synchronous moves 805 move in model only 2651 synchronous moves 3 moves in model only many moves on log Addresses the problems of token-based replay and yields paths though the model  Still time consuming  Diagnostics tend to be rather arbitrary  Fitness = 0.7964
  • 41. © Wil van der Aalst (use only with permission & acknowledgements) Not a solved problem! • Fitness is well understood, but there are multiple measures possible. • There is no consensus on the other three quality dimensions (precision, simplicity, and generalization). • Alignments are very powerful but also still time-consuming. • Less than half of the commercial tools support conformance checking (and rarely alignments)  • Still a gap between BPMN modeling tools and process mining 
  • 42. © Wil van der Aalst (use only with permission & acknowledgements) Two examples covering 20 years of research Alpha algorithm Heuristic miner Inductive miner Matrix/graph comparison Token-based replay Alignments process discovery conformance checking 1999 2019
  • 43. © Wil van der Aalst (use only with permission & acknowledgements) Process Mining Books
  • 44. © Wil van der Aalst (use only with permission & acknowledgements) Progress in Tooling
  • 45. © Wil van der Aalst (use only with permission & acknowledgements) ProM 6.X (>1500 plugins) (2010-now) Open-Source Process Mining Software (far from complete) ProM 1.1-5.2 (>286 plugins) (2004-2010) MiMo (2001-2002) EMiT (2002-2004) Thumb (2002-2004) InWolvE (2000-2004) RapidProM (2014-now) Apromore (2015*-now) PM4Py (2018-now) bupaR (2016-now) convergence divergence
  • 46. © Wil van der Aalst (use only with permission & acknowledgements) Futura Process Intelligence (Peter van den Brand, started 2007, Gartner Cool Vendor 2009) PM vendors in 2009
  • 47. © Wil van der Aalst (use only with permission & acknowledgements) Disco - Lowering the threshold to do process mining (Anne Rozinat & Christian Günther, Fluxicon started in 2009 ) 600+
  • 48. © Wil van der Aalst (use only with permission & acknowledgements) Over 30 process mining vendors today Etc.
  • 49. © Wil van der Aalst (use only with permission & acknowledgements) Trend: From Ad-Hoc to Continuous PM (e.g., Celonis and ProcessGold) From data scientists to process managers and from insights to actions.
  • 50. © Wil van der Aalst (use only with permission & acknowledgements) Terminology: Avoid the temptation … (process mining is broad, but also specific: event data & process models) • Process mining • Workflow mining (my mistake) • Automated business process discovery (Gartner) • Business process intelligence • Process intelligence • Business intelligence • Process analytics • Business process analytics • …
  • 51. © Wil van der Aalst (use only with permission & acknowledgements) Challenges “towards better processes”
  • 52. © Wil van der Aalst (use only with permission & acknowledgements) Process Mining Manifesto (2011) Six guiding principles and 11 challenges: 1. Finding, Merging, and Cleaning Event Data 2. Dealing with Complex Event Logs Having Diverse Characteristics 3. Creating Representative Benchmarks 4. Dealing with Concept Drift 5. Improving the Representational Bias Used for Process Discovery 6. Balancing Between Quality Criteria 7. Cross-Organizational Mining 8. Providing Operational Support 9. Combining Process Mining With Other Types of Analysis 10. Improving Usability for Non-Experts 11. Improving Understandability for Non-Experts
  • 53. © Wil van der Aalst (use only with permission & acknowledgements) Process Mining Manifesto (2011) Six guiding principles and 11 challenges: 1. Finding, Merging, and Cleaning Event Data 2. Dealing with Complex Event Logs Having Diverse Characteristics 3. Creating Representative Benchmarks 4. Dealing with Concept Drift 5. Improving the Representational Bias Used for Process Discovery 6. Balancing Between Quality Criteria 7. Cross-Organizational Mining 8. Providing Operational Support 9. Combining Process Mining With Other Types of Analysis 10. Improving Usability for Non-Experts 11. Improving Understandability for Non-Experts * green = addressed to some degree, red=still open, orange = less imported as expected
  • 54. © Wil van der Aalst (use only with permission & acknowledgements) “Old” Challenges
  • 55. © Wil van der Aalst (use only with permission & acknowledgements) process discovery conformance checking measuring model quality data extraction
  • 56. © Wil van der Aalst (use only with permission & acknowledgements) From backward looking to forward looking
  • 57. © Wil van der Aalst (use only with permission & acknowledgements) From backward to forward looking historic current tomorrow
  • 58. © Wil van der Aalst (use only with permission & acknowledgements) From backward to forward looking quality of predictions needs to improve predictions need to be turned into actions
  • 59. © Wil van der Aalst (use only with permission & acknowledgements) Context matters!
  • 60. © Wil van der Aalst (use only with permission & acknowledgements) Better integration of process discovery, conformance checking, and process modeling
  • 61. © Wil van der Aalst (use only with permission & acknowledgements) Hybrid process models are needed showing both the “sure/formal” and the “unsure/informal” parts.
  • 62. © Wil van der Aalst (use only with permission & acknowledgements) Process modeling with “haptic feedback” based on data Interactive process modeling still outperforms fully automated discovery techniques.
  • 63. © Wil van der Aalst (use only with permission & acknowledgements) Better support for comparative process mining
  • 64. © Wil van der Aalst (use only with permission & acknowledgements)
  • 65. © Wil van der Aalst (use only with permission & acknowledgements)
  • 66. © Wil van der Aalst (use only with permission & acknowledgements) What are the differences? (different periods, departments, customer groups) Recall comment on just comparing graphs.
  • 67. © Wil van der Aalst (use only with permission & acknowledgements) What are the differences? (different periods, departments, customer groups) More difficult are differences in frequencies, times, etc.
  • 68. © Wil van der Aalst (use only with permission & acknowledgements) Considering causality and fairness to suggest more meaningful improvements
  • 69. © Wil van der Aalst (use only with permission & acknowledgements) Process mining can be used to identify compliance and performance problems • mandatory activity is skipped • activity is performed too late • wrong order • unauthorized resource • bottlenecks and delays • unnecessary rework • waste • overproduction Process mining can be used to show the root causes of such problems, but … If Wil works on a case, check activities are more likely to be skipped. Cases for this supplier tend to have many price changes. In this department, checks are performed after the legal deadline. There are often delays in the back office on Fridays.
  • 70. © Wil van der Aalst (use only with permission & acknowledgements) Root case analysis? flowtime deviations  crimerate ice cream sales 
  • 71. © Wil van der Aalst (use only with permission & acknowledgements) Correlation ≠ Causality crimerate ice cream sales  crimerate temperature icecreamsales temperature 
  • 72. © Wil van der Aalst (use only with permission & acknowledgements) Fairness • Don’t blame overloaded resources for causing bottlenecks. • Don’t blame the most experienced resources taking the most difficult cases for deviating. • Discrimination-aware data/process mining aims to avoid such errors. • Trade-off between fairness and accuracy.
  • 73. © Wil van der Aalst (use only with permission & acknowledgements) Making process mining results actionable (e.g., the RPA connection)
  • 74. © Wil van der Aalst (use only with permission & acknowledgements) diagnosis action operational support (alerting, prediction, recommendations) process reengineering
  • 75. © Wil van der Aalst (use only with permission & acknowledgements) Process-mining-informed automation (RPA) case frequency (number of similar cases in a given period) different types of cases (sorted by frequency) traditional process automation Robotic Process Automation (RPA) candidates work that can only be done by humans
  • 76. © Wil van der Aalst (use only with permission & acknowledgements) Ensuring confidentiality in process mining
  • 77. © Wil van der Aalst (use only with permission & acknowledgements) Name Activity Date Time From To WvdA check-in 30-8-19 8:20 CGN VIE WvdA drop-bag 1-9-19 9:20 CGN VIE WvdA board 1-9-19 9:40 CGN VIE … … … … … … WvdA check-in 15-9-19 22:58 DUS OSL WvdA drop-bag 17-9-19 18:38 DUS OSL WvdA board 17-9-19 19:10 DUS OSL … … … … … … WvdA check-in 23-9-19 22:46 DUS NRT WvdA drop-bag 24-9-19 16:18 DUS NRT WvdA board 24-9-19 17:12 DUS NRTEvent data are very sensitive!
  • 78. © Wil van der Aalst (use only with permission & acknowledgements) Name Activity Date Time From To #6@7 check-in 30-8-19 8:20 CGN VIE #6@7 drop-bag 1-9-19 9:20 CGN VIE #6@7 board 1-9-19 9:40 CGN VIE … … … … … … #6@7 check-in 15-9-19 22:58 DUS OSL #6@7 drop-bag 17-9-19 18:38 DUS OSL #6@7 board 17-9-19 19:10 DUS OSL … … … … … … #6@7 check-in 23-9-19 22:46 DUS NRT #6@7 drop-bag 24-9-19 16:18 DUS NRT #6@7 board 24-9-19 17:12 DUS NRT
  • 79. © Wil van der Aalst (use only with permission & acknowledgements) Name Activity Date Time From To #6@7 check-in 30-8-19 VIE #6@7 drop-bag 1-9-19 VIE #6@7 board 1-9-19 VIE … … … … #6@7 check-in 15-9-19 OSL #6@7 drop-bag 17-9-19 OSL #6@7 board 17-9-19 OSL … … … … #6@7 check-in 23-9-19 NRT #6@7 drop-bag 24-9-19 NRT #6@7 board 24-9-19 NRT
  • 80. © Wil van der Aalst (use only with permission & acknowledgements) event data encrypted data desired result Minimal information needed to get the result, e.g. a DFG.
  • 81. © Wil van der Aalst (use only with permission & acknowledgements) Many open challenges and opportunities … Therefore, we are looking for PhDs and Postdocs that would like make a difference!
  • 82. © Wil van der Aalst (use only with permission & acknowledgements) Conclusion “recommendations”
  • 83. © Wil van der Aalst (use only with permission & acknowledgements) From event report: , but the speed is accelerating!! Adoption is slow …
  • 84. © Wil van der Aalst (use only with permission & acknowledgements) Free Advice
  • 85. © Wil van der Aalst (use only with permission & acknowledgements) For process mining users … • You get the tools you deserve. If you do not ask for it, you will not get it. • You need: Domain/business expertise, knowledge of the information systems, and data science skills (i.e., different people). If one element is missing, you will fail. • You can only make a business case if you are able to apply process mining continuously (when 80% is spent on data extraction, you want to use this multiple times). • But, the business case is typically much better than most BPM, process modeling, Six Sigma, etc. initiatives.
  • 86. © Wil van der Aalst (use only with permission & acknowledgements) For process mining vendors … • Try to better adopt ideas from academia and provide feedback (even when you still need to do the engineering). • Going beyond DFGs is unavoidable if you want to stay in business. • Advanced features will only be used if they are usable and made scalable (adding conformance half-heartedly will not help your customers). • Riding the AI/ML wave may backfire. • Initiatives like XES will not help you sell more licenses, but help to establish process mining as a discipline.
  • 87. © Wil van der Aalst (use only with permission & acknowledgements) For academics … • Good news: Many open problems! • But: − Get your own case studies (“eat your own dog food”). − Avoid working on techniques that do slightly better on selected data sets using well selected criteria (even when these papers still get accepted). − Work on original problems or use truly original approaches (even when your paper gets rejected at first). − Understand why vendors are still using simple DFGs. − In the end, we would like improve processes, right?
  • 88. © Wil van der Aalst (use only with permission & acknowledgements) Enjoy