PPINOT: A Performance Management Solution for Process Oriented
Organisations
Adela del Río Ortega, Universidad de Sevilla
Manuel Resinas, Universidad de Sevilla
Antonio Ruiz Cortés, Universidad de Sevilla
Congreso Académico ITGSM13 – Diapositiva
2
Adela del Río Ortega
PhD Computer Sciences- BPM & Metrics
5 Years Experience Research and Teaching
BPM
SOC
Introduction
Motivation
Congreso Académico ITGSM13 – Diapositiva
4
Introduction
Motivation
Business Processes (BPs)
Activities
Organisation
Humans
IT systems
Data
Other resources
Business
goal
Congreso Académico ITGSM13 – Diapositiva
6
Request For Change (RFC) Management BP
Analyse RFC and
give an answer
Requester
(Participant 1)
Participants
RFC
IT systems
RFC approved
or cancelled
Congreso Académico ITGSM13 – Diapositiva
8
Business Process Management
BP modelling & analysis (simulation)
Configuration
Evaluation
Execution and monitoring
Execution
logs
Process
repository
Process designer
System architect
Congreso Académico ITGSM13 – Diapositiva
10
Measure for the Manager
BAM
Manager
Measure for Employees
To keep them motivated
If we get an EFQM +200 certification, then
we will get an extra payment
Congreso Académico ITGSM13 – Diapositiva
12
Measure for Customers
To pay according to the QoS
Key Performance Indicator (KPI)
KPIs are
quantifiable metrics
that an organisation
uses to measure
performance
in terms of meeting
its
strategic and operational objectives
.
Congreso Académico ITGSM13 – Diapositiva
14
KPI Example
The average class attendance should be increased
by 15% during this course
Process Performance Indicator
KPI
1
KPI
n
…
BP
n
BP
1
…
PPI
1-1
PPI
1-n
…
PPI
n-1
PPI
n-n
…
Congreso Académico ITGSM13 – Diapositiva
16
PPI vs KPIs
KPIs
Process Performance Indicator (PPI)
Quantifiable metrics
that allow the evaluation of
the
efficiency and effectiveness of business
processes
. They can be measured directly by
data that is generated within the process flow and
are aimed at the process controlling and
continuous optimization.
Congreso Académico ITGSM13 – Diapositiva
18
PPI Examples
delays caused
by committee
number of
RFCs per
project
percentage of
corrective
changes from
RFC approved
Introduction
Motivation
Congreso Académico ITGSM13 – Diapositiva
20
Integrating the PPIM lifecycle into the BPM one
Design
Instrumen-tation
Computa-tion
Evaluation
Design and
Analysis
Configuration
Enactment
Evaluation
BPM lifecycle
PPIM lifecycle
Define PPIs
,
Connect with BP,
design-time
analysis
Implement
measurement
points
Calculate
PPIs’ values
and monitor
PPIs
Identify PPI
correlations,
conflicts and
predict future
behaviour
Congreso Académico ITGSM13 – Diapositiva
22
Problem Statement
•
How to depict PPIs for all
kinds of users?
•
How to extract valuable
information?
•
How to define PPIs to fully
support the PPIM
Congreso Académico ITGSM13 – Diapositiva
24
Desirable Properties
Way of
defining a PPI
•
PPI Definition
P2.
Traceability
P1.
Unambiguity &
completeness
P3.
Expressiveness
P1: Unambiguity and Completeness
Duration of
the analysis
activity
Which analysis
activity
When
Congreso Académico ITGSM13 – Diapositiva
26
P2: Traceability
Way of
defining a
PPI
?
?
? ?
P3: Expressiveness
3
1
2
✔
?
?
✔
?
SMART
Specific Achievable Relevant Timed Measurable3.1
3.2
3.3
Congreso Académico ITGSM13 – Diapositiva
28
Desirable Properties
•
PPI Representation
P4
. Understandability
P5.
Bridging
the Visual gap
P4: Understandability
?
?
Precise vs understandable
Congreso Académico ITGSM13 – Diapositiva
30
P5: Visual Gap
Way of
defining a
PPI
Partial views
Comprehensive
views
Desirable Properties
•
Analysis of PPIs
P6.
Design-time
automated analysis
Congreso Académico ITGSM13 – Diapositiva
32
P6: Design-time Automated Analysis
Configuration
Evaluation
Execution and monitoring
Execution
logs
Process
repository
BP modelling & analysis (simulation)
Run-time analysis
Post-mortem
analysis
Desig-time
Two Additional Requirements
Congreso Académico ITGSM13 – Diapositiva
34
State of the Art
Proposal
P1 P2
P3
P4 P5
P6
R1 R2
3.1
3.2
3.3
6.1 6.2
3.2.1 3.2.2 3.2.3 3.2.4 3.2.5 3.2.6 3.2.7 3.3.1 3.3.2 3.3.3✔
~
✔
✔
~
~
~
✔
ARIS PPM
✔
~
✔
✔
✔
~
✔
✔
✔
✔
~
✔
~
✔
Mayerl et al.
✔
~
✔
✔
✔
~
✔
Momm et al.
✔ ✔
✔
✔
~
✔
Pedrinaci et al.
✔
✔
✔
✔
✔
✔
✔
✔
~ ~
✔
✔
✔ ✔ ✔
✔
✔
✔
✔
~
~ ~
✔
González et al.
✔
✔
~
✔
✔
~
✔
~
✔
~
✔
Popova et al.
✔ ✔ ✔
✔
✔
✔
✔
~
Barone et al.
~ ~
✔
✔
✔
✔✔
~
~
✔ ✔ ✔
✔
✔
~
✔
✔
✔
✔
✔
~
✔
✔
N/A
N/A
N/A
✔*
✔*
✔*
✔*
✔*
✔*
✔*
✔*
N/A
N/A
N/A
N/A
✔*
N/A
N/A
Castellanos et al.
Wetzstein et al.
Friedenstabet al.
Introduction
Motivation
Congreso Académico ITGSM13 – Diapositiva
36
Proposal
1. Metamodel
2. Graph not
3. Templates
4. Design-time
analysis
Proposal
1. Metamodel
2. Graph not
3. Templates
4. Design-time
analysis
Congreso Académico ITGSM13 – Diapositiva
38
Contributions
C1. Metamodel
C2. Graph not
C3. Templates
C4.
Design-time analysis
Why a Graphical Notation
Comprehensive
views
P4.
Understandability
P5. Bridging the Visual gap
Congreso Académico ITGSM13 – Diapositiva
40
Graphical Notation
PPI
Measures
Aggregated Measure
Derived Single-Instance
Measure
Derived Multi-Instance
Measure
Base Measure
What to measure
Time
SUM SUMCount
State
Condition
Data Property
Condition
Data content
Connectors
Aggregates
Time connectors
Applies to
isGroupedBy
Uses
Some Guidelines
I want to
know the
delays
caused by
committee
What
to
measure
Congreso Académico ITGSM13 – Diapositiva
42
Some Guidelines
I want to
know the
delays
caused by
committee
What
to
measure
Some Guidelines
I want to
know the
delays
caused by
committee
How to
connect
it
to the BP
Congreso Académico ITGSM13 – Diapositiva
44
Some Guidelines
I want to
know the
delays
caused by
committee
How
to
measure
Aggregating several
Instances:
AggregatedMeasure
What aggregation?:
Average (AVG
)
Proposal
1. Metamodel
2. Graph not
3. Templates
4. Design-time
analysis
Congreso Académico ITGSM13 – Diapositiva
46
Why Templates
?
Scalability
Business manager
P4.
Understandability
learning curve
Templates
Helps to structure
information
Serves as a guide
Uses (structured)
natural language
Congreso Académico ITGSM13 – Diapositiva
48
The PPI value must be greater than
[or equal to]
<lower bound>
Linguistic patterns
Easier and faster
than writing
whole paragraphs from scratch
Fills placeholders in
prewritten sentences
PPI-template
PPI-
<ID>
<PPI descriptive name>
Process
<process ID the PPI is related to>
Goals
<strategic or operational goals the PPI is related to>
MeasureDefinition
The PPI is calculated as{
<
TimeMeasure
>
|
<
CountMeasure
>|<
ConditionMeasure
>
|
<
DataMeasure
>
|
<
DerivedMeasure
>
|
<
AggregatedMeasure
>
}
Target
The PPI value {
<
SimpleTargetValue
>|<
ComposedTargetValue
>
|
<
CustomTargetValue
>
}
Scope
The process instances considered for this PPI are
• All
• those in
<descriptive name (
S-x)
>
Source
<
source from whcih the PPI measure can be taken
>
Responsible
{<
role
>
|
<
department
>
|
<
organisation
>
|
<
person
>
}
Congreso Académico ITGSM13 – Diapositiva
50
PPI-template Example
PPI-
005
Average time of RFC analysis
Process
Request for change (RFC)
Goals
• BG-002: Improve customer satisfaction
• BG-014: Reduce RFC response time
MeasureDefinition
The PPI is calculated as the average of the duration
between the time instants when
activity RFC analysis
becomes
active
and when
activity RFC analysis
becomes
completed
Target
The PPI value must be lower than or equal to
1 working day
Scope
The process instances considered for this PPI are those in
Last
100
instances
scope
Source
Event logs of BPMS
Responsible
Planning and quality manager
Informed
Chief Information Officer (CIO)
Proposal
1. Metamodel
2. Graph not
3. Templates
4. Design-time
analysis
Congreso Académico ITGSM13 – Diapositiva
52
Proposal
1. Metamodel
2. Graph not
3. Templates
4. Design-time
analysis
PPINOT Tool Suite
Design
A
lternat
iv
e
2
Using the Templates
Editor
Ana
lyse
A
lte
rna
tiv
e
1
Using PPINOT
graphical Editor
Design-time
analysis operations
on PPIs, e.g:
1. Which are the BP elements involved in PPI
P
?
2. Which are the PPI associated to activity A?
ecute
Integrated with Open Source BPMS (Activiti) to
instrument BPs and report PPI values
Congreso Académico ITGSM13 – Diapositiva
54
PPINOT Graphical Editor
Congreso Académico ITGSM13 – Diapositiva