4. Definition
• The term ERP, shortened from
"Enterprise Resource Planning", was
introduced by the Gartner Group in the
early 1990s [1]
• Represents computer and software
systems that combine and integrate all
related processes of the enterprise and
serve users for the management of all
functions within the enterprise [2]
5. Researh goal
To determine the
system's health and
maturity level
Reduce downtime due to
the ERP system's
performance issues
ensure data integrity
ERP system evaluation is a process used in several studies
to assess an ERP system
What is the goal of ERPs Evaluation?
decide whether to keep
the system, upgrade the
system, or look for a new
system
7. A Systematic
Literature Review
● Kitchenham et al: The Systematic Literature Review (SLR) is a
study to identify, collate, and systematically summarize empirical
evidence from two or more primary research relevant to a specific
research question [6].
The Systematic Literature Review
(SLR) method was used in this study
to discover and identify the
evaluation of an ERP System.
8. Research Question
RQ1
● What method was proposed in
earlier research on evaluating an
ERP system from 2018-2022?
RQ1
● What problems arise and can be
used to evaluate an ERP
System?
RQ1:
● Determine which methods can
be used to evaluate the ERP
system
RQ2
● Determine the research gaps
that can be used in the future
study
RQ Objective
9. Search Process
Google Scholar IEEE Xplore
Science Direct
The process carried out after defining the
research question is completing the data
source to build an SLR by using digital
libraries or online databases. The sources
used remain as follows:
10. String keyword
([all “evaluations”] OR [all “assessment”]) AND
[all “for”] AND [all “enterprise”] AND [all
“resources”] AND [all “planning”] OR [all “ERP”]
Inclusion Criteria Exclusion Criteria
• Article that explains the understanding of
ERP
• Selected articles are limited to research
articles (conference or journal).
• Articles that explain methods to evaluate
the ERP System.
• Selection of articles published between
2018-2022
• The Papers do not explain the
understanding of ERP
• The papers are not published in a peer-
reviewed conference or journal
• The Papers are not explain the method to
evaluate the ERP System
Selection Criteria
12. Tabel 1. Article in selected resource
Library Data Source Article found Relevant
Article
(read abstract)
Article
selected
(full read)
Science Direct 531 14 3
IEEE 27 13 12
Google Scholar 17.400 23 8
Total 17.958 50 23
13. Number of pulished article per year
6 6
2
5
4
0
1
2
3
4
5
6
7
2022 2021 2020 2019 2018
NUMBER
The articles used for this SLR are published in 2018 and
2022, and the fewest are in 2018.
14
9
Method Comparison
Qualitative Quantitative
Method Comparison
14. Reviewed Articles
No Title Year Theory based Method
1 An ERP Data Quality Assessment Framework for the Implementation of an APS system using Bayesian Networks 2022 Bayesian Networks Quantitative
2 Development and validation of an improved DeLone-McLean IS success model - application to the evaluation of a tax
administration ERP
2022 DeLone-McLean IS success
model
Quantitative
3 Evaluasi Pelaporan Keuangan Sistem ERP Odoo Community yang Dikembangkan PT Neo Multi Servindo 2022 Descriptive Research Qualitative
4 Evaluation of Critical Success Factors for Enterprise Resource Planning Implementation Using Quantitative Methods in
Agricultural Processing Companies
2022 Gray Relational Analysis Quantitative
5 Designing a MCDM Model for Selection of an Optimal ERP Software in Organization 2022 Multi-criteria decision Making
(MCDM) Model
Qualitative
6 Uncertainty of Preferences in the Assessment of Supply Chain Management Systems Using the PROMETHEE Method 2022 PROMETHEE Method / multi-
criteria decision aid (MCDA)
Qualitative
7 Evaluasi Keberhasilan Manajemen dalam Implementasi Sistem Enterprise Resource Planning (ERP) 2021 Descriptive Research Qualitative
8 Framework For The Evaluation Of The Erp Implementation Success: Case Study In Smes 2021 Grounded Theory Method Qualitative
9 The Evaluation Of Enterprise Resource Planning Application Using Information Systems Success Model 2021 IS success model Qualitative
10 The Evaluation of Enterprise Resource Planning using ISO 25010 Based Quality Model 2021 ISO 25010 Based Quality Model
Framework
Qualitative
11 Evaluating and Ranking of Critical Success Factors of Cloud Enterprise Resource Planning Adoption Using MCDM
Approach
2021 Multi-criteria decision Making
(MCDM) Model
Qualitative
12 Usability Evaluation of ERP Systems: A Comparison between SAP S/4 Hana & Oracle Cloud 2021 SAP Quantitative
13 Correlation and Evaluation Analysis Using The Information System Success Model In Implementation of Enterprise
Resource Planning (ERP) Supply Chain Management For Oil and Gas Industry
2020 IS success model Qualitative
14 Evaluation of Implementation of The Use of Enterprise Resource Planning System In Service Company 2020 Statistic Analysis Quantitative
15 Evaluating the Effectiveness of ERP Systems in HEIs: A Proposed Analytic Framework 2019 Balanced Scorecard (BSC)
Framework
Qualitative
16 Enterprise Resource Planning Quality Model ERPQM 2019 Quality Model ERPQM Qualitative
17 Development and Validation of Instruments for Evaluation Enterprise Resource Planning on Human Resource
Management in Higher Education Sector
2019 Quality Model ERPQM Quantitative
18 Measuring Performance Through Enterprise Resource Planning System Implementation 2019 Statistic Analysis Quantitative
19 The Evaluation of Finance Module Implementation of Enterprise Resource Planning (ERP) for Employee Performance 2019 Task Technology Fit Model Quantitative
20 Evaluate Implementation of Enterprise Resource Planning (ERP) System 2018 Factor analysis Quantitative
21 Evaluasi Penggunaan Sistem Informasi ERP Dengan Metode Pieces Framework 2018 Pieces Framework Qualitative
22 Evaluation of a framework for sustainable Enterprise Resource Planning systems implementation 2018 S-ERP Framework Qualitative
23 The Evaluation of Enterprise Resource Planning (ERP) Financial Accounting and Control Using Technology Acceptance
Model
2018 Technology Acceptance Model Qualitative
15. Number
of Theory
based used in
the paper
DeLone-McLean IS success model
Quantitative Methods
Bayesian Networks
MCDM Model
MCDA Model
The Qualitative Data Collection
ISO 25010 Based Quality Model
IS Success Model
Quality Model ERPQM
Task Technology Fit Model
Balanced Scorecard (BSC) Framework
Pieces Framework
S-ERP Framework
Technology Acceptance Model
Factor analysis
2
3
1
2
1
5
1
1
1
1
1
1
1
1
1
Theory Based
16. Conclussion
Due to the fact that every company implements a
various set of operating procedures, the ERP will
accomplish these improvements in different methods
depending on the organization
Based on this review, there are many ways to evaluate ERP systems.
These methods are classified into two types: qualitative and
quantitative methods.
No study has been conducted to demonstrate the link between the
functional aspect or the non-functional features of the ERP system.
Furthermore, the method outlined earlier can be applied in case that
has never been done before
