The document summarizes a literature review on evaluating and selecting software packages. It discusses various methodologies, techniques, tools, and criteria discussed in the literature. The key findings are that analytic hierarchy process is widely used for evaluation. There is a lack of common evaluation criteria and need for a framework to assist decision makers. The literature contributes stage-based methodologies, systems/tools for evaluation, and describes techniques like analytic hierarchy process and criteria for evaluating software packages. Limitations include constraints of the literature search and non-English papers. The study provides an overview of the evaluation and selection domain and proposes a generic methodology and criteria.
This ppt covers the following topics
Software quality
A framework for product metrics
A product metrics taxonomy
Metrics for the analysis model
Metrics for the design model
Metrics for maintenance
Today in era of software industry there is no perfect software framework available for
analysis and software development. Currently there are enormous number of software development
process exists which can be implemented to stabilize the process of developing a software system. But no
perfect system is recognized till yet which can help software developers for opting of best software
development process. This paper present the framework of skillful system combined with Likert scale. With
the help of Likert scale we define a rule based model and delegate some mass score to every process and
develop one tool name as MuxSet which will help the software developers to select an appropriate
development process that may enhance the probability of system success.
Software Quality Engineering is a broad area that is concerned with various approaches to improve software quality. A quality model would prove successful when it suffices the requirements of the developers and the consumers. This research focuses on establishing semantics between the existing techniques related to the software quality engineering and thereby designing a framework for rating software quality.
Pareto-Optimal Search-Based Software Engineering (POSBSE): A Literature SurveyAbdel Salam Sayyad
Paper presented at the 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE’13), San Francisco, USA. May 2013.
Information Systems For Management StrategiesSindhuKB
Information System Analysis and Design, Information System Development Life Cycle (SDLC), System Implementation, System Testing, Documentation, Conversion Methods.
This ppt covers the following topics
Software quality
A framework for product metrics
A product metrics taxonomy
Metrics for the analysis model
Metrics for the design model
Metrics for maintenance
Today in era of software industry there is no perfect software framework available for
analysis and software development. Currently there are enormous number of software development
process exists which can be implemented to stabilize the process of developing a software system. But no
perfect system is recognized till yet which can help software developers for opting of best software
development process. This paper present the framework of skillful system combined with Likert scale. With
the help of Likert scale we define a rule based model and delegate some mass score to every process and
develop one tool name as MuxSet which will help the software developers to select an appropriate
development process that may enhance the probability of system success.
Software Quality Engineering is a broad area that is concerned with various approaches to improve software quality. A quality model would prove successful when it suffices the requirements of the developers and the consumers. This research focuses on establishing semantics between the existing techniques related to the software quality engineering and thereby designing a framework for rating software quality.
Pareto-Optimal Search-Based Software Engineering (POSBSE): A Literature SurveyAbdel Salam Sayyad
Paper presented at the 2nd International Workshop on Realizing Artificial Intelligence Synergies in Software Engineering (RAISE’13), San Francisco, USA. May 2013.
Information Systems For Management StrategiesSindhuKB
Information System Analysis and Design, Information System Development Life Cycle (SDLC), System Implementation, System Testing, Documentation, Conversion Methods.
Similar to Evaluating and selecting software packages a review (20)
Transcript: Selling digital books in 2024: Insights from industry leaders - T...BookNet Canada
The publishing industry has been selling digital audiobooks and ebooks for over a decade and has found its groove. What’s changed? What has stayed the same? Where do we go from here? Join a group of leading sales peers from across the industry for a conversation about the lessons learned since the popularization of digital books, best practices, digital book supply chain management, and more.
Link to video recording: https://bnctechforum.ca/sessions/selling-digital-books-in-2024-insights-from-industry-leaders/
Presented by BookNet Canada on May 28, 2024, with support from the Department of Canadian Heritage.
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
GraphRAG is All You need? LLM & Knowledge GraphGuy Korland
Guy Korland, CEO and Co-founder of FalkorDB, will review two articles on the integration of language models with knowledge graphs.
1. Unifying Large Language Models and Knowledge Graphs: A Roadmap.
https://arxiv.org/abs/2306.08302
2. Microsoft Research's GraphRAG paper and a review paper on various uses of knowledge graphs:
https://www.microsoft.com/en-us/research/blog/graphrag-unlocking-llm-discovery-on-narrative-private-data/
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
LF Energy Webinar: Electrical Grid Modelling and Simulation Through PowSyBl -...DanBrown980551
Do you want to learn how to model and simulate an electrical network from scratch in under an hour?
Then welcome to this PowSyBl workshop, hosted by Rte, the French Transmission System Operator (TSO)!
During the webinar, you will discover the PowSyBl ecosystem as well as handle and study an electrical network through an interactive Python notebook.
PowSyBl is an open source project hosted by LF Energy, which offers a comprehensive set of features for electrical grid modelling and simulation. Among other advanced features, PowSyBl provides:
- A fully editable and extendable library for grid component modelling;
- Visualization tools to display your network;
- Grid simulation tools, such as power flows, security analyses (with or without remedial actions) and sensitivity analyses;
The framework is mostly written in Java, with a Python binding so that Python developers can access PowSyBl functionalities as well.
What you will learn during the webinar:
- For beginners: discover PowSyBl's functionalities through a quick general presentation and the notebook, without needing any expert coding skills;
- For advanced developers: master the skills to efficiently apply PowSyBl functionalities to your real-world scenarios.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
Generative AI Deep Dive: Advancing from Proof of Concept to ProductionAggregage
Join Maher Hanafi, VP of Engineering at Betterworks, in this new session where he'll share a practical framework to transform Gen AI prototypes into impactful products! He'll delve into the complexities of data collection and management, model selection and optimization, and ensuring security, scalability, and responsible use.
SAP Sapphire 2024 - ASUG301 building better apps with SAP Fiori.pdfPeter Spielvogel
Building better applications for business users with SAP Fiori.
• What is SAP Fiori and why it matters to you
• How a better user experience drives measurable business benefits
• How to get started with SAP Fiori today
• How SAP Fiori elements accelerates application development
• How SAP Build Code includes SAP Fiori tools and other generative artificial intelligence capabilities
• How SAP Fiori paves the way for using AI in SAP apps
In his public lecture, Christian Timmerer provides insights into the fascinating history of video streaming, starting from its humble beginnings before YouTube to the groundbreaking technologies that now dominate platforms like Netflix and ORF ON. Timmerer also presents provocative contributions of his own that have significantly influenced the industry. He concludes by looking at future challenges and invites the audience to join in a discussion.
A tale of scale & speed: How the US Navy is enabling software delivery from l...sonjaschweigert1
Rapid and secure feature delivery is a goal across every application team and every branch of the DoD. The Navy’s DevSecOps platform, Party Barge, has achieved:
- Reduction in onboarding time from 5 weeks to 1 day
- Improved developer experience and productivity through actionable findings and reduction of false positives
- Maintenance of superior security standards and inherent policy enforcement with Authorization to Operate (ATO)
Development teams can ship efficiently and ensure applications are cyber ready for Navy Authorizing Officials (AOs). In this webinar, Sigma Defense and Anchore will give attendees a look behind the scenes and demo secure pipeline automation and security artifacts that speed up application ATO and time to production.
We will cover:
- How to remove silos in DevSecOps
- How to build efficient development pipeline roles and component templates
- How to deliver security artifacts that matter for ATO’s (SBOMs, vulnerability reports, and policy evidence)
- How to streamline operations with automated policy checks on container images
Essentials of Automations: The Art of Triggers and Actions in FMESafe Software
In this second installment of our Essentials of Automations webinar series, we’ll explore the landscape of triggers and actions, guiding you through the nuances of authoring and adapting workspaces for seamless automations. Gain an understanding of the full spectrum of triggers and actions available in FME, empowering you to enhance your workspaces for efficient automation.
We’ll kick things off by showcasing the most commonly used event-based triggers, introducing you to various automation workflows like manual triggers, schedules, directory watchers, and more. Plus, see how these elements play out in real scenarios.
Whether you’re tweaking your current setup or building from the ground up, this session will arm you with the tools and insights needed to transform your FME usage into a powerhouse of productivity. Join us to discover effective strategies that simplify complex processes, enhancing your productivity and transforming your data management practices with FME. Let’s turn complexity into clarity and make your workspaces work wonders!
Essentials of Automations: The Art of Triggers and Actions in FME
Evaluating and selecting software packages a review
1. Evaluating and selecting
software packages: A review
Anil S. Jadhav*, Rajendra M. Sonar
Information and Software Technology
vol.51 pp.555–563, 2009.
Big Wu
Presenter : Jin Liu
Dean Yeh
3. Overview
• Evaluating and selecting software packages
• That meet an organization’s requirements is a difficult
software engineering process.
• The aim of this paper is to provide a basis to improve the
process
• Selection of a wrong software package
• Can turn out to be costly and adversely affect business
processes.
3
4. Overview
• This paper reports a systematic review of papers
published in journals and conference proceedings.
• The review investigates methodologies that support
decision makers include:
Selecting
Software
Packages
Software
Evaluation
Techniques
Software
Evaluation
Criteria
System
4
5. Overview
• The key findings of the review are:
1. Analytic Hierarchy Process(AHP) has been widely
used for evaluation of the software packages.
2. Lack of a common list of generic software
evaluation criteria and its meaning.
3. Need to develop a framework comprising to assist
decision makers in software selection.
5
6. Introduction
• B. Hecht (1997)
• Selecting the right solution is an exhausting process for
companies.
• J. Verville, A. Hallingten (2002)
• As ERP packages cost hundreds of thousands and even
millions of dollars, purchasing an ERP solution is a high
expenditure activity that consumes a significant portion of
companies’ capital budgets.
6
7. Research Questions
RQ1:
• What is the contribution of the literature in the field of
evaluation and selection of the software packages?
RQ2:
• What are the methodologies for selecting software
packages?
RQ3:
• What are the systems/tools to assist decision makers in
evaluating and selecting software packages?
RQ4:
• What are the software evaluation techniques?
RQ5:
• What are the software evaluation criteria?
7
8. Multiple Criteria Decision Making
(MCDM)
• K. Yoon, C. Hwang (1995) & E. Triantaphyllou (2000)
• MCDM refers to making preference decisions over the available
alternatives that are characterized by multiple, usually conflicting, attributes.
• M. Mollaghasemi, J. Pet-Edwards (1997)
• The goal of the MCDM is to help
1. Decision makers choose the best alternative of those studied.
2. Dort out alternatives that seem good among the set of alternatives studied.
3. Rank the alternatives in decreasing order of performance.
8
9. Literature review
P.K. Lawlis, K.E. Mark, D.A.
Thomas, T. Courtheyn, (1997)
B. Kizzort, (2001)
• A formal process for evaluating COTS software products,
IEEE Proceedings Software
• Selection of components for OTS component based
systems, IEEE
S. Comella-Dorda, J.C. Dean, E.
Morris, P. Oberndorf, (2002)
• A Process for COTS Software Product Evaluation, ICCBSS
K.R.P.H. Leung, Hareton K.N.
Leung, (2002)
• On the efficiency of domain-based COTS product selection
method, Information and Software Technology
C.-D. Santiago, C. John, M.
Edwin, O. Patricia, (2002)
• A process for COTS software product evaluation, ICCBSS
9
10. Literature review
D. Kunda, (2003)
K. Oh, N. Lee, S. Rhew,
(2003)
• STACE: Social Technical Approach to COTS Software
Evaluation Component Based Software Quality, LNCS,
• A selection process of COTS components based on the
quality of the software in a special attention to internet, HIS
G. Grau, J. Pablo Carvallo,
X. Franch, C. Quer, (2004)
• DesCOTS: a software system for selecting COTS
components, in: Proceedings of the 30th EUROMICRO
Conference, IEEE
J. Bhuta, B. Boehm, (2005)
• A Method for Compatible COTS Component Selection,
ICCBSS
10
11. Literature review
• In recent years, researchers have focused on models and methods for
reusable off-the-shelf (OTS) software selection.
1. Concentrate on evaluation and selection of specific software products.
2. Describe automated systems/tools that assist decision makers in various
activities involved in software evaluation and selection.
3. Describe only criteria for software selection and methodology for software
selection.
4. Relate to the evaluation of a single software attribute, quality or some quality subattribute, for a software product.
11
12. Software evaluation problem
situations
• Stamelos & Tsoukias (2003)
• analyzed the contents of different ‘‘problem situations” and
suggested a basic classification of software evaluation
problem situations:
Keep or Change
Make or Buy
Software
certification
Commercial
product
evaluation
Software
process
evaluation.
Tender
evaluation
Software
system design
selection.
12
14. Inclusion criteria
1. Methodology for selecting software
packages
2. Software evaluation criteria
3. Software evaluation technique
4. System/Tool to assist decision makers in
evaluating software packages
14
15. Search strategy and search
• Search Database
ACM Portal
Elsevier’s
Science
Direct
IEEE Xplore
SpringerVerlag
15
16. Paper selection
1. Initial selection from the search results, based
on reading the abstract of the papers.
2. Final selection from the initially selected list of
papers, based on reading of entire paper.
Reading all 130 papers in detail and considered
60 papers to be included in the final list for review.
16
18. Research Results
• The contribution of the reviewed literature in the
field of evaluation and selection.
• Contribution of the literature in the field of evaluation and
selection of the software packages (RQ1)
• The Software packages is presented stage-based
methodologies for selecting software packages.
• Software selection methodologies (RQ2)
18
19. Contribution of the literature in the field
of evaluation and selection
of the software packages (RQ1)
19
20. Software selection
methodologies (RQ2)
Step 1:
Step 2:
Step 3:
Step 4:
• Determining the need for purchasing by vendor.
• Short listing of candidate packages.
• Eliminating most candidate package.
• Using an evaluation technique of them.
20
21. Software selection
methodologies (RQ2)
Step 5:
• Doing further scrutiny by obtaining trial copy.
• Negotiating a contract specifying to terminate
any agreement.
Step 6:
• Purchasing and implementing most
appropriate software package.
Step 7:
21
22. Research Results
• Describes systems/tools to assist decision
makers in evaluating software packages.
• Systems/tools for evaluation and selection of software
packages(RQ3)
22
24. Research Results
• Techniques for evaluating software packages
and software evaluation criteria are
described in :
• Software evaluation techniques (RQ4)
• Evaluation criteria (RQ5)
24
26. Analytic Hierarchy Process(AHP)
Strengths:
Weaknesses:
• AHP enables decision makers to
• AHP is time consuming because of the
structure a decision making problem
into a hierarchy, helping them to
understand and simplify the problem.
• It is flexible and powerful tool for
handling both qualitative and
quantitative multi-criteria problems.
• AHP procedures are applicable to
individual and group decision making.
mathematical calculations and number of pair-wise
comparisons that increases as the number of
alternatives and criteria increases.
• The decision makers need to re-evaluate
alternatives when the number of criteria or
alternatives are changed.
• Ranking of alternatives depends on the
alternatives consider edfor evaluation hence
adding or deleting alternatives can lead to changes
26
in the final rank.
27. Feature Analysis
Strengths:
Weaknesses:
• Evaluation can be done to any
• Producing the single number from the
required level of detail by organizing
evaluation in different ways such as
screening mode, case study, formal
experiment and survey.
individual scores may be misleading
because many different combinations
of numbers can produce the same
aggregate score.
• It is used not only for technical
evaluation but also for evaluation of
viability of supplier.
27
28. Weighted Average Sum (WAS)
Strengths:
• Main advantage of WAS is its
ease of use.
Weaknesses:
• Weights to the attribute are assigned
arbitrary and it is very difficult to assign
weight when number of criteria is high.
• To obtain a score using this method a
common numerical scaling is required.
• Difficulties emerge when WAS is applied to
multi-dimensional MCDM problems.
28
29. Fuzzy Based Approach
Strengths:
• The decision makers can use
linguistic terms to evaluate
alternatives easily and intuitively.
• It improves decision making
procedure by accommodating the
vagueness and ambiguity occurred
during human decision making.
Weaknesses:
• Difficult to compute fuzzy
appropriateness index values
and ranking values for all
alternatives.
29
34. Limitations
• This study has the usual limitations associated with any systematic
literature review.
• With respect to the search process, we have limited ourselves to
English language studies and to four major electronic databases
and search terms related to the terms ‘‘evaluation” and ‘‘selection”.
• This strategy will not find non-English language papers, paper in
many national journals and conferences, or papers that use
unusual terminology.
34
35. Conclusions
• This study provides an overview of the
literature associated with evaluation and
selection of software packages.
• On the basis of literature review we propose
generic software selection methodology and
evaluation criteria.
35