SlideShare a Scribd company logo
1 of 17
Download to read offline
Journal of Cleaner Production 340 (2022) 130803
Available online 3 February 2022
0959-6526/© 2022 Elsevier Ltd. All rights reserved.
A review and catalogue to the use of models in enabling the achievement of
sustainable development goals (SDG)
Ebrahim Aly a,*
, Sondoss Elsawah a,b
, Michael J. Ryan a,b
a
School of Engineering and Information Technology, University of New South Wales, Canberra, Australia
b
Capability Systems Centre, University of New South Wales, Canberra, Australia
A R T I C L E I N F O
Handling editor: Mingzhou Jin
Keywords:
Sustainable development goals
Modelling and simulation
Sustainability science
2030 Agenda
Uncertainty
Decision support
A B S T R A C T
Sustainable development goals (SDG) represent one of the pillars of the UN’s 2030 agenda aiming to secure a
more sustainable future for all nations. The 17 goals comprising the SDG framework form a transformative action
plan that is designed to help nations achieve a more sustainable future focusing on their environmental, social,
and economic systems. Achieving the goals within the designated timeframe, however, entails overcoming
multiple challenges related to policy design, resources management, and harnessing the synergies and trade-offs
among the goals themselves. Recognizing the vital role modeling and simulation can play in facilitating the
achievement of the SDG, this paper provides a review of the academic literature published between 2015 and
2021 relating to the models developed to tackle SDG related issues. The main purpose of this review is to explore
the modeling practices related to SDG and to determine how aligned those modeling practices are with the
priorities of sustainability science. We developed a multi-dimension classification scheme to categorize the
models retrieved from the literature based on their main characteristics focusing on characteristics such as the
modeling approach used, model uncertainty treatment, model temporal and spatial scales, and which science
priority the model focuses on. The results of this research show that most of the models focused on studying
policy changes needed to achieve the SDG and monitoring the progress of the SDG. The results also highlight
missing important characteristics in SDG models such as cross-scale treatment and advanced uncertainty treat­
ment. While this research can be valuable in informing modelers about the gaps need to be filled in SDG
modeling and facilitates the communication between modelers and policy makers, it can be further extended by
including an evaluation for the modeling approaches used in SDG contexts as well as adding more characteristics
to the model categorization scheme.
1. Introduction
The sustainable development goals (SDGs) framework is one of the
pillars of the United Nations’ 2030 agenda which aims to achieve a
better and more prosperous future for Earth and its inhabitants. The set
of 17 overarching goals, with their subsequent 169 targets,1
represents
an ambitious transformative action plan addressing critical grand chal­
lenges pertinent to the environmental, social, and economic aspects of
modern societies UN (2015). The United Nation’s member states are
expected to adopt the SDGs framework as a roadmap to guide their
development and investment plans, to keep track of their progress to­
ward achieving the goals during the designated time frame of 15 years
(OECD and Paris, 2017; Allen et al., 2018). National endeavours toward
accomplishing SDGs entail overcoming multiple hurdles such as priori­
tizing goals and targets, tailoring national strategies and policies to
conform with the SDGs, managing trade-offs and capitalizing on the
synergies among the goals, and securing sufficient resources to facilitate
the transformation toward more sustainable development agendas (Plag
and Jules-Plag, 2019; Messerli et al., 2019; Saito et al., 2017). These
challenges originate from the innate characteristics of the SDGs as an
integrated and indivis ible framework that need to be approached in a
holistic manner, as well as being intertwined and interconnected with
existing conflicts among the goals with environmental focus and those
related to economic and social development (Scherer et al., 2018;
Nilsson et al., 2018; Swain, 2018). Additionally, the SDGs are designed
to be a universal set of goals, that are applicable in all national contexts,
* Corresponding author.
E-mail address: ebrahim.a.aly@gmail.com (E. Aly).
1
For a full list of Sustainable Development Goals, Targets, and indicators, see: https://sdgs.un.org/goals.
Contents lists available at ScienceDirect
Journal of Cleaner Production
journal homepage: www.elsevier.com/locate/jclepro
https://doi.org/10.1016/j.jclepro.2022.130803
Received 14 August 2021; Received in revised form 9 December 2021; Accepted 30 January 2022
Journal of Cleaner Production 340 (2022) 130803
2
i.e. apt for all nations regardless their level of development, however,
such universality means that they do not consider the particular con­
ditions of the nation applying them. Consequently, their potential to
transform the governance practices of those nations into a more sus­
tainable ones can be questionable (Easterly, 2015; Stevens and Kanie,
2016; Cuaresma et al., 2018). Moreover, the ingrained uncertainty
regarding the goals’ trade-offs, feedback impacts, or application at
different scales and contexts means that attaining the SDGs is a “super
wicked” problem that requires unconventional interventions (Allen
et al., 2018, 2021; Georgeson and Maslin, 2018; Cuaresma et al., 2018).
In order to manage the different complexities inherent in planning for
achieving the SDGs, policymakers will need to rely on a suite of decision
support techniques and methodologies that enhances their analytical
capabilities as well as increases their confidence in the decisions they
make. Acknowledging the inadequacy of traditional techniques such as
cost-benefit analysis or macroeconomic modeling in tackling complex
sustainability issues in general and SDGs challenges in particular
(DeCanio, 2003; Scrieciu, 2007; Haldane and Turrell, 2018; Stiglitz,
2018; Meyer and Ahlert, 2019), various research activities have sought
to develop and apply sophisticated techniques that are more capable of
managing the complexities associated with SDGs (Howells et al., 2013;
Joshi et al., 2015; Kumar et al., 2018; Almannaei et al., 2020). The
majority of the techniques deemed effective in guiding policymakers’
endeavours to achieve SDGs fall under the umbrella of modeling and
simulation and form what is known as “model-based decision support
systems” (Allen et al., 2016; Abson et al., 2017; Arnold et al., 2020).
These contemporary techniques or the models built using them, how­
ever, need to have a certain set of attributes in order to be well-suited to
the task of attaining the SDGs and to overcome the challenges associated
with them in harmony with long-term sustainability. One of the
fundamental attributes that is essential in the approaches and tech­
niques used to inform decision making in the context of SDGs is that they
need to utilize systems thinking in order to realize the multiple in­
teractions and contradictions among the economic, ecological, and so­
cial components of the SDGs (Liu et al., 2008; van Delden et al., 2011;
Miller et al., 2014; Le Blanc, 2015; Spaiser et al., 2017; Salling et al.,
2018; Scherer et al., 2018; Allen et al., 2018). The Integrated and
multi-disciplinary scope of the used models has also been recognized as
a key attribute to understand the interactions, trade-offs, and synergies
among the SDGs (Allen et al., 2018; Moon, 2017). Additional highly
desirable attributes are capacity of the model’s to capture the un­
certainties accompanying the analysis, planning for, and implementa­
tion of the SDGs (Allen et al., 2019), in addition to the models’
applicability to multiple temporal and spatial scales, and their ability to
measure the impacts on the socio-environmental-economic systems
(Elsawah et al., 2020; Moon, 2017). Comprehending the position of the
models currently used in SDGs research of those attributes and delin­
eating their dominant characteristics represent an important step to­
ward enhancing a suite of techniques critical for achieving SDGs and
overcoming different issues related to them. Previous reviews mainly
tried to describe how scientific literature is concerned with the SDGs by
examining a large number of publications that are related to the goals, e.
g. Asatani et al. (2020); Meschede (2020); Armitage et al. (2020). Apart
from those universal reviews, others attempted to include modeling in
their review, however, they were either focused on a single type of
models, e.g. Pedercini et al. (2018), or discussed models and sustain­
ability in general such as Boulanger and Bréchet (2005). To address
those issues, this research reviews the literature on SDGs modeling to
answer the following questions:
1. What are the prevalent modeling techniques currently used in
modeling SDGs?
2. Where do the models developed to address SDG issues fit in the
priorities of sustainability science?
3. What are the main characteristics of the models currently used in
modeling SDGs?
The analysis in this work was conducted on literature that discuss
models including single or multiple SDGs. In doing so, we aim to provide
a more detailed view of the characteristics of the models pertaining to
each SDG and to understand how the scientific community interested in
that SDG undertakes modeling efforts related to it. The structure of the
remainder of this paper is as follows. First, we report on a review of the
previous research focused on modeling sustainability and SDGs. Second,
an overview is provided of the methodology used in this research. Next,
we present the analysis and findings of the research. Finally, the im­
plications of the findings are discussed along with highlights of research
gaps and potential future research avenues.
2. Methodology
The scope of the review presented in this paper is directed toward the
SDG framework and the different types of models directly and explicitly
related to it. Publications having general sustainability themes or dis­
cussing models in sustainability contexts are not within the scope. Prior
to applying the research methodology illustrated in Fig. 1, a couple of
assumptions have been made to guide the steps of the methodology.
First, as our aim is to investigate the models or the modeling research
efforts carried out with the SDGs in mind, we only consider the articles
published after the declaration of the SDG framework, i.e. the articles
published from 2015 onward. This approach has been followed by
multiple reviews related to SDGs, such as Bennich et al. (2020), del Río
Castro et al. (2020), Armitage et al. (2020), Asatani et al. (2020), and
Bordignon (2021). The second assumption is related to the SDG focused
keywords used in the search query. Research efforts attempting to locate
scientific output discussing SDGs usually follow one of two approaches:
the first is to use search terms formed by combining keywords and
phrases directly excerpted from the UN’s SDG documents and textual
data such as NETWORK (2020), Olawumi et al. (2017), Asatani et al.
(2020), and Jayabalasingham et al. (2019). The second approach seeks
to acquire contextual data regarding the SDGs rather than just the
documents referring directly to the goals, e.g. retrieving all the docu­
ments discussing the contexts of SDG1 by using terms like “poor
households” or “social protection”. Researchers who use subject area
terms instead of exact terms claim that this approach returns more
relevant results that have a wider scope (Bordignon, 2021; Armitage
et al., 2020). However, using the first approach yields scientific output
that is deliberate in including the SDGs in its research agenda, as well as
reflecting an awareness of the SDGs and their subsequent indicators
(Bennich et al., 2020; Allen et al., 2021; Meschede, 2020). Within the
context of this research we adopt the method of excerpting directly from
the SDGs texts as this method serves the purpose of this review by
limiting the search results to the ones deliberately centered around the
SDG framework.
The methodology outlined in Fig. 1 comprises six main steps. S1
focuses on determining the classification basis for the literature that will
be collected in later steps. In order to answer the research questions
raised in the introduction, three classification dimensions, each of which
is related to a certain research question, will be applied to the retrieved
articles. S2 includes setting the proper keywords that will be used to run
the search query in order to retrieve the most relevant papers. S3 is to
choose the database to be searched and retrieve the search results. S4
involves screening the retrieved results and selecting the relevant
literature. S5 includes applying the classification scheme determined in
S1 on the relevant set of articles resulting from S4. S6 consists of the
analysis of the classified articles, both those discussing modeling of
multiple SDGs and those whose focal point is modeling a single SDG.
Each of the steps is discussed in detail in the following sections.
2.1. Papers classification scheme (S1)
This step includes three sub-steps described in the following sections,
each of which determines a classification dimension related to one of the
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
3
aforementioned research questions. It is worth noting that the order of
the sub-steps is not of particular significance.
2.1.1. Model typology classification (S1.1)
S1.1 aims to determine a typology for the models used in modeling
SDGs based on the modeling approach applied. Establishing a models’
typology and categorizing the models based on that typology allows
comparison of the models and exploring the utility of their subsequent
methodologies and techniques for representing SDGs. Such comparison
also facilitates exploration of the models’ strengths and weaknesses, as
well as indicating which models are most appropriate for the different
types of issues associated with each of the SDGs (Nicholson, 2007).
Despite the increasing use of models in the field of sustainability science,
and the realization of the importance of model classification, a stan­
dardized model categorization scheme is still lacking Allen et al. (2016).
However, a few efforts have been made to provide a model typology; for
instance, Boulanger and Bréchet (2005) categorized the models used in
sustainability sciences based on the five most pressing issues related to
that science, and hence recommended six candidate models for sus­
tainable development: macro-econometric models, computable general
equilibrium (CGE) models, optimization models, system dynamics
models, multi-agent models, and Bayesian networks. Moffatt (2006)
introduced a different classification which included additional types
such as database models, GIS models, and entropy maximizing models.
A more holistic classification that focused on model families instead of
single techniques was suggested by Allen et al. (2016) and Van Beeck
et al. (2000) who bundled together models with similar characteristics
and presented types such as bottom-up simulation models, bottom-up
optimization models, top-down system dynamics models, and hybrid
models. This latter classification, however, neglects other types of
models that can be very beneficial for sustainability sciences, such as
network models, Bayesian networks, and knowledge based models
(Kelly et al., 2013). Based on these classifications and the new trends in
modeling issues related to sustainability, we selected the eight
sub-dimensions presented in Table 1 to be used for the literature
classification.
2.1.2. Sustainability science priority classification (S1.2)
The S1.2 classification dimension is related to the role played by
science in advancing and accomplishing the SDGs. Since their adoption
in 2015, the SDGs have motivated a growing research agenda dedicated
to solving global sustainability problems and progressing the goals
(Saito et al., 2017). Nevertheless, the slow progress toward achieving
the SDGs, partly caused by the limited human ability to design
evidence-based transformative sustainable strategies, has prompted
multiple researchers to focus on exploring how sustainability-related
scientific output can be more effective in supporting the achievement
of the goals (Messerli et al., 2019; Schneider et al., 2019). Based on a
review of this line of research, Allen et al. (2021) describes these pri­
orities as:
• Pr.1 Monitoring and evaluating the progress toward achieving the
SDGs.
• Pr.2 Understanding and managing the synergies and trade-offs
among the SDGs, and the design of interconnections-aware policies.
• Pr.3 Managing the transformations required to achieve the SDGs,
which also entails studying policy changes and exploring different
scenarios that can help in expediting the accomplishment of SDGs.
• Pr.4 Ensuring that achieving SDGs is consistent with preserving the
planetary boundaries and guaranteeing a safe space for humanity.
The retrieved SDGs modeling literature is classified based on which
Fig. 1. Overview of the research methodology.
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
4
of the four most relevant priorities in order to evaluate how balanced the
modeling efforts are in terms of their relevance to the science priorities.
This classification also reflects the potential of models to bridge the gap
between academic efforts and policy making for each of the four
priorities.
2.1.3. Model attribute classification (S1.3)
The third and final classification dimension comprises three sub-
dimensions associated with the model’s spatial scale, uncertainty
treatment, and time treatment. The importance of the first sub-
dimension originates from the fact that integration of actions across
local, national, regional, and global levels is necessary for the achieve­
ment of the SDGs (Stevens, 2018; Downing et al., 2021). Acknowledging
the importance of such consistent cross-scale integration, the 2030
sustainable development agenda requires UN members to set their own
national targets to conform with the global targets (UN, 2015). Incor­
porating this multi-scale view in models, however, is a challenging task
that requires having different levels of knowledge and data about those
sub-systems at the considered scales (Elsawah et al., 2020). In order to
survey how SDG models handle the issue of multiple scales across the
sub-systems, a Cross Scale (CS) category was added to the Model spatial
scale.
The second model attribute to be monitored indicates how uncer­
tainty is treated. Since uncertainty is consistently stated as one of the
major aspects to be accounted for when studying and modeling SDGs
(Allen et al., 2019), we are interested in the explicit consideration of
uncertainty and not just the statistical error reporting that naturally
comes with some economic and econometric models as this error and
confidence reporting is more suited for indicating statistical significance
without real value in informing decisions under uncertainty (McShane
et al., 2019; Wasserstein et al., 2019; Gelman and Carlin, 2017). Un­
certainty, herein, is seen as the lack of clarity about the present and
future behavior of the social, environmental, and economic systems
targeted by the SDGs (Sharif and Irani, 2017). This view can be extended
to include the effects of the design options made during the model
building process, and how those design options affect the model per­
formance and its final outcome (Elsawah et al., 2020). Furthermore, an
extensive consideration of uncertainty considers the combined effect of
the different sources of uncertainty, or what is termed as deep uncertainty
(Maier et al., 2016). Based on this view of the different types of uncer­
tainty, three sub-dimensions were defined for model uncertainty treat­
ment, a) the model does not account for uncertainty in anyway, b) the
Table 1
Sub-dimensions used for model typology classification.
Model type Type
code
Type description
System dynamics SD This modeling technique represents the
modelled system as a network of cause-and-
effect relations between the system variables.
The state of the system variables is represented
by “stocks”, while the rates at which these
variables change are represented by “flows”.
SD is mainly suited to simulating the dynamic
behavior of a certain system and the feedback
reactions between the variables included in the
model. This method is particularly useful for
understanding and exploring different systems
(Elsawah et al., 2017).
Agent based models ABM The system is expressed in terms of agents,
objects, and environments. Agents are
autonomous entities that behave according to a
pre-defined set of rules. This type of models
considered as a bottom-up approach and is
powerful in representing multidisciplinary
systems. As this method allows for stochastic
representation of agents and objects, it is
suitable for managing uncertainty (Epstein and
Axtell, 1996; Boulanger and Bréchet, 2005).
Bayesian networks BN A Bayesian network is an acyclic directed
graph, where variables are represented as
nodes connected with arrows representing the
causal effects between them (Aguilera et al.,
2011). Due to their probabilistic nature,
Bayesian networks are mainly used when
uncertainty is a key consideration in the model
(Kelly et al., 2013). Another strength of BNs is
their ability to handle different types of data, as
well as their ability to perform in cases in
which variables have incomplete data or are
latent. Although they don’t have the ability to
represent feedback loops, nor explicitly
represent spatial and temporal dimensions,
variations of the method, such as dynamic
Bayesian networks and object-oriented
Bayesian networks, can be used to overcome
such limitations (Benjamin-Fink and Reilly,
2017).
Economic models ECON This family includes the models that utilize
macro-economic analysis and are considered as
top-down models. This family of models
include CGE models, input-output models, and
growth models (Van Beeck et al., 2000).
Econometric models ECT This family of models relies on a suite of
statistical methods and techniques such as time
series analysis, structural equation analysis,
and are best suitable for predicting short to
medium term future. These models are also
useful in handling uncertainty (Allen et al.,
2016; Van Beeck et al., 2000).
Integrated models IM This approach combines multiple components
to leverage the strengths of different modeling
techniques. They can be used for a wide range
of applications due to their flexibility and
customizability. Their ability to combine
bottom-up and top-down techniques in one
model means that they are able to overcome
complex systems modeling challenges (
Hamilton et al., 2015). Although integrated
models can be developed using a single
modeling approach or a combination of
modeling approaches, their value comes from
their focus on the integration of various loci in
the modeling process, i.e. integration of
multidisciplinary knowledge, integration of
process, integration of temporal and spatial
scales, or integration with stakeholders (Kelly
et al., 2013). In the context of this analysis, we
categorize a model as an “Integrated model” if
Table 1 (continued)
Model type Type
code
Type description
the researcher states that integration is one of
the model’s intentions.
Knowledge based
modeling
KB Knowledge-based models uses the knowledge
elicited from users and experts to make
inference. They have the ability to incorporate
both qualitative and quantitative data, as well
as to handle uncertainty through the use of
fuzzy logic (Kelly et al., 2013).
Mathematical
quantitative models
MQM This type includes the models that rely on
mathematical and analytical methods such as
optimization models or linear programming
models. One of their main drawbacks is that
they require a high level of mathematical
knowledge and are hard to communicate to
stakeholders (Van Beeck et al., 2000).
Network models NM In network models, variables are represented
as nodes connected with weighted edges,
where the weights represent the levels of
association among the nodes. They are mainly
used to measure interlinkages, synergies, and
trade-offs among system components (
Newman, 2006).
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
5
model includes basic error reporting techniques such as confidence in­
tervals or root square error, and c) the model considers an extended view
of uncertainty. Various methodologies have been developed for dealing
with uncertainty (see for example Refsgaard et al. (2007) and Elsawah
et al. (2020)), however the methods utilized by the models covered in
this research are presented in more detail in the analysis and discussion
section.
The final sub-dimension indicates whether the model is able to
perform analysis over a certain time frame, or whether it is only inten­
ded to evaluate a certain point in time, i.e. Dynamic or Static. Table 2
shows the possible values, description, and codes of each of the three
sub-dimensions of the S1.3 dimension.
2.2. Search queries design (S2)
This second step covers the design of the keywords to be used as
search queries to retrieve the documents that discuss modeling of SDGs.
The selection of search queries is an important step in the analysis as it
has a significant effect on the relevance of the retrieved documents and
their ability to answer the research questions. Such a step becomes more
critical when tackling topics such as the SDGs that have caused much
discussion. This is mainly because terms related to the goals are used
“loosely” within research papers, so that the existence of terminology
related to SDGs in an article does not in any way mean that the article
provide a direct concrete contribution to the topic (Armitage et al.,
2020). The same concept applies to the topic of “modeling and simu­
lation”, as its terminology is used in several contexts beyond the scope of
this research. An effective search query should not be too narrow and
complex, nor so broad that it becomes prone to polysemy and false
positive results (Bordignon, 2021). As stated in the assumptions at the
beginning of this section, we limited our search using terminology
matching that used in description of each goal writing with the intention
to, first, retrieve only documents whose authors explicitly link their
work to the SDGs, and second, to retain specificity to the goals. Fig. 2,
illustrates the fields used to run the search. The fields can be divided into
three main levels: keywords related to modeling and simulation; SDGs
keywords; the conditions define the search temporal scope, document
types, and language. The exact keywords used for the search at each
level are included in the Appendix Table (A2).
2.3. Selection of database and literature search (S3)
In this third step, the search keywords combinations established in
step S2 were used to search the title, abstract, and keywords of publi­
cations in two different multidisciplinary scientific databases, Scopus
and Web of Science (WoS). Previous research analyzing the content of
the two databases discovered considerable discrepancies in the coverage
of the two databases in terms of the number of publications as well as the
covered subject areas (Mongeon and Paul-Hus, 2016; Gavel and Iselid,
2008). Therefore, including search results from the two databases in the
analysis enabled us to draw more accurate conclusions. As shown in
Fig. 2, we limited our search to the documents published between 2015
and 2021 as the SDGs were initiated in 2015. We also designated three
types of documents to be retrieved: Paper articles, Conference pro­
ceedings, and Book chapters. Finally, only English documents were
considered. The Scopus search returned 552 results, and the WoS search
returned only 203 documents.
2.4. Search results screening and selection relevant papers (S4)
Prior to filtering the retrieved articles and extracting the most rele­
vant ones, the two sets of documents from the two databases are
combined and the duplicate results removed, which resulted in a set of
659 unique documents. Then, the unique search results are reviewed
and manually filtered according to the following relevance criteria:
1. Only papers that have direct contribution to SDGs were retained. For
example, a large number of papers include statements such as “This
research will help in achieving the SDGs” or “The 2030 agenda recom­
mends that … " without the article topic being directly related to the
SDGs, nor contributing to any of the science priorities.
2. Only papers that present a model or discuss a modeling technique are
retained. The retained papers include those proposing qualitative
and quantitative models as long as they utilized one of the ap­
proaches mentioned in Table 1. Some papers described the use of
certain computer software as a model, while others used the terms
“model” and “modeling” in irrelevant contexts such as building an
information model” or “topic modeling".
Based on these two filtration criteria, 101 papers were selected. In
addition to these 101 papers that discuss modeling of multiple SDGs, the
papers that focus on individual SDG were collected in a separate set. This
resulted in 17 additional sets each of which related to one of the SDGs.
The number of papers included in each of the 17 sets are shown in
Table A1 modeling.
2.4.1. Article model classification (S5)
After determining the most relevant modeling papers that discusses
multiple SDGs and single SDGs, each of the papers was manually clas­
sified according to the dimensions presented in step S1. Table 3 sum­
marizes the number of papers at each of the sub-dimensions and the
details of the paper classification are in Table SM2 Paper classification in
the supplementary materials.
2.5. Articles analysis (S6)
This step concludes the methodology by performing analysis and
drawing conclusions based on the retrieved documents and their clas­
sification. The following section presents the details of the analysis.
3. Results
Application of steps S1 to S5 outlined in Fig. 1 enabled the collection
and classification of the literature ad-dressing the utilization of
modeling and simulation in SDG contexts. This section provides the
results of analyzing the selected papers which discuss modeling the
SDGs. While the main focus of this section ison the literature including
multiple SDGs in the models (the set of selected 101 papers), it also
presents a brief analysis for the literature discussing single SDGs.
3.1. Overview of the retrieved scientific literature
An overview of the collected documents indicates that modeling
applications for SDGs have grown rapidly from 3 publications in 2015, i.
e. the initiation of the agenda, to 28 publications in 2020. In terms of the
distribution of the models tackling the different science priorities, as
shown in Fig. 3, most of the modeling efforts have focused on Priority 3
Table 2
Sub-dimensions of the S1.3 model attributes dimensions.
Sub-dimension Code Description
Model spatial
scale
G R N
S
CS
Global Regional National Sub-national
Cross scale
Uncertainty
treatment
N
BER
EXU
The model does not account for uncertainty even if
the authors recognize uncertainty exists.
The model uses basic error reporting techniques to
represent un- certainty.
The model acknowledges higher levels of
uncertainty and uses special methods and techniques
to account for it.
Model time
treatment
S
D
Static
Dynamic
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
6
i.e. Managing the transformation required to achieve the SDGs. This
trend rises monotonically unlike the trends of the other priorities which
fluctuate.
Priority 2, i.e. understanding and managing the synergies and trade-
offs among the SDGs was the second which modeling activities focused
on. This interest is aligned with the rapidly evolving field of studying the
SDG interactions and the increasing amount of literature produced dis­
cussing this topic. Science Priority 1, i.e. monitoring and evaluating the
progress toward achieving the SDGs, did not gain traction until recently
which can be attributed to the fact that the modeling community needed
first to decipher the new framework and understand its dynamics. Sci­
ence Priority 4, i.e. ensuring that achieving the SDGs is consistent with
preserving the planetary boundaries, was the focus of the least number
of models despite the concerns raised in recent years that achievement of
the SDGs does not necessarily guarantee the achievement of long-term
sustainability.
A review of the network of sources of the collected articles (Fig. 4)2
shows that they mostly came from multidisciplinary journals or sus­
tainability oriented journals. “The Journal of Cleaner Production” and
“Nature Energy” were the most common, followed by “Sustainability
(Switzerland), “Ecological Economics”, and “Sustainability Science”.
The absence of simulation-oriented publications is an indication that the
simulation and modeling community still has significant role to play in
advancing sustainability sciences. In addition to the sources of the
publications, Fig. 4 also shows additional information about each: the
year of the publication represented by the color of the nodes in the
network and the number of citations represented by the size of the node.
We then looked on the most prevalent modeling techniques applied
in the context of SDGs. As Fig. 5 illustrates, 41% of the models included
in the considered publications were developed using an integrated
modeling approach. The ability of this technique to combine multiple
modeling approaches and balance the strengths and weaknesses of such
approaches, means that it is an efficient choice to model the complex
issues associated with SDGs. Additionally, when used in multidisci­
plinary research, it allows participating parties from different back­
grounds to combine the techniques that are most suitable to each of
them, which increases the model’s usability. Econometric techniques are
also commonly used as well as network modeling and system dynamics
as they represented 17%, 10%, and 9% respectively of the developed
models. The common use of these techniques, particularly econometrics
and network analysis, conforms with the sustainability science priorities
in Fig. 3 as they are mostly used for evaluation and modeling of different
policies in order to test their impacts on achievement of the SDGs as well
as analyzing the interdependencies among the goals. Fig. 5 shows that
techniques such as Bayesian networks and Agent based modelingmod­
eling are under-utilized as they, combined, represent less than 5% of the
developed models.
The performance of the other two model attributes, i.e. spatial
treatment and temporal treatment, is presented in Fig. 6, which shows
that there was little variation in the temporal treatment in the models
with the number of static models being 55 and the dynamic models are
46. In terms of spatial scales, global and national models represented the
highest ratio. The dominance of modeling applications on national and
global scales reflects how SDGs are lacking in the level of detail required
for them to be applicable at more aggregate levels, and that aiding in­
dicators are needed for the models to be beneficial for sustainability at
finer spatial scales Fioramonti et al. (2019); Bahadur et al. (2015).
Moreover, only 5 models attempted to address the cross scale issue when
modeling SDGs. Within the collected documents, only four publications
Fig. 2. The level of search fields using the set of keywords chosen in step S2.
Table 3
Number of papers retrieved for each of the sub-dimensions used to classify the
101 retrieved papers discussing modeling of multiple SDGs.
Dimension Sub-dimension (code) Number of
papers
Model type System dynamics (SD) 9
Agent Based Models (ABM) 2
Bayesian networks (BN) 3
Economic models (ECON) 7
Econometric models (ECT) 17
Integrated models (IM) 42
Knowledge based modeling (KB) 9
Mathematical quantitative models
(MQM)
2
Network models (NM) 10
Total 101
Sustainability science
priority
Priority 1 (Pr1) 14
Priority 2 (Pr2) 17
Priority 3 (Pr3) 56
Priority 4 (Pr4) 14
Total 101
Model spatial scale Global (G) 31
Regional (R) 16
National (N) 31
Sub-national (S) 18
Cross-scale (CS) 5
Total 101
Uncertainty treatment No uncertainty treatment (N) 42
Basic error reporting (BER) 25
Express uncertainty (EXU) 34
Total 101
Model time treatment Static (S) 55
Dynamic (D) 46
Total 101
2
The publications network analysis was performed using the free software
tool VOS viewer (Van Eck and Waltman, 2010).
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
7
Fig. 3. Distribution of the number of models representing sustainability science priorities over the years.
Fig. 4. Layout of the journals where the collected articles are published.
Fig. 5. The most used modeling techniques in the collected papers. [IM: integrated models; ECT: econometric models; NM: network models; SD: system dynamics;
KB: knowledge based models; ECON: economic models; BN: Bayesian networks; MQM: mathematical quantitative models; ABN: agent based models].
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
8
presented models that addressed multiple scales. Aguiar et al. (2020)
proposed a novel approach to develop SDG achieving scenarios that
integrate global perspectives with national planning efforts. Their
method incorporates a participatory process where stakeholders repre­
senting different scales provide insights about alternative pathways for
achieving SDGS. Shaaban et al. (2021) attempted to build an integrated
model to measure the impact of different agents’ behavior on achieving
the SDGs in agricultural contexts. They handled the cross-scale problem
by integrating different modeling techniques, each of which is known to
be effective in managing multiple scales in the model. Another model
that aimed to use global sustainability conditions to guide local land use
patterns was developed by Heck et al. (2018) who applied a top-down
approach to model the synergies and trade-offs among different SDGs
at different scales. Finally, Lucas et al. (2020) utilized a down scaling
approach to model the impacts of changes in the critical Earth systems
on national plans to achieve the SDGs.
In terms of uncertainty, 41.5% of the models did not include any
uncertainty treatment as shown in Fig. 7. For the models that had a view
of uncertainty beyond the basic error reporting, we found that seven
methods have been mostly used for uncertainty treatment. Scenario
modeling was by far the most used technique to account for uncertainty
in models as they represented 37% of the models included uncertainty
treatment. This method is recognized as one of the most effective
methods to handle uncertainty particularly for models serving decision
making proposes (Liu et al., 2008). Using this method, the modelers
investigate a suite of plausible future scenarios to evaluate potential
risks and opportunities as well as the implications of different decisions
(Allen et al., 2016). The other most used methods included Bayesian
analysis, multi-model analysis, and sensitivity analysis. Bayesian infer­
ence is used to represent model parameters in a probabilistic manner
and can also reflect the uncertainty about model structure (Renard et al.,
2010), multi-model simulation on the other hand focuses on the un­
certainty about model structure as assessment is performed using
alternative models for the same systems (Butts et al., 2004). The three
least-used methods were model experiments, expert elicitation, and
exploratory analysis.
In the final part of this section we draw a holistic picture of the
relationship among three of the main attributes measured for the
collected models: the science priority targeted by the model, the
modeling technique utilized by the model, and the spatial scale incor­
porated in the model. The relationships among these three attributes are
represented by the diagram in Fig. 8, which shows how the choice of the
modeling technique is affected by the science priority targeted by the
model, as well as showing how the chosen modeling technique is related
to the treatment of space. For science priorities 1, 3 and 4, i.e. moni­
toring and evaluating the progress toward achieving the SDGs, man­
aging the policy transformations required to achieve the SDGs, and
ensuring that achieving the SDGs in consistent with preserving the
planetary boundaries respectively, integrated modeling was the domi­
nant modeling technique, since targeting those three priorities is closely
related to dealing with the underlying social, environmental, and eco­
nomic systems, therefore the used modeling technique needs to be able
to incorporate knowledge across different disciplines as well as having
the ability to make use of existing models to form a bigger more infor­
mative model. In terms of spatial treatment, integrated modeling ap­
proaches also proved to be suitable for applications most of the scales,
and particularly for cross-scale dimension. We can also see that at na­
tional levels, econometric models are extensively used. This can mainly
be due to the availability of data used by the models on national levels.
In general, the relationships among the three variables indicate the
value of integrated modeling in advancing the science priorities and how
more efforts need to be directed toward advancing science priorities 1
and 4.
3.2. How modeling addresses the four science priorities
This section focuses on the details of the alignment between the
models and the priorities of sustainability science. In order to do so, we
map each of the science priorities to the models used to address it, then
inspect the characteristics of these models. Fig. 9 gives an overview
about the size of representation of each priority as well as the modeling
Fig. 6. Proportion of models belongs to the categories of spatial and temporal treatment among the collected documents. Space treatment abbreviations: [N: Na­
tional; G: Global; S: Sub-national; R: Regional] Time treatment abbreviations: [D: dynamic; S: static].
Fig. 7. Distribution of uncertainty treatment categories and the methods used
to handle model uncertainty. [N: no treatment; BER: basic error reporting; EXU:
expressed uncertainty; SM: scenario modeling; SA: sensitivity analysis].
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
9
techniques used in relation to that priority. At the very outer level, the
figure shows the proportion of the models that considered uncertainty as
a core part of the model development process. Although most of the
models were not developed around the sustainability science priorities,
they help to fulfil the priorities even if they do so unintentionally. The
modeling efforts related to each of the four science priorities are dis­
cussed in more details in sub sections 3.2.1, 3.2.2, 3.2.3, and 3.2.4.
3.2.1. Modeling efforts related to science priority 1
The percentage of models in the collected literature that can support
science Priority 1: Monitoring and evaluating the progress toward
achieving the SDGs was found to be only 14%, however, integrated
modeling was used in 43% of these models. Reid et al. (2019), for
example, integrated three sub models related to monitoring the envi­
ronmental and social systems in order to measure the progress in
goals#2, #6, #13, #14, and #15. Similarly, Long et al. (2020), estab­
lished the key steps for achieving sustainability in an island community,
and measured how pursuing these steps contributes to progressing the
SDGs. Their model included social, physical, and economic sub-models.
In general, researchers who applied integrated modeling under the
umbrella of science priority one, benefited from the ability of the tech­
nique to deal with multiple systems concurrently, and seamlessly inte­
grate different data collection methods, especially with advances of
observation systems such as GIS. Additionally, being able to build a
model based on existing sub-models, facilitated the validation of the
final product and increased the level of confidence in the results (Kebede
Fig. 8. Links between science priorities, modeling techniques, and the spatial scale categories.
Fig. 9. The mapping between different model types and the priorities of sustainability science.
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
10
et al., 2020; Marsh et al., 2016; Kostoska and Kocarev, 2019). The sec­
ond most common type of models that was used for the same priority, is
econometric models which were used mainly to model applications
related to business and their contribution to achieve the SDGs. Those
business oriented applications mainly utilized the abilities of econo­
metric models in dealing with vast amount of data that comes from
different sources and includes multiple inconsistencies (Heravi et al.,
2015; Rasoolimanesh et al., 2019; Alipour et al., 2019). A small portion
of the models in this group utilized the technique of system dynamics.
They mainly relied on this technique due to the dynamic nature of the
system they intended to model, as well as being interested in measuring
the feedback effects within their mode (Spaiser et al., 2019; Pedercini
et al., 2018).
3.2.2. Modeling efforts related to science priority 2
ModelingmodelingThe number of papers related to science Priority
2: Understanding and managing the synergies and trade-offs
among the SDGs is almost equal to those related to the first priority,
with priority 1 representing 17% of the models and priority 1 repre­
senting 14%. The most used modeling approach for priority 2 is network
modeling (41%), which is in fact one of the most favored techniques for
studying the interlinkages among SDGs (Bennich et al., 2020). Re­
searchers apply network modeling to study the trade-offs and synergies
among the SDGs, capitalizing on the technique’s ability to produce
data-driven models that efficiently handle big-data available at multiple
sources (Sebestyén et al., 2019; Zelinka and Amadei, 2019). Another
important feature of network models appropriate to the second science
priority is how it can map different types of real life complex systems, e.
g. social and environmental systems (Weitz et al., 2018; Lim et al.,
2018). Moreover, unlike other techniques such systems dynamics, the
structure of the networks enable its user to investigate causalities in
modelled systems, therefore it can be used to unravel complex in­
teractions among a large number of variables (Dörgo et al., 2018). In­
tegrated models represented 18% of the models addressed priority 2
because of their ability to model complex systems that include different
components that have inconsistent natures was one of the major factors
influencing researchers’ selection. In addition, researchers also appre­
ciated their ability to comprise trusted and reliable sub-models which
reduced the overall uncertainty of the integrated model Forouli et al.
(2020); Moyer and Hedden (2020). Integrated models were also used
because of their ability to capture the changes in different systems with
great accuracy which, when coupled with components to measure the
changes in the SDGs, revealed the underlying interconnections among
the SDGs (Banerjee et al., 2019; Heck et al., 2018; Mainali et al., 2018).
3.2.3. Modeling efforts related to science priority 3
Science Priority 3: Managing the policy transformations required
to achieve the SDGs originates from the view of SDGs as a trans­
formative agenda because in their essence they require serious changes
to current practices and strategies in order for them to progress at a
satisfactory rate (Randers et al., 2018). As the scientific community
began to understand how drastic and deep those changes need to be, it
gave tremendous focus to framing those changes, as a result, our analysis
shows that the third science priority is the most researched among the
four priorities. Research also put special emphasis on the inadequacy of
conventional modeling techniques to handle and manage the policy
transformations needed to make meaningful progress toward a more
sustainable future (Pedercini et al., 2020). This view is echoed in the
modeling efforts related to this third science priority. As it appears in
Figs. 9 and 45% of the modelingmodels related to priority 3 are devel­
oped using integrated modeling. The papers related to this context
frequently utilize a combination of existing models that are academi­
cally recognized, such as IMAGE (Van Vuuren et al., 2017), AIM (Fuji­
mori et al., 2017), or WITCH (Emmerling et al., 2016). In relation to
SDGs, these models either use a single or a group of SDGs as an end
target then apply the model to backcast the policy changes needed to
achieve this goal (Fujimori et al., 2019; Vishwanathan and Garg, 2020;
Grubler et al., 2018; McCollum et al., 2018), or develop different sce­
narios based national contexts and test them regarding their impacts on
progressing SDGs (Pedercini et al., 2018; Mulligan et al., 2020; Grubler
et al., 2018; Llorca et al., 2020; Rao et al., 2016; Allen et al., 2019).
Econometric models represented the second most commonly used
models for science priority three as 20% of the models was developed
using this technique. Although they are not as effective as advanced
modeling techniques such as integrated modeling, they are common in
social science and business applications (Zaini and Akhtar, 2019;
Tiyarattanachai and Chhang, 2019; Ul Hassan and Naz, 2020; Zhou
et al., 2020). System dynamics models were also for 9% of the models as
they allow policy makers to explore the impacts of their decisions on the
long term and how different variables in the system can respond to those
decisions at the future.
3.2.4. Modeling efforts related to science priority 4
Science Priority 4: Ensuring that achieving the SDGs is consistent
with preserving the planetary boundaries and guaranteeing a safe
space for humanity is related to the existing contradictions in the SDGs
that have been argued by different researchers whose concern was that
the frame-work favors economic aspects of development over those that
have an environmental focus (del Río Castro et al., 2020; Hickel, 2019).
Evidence from different countries showed that progress toward social
and economic goals, such as SDGs 1 & 10, had adverse impacts on the
environmentally focused goals (Barbier and Burgess, 2017; Scherer
et al., 2018). These contradictions mean that the achievement of SDGs
does not entail following a sustainable development path, on the con­
trary, it can indicate a deviation from that path due to the unwise use of
resources particularly for developing countries (Dasgupta et al., 2021).
To avoid such a predicament, some researchers proposed using com­
plementary indicators to ensure that by achieving the sustainable
development goals, nations do not compromise long-term sustainability
(Saito et al., 2017; Dasgupta et al., 2021; Pothen and Welsch, 2019).
Moreover, another concern related to how expediting the achievement
of the SDGs may have adverse effects on a nation’s capital assets, is that
eroding the resources base of a country increases their vulnerability to
disasters and hazards, and consequently, decreases their resilience
(Yonehara et al., 2017; Bamberger et al., 2016).
Balancing the achievement of the SDGs and maintenance of the
Earth’s stock of resources to ensure a sustainable and safe future for all is
the focal point of the fourth science priority. It is suggested that this can
be achieved through the integration of the SDGs and other frameworks
that put more focus on resources preservation and maintenance of the
planetary boundaries (Plag and Jules-Plag, 2019; Dasgupta et al., 2021;
Stafford-Smith et al., 2017). This task, however, is not a trivial one
(Häyhä et al., 2016) and modeling can play an effective role in realizing
it (Allen et al., 2021). So far, modelingthe modeling efforts that have
been made toward this end are scarce. Among the notable efforts is the
work of Heck et al. (2018) in which integrated modeling was used to
assess land-use options against their impacts on planetary boundaries.
They did also consider the land uses that contribute to achieving certain
SDGs. Lucas et al. (2020) attempted to operationalize the concept of
planetary boundaries and apply it on a national scale utilizing scenario
modeling to advise SDGs target setting.
3.2.5. Modeling single SDGs
Fewer models have been developed to tackle issues related to a single
SDGs than the ones developed to handle multiple SDGs, as only 83
models have been located in literature covering the 17 SDGs (see
Table A1 for the number of papers related to each SDG). This is mainly
because of the nature of the SDGs as an indivisible and universal
framework. However, for the existing models in which a single SDG is
investigated, SDGs 2 and 6 were the most common with 11 papers for
each (as shown in Fig. 10). SDG 2 pertains to ending hunger, achieving
food security, and promoting sustainable agricultural. The models
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
11
related to SDG 2 only covered science priorities 1 and 3, with more
models covering priority 3. The models focusing on policy issues, i.e.
priority 3, attempt to handle issues such the role of investment in
developing countries for advances of SDG2, or how farming policies can
affect food security (Mason-D’Croz et al., 2019; Scott et al., 2020; Gyasi
et al., 2021; Ritchie et al., 2018). The models related to monitoring the
progress of SDG 2, hence contributing to science priority 1, used mainly
econometric models with one model only relying on system dynamics
(see Kopainsky et al. (2018)).
SDG 6, related to ensuring the availability and sustainability of water
resources, gained a lot of focus as well with applications covering sci­
ence priorities 2 and 3, however, one of the papers discussing it applied
data driven approach to develop a Bayesian network to its interactions
with other component of the 2030 UN agenda (Requejo-Castro et al.,
2020). Most of the papers in this group, i.e. the ones related to a single
SDG, fall under science priorities 1 and 3, however, SDG 4, 7, 11, and 12
contained papers relating to priority number 4. Under SDG 7, for
example, Tiba and Belaid (2021) used a suite of econometric models to
estimate how renewable energy can contribute to achieving SDG 7 as
well as having positive impacts on long term sustainability including its
social, environmental, and economic aspects. The full list of papers and
their classifications can be found in Table SM2 in the supplementary
materials.
4. Discussion
The results of this review provide useful insights for the modeling
efforts carried out to help expedite the achievement of the SDGs. First,
despite the important role that models play in tackling issues related to
SDGs and to sustainability in general (Pedercini et al., 2020; Allen et al.,
2016), research shows that they have a limited impact on decision
making and that very few models are directly used to influence legis­
lation (Will et al., 2021). Among the main causes of this limited use of
models are the lack of a common language between modelers and policy
makers and the mismanaged expectations of policy makers concerning
the models’ capabilities and aspects (Will et al., 2021; Gilbert et al.,
2018). When policy makers cannot understand how the models are
developed and what assumptions affect the model output, they, in such
cases, see models as black boxes that can only be handled by modelers
which reduces their trust and acceptability of the models (Gilbert et al.,
2018). Communicating models’ aspects to decision makers can be a
challenging task for modelers as the former do not have much knowl­
edge about the modeling techniques and do not have much interest in
knowing the technical details of the model (Harris and Howes, 2005).
The multi dimension classification of the models used in SDGs’ contexts
helps in simplifying the communication between decision makers and
modelers as the classification makes it easier to discuss the model
characteristics and link them to the model purpose. Having that type of
model typology can also help in the cases where multiple models are
developed for the same purpose as it will facilitate the conversation
between policy makers, stakeholders, and the model developers. Addi­
tionally, when the model users understand the design decisions that
were taken by modelers, they can put the model into better use which
will, consequently, increases the model’s utility (Mayer et al., 2017).
That effective communication between modelers and policy makers is
particularly important at the early stages of the collaboration between
them, i.e. at the agenda setting, problem framing, and conceptual
modeling stages (Jann and Wegrich, 2017; McIntosh et al., 2007). The
decisions taken at these stages, either the ones related to policy or the
ones related to the model design, are influenced to a great extent by the
Fig. 10. Mapping single SDGs models to the science priorities and the modeling techniques related to each.
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
12
mental frameworks of the collaborating parties (Moallemi et al., 2020).
These mental frameworks, or mental models, reflect the parties’
perception of reality and their understanding of the problem and how to
approach it (Blacketer et al., 2021; Gray et al., 2012). Having an
inconsistent shared mental model between policy makers and modelers
can cause conflicts as well as leading to undesirable model performance
(Lai et al., 2020). On the other hand, having a consistent shared mental
model increases the policy makers’ inclination toward adopting the
model as well as enhancing its performance (Hall et al., 2014). There­
fore, it is important that policy makers are able to understand, to some
extent, the modeling choices made by the modelers and be aware of the
model design aspects (Voinov et al., 2018; Smajgl, 2015). By revealing
and delineating some of the SDG models’ design aspects, this research
implicitly participates in facilitating the communication between policy
makers and modelers.
Additionally, the results of this research provide another insight
related to policy formulation. It is noticed that at the times of crises, such
as the ongoing COVID 19 pandemic, economic growth is usually prior­
itized as it is framed as a necessity for social and environmental devel­
opment. Consequently, policies developed at such times tend to lack
environmental perspective as well as failing to have a balanced
consideration of the three sustainability pillars (Spangenberg, 2010).
While the SDG framework aims to help policy makers to keep social and
environmental systems at the center of their policies and to foster in­
ternational cooperation (Ferranti, 2019), the framework is also criti­
cized for having an imbalanced representation of the social,
environmental, and economic systems (Costanza et al., 2016; Fior­
amonti et al., 2019). Such imbalance between the three sustainability
pillars does not guarantee that the policies designed to achieve the SDG
will contribute to long-term sustainability (Giannetti et al., 2020).
Another adverse effect disasters can have on achieving the SDGs is that
they weaken global engagement and motivate nations to retreat from
planetary thinking (DeWit et al., 2020). This goes against one of the
main principles SDGs aim at maintaining which is to leave no one behind
(Willis, 2016). These challenges highlight the importance of utilizing the
science priorities to inform policy making as well as modeling efforts. In
fact, they show that it is becoming more important to jointly consider
multiple priorities when devising policies related to the SDGs. Priority 3,
for example, needs to be an overarching target that is considered along
with any of the other priorities. Considering multiple priorities in SDGs
models entails the need for building more advance integrated models
and increases the complexity of the challenges modelers need to over­
come in order to efficiently accomplish such task (Elsawah et al., 2020).
Another critical issue that is highlighted in the results of this review
is the representation and communication of uncertainty in SDG related
models. The models’ uncertainty treatment is among the main factors
that affect their acceptance and adoption by policy makers (Will et al.,
2021; Newcomb et al., 2021; Kolkman et al., 2016). The results of this
research show that uncertainty treatment was mostly either lacking or
done using simplified methods that are not suitable for the models tar­
geting SDG issues. In order to robustly support decision making for
interacting social-environmental-economic systems, modelers are
encouraged to utilize more advance uncertainty treatment approaches
such as applying mixed uncertainty treatment frameworks as well as
being elaborate in documenting and reporting the uncertainty treatment
process and its underlying assumptions (Moallemi et al., 2020; New­
comb et al., 2021).
Finally, the outcomes of this research can be useful for modelers
through their attempts to develop SDG related models by presenting the
common modeling practices found in literature. In that sense, these
common practices encapsulate the knowledge applied by other modelers
in this particular context, i.e. the context of SDGs related models
(Boissier, 2017). Although we do not provide an evaluation for the
modeling approaches used for the multi-dimensional classification, their
usage trends in literature can be informative for future modeling efforts.
5. Conclusion
This paper highlights the role played by modeling in advancing the
UN’s SDGs. The potential of models to advance the SDGs and sustain­
ability is recognized and emphasized by multiple researchers from
different backgrounds. However, the models pertaining to SDGs need to
part of an organized research agenda that set the priorities for these
models and increases their effectiveness. From this start point, we
addressed three research questions regarding the main types of models
used in addressing SDGs; how aligned the developed models are with the
priorities of sustainability science as decided by the scientific commu­
nity; and finally the main characteristics of the models developed in
SDGs contexts. In order to answer these questions, we performed a
literature review and analysis for 101 publications that address the ap­
plications of modelingmodeling multiple SDGs as well as 82 publications
that address modeling single SDGs between 2015 and 2021. Prior to
analyzing the collected literature, we presented a multi-dimensional
model classification scheme that enables us to understand how models
are contributing to achieving the SDGs, as well as recognizing the pre­
vailing characteristics of the models used in this application. The top
level of the scheme benefited from the advances of sustainability science
and the efforts made to delineate the gaps that need to be filled with
SDGs’ models. The classification and analysis of the retrieved literature
enabled us to answer the three research questions underpinning this
work.
The first of the three research questions motivating this work is
related to discovering the main modeling methods currently utilized in
building SDG models. Based on the reviewed articles, we found nine
modeling techniques are consistently used to directly address SDGs
related issues, namely, System dynamics, agent based modeling,
Bayesian networks, Econometric models, Economic models, Integrated
models, Knowledge based models, Network models, and Mathematical
quantitative models. Among these types, integrated modeling was the
most adopted modeling approach followed by econometric methods,
while the least applied approaches are Bayesian networks, agent based
modeling, and mathematical quantitative methods. The suitability of
integrated models to represent SDGs stems from their capacity to
leverage the strengths of different other modeling approaches and pro­
vide a more flexible model that overcomes the limitations of other
methods. Additionally, mapping the modeling techniques employed to
the spatial scales of the developed models revealed that integrated
modeling is used for all the possible scales, especially for cross-scale
models which proved to be challenging to develop.
The second research question is underpinned by defining the current
priorities of sustainability research so we can assess if those priorities are
sufficiently addressed by SDG models. Locating the gap between the
topics SDG models focus on and the priorities of sustainability science
will help the modeling community to play a more effective role in
achieving the SDGs. According to recent reviews, there are four areas
that if addressed properly will greatly boost the implementation of the
SDGs. Those areas are: 1) monitoring the progress of the SDGs, 2) un­
derstanding and managing the interconnections between the SDGs, 3)
studying the policy transformations needed to achieve the SDGs, and 4)
evaluating the consistency between achieving the SDGs and preserving
the planetary boundaries. According to the analysis of the current SDGs
models, 72% of the models focused on studying the policy
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
13
transformations needed to achieve the SDGs, as well as understanding
the interconnections among the SDGs. There is therefore a need to direct
more modeling efforts toward studying the coherence between
achieving the SDGs and maintaining the long-term sustainability and
resilience of communities.
Finally, to determine the main characteristics of SDG-focused
models, we first defined three main characteristics with which to cate­
gorize the models: the model spatial scale, how the model deals with
uncertainty, and whether the model is static or dynamic in time. Around
62% of the reviewed models were applied either on a global or national
scales, and only 5% of the models applied a cross-scale approach. This
can be attributed to the complexity of addressing multiple scales in the
same models which highlights the need for developing a more accessible
suite of scaling methods that can be applied by researchers from
different backgrounds. In terms of the way the models treat uncertainty,
we found that, surprisingly, a considerable portion of the studied models
(41.5%) do not include any treatment for uncertainty. Those which did
account for uncertainty, however, relied mainly on seven techniques,
the most common of which is scenario modeling followed by using
Bayesian methods. Sensitivity analysis and multi-model analysis were
also used. It was also found that almost half (46%) of the developed
models were dynamic models relying on a large amount of historical
data as well as trying to provide an analysis of future scenarios for
achieving the SDGs.
There are a number of directions for future research efforts. First, and
most important, is the development of models that address the gaps
outlined by the sustainability science priorities. Additionally, there is
more need to utilize probabilistic methods in building SDG models to be
able to address the uncertainty inherent to the social, economic, and
environmental systems underlying them. Also, more attention should be
given to building a more standardized approach for model categoriza­
tion as a step toward creating a catalogue of models that allows policy
makers to choose optimal models for each application.
Moreover, while this research focuses on the models related to SDGs
extracted from literature, it is expected that these models reflect only the
point of view of researchers and modelers with academic background
and missing the direct input of policy makers. One way to increase the
applicability and efficiency of models in SDG contexts is to investigate
the models that have been already used by policy makers or applied in
real life projects. Following this investigation, interviews with parties
participating in these projects, i.e. model developers, government offi­
cials, and stakeholders from community, can be conducted to extract key
lessons that can guide future modeling efforts. In addition, SDG
Voluntary National Reviews (VNR) can be investigated to check if they
contain any reporting on models’ usage.
Finally, while the focus of this research is on the technical aspects of
models, it is important to consider the political ramifications of those
technical aspects or design choices. Considering the political impacts
associated with policy guided by the model can be very helpful in un­
derstanding the values guiding the SDG decision process from a policy
makers’ perspective and compare it to the values that influence the
scientists through their efforts to develop SDG models’ (or complex
systems models in general). While delineating the types and impacts of
values and biases that influence the decisions modelers make while
building environmental management models have been sought by some
research efforts (e.g. Mayer et al. (2017); Moallemi et al. (2020)),
comparing the modelers’ values to their policy makers’ equivalent can
positively affect the usability and efficiency of SDG models.
Declaration of competing interest
The authors declare that they have no known competing financial
interests or personal relationships that could have appeared to influence
the work reported in this paper.
Appendix
Table A 1
The numbers of papers focusing on modeling
single SDGS
SDG No. of relevant papers
SDG1 6
SDG2 11
SDG3 10
SDG4 6
SDG5 4
SDG6 11
SDG7 7
SDG8 3
SDG9 3
SDG10 0
SDG11 8
SDG12 2
SDG13 3
SDG14 2
SDG15 1
SDG16 2
SDG17 3
Total 82
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
14
Table A 2
The keywords used to run the search at different levels
Search Level Keywords
Modeling Keywords simulation OR modeling OR modeling OR (“integrated Pre/3 model*") OR “system*dynamics” OR “Bayesian network” OR BN OR “agent*based” OR
abm OR “multi agent” OR “scenario model*"
All SDGs Keywords sustainable development goals OR “SDGs” OR “2030 agenda"
Single SDG
keywords
SDG1 “sdg-1′′
or “sdg1′′
“sustainable development goal” near/3 (1 or one) “sustainable development goal” near/15 (poverty or poor)
SDG2 “sdg-2′′
or “sdg2′′
“sustainable development goal” near/3 (2 or two)
“sustainable development goal” near/15 (hunger or “food security” or “sustainable agriculture")
SDG3 “sdg-3′′
or “sdg3′′
“sustainable development goal” near/3 (3 or three)
“sustainable development goal” near/15 (“healthy lives” or “well-being")
SDG4 “sdg-4′′
or “sdg4′′
“sustainable development goal” near/3 (4 or four)
“sustainable development goal” near/15 (“education” or “learning")
SDG5 “sdg-5′′
or “sdg5′′
“sustainable development goal” near/3 (5 or five)
“sustainable development goal” near/15 (“gender equality” or “gender inequality” or (empower* near/3 women))
SDG6 “sdg-6′′
or “sdg6′′
“sustainable development goal” near/3 (6 or six)
“sustainable development goal” near/15 (“sanitation” or (water near/3 availability) or (water near/3 management))
SDG7 “sdg-7′′
or “sdg7′′
“sustainable development goal” near/3 (“7′′
or “seven")
“sustainable development goal” near/15 (“modern energy” or (sustainable near/3 energy) or (affordable near/3 energy))
SDG8 “sdg-8′′
or “sdg8′′
“sustainable development goal” near/3 (“8′′
or “eight")
“sustainable development goal” near/15 (“economic growth” or (productive near/3 employment) or (sustainable near/3 growth) or (sustainable
near/3 economy) or (inclusive near/3 growth))
SDG9 “sdg-9′′
or “sdg9′′
“sustainable development goal” near/3 (“9′′
or “nine")
“sustainable development goal” near/15 (“resilient infrastructure” or (sustainable near/3 industr*) or (inclusive near/3 industr*))
SDG10 “sdg-10′′
or “sdg10′′
“sustainable development goal” near/3 (“10′′
or “ten")
“sustainable development goal” near/15 (inequality near/3 countries)
SDG11 “sdg-11′′
or “sdg11′′
“sustainable development goal” near/3 (“11′′
or “eleven")
“sustainable development goal” near/15 ((resilient near/3 (cities or settlements)) or (inclusive near/3 (cities or settlements)) or (urban near/3
resilien*))
SDG12 “sdg-12′′
or “sdg12′′
“sustainable development goal” near/3 (“12′′
or “twelve")
“sustainable development goal” near/15 ((sustainable near/3 (consumption or production)) or (clean near/3 (consumption or production)))
SDG13 “sdg-13′′
or “sdg13′′
“sustainable development goal” near/3 (“13′′
or “thirteen")
“sustainable development goal” near/15 (“climate change” or “greenhouse gas” or (climate near/3 adapt*) or (climate near/5 resilien*) or (resilien*
near/5 “natural hazards”) or (resilien* near/5 “natural disaster*"))
SDG14 “sdg-14′′
or “sdg14′′
“sustainable development goal” near/3 (“14′′
or “forteen")
“sustainable development goal” near/15 ((sustainbl* near/5 (ocean* or sea* or marine)) or “life below water")
SDG15 “sdg-15′′
or “sdg15′′
“sustainable development goal” near/3 (“15′′
or “fifteen")
“sustainable development goal” near/15 (forest* or terrestrial or desertification or “land degra- dation” or “biodiversity loss")
SDG16 “sdg-16′′
or “sdg16′′
“sustainable development goal” near/3 (“16′′
or “sixteen")
“sustainable development goal” near/15 (societ* near/3 (inclusi* or peac*) or (justice or effec* or accountable or inclusive) near/3 institutions)
SDG17 “sdg-17′′
or “sdg17′′
“sustainable development goal” near/3 (“17′′
or “seventeen")
“sustainable development goal” near/15 (“global partenership” or “sustainble development finance” or “foreign aid” or “international trade” or
“international support")
Appendix A. Supplementary data
Supplementary data to this article can be found online at https://doi.org/10.1016/j.jclepro.2022.130803.
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
15
References
Abson, D.J., Fischer, J., Leventon, J., Newig, J., Schomerus, T., Vilsmaier, U., Von
Wehrden, H., Abernethy, P., Ives, C.D., Jager, N.W., et al., 2017. Leverage points for
sustainability transformation. Ambio 46 (1), 30–39.
Aguiar, A.P.D., Collste, D., Harmácková, Z.V., Pereira, L., Selomane, O., Galafassi, D.,
Van Vuuren, D., Van Der Leeuw, S., 2020. Co- designing global target-seeking
scenarios: a cross-scale participatory process for capturing multiple perspectives on
pathways to sustainability. Global Environ. Change 65, 102198.
Aguilera, P.A., Fernández, A., Fernández, R., Rumí, R., Salmerón, A., 2011. Bayesian
networks in environmental modelling. Environ. Model. Software 26 (12),
1376–1388.
Alipour, H., Safaeimanesh, F., Soosan, A., 2019. Investigating sustainable practices in
hotel industry-from employees’ perspective: evidence from a mediterranean island.
Sustainability 11 (23), 6556.
Allen, C., Metternicht, G., Wiedmann, T., 2016. National pathways to the sustainable
development goals (sdgs): a comparative review of scenario modelling tools.
Environ. Sci. Pol. 66, 199–207.
Allen, C., Metternicht, G., Wiedmann, T., 2018. Initial progress in implementing the
sustainable development goals (sdgs): a review of evidence from countries. Sustain.
Sci. 13 (5), 1453–1467.
Allen, C., Metternicht, G., Wiedmann, T., 2021. Priorities for Science to Support National
Implementation of the Sustainable Development Goals: A Review of Progress and
Gaps. Sustainable Development.
Allen, C., Metternicht, G., Wiedmann, T., Pedercini, M., 2019. Greater gains for Australia
by tackling all sdgs but the last steps will be the most challenging. Nat. Sustain. 2
(11), 1041–1050.
Almannaei, N.A., Akhter, M.S., Shah, A., 2020. Improving Environmental Policy-Making
Process to Enable Achievement of Sustainable Development Goals. Environmental
Policy and Law -(Preprint), pp. 1–8.
Armitage, C.S., Lorenz, M., Mikki, S., 2020. Mapping scholarly publications related to the
sustainable development goals: do independent bibliometric approaches get the
same results? Quant. Sci. Stud. 1 (3), 1092–1108.
Arnold, T., Guillaume, J.H., Lahtinen, T.J., Vervoort, R.W., 2020. From ad-hoc modelling
to strategic infrastructure: a manifesto for model management. Environ. Model.
Software 123, 104563.
Asatani, K., Takeda, H., Yamano, H., Sakata, I., 2020. Scientific attention to sustainability
and sdgs: meta-analysis of academic papers. Energies 13 (4), 975.
Bahadur, A., Lovell, E., Wilkinson, E., Tanner, T., 2015. Resilience in the Sdgs:
Developing an Indicator for Target 1.5 that Is Fit for Purpose. Overseas Development
Institute Briefing, London.
Bamberger, M., Segone, M., Tateossian, F., 2016. Evaluating the Sustainable
Development Goals: with a “No One Left behind” Lens through Equity-Focused and
Gender-Responsive Evaluations. UN Women, New York.
Banerjee, O., Cicowiez, M., Horridge, M., Vargas, R., 2019. Evaluating synergies and
trade-offs in achieving the sdgs of zero hunger and clean water and sanitation: an
application of the ieem platform to Guatemala. Ecol. Econ. 161, 280–291.
Barbier, E.B., Burgess, J.C., 2017. The sustainable development goals and the systems
approach to sustainability. Economics: The OpenAccess, Open-Assessment E-Journal
11 (2017–28), 1–23.
Benjamin-Fink, N., Reilly, B.K., 2017. A road map for developing and applying object-
oriented bayesian networks to “wicked” problems. Ecol. Model. 360, 27–44.
Bennich, T., Weitz, N., Carlsen, H., 2020. Deciphering the Scientific Literature on SDG
Interactions: A Review and Reading Guide. Science of The Total Environment,
138405.
Blacketer, M.P., Brownlee, M.T., Baldwin, E.D., Bowen, B.B., 2021. Fuzzy cognitive maps
of social-ecological complexity: applying mental modeler to the bonneville salt flats.
Ecol. Complex. 47, 100950.
Boissier, F., 2017. Supporting modelers with model qualities and patterns. In: 2017 11th
International Conference on Research Challenges in Information Science (RCIS)’,
IEEE, pp. 440–445.
Bordignon, F., 2021. Dataset of search queries to map scientific publications to the un
sustainable development goals. Data Brief 34, 106731.
Boulanger, P.-M., Bréchet, T., 2005. Models for policy-making in sustainable
development: the state of the art and perspectives for research. Ecol. Econ. 55 (3),
337–350.
Butts, M.B., Payne, J.T., Kristensen, M., Madsen, H., 2004. An evaluation of the impact of
model structure on hydrological modelling uncertainty for streamflow simulation.
J. Hydrol. 298 (1–4), 242–266.
Costanza, R., Daly, L., Fioramonti, L., Giovannini, E., Kubiszewski, I., Mortensen, L.F.,
Pickett, K.E., Ragnarsdottir, K.V., De Vogli, R., Wilkinson, R., 2016. Modelling and
measuring sustainable wellbeing in connection with the un sustainable development
goals. Ecol. Econ. 130, 350–355.
Cuaresma, J.C., Fengler, W., Kharas, H., Bekhtiar, K., Brottrager, M., Hofer, M., 2018.
Will the sustainable development goals be fulfilled? assessing present and future
global poverty. Palgrave Commun. 4 (1), 1–8.
Dasgupta, P., Managi, S., Kumar, P., 2021. The inclusive wealth index and sustainable
development goals. Sustain. Sci. 1–5.
DeCanio, S., 2003. Economic Models of Climate Change: a Critique (Springer).
del Río Castro, G., Fernández, M.C.G., Colsa, Á.U., 2020. Unleashing the convergence
amid digitalization and sustainability towards pursuing the sustainable development
goals (sdgs): a holistic review. J. Clean. Prod., 122204
DeWit, A., Shaw, R., Djalante, R., 2020. An integrated approach to sustainable
development, national resilience, and covid-19 responses: the case of Japan. Int. J.
Disaster Risk Reduc., 101808
Dörgo, G., Sebestyén, V., Abonyi, J., 2018. Evaluating the interconnectedness of the
sustainable development goals based on the causality analysis of sustainability
indicators. Sustainability 10 (10), 3766.
Downing, A.S., Wong, G.Y., Dyer, M., Aguiar, A.P., Selomane, O., Aceituno, A.J., 2021.
When the whole is less than the sum of all parts–tracking global-level impacts of
national sustainability initiatives. Global Environ. Change 69, 102306.
Easterly, W., 2015. The trouble with the sustainable development goals. Curr. Hist. 114
(775), 322.
Elsawah, S., Filatova, T., Jakeman, A.J., Kettner, A.J., Zellner, M.L., Athanasiadis, I.N.,
Hamilton, S.H., Axtell, R.L., Brown, D.G., Gilligan, J.M., et al., 2020. Eight grand
challenges in socio-environmental systems modeling. Socio-Environ. Sys. Model. 2,
16226–16226.
Elsawah, S., Pierce, S.A., Hamilton, S.H., Van Delden, H., Haase, D., Elmahdi, A.,
Jakeman, A.J., 2017. An overview of the system dynamics process for integrated
modelling of socio-ecological systems: lessons on good modelling practice from five
case studies. Environ. Model. Software 93, 127–145.
Emmerling, J., Drouet, L., Reis, L., Bevione, M., Berger, L., Bosetti, V., Carrara, S., De
Cian, E., De Maere D’Aertrycke, G., Longden, T., et al., 2016. The Witch 2016 Model-
Documentation and Implementation of the Shared Socioeconomic Pathways.
Epstein, J.M., Axtell, R., 1996. Growing Artificial Societies: Social Science from the
Bottom up. Brookings Institution Press.
Ferranti, P., 2019. The united nations sustainable development goals. Encyclopedia of
Food Security and Sustainability 6–8.
Fioramonti, L., Coscieme, L., Mortensen, L.F., 2019. From gross domestic product to
wellbeing: how alternative indicators can help connect the new economy with the
sustainable development goals. The Anthropocene Review 6 (3), 207–222.
Forouli, A., Nikas, A., Van de Ven, D.-J., Sampedro, J., Doukas, H., 2020. A multiple-
uncertainty analysis framework for integrated assessment modelling of several
sustainable development goals. Environ. Model. Software 131, 104795.
Fujimori, S., Hasegawa, T., Krey, V., Riahi, K., Bertram, C., Bodirsky, B.L., Bosetti, V.,
Callen, J., Després, J., Doelman, J., et al., 2019. A multi-model assessment of food
security implications of climate change mitigation. Nat. Sustain. 2 (5), 386–396.
Fujimori, S., Hasegawa, T., Masui, T., Takahashi, K., Herran, D.S., Dai, H., Hijioka, Y.,
Kainuma, M., 2017. Ssp3: aim implementation of shared socioeconomic pathways.
Global Environ. Change 42, 268–283.
Gavel, Y., Iselid, L., 2008. Web of Science and Scopus: a Journal Title Overlap Study.
Online information review.
Gelman, A., Carlin, J., 2017. Some natural solutions to the p-value communication
problem—and why they won’t work. J. Am. Stat. Assoc. 112 (519), 899–901.
Georgeson, L., Maslin, M., 2018. Putting the united nations sustainable development
goals into practice: a review of implementation, monitoring, and finance. Geo:
Geogr. Environ. 5 (1), e00049.
Giannetti, B.F., Agostinho, F., Almeida, C.M., Liu, G., Contreras, L.E., Vandecasteele, C.,
Coscieme, L., Sutton, P., Poveda, C., 2020. Insights on the united nations sustainable
development goals scope: are they aligned with a ‘strong’sustainable development?
J. Clean. Prod. 252, 119574.
Gilbert, N., Ahrweiler, P., Barbrook-Johnson, P., Narasimhan, K.P., Wilkinson, H., 2018.
Computational modelling of public policy: reflections on practice. J. Artif. Soc. Soc.
Simulat. 21 (1).
Gray, S., Chan, A., Clark, D., Jordan, R., 2012. Modeling the integration of stakeholder
knowledge in social–ecological decision-making: benefits and limitations to
knowledge diversity. Ecol. Model. 229, 88–96.
Grubler, A., Wilson, C., Bento, N., Boza-Kiss, B., Krey, V., McCollum, D.L., Rao, N.D.,
Riahi, K., Rogelj, J., De Stercke, S., et al., 2018. A low energy demand scenario for
meeting the 1.5 c target and sustainable development goals without negative
emission technologies. Nat. Energy 3 (6), 515–527.
Gyasi, R.M., Phillips, D.R., Adam, A.M., 2021. How far is inclusivity of financial services
associated with food insecurity in later life? implications for health policy and
sustainable development goals. J. Appl. Gerontol. 40 (2), 189–200.
Haldane, A.G., Turrell, A.E., 2018. An interdisciplinary model for macroeconomics. Oxf.
Rev. Econ. Pol. 34 (1–2), 219–251.
Hall, D.M., Lazarus, E.D., Swannack, T.M., 2014. Strategies for communicating systems
models. Environ. Model. Software 55, 70–76.
Hamilton, S.H., ElSawah, S., Guillaume, J.H., Jakeman, A.J., Pierce, S.A., 2015.
Integrated assessment and modelling: overview and synthesis of salient dimensions.
Environ. Model. Software 64, 215–229.
Harris, C., Howes, T., et al., 2005. Does modelling need an image consultant?. In:
Modsim 2005: International Congress on Modelling and Simulation: Advances and
Applications for Management and Decision Making. The Modelling and Simulation
Society of Australia and New Zealand, pp. 2797–2803.
Häyhä, T., Lucas, P.L., van Vuuren, D.P., Cornell, S.E., Hoff, H., 2016. From planetary
boundaries to national fair shares of the global safe operating space—how can the
scales be bridged? Global Environ. Change 40, 60–72.
Heck, V., Hoff, H., Wirsenius, S., Meyer, C., Kreft, H., 2018. Land use options for staying
within the planetary boundaries–synergies and trade-offs between global and local
sustainability goals. Global Environ. Change 49, 73–84.
Heravi, G., Fathi, M., Faeghi, S., 2015. Evaluation of sustainability indicators of
industrial buildings focused on petrochemical projects. J. Clean. Prod. 109, 92–107.
Hickel, J., 2019. The contradiction of the sustainable development goals: growth versus
ecology on a finite planet. Sustain. Dev. 27 (5), 873–884.
Howells, M., Hermann, S., Welsch, M., Bazilian, M., Segerström, R., Alfstad, T.,
Gielen, D., Rogner, H., Fischer, G., Van Velthuizen, H., et al., 2013. Integrated
analysis of climate change, land-use, energy and water strategies. Nat. Clim. Change
3 (7), 621–626.
Jann, W., Wegrich, K., 2017. Theories of the policy cycle. In: Handbook of Public Policy
Analysis. Routledge, pp. 69–88.
E. Aly et al.
Journal of Cleaner Production 340 (2022) 130803
16
Jayabalasingham, B., Boverhof, R., Agnew, K., Klein, L., 2019. Identifying Research
Supporting the United Nations Sustainable Development Goals.
Joshi, D.K., Hughes, B.B., Sisk, T.D., 2015. Improving governance for the post-2015
sustainable development goals: scenario forecasting the next 50 years. World Dev.
70, 286–302.
Kebede, A.S., Nicholls, R.J., Clarke, D., Savin, C., Harrison, P.A., 2020. Integrated
assessment of the food-water-land-ecosystems nexus in europe: implications for
sustainability. Sci. Total Environ., 144461
Kelly, R.A., Jakeman, A.J., Barreteau, O., Borsuk, M.E., ElSawah, S., Hamilton, S.H.,
Henriksen, H.J., Kuikka, S., Maier, H.R., Rizzoli, A.E., et al., 2013. Selecting among
five common modelling approaches for integrated environmental assessment and
management. Environ. Model. Software 47, 159–181.
Kolkman, D.A., Campo, P., Balke-Visser, T., Gilbert, N., 2016. How to build models for
government: criteria driving model acceptance in policymaking. Pol. Sci. 49 (4),
489–504.
Kopainsky, B., Tribaldos, T., Ledermann, S.T., 2018. A food systems perspective for food
and nutrition security beyond the post-2015 development agenda. Syst. Res. Behav.
Sci. 35 (2), 178–190.
Kostoska, O., Kocarev, L., 2019. A novel ict framework for sustainable development
goals. Sustainability 11 (7), 1961.
Kumar, P., Ahmed, F., Singh, R.K., Sinha, P., 2018. Determination of hierarchical
relationships among sustainable development goals using interpretive structural
modeling. Environ. Dev. Sustain. 20 (5), 2119–2137.
Lai, H.-Y., Chen, C.-H., Zheng, P., Khoo, L.P., 2020. Investigating the evolving context of
an unstable approach in aviation from mental model disconnects with an agent-
based model. Reliab. Eng. Syst. Saf. 193, 106657.
Le Blanc, D., 2015. Towards integration at last? the sustainable development goals as a
network of targets. Sustain. Dev. 23 (3), 176–187.
Lim, M.M., Jørgensen, P.S., Wyborn, C.A., 2018. Reframing the sustainable development
goals to achieve sustainable development in the anthropocene—a systems approach.
Ecol. Soc. 23 (3).
Liu, Y., Gupta, H., Springer, E., Wagener, T., 2008. Linking science with environmental
decision making: experiences from an integrated modeling approach to supporting
sustainable water resources management. Environ. Model. Software 23 (7),
846–858.
Llorca, C., Silva, C., Kuehnel, N., Moreno, A.T., Zhang, Q., Kii, M., Moeckel, R., 2020.
Integration of land use and transport to reach sustainable development goals: will
radical scenarios actually get us there? Sustainability 12 (23), 9795.
Long, X., Yu, H., Sun, M., Wang, X.-C., Klemeš, J.J., Xie, W., Wang, C., Li, W., Wang, Y.,
2020. Sustainability evaluation based on the threedimensional ecological footprint
and human development index: a case study on the four island regions in China.
J. Environ. Manag. 265, 110509.
Lucas, P.L., Wilting, H.C., Hof, A.F., van Vuuren, D.P., 2020. Allocating planetary
boundaries to large economies: distributional consequences of alternative
perspectives on distributive fairness. Global Environ. Change 60, 102017.
Maier, H.R., Guillaume, J.H., van Delden, H., Riddell, G.A., Haasnoot, M., Kwakkel, J.H.,
2016. An uncertain future, deep uncertainty, scenarios, robustness and adaptation:
how do they fit together? Environ. Model. Software 81, 154–164.
Mainali, B., Luukkanen, J., Silveira, S., Kaivo-Oja, J., 2018. Evaluating synergies and
trade-offs among sustainable development goals (sdgs): explorative analyses of
development paths in south asia and sub-saharan africa. Sustainability 10 (3), 815.
Marsh, T.L., Yoder, J., Deboch, T., McElwain, T.F., Palmer, G.H., 2016. Livestock
vaccinations translate into increased human capital and school attendance by girls.
Sci. Adv. 2 (12), e1601410.
Mason-D’Croz, D., Sulser, T.B., Wiebe, K., Rosegrant, M.W., Lowder, S.K., Nin-Pratt, A.,
Willenbockel, D., Robinson, S., Zhu, T., Cenacchi, N., et al., 2019. Agricultural
investments and hunger in africa modeling potential contributions to sdg2–zero
hunger. World Dev. 116, 38–53.
Mayer, L.A., Loa, K., Cwik, B., Tuana, N., Keller, K., Gonnerman, C., Parker, A.M.,
Lempert, R.J., 2017. Understanding scientists’ computational modeling decisions
about climate risk management strategies using values-informed mental models.
Global Environ. Change 42, 107–116.
McCollum, D.L., Zhou, W., Bertram, C., De Boer, H.-S., Bosetti, V., Busch, S., Després, J.,
Drouet, L., Emmerling, J., Fay, M., et al., 2018. Energy investment needs for fulfilling
the paris agreement and achieving the sustainable development goals. Nat. Energy 3
(7), 589–599.
McIntosh, B.S., Seaton, R.A., Jeffrey, P., 2007. Tools to think with? towards
understanding the use of computer-based support tools in policy relevant research.
Environ. Model. Software 22 (5), 640–648.
McShane, B.B., Gal, D., Gelman, A., Robert, C., Tackett, J.L., 2019. Abandon statistical
significance. Am. Statistician 73 (Suppl. 1), 235–245.
Meschede, C., 2020. The sustainable development goals in scientific literature: a
bibliometric overview at the meta-level. Sustainability 12 (11), 4461.
Messerli, P., Kim, E.M., Lutz, W., Moatti, J.-P., Richardson, K., Saidam, M., Smith, D.,
Eloundou-Enyegue, P., Foli, E., Glassman, A., et al., 2019. Expansion of
sustainability science needed for the sdgs. Nat. Sustain. 2 (10), 892–894.
Meyer, B., Ahlert, G., 2019. Imperfect markets and the properties of macro-economic-
environmental models as tools for policy evaluation. Ecol. Econ. 155, 80–87.
Miller, T.R., Wiek, A., Sarewitz, D., Robinson, J., Olsson, L., Kriebel, D., Loorbach, D.,
2014. The future of sustainability science: a solutions-oriented research agenda.
Sustain. Sci. 9 (2), 239–246.
Moallemi, E.A., Elsawah, S., Ryan, M.J., 2020a. Strengthening ‘good’modelling practices
in robust decision support: a reporting guideline for combining multiple model-
based methods. Math. Comput. Simulat. 175, 3–24.
Moallemi, E.A., Zare, F., Reed, P.M., Elsawah, S., Ryan, M.J., Bryan, B.A., 2020b.
Structuring and evaluating decision support processes to enhance the robustness of
complex human–natural systems. Environ. Model. Software 123, 104551.
Moffatt, I., 2006. Potentialities, problems, policies and progress in modelling sustainable
development: a dynamic, hierarchical approach. Int. J. Sustain. Dev. World Ecol. 13
(2), 131–150.
Mongeon, P., Paul-Hus, A., 2016. ‘The journal coverage of web of science and scopus: a
comparative analysis’. Scientometrics 106 (1), 213–228.
Moon, Y.B., 2017. Simulation modelling for sustainability: a review of the literature. Int.
J. Sustain. Eng. 10 (1), 2–19.
Moyer, J.D., Hedden, S., 2020. Are we on the right path to achieve the sustainable
development goals? World Dev. 127, 104749.
Mulligan, M., van Soesbergen, A., Hole, D.G., Brooks, T.M., Burke, S., Hutton, J., 2020.
Mapping nature’s contribution to sdg 6 and implications for other sdgs at policy
relevant scales. Remote Sens. Environ. 239, 111671.
Network, A.U., 2020. Search Queries for “Mapping Research Output to the Sustainable
Development Goals (Sdgs)” V5. 0. https://aurora-networkglobal.github.io/
sdg-queries/query_sdg17.xml.
Newcomb, T.J., Simonin, P.W., Martinez, F.A., Chadderton, W.L., Bossenbroek, J.M.,
Cudmore, B., Hoff, M.H., Keller, R.P., Ridenhour, B.D., Rothlisberger, J.D., et al.,
2021. A best practices case study for scientific collaboration between researchers and
managers. Fisheries 46 (3), 131–138.
Newman, M.E., 2006. Modularity and community structure in networks. Proc. Natl.
Acad. Sci. Unit. States Am. 103 (23), 8577–8582.
Nicholson, C.F., 2007. Review of methods for modelling systems evolution. ILRI
Discussion Paper.
Nilsson, M., Chisholm, E., Griggs, D., Howden-Chapman, P., McCollum, D., Messerli, P.,
Neumann, B., Stevance, A.-S., Visbeck, M., StaffordSmith, M., 2018. Mapping
interactions between the sustainable development goals: lessons learned and ways
forward. Sustain. Sci. 13 (6), 1489–1503.
Oecd, S., Paris, M., 2017. Measuring Distance to the Sdg Targets: an Assessment of where
Oecd Countries Stand.
Olawumi, T.O., Chan, D.W., Wong, J.K., 2017. Evolution in the intellectual structure of
bim research: a bibliometric analysis. J. Civ. Eng. Manag. 23 (8), 1060–1081.
Pedercini, M., Arquitt, S., Chan, D., 2020. Integrated simulation for the 2030 agenda.
Syst. Dynam. Rev. 36 (3), 333–357.
Pedercini, M., Zuellich, G., Dianati, K., Arquitt, S., 2018. Toward achieving sustainable
development goals in ivory coast: simulating pathways to sustainable development.
Sustain. Dev. 26 (6), 588–595.
Plag, H.-P., Jules-Plag, S.-A., 2019. A goal-based approach to the identification of
essential transformation variables in support of the implementation of the 2030
agenda for sustainable development. Int. J. Digital Earth 13, 166–187.
Pothen, F., Welsch, H., 2019. Economic development and material use. evidence from
international panel data. World Dev. 115, 107–119.
Randers, J., RockstrÖm, J., Stoknes, P.E., Golüke, U., Collste, D., Cornell, S., 2018.
Transformation is feasible: how to achieve the sustainable development goals within
planetary boundaries. In: A Report to the Club of Rome, for its 50 Years Anniversary
17.
Rao, S., Klimont, Z., Leitao, J., Riahi, K., Van Dingenen, R., Reis, L.A., Calvin, K.,
Dentener, F., Drouet, L., Fujimori, S., et al., 2016. A multi-model assessment of the
co-benefits of climate mitigation for global air quality. Environ. Res. Lett. 11 (12),
124013.
Rasoolimanesh, S.M., Badarulzaman, N., Abdullah, A., Behrang, M., 2019. How
governance influences the components of sustainable urban development? J. Clean.
Prod. 238, 117983.
Refsgaard, J.C., van der Sluijs, J.P., Højberg, A.L., Vanrolleghem, P.A., 2007. Uncertainty
in the environmental modelling process–a framework and guidance. Environ. Model.
Software 22 (11), 1543–1556.
Reid, J., Zeng, C., Wood, D., 2019. Combining Social, Environmental and Design Models
to Support the Sustainable Development Goals. 2019 IEEE Aerospace Conference’,
IEEE, pp. 1–13.
Renard, B., Kavetski, D., Kuczera, G., Thyer, M., Franks, S.W., 2010. Understanding
predictive uncertainty in hydrologic modeling: the challenge of identifying input and
structural errors. Water Resour. Res. 46 (5).
Requejo-Castro, D., Giné-Garriga, R., Pérez-Foguet, A., 2020. Data-driven bayesian
network modelling to explore the relationships between sdg 6 and the 2030 agenda.
Sci. Total Environ. 710, 136014.
Ritchie, H., Reay, D., Higgins, P., 2018. Sustainable food security in India—domestic
production and macronutrient availability. PLoS One 13 (3), e0193766.
Saito, O., Managi, S., Kanie, N., Kauffman, J., Takeuchi, K., 2017. Sustainability science
and implementing the sustainable development goals. Sustain. Sci. 12 (6), 907–910.
Salling, K.B., Barfod, M.B., Pryn, M.R., Leleur, S., 2018. Flexible decision support for
sustainable development: the sustain framework model. Eur. J. Transport Infrastruct.
Res. 18 (3).
Scherer, L., Behrens, P., de Koning, A., Heijungs, R., Sprecher, B., Tukker, A., 2018.
Trade-offs between social and environmental sustainable development goals.
Environ. Sci. Pol. 90, 65–72.
Schneider, F., Kläy, A., Zimmermann, A.B., Buser, T., Ingalls, M., Messerli, P., 2019. How
can science support the 2030 agenda for sustainable development? four tasks to
tackle the normative dimension of sustainability. Sustain. Sci. 14 (6), 1593–1604.
Scott, N., Delport, D., Hainsworth, S., Pearson, R., Morgan, C., Huang, S., Akuoku, J.K.,
Piwoz, E., Shekar, M., Levin, C., et al., 2020. Ending malnutrition in all its forms
requires scaling up proven nutrition interventions and much more: a 129-country
analysis. BMC Med. 18 (1), 1–19.
Scrieciu, S.S., 2007. The inherent dangers of using computable general equilibrium
models as a single integrated modelling framework for sustainability impact
E. Aly et al.
A review and catalogue to the use of models in enabling the achievement of.pdf

More Related Content

Similar to A review and catalogue to the use of models in enabling the achievement of.pdf

I526888.pdf
I526888.pdfI526888.pdf
I526888.pdfaijbm
 
bottom up sustainability.pdf
bottom up sustainability.pdfbottom up sustainability.pdf
bottom up sustainability.pdfbhuvanes6
 
Socio-Economic Factors and Project Implementation in Government Aided Seconda...
Socio-Economic Factors and Project Implementation in Government Aided Seconda...Socio-Economic Factors and Project Implementation in Government Aided Seconda...
Socio-Economic Factors and Project Implementation in Government Aided Seconda...AJHSSR Journal
 
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...Felicia Clark
 
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS f
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS fROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS f
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS fAjit Sabnis
 
Presentation supporting my application to Postdoctoral Research Associate pos...
Presentation supporting my application to Postdoctoral Research Associate pos...Presentation supporting my application to Postdoctoral Research Associate pos...
Presentation supporting my application to Postdoctoral Research Associate pos...Private
 
Adaptive project management practices applied to inter-institutional business...
Adaptive project management practices applied to inter-institutional business...Adaptive project management practices applied to inter-institutional business...
Adaptive project management practices applied to inter-institutional business...André Nery, MSc, PMP
 
Strategic spatial planning, evolutionary governance, and mission-oriented inn...
Strategic spatial planning, evolutionary governance, and mission-oriented inn...Strategic spatial planning, evolutionary governance, and mission-oriented inn...
Strategic spatial planning, evolutionary governance, and mission-oriented inn...Private
 
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docx
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docxRESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docx
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docxrgladys1
 
Assessing Climate Resilience - A Generic Evaluation Framework
Assessing Climate Resilience - A Generic Evaluation FrameworkAssessing Climate Resilience - A Generic Evaluation Framework
Assessing Climate Resilience - A Generic Evaluation FrameworkAmy Cernava
 
Customer engagement and social media.pdf
Customer engagement and social media.pdfCustomer engagement and social media.pdf
Customer engagement and social media.pdfAbdulWahab214415
 
Addressing Complex Challenges Using A Co-Innovation Approach Lessons From Fi...
Addressing Complex Challenges Using A Co-Innovation Approach  Lessons From Fi...Addressing Complex Challenges Using A Co-Innovation Approach  Lessons From Fi...
Addressing Complex Challenges Using A Co-Innovation Approach Lessons From Fi...Cynthia King
 
Computational Modelling of Public PolicyReflections on Prac.docx
Computational Modelling of Public PolicyReflections on Prac.docxComputational Modelling of Public PolicyReflections on Prac.docx
Computational Modelling of Public PolicyReflections on Prac.docxmccormicknadine86
 
Effective Strategy in Local & Regional Development
Effective Strategy in Local & Regional DevelopmentEffective Strategy in Local & Regional Development
Effective Strategy in Local & Regional DevelopmentScott Hutcheson, Ph.D.
 
Sustainability Marker to Support the Project Selection Process: the UNOPS Case
Sustainability Marker to Support the Project Selection Process: the UNOPS CaseSustainability Marker to Support the Project Selection Process: the UNOPS Case
Sustainability Marker to Support the Project Selection Process: the UNOPS CaseRicardo Viana Vargas
 

Similar to A review and catalogue to the use of models in enabling the achievement of.pdf (20)

I526888.pdf
I526888.pdfI526888.pdf
I526888.pdf
 
bottom up sustainability.pdf
bottom up sustainability.pdfbottom up sustainability.pdf
bottom up sustainability.pdf
 
Socio-Economic Factors and Project Implementation in Government Aided Seconda...
Socio-Economic Factors and Project Implementation in Government Aided Seconda...Socio-Economic Factors and Project Implementation in Government Aided Seconda...
Socio-Economic Factors and Project Implementation in Government Aided Seconda...
 
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...
An Assessment Tool To Integrate Sustainability Principles Into The Global Sup...
 
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS f
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS fROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS f
ROLE OF ACADEMIA IN ACHIEVING THE SUSTAINABLE DEVELOPMENT GOALS f
 
Presentation supporting my application to Postdoctoral Research Associate pos...
Presentation supporting my application to Postdoctoral Research Associate pos...Presentation supporting my application to Postdoctoral Research Associate pos...
Presentation supporting my application to Postdoctoral Research Associate pos...
 
Adaptive project management practices applied to inter-institutional business...
Adaptive project management practices applied to inter-institutional business...Adaptive project management practices applied to inter-institutional business...
Adaptive project management practices applied to inter-institutional business...
 
Trn 03
Trn 03Trn 03
Trn 03
 
7. csr 1751 materialiity
7. csr 1751 materialiity7. csr 1751 materialiity
7. csr 1751 materialiity
 
An Adaptive Learning Process for Developing and Applying Sustainability Indic...
An Adaptive Learning Process for Developing and Applying Sustainability Indic...An Adaptive Learning Process for Developing and Applying Sustainability Indic...
An Adaptive Learning Process for Developing and Applying Sustainability Indic...
 
Strategic spatial planning, evolutionary governance, and mission-oriented inn...
Strategic spatial planning, evolutionary governance, and mission-oriented inn...Strategic spatial planning, evolutionary governance, and mission-oriented inn...
Strategic spatial planning, evolutionary governance, and mission-oriented inn...
 
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docx
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docxRESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docx
RESEARCH ARTICLEMUTUAL UNDERSTANDING IN INFORMATION SYSTEM.docx
 
Assessing Climate Resilience - A Generic Evaluation Framework
Assessing Climate Resilience - A Generic Evaluation FrameworkAssessing Climate Resilience - A Generic Evaluation Framework
Assessing Climate Resilience - A Generic Evaluation Framework
 
Customer engagement and social media.pdf
Customer engagement and social media.pdfCustomer engagement and social media.pdf
Customer engagement and social media.pdf
 
Addressing Complex Challenges Using A Co-Innovation Approach Lessons From Fi...
Addressing Complex Challenges Using A Co-Innovation Approach  Lessons From Fi...Addressing Complex Challenges Using A Co-Innovation Approach  Lessons From Fi...
Addressing Complex Challenges Using A Co-Innovation Approach Lessons From Fi...
 
Computational Modelling of Public PolicyReflections on Prac.docx
Computational Modelling of Public PolicyReflections on Prac.docxComputational Modelling of Public PolicyReflections on Prac.docx
Computational Modelling of Public PolicyReflections on Prac.docx
 
Effective Strategy in Local & Regional Development
Effective Strategy in Local & Regional DevelopmentEffective Strategy in Local & Regional Development
Effective Strategy in Local & Regional Development
 
Sustainability Marker to Support the Project Selection Process: the UNOPS Case
Sustainability Marker to Support the Project Selection Process: the UNOPS CaseSustainability Marker to Support the Project Selection Process: the UNOPS Case
Sustainability Marker to Support the Project Selection Process: the UNOPS Case
 
SPM_Metrics_WhitePaper_3
SPM_Metrics_WhitePaper_3SPM_Metrics_WhitePaper_3
SPM_Metrics_WhitePaper_3
 
7 me.pdf
7 me.pdf7 me.pdf
7 me.pdf
 

Recently uploaded

Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...PsychoTech Services
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13Steve Thomason
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Krashi Coaching
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpinRaunakKeshri1
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactPECB
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3JemimahLaneBuaron
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsTechSoup
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDThiyagu K
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 

Recently uploaded (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
IGNOU MSCCFT and PGDCFT Exam Question Pattern: MCFT003 Counselling and Family...
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13The Most Excellent Way | 1 Corinthians 13
The Most Excellent Way | 1 Corinthians 13
 
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
Kisan Call Centre - To harness potential of ICT in Agriculture by answer farm...
 
Student login on Anyboli platform.helpin
Student login on Anyboli platform.helpinStudent login on Anyboli platform.helpin
Student login on Anyboli platform.helpin
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3Q4-W6-Restating Informational Text Grade 3
Q4-W6-Restating Informational Text Grade 3
 
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Introduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The BasicsIntroduction to Nonprofit Accounting: The Basics
Introduction to Nonprofit Accounting: The Basics
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 

A review and catalogue to the use of models in enabling the achievement of.pdf

  • 1. Journal of Cleaner Production 340 (2022) 130803 Available online 3 February 2022 0959-6526/© 2022 Elsevier Ltd. All rights reserved. A review and catalogue to the use of models in enabling the achievement of sustainable development goals (SDG) Ebrahim Aly a,* , Sondoss Elsawah a,b , Michael J. Ryan a,b a School of Engineering and Information Technology, University of New South Wales, Canberra, Australia b Capability Systems Centre, University of New South Wales, Canberra, Australia A R T I C L E I N F O Handling editor: Mingzhou Jin Keywords: Sustainable development goals Modelling and simulation Sustainability science 2030 Agenda Uncertainty Decision support A B S T R A C T Sustainable development goals (SDG) represent one of the pillars of the UN’s 2030 agenda aiming to secure a more sustainable future for all nations. The 17 goals comprising the SDG framework form a transformative action plan that is designed to help nations achieve a more sustainable future focusing on their environmental, social, and economic systems. Achieving the goals within the designated timeframe, however, entails overcoming multiple challenges related to policy design, resources management, and harnessing the synergies and trade-offs among the goals themselves. Recognizing the vital role modeling and simulation can play in facilitating the achievement of the SDG, this paper provides a review of the academic literature published between 2015 and 2021 relating to the models developed to tackle SDG related issues. The main purpose of this review is to explore the modeling practices related to SDG and to determine how aligned those modeling practices are with the priorities of sustainability science. We developed a multi-dimension classification scheme to categorize the models retrieved from the literature based on their main characteristics focusing on characteristics such as the modeling approach used, model uncertainty treatment, model temporal and spatial scales, and which science priority the model focuses on. The results of this research show that most of the models focused on studying policy changes needed to achieve the SDG and monitoring the progress of the SDG. The results also highlight missing important characteristics in SDG models such as cross-scale treatment and advanced uncertainty treat­ ment. While this research can be valuable in informing modelers about the gaps need to be filled in SDG modeling and facilitates the communication between modelers and policy makers, it can be further extended by including an evaluation for the modeling approaches used in SDG contexts as well as adding more characteristics to the model categorization scheme. 1. Introduction The sustainable development goals (SDGs) framework is one of the pillars of the United Nations’ 2030 agenda which aims to achieve a better and more prosperous future for Earth and its inhabitants. The set of 17 overarching goals, with their subsequent 169 targets,1 represents an ambitious transformative action plan addressing critical grand chal­ lenges pertinent to the environmental, social, and economic aspects of modern societies UN (2015). The United Nation’s member states are expected to adopt the SDGs framework as a roadmap to guide their development and investment plans, to keep track of their progress to­ ward achieving the goals during the designated time frame of 15 years (OECD and Paris, 2017; Allen et al., 2018). National endeavours toward accomplishing SDGs entail overcoming multiple hurdles such as priori­ tizing goals and targets, tailoring national strategies and policies to conform with the SDGs, managing trade-offs and capitalizing on the synergies among the goals, and securing sufficient resources to facilitate the transformation toward more sustainable development agendas (Plag and Jules-Plag, 2019; Messerli et al., 2019; Saito et al., 2017). These challenges originate from the innate characteristics of the SDGs as an integrated and indivis ible framework that need to be approached in a holistic manner, as well as being intertwined and interconnected with existing conflicts among the goals with environmental focus and those related to economic and social development (Scherer et al., 2018; Nilsson et al., 2018; Swain, 2018). Additionally, the SDGs are designed to be a universal set of goals, that are applicable in all national contexts, * Corresponding author. E-mail address: ebrahim.a.aly@gmail.com (E. Aly). 1 For a full list of Sustainable Development Goals, Targets, and indicators, see: https://sdgs.un.org/goals. Contents lists available at ScienceDirect Journal of Cleaner Production journal homepage: www.elsevier.com/locate/jclepro https://doi.org/10.1016/j.jclepro.2022.130803 Received 14 August 2021; Received in revised form 9 December 2021; Accepted 30 January 2022
  • 2. Journal of Cleaner Production 340 (2022) 130803 2 i.e. apt for all nations regardless their level of development, however, such universality means that they do not consider the particular con­ ditions of the nation applying them. Consequently, their potential to transform the governance practices of those nations into a more sus­ tainable ones can be questionable (Easterly, 2015; Stevens and Kanie, 2016; Cuaresma et al., 2018). Moreover, the ingrained uncertainty regarding the goals’ trade-offs, feedback impacts, or application at different scales and contexts means that attaining the SDGs is a “super wicked” problem that requires unconventional interventions (Allen et al., 2018, 2021; Georgeson and Maslin, 2018; Cuaresma et al., 2018). In order to manage the different complexities inherent in planning for achieving the SDGs, policymakers will need to rely on a suite of decision support techniques and methodologies that enhances their analytical capabilities as well as increases their confidence in the decisions they make. Acknowledging the inadequacy of traditional techniques such as cost-benefit analysis or macroeconomic modeling in tackling complex sustainability issues in general and SDGs challenges in particular (DeCanio, 2003; Scrieciu, 2007; Haldane and Turrell, 2018; Stiglitz, 2018; Meyer and Ahlert, 2019), various research activities have sought to develop and apply sophisticated techniques that are more capable of managing the complexities associated with SDGs (Howells et al., 2013; Joshi et al., 2015; Kumar et al., 2018; Almannaei et al., 2020). The majority of the techniques deemed effective in guiding policymakers’ endeavours to achieve SDGs fall under the umbrella of modeling and simulation and form what is known as “model-based decision support systems” (Allen et al., 2016; Abson et al., 2017; Arnold et al., 2020). These contemporary techniques or the models built using them, how­ ever, need to have a certain set of attributes in order to be well-suited to the task of attaining the SDGs and to overcome the challenges associated with them in harmony with long-term sustainability. One of the fundamental attributes that is essential in the approaches and tech­ niques used to inform decision making in the context of SDGs is that they need to utilize systems thinking in order to realize the multiple in­ teractions and contradictions among the economic, ecological, and so­ cial components of the SDGs (Liu et al., 2008; van Delden et al., 2011; Miller et al., 2014; Le Blanc, 2015; Spaiser et al., 2017; Salling et al., 2018; Scherer et al., 2018; Allen et al., 2018). The Integrated and multi-disciplinary scope of the used models has also been recognized as a key attribute to understand the interactions, trade-offs, and synergies among the SDGs (Allen et al., 2018; Moon, 2017). Additional highly desirable attributes are capacity of the model’s to capture the un­ certainties accompanying the analysis, planning for, and implementa­ tion of the SDGs (Allen et al., 2019), in addition to the models’ applicability to multiple temporal and spatial scales, and their ability to measure the impacts on the socio-environmental-economic systems (Elsawah et al., 2020; Moon, 2017). Comprehending the position of the models currently used in SDGs research of those attributes and delin­ eating their dominant characteristics represent an important step to­ ward enhancing a suite of techniques critical for achieving SDGs and overcoming different issues related to them. Previous reviews mainly tried to describe how scientific literature is concerned with the SDGs by examining a large number of publications that are related to the goals, e. g. Asatani et al. (2020); Meschede (2020); Armitage et al. (2020). Apart from those universal reviews, others attempted to include modeling in their review, however, they were either focused on a single type of models, e.g. Pedercini et al. (2018), or discussed models and sustain­ ability in general such as Boulanger and Bréchet (2005). To address those issues, this research reviews the literature on SDGs modeling to answer the following questions: 1. What are the prevalent modeling techniques currently used in modeling SDGs? 2. Where do the models developed to address SDG issues fit in the priorities of sustainability science? 3. What are the main characteristics of the models currently used in modeling SDGs? The analysis in this work was conducted on literature that discuss models including single or multiple SDGs. In doing so, we aim to provide a more detailed view of the characteristics of the models pertaining to each SDG and to understand how the scientific community interested in that SDG undertakes modeling efforts related to it. The structure of the remainder of this paper is as follows. First, we report on a review of the previous research focused on modeling sustainability and SDGs. Second, an overview is provided of the methodology used in this research. Next, we present the analysis and findings of the research. Finally, the im­ plications of the findings are discussed along with highlights of research gaps and potential future research avenues. 2. Methodology The scope of the review presented in this paper is directed toward the SDG framework and the different types of models directly and explicitly related to it. Publications having general sustainability themes or dis­ cussing models in sustainability contexts are not within the scope. Prior to applying the research methodology illustrated in Fig. 1, a couple of assumptions have been made to guide the steps of the methodology. First, as our aim is to investigate the models or the modeling research efforts carried out with the SDGs in mind, we only consider the articles published after the declaration of the SDG framework, i.e. the articles published from 2015 onward. This approach has been followed by multiple reviews related to SDGs, such as Bennich et al. (2020), del Río Castro et al. (2020), Armitage et al. (2020), Asatani et al. (2020), and Bordignon (2021). The second assumption is related to the SDG focused keywords used in the search query. Research efforts attempting to locate scientific output discussing SDGs usually follow one of two approaches: the first is to use search terms formed by combining keywords and phrases directly excerpted from the UN’s SDG documents and textual data such as NETWORK (2020), Olawumi et al. (2017), Asatani et al. (2020), and Jayabalasingham et al. (2019). The second approach seeks to acquire contextual data regarding the SDGs rather than just the documents referring directly to the goals, e.g. retrieving all the docu­ ments discussing the contexts of SDG1 by using terms like “poor households” or “social protection”. Researchers who use subject area terms instead of exact terms claim that this approach returns more relevant results that have a wider scope (Bordignon, 2021; Armitage et al., 2020). However, using the first approach yields scientific output that is deliberate in including the SDGs in its research agenda, as well as reflecting an awareness of the SDGs and their subsequent indicators (Bennich et al., 2020; Allen et al., 2021; Meschede, 2020). Within the context of this research we adopt the method of excerpting directly from the SDGs texts as this method serves the purpose of this review by limiting the search results to the ones deliberately centered around the SDG framework. The methodology outlined in Fig. 1 comprises six main steps. S1 focuses on determining the classification basis for the literature that will be collected in later steps. In order to answer the research questions raised in the introduction, three classification dimensions, each of which is related to a certain research question, will be applied to the retrieved articles. S2 includes setting the proper keywords that will be used to run the search query in order to retrieve the most relevant papers. S3 is to choose the database to be searched and retrieve the search results. S4 involves screening the retrieved results and selecting the relevant literature. S5 includes applying the classification scheme determined in S1 on the relevant set of articles resulting from S4. S6 consists of the analysis of the classified articles, both those discussing modeling of multiple SDGs and those whose focal point is modeling a single SDG. Each of the steps is discussed in detail in the following sections. 2.1. Papers classification scheme (S1) This step includes three sub-steps described in the following sections, each of which determines a classification dimension related to one of the E. Aly et al.
  • 3. Journal of Cleaner Production 340 (2022) 130803 3 aforementioned research questions. It is worth noting that the order of the sub-steps is not of particular significance. 2.1.1. Model typology classification (S1.1) S1.1 aims to determine a typology for the models used in modeling SDGs based on the modeling approach applied. Establishing a models’ typology and categorizing the models based on that typology allows comparison of the models and exploring the utility of their subsequent methodologies and techniques for representing SDGs. Such comparison also facilitates exploration of the models’ strengths and weaknesses, as well as indicating which models are most appropriate for the different types of issues associated with each of the SDGs (Nicholson, 2007). Despite the increasing use of models in the field of sustainability science, and the realization of the importance of model classification, a stan­ dardized model categorization scheme is still lacking Allen et al. (2016). However, a few efforts have been made to provide a model typology; for instance, Boulanger and Bréchet (2005) categorized the models used in sustainability sciences based on the five most pressing issues related to that science, and hence recommended six candidate models for sus­ tainable development: macro-econometric models, computable general equilibrium (CGE) models, optimization models, system dynamics models, multi-agent models, and Bayesian networks. Moffatt (2006) introduced a different classification which included additional types such as database models, GIS models, and entropy maximizing models. A more holistic classification that focused on model families instead of single techniques was suggested by Allen et al. (2016) and Van Beeck et al. (2000) who bundled together models with similar characteristics and presented types such as bottom-up simulation models, bottom-up optimization models, top-down system dynamics models, and hybrid models. This latter classification, however, neglects other types of models that can be very beneficial for sustainability sciences, such as network models, Bayesian networks, and knowledge based models (Kelly et al., 2013). Based on these classifications and the new trends in modeling issues related to sustainability, we selected the eight sub-dimensions presented in Table 1 to be used for the literature classification. 2.1.2. Sustainability science priority classification (S1.2) The S1.2 classification dimension is related to the role played by science in advancing and accomplishing the SDGs. Since their adoption in 2015, the SDGs have motivated a growing research agenda dedicated to solving global sustainability problems and progressing the goals (Saito et al., 2017). Nevertheless, the slow progress toward achieving the SDGs, partly caused by the limited human ability to design evidence-based transformative sustainable strategies, has prompted multiple researchers to focus on exploring how sustainability-related scientific output can be more effective in supporting the achievement of the goals (Messerli et al., 2019; Schneider et al., 2019). Based on a review of this line of research, Allen et al. (2021) describes these pri­ orities as: • Pr.1 Monitoring and evaluating the progress toward achieving the SDGs. • Pr.2 Understanding and managing the synergies and trade-offs among the SDGs, and the design of interconnections-aware policies. • Pr.3 Managing the transformations required to achieve the SDGs, which also entails studying policy changes and exploring different scenarios that can help in expediting the accomplishment of SDGs. • Pr.4 Ensuring that achieving SDGs is consistent with preserving the planetary boundaries and guaranteeing a safe space for humanity. The retrieved SDGs modeling literature is classified based on which Fig. 1. Overview of the research methodology. E. Aly et al.
  • 4. Journal of Cleaner Production 340 (2022) 130803 4 of the four most relevant priorities in order to evaluate how balanced the modeling efforts are in terms of their relevance to the science priorities. This classification also reflects the potential of models to bridge the gap between academic efforts and policy making for each of the four priorities. 2.1.3. Model attribute classification (S1.3) The third and final classification dimension comprises three sub- dimensions associated with the model’s spatial scale, uncertainty treatment, and time treatment. The importance of the first sub- dimension originates from the fact that integration of actions across local, national, regional, and global levels is necessary for the achieve­ ment of the SDGs (Stevens, 2018; Downing et al., 2021). Acknowledging the importance of such consistent cross-scale integration, the 2030 sustainable development agenda requires UN members to set their own national targets to conform with the global targets (UN, 2015). Incor­ porating this multi-scale view in models, however, is a challenging task that requires having different levels of knowledge and data about those sub-systems at the considered scales (Elsawah et al., 2020). In order to survey how SDG models handle the issue of multiple scales across the sub-systems, a Cross Scale (CS) category was added to the Model spatial scale. The second model attribute to be monitored indicates how uncer­ tainty is treated. Since uncertainty is consistently stated as one of the major aspects to be accounted for when studying and modeling SDGs (Allen et al., 2019), we are interested in the explicit consideration of uncertainty and not just the statistical error reporting that naturally comes with some economic and econometric models as this error and confidence reporting is more suited for indicating statistical significance without real value in informing decisions under uncertainty (McShane et al., 2019; Wasserstein et al., 2019; Gelman and Carlin, 2017). Un­ certainty, herein, is seen as the lack of clarity about the present and future behavior of the social, environmental, and economic systems targeted by the SDGs (Sharif and Irani, 2017). This view can be extended to include the effects of the design options made during the model building process, and how those design options affect the model per­ formance and its final outcome (Elsawah et al., 2020). Furthermore, an extensive consideration of uncertainty considers the combined effect of the different sources of uncertainty, or what is termed as deep uncertainty (Maier et al., 2016). Based on this view of the different types of uncer­ tainty, three sub-dimensions were defined for model uncertainty treat­ ment, a) the model does not account for uncertainty in anyway, b) the Table 1 Sub-dimensions used for model typology classification. Model type Type code Type description System dynamics SD This modeling technique represents the modelled system as a network of cause-and- effect relations between the system variables. The state of the system variables is represented by “stocks”, while the rates at which these variables change are represented by “flows”. SD is mainly suited to simulating the dynamic behavior of a certain system and the feedback reactions between the variables included in the model. This method is particularly useful for understanding and exploring different systems (Elsawah et al., 2017). Agent based models ABM The system is expressed in terms of agents, objects, and environments. Agents are autonomous entities that behave according to a pre-defined set of rules. This type of models considered as a bottom-up approach and is powerful in representing multidisciplinary systems. As this method allows for stochastic representation of agents and objects, it is suitable for managing uncertainty (Epstein and Axtell, 1996; Boulanger and Bréchet, 2005). Bayesian networks BN A Bayesian network is an acyclic directed graph, where variables are represented as nodes connected with arrows representing the causal effects between them (Aguilera et al., 2011). Due to their probabilistic nature, Bayesian networks are mainly used when uncertainty is a key consideration in the model (Kelly et al., 2013). Another strength of BNs is their ability to handle different types of data, as well as their ability to perform in cases in which variables have incomplete data or are latent. Although they don’t have the ability to represent feedback loops, nor explicitly represent spatial and temporal dimensions, variations of the method, such as dynamic Bayesian networks and object-oriented Bayesian networks, can be used to overcome such limitations (Benjamin-Fink and Reilly, 2017). Economic models ECON This family includes the models that utilize macro-economic analysis and are considered as top-down models. This family of models include CGE models, input-output models, and growth models (Van Beeck et al., 2000). Econometric models ECT This family of models relies on a suite of statistical methods and techniques such as time series analysis, structural equation analysis, and are best suitable for predicting short to medium term future. These models are also useful in handling uncertainty (Allen et al., 2016; Van Beeck et al., 2000). Integrated models IM This approach combines multiple components to leverage the strengths of different modeling techniques. They can be used for a wide range of applications due to their flexibility and customizability. Their ability to combine bottom-up and top-down techniques in one model means that they are able to overcome complex systems modeling challenges ( Hamilton et al., 2015). Although integrated models can be developed using a single modeling approach or a combination of modeling approaches, their value comes from their focus on the integration of various loci in the modeling process, i.e. integration of multidisciplinary knowledge, integration of process, integration of temporal and spatial scales, or integration with stakeholders (Kelly et al., 2013). In the context of this analysis, we categorize a model as an “Integrated model” if Table 1 (continued) Model type Type code Type description the researcher states that integration is one of the model’s intentions. Knowledge based modeling KB Knowledge-based models uses the knowledge elicited from users and experts to make inference. They have the ability to incorporate both qualitative and quantitative data, as well as to handle uncertainty through the use of fuzzy logic (Kelly et al., 2013). Mathematical quantitative models MQM This type includes the models that rely on mathematical and analytical methods such as optimization models or linear programming models. One of their main drawbacks is that they require a high level of mathematical knowledge and are hard to communicate to stakeholders (Van Beeck et al., 2000). Network models NM In network models, variables are represented as nodes connected with weighted edges, where the weights represent the levels of association among the nodes. They are mainly used to measure interlinkages, synergies, and trade-offs among system components ( Newman, 2006). E. Aly et al.
  • 5. Journal of Cleaner Production 340 (2022) 130803 5 model includes basic error reporting techniques such as confidence in­ tervals or root square error, and c) the model considers an extended view of uncertainty. Various methodologies have been developed for dealing with uncertainty (see for example Refsgaard et al. (2007) and Elsawah et al. (2020)), however the methods utilized by the models covered in this research are presented in more detail in the analysis and discussion section. The final sub-dimension indicates whether the model is able to perform analysis over a certain time frame, or whether it is only inten­ ded to evaluate a certain point in time, i.e. Dynamic or Static. Table 2 shows the possible values, description, and codes of each of the three sub-dimensions of the S1.3 dimension. 2.2. Search queries design (S2) This second step covers the design of the keywords to be used as search queries to retrieve the documents that discuss modeling of SDGs. The selection of search queries is an important step in the analysis as it has a significant effect on the relevance of the retrieved documents and their ability to answer the research questions. Such a step becomes more critical when tackling topics such as the SDGs that have caused much discussion. This is mainly because terms related to the goals are used “loosely” within research papers, so that the existence of terminology related to SDGs in an article does not in any way mean that the article provide a direct concrete contribution to the topic (Armitage et al., 2020). The same concept applies to the topic of “modeling and simu­ lation”, as its terminology is used in several contexts beyond the scope of this research. An effective search query should not be too narrow and complex, nor so broad that it becomes prone to polysemy and false positive results (Bordignon, 2021). As stated in the assumptions at the beginning of this section, we limited our search using terminology matching that used in description of each goal writing with the intention to, first, retrieve only documents whose authors explicitly link their work to the SDGs, and second, to retain specificity to the goals. Fig. 2, illustrates the fields used to run the search. The fields can be divided into three main levels: keywords related to modeling and simulation; SDGs keywords; the conditions define the search temporal scope, document types, and language. The exact keywords used for the search at each level are included in the Appendix Table (A2). 2.3. Selection of database and literature search (S3) In this third step, the search keywords combinations established in step S2 were used to search the title, abstract, and keywords of publi­ cations in two different multidisciplinary scientific databases, Scopus and Web of Science (WoS). Previous research analyzing the content of the two databases discovered considerable discrepancies in the coverage of the two databases in terms of the number of publications as well as the covered subject areas (Mongeon and Paul-Hus, 2016; Gavel and Iselid, 2008). Therefore, including search results from the two databases in the analysis enabled us to draw more accurate conclusions. As shown in Fig. 2, we limited our search to the documents published between 2015 and 2021 as the SDGs were initiated in 2015. We also designated three types of documents to be retrieved: Paper articles, Conference pro­ ceedings, and Book chapters. Finally, only English documents were considered. The Scopus search returned 552 results, and the WoS search returned only 203 documents. 2.4. Search results screening and selection relevant papers (S4) Prior to filtering the retrieved articles and extracting the most rele­ vant ones, the two sets of documents from the two databases are combined and the duplicate results removed, which resulted in a set of 659 unique documents. Then, the unique search results are reviewed and manually filtered according to the following relevance criteria: 1. Only papers that have direct contribution to SDGs were retained. For example, a large number of papers include statements such as “This research will help in achieving the SDGs” or “The 2030 agenda recom­ mends that … " without the article topic being directly related to the SDGs, nor contributing to any of the science priorities. 2. Only papers that present a model or discuss a modeling technique are retained. The retained papers include those proposing qualitative and quantitative models as long as they utilized one of the ap­ proaches mentioned in Table 1. Some papers described the use of certain computer software as a model, while others used the terms “model” and “modeling” in irrelevant contexts such as building an information model” or “topic modeling". Based on these two filtration criteria, 101 papers were selected. In addition to these 101 papers that discuss modeling of multiple SDGs, the papers that focus on individual SDG were collected in a separate set. This resulted in 17 additional sets each of which related to one of the SDGs. The number of papers included in each of the 17 sets are shown in Table A1 modeling. 2.4.1. Article model classification (S5) After determining the most relevant modeling papers that discusses multiple SDGs and single SDGs, each of the papers was manually clas­ sified according to the dimensions presented in step S1. Table 3 sum­ marizes the number of papers at each of the sub-dimensions and the details of the paper classification are in Table SM2 Paper classification in the supplementary materials. 2.5. Articles analysis (S6) This step concludes the methodology by performing analysis and drawing conclusions based on the retrieved documents and their clas­ sification. The following section presents the details of the analysis. 3. Results Application of steps S1 to S5 outlined in Fig. 1 enabled the collection and classification of the literature ad-dressing the utilization of modeling and simulation in SDG contexts. This section provides the results of analyzing the selected papers which discuss modeling the SDGs. While the main focus of this section ison the literature including multiple SDGs in the models (the set of selected 101 papers), it also presents a brief analysis for the literature discussing single SDGs. 3.1. Overview of the retrieved scientific literature An overview of the collected documents indicates that modeling applications for SDGs have grown rapidly from 3 publications in 2015, i. e. the initiation of the agenda, to 28 publications in 2020. In terms of the distribution of the models tackling the different science priorities, as shown in Fig. 3, most of the modeling efforts have focused on Priority 3 Table 2 Sub-dimensions of the S1.3 model attributes dimensions. Sub-dimension Code Description Model spatial scale G R N S CS Global Regional National Sub-national Cross scale Uncertainty treatment N BER EXU The model does not account for uncertainty even if the authors recognize uncertainty exists. The model uses basic error reporting techniques to represent un- certainty. The model acknowledges higher levels of uncertainty and uses special methods and techniques to account for it. Model time treatment S D Static Dynamic E. Aly et al.
  • 6. Journal of Cleaner Production 340 (2022) 130803 6 i.e. Managing the transformation required to achieve the SDGs. This trend rises monotonically unlike the trends of the other priorities which fluctuate. Priority 2, i.e. understanding and managing the synergies and trade- offs among the SDGs was the second which modeling activities focused on. This interest is aligned with the rapidly evolving field of studying the SDG interactions and the increasing amount of literature produced dis­ cussing this topic. Science Priority 1, i.e. monitoring and evaluating the progress toward achieving the SDGs, did not gain traction until recently which can be attributed to the fact that the modeling community needed first to decipher the new framework and understand its dynamics. Sci­ ence Priority 4, i.e. ensuring that achieving the SDGs is consistent with preserving the planetary boundaries, was the focus of the least number of models despite the concerns raised in recent years that achievement of the SDGs does not necessarily guarantee the achievement of long-term sustainability. A review of the network of sources of the collected articles (Fig. 4)2 shows that they mostly came from multidisciplinary journals or sus­ tainability oriented journals. “The Journal of Cleaner Production” and “Nature Energy” were the most common, followed by “Sustainability (Switzerland), “Ecological Economics”, and “Sustainability Science”. The absence of simulation-oriented publications is an indication that the simulation and modeling community still has significant role to play in advancing sustainability sciences. In addition to the sources of the publications, Fig. 4 also shows additional information about each: the year of the publication represented by the color of the nodes in the network and the number of citations represented by the size of the node. We then looked on the most prevalent modeling techniques applied in the context of SDGs. As Fig. 5 illustrates, 41% of the models included in the considered publications were developed using an integrated modeling approach. The ability of this technique to combine multiple modeling approaches and balance the strengths and weaknesses of such approaches, means that it is an efficient choice to model the complex issues associated with SDGs. Additionally, when used in multidisci­ plinary research, it allows participating parties from different back­ grounds to combine the techniques that are most suitable to each of them, which increases the model’s usability. Econometric techniques are also commonly used as well as network modeling and system dynamics as they represented 17%, 10%, and 9% respectively of the developed models. The common use of these techniques, particularly econometrics and network analysis, conforms with the sustainability science priorities in Fig. 3 as they are mostly used for evaluation and modeling of different policies in order to test their impacts on achievement of the SDGs as well as analyzing the interdependencies among the goals. Fig. 5 shows that techniques such as Bayesian networks and Agent based modelingmod­ eling are under-utilized as they, combined, represent less than 5% of the developed models. The performance of the other two model attributes, i.e. spatial treatment and temporal treatment, is presented in Fig. 6, which shows that there was little variation in the temporal treatment in the models with the number of static models being 55 and the dynamic models are 46. In terms of spatial scales, global and national models represented the highest ratio. The dominance of modeling applications on national and global scales reflects how SDGs are lacking in the level of detail required for them to be applicable at more aggregate levels, and that aiding in­ dicators are needed for the models to be beneficial for sustainability at finer spatial scales Fioramonti et al. (2019); Bahadur et al. (2015). Moreover, only 5 models attempted to address the cross scale issue when modeling SDGs. Within the collected documents, only four publications Fig. 2. The level of search fields using the set of keywords chosen in step S2. Table 3 Number of papers retrieved for each of the sub-dimensions used to classify the 101 retrieved papers discussing modeling of multiple SDGs. Dimension Sub-dimension (code) Number of papers Model type System dynamics (SD) 9 Agent Based Models (ABM) 2 Bayesian networks (BN) 3 Economic models (ECON) 7 Econometric models (ECT) 17 Integrated models (IM) 42 Knowledge based modeling (KB) 9 Mathematical quantitative models (MQM) 2 Network models (NM) 10 Total 101 Sustainability science priority Priority 1 (Pr1) 14 Priority 2 (Pr2) 17 Priority 3 (Pr3) 56 Priority 4 (Pr4) 14 Total 101 Model spatial scale Global (G) 31 Regional (R) 16 National (N) 31 Sub-national (S) 18 Cross-scale (CS) 5 Total 101 Uncertainty treatment No uncertainty treatment (N) 42 Basic error reporting (BER) 25 Express uncertainty (EXU) 34 Total 101 Model time treatment Static (S) 55 Dynamic (D) 46 Total 101 2 The publications network analysis was performed using the free software tool VOS viewer (Van Eck and Waltman, 2010). E. Aly et al.
  • 7. Journal of Cleaner Production 340 (2022) 130803 7 Fig. 3. Distribution of the number of models representing sustainability science priorities over the years. Fig. 4. Layout of the journals where the collected articles are published. Fig. 5. The most used modeling techniques in the collected papers. [IM: integrated models; ECT: econometric models; NM: network models; SD: system dynamics; KB: knowledge based models; ECON: economic models; BN: Bayesian networks; MQM: mathematical quantitative models; ABN: agent based models]. E. Aly et al.
  • 8. Journal of Cleaner Production 340 (2022) 130803 8 presented models that addressed multiple scales. Aguiar et al. (2020) proposed a novel approach to develop SDG achieving scenarios that integrate global perspectives with national planning efforts. Their method incorporates a participatory process where stakeholders repre­ senting different scales provide insights about alternative pathways for achieving SDGS. Shaaban et al. (2021) attempted to build an integrated model to measure the impact of different agents’ behavior on achieving the SDGs in agricultural contexts. They handled the cross-scale problem by integrating different modeling techniques, each of which is known to be effective in managing multiple scales in the model. Another model that aimed to use global sustainability conditions to guide local land use patterns was developed by Heck et al. (2018) who applied a top-down approach to model the synergies and trade-offs among different SDGs at different scales. Finally, Lucas et al. (2020) utilized a down scaling approach to model the impacts of changes in the critical Earth systems on national plans to achieve the SDGs. In terms of uncertainty, 41.5% of the models did not include any uncertainty treatment as shown in Fig. 7. For the models that had a view of uncertainty beyond the basic error reporting, we found that seven methods have been mostly used for uncertainty treatment. Scenario modeling was by far the most used technique to account for uncertainty in models as they represented 37% of the models included uncertainty treatment. This method is recognized as one of the most effective methods to handle uncertainty particularly for models serving decision making proposes (Liu et al., 2008). Using this method, the modelers investigate a suite of plausible future scenarios to evaluate potential risks and opportunities as well as the implications of different decisions (Allen et al., 2016). The other most used methods included Bayesian analysis, multi-model analysis, and sensitivity analysis. Bayesian infer­ ence is used to represent model parameters in a probabilistic manner and can also reflect the uncertainty about model structure (Renard et al., 2010), multi-model simulation on the other hand focuses on the un­ certainty about model structure as assessment is performed using alternative models for the same systems (Butts et al., 2004). The three least-used methods were model experiments, expert elicitation, and exploratory analysis. In the final part of this section we draw a holistic picture of the relationship among three of the main attributes measured for the collected models: the science priority targeted by the model, the modeling technique utilized by the model, and the spatial scale incor­ porated in the model. The relationships among these three attributes are represented by the diagram in Fig. 8, which shows how the choice of the modeling technique is affected by the science priority targeted by the model, as well as showing how the chosen modeling technique is related to the treatment of space. For science priorities 1, 3 and 4, i.e. moni­ toring and evaluating the progress toward achieving the SDGs, man­ aging the policy transformations required to achieve the SDGs, and ensuring that achieving the SDGs in consistent with preserving the planetary boundaries respectively, integrated modeling was the domi­ nant modeling technique, since targeting those three priorities is closely related to dealing with the underlying social, environmental, and eco­ nomic systems, therefore the used modeling technique needs to be able to incorporate knowledge across different disciplines as well as having the ability to make use of existing models to form a bigger more infor­ mative model. In terms of spatial treatment, integrated modeling ap­ proaches also proved to be suitable for applications most of the scales, and particularly for cross-scale dimension. We can also see that at na­ tional levels, econometric models are extensively used. This can mainly be due to the availability of data used by the models on national levels. In general, the relationships among the three variables indicate the value of integrated modeling in advancing the science priorities and how more efforts need to be directed toward advancing science priorities 1 and 4. 3.2. How modeling addresses the four science priorities This section focuses on the details of the alignment between the models and the priorities of sustainability science. In order to do so, we map each of the science priorities to the models used to address it, then inspect the characteristics of these models. Fig. 9 gives an overview about the size of representation of each priority as well as the modeling Fig. 6. Proportion of models belongs to the categories of spatial and temporal treatment among the collected documents. Space treatment abbreviations: [N: Na­ tional; G: Global; S: Sub-national; R: Regional] Time treatment abbreviations: [D: dynamic; S: static]. Fig. 7. Distribution of uncertainty treatment categories and the methods used to handle model uncertainty. [N: no treatment; BER: basic error reporting; EXU: expressed uncertainty; SM: scenario modeling; SA: sensitivity analysis]. E. Aly et al.
  • 9. Journal of Cleaner Production 340 (2022) 130803 9 techniques used in relation to that priority. At the very outer level, the figure shows the proportion of the models that considered uncertainty as a core part of the model development process. Although most of the models were not developed around the sustainability science priorities, they help to fulfil the priorities even if they do so unintentionally. The modeling efforts related to each of the four science priorities are dis­ cussed in more details in sub sections 3.2.1, 3.2.2, 3.2.3, and 3.2.4. 3.2.1. Modeling efforts related to science priority 1 The percentage of models in the collected literature that can support science Priority 1: Monitoring and evaluating the progress toward achieving the SDGs was found to be only 14%, however, integrated modeling was used in 43% of these models. Reid et al. (2019), for example, integrated three sub models related to monitoring the envi­ ronmental and social systems in order to measure the progress in goals#2, #6, #13, #14, and #15. Similarly, Long et al. (2020), estab­ lished the key steps for achieving sustainability in an island community, and measured how pursuing these steps contributes to progressing the SDGs. Their model included social, physical, and economic sub-models. In general, researchers who applied integrated modeling under the umbrella of science priority one, benefited from the ability of the tech­ nique to deal with multiple systems concurrently, and seamlessly inte­ grate different data collection methods, especially with advances of observation systems such as GIS. Additionally, being able to build a model based on existing sub-models, facilitated the validation of the final product and increased the level of confidence in the results (Kebede Fig. 8. Links between science priorities, modeling techniques, and the spatial scale categories. Fig. 9. The mapping between different model types and the priorities of sustainability science. E. Aly et al.
  • 10. Journal of Cleaner Production 340 (2022) 130803 10 et al., 2020; Marsh et al., 2016; Kostoska and Kocarev, 2019). The sec­ ond most common type of models that was used for the same priority, is econometric models which were used mainly to model applications related to business and their contribution to achieve the SDGs. Those business oriented applications mainly utilized the abilities of econo­ metric models in dealing with vast amount of data that comes from different sources and includes multiple inconsistencies (Heravi et al., 2015; Rasoolimanesh et al., 2019; Alipour et al., 2019). A small portion of the models in this group utilized the technique of system dynamics. They mainly relied on this technique due to the dynamic nature of the system they intended to model, as well as being interested in measuring the feedback effects within their mode (Spaiser et al., 2019; Pedercini et al., 2018). 3.2.2. Modeling efforts related to science priority 2 ModelingmodelingThe number of papers related to science Priority 2: Understanding and managing the synergies and trade-offs among the SDGs is almost equal to those related to the first priority, with priority 1 representing 17% of the models and priority 1 repre­ senting 14%. The most used modeling approach for priority 2 is network modeling (41%), which is in fact one of the most favored techniques for studying the interlinkages among SDGs (Bennich et al., 2020). Re­ searchers apply network modeling to study the trade-offs and synergies among the SDGs, capitalizing on the technique’s ability to produce data-driven models that efficiently handle big-data available at multiple sources (Sebestyén et al., 2019; Zelinka and Amadei, 2019). Another important feature of network models appropriate to the second science priority is how it can map different types of real life complex systems, e. g. social and environmental systems (Weitz et al., 2018; Lim et al., 2018). Moreover, unlike other techniques such systems dynamics, the structure of the networks enable its user to investigate causalities in modelled systems, therefore it can be used to unravel complex in­ teractions among a large number of variables (Dörgo et al., 2018). In­ tegrated models represented 18% of the models addressed priority 2 because of their ability to model complex systems that include different components that have inconsistent natures was one of the major factors influencing researchers’ selection. In addition, researchers also appre­ ciated their ability to comprise trusted and reliable sub-models which reduced the overall uncertainty of the integrated model Forouli et al. (2020); Moyer and Hedden (2020). Integrated models were also used because of their ability to capture the changes in different systems with great accuracy which, when coupled with components to measure the changes in the SDGs, revealed the underlying interconnections among the SDGs (Banerjee et al., 2019; Heck et al., 2018; Mainali et al., 2018). 3.2.3. Modeling efforts related to science priority 3 Science Priority 3: Managing the policy transformations required to achieve the SDGs originates from the view of SDGs as a trans­ formative agenda because in their essence they require serious changes to current practices and strategies in order for them to progress at a satisfactory rate (Randers et al., 2018). As the scientific community began to understand how drastic and deep those changes need to be, it gave tremendous focus to framing those changes, as a result, our analysis shows that the third science priority is the most researched among the four priorities. Research also put special emphasis on the inadequacy of conventional modeling techniques to handle and manage the policy transformations needed to make meaningful progress toward a more sustainable future (Pedercini et al., 2020). This view is echoed in the modeling efforts related to this third science priority. As it appears in Figs. 9 and 45% of the modelingmodels related to priority 3 are devel­ oped using integrated modeling. The papers related to this context frequently utilize a combination of existing models that are academi­ cally recognized, such as IMAGE (Van Vuuren et al., 2017), AIM (Fuji­ mori et al., 2017), or WITCH (Emmerling et al., 2016). In relation to SDGs, these models either use a single or a group of SDGs as an end target then apply the model to backcast the policy changes needed to achieve this goal (Fujimori et al., 2019; Vishwanathan and Garg, 2020; Grubler et al., 2018; McCollum et al., 2018), or develop different sce­ narios based national contexts and test them regarding their impacts on progressing SDGs (Pedercini et al., 2018; Mulligan et al., 2020; Grubler et al., 2018; Llorca et al., 2020; Rao et al., 2016; Allen et al., 2019). Econometric models represented the second most commonly used models for science priority three as 20% of the models was developed using this technique. Although they are not as effective as advanced modeling techniques such as integrated modeling, they are common in social science and business applications (Zaini and Akhtar, 2019; Tiyarattanachai and Chhang, 2019; Ul Hassan and Naz, 2020; Zhou et al., 2020). System dynamics models were also for 9% of the models as they allow policy makers to explore the impacts of their decisions on the long term and how different variables in the system can respond to those decisions at the future. 3.2.4. Modeling efforts related to science priority 4 Science Priority 4: Ensuring that achieving the SDGs is consistent with preserving the planetary boundaries and guaranteeing a safe space for humanity is related to the existing contradictions in the SDGs that have been argued by different researchers whose concern was that the frame-work favors economic aspects of development over those that have an environmental focus (del Río Castro et al., 2020; Hickel, 2019). Evidence from different countries showed that progress toward social and economic goals, such as SDGs 1 & 10, had adverse impacts on the environmentally focused goals (Barbier and Burgess, 2017; Scherer et al., 2018). These contradictions mean that the achievement of SDGs does not entail following a sustainable development path, on the con­ trary, it can indicate a deviation from that path due to the unwise use of resources particularly for developing countries (Dasgupta et al., 2021). To avoid such a predicament, some researchers proposed using com­ plementary indicators to ensure that by achieving the sustainable development goals, nations do not compromise long-term sustainability (Saito et al., 2017; Dasgupta et al., 2021; Pothen and Welsch, 2019). Moreover, another concern related to how expediting the achievement of the SDGs may have adverse effects on a nation’s capital assets, is that eroding the resources base of a country increases their vulnerability to disasters and hazards, and consequently, decreases their resilience (Yonehara et al., 2017; Bamberger et al., 2016). Balancing the achievement of the SDGs and maintenance of the Earth’s stock of resources to ensure a sustainable and safe future for all is the focal point of the fourth science priority. It is suggested that this can be achieved through the integration of the SDGs and other frameworks that put more focus on resources preservation and maintenance of the planetary boundaries (Plag and Jules-Plag, 2019; Dasgupta et al., 2021; Stafford-Smith et al., 2017). This task, however, is not a trivial one (Häyhä et al., 2016) and modeling can play an effective role in realizing it (Allen et al., 2021). So far, modelingthe modeling efforts that have been made toward this end are scarce. Among the notable efforts is the work of Heck et al. (2018) in which integrated modeling was used to assess land-use options against their impacts on planetary boundaries. They did also consider the land uses that contribute to achieving certain SDGs. Lucas et al. (2020) attempted to operationalize the concept of planetary boundaries and apply it on a national scale utilizing scenario modeling to advise SDGs target setting. 3.2.5. Modeling single SDGs Fewer models have been developed to tackle issues related to a single SDGs than the ones developed to handle multiple SDGs, as only 83 models have been located in literature covering the 17 SDGs (see Table A1 for the number of papers related to each SDG). This is mainly because of the nature of the SDGs as an indivisible and universal framework. However, for the existing models in which a single SDG is investigated, SDGs 2 and 6 were the most common with 11 papers for each (as shown in Fig. 10). SDG 2 pertains to ending hunger, achieving food security, and promoting sustainable agricultural. The models E. Aly et al.
  • 11. Journal of Cleaner Production 340 (2022) 130803 11 related to SDG 2 only covered science priorities 1 and 3, with more models covering priority 3. The models focusing on policy issues, i.e. priority 3, attempt to handle issues such the role of investment in developing countries for advances of SDG2, or how farming policies can affect food security (Mason-D’Croz et al., 2019; Scott et al., 2020; Gyasi et al., 2021; Ritchie et al., 2018). The models related to monitoring the progress of SDG 2, hence contributing to science priority 1, used mainly econometric models with one model only relying on system dynamics (see Kopainsky et al. (2018)). SDG 6, related to ensuring the availability and sustainability of water resources, gained a lot of focus as well with applications covering sci­ ence priorities 2 and 3, however, one of the papers discussing it applied data driven approach to develop a Bayesian network to its interactions with other component of the 2030 UN agenda (Requejo-Castro et al., 2020). Most of the papers in this group, i.e. the ones related to a single SDG, fall under science priorities 1 and 3, however, SDG 4, 7, 11, and 12 contained papers relating to priority number 4. Under SDG 7, for example, Tiba and Belaid (2021) used a suite of econometric models to estimate how renewable energy can contribute to achieving SDG 7 as well as having positive impacts on long term sustainability including its social, environmental, and economic aspects. The full list of papers and their classifications can be found in Table SM2 in the supplementary materials. 4. Discussion The results of this review provide useful insights for the modeling efforts carried out to help expedite the achievement of the SDGs. First, despite the important role that models play in tackling issues related to SDGs and to sustainability in general (Pedercini et al., 2020; Allen et al., 2016), research shows that they have a limited impact on decision making and that very few models are directly used to influence legis­ lation (Will et al., 2021). Among the main causes of this limited use of models are the lack of a common language between modelers and policy makers and the mismanaged expectations of policy makers concerning the models’ capabilities and aspects (Will et al., 2021; Gilbert et al., 2018). When policy makers cannot understand how the models are developed and what assumptions affect the model output, they, in such cases, see models as black boxes that can only be handled by modelers which reduces their trust and acceptability of the models (Gilbert et al., 2018). Communicating models’ aspects to decision makers can be a challenging task for modelers as the former do not have much knowl­ edge about the modeling techniques and do not have much interest in knowing the technical details of the model (Harris and Howes, 2005). The multi dimension classification of the models used in SDGs’ contexts helps in simplifying the communication between decision makers and modelers as the classification makes it easier to discuss the model characteristics and link them to the model purpose. Having that type of model typology can also help in the cases where multiple models are developed for the same purpose as it will facilitate the conversation between policy makers, stakeholders, and the model developers. Addi­ tionally, when the model users understand the design decisions that were taken by modelers, they can put the model into better use which will, consequently, increases the model’s utility (Mayer et al., 2017). That effective communication between modelers and policy makers is particularly important at the early stages of the collaboration between them, i.e. at the agenda setting, problem framing, and conceptual modeling stages (Jann and Wegrich, 2017; McIntosh et al., 2007). The decisions taken at these stages, either the ones related to policy or the ones related to the model design, are influenced to a great extent by the Fig. 10. Mapping single SDGs models to the science priorities and the modeling techniques related to each. E. Aly et al.
  • 12. Journal of Cleaner Production 340 (2022) 130803 12 mental frameworks of the collaborating parties (Moallemi et al., 2020). These mental frameworks, or mental models, reflect the parties’ perception of reality and their understanding of the problem and how to approach it (Blacketer et al., 2021; Gray et al., 2012). Having an inconsistent shared mental model between policy makers and modelers can cause conflicts as well as leading to undesirable model performance (Lai et al., 2020). On the other hand, having a consistent shared mental model increases the policy makers’ inclination toward adopting the model as well as enhancing its performance (Hall et al., 2014). There­ fore, it is important that policy makers are able to understand, to some extent, the modeling choices made by the modelers and be aware of the model design aspects (Voinov et al., 2018; Smajgl, 2015). By revealing and delineating some of the SDG models’ design aspects, this research implicitly participates in facilitating the communication between policy makers and modelers. Additionally, the results of this research provide another insight related to policy formulation. It is noticed that at the times of crises, such as the ongoing COVID 19 pandemic, economic growth is usually prior­ itized as it is framed as a necessity for social and environmental devel­ opment. Consequently, policies developed at such times tend to lack environmental perspective as well as failing to have a balanced consideration of the three sustainability pillars (Spangenberg, 2010). While the SDG framework aims to help policy makers to keep social and environmental systems at the center of their policies and to foster in­ ternational cooperation (Ferranti, 2019), the framework is also criti­ cized for having an imbalanced representation of the social, environmental, and economic systems (Costanza et al., 2016; Fior­ amonti et al., 2019). Such imbalance between the three sustainability pillars does not guarantee that the policies designed to achieve the SDG will contribute to long-term sustainability (Giannetti et al., 2020). Another adverse effect disasters can have on achieving the SDGs is that they weaken global engagement and motivate nations to retreat from planetary thinking (DeWit et al., 2020). This goes against one of the main principles SDGs aim at maintaining which is to leave no one behind (Willis, 2016). These challenges highlight the importance of utilizing the science priorities to inform policy making as well as modeling efforts. In fact, they show that it is becoming more important to jointly consider multiple priorities when devising policies related to the SDGs. Priority 3, for example, needs to be an overarching target that is considered along with any of the other priorities. Considering multiple priorities in SDGs models entails the need for building more advance integrated models and increases the complexity of the challenges modelers need to over­ come in order to efficiently accomplish such task (Elsawah et al., 2020). Another critical issue that is highlighted in the results of this review is the representation and communication of uncertainty in SDG related models. The models’ uncertainty treatment is among the main factors that affect their acceptance and adoption by policy makers (Will et al., 2021; Newcomb et al., 2021; Kolkman et al., 2016). The results of this research show that uncertainty treatment was mostly either lacking or done using simplified methods that are not suitable for the models tar­ geting SDG issues. In order to robustly support decision making for interacting social-environmental-economic systems, modelers are encouraged to utilize more advance uncertainty treatment approaches such as applying mixed uncertainty treatment frameworks as well as being elaborate in documenting and reporting the uncertainty treatment process and its underlying assumptions (Moallemi et al., 2020; New­ comb et al., 2021). Finally, the outcomes of this research can be useful for modelers through their attempts to develop SDG related models by presenting the common modeling practices found in literature. In that sense, these common practices encapsulate the knowledge applied by other modelers in this particular context, i.e. the context of SDGs related models (Boissier, 2017). Although we do not provide an evaluation for the modeling approaches used for the multi-dimensional classification, their usage trends in literature can be informative for future modeling efforts. 5. Conclusion This paper highlights the role played by modeling in advancing the UN’s SDGs. The potential of models to advance the SDGs and sustain­ ability is recognized and emphasized by multiple researchers from different backgrounds. However, the models pertaining to SDGs need to part of an organized research agenda that set the priorities for these models and increases their effectiveness. From this start point, we addressed three research questions regarding the main types of models used in addressing SDGs; how aligned the developed models are with the priorities of sustainability science as decided by the scientific commu­ nity; and finally the main characteristics of the models developed in SDGs contexts. In order to answer these questions, we performed a literature review and analysis for 101 publications that address the ap­ plications of modelingmodeling multiple SDGs as well as 82 publications that address modeling single SDGs between 2015 and 2021. Prior to analyzing the collected literature, we presented a multi-dimensional model classification scheme that enables us to understand how models are contributing to achieving the SDGs, as well as recognizing the pre­ vailing characteristics of the models used in this application. The top level of the scheme benefited from the advances of sustainability science and the efforts made to delineate the gaps that need to be filled with SDGs’ models. The classification and analysis of the retrieved literature enabled us to answer the three research questions underpinning this work. The first of the three research questions motivating this work is related to discovering the main modeling methods currently utilized in building SDG models. Based on the reviewed articles, we found nine modeling techniques are consistently used to directly address SDGs related issues, namely, System dynamics, agent based modeling, Bayesian networks, Econometric models, Economic models, Integrated models, Knowledge based models, Network models, and Mathematical quantitative models. Among these types, integrated modeling was the most adopted modeling approach followed by econometric methods, while the least applied approaches are Bayesian networks, agent based modeling, and mathematical quantitative methods. The suitability of integrated models to represent SDGs stems from their capacity to leverage the strengths of different other modeling approaches and pro­ vide a more flexible model that overcomes the limitations of other methods. Additionally, mapping the modeling techniques employed to the spatial scales of the developed models revealed that integrated modeling is used for all the possible scales, especially for cross-scale models which proved to be challenging to develop. The second research question is underpinned by defining the current priorities of sustainability research so we can assess if those priorities are sufficiently addressed by SDG models. Locating the gap between the topics SDG models focus on and the priorities of sustainability science will help the modeling community to play a more effective role in achieving the SDGs. According to recent reviews, there are four areas that if addressed properly will greatly boost the implementation of the SDGs. Those areas are: 1) monitoring the progress of the SDGs, 2) un­ derstanding and managing the interconnections between the SDGs, 3) studying the policy transformations needed to achieve the SDGs, and 4) evaluating the consistency between achieving the SDGs and preserving the planetary boundaries. According to the analysis of the current SDGs models, 72% of the models focused on studying the policy E. Aly et al.
  • 13. Journal of Cleaner Production 340 (2022) 130803 13 transformations needed to achieve the SDGs, as well as understanding the interconnections among the SDGs. There is therefore a need to direct more modeling efforts toward studying the coherence between achieving the SDGs and maintaining the long-term sustainability and resilience of communities. Finally, to determine the main characteristics of SDG-focused models, we first defined three main characteristics with which to cate­ gorize the models: the model spatial scale, how the model deals with uncertainty, and whether the model is static or dynamic in time. Around 62% of the reviewed models were applied either on a global or national scales, and only 5% of the models applied a cross-scale approach. This can be attributed to the complexity of addressing multiple scales in the same models which highlights the need for developing a more accessible suite of scaling methods that can be applied by researchers from different backgrounds. In terms of the way the models treat uncertainty, we found that, surprisingly, a considerable portion of the studied models (41.5%) do not include any treatment for uncertainty. Those which did account for uncertainty, however, relied mainly on seven techniques, the most common of which is scenario modeling followed by using Bayesian methods. Sensitivity analysis and multi-model analysis were also used. It was also found that almost half (46%) of the developed models were dynamic models relying on a large amount of historical data as well as trying to provide an analysis of future scenarios for achieving the SDGs. There are a number of directions for future research efforts. First, and most important, is the development of models that address the gaps outlined by the sustainability science priorities. Additionally, there is more need to utilize probabilistic methods in building SDG models to be able to address the uncertainty inherent to the social, economic, and environmental systems underlying them. Also, more attention should be given to building a more standardized approach for model categoriza­ tion as a step toward creating a catalogue of models that allows policy makers to choose optimal models for each application. Moreover, while this research focuses on the models related to SDGs extracted from literature, it is expected that these models reflect only the point of view of researchers and modelers with academic background and missing the direct input of policy makers. One way to increase the applicability and efficiency of models in SDG contexts is to investigate the models that have been already used by policy makers or applied in real life projects. Following this investigation, interviews with parties participating in these projects, i.e. model developers, government offi­ cials, and stakeholders from community, can be conducted to extract key lessons that can guide future modeling efforts. In addition, SDG Voluntary National Reviews (VNR) can be investigated to check if they contain any reporting on models’ usage. Finally, while the focus of this research is on the technical aspects of models, it is important to consider the political ramifications of those technical aspects or design choices. Considering the political impacts associated with policy guided by the model can be very helpful in un­ derstanding the values guiding the SDG decision process from a policy makers’ perspective and compare it to the values that influence the scientists through their efforts to develop SDG models’ (or complex systems models in general). While delineating the types and impacts of values and biases that influence the decisions modelers make while building environmental management models have been sought by some research efforts (e.g. Mayer et al. (2017); Moallemi et al. (2020)), comparing the modelers’ values to their policy makers’ equivalent can positively affect the usability and efficiency of SDG models. Declaration of competing interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper. Appendix Table A 1 The numbers of papers focusing on modeling single SDGS SDG No. of relevant papers SDG1 6 SDG2 11 SDG3 10 SDG4 6 SDG5 4 SDG6 11 SDG7 7 SDG8 3 SDG9 3 SDG10 0 SDG11 8 SDG12 2 SDG13 3 SDG14 2 SDG15 1 SDG16 2 SDG17 3 Total 82 E. Aly et al.
  • 14. Journal of Cleaner Production 340 (2022) 130803 14 Table A 2 The keywords used to run the search at different levels Search Level Keywords Modeling Keywords simulation OR modeling OR modeling OR (“integrated Pre/3 model*") OR “system*dynamics” OR “Bayesian network” OR BN OR “agent*based” OR abm OR “multi agent” OR “scenario model*" All SDGs Keywords sustainable development goals OR “SDGs” OR “2030 agenda" Single SDG keywords SDG1 “sdg-1′′ or “sdg1′′ “sustainable development goal” near/3 (1 or one) “sustainable development goal” near/15 (poverty or poor) SDG2 “sdg-2′′ or “sdg2′′ “sustainable development goal” near/3 (2 or two) “sustainable development goal” near/15 (hunger or “food security” or “sustainable agriculture") SDG3 “sdg-3′′ or “sdg3′′ “sustainable development goal” near/3 (3 or three) “sustainable development goal” near/15 (“healthy lives” or “well-being") SDG4 “sdg-4′′ or “sdg4′′ “sustainable development goal” near/3 (4 or four) “sustainable development goal” near/15 (“education” or “learning") SDG5 “sdg-5′′ or “sdg5′′ “sustainable development goal” near/3 (5 or five) “sustainable development goal” near/15 (“gender equality” or “gender inequality” or (empower* near/3 women)) SDG6 “sdg-6′′ or “sdg6′′ “sustainable development goal” near/3 (6 or six) “sustainable development goal” near/15 (“sanitation” or (water near/3 availability) or (water near/3 management)) SDG7 “sdg-7′′ or “sdg7′′ “sustainable development goal” near/3 (“7′′ or “seven") “sustainable development goal” near/15 (“modern energy” or (sustainable near/3 energy) or (affordable near/3 energy)) SDG8 “sdg-8′′ or “sdg8′′ “sustainable development goal” near/3 (“8′′ or “eight") “sustainable development goal” near/15 (“economic growth” or (productive near/3 employment) or (sustainable near/3 growth) or (sustainable near/3 economy) or (inclusive near/3 growth)) SDG9 “sdg-9′′ or “sdg9′′ “sustainable development goal” near/3 (“9′′ or “nine") “sustainable development goal” near/15 (“resilient infrastructure” or (sustainable near/3 industr*) or (inclusive near/3 industr*)) SDG10 “sdg-10′′ or “sdg10′′ “sustainable development goal” near/3 (“10′′ or “ten") “sustainable development goal” near/15 (inequality near/3 countries) SDG11 “sdg-11′′ or “sdg11′′ “sustainable development goal” near/3 (“11′′ or “eleven") “sustainable development goal” near/15 ((resilient near/3 (cities or settlements)) or (inclusive near/3 (cities or settlements)) or (urban near/3 resilien*)) SDG12 “sdg-12′′ or “sdg12′′ “sustainable development goal” near/3 (“12′′ or “twelve") “sustainable development goal” near/15 ((sustainable near/3 (consumption or production)) or (clean near/3 (consumption or production))) SDG13 “sdg-13′′ or “sdg13′′ “sustainable development goal” near/3 (“13′′ or “thirteen") “sustainable development goal” near/15 (“climate change” or “greenhouse gas” or (climate near/3 adapt*) or (climate near/5 resilien*) or (resilien* near/5 “natural hazards”) or (resilien* near/5 “natural disaster*")) SDG14 “sdg-14′′ or “sdg14′′ “sustainable development goal” near/3 (“14′′ or “forteen") “sustainable development goal” near/15 ((sustainbl* near/5 (ocean* or sea* or marine)) or “life below water") SDG15 “sdg-15′′ or “sdg15′′ “sustainable development goal” near/3 (“15′′ or “fifteen") “sustainable development goal” near/15 (forest* or terrestrial or desertification or “land degra- dation” or “biodiversity loss") SDG16 “sdg-16′′ or “sdg16′′ “sustainable development goal” near/3 (“16′′ or “sixteen") “sustainable development goal” near/15 (societ* near/3 (inclusi* or peac*) or (justice or effec* or accountable or inclusive) near/3 institutions) SDG17 “sdg-17′′ or “sdg17′′ “sustainable development goal” near/3 (“17′′ or “seventeen") “sustainable development goal” near/15 (“global partenership” or “sustainble development finance” or “foreign aid” or “international trade” or “international support") Appendix A. Supplementary data Supplementary data to this article can be found online at https://doi.org/10.1016/j.jclepro.2022.130803. E. Aly et al.
  • 15. Journal of Cleaner Production 340 (2022) 130803 15 References Abson, D.J., Fischer, J., Leventon, J., Newig, J., Schomerus, T., Vilsmaier, U., Von Wehrden, H., Abernethy, P., Ives, C.D., Jager, N.W., et al., 2017. Leverage points for sustainability transformation. Ambio 46 (1), 30–39. Aguiar, A.P.D., Collste, D., Harmácková, Z.V., Pereira, L., Selomane, O., Galafassi, D., Van Vuuren, D., Van Der Leeuw, S., 2020. Co- designing global target-seeking scenarios: a cross-scale participatory process for capturing multiple perspectives on pathways to sustainability. Global Environ. Change 65, 102198. Aguilera, P.A., Fernández, A., Fernández, R., Rumí, R., Salmerón, A., 2011. Bayesian networks in environmental modelling. Environ. Model. Software 26 (12), 1376–1388. Alipour, H., Safaeimanesh, F., Soosan, A., 2019. Investigating sustainable practices in hotel industry-from employees’ perspective: evidence from a mediterranean island. Sustainability 11 (23), 6556. Allen, C., Metternicht, G., Wiedmann, T., 2016. National pathways to the sustainable development goals (sdgs): a comparative review of scenario modelling tools. Environ. Sci. Pol. 66, 199–207. Allen, C., Metternicht, G., Wiedmann, T., 2018. Initial progress in implementing the sustainable development goals (sdgs): a review of evidence from countries. Sustain. Sci. 13 (5), 1453–1467. Allen, C., Metternicht, G., Wiedmann, T., 2021. Priorities for Science to Support National Implementation of the Sustainable Development Goals: A Review of Progress and Gaps. Sustainable Development. Allen, C., Metternicht, G., Wiedmann, T., Pedercini, M., 2019. Greater gains for Australia by tackling all sdgs but the last steps will be the most challenging. Nat. Sustain. 2 (11), 1041–1050. Almannaei, N.A., Akhter, M.S., Shah, A., 2020. Improving Environmental Policy-Making Process to Enable Achievement of Sustainable Development Goals. Environmental Policy and Law -(Preprint), pp. 1–8. Armitage, C.S., Lorenz, M., Mikki, S., 2020. Mapping scholarly publications related to the sustainable development goals: do independent bibliometric approaches get the same results? Quant. Sci. Stud. 1 (3), 1092–1108. Arnold, T., Guillaume, J.H., Lahtinen, T.J., Vervoort, R.W., 2020. From ad-hoc modelling to strategic infrastructure: a manifesto for model management. Environ. Model. Software 123, 104563. Asatani, K., Takeda, H., Yamano, H., Sakata, I., 2020. Scientific attention to sustainability and sdgs: meta-analysis of academic papers. Energies 13 (4), 975. Bahadur, A., Lovell, E., Wilkinson, E., Tanner, T., 2015. Resilience in the Sdgs: Developing an Indicator for Target 1.5 that Is Fit for Purpose. Overseas Development Institute Briefing, London. Bamberger, M., Segone, M., Tateossian, F., 2016. Evaluating the Sustainable Development Goals: with a “No One Left behind” Lens through Equity-Focused and Gender-Responsive Evaluations. UN Women, New York. Banerjee, O., Cicowiez, M., Horridge, M., Vargas, R., 2019. Evaluating synergies and trade-offs in achieving the sdgs of zero hunger and clean water and sanitation: an application of the ieem platform to Guatemala. Ecol. Econ. 161, 280–291. Barbier, E.B., Burgess, J.C., 2017. The sustainable development goals and the systems approach to sustainability. Economics: The OpenAccess, Open-Assessment E-Journal 11 (2017–28), 1–23. Benjamin-Fink, N., Reilly, B.K., 2017. A road map for developing and applying object- oriented bayesian networks to “wicked” problems. Ecol. Model. 360, 27–44. Bennich, T., Weitz, N., Carlsen, H., 2020. Deciphering the Scientific Literature on SDG Interactions: A Review and Reading Guide. Science of The Total Environment, 138405. Blacketer, M.P., Brownlee, M.T., Baldwin, E.D., Bowen, B.B., 2021. Fuzzy cognitive maps of social-ecological complexity: applying mental modeler to the bonneville salt flats. Ecol. Complex. 47, 100950. Boissier, F., 2017. Supporting modelers with model qualities and patterns. In: 2017 11th International Conference on Research Challenges in Information Science (RCIS)’, IEEE, pp. 440–445. Bordignon, F., 2021. Dataset of search queries to map scientific publications to the un sustainable development goals. Data Brief 34, 106731. Boulanger, P.-M., Bréchet, T., 2005. Models for policy-making in sustainable development: the state of the art and perspectives for research. Ecol. Econ. 55 (3), 337–350. Butts, M.B., Payne, J.T., Kristensen, M., Madsen, H., 2004. An evaluation of the impact of model structure on hydrological modelling uncertainty for streamflow simulation. J. Hydrol. 298 (1–4), 242–266. Costanza, R., Daly, L., Fioramonti, L., Giovannini, E., Kubiszewski, I., Mortensen, L.F., Pickett, K.E., Ragnarsdottir, K.V., De Vogli, R., Wilkinson, R., 2016. Modelling and measuring sustainable wellbeing in connection with the un sustainable development goals. Ecol. Econ. 130, 350–355. Cuaresma, J.C., Fengler, W., Kharas, H., Bekhtiar, K., Brottrager, M., Hofer, M., 2018. Will the sustainable development goals be fulfilled? assessing present and future global poverty. Palgrave Commun. 4 (1), 1–8. Dasgupta, P., Managi, S., Kumar, P., 2021. The inclusive wealth index and sustainable development goals. Sustain. Sci. 1–5. DeCanio, S., 2003. Economic Models of Climate Change: a Critique (Springer). del Río Castro, G., Fernández, M.C.G., Colsa, Á.U., 2020. Unleashing the convergence amid digitalization and sustainability towards pursuing the sustainable development goals (sdgs): a holistic review. J. Clean. Prod., 122204 DeWit, A., Shaw, R., Djalante, R., 2020. An integrated approach to sustainable development, national resilience, and covid-19 responses: the case of Japan. Int. J. Disaster Risk Reduc., 101808 Dörgo, G., Sebestyén, V., Abonyi, J., 2018. Evaluating the interconnectedness of the sustainable development goals based on the causality analysis of sustainability indicators. Sustainability 10 (10), 3766. Downing, A.S., Wong, G.Y., Dyer, M., Aguiar, A.P., Selomane, O., Aceituno, A.J., 2021. When the whole is less than the sum of all parts–tracking global-level impacts of national sustainability initiatives. Global Environ. Change 69, 102306. Easterly, W., 2015. The trouble with the sustainable development goals. Curr. Hist. 114 (775), 322. Elsawah, S., Filatova, T., Jakeman, A.J., Kettner, A.J., Zellner, M.L., Athanasiadis, I.N., Hamilton, S.H., Axtell, R.L., Brown, D.G., Gilligan, J.M., et al., 2020. Eight grand challenges in socio-environmental systems modeling. Socio-Environ. Sys. Model. 2, 16226–16226. Elsawah, S., Pierce, S.A., Hamilton, S.H., Van Delden, H., Haase, D., Elmahdi, A., Jakeman, A.J., 2017. An overview of the system dynamics process for integrated modelling of socio-ecological systems: lessons on good modelling practice from five case studies. Environ. Model. Software 93, 127–145. Emmerling, J., Drouet, L., Reis, L., Bevione, M., Berger, L., Bosetti, V., Carrara, S., De Cian, E., De Maere D’Aertrycke, G., Longden, T., et al., 2016. The Witch 2016 Model- Documentation and Implementation of the Shared Socioeconomic Pathways. Epstein, J.M., Axtell, R., 1996. Growing Artificial Societies: Social Science from the Bottom up. Brookings Institution Press. Ferranti, P., 2019. The united nations sustainable development goals. Encyclopedia of Food Security and Sustainability 6–8. Fioramonti, L., Coscieme, L., Mortensen, L.F., 2019. From gross domestic product to wellbeing: how alternative indicators can help connect the new economy with the sustainable development goals. The Anthropocene Review 6 (3), 207–222. Forouli, A., Nikas, A., Van de Ven, D.-J., Sampedro, J., Doukas, H., 2020. A multiple- uncertainty analysis framework for integrated assessment modelling of several sustainable development goals. Environ. Model. Software 131, 104795. Fujimori, S., Hasegawa, T., Krey, V., Riahi, K., Bertram, C., Bodirsky, B.L., Bosetti, V., Callen, J., Després, J., Doelman, J., et al., 2019. A multi-model assessment of food security implications of climate change mitigation. Nat. Sustain. 2 (5), 386–396. Fujimori, S., Hasegawa, T., Masui, T., Takahashi, K., Herran, D.S., Dai, H., Hijioka, Y., Kainuma, M., 2017. Ssp3: aim implementation of shared socioeconomic pathways. Global Environ. Change 42, 268–283. Gavel, Y., Iselid, L., 2008. Web of Science and Scopus: a Journal Title Overlap Study. Online information review. Gelman, A., Carlin, J., 2017. Some natural solutions to the p-value communication problem—and why they won’t work. J. Am. Stat. Assoc. 112 (519), 899–901. Georgeson, L., Maslin, M., 2018. Putting the united nations sustainable development goals into practice: a review of implementation, monitoring, and finance. Geo: Geogr. Environ. 5 (1), e00049. Giannetti, B.F., Agostinho, F., Almeida, C.M., Liu, G., Contreras, L.E., Vandecasteele, C., Coscieme, L., Sutton, P., Poveda, C., 2020. Insights on the united nations sustainable development goals scope: are they aligned with a ‘strong’sustainable development? J. Clean. Prod. 252, 119574. Gilbert, N., Ahrweiler, P., Barbrook-Johnson, P., Narasimhan, K.P., Wilkinson, H., 2018. Computational modelling of public policy: reflections on practice. J. Artif. Soc. Soc. Simulat. 21 (1). Gray, S., Chan, A., Clark, D., Jordan, R., 2012. Modeling the integration of stakeholder knowledge in social–ecological decision-making: benefits and limitations to knowledge diversity. Ecol. Model. 229, 88–96. Grubler, A., Wilson, C., Bento, N., Boza-Kiss, B., Krey, V., McCollum, D.L., Rao, N.D., Riahi, K., Rogelj, J., De Stercke, S., et al., 2018. A low energy demand scenario for meeting the 1.5 c target and sustainable development goals without negative emission technologies. Nat. Energy 3 (6), 515–527. Gyasi, R.M., Phillips, D.R., Adam, A.M., 2021. How far is inclusivity of financial services associated with food insecurity in later life? implications for health policy and sustainable development goals. J. Appl. Gerontol. 40 (2), 189–200. Haldane, A.G., Turrell, A.E., 2018. An interdisciplinary model for macroeconomics. Oxf. Rev. Econ. Pol. 34 (1–2), 219–251. Hall, D.M., Lazarus, E.D., Swannack, T.M., 2014. Strategies for communicating systems models. Environ. Model. Software 55, 70–76. Hamilton, S.H., ElSawah, S., Guillaume, J.H., Jakeman, A.J., Pierce, S.A., 2015. Integrated assessment and modelling: overview and synthesis of salient dimensions. Environ. Model. Software 64, 215–229. Harris, C., Howes, T., et al., 2005. Does modelling need an image consultant?. In: Modsim 2005: International Congress on Modelling and Simulation: Advances and Applications for Management and Decision Making. The Modelling and Simulation Society of Australia and New Zealand, pp. 2797–2803. Häyhä, T., Lucas, P.L., van Vuuren, D.P., Cornell, S.E., Hoff, H., 2016. From planetary boundaries to national fair shares of the global safe operating space—how can the scales be bridged? Global Environ. Change 40, 60–72. Heck, V., Hoff, H., Wirsenius, S., Meyer, C., Kreft, H., 2018. Land use options for staying within the planetary boundaries–synergies and trade-offs between global and local sustainability goals. Global Environ. Change 49, 73–84. Heravi, G., Fathi, M., Faeghi, S., 2015. Evaluation of sustainability indicators of industrial buildings focused on petrochemical projects. J. Clean. Prod. 109, 92–107. Hickel, J., 2019. The contradiction of the sustainable development goals: growth versus ecology on a finite planet. Sustain. Dev. 27 (5), 873–884. Howells, M., Hermann, S., Welsch, M., Bazilian, M., Segerström, R., Alfstad, T., Gielen, D., Rogner, H., Fischer, G., Van Velthuizen, H., et al., 2013. Integrated analysis of climate change, land-use, energy and water strategies. Nat. Clim. Change 3 (7), 621–626. Jann, W., Wegrich, K., 2017. Theories of the policy cycle. In: Handbook of Public Policy Analysis. Routledge, pp. 69–88. E. Aly et al.
  • 16. Journal of Cleaner Production 340 (2022) 130803 16 Jayabalasingham, B., Boverhof, R., Agnew, K., Klein, L., 2019. Identifying Research Supporting the United Nations Sustainable Development Goals. Joshi, D.K., Hughes, B.B., Sisk, T.D., 2015. Improving governance for the post-2015 sustainable development goals: scenario forecasting the next 50 years. World Dev. 70, 286–302. Kebede, A.S., Nicholls, R.J., Clarke, D., Savin, C., Harrison, P.A., 2020. Integrated assessment of the food-water-land-ecosystems nexus in europe: implications for sustainability. Sci. Total Environ., 144461 Kelly, R.A., Jakeman, A.J., Barreteau, O., Borsuk, M.E., ElSawah, S., Hamilton, S.H., Henriksen, H.J., Kuikka, S., Maier, H.R., Rizzoli, A.E., et al., 2013. Selecting among five common modelling approaches for integrated environmental assessment and management. Environ. Model. Software 47, 159–181. Kolkman, D.A., Campo, P., Balke-Visser, T., Gilbert, N., 2016. How to build models for government: criteria driving model acceptance in policymaking. Pol. Sci. 49 (4), 489–504. Kopainsky, B., Tribaldos, T., Ledermann, S.T., 2018. A food systems perspective for food and nutrition security beyond the post-2015 development agenda. Syst. Res. Behav. Sci. 35 (2), 178–190. Kostoska, O., Kocarev, L., 2019. A novel ict framework for sustainable development goals. Sustainability 11 (7), 1961. Kumar, P., Ahmed, F., Singh, R.K., Sinha, P., 2018. Determination of hierarchical relationships among sustainable development goals using interpretive structural modeling. Environ. Dev. Sustain. 20 (5), 2119–2137. Lai, H.-Y., Chen, C.-H., Zheng, P., Khoo, L.P., 2020. Investigating the evolving context of an unstable approach in aviation from mental model disconnects with an agent- based model. Reliab. Eng. Syst. Saf. 193, 106657. Le Blanc, D., 2015. Towards integration at last? the sustainable development goals as a network of targets. Sustain. Dev. 23 (3), 176–187. Lim, M.M., Jørgensen, P.S., Wyborn, C.A., 2018. Reframing the sustainable development goals to achieve sustainable development in the anthropocene—a systems approach. Ecol. Soc. 23 (3). Liu, Y., Gupta, H., Springer, E., Wagener, T., 2008. Linking science with environmental decision making: experiences from an integrated modeling approach to supporting sustainable water resources management. Environ. Model. Software 23 (7), 846–858. Llorca, C., Silva, C., Kuehnel, N., Moreno, A.T., Zhang, Q., Kii, M., Moeckel, R., 2020. Integration of land use and transport to reach sustainable development goals: will radical scenarios actually get us there? Sustainability 12 (23), 9795. Long, X., Yu, H., Sun, M., Wang, X.-C., Klemeš, J.J., Xie, W., Wang, C., Li, W., Wang, Y., 2020. Sustainability evaluation based on the threedimensional ecological footprint and human development index: a case study on the four island regions in China. J. Environ. Manag. 265, 110509. Lucas, P.L., Wilting, H.C., Hof, A.F., van Vuuren, D.P., 2020. Allocating planetary boundaries to large economies: distributional consequences of alternative perspectives on distributive fairness. Global Environ. Change 60, 102017. Maier, H.R., Guillaume, J.H., van Delden, H., Riddell, G.A., Haasnoot, M., Kwakkel, J.H., 2016. An uncertain future, deep uncertainty, scenarios, robustness and adaptation: how do they fit together? Environ. Model. Software 81, 154–164. Mainali, B., Luukkanen, J., Silveira, S., Kaivo-Oja, J., 2018. Evaluating synergies and trade-offs among sustainable development goals (sdgs): explorative analyses of development paths in south asia and sub-saharan africa. Sustainability 10 (3), 815. Marsh, T.L., Yoder, J., Deboch, T., McElwain, T.F., Palmer, G.H., 2016. Livestock vaccinations translate into increased human capital and school attendance by girls. Sci. Adv. 2 (12), e1601410. Mason-D’Croz, D., Sulser, T.B., Wiebe, K., Rosegrant, M.W., Lowder, S.K., Nin-Pratt, A., Willenbockel, D., Robinson, S., Zhu, T., Cenacchi, N., et al., 2019. Agricultural investments and hunger in africa modeling potential contributions to sdg2–zero hunger. World Dev. 116, 38–53. Mayer, L.A., Loa, K., Cwik, B., Tuana, N., Keller, K., Gonnerman, C., Parker, A.M., Lempert, R.J., 2017. Understanding scientists’ computational modeling decisions about climate risk management strategies using values-informed mental models. Global Environ. Change 42, 107–116. McCollum, D.L., Zhou, W., Bertram, C., De Boer, H.-S., Bosetti, V., Busch, S., Després, J., Drouet, L., Emmerling, J., Fay, M., et al., 2018. Energy investment needs for fulfilling the paris agreement and achieving the sustainable development goals. Nat. Energy 3 (7), 589–599. McIntosh, B.S., Seaton, R.A., Jeffrey, P., 2007. Tools to think with? towards understanding the use of computer-based support tools in policy relevant research. Environ. Model. Software 22 (5), 640–648. McShane, B.B., Gal, D., Gelman, A., Robert, C., Tackett, J.L., 2019. Abandon statistical significance. Am. Statistician 73 (Suppl. 1), 235–245. Meschede, C., 2020. The sustainable development goals in scientific literature: a bibliometric overview at the meta-level. Sustainability 12 (11), 4461. Messerli, P., Kim, E.M., Lutz, W., Moatti, J.-P., Richardson, K., Saidam, M., Smith, D., Eloundou-Enyegue, P., Foli, E., Glassman, A., et al., 2019. Expansion of sustainability science needed for the sdgs. Nat. Sustain. 2 (10), 892–894. Meyer, B., Ahlert, G., 2019. Imperfect markets and the properties of macro-economic- environmental models as tools for policy evaluation. Ecol. Econ. 155, 80–87. Miller, T.R., Wiek, A., Sarewitz, D., Robinson, J., Olsson, L., Kriebel, D., Loorbach, D., 2014. The future of sustainability science: a solutions-oriented research agenda. Sustain. Sci. 9 (2), 239–246. Moallemi, E.A., Elsawah, S., Ryan, M.J., 2020a. Strengthening ‘good’modelling practices in robust decision support: a reporting guideline for combining multiple model- based methods. Math. Comput. Simulat. 175, 3–24. Moallemi, E.A., Zare, F., Reed, P.M., Elsawah, S., Ryan, M.J., Bryan, B.A., 2020b. Structuring and evaluating decision support processes to enhance the robustness of complex human–natural systems. Environ. Model. Software 123, 104551. Moffatt, I., 2006. Potentialities, problems, policies and progress in modelling sustainable development: a dynamic, hierarchical approach. Int. J. Sustain. Dev. World Ecol. 13 (2), 131–150. Mongeon, P., Paul-Hus, A., 2016. ‘The journal coverage of web of science and scopus: a comparative analysis’. Scientometrics 106 (1), 213–228. Moon, Y.B., 2017. Simulation modelling for sustainability: a review of the literature. Int. J. Sustain. Eng. 10 (1), 2–19. Moyer, J.D., Hedden, S., 2020. Are we on the right path to achieve the sustainable development goals? World Dev. 127, 104749. Mulligan, M., van Soesbergen, A., Hole, D.G., Brooks, T.M., Burke, S., Hutton, J., 2020. Mapping nature’s contribution to sdg 6 and implications for other sdgs at policy relevant scales. Remote Sens. Environ. 239, 111671. Network, A.U., 2020. Search Queries for “Mapping Research Output to the Sustainable Development Goals (Sdgs)” V5. 0. https://aurora-networkglobal.github.io/ sdg-queries/query_sdg17.xml. Newcomb, T.J., Simonin, P.W., Martinez, F.A., Chadderton, W.L., Bossenbroek, J.M., Cudmore, B., Hoff, M.H., Keller, R.P., Ridenhour, B.D., Rothlisberger, J.D., et al., 2021. A best practices case study for scientific collaboration between researchers and managers. Fisheries 46 (3), 131–138. Newman, M.E., 2006. Modularity and community structure in networks. Proc. Natl. Acad. Sci. Unit. States Am. 103 (23), 8577–8582. Nicholson, C.F., 2007. Review of methods for modelling systems evolution. ILRI Discussion Paper. Nilsson, M., Chisholm, E., Griggs, D., Howden-Chapman, P., McCollum, D., Messerli, P., Neumann, B., Stevance, A.-S., Visbeck, M., StaffordSmith, M., 2018. Mapping interactions between the sustainable development goals: lessons learned and ways forward. Sustain. Sci. 13 (6), 1489–1503. Oecd, S., Paris, M., 2017. Measuring Distance to the Sdg Targets: an Assessment of where Oecd Countries Stand. Olawumi, T.O., Chan, D.W., Wong, J.K., 2017. Evolution in the intellectual structure of bim research: a bibliometric analysis. J. Civ. Eng. Manag. 23 (8), 1060–1081. Pedercini, M., Arquitt, S., Chan, D., 2020. Integrated simulation for the 2030 agenda. Syst. Dynam. Rev. 36 (3), 333–357. Pedercini, M., Zuellich, G., Dianati, K., Arquitt, S., 2018. Toward achieving sustainable development goals in ivory coast: simulating pathways to sustainable development. Sustain. Dev. 26 (6), 588–595. Plag, H.-P., Jules-Plag, S.-A., 2019. A goal-based approach to the identification of essential transformation variables in support of the implementation of the 2030 agenda for sustainable development. Int. J. Digital Earth 13, 166–187. Pothen, F., Welsch, H., 2019. Economic development and material use. evidence from international panel data. World Dev. 115, 107–119. Randers, J., RockstrÖm, J., Stoknes, P.E., Golüke, U., Collste, D., Cornell, S., 2018. Transformation is feasible: how to achieve the sustainable development goals within planetary boundaries. In: A Report to the Club of Rome, for its 50 Years Anniversary 17. Rao, S., Klimont, Z., Leitao, J., Riahi, K., Van Dingenen, R., Reis, L.A., Calvin, K., Dentener, F., Drouet, L., Fujimori, S., et al., 2016. A multi-model assessment of the co-benefits of climate mitigation for global air quality. Environ. Res. Lett. 11 (12), 124013. Rasoolimanesh, S.M., Badarulzaman, N., Abdullah, A., Behrang, M., 2019. How governance influences the components of sustainable urban development? J. Clean. Prod. 238, 117983. Refsgaard, J.C., van der Sluijs, J.P., Højberg, A.L., Vanrolleghem, P.A., 2007. Uncertainty in the environmental modelling process–a framework and guidance. Environ. Model. Software 22 (11), 1543–1556. Reid, J., Zeng, C., Wood, D., 2019. Combining Social, Environmental and Design Models to Support the Sustainable Development Goals. 2019 IEEE Aerospace Conference’, IEEE, pp. 1–13. Renard, B., Kavetski, D., Kuczera, G., Thyer, M., Franks, S.W., 2010. Understanding predictive uncertainty in hydrologic modeling: the challenge of identifying input and structural errors. Water Resour. Res. 46 (5). Requejo-Castro, D., Giné-Garriga, R., Pérez-Foguet, A., 2020. Data-driven bayesian network modelling to explore the relationships between sdg 6 and the 2030 agenda. Sci. Total Environ. 710, 136014. Ritchie, H., Reay, D., Higgins, P., 2018. Sustainable food security in India—domestic production and macronutrient availability. PLoS One 13 (3), e0193766. Saito, O., Managi, S., Kanie, N., Kauffman, J., Takeuchi, K., 2017. Sustainability science and implementing the sustainable development goals. Sustain. Sci. 12 (6), 907–910. Salling, K.B., Barfod, M.B., Pryn, M.R., Leleur, S., 2018. Flexible decision support for sustainable development: the sustain framework model. Eur. J. Transport Infrastruct. Res. 18 (3). Scherer, L., Behrens, P., de Koning, A., Heijungs, R., Sprecher, B., Tukker, A., 2018. Trade-offs between social and environmental sustainable development goals. Environ. Sci. Pol. 90, 65–72. Schneider, F., Kläy, A., Zimmermann, A.B., Buser, T., Ingalls, M., Messerli, P., 2019. How can science support the 2030 agenda for sustainable development? four tasks to tackle the normative dimension of sustainability. Sustain. Sci. 14 (6), 1593–1604. Scott, N., Delport, D., Hainsworth, S., Pearson, R., Morgan, C., Huang, S., Akuoku, J.K., Piwoz, E., Shekar, M., Levin, C., et al., 2020. Ending malnutrition in all its forms requires scaling up proven nutrition interventions and much more: a 129-country analysis. BMC Med. 18 (1), 1–19. Scrieciu, S.S., 2007. The inherent dangers of using computable general equilibrium models as a single integrated modelling framework for sustainability impact E. Aly et al.