Parallelization of Benchmarking using HPC: Text Summarization in Natural Language Processing (NLP), Glider Piloting in Deep-sea Missions, and Search Algorithms in Computational Intelligence (CI)
In Slovene: predavanje na daljavo: SUPERRAČUNALNIŠTVO V MARIBORU (izr. prof. dr. Aleš Zamuda), torek, 21. decembra 2021 ob 20:00 na daljavo preko MS Teams.
The event report for IEEE CIS11:
https://events.vtools.ieee.org/m/295510
Examples Implementing Black-Box Discrete Optimization Benchmarking Survey for...University of Maribor
PPSN XV: 15th International Conference on Parallel Problem Solving from Nature
Coimbra, Portugal, September 8–12, 2018
Session: Black Box Discrete Optimization Benchmarking (BB-DOB)
Saturday, 8 September, 14:00-15:30, Room 2.4
Aleš Zamuda, Goran Hrovat, Elena Lloret, Miguel Nicolau, Christine Zarges
Hardware Acceleration of SVM Training for Real-time Embedded Systems: An Over...Ilham Amezzane
Support Vector Machines (SVMs) have proven to yield high accuracy and have been used widespread in recent years. However, the standard versions of the SVM algorithm are very time-consuming and computationally intensive; which places a challenge on engineers to explore other hardware architectures than CPU, capable of performing real-time training and classifications while maintaining low power consumption in embedded systems. This paper proposes an overview of works based on the two most popular parallel processing devices: GPU and FPGA, with a focus on multiclass training process. Since different techniques have been evaluated using different experimentation platforms and methodologies, we only focus on the improvements realized in each study.
In Slovene: predavanje na daljavo: SUPERRAČUNALNIŠTVO V MARIBORU (izr. prof. dr. Aleš Zamuda), torek, 21. decembra 2021 ob 20:00 na daljavo preko MS Teams.
The event report for IEEE CIS11:
https://events.vtools.ieee.org/m/295510
Examples Implementing Black-Box Discrete Optimization Benchmarking Survey for...University of Maribor
PPSN XV: 15th International Conference on Parallel Problem Solving from Nature
Coimbra, Portugal, September 8–12, 2018
Session: Black Box Discrete Optimization Benchmarking (BB-DOB)
Saturday, 8 September, 14:00-15:30, Room 2.4
Aleš Zamuda, Goran Hrovat, Elena Lloret, Miguel Nicolau, Christine Zarges
Hardware Acceleration of SVM Training for Real-time Embedded Systems: An Over...Ilham Amezzane
Support Vector Machines (SVMs) have proven to yield high accuracy and have been used widespread in recent years. However, the standard versions of the SVM algorithm are very time-consuming and computationally intensive; which places a challenge on engineers to explore other hardware architectures than CPU, capable of performing real-time training and classifications while maintaining low power consumption in embedded systems. This paper proposes an overview of works based on the two most popular parallel processing devices: GPU and FPGA, with a focus on multiclass training process. Since different techniques have been evaluated using different experimentation platforms and methodologies, we only focus on the improvements realized in each study.
Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recom...Daniel Valcarce
Slides of the presentation given at ECIR 2016 for the following paper:
Daniel Valcarce, Javier Parapar, Alvaro Barreiro: Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recommendation. ECIR 2016: 602-613
http://dx.doi.org/10.1007/978-3-319-30671-1_44
Semantics and optimisation of the SPARQL1.1 federation extensionOscar Corcho
Presentation done at ESWC2011 for the paper "Semantics and optimisation of the SPARQL1.1 federation extension". Buil-Aranda C, Arenas M, Corcho O. ESWC2011, May 2011, Hersonissos, Greece
In this project, we consider the deep learning-based approaches to performing Neural Style Transfer (NST) on images. In particular, we intend to assess the Real-Time performance of this approach, since it has become a trending topic both in academia and in industrial applications.
For this purpose, after exploring the perceptual loss concept, which is used by the majority of models when performing NST, we conducted a review on a range of existing methods for this practical problem. We found that the feedforward based methods allow to achieve real time performance as opposed to the framework of iterative optimization proposed in the original Neural Style Transfer algorithm introduced by Gatys et al. Which is why we mainly focused on two feed-forward methods proposed in the literature: one that focuses on Single-Style transfer, TransformNet, and one that tackles the more generic problem of Multiple Style Transfer, MSG-Net.
A COMPARATIVE STUDY OF BACKPROPAGATION ALGORITHMS IN FINANCIAL PREDICTIONIJCSEA Journal
Stock market price index prediction is a challenging task for investors and scholars. Artificial neural networks have been widely employed to predict financial stock market levels thanks to their ability to model nonlinear functions. The accuracy of backpropagation neural networks trained with different heuristic and numerical algorithms is measured for comparison purpose. It is found that numerical algorithm outperform heuristic techniques.
Cinnamons are a new computation model intended to form a theoretical foundation for Control Network Programming (CNP). CNP has established itself as a programming approach combining declarative and imperative features. It supports powerful tools for control of the computation process; in particular, these tools allow easy, intuitive, visual development of heuristic, nondeterministic, or randomized solutions. The paper providesrigorous definitions of the syntax and semantics of the new model of computation, at the same time trying to keep the intuition behind clear. The purposely simplified theoretical model is then compared to both WHILE-programs (thus demonstrating its Turing completeness), and the “real” CNP. Finally, future research possibilities are mentioned that would eventually extend the cinnamon programming and its theoretical foundation into the directions of nondeterminism, randomness and fuzziness.
Programming (CNP). CNP has established itself as a programming approach combining declarative and imperative features. It supports powerful tools for control of the computation process; in particular, these tools allow easy, intuitive, visual development of heuristic, nondeterministic, or randomized solutions. The paper providesrigorous definitions of the syntax and semantics of the new model of computation, at the same time trying to keep the intuition behind clear. The purposely simplified theoretical model is then compared to both WHILE-programs (thus demonstrating its Turing completeness), and the “real” CNP. Finally, future research possibilities are mentioned that would eventually extend the cinnamon programming and its theoretical foundation into the directions of nondeterminism, randomness and fuzziness.
Duality Theory in Multi Objective Linear Programming Problemstheijes
The International Journal of Engineering & Science is aimed at providing a platform for researchers, engineers, scientists, or educators to publish their original research results, to exchange new ideas, to disseminate information in innovative designs, engineering experiences and technological skills. It is also the Journal's objective to promote engineering and technology education. All papers submitted to the Journal will be blind peer-reviewed. Only original articles will be published.
The papers for publication in The International Journal of Engineering& Science are selected through rigorous peer reviews to ensure originality, timeliness, relevance, and readability.
Theoretical work submitted to the Journal should be original in its motivation or modeling structure. Empirical analysis should be based on a theoretical framework and should be capable of replication. It is expected that all materials required for replication (including computer programs and data sets) should be available upon request to the authors.
The International Journal of Engineering & Science would take much care in making your article published without much delay with your kind cooperation
In the quest of improving the quality of education, Flexudy leverages the
power of AI to help people learn more efficiently.
During the talk, I will show how we trained an automatic extractive text
summarizer based on concepts from Reinforcement Learning, Deep Learning and Natural Language Processing. Also, I will talk about how we use pre-trained NLP models to generate simple questions for self-assessment.
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/
Presentation of IEEE Slovenia CIS (Computational Intelligence Society) Chapte...University of Maribor
Slides from talk presenting:
Aleš Zamuda: Presentation of IEEE Slovenia CIS (Computational Intelligence Society) Chapter and Networking.
Presentation at IcETRAN 2024 session:
"Inter-Society Networking Panel GRSS/MTT-S/CIS
Panel Session: Promoting Connection and Cooperation"
IEEE Slovenia GRSS
IEEE Serbia and Montenegro MTT-S
IEEE Slovenia CIS
11TH INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONIC AND COMPUTING ENGINEERING
3-6 June 2024, Niš, Serbia
More Related Content
Similar to Parallelization of Benchmarking using HPC: Text Summarization in Natural Language Processing (NLP), Glider Piloting in Deep-sea Missions, and Search Algorithms in Computational Intelligence (CI)
Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recom...Daniel Valcarce
Slides of the presentation given at ECIR 2016 for the following paper:
Daniel Valcarce, Javier Parapar, Alvaro Barreiro: Efficient Pseudo-Relevance Feedback Methods for Collaborative Filtering Recommendation. ECIR 2016: 602-613
http://dx.doi.org/10.1007/978-3-319-30671-1_44
Semantics and optimisation of the SPARQL1.1 federation extensionOscar Corcho
Presentation done at ESWC2011 for the paper "Semantics and optimisation of the SPARQL1.1 federation extension". Buil-Aranda C, Arenas M, Corcho O. ESWC2011, May 2011, Hersonissos, Greece
In this project, we consider the deep learning-based approaches to performing Neural Style Transfer (NST) on images. In particular, we intend to assess the Real-Time performance of this approach, since it has become a trending topic both in academia and in industrial applications.
For this purpose, after exploring the perceptual loss concept, which is used by the majority of models when performing NST, we conducted a review on a range of existing methods for this practical problem. We found that the feedforward based methods allow to achieve real time performance as opposed to the framework of iterative optimization proposed in the original Neural Style Transfer algorithm introduced by Gatys et al. Which is why we mainly focused on two feed-forward methods proposed in the literature: one that focuses on Single-Style transfer, TransformNet, and one that tackles the more generic problem of Multiple Style Transfer, MSG-Net.
A COMPARATIVE STUDY OF BACKPROPAGATION ALGORITHMS IN FINANCIAL PREDICTIONIJCSEA Journal
Stock market price index prediction is a challenging task for investors and scholars. Artificial neural networks have been widely employed to predict financial stock market levels thanks to their ability to model nonlinear functions. The accuracy of backpropagation neural networks trained with different heuristic and numerical algorithms is measured for comparison purpose. It is found that numerical algorithm outperform heuristic techniques.
Cinnamons are a new computation model intended to form a theoretical foundation for Control Network Programming (CNP). CNP has established itself as a programming approach combining declarative and imperative features. It supports powerful tools for control of the computation process; in particular, these tools allow easy, intuitive, visual development of heuristic, nondeterministic, or randomized solutions. The paper providesrigorous definitions of the syntax and semantics of the new model of computation, at the same time trying to keep the intuition behind clear. The purposely simplified theoretical model is then compared to both WHILE-programs (thus demonstrating its Turing completeness), and the “real” CNP. Finally, future research possibilities are mentioned that would eventually extend the cinnamon programming and its theoretical foundation into the directions of nondeterminism, randomness and fuzziness.
Programming (CNP). CNP has established itself as a programming approach combining declarative and imperative features. It supports powerful tools for control of the computation process; in particular, these tools allow easy, intuitive, visual development of heuristic, nondeterministic, or randomized solutions. The paper providesrigorous definitions of the syntax and semantics of the new model of computation, at the same time trying to keep the intuition behind clear. The purposely simplified theoretical model is then compared to both WHILE-programs (thus demonstrating its Turing completeness), and the “real” CNP. Finally, future research possibilities are mentioned that would eventually extend the cinnamon programming and its theoretical foundation into the directions of nondeterminism, randomness and fuzziness.
Duality Theory in Multi Objective Linear Programming Problemstheijes
The International Journal of Engineering & Science is aimed at providing a platform for researchers, engineers, scientists, or educators to publish their original research results, to exchange new ideas, to disseminate information in innovative designs, engineering experiences and technological skills. It is also the Journal's objective to promote engineering and technology education. All papers submitted to the Journal will be blind peer-reviewed. Only original articles will be published.
The papers for publication in The International Journal of Engineering& Science are selected through rigorous peer reviews to ensure originality, timeliness, relevance, and readability.
Theoretical work submitted to the Journal should be original in its motivation or modeling structure. Empirical analysis should be based on a theoretical framework and should be capable of replication. It is expected that all materials required for replication (including computer programs and data sets) should be available upon request to the authors.
The International Journal of Engineering & Science would take much care in making your article published without much delay with your kind cooperation
In the quest of improving the quality of education, Flexudy leverages the
power of AI to help people learn more efficiently.
During the talk, I will show how we trained an automatic extractive text
summarizer based on concepts from Reinforcement Learning, Deep Learning and Natural Language Processing. Also, I will talk about how we use pre-trained NLP models to generate simple questions for self-assessment.
Similar to Parallelization of Benchmarking using HPC: Text Summarization in Natural Language Processing (NLP), Glider Piloting in Deep-sea Missions, and Search Algorithms in Computational Intelligence (CI) (20)
Remote Sensing and Computational, Evolutionary, Supercomputing, and Intellige...University of Maribor
Slides from talk:
Aleš Zamuda: Remote Sensing and Computational, Evolutionary, Supercomputing, and Intelligent Systems.
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Inter-Society Networking Panel GRSS/MTT-S/CIS Panel Session: Promoting Connection and Cooperation
https://www.etran.rs/2024/en/home-english/
Presentation of IEEE Slovenia CIS (Computational Intelligence Society) Chapte...University of Maribor
Slides from talk presenting:
Aleš Zamuda: Presentation of IEEE Slovenia CIS (Computational Intelligence Society) Chapter and Networking.
Presentation at IcETRAN 2024 session:
"Inter-Society Networking Panel GRSS/MTT-S/CIS
Panel Session: Promoting Connection and Cooperation"
IEEE Slovenia GRSS
IEEE Serbia and Montenegro MTT-S
IEEE Slovenia CIS
11TH INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONIC AND COMPUTING ENGINEERING
3-6 June 2024, Niš, Serbia
Comparing Evolved Extractive Text Summary Scores of Bidirectional Encoder Rep...University of Maribor
Slides from:
11th International Conference on Electrical, Electronics and Computer Engineering (IcETRAN), Niš, 3-6 June 2024
Track: Artificial Intelligence
https://www.etran.rs/2024/en/home-english/
Poročilo odbora CIS (CH08873) za leto 2023 na letni skupščini IEEE Slovenija ...University of Maribor
Slides for CIS chapter (CH08873) at Slovenia Section, reporting the activities done in year 2023. The report is for the event of the annual meeting of the IEEE Slovenia Section at Vransko, on 13.2.2024:
https://events.vtools.ieee.org/m/400903
Slides from the talk:
Aleš Zamuda. EuroHPC AI in DAPHNE and Text Summarization. Conferencia Invitada. 15/Sep/2023, Sala Ada Lovelace, Department of Software and Computing Systems, University of Alicante, Spain. https://www.dlsi.ua.es/eines/noticia.cgi?id=eng&idn=596
Slides from the talk:
Aleš Zamuda. EuroHPC AI in DAPHNE. Severo Ochoa Research Seminars. 12/Sep/2023, 1-3-2 Room, BSC Main Building and Zoom. Barcelona Supercomputing Center, Barcelona, Spain.
Load balancing energy power plants with high-performance data analytics (HPDA...University of Maribor
Slides from "Superpower for the power grid", 30 March 2023
https://vsc.ac.at//training/2023/superpower/
https://eurocc-austria.at/events/events-workshops/superpowergrid
ULPGC2023-Erasmus+lectures_Ales_Zamuda_SystemsTheory+IntelligentAutonomousSys...University of Maribor
Aleš Zamuda: ULPGC 2023 Erasmus+ Lecture Series from the Teaching Programme "Optimization Algorithms and Autonomous Systems".
ERASMUS+ STAFF MOBILITY FOR TEACHING (STA)
Staff mobility-Erasmus+ programme countries (KA103)
Faculty of Electrical Engineering and Computer Science (University of Maribor, SI MARIBOR01)
Escuela de Ingenierı́a Informática (Universiad de Las Palmas de Gran Canaria, E LAS-PAL01)
From 6/March/2023 to 24/March/2023 at Campus de Tafira, Las Palmas de Gran Canaria, Spain
Part I: Differential Evolution and Large-Scale Optimization Applications
Part II: HPC Integrated Data Analysis Pipelines for Underwater Glider Path Planning
Part III: Success history applied to expert system for underwater glider path planning
using differential evolution, with prospects for Machine Learning and Research
This is my presentation (in Slovene) about the IEEE CIS Slovenia report for 2022, presented at the IEEE Slovenia meeting at Vransko on February 17, 2023.
HPC Deployment / Use Cases (EVEREST + DAPHNE: Workshop on Design and Programm...University of Maribor
Extended slides from the talk provided at:
High Performance Embedded Architectures and Compilers (HiPEAC) 2023
https://www.hipeac.net/2023/toulouse/
EVEREST + DAPHNE: Workshop on Design and Programming High-performance, distributed, reconfigurable and heterogeneous platforms for extreme-scale analytics
https://www.hipeac.net/2023/toulouse/#/program/sessions/8037/
Wednesday, January 18th 2023, 10:00 - 17:30
Argos (Level 1), Pierre Baudis Convention Centre, Toulouse, France
IEEE Slovenia: Introduction (in Slovene), with details in EnglishUniversity of Maribor
The slides are from my talks as IEEE Slovenia vice-chair from the event:
https://events.vtools.ieee.org/m/295510
More about IEEE Slovenia:
https://www.ieee.si/
Adaptive Constraint Handling and Success History Differential Evolution for C...University of Maribor
Talk given in: 2017 IEEE Congress on Evolutionary Computation (CEC), taking place at Donostia - San Sebastian, Spain, June 5-8, 2017. Associated special session at CEC: Associated with Competition on Bound Constrained Single Objective Numerical Optimization III (June 6, 14:30-16:30, Room 4).
ANAMOLOUS SECONDARY GROWTH IN DICOT ROOTS.pptxRASHMI M G
Abnormal or anomalous secondary growth in plants. It defines secondary growth as an increase in plant girth due to vascular cambium or cork cambium. Anomalous secondary growth does not follow the normal pattern of a single vascular cambium producing xylem internally and phloem externally.
Phenomics assisted breeding in crop improvementIshaGoswami9
As the population is increasing and will reach about 9 billion upto 2050. Also due to climate change, it is difficult to meet the food requirement of such a large population. Facing the challenges presented by resource shortages, climate
change, and increasing global population, crop yield and quality need to be improved in a sustainable way over the coming decades. Genetic improvement by breeding is the best way to increase crop productivity. With the rapid progression of functional
genomics, an increasing number of crop genomes have been sequenced and dozens of genes influencing key agronomic traits have been identified. However, current genome sequence information has not been adequately exploited for understanding
the complex characteristics of multiple gene, owing to a lack of crop phenotypic data. Efficient, automatic, and accurate technologies and platforms that can capture phenotypic data that can
be linked to genomics information for crop improvement at all growth stages have become as important as genotyping. Thus,
high-throughput phenotyping has become the major bottleneck restricting crop breeding. Plant phenomics has been defined as the high-throughput, accurate acquisition and analysis of multi-dimensional phenotypes
during crop growing stages at the organism level, including the cell, tissue, organ, individual plant, plot, and field levels. With the rapid development of novel sensors, imaging technology,
and analysis methods, numerous infrastructure platforms have been developed for phenotyping.
Professional air quality monitoring systems provide immediate, on-site data for analysis, compliance, and decision-making.
Monitor common gases, weather parameters, particulates.
ESR spectroscopy in liquid food and beverages.pptxPRIYANKA PATEL
With increasing population, people need to rely on packaged food stuffs. Packaging of food materials requires the preservation of food. There are various methods for the treatment of food to preserve them and irradiation treatment of food is one of them. It is the most common and the most harmless method for the food preservation as it does not alter the necessary micronutrients of food materials. Although irradiated food doesn’t cause any harm to the human health but still the quality assessment of food is required to provide consumers with necessary information about the food. ESR spectroscopy is the most sophisticated way to investigate the quality of the food and the free radicals induced during the processing of the food. ESR spin trapping technique is useful for the detection of highly unstable radicals in the food. The antioxidant capability of liquid food and beverages in mainly performed by spin trapping technique.
The use of Nauplii and metanauplii artemia in aquaculture (brine shrimp).pptxMAGOTI ERNEST
Although Artemia has been known to man for centuries, its use as a food for the culture of larval organisms apparently began only in the 1930s, when several investigators found that it made an excellent food for newly hatched fish larvae (Litvinenko et al., 2023). As aquaculture developed in the 1960s and ‘70s, the use of Artemia also became more widespread, due both to its convenience and to its nutritional value for larval organisms (Arenas-Pardo et al., 2024). The fact that Artemia dormant cysts can be stored for long periods in cans, and then used as an off-the-shelf food requiring only 24 h of incubation makes them the most convenient, least labor-intensive, live food available for aquaculture (Sorgeloos & Roubach, 2021). The nutritional value of Artemia, especially for marine organisms, is not constant, but varies both geographically and temporally. During the last decade, however, both the causes of Artemia nutritional variability and methods to improve poorquality Artemia have been identified (Loufi et al., 2024).
Brine shrimp (Artemia spp.) are used in marine aquaculture worldwide. Annually, more than 2,000 metric tons of dry cysts are used for cultivation of fish, crustacean, and shellfish larva. Brine shrimp are important to aquaculture because newly hatched brine shrimp nauplii (larvae) provide a food source for many fish fry (Mozanzadeh et al., 2021). Culture and harvesting of brine shrimp eggs represents another aspect of the aquaculture industry. Nauplii and metanauplii of Artemia, commonly known as brine shrimp, play a crucial role in aquaculture due to their nutritional value and suitability as live feed for many aquatic species, particularly in larval stages (Sorgeloos & Roubach, 2021).
Travis Hills' Endeavors in Minnesota: Fostering Environmental and Economic Pr...Travis Hills MN
Travis Hills of Minnesota developed a method to convert waste into high-value dry fertilizer, significantly enriching soil quality. By providing farmers with a valuable resource derived from waste, Travis Hills helps enhance farm profitability while promoting environmental stewardship. Travis Hills' sustainable practices lead to cost savings and increased revenue for farmers by improving resource efficiency and reducing waste.
Nutraceutical market, scope and growth: Herbal drug technologyLokesh Patil
As consumer awareness of health and wellness rises, the nutraceutical market—which includes goods like functional meals, drinks, and dietary supplements that provide health advantages beyond basic nutrition—is growing significantly. As healthcare expenses rise, the population ages, and people want natural and preventative health solutions more and more, this industry is increasing quickly. Further driving market expansion are product formulation innovations and the use of cutting-edge technology for customized nutrition. With its worldwide reach, the nutraceutical industry is expected to keep growing and provide significant chances for research and investment in a number of categories, including vitamins, minerals, probiotics, and herbal supplements.
Observation of Io’s Resurfacing via Plume Deposition Using Ground-based Adapt...Sérgio Sacani
Since volcanic activity was first discovered on Io from Voyager images in 1979, changes
on Io’s surface have been monitored from both spacecraft and ground-based telescopes.
Here, we present the highest spatial resolution images of Io ever obtained from a groundbased telescope. These images, acquired by the SHARK-VIS instrument on the Large
Binocular Telescope, show evidence of a major resurfacing event on Io’s trailing hemisphere. When compared to the most recent spacecraft images, the SHARK-VIS images
show that a plume deposit from a powerful eruption at Pillan Patera has covered part
of the long-lived Pele plume deposit. Although this type of resurfacing event may be common on Io, few have been detected due to the rarity of spacecraft visits and the previously low spatial resolution available from Earth-based telescopes. The SHARK-VIS instrument ushers in a new era of high resolution imaging of Io’s surface using adaptive
optics at visible wavelengths.
Seminar of U.V. Spectroscopy by SAMIR PANDASAMIR PANDA
Spectroscopy is a branch of science dealing the study of interaction of electromagnetic radiation with matter.
Ultraviolet-visible spectroscopy refers to absorption spectroscopy or reflect spectroscopy in the UV-VIS spectral region.
Ultraviolet-visible spectroscopy is an analytical method that can measure the amount of light received by the analyte.
Parallelization of Benchmarking using HPC: Text Summarization in Natural Language Processing (NLP), Glider Piloting in Deep-sea Missions, and Search Algorithms in Computational Intelligence (CI)
1. Abstract NLP UGPP CI References
Parallelization of
Benchmarking using HPC:
Text Summarization in Natural Language Processing
(NLP), Glider Piloting in Deep-sea Missions, and
Search Algorithms in Computational Intelligence (CI)
ASHPC21, Austrian-Slovenian High-Performance Computing Meeting
Institute of Information Science in Maribor, Slovenia
1 May – 2 June, 2021 (online exclusively via livestream)
Aleš Zamuda
ales.zamuda@um.si
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 1/ 40
2. Abstract NLP UGPP CI References
Introduction: Overview
This contribution focuses on
I recent developments and trends
I in terms of efficient and successful
I high-performance computing (HPC) applications.
Real examples: science and HPC
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 2/ 40
3. Abstract NLP UGPP CI References
Introduction: Aims of this Talk at ASHPC21 Meeting
I First (5 minutes), a collaboration benefiting from HPC:
a state-of-the-art topic of text summarization for NLP
(part of ”Big Data”),
I spanning over the time curse of successful HPC initiatives
including Slovenia: SLING → SIHPC → ImAppNIO →
cHiPSet → HPC RIVR → TFoB → EuroCC → DAPHNE
I Second (+10 minutes), additional success stories are listed,
like those developed through program funded unit P2-0041,
HPC RIVR project, and projects by EU under programs like
Erasmus+, COST (Cooperation in Science and Technology)
and H2020 (Horizon 2020).
I Third (5 minutes), this contribution aims at leveraging
potential opportunities in NLP and HPC for shared and
collaborative synergies, enhancing sustainable HPC
development.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 3/ 40
4. Abstract NLP UGPP CI References
HPC Application 1:
Text Summarization
I NLP and computational linguistics for Text Summarization:
I Multi-Document Text Summarization is a hard CI challenge.
I Basically, an evolutionary algorithm is applied for
summarization,
I it is a state-of-the-art topic of text summarization for NLP
(part of ”Big Data”) and presented as a collaboration
[JoCS2020], acknowledging several efforts.
I we add: self-adaptation of optimization control parameters;
analysis through benchmarking using HPC, and
apply additional NLP tools.
I How it works: for the abstract, sentences from original text
are selected for full inclusion (extraction).
I To extract a combination of sentences:
I can be computationally demanding,
I we use heuristic optimization,
I the time to run optimization can be limited.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 4/ 40
5. Abstract NLP UGPP CI References
1 – Preprocessing (environment sensing, knowledge
representation) (1/2)
1) The files of documents are each taken through the following
process using NLP (Natural Language Processing) tools:
INPUT
CORPUS
NATURAL
LANGUAGE
PROCESSING
ANALYSIS
CONCEPTS
DISTRIBUTION
PER
SENTENCES
MATRIX OF
CONCEPTS
PROCESSING
CORPUS
PREPROCESSING
PHASE
OPTIMIZATION
TASKS
EXECUTION
PHASE
ASSEMBLE
TASK
DESCRIPTION
SUBMIT
TASKS
TO PARALLEL
EXECUTION
OPTIMIZER
+
TASK DATA
ROUGE
EVALUATION
2) For each document is D, sentences are indexed using NLP tools.
I Terms across sentences are determined using a semantic analysis
using both:
I coreference resolution (using WordNet) and
I a Concept Matrix (from Freeling).
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 5/ 40
6. Abstract NLP UGPP CI References
1 – Preprocessing (environment sensing, knowledge
representation) (2/2)
I 3) For each i-th term (wi ), during indexing
I number of occurences in the text is gathered, and
I number of occurences (nk ) of a term in some k-th statement,
I 4) For each term wi in the document, inverse frequency:
isfw i = log(
n
nk
),
I where n denotes number of statements in the document, and
I nk number of statements including a term wi .
I 5) To conclude preprocessing, for each term in the document,
a weight is calculated:
wi,k = tfi,kisfk,
where tfik is number of occurences (term frequency) of a term
wk in a statement si .
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP & CI 6/ 40
7. Abstract NLP UGPP CI References
2 – Summary Optimization (1/3)
I Sentence combination (X) is optimized using jDE algorithm:
I as a 0/1 knapsack problem, we want to include optimal
selection of statements in the final output
I an i-th sentence si is selected (xi = 1) or unselected (xi = 0).
I a) Price of a knapsack (its fitness) should be maximized,
I the fitness represents a ratio between content coverage, V (X),
and redundancy, R(X):
f (X) =
V (X)
R(X)
,
I considering a constraint: the summary length is L ± words.
I Constraint handling with solutions:
I each feasable solution is better than unfeasable,
I unfeasable compared by constraint value (lower better),
I feasable compared by fitness (higher better).
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 7/ 40
8. Abstract NLP UGPP CI References
2 – Summary Optimization (2/3)
I b) Content coverage V (X) is computed as a double sum of
similarities (defined at d)):
V (X) =
n−1
X
i=1
n
X
j=i+1
(sim(si , O) + sim(sj , O))xi,j ,
I where xi,j denotes inclusion of both statement, si , and sj ,
I xi,j is only 1 if xi = xj = 1, otherwise 0,
I and O is a vector of average term weights wi,k :
O = (o1, o2, ..., om) for all i = {1..m} different text terms:
oi =
Pn
j=1 wi,j
n
.
I c) Redundance R(X) is also measured as double similarity
(defined at d)) sum for all statements:
R(X) =
n−1
X
i=1
n
X
j=i+1
sim(si , sj )xi,j ,
I where xi,j denotes inclusion of both statement, si , and sj ,
I again, xi,j is only 1 if xi = xj = 1, otherwise 0.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 8/ 40
9. Abstract NLP UGPP CI References
2 – Summary Optimization (3/3)
I d) Similarity between statements si = [wi,1, wi,2, ..., wi,m] and
sj = [wj,1, wj,2, ..., wj,m] is computed:
sim(si , sj ) =
m
X
k=1
wi,kwj,k
pPm
k=1 wi,kwi,k
Pm
k=1 wj,kwj,k
,
where wi,k is term weight (defined in 5)) and m number of all
terms in text.
I e) When concluded:
I the selected statements from the best assessed combination
are printed,
I in order as they appear in the text, and
I the summary is stored.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 9/ 40
10. Abstract NLP UGPP CI References
Summary Optimization — Algorithm Pseudocode
The detailed new method called
CaBiSDETS is developed in the
HPC approach comprising of:
I a version of evolutionary
algorithm (Differential
Evolution, DE),
I self-adaptation, binarization,
constraint adjusting, and
some more pre-computation,
I optimizing the inputs to
define the summarization
optimization model.
Aleš Zamuda, Elena Lloret.
Optimizing Data-Driven Models
for Summarization as Parallel
Tasks. Journal of Computational
Science, 2020, vol. 42, pp. 101101.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 10/ 40
11. Abstract NLP UGPP CI References
Running the Tasks on HPC: ARC Job Preparation
Submission, Results Retrieval Merging [JoCS2020]
Through an HPC approach and by parallelization of tasks,
a data-driven summarization model optimization yields
improved benchmark metric results (drawn using gnuplot merge).
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 11/ 40
12. Abstract NLP UGPP CI References
Results Published in Journal of Computational Science
The most interesting finding of the HPC study though is that
I the fitness of the NLP model keeps increasing with prolonging
the dedicated HPC resources (see below) and that
I the fitness improvement correlates with ROUGE evaluation in
the benchmark, i.e. better summaries.
-0.05
0
0.05
0.1
0.15
0.2
0.25
0.3
0.35
0.4
1 10 100 1000 10000
ROUGE-1R
ROUGE-2R
ROUGE-LR
ROUGE-SU4R
Fitness (scaled)
Hence, the use of HPC significantly contributes to capability of
this NLP challenge.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 12/ 40
13. Abstract NLP UGPP CI References
HPC Application 2:
Underwater Glider: Autonomous, Unmanned, Robotic
I underwater glider – navigating sea oceans,
I Autonomous Underwater Vehicle (AUV)
6=
Unmanned Aerial Vehicle (UAV)
I AUV Slocum model (expertise in domain of ULPGC, work
with J. D. Hernández Sosa)
Images:
”Photo: Richard Watt/MOD” (License: OGL v1.0)
Slocum-Glider-Auvpicture 5.jpg (License: Public Domain)
MiniU.jpg (License: CC-BY-SA 3.0)
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 13/ 40
14. Abstract NLP UGPP CI References
The Buoyancy Drive and Submarine Probes Usefulness
I Driving ”yoyo” uses little energy, most only on descent and
rise (pump); also for maintaining direction little power is
consumed.
+ Use: improving ocean models with real data,
+ the real data at the point of capture,
+ sampling flow of oil discharges,
+ monitoring cable lines, and
+ real-time monitoring of different
sensor data.
1
http://spectrum.ieee.org/image/1523708
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 14/ 40
15. Abstract NLP UGPP CI References
Preparations – Simulation Scenarios
https://www.google.si/maps/@28.059806,-15.998355,650054m/data=!3m1!1e3
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 15/ 40
16. Abstract NLP UGPP CI References
Trajectory Optimization: P201,ESTOC2013 3
+ BigData, MyOcean IBI,
satelite link, GPS location
The real trajectory and collected data is available in a Google Earth KML file at the EGO network:
http://www.ego-network.org/dokuwiki/doku.php?glider=P201,ESTOC2013_3
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 16/ 40
17. Abstract NLP UGPP CI References
Constrained Differential Evolution Optimization
for Underwater Glider Path Planning
in Sub-mesoscale Eddy Sampling
I Corridor-constrained optimization:
eddy border region sampling
I new challenge for UGPP DE
I Feasible path area is constrained
I trajectory in corridor around the
border of an ocean eddy
The objective of the glider here is to
sample the oceanographic variables more
efficiently,
while keeping a bounded trajectory
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 17/ 40
18. Abstract NLP UGPP CI References
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 18/ 40
19. Abstract NLP UGPP CI References
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 19/ 40
20. Abstract NLP UGPP CI References
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 20/ 40
21. Abstract NLP UGPP CI References
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 21/ 40
22. Abstract NLP UGPP CI References
HoP — New Trajectories:
Success history applied to expert system for underwater
glider path planning using differential evolution
I Improved underwater glider path
planning mission scenarios:
optimization with L-SHADE.
I Several configured algorithms
are also compared to, analysed,
and further improved.
I Outranked all other previous
results from literature and
ranked first in comparison.
I New algorithm yielded
practically stable and
competitive output trajectories.
I UGPP unconstrained scenarios —
contributed significantly to the capacity of
the decision-makers for mission plannings.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 22/ 40
23. Abstract NLP UGPP CI References
Ranking UGPP —
Benchmarking
Aggregation
I Statistically,
all results
from previous paper
were outperformed.
I Main reasons:
tuning (NP),
parameter control
(L-SHADE).
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 23/ 40
24. Abstract NLP UGPP CI References
HPC Application 3:
Multi-application domain generalized
Computational Intelligence (CI) through HPC
I With the ubiquity of HPC and Cloud Computing,
I connectible using versatile interfaces for their utilisation,
I example successes of these systems is computational
intelligence.
I One of designs for these services is:
I using evolutionary optimization approaches,
I needing much efficiently parallelizable data processing power.
I There are several application domains of this approach:
I generalized numerical functions problems and
I other parallel real world problems, such as
I text processing,
I molecular modelling,
I evolutionary computer vision, and
I robotics.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 24/ 40
25. Abstract NLP UGPP CI References
CI Algorithm Design: Control Parameters Self-Adaptation
I Through more suitable values of control parameters the search
process exhibits a better convergence (CI — Computational
Intelligence),
I therefore the search converges faster to better solutions,
which survive with greater probability and they create more
offspring and propagate their control parameters
I Recent study with cca. 10 million runs of SPSRDEMMS:
A. Zamuda, J. Brest. Self-adaptive control parameters’
randomization frequency and propagations in differential
evolution. Swarm and Evolutionary Computation, 2015, vol.
25C, pp. 72-99.
DOI 10.1016/j.swevo.2015.10.007.
– SWEVO 2015 RAMONA / SNIP 5.220
I Deployed using arcsub.
I Update: DISH algorithm —
https://doi.org/10.1016/j.swevo.2018.10.013
(Outperforms on CEC 2017 functions.)
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 25/ 40
26. Abstract NLP UGPP CI References
Existing Challenges: Benchmarks for Known Environments
Inspired by previous computational optimization competitions in continuous settings
that used test functions for optimization application domains:
I single-objective: CEC 2005, 2013, 2014, 2015
I constrained: CEC 2006, CEC 2007, CEC 2010
I multi-modal: CEC 2010, SWEVO 2016
I black-box (target value): BBOB 2009, COCO 2016
I noisy optimization: BBOB 2009
I large-scale: CEC 2008, CEC 2010
I dynamic: CEC 2009, CEC 2014
I real-world: CEC 2011
I computationally expensive: CEC 2013, CEC 2015
I learning-based: CEC 2015
I 100-digit (50% targets): 2019 joined CEC, SEMCCO, GECCO
I multi-objective: CEC 2002, CEC 2007, CEC 2009, CEC 2014
I bi-objective: CEC 2008
I many objective: CEC 2018
Tuning/ranking/hyperheuristics use. → DEs as usual winner algorithms.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 26/ 40
27. Abstract NLP UGPP CI References
IEEE Congress on Evolutionary Computation (CEC)
Competitions (1/4)
I Storn, Rainer, and Kenneth V. Price. ”Minimizing the Real Functions of
the ICEC’96 Contest by Differential Evolution.”
International Conference on Evolutionary Computation. 1996.
I ...
I CEC 2005 Special Session / Competition on
Evolutionary Real Parameter single objective optimization
I CEC 2006 Special Session / Competition on
Evolutionary Constrained Real Parameter single objective optimization
I CEC 2007 Special Session / Competition on
Performance Assessment of real-parameter MOEAs
I CEC 2008 Special Session / Competition on
large scale single objective global optimization with bound constraints
I CEC 2008 Scale-Invariant Optimisation Competition ”Mountains or Molehills”
I CEC 2009 Special Session / Competition on
Dynamic Optimization (Primarily composition functions were used)
I CEC 2009 Special Session / Competition on
Performance Assessment of real-parameter MOEAs
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 27/ 40
28. Abstract NLP UGPP CI References
IEEE Congress on Evolutionary Computation (CEC)
Competitions (2/4)
I CEC 2010 Special Session / Competition on
large-scale single objective global optimization with bound constraints
I CEC 2010 Special Session / Competition on
Evolutionary Constrained Real Parameter single objective optimization
I CEC 2010 Special Session on
Niching Introduces novel scalable test problems
I CEC 2011 Competition on Testing Evolutionary Algorithms on Real-world
Numerical Optimization Problems
I CEC 2013 Special Session / Competition on
Real Parameter Single Objective Optimization
I CEC 2014 Special Session / Competition on
Real Parameter Single Objective Optimization
(incorporates expensive functions)
I CEC 2014: Dynamic MOEA Benchmark Problems
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 28/ 40
29. Abstract NLP UGPP CI References
IEEE Congress on Evolutionary Computation (CEC)
Competitions (3/4)
I CEC 2015 Special Session / Competition on
Real Parameter Single Objective Optimization (incorporates 3 scenarios)
I CEC 2015 Black Box Optimization Competition
I CEC 2015 Dynamic Multi-Objective Optimization
I CEC 2015 Optimization of Big Data
I CEC 2015 Large Scale Global Optimization
I CEC 2015 Bound Constrained Single-Objective Numerical Optimization
I CEC 2015
Optimisation of Problems with Multiple Interdependent Components
I CEC 2015 Niching Methods for Multimodal Optimization
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 29/ 40
30. Abstract NLP UGPP CI References
IEEE Congress on Evolutionary Computation (CEC)
Competitions (4/4)
I CEC 2016 Special Session / Competition on
Real Parameter Single Objective Optimization (incorporates 4 scenarios)
I CEC 2016 Big Optimization (BigOpt2016)
I CEC 2016 Niching Methods for Multimodal Optimization
I CEC 2016 Special Session Associated with Competition on
Bound Constrained Single Objective Numerical Optimization
I CEC2017 Special Session / Competition on Real Parameter Single
Objective Optimization (also constrained)
I CEC2018 Special Session / Competition on Real Parameter Single
Objective Optimization
I CEC2019 Special Session / Competition on 100-Digit Challenge on Single
Objective Numerical Optimization
I CEC 2020, CEC 2021, ...: see IEEE Task Force on Benchmarking listings
(incl. BOCIA, TEVC, MDPI SIs etc.)
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 30/ 40
31. Abstract NLP UGPP CI References
Some More Benchmark Function Sets
The Genetic and Evolutionary Computation Conference (GECCO):
I GECCO 2014 Windfarm Layout Optimization Competition
I GECCO 2014 Permutation-based Combinatorial Optimization Problems
I GECCO 2015 Black Box Optimization (BBComp)
I GECCO 2015 Combinatorial Black-Box Optimization (CBBOC)
I GECCO 2019 Workshop Competition on Numerical Optimization
I Swarm and Evolutionary Computation: Novel benchmark functions for
continuous multimodal optimization with comparative results (2015)
I Benchmarks for natural architecture design:
Spatial Tree Morphology Reconstruction
(seeded/pre-processed/vectorized/multi-objective)
I We prepare benchmarks for ocean exploration with underwater robots:
Underwater Glider Path Planning
(unconstraint/constraint/variable/multi-objective)
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 31/ 40
32. Abstract NLP UGPP CI References
Real World Industry Challenges: Motivation
I Optimization of Real World Industry Challenges (RWIC),
I selected as CEC 2011 Real World Optimization Problems,
I a benchmark set contains functions modelling the problems,
I assessment on all 22 functions of CEC 2011 set,
I functions with constraints are handled with additional care.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 32/ 40
33. Abstract NLP UGPP CI References
Selected Challenges in the CEC 2011 Benchmark (1/2)
I Decomposition of radio FM signals,
I determination of ternary protein structure
I Lennard-Jones inter-atom energy potential,
I parameterization of a chemical process,
I methylcyclopentane → benzene,
I control parameterization for chemical reaction in a continuous
stirred tank reactor,
I inter-atom potential in covalent Silicon systems
I Tersoff energy potential,
I radar spectrum signal broadcast parameterization,
I spread spectrum radar polly phase code design,
I electrical transmission network expansion planning,
I new lines for transmission selection.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 33/ 40
34. Abstract NLP UGPP CI References
Selected Challenges in the CEC 2011 Benchmark (2/2)
I Large scale transmission pricing,
I circular antenna array design,
I dynamic economic dispatch (with power generator control),
I static economic load dispatch (of power generated),
I hydrothermal scheduling (among hydro/thermal units),
I spacecraft trajectory optimization,
I Mercury (Messenger),
I Saturn (Cassini).
I The collection includes 22 functions, with constraints as:
1. non-feasible evaluation is NaN when constraints are not met, or
2. the constraints are included in the function evaluation value.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 34/ 40
35. Abstract NLP UGPP CI References
Conclusion: Summary Teaching towards HPC
Summary: presented 3 HPC domains (NLP, UGPP, CI).
More: at University of Maribor, Bologna study courses for learning
(teaching, training) of Computer Science at cycles — click URL:
I level 1 (BSc)
I year 1: Programming I – e.g. C++ syntax
I year 2: Computer Architectures – e.g. assembly, microcode, ILP
I year 3: Parallell and Distributed Computing – e.g. OpenMP, MPI, CUDA
I level 2 (MSc)
I year 1: Cloud Computing Deployment and Management – e.g. arc, slurm,
containers (docker, singularity, kubernetes)
I level 3 (PhD)
I EU and other national projects research:
HPC RIVR, EuroCC, DAPHNE, ... – e.g. scaling new systems
of CI Operational Research of ... over HPC
I IEEE Computational Intelligence Task Force on Benchmarking
I Scientific Journals (e.g. SWEVO, TEVC, JoCS, ASOC, INS)
These contribute towards Sustainable Development of HPC.
Thanks!
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 35/ 40
36. Abstract NLP UGPP CI References
Biography and References: Organizations
I Associate Professorat University of Maribor, Slovenia
I Continuous research programme funded by Slovenian Research Agency,
P2-0041: Computer Systems, Methodologies, and Intelligent Services
I Associate Editor: Swarm and Evolutionary Computation (SWEVO)
I IEEE (Institute of Electrical and Electronics Engineers) senior
I IEEE Computational Intelligence Society (CIS), senior member
I IEEE CIS Task Force on Benchmarking, chair
I IEEE CIS, Slovenia Section Chapter (CH08873), chair
I IEEE Slovenia Section, vice chair
I IEEE Young Professionals Slovenia, past chair
I ACM SIGEVO (Special Interest Group on Genetic and Evolutionary Computation); EurAI; SLAIS
I Co-operation in Science and Techology (COST) Association
Management Committee, member:
I CA COST Action CA15140: Improving Applicability of Nature-Inspired
Optimisation by Joining Theory and Practice (ImAppNIO), WG3 VC
I ICT COST Action IC1406 High-Performance Modelling and Simulation
for Big Data Applications (cHiPSet); SI-HPC; HPC-RIVR user
I EU H2020 Research and Innovation project, holder for UM part: Integrated
Data Analysis Pipelines for Large-Scale Data Management, HPC, and Machine
Learning (DAPHNE), https://cordis.europa.eu/project/id/957407
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 36/ 40
37. Abstract NLP UGPP CI References
Biography and References: Top Publications
I Aleš Zamuda, Elena Lloret. Optimizing Data-Driven Models for Summarization as Parallel Tasks.
Journal of Computational Science, 2020, vol. 42, pp. 101101. DOI 10.1016/j.jocs.2020.101101.
I A. Zamuda, J. D. Hernández Sosa. Success history applied to expert system for underwater glider path
planning using differential evolution. Expert Systems with Applications, 2019, vol. 119, pp. 155-170.
DOI 10.1016/j.eswa.2018.10.048
I A. Viktorin, R. Senkerik, M. Pluhacek, T. Kadavy, A. Zamuda. Distance Based Parameter Adaptation
for Success-History based Differential Evolution. Swarm and Evolutionary Computation, 2019, vol. 50,
pp. 100462. DOI 10.1016/j.swevo.2018.10.013.
I A. Zamuda, J. Brest. Self-adaptive control parameters’ randomization frequency and propagations in
differential evolution. Swarm and Evolutionary Computation, 2015, vol. 25C, pp. 72-99.
DOI 10.1016/j.swevo.2015.10.007.
I A. Zamuda, J. D. Hernández Sosa, L. Adler. Constrained Differential Evolution Optimization for
Underwater Glider Path Planning in Sub-mesoscale Eddy Sampling. Applied Soft Computing, 2016,
vol. 42, pp. 93-118. DOI 10.1016/j.asoc.2016.01.038.
I A. Zamuda, J. D. Hernández Sosa. Differential Evolution and Underwater Glider Path Planning
Applied to the Short-Term Opportunistic Sampling of Dynamic Mesoscale Ocean Structures.
Applied Soft Computing, vol. 24, November 2014, pp. 95-108. DOI 10.1016/j.asoc.2014.06.048.
I A. Zamuda, J. Brest. Vectorized Procedural Models for Animated Trees Reconstruction using
Differential Evolution. Information Sciences, vol. 278, pp. 1-21, 2014. DOI 10.1016/j.ins.2014.04.037.
I A. Zamuda, J. Brest. Environmental Framework to Visualize Emergent Artificial Forest Ecosystems.
Information Sciences, vol. 220, pp. 522-540, 2013. DOI 10.1016/j.ins.2012.07.031.
I A. Glotić, A. Zamuda. Short-term combined economic and emission hydrothermal optimization by
surrogate differential evolution. Applied Energy, 1 March 2015, vol. 141, pp. 42-56.
DOI 10.1016/j.apenergy.2014.12.020.
I H. Hamann, Y. Khaluf, J. Botev, M. Divband Soorati, E. Ferrante, O. Kosak, J.-M. Montanier, S.
Mostaghim, R. Redpath, J. Timmis, F. Veenstra, M. Wahby and A. Zamuda. Hybrid Societies:
Challenges and Perspectives in the Design of Collective Behavior in Self-organizing Systems.
Frontiers in Robotics and AI, 2016, vol. 3, no. 14. DOI 10.3389/frobt.2016.00014.
I J. Šilc, A. Zamuda. Special Issue on ”Bioinspired Optimization” (guest editors). Informatica - An
International Journal of Computing and Informatics, 2015, vol. 39, no. 2, pp. 1-122.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 37/ 40
38. Abstract NLP UGPP CI References
Biography and References: Bound Specific to HPC
PROJECTS:
I DAPHNE: Integrated Data Analysis Pipelines for Large-Scale Data
Management, HPC, and Machine Learning
I ICT COST Action IC1406 High-Performance Modelling and Simulation for Big
Data Applications
I SLING: Slovenian national supercomputing network
I SI-HPC: Slovenian corsortium for High-Performance Computing
I UM HPC-RIVR: Supercomputer at UM, https://www.hpc-rivr.si/
I SmartVillages: Smart digital transformation of villages in the Alpine Space
I Interreg Alpine Space,
https://www.alpine-space.eu/projects/smartvillages/en/home
I Interactive multimedia digital signage (PKP, Adin DS)
EDITOR:
I SWEVO (Top Journal), Associate Editor
I Mathematics-MDPI, Special Issue: Evolutionary Algorithms in Engineering Design Optimization
I Journal of advanced engineering and computation (member of editorial board since 2019). Viet Nam: Ton
Duc Thang University, 2017-. ISSN 2588-123X.
I Cloud Computing and Data Science (Associate Editor, since 2019). Universal Wiser Publisher Pte.Ltd.
I D. Gleich, P. Planinšič, A. Zamuda. 2018 25th International Conference on Systems, Signals and Image
Processing (IWSSIP). IEEE Xplore, Maribor, 20-22 June 2018.
I General Chair: 7-th Joint International Conferences on Swarm, Evolutionary and Memetic Computing
Conference (SEMCCO 2019) Fuzzy And Neural Computing Conference (FANCCO 2019), Maribor,
Slovenia, EU, 10-12 July 2019; co-editors: Aleš Zamuda, Swagatam Das, Ponnuthurai Nagaratnam
Suganthan, Bijaya Ketan Panigrahi.
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 38/ 40
39. Abstract NLP UGPP CI References
Biography and References: More on HPC
RESEARCH PUBLICATIONS:
I Aleš Zamuda, Elena Lloret. Optimizing Data-Driven Models for Summarization as Parallel Tasks.
Journal of Computational Science, 2020, vol. 42, pp. 101101. DOI 10.1016/j.jocs.2020.101101.
I Aleš Zamuda, Vincenzo Crescimanna, Juan C. Burguillo, Joana Matos Dias, Katarzyna Wegrzyn-Wolska,
Imen Rached, Horacio González-Vélez, Roman Senkerik, Claudia Pop, Tudor Cioara, Ioan Salomie, Andrea
Bracciali. Forecasting Cryptocurrency Value by Sentiment Analysis: An HPC-Oriented Survey of the
State-of-the-Art in the Cloud Era. Kolodziej J., González-Vélez H. (eds) High-Performance Modelling and
Simulation for Big Data Applications. Lecture Notes in Computer Science, vol 11400, 2019, pp. 325-349.
DOI 10.1007/978-3-030-16272-6 12.
I Nenad Karolija, Aleš Zamuda. On cloud-supported web-based integrated development environment for
programming dataflow architectures. MILUTINOVIĆ, Veljko (ur.), KOTLAR, Milos (ur.). Exploring the
DataFlow supercomputing paradigm: example algorithms for selected applications, (Computer
communications and networks (Internet), ISSN 2197-8433), 2019, pp. 41-51. DOI
10.1007/978-3-030-13803-5 2.
I Simone Spolaor, Marco Gribaudo, Mauro Iacono, Tomas Kadavy, Zuzana Komı́nková Oplatková, Giancarlo
Mauri, Sabri Pllana, Roman Senkerik, Natalija Stojanovic, Esko Turunen, Adam Viktorin, Salvatore
Vitabile, Aleš Zamuda, Marco S. Nobile. Towards Human Cell Simulation. Kolodziej J., González-Vélez H.
(eds) High-Performance Modelling and Simulation for Big Data Applications. Lecture Notes in
Computer Science, vol 11400, 2019, pp. 221-249. DOI 10.1007/978-3-030-16272-6 8.
I A. Zamuda, J. D. Hernandez Sosa, L. Adler. Improving Constrained Glider Trajectories for Ocean Eddy
Border Sampling within Extended Mission Planning Time. IEEE Congress on Evolutionary Computation
(CEC) 2016, 2016, pp. 1727-1734.
I A. Zamuda. Function evaluations upto 1e+12 and large population sizes assessed in distance-based
success history differential evolution for 100-digit challenge and numerical optimization scenarios
(DISHchain 1e+12): a competition entry for ”100-digit challenge, and four other numerical optimization
competitions” at the genetic and evolutionary computation conference (GECCO) 2019. Proceedings of the
Genetic and Evolutionary Computation Conference Companion (GECCO 2019), 2019, pp. 11-12.
I ... several more experiments for papers run using HPCs.
I ... also, pedagogic materials in Slovenian and English — see Conclusion .
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 39/ 40
40. Abstract NLP UGPP CI References
Promo materials: Calls for Papers, Informational Websites
CS FERI WWW
CIS TFoB
CFPs WWW
LinkedIn
Twitter
Aleš Zamuda 7@aleszamuda Parallelization of Benchmarking using HPC: NLP, UGPP CI 40/ 40