This document discusses hybrid learning approaches for Adaptive Neuro Fuzzy Inference Systems (ANFIS). It describes the ANFIS architecture, which combines artificial neural networks and fuzzy logic. The training algorithms analyzed are Back Propagation, gradient descent, and Runge-Kutta learning. Experiments showed that ANFIS combined with Runge-Kutta learning provides better training error results than the other methods. The hybrid approach allows ANFIS to incorporate human expertise and adapt through learning input-output data.
A Mixed Binary-Real NSGA II Algorithm Ensuring Both Accuracy and Interpretabi...IJECEIAES
In this work, a Neuro-Fuzzy Controller network, called NFC that implements a Mamdani fuzzy inference system is proposed. This network includes neurons able to perform fundamental fuzzy operations. Connections between neurons are weighted through binary and real weights. Then a mixed binaryreal Non dominated Sorting Genetic Algorithm II (NSGA II) is used to perform both accuracy and interpretability of the NFC by minimizing two objective functions; one objective relates to the number of rules, for compactness, while the second is the mean square error, for accuracy. In order to preserve interpretability of fuzzy rules during the optimization process, some constraints are imposed. The approach is tested on two control examples: a single input single output (SISO) system and a multivariable (MIMO) system.
A Learning Linguistic Teaching Control for a Multi-Area Electric Power SystemCSCJournals
This paper presents a new methodology for designing a neuro-fuzzy control for complex physical systems. By developing a Neural -Fuzzy system learning with linguistic teaching signals. The advantage of this technique is that, produce a simple and well-performing system because it selects the fuzzy sets and the numerical numbers and process both numerical and linguistic information. This approach is able to process and learn numerical information as well as linguistic information. The proposed control scheme is applied to a multi-area power system with hydraulic and thermal turbines.
DESIGN AND IMPLEMENTATION OF BINARY NEURAL NETWORK LEARNING WITH FUZZY CLUSTE...cscpconf
In this paper, Design and Implementation of Binary Neural Network Learning with Fuzzy
Clustering (DIBNNFC), is proposed to classify semisupervised data, it is based on the
concept of binary neural network and geometrical expansion. Parameters are updated
according to the geometrical location of the training samples in the input space, and each
sample in the training set is learned only once. It’s a semisupervised based approach, the
training samples are semi-labelled i.e. for some samples, labels are known and for some
samples data labels are not known. The method starts with classification, which is done by
using the concept of ETL algorithm. In classification process various classes are formed.
These classes classify samples in to two classes after that considers each class as a region and calculates the average of the entire region separately. This average is centres of the region which is used for the purpose of clustering by using FCM algorithm. Once clustering process over labelling of semi supervised data is done, then whole samples would be classify by (DIBNNFC). The method proposes here is exhaustively tested with different benchmark datasets and it is found that, on increasing value of training parameters number of hidden neurons and training time both are getting decrease. The result reported, using real character recognition data set and result will compare with existing semi-supervised classifier, the proposed approach learned with semi-supervised leads to higher classification accuracy.
INTERVAL TYPE-2 INTUITIONISTIC FUZZY LOGIC SYSTEM FOR TIME SERIES AND IDENTIF...ijfls
This paper proposes a sliding mode control-based learning of interval type-2 intuitionistic fuzzy logic system for time series and identification problems. Until now, derivative-based algorithms such as gradient descent back propagation, extended Kalman filter, decoupled extended Kalman filter and hybrid method of decoupled extended Kalman filter and gradient descent methods have been utilized for the optimization of the parameters of interval type-2 intuitionistic fuzzy logic systems. The proposed model is based on a Takagi-Sugeno-Kang inference system. The evaluations of the model are conducted using both real world and artificially generated datasets. Analysis of results reveals that the proposed interval type-2 intuitionistic fuzzy logic system trained with sliding mode control learning algorithm (derivative-free) do outperforms some existing models in terms of the test root mean squared error while competing favourable with other models in the literature. Moreover, the proposed model may stand as a good choice for real time applications where running time is paramount compared to the derivative-based models.
Investigations on Hybrid Learning in ANFISIJERA Editor
Neural networks have attractiveness to several researchers due to their great closeness to the structure of the brain, their characteristics not shared by many traditional systems. An Artificial Neural Network (ANN) is a network of interconnected artificial processing elements (called neurons) that co-operate with one another in order to solve specific issues. ANNs are inspired by the structure and functional aspects of biological nervous systems. Neural networks, which recognize patterns and adopt themselves to cope with changing environments. Fuzzy inference system incorporates human knowledge and performs inferencing and decision making. The integration of these two complementary approaches together with certain derivative free optimization techniques, results in a novel discipline called Neuro Fuzzy. In Neuro fuzzy development a specific approach is called Adaptive Neuro Fuzzy Inference System (ANFIS), which has shown significant results in modeling nonlinear functions. The basic idea behind the paper is to design a system that uses a fuzzy system to represent knowledge in an interpretable manner and have the learning ability derived from a Runge-Kutta learning method (RKLM) to adjust its membership functions and parameters in order to enhance the system performance. The problem of finding appropriate membership functions and fuzzy rules is often a tiring process of trial and error. It requires users to understand the data before training, which is usually difficult to achieve when the database is relatively large. To overcome these problems, a hybrid of Back Propagation Neural network (BPN) and RKLM can combine the advantages of two systems and avoid their disadvantages.
This document proposes and constructs new mathematical models based on fuzzy set theory and fuzzy systems. It presents two models: a Fuzzy Inference System (FIS) and an Adaptive Fuzzy System using neural networks. The models are applied to washing machine data and show good accuracy. Key aspects covered include: fuzzy rules, fuzzy inference systems, fuzzy logic operations, fuzzification and defuzzification methods, and constructing a 3-dimensional fuzzy system model. MATLAB is used to program and test the models.
Fuzzy Logic and Neuro-fuzzy Systems: A Systematic IntroductionWaqas Tariq
Fuzzy logic is a rigorous mathematical field, and it provides an effective vehicle for modeling the uncertainty in human reasoning. In fuzzy logic, the knowledge of experts is modeled by linguistic rules represented in the form of IF-THEN logic. Like neural network models such as the multilayer perceptron (MLP) and the radial basis function network (RBFN), some fuzzy inference systems (FISs) have the capability of universal approximation. Fuzzy logic can be used in most areas where neural networks are applicable. In this paper, we first give an introduction to fuzzy sets and logic. We then make a comparison between FISs and some neural network models. Rule extraction from trained neural networks or numerical data is then described. We finally introduce the synergy of neural and fuzzy systems, and describe some neuro-fuzzy models as well. Some circuits implementations of neuro-fuzzy systems are also introduced. Examples are given to illustrate the cocepts of neuro-fuzzy systems.
This document discusses hybrid learning approaches for Adaptive Neuro Fuzzy Inference Systems (ANFIS). It describes the ANFIS architecture, which combines artificial neural networks and fuzzy logic. The training algorithms analyzed are Back Propagation, gradient descent, and Runge-Kutta learning. Experiments showed that ANFIS combined with Runge-Kutta learning provides better training error results than the other methods. The hybrid approach allows ANFIS to incorporate human expertise and adapt through learning input-output data.
A Mixed Binary-Real NSGA II Algorithm Ensuring Both Accuracy and Interpretabi...IJECEIAES
In this work, a Neuro-Fuzzy Controller network, called NFC that implements a Mamdani fuzzy inference system is proposed. This network includes neurons able to perform fundamental fuzzy operations. Connections between neurons are weighted through binary and real weights. Then a mixed binaryreal Non dominated Sorting Genetic Algorithm II (NSGA II) is used to perform both accuracy and interpretability of the NFC by minimizing two objective functions; one objective relates to the number of rules, for compactness, while the second is the mean square error, for accuracy. In order to preserve interpretability of fuzzy rules during the optimization process, some constraints are imposed. The approach is tested on two control examples: a single input single output (SISO) system and a multivariable (MIMO) system.
A Learning Linguistic Teaching Control for a Multi-Area Electric Power SystemCSCJournals
This paper presents a new methodology for designing a neuro-fuzzy control for complex physical systems. By developing a Neural -Fuzzy system learning with linguistic teaching signals. The advantage of this technique is that, produce a simple and well-performing system because it selects the fuzzy sets and the numerical numbers and process both numerical and linguistic information. This approach is able to process and learn numerical information as well as linguistic information. The proposed control scheme is applied to a multi-area power system with hydraulic and thermal turbines.
DESIGN AND IMPLEMENTATION OF BINARY NEURAL NETWORK LEARNING WITH FUZZY CLUSTE...cscpconf
In this paper, Design and Implementation of Binary Neural Network Learning with Fuzzy
Clustering (DIBNNFC), is proposed to classify semisupervised data, it is based on the
concept of binary neural network and geometrical expansion. Parameters are updated
according to the geometrical location of the training samples in the input space, and each
sample in the training set is learned only once. It’s a semisupervised based approach, the
training samples are semi-labelled i.e. for some samples, labels are known and for some
samples data labels are not known. The method starts with classification, which is done by
using the concept of ETL algorithm. In classification process various classes are formed.
These classes classify samples in to two classes after that considers each class as a region and calculates the average of the entire region separately. This average is centres of the region which is used for the purpose of clustering by using FCM algorithm. Once clustering process over labelling of semi supervised data is done, then whole samples would be classify by (DIBNNFC). The method proposes here is exhaustively tested with different benchmark datasets and it is found that, on increasing value of training parameters number of hidden neurons and training time both are getting decrease. The result reported, using real character recognition data set and result will compare with existing semi-supervised classifier, the proposed approach learned with semi-supervised leads to higher classification accuracy.
INTERVAL TYPE-2 INTUITIONISTIC FUZZY LOGIC SYSTEM FOR TIME SERIES AND IDENTIF...ijfls
This paper proposes a sliding mode control-based learning of interval type-2 intuitionistic fuzzy logic system for time series and identification problems. Until now, derivative-based algorithms such as gradient descent back propagation, extended Kalman filter, decoupled extended Kalman filter and hybrid method of decoupled extended Kalman filter and gradient descent methods have been utilized for the optimization of the parameters of interval type-2 intuitionistic fuzzy logic systems. The proposed model is based on a Takagi-Sugeno-Kang inference system. The evaluations of the model are conducted using both real world and artificially generated datasets. Analysis of results reveals that the proposed interval type-2 intuitionistic fuzzy logic system trained with sliding mode control learning algorithm (derivative-free) do outperforms some existing models in terms of the test root mean squared error while competing favourable with other models in the literature. Moreover, the proposed model may stand as a good choice for real time applications where running time is paramount compared to the derivative-based models.
Investigations on Hybrid Learning in ANFISIJERA Editor
Neural networks have attractiveness to several researchers due to their great closeness to the structure of the brain, their characteristics not shared by many traditional systems. An Artificial Neural Network (ANN) is a network of interconnected artificial processing elements (called neurons) that co-operate with one another in order to solve specific issues. ANNs are inspired by the structure and functional aspects of biological nervous systems. Neural networks, which recognize patterns and adopt themselves to cope with changing environments. Fuzzy inference system incorporates human knowledge and performs inferencing and decision making. The integration of these two complementary approaches together with certain derivative free optimization techniques, results in a novel discipline called Neuro Fuzzy. In Neuro fuzzy development a specific approach is called Adaptive Neuro Fuzzy Inference System (ANFIS), which has shown significant results in modeling nonlinear functions. The basic idea behind the paper is to design a system that uses a fuzzy system to represent knowledge in an interpretable manner and have the learning ability derived from a Runge-Kutta learning method (RKLM) to adjust its membership functions and parameters in order to enhance the system performance. The problem of finding appropriate membership functions and fuzzy rules is often a tiring process of trial and error. It requires users to understand the data before training, which is usually difficult to achieve when the database is relatively large. To overcome these problems, a hybrid of Back Propagation Neural network (BPN) and RKLM can combine the advantages of two systems and avoid their disadvantages.
This document proposes and constructs new mathematical models based on fuzzy set theory and fuzzy systems. It presents two models: a Fuzzy Inference System (FIS) and an Adaptive Fuzzy System using neural networks. The models are applied to washing machine data and show good accuracy. Key aspects covered include: fuzzy rules, fuzzy inference systems, fuzzy logic operations, fuzzification and defuzzification methods, and constructing a 3-dimensional fuzzy system model. MATLAB is used to program and test the models.
Fuzzy Logic and Neuro-fuzzy Systems: A Systematic IntroductionWaqas Tariq
Fuzzy logic is a rigorous mathematical field, and it provides an effective vehicle for modeling the uncertainty in human reasoning. In fuzzy logic, the knowledge of experts is modeled by linguistic rules represented in the form of IF-THEN logic. Like neural network models such as the multilayer perceptron (MLP) and the radial basis function network (RBFN), some fuzzy inference systems (FISs) have the capability of universal approximation. Fuzzy logic can be used in most areas where neural networks are applicable. In this paper, we first give an introduction to fuzzy sets and logic. We then make a comparison between FISs and some neural network models. Rule extraction from trained neural networks or numerical data is then described. We finally introduce the synergy of neural and fuzzy systems, and describe some neuro-fuzzy models as well. Some circuits implementations of neuro-fuzzy systems are also introduced. Examples are given to illustrate the cocepts of neuro-fuzzy systems.
TFFN: Two Hidden Layer Feed Forward Network using the randomness of Extreme L...Nimai Chand Das Adhikari
The learning speed of the feed forward neural
network takes a lot of time to be trained which is a major
drawback in their applications since the past decades. The
key reasons behind may be due to the slow gradient-based
learning algorithms which are extensively used to train the
neural networks or due to the parameters in the networks
which are tuned iteratively using some learning algorithms.
Thus, in order to eradicate the above pitfalls, a new learning
algorithm was proposed known as Extreme Learning Machines
(ELM). This algorithm tries to compute Hidden-layer-output
matrix that is made of randomly assigned input layer and
hidden layer weights and randomly assigned biases. Unlike the
other feedforward networks, ELM has the access of the whole
training dataset before going into the computation part. Here,
we have devised a new two-layer-feedforward network (TFFN)
for ELM in a new manner with randomly assigning the weights
and biases in both the hidden layers, which then calculates the
output-hidden layer weights using the Moore-Penrose generalized
inverse. TFFN doesn’t restricts the algorithm to fix the number
of hidden neurons that the algorithm should have. Rather it
searches the space which gives an optimized result in the neurons
combination in both the hidden layers. This algorithm provides a
good generalization capability than the parent Extreme Learning
Machines at an extremely fast learning speed. Here, we have
experimented the algorithm on various types of datasets and
various popular algorithm to find the performances and report
a comparison.
The document provides an overview of artificial neural networks and their learning capabilities. It discusses:
- How biological neural networks in the brain inspired artificial neural networks
- The basic structure of artificial neurons and how they are connected in a network
- Single layer perceptrons and how they can be trained to learn simple tasks using supervised learning algorithms like the perceptron learning rule
- Multilayer neural networks with one or more hidden layers that can learn more complex patterns using backpropagation to modify weights.
Survey on Artificial Neural Network Learning Technique AlgorithmsIRJET Journal
This document discusses different types of learning algorithms used in artificial neural networks. It begins with an introduction to neural networks and their ability to learn from their environment through adjustments to synaptic weights. Four main learning algorithms are then described: error correction learning, which uses algorithms like backpropagation to minimize error; memory based learning, which stores all training examples and analyzes nearby examples to classify new inputs; Hebbian learning, where connection weights are adjusted based on the activity of neurons; and competitive learning, where neurons compete to respond to inputs to become specialized feature detectors through a winner-take-all mechanism. The document provides details on how each type of learning algorithm works.
DSR Routing Decisions for Mobile Ad Hoc Networks using Fuzzy Inference Systemcscpconf
Mobile ad-hoc network technology has gained popularity in recent years by researchers on account of its flexibility, low cost and ease of deployment. The objective of this paper is to model the behavior of MANET for DSR protocol by considering some prominent routing metrics.These metrics ( packet delivery fraction, normalized routing load , average end- to- end delayetc.) have been generated by Network Simulator NS 2.34 tools and the node movement has beengenerated using Bonmotion 1.4.The MANET behavior for DSR protocol is hypothesized to be dependent on fuzzy variables like node density, pause time , number of packets transferred , and the number of connection. In this paper the behavior of MANET is modeled using Fuzzy Inference System for DSR (Dynamic Source Routing) protocol , Fuzzy Inference System offers a natural way of representing and reasoning the problems with uncertainty and imprecision. Fuzzy logic is found to be a suitable way in the mobile ad hoc network routing decision. A Fuzzy inference system is implemented on MATLAB 7.0 and the model is found to be satisfactory with the fuzzy input metrics and de fuzzified output metrics .
Neuro-fuzzy systems combine neural networks and fuzzy logic to utilize the advantages of both. The neuro-fuzzy system has the ability to self-learn and generate rules from data without expert knowledge. It consists of layers that perform fuzzification, rule evaluation, implication, aggregation, and defuzzification. Such a system can provide effective advisory and self-learning capabilities for small-scale economic problems where data is available but generalization and expertise are limited.
The document summarizes a proposed fuzzy logic-based joint space path planning system for a 3 degree-of-freedom robot manipulator. The system is composed of three separate fuzzy logic units that each control one of the manipulator joints. The inputs and outputs of each fuzzy block control the change in joint position for each time step. Simulation results show the robot is able to reach the goal configuration successfully using this approach. The fuzzy logic method is able to meet real-time requirements for robot motion planning without requiring an exact model of the robot.
This document discusses several dynamic thresholding approaches for segmenting continuous Bangla speech sentences into words or subwords. It proposes using k-means clustering, fuzzy c-means clustering (FCM), and Otsu's thresholding method to determine optimal thresholds for segmentation. K-means and FCM clustering produce better segmentation results than Otsu's method. The algorithms are implemented in MATLAB and achieve an average segmentation accuracy of 94%. Blocking black areas and boundary detection techniques are used to properly detect word boundaries in continuous speech and label the segmented units.
1. Self-organizing maps (SOM) are an unsupervised learning algorithm that transform high-dimensional data into lower dimensions for visualization while preserving topological properties.
2. The SOM network has an input layer fully connected to an output layer arranged in a grid, with each node containing a weight vector of the same dimension as inputs.
3. During training, the best matching unit (BMU) and its neighbors on the grid have their weight vectors adjusted to better match the input based on their distance from the BMU, with learning rates decreasing over time.
Derivation of Convolutional Neural Network (ConvNet) from Fully Connected Net...Ahmed Gad
In image analysis, convolutional neural networks (CNNs or ConvNets for short) are time and memory efficient than fully connected (FC) networks. But why? What are the advantages of ConvNets over FC networks in image analysis? How is ConvNet derived from FC networks? Where the term convolution in CNNs came from? These questions are to be answered in this article.
Image analysis has a number of challenges such as classification, object detection, recognition, description, etc. If an image classifier, for example, is to be created, it should be able to work with a high accuracy even with variations such as occlusion, illumination changes, viewing angles, and others. The traditional pipeline of image classification with its main step of feature engineering is not suitable for working in rich environments. Even experts in the field won’t be able to give a single or a group of features that are able to reach high accuracy under different variations. Motivated by this problem, the idea of feature learning came out. The suitable features to work with images are learned automatically. This is the reason why artificial neural networks (ANNs) are one of the robust ways of image analysis. Based on a learning algorithm such as gradient descent (GD), ANN learns the image features automatically. The raw image is applied to the ANN and ANN is responsible for generating the features describing it.
-Reference
Aghdam, Hamed Habibi, and Elnaz Jahani Heravi. Guide to Convolutional Neural Networks: A Practical Application to Traffic-Sign Detection and Classification. Springer, 2017.
Dynamic thresholding on speech segmentationeSAT Journals
Abstract Word is the preferred and natural unit of speech, because word units have well defined acoustic representation. This paper presents several dynamic thresholding approaches for segmenting continuous Bangla speech sentences into words/sub-words. We have proposed three efficient methods for speech segmentation: two of them are usually used in pattern classification (i.e., k-means and FCM clustering) and one of them is used in image segmentation (i.e., Otsu’s thresholding method). We also used new approaches blocking black area and boundary detection techniques to properly detect word boundaries in continuous speech and label the entire speech sentence into a sequence of words/sub-words. K-Means and FCM clustering methods produce better segmentation results than that of Otsu’s Method. All the algorithms and methods used in this research are implemented in MATLAB and the proposed system achieved the average segmentation accuracy of 94% approximately. Keywords: Blocking Black Area, Clustering, Dynamic Thresholding, Fuzzy Logic and Speech Segmentation.
GENERAL REGRESSION NEURAL NETWORK BASED POS TAGGING FOR NEPALI TEXTcscpconf
This article presents Part of Speech tagging for Nepali text using General Regression Neural
Network (GRNN). The corpus is divided into two parts viz. training and testing. The network is
trained and validated on both training and testing data. It is observed that 96.13% words are
correctly being tagged on training set whereas 74.38% words are tagged correctly on testing
data set using GRNN. The result is compared with the traditional Viterbi algorithm based on
Hidden Markov Model. Viterbi algorithm yields 97.2% and 40% classification accuracies on
training and testing data sets respectively. GRNN based POS Tagger is more consistent than the
traditional Viterbi decoding technique.
This document discusses unsupervised learning approaches including clustering, blind signal separation, and self-organizing maps (SOM). Clustering groups unlabeled data points together based on similarities. Blind signal separation separates mixed signals into their underlying source signals without information about the mixing process. SOM is an algorithm that maps higher-dimensional data onto lower-dimensional displays to visualize relationships in the data.
This document provides a review of how fuzzy logic techniques can improve the efficiency of power system stability. It begins with an introduction to fuzzy logic and how it can model human reasoning to address uncertainty. It then discusses issues with conventional power system stabilizers (PSS) and how fuzzy logic controllers (FLC) can help address their limitations in dealing with nonlinear systems. The document outlines the basic components of an FLC and steps to design one. It reviews several studies that have applied FLCs to PSS and gas turbine control and found they provide better damping and robustness compared to conventional controllers. The conclusion is that fuzzy logic is an effective approach for controlling complex, nonlinear processes in power systems.
Fuzzy modeling require two main steps which are structure identification and parameter optimization, the
first one determines the numbers of membership functions and fuzzy if-then rules, while the second
identifies a feasible set of parameters under the given structure. However, the increase of input dimension,
rule numbers will have an exponential growth and there will cause problem of “rule disaster”. In this
paper, we have applied adaptive network fuzzy inference system ANFIS for phonemes recognition. The
appropriate learning algorithm is performed on TIMIT speech database supervised type, a pre-processing
of the acoustic signal and extracting the coefficients MFCCs parameters relevant to the recognition system.
First learning of the network structure by subtractive clustering, in order to define an optimal structure and
obtain small number of rules, then learning of parameters network by hybrid learning which combine the
gradient decent and least square estimation LSE to find a feasible set of antecedents and consequents
parameters. The results obtained show the effectiveness of the method in terms of recognition rate and
number of fuzzy rules generated.
Black-box modeling of nonlinear system using evolutionary neural NARX modelIJECEIAES
Nonlinear systems with uncertainty and disturbance are very difficult to model using mathematic approach. Therefore, a black-box modeling approach without any prior knowledge is necessary. There are some modeling approaches have been used to develop a black box model such as fuzzy logic, neural network, and evolution algorithms. In this paper, an evolutionary neural network by combining a neural network and a modified differential evolution algorithm is applied to model a nonlinear system. The feasibility and effectiveness of the proposed modeling are tested on a piezoelectric actuator SISO system and an experimental quadruple tank MIMO system.
SPECIFICATION OF THE STATE’S LIFETIME IN THE DEVS FORMALISM BY FUZZY CONTROLLERijait
This paper aims to develop a new approach to assess the duration of state in the DEVS formalism by fuzzy
controller. The idea is to define a set of fuzzy rules obtained from observers or expert knowledge and to
specify a fuzzy model which computes this duration, this latter is fed into the simulator to specify the new
value in the model. In conventional model, each state is defined by a mean lifetime value whereas our
method, calculates for each state the new lifetime according to inputs values. A wildfire case study is
presented at the end of the paper. It is a challenging task due to its complex behavior, dynamical weather
condition, and various variables involved. A global specification of the fuzzy controller and the forest fire
model are presented in the DEVS formalism and comparison between conventional and fuzzy method is
illustrated.
An Artificial Intelligence Approach to Ultra High Frequency Path Loss Modelli...ijtsrd
This study proposes Artificial Intelligence AI based path loss prediction models for the suburban areas of Abuja, Nigeria. The AI based models were created on the bases of two deep learning networks, namely the Adaptive Neuro Fuzzy Inference System ANFIS and the Generalized Radial Basis Function Neural network RBF NN . These prediction models were created, trained, validated and tested for path loss prediction using path loss data recorded at 1800MHz from multiple Base Transceiver Stations BTSs distributed across the areas under investigation. Results indicate that the ANFIS and RBF NN based models with Root Mean Squared Error RMSE values of 5.30dB and 5.31dB respectively, offer greater prediction accuracy over the widely used empirical COST 231 Hata, which has an RMSE of 8.18dB. Deme C. Abraham ""An Artificial Intelligence Approach to Ultra-High Frequency Path Loss Modelling of the Suburban Areas of Abuja, Nigeria"" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-4 | Issue-2 , February 2020,
URL: https://www.ijtsrd.com/papers/ijtsrd30227.pdf
Paper Url : https://www.ijtsrd.com/computer-science/artificial-intelligence/30227/an-artificial-intelligence-approach-to-ultra-high-frequency-path-loss-modelling-of-the-suburban-areas-of-abuja-nigeria/deme-c-abraham
Fuzzy inference systems use fuzzy logic to map inputs to outputs. There are two main types:
Mamdani systems use fuzzy outputs and are well-suited for problems involving human expert knowledge. Sugeno systems have faster computation using linear or constant outputs.
The fuzzy inference process involves fuzzifying inputs, applying fuzzy logic operators, and using if-then rules. Outputs are determined through implication, aggregation, and defuzzification. Mamdani systems find the centroid of fuzzy outputs while Sugeno uses weighted averages, making it more efficient.
The document discusses using clustering models like subtractive fuzzy clustering (SFC) and fuzzy c-means clustering (FCM) to generate an adaptive neuro-fuzzy inference system (ANFIS) for medical diagnoses. Experimental results on medical diagnosis datasets show that ANFIS models using SFC and FCM clustering (ANFIS-SFC and ANFIS-FCM) had better average training and checking errors compared to ANFIS without clustering. Specifically, ANFIS-SFC performed best using backpropagation learning, while ANFIS-FCM performed best using a hybrid learning model. Clustering the datasets without ANFIS was also able to identify different disease clusters.
ADAPTIVE NETWORK BASED FUZZY INFERENCE SYSTEM FOR SPEECH RECOGNITION THROUGH ...ijaia
Fuzzy modeling require two main steps which are structure identification and parameter optimization, the
first one determines the numbers of membership functions and fuzzy if-then rules, while the second
identifies a feasible set of parameters under the given structure. However, the increase of input dimension,
rule numbers will have an exponential growth and there will cause problem of “rule disaster”. In this
paper, we have applied adaptive network fuzzy inference system ANFIS for phonemes recognition. The
appropriate learning algorithm is performed on TIMIT speech database supervised type, a pre-processing
of the acoustic signal and extracting the coefficients MFCCs parameters relevant to the recognition system.
First learning of the network structure by subtractive clustering, in order to define an optimal structure and
obtain small number of rules, then learning of parameters network by hybrid learning which combine the
gradient decent and least square estimation LSE to find a feasible set of antecedents and consequents
parameters. The results obtained show the effectiveness of the method in terms of recognition rate and
number of fuzzy rules generated.
TFFN: Two Hidden Layer Feed Forward Network using the randomness of Extreme L...Nimai Chand Das Adhikari
The learning speed of the feed forward neural
network takes a lot of time to be trained which is a major
drawback in their applications since the past decades. The
key reasons behind may be due to the slow gradient-based
learning algorithms which are extensively used to train the
neural networks or due to the parameters in the networks
which are tuned iteratively using some learning algorithms.
Thus, in order to eradicate the above pitfalls, a new learning
algorithm was proposed known as Extreme Learning Machines
(ELM). This algorithm tries to compute Hidden-layer-output
matrix that is made of randomly assigned input layer and
hidden layer weights and randomly assigned biases. Unlike the
other feedforward networks, ELM has the access of the whole
training dataset before going into the computation part. Here,
we have devised a new two-layer-feedforward network (TFFN)
for ELM in a new manner with randomly assigning the weights
and biases in both the hidden layers, which then calculates the
output-hidden layer weights using the Moore-Penrose generalized
inverse. TFFN doesn’t restricts the algorithm to fix the number
of hidden neurons that the algorithm should have. Rather it
searches the space which gives an optimized result in the neurons
combination in both the hidden layers. This algorithm provides a
good generalization capability than the parent Extreme Learning
Machines at an extremely fast learning speed. Here, we have
experimented the algorithm on various types of datasets and
various popular algorithm to find the performances and report
a comparison.
The document provides an overview of artificial neural networks and their learning capabilities. It discusses:
- How biological neural networks in the brain inspired artificial neural networks
- The basic structure of artificial neurons and how they are connected in a network
- Single layer perceptrons and how they can be trained to learn simple tasks using supervised learning algorithms like the perceptron learning rule
- Multilayer neural networks with one or more hidden layers that can learn more complex patterns using backpropagation to modify weights.
Survey on Artificial Neural Network Learning Technique AlgorithmsIRJET Journal
This document discusses different types of learning algorithms used in artificial neural networks. It begins with an introduction to neural networks and their ability to learn from their environment through adjustments to synaptic weights. Four main learning algorithms are then described: error correction learning, which uses algorithms like backpropagation to minimize error; memory based learning, which stores all training examples and analyzes nearby examples to classify new inputs; Hebbian learning, where connection weights are adjusted based on the activity of neurons; and competitive learning, where neurons compete to respond to inputs to become specialized feature detectors through a winner-take-all mechanism. The document provides details on how each type of learning algorithm works.
DSR Routing Decisions for Mobile Ad Hoc Networks using Fuzzy Inference Systemcscpconf
Mobile ad-hoc network technology has gained popularity in recent years by researchers on account of its flexibility, low cost and ease of deployment. The objective of this paper is to model the behavior of MANET for DSR protocol by considering some prominent routing metrics.These metrics ( packet delivery fraction, normalized routing load , average end- to- end delayetc.) have been generated by Network Simulator NS 2.34 tools and the node movement has beengenerated using Bonmotion 1.4.The MANET behavior for DSR protocol is hypothesized to be dependent on fuzzy variables like node density, pause time , number of packets transferred , and the number of connection. In this paper the behavior of MANET is modeled using Fuzzy Inference System for DSR (Dynamic Source Routing) protocol , Fuzzy Inference System offers a natural way of representing and reasoning the problems with uncertainty and imprecision. Fuzzy logic is found to be a suitable way in the mobile ad hoc network routing decision. A Fuzzy inference system is implemented on MATLAB 7.0 and the model is found to be satisfactory with the fuzzy input metrics and de fuzzified output metrics .
Neuro-fuzzy systems combine neural networks and fuzzy logic to utilize the advantages of both. The neuro-fuzzy system has the ability to self-learn and generate rules from data without expert knowledge. It consists of layers that perform fuzzification, rule evaluation, implication, aggregation, and defuzzification. Such a system can provide effective advisory and self-learning capabilities for small-scale economic problems where data is available but generalization and expertise are limited.
The document summarizes a proposed fuzzy logic-based joint space path planning system for a 3 degree-of-freedom robot manipulator. The system is composed of three separate fuzzy logic units that each control one of the manipulator joints. The inputs and outputs of each fuzzy block control the change in joint position for each time step. Simulation results show the robot is able to reach the goal configuration successfully using this approach. The fuzzy logic method is able to meet real-time requirements for robot motion planning without requiring an exact model of the robot.
This document discusses several dynamic thresholding approaches for segmenting continuous Bangla speech sentences into words or subwords. It proposes using k-means clustering, fuzzy c-means clustering (FCM), and Otsu's thresholding method to determine optimal thresholds for segmentation. K-means and FCM clustering produce better segmentation results than Otsu's method. The algorithms are implemented in MATLAB and achieve an average segmentation accuracy of 94%. Blocking black areas and boundary detection techniques are used to properly detect word boundaries in continuous speech and label the segmented units.
1. Self-organizing maps (SOM) are an unsupervised learning algorithm that transform high-dimensional data into lower dimensions for visualization while preserving topological properties.
2. The SOM network has an input layer fully connected to an output layer arranged in a grid, with each node containing a weight vector of the same dimension as inputs.
3. During training, the best matching unit (BMU) and its neighbors on the grid have their weight vectors adjusted to better match the input based on their distance from the BMU, with learning rates decreasing over time.
Derivation of Convolutional Neural Network (ConvNet) from Fully Connected Net...Ahmed Gad
In image analysis, convolutional neural networks (CNNs or ConvNets for short) are time and memory efficient than fully connected (FC) networks. But why? What are the advantages of ConvNets over FC networks in image analysis? How is ConvNet derived from FC networks? Where the term convolution in CNNs came from? These questions are to be answered in this article.
Image analysis has a number of challenges such as classification, object detection, recognition, description, etc. If an image classifier, for example, is to be created, it should be able to work with a high accuracy even with variations such as occlusion, illumination changes, viewing angles, and others. The traditional pipeline of image classification with its main step of feature engineering is not suitable for working in rich environments. Even experts in the field won’t be able to give a single or a group of features that are able to reach high accuracy under different variations. Motivated by this problem, the idea of feature learning came out. The suitable features to work with images are learned automatically. This is the reason why artificial neural networks (ANNs) are one of the robust ways of image analysis. Based on a learning algorithm such as gradient descent (GD), ANN learns the image features automatically. The raw image is applied to the ANN and ANN is responsible for generating the features describing it.
-Reference
Aghdam, Hamed Habibi, and Elnaz Jahani Heravi. Guide to Convolutional Neural Networks: A Practical Application to Traffic-Sign Detection and Classification. Springer, 2017.
Dynamic thresholding on speech segmentationeSAT Journals
Abstract Word is the preferred and natural unit of speech, because word units have well defined acoustic representation. This paper presents several dynamic thresholding approaches for segmenting continuous Bangla speech sentences into words/sub-words. We have proposed three efficient methods for speech segmentation: two of them are usually used in pattern classification (i.e., k-means and FCM clustering) and one of them is used in image segmentation (i.e., Otsu’s thresholding method). We also used new approaches blocking black area and boundary detection techniques to properly detect word boundaries in continuous speech and label the entire speech sentence into a sequence of words/sub-words. K-Means and FCM clustering methods produce better segmentation results than that of Otsu’s Method. All the algorithms and methods used in this research are implemented in MATLAB and the proposed system achieved the average segmentation accuracy of 94% approximately. Keywords: Blocking Black Area, Clustering, Dynamic Thresholding, Fuzzy Logic and Speech Segmentation.
GENERAL REGRESSION NEURAL NETWORK BASED POS TAGGING FOR NEPALI TEXTcscpconf
This article presents Part of Speech tagging for Nepali text using General Regression Neural
Network (GRNN). The corpus is divided into two parts viz. training and testing. The network is
trained and validated on both training and testing data. It is observed that 96.13% words are
correctly being tagged on training set whereas 74.38% words are tagged correctly on testing
data set using GRNN. The result is compared with the traditional Viterbi algorithm based on
Hidden Markov Model. Viterbi algorithm yields 97.2% and 40% classification accuracies on
training and testing data sets respectively. GRNN based POS Tagger is more consistent than the
traditional Viterbi decoding technique.
This document discusses unsupervised learning approaches including clustering, blind signal separation, and self-organizing maps (SOM). Clustering groups unlabeled data points together based on similarities. Blind signal separation separates mixed signals into their underlying source signals without information about the mixing process. SOM is an algorithm that maps higher-dimensional data onto lower-dimensional displays to visualize relationships in the data.
This document provides a review of how fuzzy logic techniques can improve the efficiency of power system stability. It begins with an introduction to fuzzy logic and how it can model human reasoning to address uncertainty. It then discusses issues with conventional power system stabilizers (PSS) and how fuzzy logic controllers (FLC) can help address their limitations in dealing with nonlinear systems. The document outlines the basic components of an FLC and steps to design one. It reviews several studies that have applied FLCs to PSS and gas turbine control and found they provide better damping and robustness compared to conventional controllers. The conclusion is that fuzzy logic is an effective approach for controlling complex, nonlinear processes in power systems.
Fuzzy modeling require two main steps which are structure identification and parameter optimization, the
first one determines the numbers of membership functions and fuzzy if-then rules, while the second
identifies a feasible set of parameters under the given structure. However, the increase of input dimension,
rule numbers will have an exponential growth and there will cause problem of “rule disaster”. In this
paper, we have applied adaptive network fuzzy inference system ANFIS for phonemes recognition. The
appropriate learning algorithm is performed on TIMIT speech database supervised type, a pre-processing
of the acoustic signal and extracting the coefficients MFCCs parameters relevant to the recognition system.
First learning of the network structure by subtractive clustering, in order to define an optimal structure and
obtain small number of rules, then learning of parameters network by hybrid learning which combine the
gradient decent and least square estimation LSE to find a feasible set of antecedents and consequents
parameters. The results obtained show the effectiveness of the method in terms of recognition rate and
number of fuzzy rules generated.
Black-box modeling of nonlinear system using evolutionary neural NARX modelIJECEIAES
Nonlinear systems with uncertainty and disturbance are very difficult to model using mathematic approach. Therefore, a black-box modeling approach without any prior knowledge is necessary. There are some modeling approaches have been used to develop a black box model such as fuzzy logic, neural network, and evolution algorithms. In this paper, an evolutionary neural network by combining a neural network and a modified differential evolution algorithm is applied to model a nonlinear system. The feasibility and effectiveness of the proposed modeling are tested on a piezoelectric actuator SISO system and an experimental quadruple tank MIMO system.
SPECIFICATION OF THE STATE’S LIFETIME IN THE DEVS FORMALISM BY FUZZY CONTROLLERijait
This paper aims to develop a new approach to assess the duration of state in the DEVS formalism by fuzzy
controller. The idea is to define a set of fuzzy rules obtained from observers or expert knowledge and to
specify a fuzzy model which computes this duration, this latter is fed into the simulator to specify the new
value in the model. In conventional model, each state is defined by a mean lifetime value whereas our
method, calculates for each state the new lifetime according to inputs values. A wildfire case study is
presented at the end of the paper. It is a challenging task due to its complex behavior, dynamical weather
condition, and various variables involved. A global specification of the fuzzy controller and the forest fire
model are presented in the DEVS formalism and comparison between conventional and fuzzy method is
illustrated.
An Artificial Intelligence Approach to Ultra High Frequency Path Loss Modelli...ijtsrd
This study proposes Artificial Intelligence AI based path loss prediction models for the suburban areas of Abuja, Nigeria. The AI based models were created on the bases of two deep learning networks, namely the Adaptive Neuro Fuzzy Inference System ANFIS and the Generalized Radial Basis Function Neural network RBF NN . These prediction models were created, trained, validated and tested for path loss prediction using path loss data recorded at 1800MHz from multiple Base Transceiver Stations BTSs distributed across the areas under investigation. Results indicate that the ANFIS and RBF NN based models with Root Mean Squared Error RMSE values of 5.30dB and 5.31dB respectively, offer greater prediction accuracy over the widely used empirical COST 231 Hata, which has an RMSE of 8.18dB. Deme C. Abraham ""An Artificial Intelligence Approach to Ultra-High Frequency Path Loss Modelling of the Suburban Areas of Abuja, Nigeria"" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-4 | Issue-2 , February 2020,
URL: https://www.ijtsrd.com/papers/ijtsrd30227.pdf
Paper Url : https://www.ijtsrd.com/computer-science/artificial-intelligence/30227/an-artificial-intelligence-approach-to-ultra-high-frequency-path-loss-modelling-of-the-suburban-areas-of-abuja-nigeria/deme-c-abraham
Fuzzy inference systems use fuzzy logic to map inputs to outputs. There are two main types:
Mamdani systems use fuzzy outputs and are well-suited for problems involving human expert knowledge. Sugeno systems have faster computation using linear or constant outputs.
The fuzzy inference process involves fuzzifying inputs, applying fuzzy logic operators, and using if-then rules. Outputs are determined through implication, aggregation, and defuzzification. Mamdani systems find the centroid of fuzzy outputs while Sugeno uses weighted averages, making it more efficient.
The document discusses using clustering models like subtractive fuzzy clustering (SFC) and fuzzy c-means clustering (FCM) to generate an adaptive neuro-fuzzy inference system (ANFIS) for medical diagnoses. Experimental results on medical diagnosis datasets show that ANFIS models using SFC and FCM clustering (ANFIS-SFC and ANFIS-FCM) had better average training and checking errors compared to ANFIS without clustering. Specifically, ANFIS-SFC performed best using backpropagation learning, while ANFIS-FCM performed best using a hybrid learning model. Clustering the datasets without ANFIS was also able to identify different disease clusters.
ADAPTIVE NETWORK BASED FUZZY INFERENCE SYSTEM FOR SPEECH RECOGNITION THROUGH ...ijaia
Fuzzy modeling require two main steps which are structure identification and parameter optimization, the
first one determines the numbers of membership functions and fuzzy if-then rules, while the second
identifies a feasible set of parameters under the given structure. However, the increase of input dimension,
rule numbers will have an exponential growth and there will cause problem of “rule disaster”. In this
paper, we have applied adaptive network fuzzy inference system ANFIS for phonemes recognition. The
appropriate learning algorithm is performed on TIMIT speech database supervised type, a pre-processing
of the acoustic signal and extracting the coefficients MFCCs parameters relevant to the recognition system.
First learning of the network structure by subtractive clustering, in order to define an optimal structure and
obtain small number of rules, then learning of parameters network by hybrid learning which combine the
gradient decent and least square estimation LSE to find a feasible set of antecedents and consequents
parameters. The results obtained show the effectiveness of the method in terms of recognition rate and
number of fuzzy rules generated.
Capital market applications of neural networks etc23tino
The document provides an overview of capital market applications of neural networks, fuzzy logic, and genetic algorithms that have been studied in academic literature. It reviews studies that use these techniques for market forecasting, trading rules, option pricing, bond ratings, and portfolio construction. For market forecasting specifically, several studies are described that use neural networks and neuro-fuzzy systems to predict stock market indexes and interest rates, finding they often outperform traditional econometric models.
This document discusses using artificial neural networks for network intrusion detection. Specifically, it proposes a hybrid classification model that uses entropy-based feature selection to reduce the dataset, followed by four neural network techniques (RBFN, SOM, SMO, PART) for classification. It provides details on each neural network technique and the overall methodology, which uses 10-fold cross validation to evaluate performance based on standard criteria. The goal is to build an efficient intrusion detection system with low false alarms and high detection rates.
FUZZY CONTROL OF A SERVOMECHANISM: PRACTICAL APPROACH USING MAMDANI AND TAKAG...ijfls
The main objective of this work is to propose two fuzzy controllers: one based on the Mamdani inference
method and another controller based on the Takagi- Sugeno inference method, both will be designed for
application in a position control system of a servomechanism. Some comparations between the methods
mentioned above will be made with regard to the performance of the system in order to identify the
advantages of the Takagi- Sugeno method in relation to the Mamdani method in the presence of
disturbances and nonlinearities of the system. Some results of simulation and practical application are
presented and results obtained showed that controllers based on Takagi- Sugeno method is more efficient
than controllers based on Mamdani method for this specific application.
Fuzzy Control of a Servomechanism: Practical Approach using Mamdani and Takag...ijfls
The main objective of this work is to propose two fuzzy controllers: one based on the Mamdani inference method and another controller based on the Takagi- Sugeno inference method, both will be designed for application in a position control system of a servomechanism. Some comparations between the methods mentioned above will be made with regard to the performance of the system in order to identify the advantages of the Takagi- Sugeno method in relation to the Mamdani method in the presence of disturbances and nonlinearities of the system. Some results of simulation and practical application are presented and results obtained showed that controllers based on Takagi- Sugeno method is more efficient than controllers based on Mamdani method for this specific application.
This document summarizes a study that compares fuzzy logic and neuro-fuzzy models for predicting direct current in motors. Fuzzy logic and neuro-fuzzy systems were used to model the relationship between motor torque, power, speed (inputs) and current (output). Both techniques were tested on a dataset of 507 samples. The neuro-fuzzy inference system (ANFIS) performed slightly better than the fuzzy logic system at predicting motor current, demonstrating the benefits of combining fuzzy logic with neural networks.
AN ANN APPROACH FOR NETWORK INTRUSION DETECTION USING ENTROPY BASED FEATURE S...IJNSA Journal
With the increase in Internet users the number of malicious users are also growing day-by-day posing a serious problem in distinguishing between normal and abnormal behavior of users in the network. This has led to the research area of intrusion detection which essentially analyzes the network traffic and tries to determine normal and abnormal patterns of behavior.In this paper, we have analyzed the standard NSL-KDD intrusion dataset using some neural network based techniques for predicting possible intrusions. Four most effective classification methods, namely, Radial Basis Function Network, SelfOrganizing Map, Sequential Minimal Optimization, and Projective Adaptive Resonance Theory have been applied. In order to enhance the performance of the classifiers, three entropy based feature selection methods have been applied as preprocessing of data. Performances of different combinations of classifiers and attribute reduction methods have also been compared.
Although fuzzy systems demonstrate their ability to
solve different kinds of problems in various applications, there is an increasing interest on developing solid mathematical implementations suitable for control applications such as that used in fuzzy logic controllers (FLC). It is well known that, wide range of parameters is needed to be specified before the construction of a fuzzy system. To simplify in a systematic way the design and construction of a general fuzzy system, and without loss for generality a full parameterization process for a singleton type FLC is proposed in this paper. The resented methodology is very helpful in developing a universal computing algorithm for a standard fuzzy like PID controllers. An illustrative example shows the simplicity of applying the new paradigm.
This document discusses using repeated simulations of a crisp neural network to obtain quasi-fuzzy weight sets (QFWS) that can be used to initialize fuzzy neural networks. The key points are:
1) A crisp neural network is repeatedly trained on input-output data to model an unknown function. The connection weights change with each simulation.
2) Recording the weights from multiple simulations produces quasi-fuzzy weight sets, where each weight is a fuzzy set rather than a single value.
3) These QFWS can provide initial solutions for training type-I fuzzy neural networks with reduced computational complexity compared to random initialization.
4) The QFWS follow fuzzy arithmetic and allow both numerical and linguistic data to
This document proposes a new method for extracting rules from trained multilayer artificial neural networks that can represent rules in both "if-then" and "M of N" formats. The method extracts an intermediate structure called a "generator list" from which both types of rules can be derived. This provides a more generic representation than existing methods that can only output one rule format. The generator list approach avoids preprocessing steps used in other methods that can modify the original network. It uses heuristics to prune the search space when extracting the generator list to address the computational complexity involved.
This document summarizes an article about using an artificial bee colony (ABC) algorithm to extract knowledge from numerical data to generate fuzzy rules. The ABC algorithm is an optimization technique inspired by honeybee behavior that can be used for data-driven modeling when domain experts are unavailable. The article describes fuzzy systems and their components, defines the problem of generating fuzzy rules from data as a minimization problem, and provides an example of applying the ABC algorithm to generate rules for a rapid battery charger system based on temperature and charging rate data.
A hybrid intelligent system is one that combines at least two intelligent technologies.
For example, combining a neural network with a fuzzy system results in a hybrid neuro-fuzzy system.
Fuzzy logic and neural networks are natural complementary tools in building intelligent systems.
While neural networks are low-level computational structures that perform well when dealing with raw data.
fuzzy logic deals with reasoning on a higher level, using linguistic information acquired from domain experts
However, fuzzy systems lack the ability to learn and cannot adjust themselves to a new environment.
On the other hand, although neural networks can learn, they are opaque to the user.
Integrated neuro-fuzzy systems can combine the parallel computation and learning abilities of neural networks with the human-like knowledge representation and explanation abilities of fuzzy systems.
As a result, neural networks become more transparent, while fuzzy systems become capable of learning.
This document describes a study that developed a neuro-fuzzy system for predicting electricity consumption. The neuro-fuzzy system combines the learning capabilities of neural networks with the linguistic rule interpretation of fuzzy inference systems. It was applied to predict future electricity consumption in Northern Cyprus based on past consumption data. The system was trained using a supervised learning algorithm to determine optimal parameters. Simulation results showed the neuro-fuzzy system achieved more accurate predictions of electricity consumption than a neural network model alone, using fewer training epochs.
NEURAL NETWORK FOR THE RELIABILITY ANALYSIS OF A SERIES - PARALLEL SYSTEM SUB...IAEME Publication
Artificial neural networks can achieve high computation rates by employing a massive number of simple processing elements with a high degree of connectivity between the elements. Neural networks with feedback connections provide a computing model capable of exploiting fine- grained parallelism to solve a rich class of complex problems. In this paper we discuss a complex series-parallel system subjected to finite common cause and finite human error failures and its reliability using neural network method.
Understanding Inductive Bias in Machine LearningSUTEJAS
This presentation explores the concept of inductive bias in machine learning. It explains how algorithms come with built-in assumptions and preferences that guide the learning process. You'll learn about the different types of inductive bias and how they can impact the performance and generalizability of machine learning models.
The presentation also covers the positive and negative aspects of inductive bias, along with strategies for mitigating potential drawbacks. We'll explore examples of how bias manifests in algorithms like neural networks and decision trees.
By understanding inductive bias, you can gain valuable insights into how machine learning models work and make informed decisions when building and deploying them.
Introduction- e - waste – definition - sources of e-waste– hazardous substances in e-waste - effects of e-waste on environment and human health- need for e-waste management– e-waste handling rules - waste minimization techniques for managing e-waste – recycling of e-waste - disposal treatment methods of e- waste – mechanism of extraction of precious metal from leaching solution-global Scenario of E-waste – E-waste in India- case studies.
KuberTENes Birthday Bash Guadalajara - K8sGPT first impressionsVictor Morales
K8sGPT is a tool that analyzes and diagnoses Kubernetes clusters. This presentation was used to share the requirements and dependencies to deploy K8sGPT in a local environment.
Using recycled concrete aggregates (RCA) for pavements is crucial to achieving sustainability. Implementing RCA for new pavement can minimize carbon footprint, conserve natural resources, reduce harmful emissions, and lower life cycle costs. Compared to natural aggregate (NA), RCA pavement has fewer comprehensive studies and sustainability assessments.
A review on techniques and modelling methodologies used for checking electrom...nooriasukmaningtyas
The proper function of the integrated circuit (IC) in an inhibiting electromagnetic environment has always been a serious concern throughout the decades of revolution in the world of electronics, from disjunct devices to today’s integrated circuit technology, where billions of transistors are combined on a single chip. The automotive industry and smart vehicles in particular, are confronting design issues such as being prone to electromagnetic interference (EMI). Electronic control devices calculate incorrect outputs because of EMI and sensors give misleading values which can prove fatal in case of automotives. In this paper, the authors have non exhaustively tried to review research work concerned with the investigation of EMI in ICs and prediction of this EMI using various modelling methodologies and measurement setups.
Low power architecture of logic gates using adiabatic techniquesnooriasukmaningtyas
The growing significance of portable systems to limit power consumption in ultra-large-scale-integration chips of very high density, has recently led to rapid and inventive progresses in low-power design. The most effective technique is adiabatic logic circuit design in energy-efficient hardware. This paper presents two adiabatic approaches for the design of low power circuits, modified positive feedback adiabatic logic (modified PFAL) and the other is direct current diode based positive feedback adiabatic logic (DC-DB PFAL). Logic gates are the preliminary components in any digital circuit design. By improving the performance of basic gates, one can improvise the whole system performance. In this paper proposed circuit design of the low power architecture of OR/NOR, AND/NAND, and XOR/XNOR gates are presented using the said approaches and their results are analyzed for powerdissipation, delay, power-delay-product and rise time and compared with the other adiabatic techniques along with the conventional complementary metal oxide semiconductor (CMOS) designs reported in the literature. It has been found that the designs with DC-DB PFAL technique outperform with the percentage improvement of 65% for NOR gate and 7% for NAND gate and 34% for XNOR gate over the modified PFAL techniques at 10 MHz respectively.
CHINA’S GEO-ECONOMIC OUTREACH IN CENTRAL ASIAN COUNTRIES AND FUTURE PROSPECTjpsjournal1
The rivalry between prominent international actors for dominance over Central Asia's hydrocarbon
reserves and the ancient silk trade route, along with China's diplomatic endeavours in the area, has been
referred to as the "New Great Game." This research centres on the power struggle, considering
geopolitical, geostrategic, and geoeconomic variables. Topics including trade, political hegemony, oil
politics, and conventional and nontraditional security are all explored and explained by the researcher.
Using Mackinder's Heartland, Spykman Rimland, and Hegemonic Stability theories, examines China's role
in Central Asia. This study adheres to the empirical epistemological method and has taken care of
objectivity. This study analyze primary and secondary research documents critically to elaborate role of
china’s geo economic outreach in central Asian countries and its future prospect. China is thriving in trade,
pipeline politics, and winning states, according to this study, thanks to important instruments like the
Shanghai Cooperation Organisation and the Belt and Road Economic Initiative. According to this study,
China is seeing significant success in commerce, pipeline politics, and gaining influence on other
governments. This success may be attributed to the effective utilisation of key tools such as the Shanghai
Cooperation Organisation and the Belt and Road Economic Initiative.
2. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 444
order to process fuzzy rules by neural networks, it is necessary to modify the standard neural network
structure appropriately. Since fuzzy systems are universal approximates, it is expected that their
equivalent neural network representations will possess the same property. The reason to represent a
fuzzy system in terms of neural network is to utilize the learning capability of neural networks to
improve performance, such as adaptation of fuzzy systems [17]. Thus, the training algorithm in the
modified neural networks should be examined. In this work we will introduce the application of Neuro-
Fuzzy Inference System (ANFIS) for washing machine, using the Matlab toolbox. The relation of the
inputs with output has been discussed during application dependent on real data. This work presents an
alternative modeling approach to find the degree of cleanness of clothes dependent on the property of
inputs. The principal constituents of the modeling approach are fuzzy set, fuzzy system and neural
network. These are combined into the so-called hybrid modeling system (Neuro-fuzzy) [19]. In the
present work two different models have been designed using two different systems, Fuzzy Inference
System and Adaptive Neuro-Fuzzy System, and comparison is made between them to know which
better one is. The focus here is not only on how to construct the model but also on how to use this
modeling system to interpret the results and assess the uncertainty of the model.
2. Fuzzy Inference Systems
Fuzzy inference systems are also known as fuzzy-rule-based systems, fuzzy models, fuzzy associative
memories (FAM), or fuzzy controller when used as controllers [19,6]. In the field of learning systems
an interesting research subject concerns how to join the experimental knowledge of a system with the
knowledge of experts. The former, based on data collected from experiments, is commonly used to
train neural networks while the latter is used in expert systems and more recently in fuzzy systems [8].
The crisp input is fuzzified by the associated input membership function and submitted to fuzzy
inference block, which is a decision-making unit and generates fuzzy output through fuzzy reasoning.
Defuzzification block calculates crisp output from fuzzy output [17,3]. Knowledge base, composed of
data base and rule base, defines the associated membership function in fuzzification and
defuzzification blocks, and provides fuzzy rules to fuzzy inference block. (See Fig (1)):
Figure 1: The structure of the fuzzy. inference system.
There exist three main types of fuzzy systems that differ in the way they define the consequents
of their rules: Mamdani, Takagi-Sugeno, and Singleton fuzzy systems. I sketch below their main
characteristics:
3. 445 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
Type1: Mamdani's-Type of FIS: In Mamdani model, both the input and output are represented
by linguistic terms. The antecedent and consequent parts of a rule are typically Boolean
expressions of simple clauses.
Type2: Sugeno-Type of FIS: This type is called also Takagi-Sugeno method of fuzzy inference.
Introduced in 1985 and it is similar to the Mamdani method in many respects. The first
two parts of the fuzzy inference process, fuzzifying the inputs and applying the fuzzy
operator, are exactly the same. The main difference between Mamdani and Sugeno is
that the Sugeno output membership functions are either linear or constant. A typical
rule in a Sugeno fuzzy model has the following form [17,6]:
If input1= x and input2= y then output is f= px + qy + r (1)
For a zero-order Sugeno model, the output level f is a constant (p=q=0). The output level fi of
each rule is weighted by the Wi of the rule. The final output f of the system is the weighted average of
all rule outputs, computed as (see Fig (2)):
N
i i i
1
w f
N
i i
Final ouput f
w
= = =
(2)
Figure 2: Zero-order TS fuzzy inference system with two inputs.
Type 3: Singleton-Type of Fuzzy Interference System: The rule consequents of this type of
systems are constant values. Singleton fuzzy systems can be considered as a particular
case of either Mamdani or TS fuzzy systems. In fact, a constant value is equivalent to
both a singleton fuzzy set i.e., a fuzzy set that concentrates its membership value in a
single point of the universe and a linear function in which the coefficients of the input
variables value 0, [2,8].
A types of fuzzy system model mostly used is based on “fuzzy conditional statement” also
called fuzzy if-then rules and originally applied for modeling, ill-defined industrial processes. A model
of a multi-input single-output system can be described by means of a set of rules [9,3]:
1 1 2 2 : ( ) ( ) ( ) i i i n in i R if x is A and x is A and x is A then y is B (3)
where xj , j = 1,..,n are input variables, y the output variable and Ai1 , Bi are the fuzzy sets. The model
composed of fuzzy if-then rules must be completed with an inference process. In the inference process
the degree of truth of the rule premise is evaluated. This value is carried out to the consequent and then
all the fuzzy output variables so obtained are joined and defuzzified. The four steps of the fuzzy
inference system applied to the Product-Sum method, that we have chosen to implement in our
architecture, are reported as follows:
4. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 446
2.1. Fuzzification
In the fuzzification, the crisp input values are transformed to fuzzy values. If the input has a crisp
value, the matching against the membership function of linguistic variable is shown in Fig. (3a). If the
input contains noise, it can be modeled by using a fuzzy input value. In this case the fuzzy output is the
intersection of fuzzy input and the linguistic variable membership functions as shown in Fig. (3b).
However, the crisp input value fuzzification is mostly used because of its simplicity [9,19,4].
2.2. Inference
The decision making unit performs the inference operations on the fuzzy rules. The fuzzy values within
a fuzzy rule are aggregated with connective operators like intersection (AND), union (OR) and
complement (NOT). The operation of the intersection is shown in Fig. (4) The final output fuzzy sets
are obtained either scaling (Max-Dot method) or cutting (Max-Min) according to the firing strength of
the fuzzy rules. If the output fuzzy sets are singletons, they are not handled by the firing strengths in
this stage [19,3].
Figure 3: Fuzzification of a crisp input and a fuzzy input.
Figure 4: The fuzzy inference using the Min-inference.
Figure 5: Defuzzification using the weighted
average strategy.
2.3. Defuzzification
In the defuzzification stage, the outputs of the fuzzy rules are combined to a crisp output value. Several
defuzzification strategies have been suggested. The most common method is the center of area (COA)
defuzzification strategy, illustrated in Fig. (5)[8]. Assuming a discrete universe of discount, the crisp
output F is produced by searching the center of gravity of consequence fuzzy sets according to:
5. 447 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
m
i o
c i i
m
i i i
o
( )
( )
f f
F
f
μ
μ
=
=
=
(7)
where m is the number of quantization levels of the output, fi is the amount of output at the
quantization level i, and μi(fi) represents its membership value in C,[9,4].
If only singletons are used as the consequences of fuzzy rules, the natural defuzzification
method is the weighted average (WA). It can be considered as a special case of COA defuzzification
method. The WA method combines the consequences of the fuzzy rules to the output of the inference
system F according to:
n
i o
i i
m
i i
o
f
F
μ
μ
=
=
=
(8)
where n is number of fuzzy rules, μi
is the firing strength of the rule, and fi is the output value of the ith
singleton[13,9].
3. Adaptive Neuro-Fuzzy Inference Systems (ANFIS)
The ANFIS is an adaptive network of nodes and directional links with associated learning rules. The
approach learns the rules and membership functions MFs from the data [9,20,4]. Jang in 1993
introduced architecture and learning procedure for the FIS that uses a neural network learning
algorithm for constructing a set of fuzzy if-then rules with appropriate MFs from the specified input–
output pairs. This procedure of developing a FIS using the system of adaptive neural networks is called
an adaptive neuro-fuzzy inference system (ANFIS). There are two methods that ANFIS learning
employs for updating membership function parameters [10,13]:
1) Backpropagation method (BP) for all parameters (a steepest descent method).
Backpropagation is probably the most popular neural learning method. It is an application
of gradient descent algorithm originally for multilayer perceptron network. On research of
neuro-fuzzy systems, the gradient descent algorithm is used by several authors and it is
discussed widely in neural network literature. Usually, the initial fuzzy sets and rules are
first given by user. After that, the fuzzy rules are updated by a gradient descent algorithm.
The slow convergence speed near the minima is the biggest drawback of the
backpropagation [19,1].
2) Hybrid method consisting of backpropagation for the parameters associated with the input
MFs and least squares estimation for the parameters associated with the output MFs. In this
approach, both fuzzy and neural networks techniques are used independently, becoming, in
this sense, a hybrid system. Each one does its own job in serving different functions in the
system, incorporating and complementing each other in order to achieve a common goal
[4,21]. The idea of a hybrid model is the interpretation of the fuzzy rule-base in terms of a
neural network. In this way the fuzzy sets can be interpreted as weights, and the rules,
input variables, and output variables can be represented as neurons. The learning algorithm
results, like in neural networks, in a change of the architecture, i.e. in an adaption of the
weights, and/or in creating or deleting connections. These changes can be interpreted both
in terms of a neural net and in terms of a fuzzy controller [22].
The hybrid learning algorithm of ANFIS in Matlab can be explained as follows: each epoch is
composed from a forward pass and a backward pass [9,5]. In particular, the learning process consists of
a forward pass and back-propagation, where in the forward pass, functional signals go forward, and the
consequent parameters are identified by the least-square estimate. In the backward pass, the error rates
propagate backwards and the premise parameters are updated by the gradient descent shown through
the Fig.(6)[20,10].
6. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 448
Although adaptive networks cover a number of different approaches, for our purposes, we will
conduct a detailed investigation of the method proposed by with the architecture [19,13]. The network
can be regarded both as an adaptive fuzzy inference system with the capability of learning fuzzy rules
from data, and as a connection architecture provided with linguistic meaning shown in Figure (7).
Figure 6: Learning algorithm forward and backward
passes.
Figure 7: ANFIS architecture.
ANFIS Optimal consequence
Adjust optimally the premise paramise
parameters (a,b,c)
parameters are found (p, q, r)
Forward pass
Backward pass
The circular nodes have a fixed input-output relation; whereas the square nodes have
parameters to be learnt. Typical fuzzy rules are defined as a conditional statement in the form [5]:
If (x is A1) then (y is B1) (9)
2 2 If (x is A ) then (y is B ) (10)
where X and Y are linguistic variables; Ai and Bi are linguistic values determined by fuzzy sets on the
particular universes of discourse X and Y respectively. However, in ANFIS we use the first order
Takagi-Sugeno system which is:
1 1 1 1 1 1 If (x is A ) and (y is B ) then f = p x + q y + r ) (11)
2 2 2 2 2 2 If (x is A ) and (y is B ) then f = p x + q y + r ) (12)
where A1, A2 and B1, B2 are the MFs for inputs x and y, respectively, p1, q1, r1 and p2, q2, r2 are the
parameters of the output function. The functioning of the ANFIS is described as:
Layer 1: Every node in this layer produces membership grades of an input parameter. The node
output O1,i is explained by [21,1]:
O = μ ( x ) for i = 1,2
(13a)
1, i A i or
1, -2 ( ) 3,4 i Bi O = μ y for i = (13b)
where x (or y) is the input to the node i; Ai (or Bi–2) is a linguistic fuzzy set associated with this node.
O1,i is the MFs grade of a fuzzy set and it specifies the degree to which the given input x (or y) satisfies
the quantifier. MFs can be any functions that are Triangular, Gaussian, Bell shaped or Trapezoidal
shaped function [17].
Layer 2: Every node in this layer is a fixed node, whose output is the product of all incoming
signals:
2, ( ) ( ) , 1,2
i i i i A B O =w =μ x μ y i = (14)
Layer 3: The ith node of this layer, calculates the normalized firing strength as,
3,
, 1,2 i
= = =
1 2
i i
w
O w i
w w
+
(15)
7. 449 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
Layer 4: Every node i in this layer is an adaptive node with a node function,
( ) O4,i = wi fi = wi pi x + qi y + ri (16)
where 1 w is the output of layer 3 and {pi, qi, ri} is the parameter set of this node.
Layer 5: The single node in this layer is a fixed node, labeled , which computes the overall
output as the summation of all incoming signals [19,22]:
w f
(17)
5, i i i
i i i i
i i
Overall output O w f
w
= = =
This is how the input vector is typically fed through the network layer by layer. We then
consider how the ANFIS learns the premise and consequent parameters for the MFs and the rules.
4. Neuro-Fuzzy Systems
Hybrid systems combining fuzzy system, neural networks, genetic algorithms, and expert systems are
proving their effectiveness in a wide variety of real-world problems. Every intelligent technique has
particular computational properties that make them suited for particular problems and not for others
[21,2]. Fuzzy systems, which can reason with imprecise information, are good at explaining their
decisions but they cannot automatically acquire the rules they use to make those decisions [17,16]. These
limitations have been a central driving force behind the creation of intelligent hybrid systems where
two or more techniques are combined in a manner that overcomes the limitations of individual
techniques. There are three types of neuro-fuzzy systems, first: neural fuzzy systems (see Fig (8a)),
second: fuzzy neural networks (see Fig (8b)) and third: fuzzy-neural hybrid systems [14,17,19]. Hybrid
systems are very important when considering the varied nature of application domains. Many complex
domains have many different problems, each of which may require different types of processing. If
there is a complex application which has two distinct sub problems, say a signal processing task and a
serial reasoning task, then a neural network and an expert system respectively can be used for solving
these separate tasks [16,14]. The use of intelligent hybrid systems is growing rapidly with successful
applications in many areas including process control, engineering design, credit evaluation, medical
diagnosis, and cognitive simulation. The main advantage of neural systems is their ability to learn from
numerical data. However, the knowledge of them is distributed into the whole network as synaptic
weights [9,11].
Figure 8: Neural fuzzy system and Fuzzy neural network.
8. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 450
Fuzzy system contains if-then rules, which are linguistic interpretable and easily incorporate a
prior knowledge from a human expert. Neuro-fuzzy modeling refers to the way of applying various
learning techniques developed in the neural network literature to fuzzy modeling or to FIS [6]. The
basic structure of a FIS consists of three conceptual components [14, 2]: a rulebase, which contains a
selection of fuzzy rules; a database which defines the MFs used in the fuzzy rules; and a reasoning
mechanism, which performs the inference procedure upon the rules to derive an output. To utilize both
advantages within a single system, various architectures called neuro-fuzzy systems or fuzzy neural
networks have been proposed as a hybrid of fuzzy systems and neural networks [19, 17, 7].
5. Application Example: Neuro-Fuzzy System of Washing Machines
Washing machines are a common feature today in the all household. The most important utility, a
customer can derive from a washing machine is that he saves the effort he/she had to put in brushing,
agitating and washing the cloths. Most of the people wouldn’t have noticed (but can reason out very
well) that different of all one from amount of washing time, temperature of water and amount of
washing powder, claim to the different degrees of cleanness of clothes which depends directly on the
dirt in clothes, amount of dirt, cloth quality etc.. [14]. The washing machines that are used today (the
one not using fuzzy system) serves all the purpose of washing, but which cleanness of cloths needs
what amount of agitations (washing time, temperature of water, amount of washing powder) is a
business which has not been dealt with properly[3]. In most of the cases either the user is compelled to
give all the cloths same agitation or is provided with a restricted amount of control [14]. The thing is that
the washing machines used are not as automatic as they should be and can be. This work aims at
presenting the idea of controlling the cleanness of clothes using fuzzy system, where it describes the
procedure that can be used to get a suitable cleanness of clothes for different washing time, temperature
of water and amount of washing powder [5]. The process is based entirely on the principle of taking no
precise inputs from the sensors, subjecting them to fuzzy arithmetic and obtaining a crisp value of the
cleanness. It is quite clear from this work itself that this method can be used in practice to further
automate the washing machines. Never the less, this method, though with much larger number of input
parameters and further complex situations, is being used by the giants. When one uses a washing
machine, the person generally select the length of wash time based on the amount and dirt of clothes
he/she wish to wash and degree of dirt cloths have. To automate this process, we use sensors to detect
these inputs (i.e. washing time, temperature of water, amount of washing powder). The cleanness is
then determined from this data. Unfortunately, there is no easy way to formulate a precise
mathematical relationship between time, temperature powder with the degree of cleanness required.
Consequently, this problem has remained unsolved until very recently. Conventionally, people simply
set cleanness by hand and from personal trial and error experience. The real data we used had
practically reached a group of experts in one of the giant companies to 50 cases. Washing machines
were not as automatic as they could be [3,5]. The sensor system provides external input signals into the
machine from which decisions can be made. It is the controller's responsibility to make the decisions
and to signal the outside world by some form of output. Because the input/output relationship is not
clear, the design of a washing machine controller has not in the past lent itself to traditional methods of
control design [14]. We address this design problem using fuzzy system, fuzzy system has been used
because it controlled washing machine controller gives the correct cleanness even though a precise
model of the input/output relationship is not available. The problem in this work has been simplified by
using three variables for inputs and one output variable (Cleanness of clothes) depends upon three
inputs variable(see Table(1)).
9. 451 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
Figure 9: Fuzzy Inference System of Washing Machine using Mamdani method.
We will now load the inputs and output variables used for this demo into the workspace, where
the real data ready got and these data to 50 case (see Table(1)). Three variables are loaded in the
workspace of inputs and one variable is loaded in the workspace of output, datin has 3 columns to
representing the 3 input variables and datout has 1 column representing the 1 output variable. The
number of rows in datin datout, 50, represent the number of observations or samples or datapoints
available. A row in datin constitutes a set of observed values of the 3 input variables (washing time,
temperature of water and amount of washing powder) and the corresponding row in datout represents
the observed value for the degree of cleanness of clothes generated given the observations made for the
input variables. The three inputs are:
1. Input 1(Washing Time)
Range of time from 0 to 15 and the unit is minute, but these data were treated and measured so that
becomes trapped between 0 and 1(see Fig. (10)). Washing Time represented two linguistic variables as:
Less Time (Ltime) and More Time (Mtime), (see Fig. (11)).
Figure 10: Represent real data of washing time. Figure 11: Figure (11): Represent input1
(Washing Time) using (FIS).
10. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 452
2. Input 2 (Temperature of Water)
Range of temperature 0 to 50 and the unit is ° C, but these data were treated and measured so that
becomes trapped between 0 and 1(see Fig. (12)). Temperature of water have five different degree of
linguistic variables as: Very Cold (Vcold), Cold (cold), Good (good), Hot (hot) and Very Hot (Vhot).
This variable defined below showing the membership function of powder (see Fig (13)).
Figure 12: Represent real data of Temperature of
water.
Figure 13: Represent input2 (Temperature of water).
3. Input 3 (Amount of washing powder)
Range of washing powder from 0 to 100 and the unit is gram , in this case also were measured data , so
that become trapped between 0 and 1(see Fig (14)). Washing powder also represented five linguistic
variables as: Very Less (Vless), less (less), middle (mid), more (more) and Very More (Vmore), (see
Fig (15)).
Figure 14: Represent real data of washing powder. Figure 15: Represent input3 (Washing powder).
5.1. (Part 1): Generating the Fuzzy Inference System (FIS)
We will model the relationship between the input variables and the output variable by Fuzzy Inference
System (FIS) in this part which can then be used to explore and understand cleanness patterns. It can
be used to take fuzzy or imprecise observations for inputs and yet arrive at crisp and precise values for
outputs. Also, the FIS is a simple and commonsensical way to build systems without using complex
analytical equations. The FIS will then act as a model that will reflect the relationship between inputs
and output. ‘genfis2’ is the function that creates and constructs the FIS. A FIS is composed of inputs,
outputs, rules and each input/output can have any number of MFs. The rules dictate the behavior of the
11. 453 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
fuzzy system based on inputs, outputs and MF. ‘genfis2’ constructs the FIS in an attempt to capture the
position and influence of the inputs space. ‘myfis’ is the FIS that ‘genfis2’ has generated. Since the
dataset has 3 input variables and 1 output variable, ‘genfis2’ constructs a FIS with 3 inputs and 1
output. Each inputs and output has as many MFs. As seen previously, for the current dataset 2 sets of
Time and 5 sets for temperature of water amount of washing powder. After made relation between
the inputs and output for all possibility cases became the number of rules and therefore total 51 rules
are created.
We can now probe the FIS to understand how the sets got converted internally into MFs and
rules. ’fuzzy’ also is the function that launches the graphical editor for building fuzzy systems. As can
be seen, the FIS has 3 inputs and 1 output with the inputs mapped to the outputs through a rule base
(white box in the fig.(9)).
Output (Cleanness of Clothes)
Range of cleanness of clothes from 0 to 1 and the unit is percent (see Fig (16)). Cleanness of clothes
represents five linguistic variables as: Not Clean (Nclean), Less Average (Laverage), Average
(Average), More Average (Maverage) and Full Clean (Fclean) (see Fig (17)).
Figure 16: Represent real data of washing powder. Figure 17: Represent input3 (Washing powder).
In FIS programme, we have determined:
Name '(FIS) Washing machine' for system.
Type 'mamdani'
Number of Inputs 3
Number Outputs 1
Number Rules 51
And Method 'min'
Or Method 'max'
Implementation Method 'min'
Aggregation Method 'max'
Defuzzification Method 'centroid'
Now, let's explore how the fuzzy rules are constructed. ‘ruleedit’ is the graphical fuzzy rule
editor. As we can notice, there are exactly 51 rules. Each rule attempts to map a set in the inputs space
to a set in the output space, where first rule can be explained simply as follows Fig (18). The number
‘(1)’ at the end of the rules is to indicate that the rule has standard weight or an importance of 1,
where weights can take any value between 0 and 1. The output of the rules (Cleanness of clothes) is
then used to generate the output of the FIS through the output MFs. The one output of the FIS, number
of cleanness, has 5 Non linear MFs representing the 5 linguistic variables identified by subsets. We
have used the FIS for data exploration, where we could use the FIS that has been constructed to
understand the underlying dynamics of relationship being modeled. ‘surfview’ is the surface viewer
that helps view the input/output surface of the fuzzy system. In other words, this tool simulates the
response of the fuzzy system for the entire range of inputs that the system is configured to work for.
12. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 454
Thereafter, the output or the response of the FIS to the inputs is plotted against the inputs as a surface.
This visualization is very helpful to understand how the system is going to behave for the entire range
of values in the inputs space.
Figure 18: Represent rules editor. Figure 19: Rule view to inputs with output.
In the plots below the first surface viewer shows the output surface for two inputs Time
Powder (see Fig. (20a)), second surface viewer shows the output surface for two inputs Time
Temperature (see Fig. (20b)) and third surface viewer shows the output surface for two inputs
Temperature Powder (see Fig. (20b)). As we can see the degree of output increases with increase in
Time, Temperature and Amount of powder.
Figure (19a): Surface viewer. Figure (19b): Surface viewer. Figure (19c): Surface viewer.
Rule view is the graphical simulator for simulating the FIS response for specific values of the
input variables (see Fig. (19)). This system gives a snapshot of the entire fuzzy inference process, right
from how the MFs are being satisfied in every rule to how the final output is being generated through
defuzzification. In this generated to FIS we got the result for all data by use rule view, where all result
finding in Table (1), from this table we have seen the error = |Rv –FISv| (where Rv (Real value) and
FISv (FIS value)) is very less, where (min error=0.0045) (max error=0.07).
5.2. (Part 2): Generating the Adaptive Neuro-Fuzzy Inference System (ANFIS)
The basic structure of the type of FIS that we've seen thus far is a model that maps input characteristics
to input MFs, input MF to rules, rules to a set of output characteristics, output characteristics to output
MFs, and the output MF to a single valued output or a decision associated with the output, where we
have applied this system in part1. In this part we discuss the use of the ANFIS; these tools apply Neuro-fuzzy
inference techniques to data modeling. Neuro-adaptive learning techniques provide a method for
the fuzzy modeling procedure to learn information about a data set. Then, Fuzzy Logic Toolbox
computes the MF parameters that best allow the associated FIS to track the given input/output data.
13. 455 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
The Fuzzy Logic Toolbox function that accomplishes this MF parameter adjustment is called anfis.
The anfis function can be accessed either from the command line or through the ANFIS Editor. Using a
given input/output data set, the toolbox function anfis constructs ANFIS whose MF parameters are
adjusted using either a backpropagation algorithm alone or in combination with a least squares type of
method. This adjustment allows our fuzzy systems to learn from the data they are modeling. In general,
this type of modeling works well if the training data presented to anfis for training (estimating) MF
parameters is fully representative of the features of the data that the trained FIS is intended to model.
Now, let's load training and checking data sets, where the checking data set is corrupted by
noise, into the ANFIS Editor from the workspace. In MATLAB command line to load these data sets
from the directory fuzzydemos into the MATLAB workspace. We could open the ANFIS Editor by
typing ‘anfisedit’ in the MATLAB command line. The training data, ‘trnData’, is a required argument
to anfis, as well as to the ANFIS. Each row of ‘trnData’ is a desired input/output pair of the target
system, where we want to model each row starts with input vectors and is followed by an output value.
Therefore, the number of rows of ‘trnData’ is equal to the number of training data pairs, and, because
there is only one output, the number of columns of ‘trnData’ is equal to the number of inputs plus one.
The training data appears in the plot as a set of circles blow ‘o’, but the checking data appears as pluses
superimposed ‘+’ on the training data (see Fig (21)). The checking data, ‘chkData’, is used for testing
the generalization capability of the ANFIS at each epoch. The checking data has the same format as
that of the training data, and its elements are generally distinct from those of the training data. The
checking data is important for learning tasks for which the inputs number is large, and/or operation the
data itself is noisy. ANFIS needs to track a given input/output data set well. Because the model
structure used for anfis is fixed, there is a tendency for the model to over fit the data on which is it
trained, especially for a large number of training epochs. If over fitting does occur, the ANFIS may not
respond well to other independent data sets, especially if they are corrupted by noise. This data set is
used to train a fuzzy system by adjusting the MF parameters that best model this data. The next step is
to specify an initial FIS for anfis to train. After that it would generate FIS. We used Gaussian MF
‘gaussmf’ to represent inputs FIS and we choice Sugeno-type systems of output MF because anfis only
operates on these type systems (see fig. (22)). we can implement FIS generation from the command
line using the command ‘genfis1’ (for grid partitioning). The output MFs must either be all constant or
all linear (as this work). To load an existing FIS for ANFIS initialization, in the Generate FIS portion,
select load from workspace or load from file. When we build the program FIS we should determined:
Figure 21: Rule view to inputs with output. Figure 22: The structure to Generate FIS of W.
M. using ST model.
Name'(ANFIS)Washing Machine'
Type 'sugeno' Number Inputs 3
Number Outputs 1 Number Rules 50
And Method 'prod'
Or Method 'probor'
Implication Method 'prod'
Aggregation Method 'sum'
Defuzzification Method 'wtaver'
14. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 456
After we generated the FIS, we can view the model structure, as follows Fig. (23). the branches
in this graph are color coded to indicate whether and, not, or are used in the rules. If clicking on the
nodes indicates information about the structure. To ANFIS training the two anfis parameter
optimization method options available for ANFIS training are ‘hybrid’ (the default, mixed least squares
and backpropagation) and ‘backpropa’ (backpropagation). Error Tolerance is used to create a training
stopping criterion, which is related to the error size. The training will stop after the training data error
remains within this tolerance.
Figure 23: The ANFIS model structure. Figure 24: The ANFIS editor to Train FIS.
To start the training: Leave the optimization method at hybrid or backpropa, set the number of
training Epochs to (33) and select Train Now. The following window appears on our screen (see fig.
(24)), after we performed this step, the program would find:
Number of nodes: 130
Number of linear parameters: 200
Number of nonlinear parameters: 36
Total number of parameters: 236
Number of training data pairs: 50
Number of checking data pairs: 50
Number of fuzzy rules: 50
Note:
1. At second row there are find 50 rules every rule has output and every output (f50) has 4 parameter (a1, a2, a3, b).
2. Third row there are find 3 inputs first input has 2 Mfs, second and third has 5 Mfs, every Mf has 3 parameters.
3. Fourth row there are find 50 cases.
4. Fifth row there are find 50 cases same training data but with noise.
The checking error decreases up to a certain point in the training. This application shows why
the checking data option of anfis is useful. After we have performed the program steps is got very less
error (0.0026402). The last step in this system Testing Data against the trained ANFIS, to test ANFIS
against the checking data. When we test the checking data against the ANFIS, it looks satisfactory,
where we got less Average testing error for cheking data (0.0090721) and we got less Average testing
error for Training data (2.0654e-006= 0.0053) (see Fig. (25)).
In this part we can getting the result for all data by use rule view special to this system ANFIS,
where all result finding in Table (1), from this table we have seen the Error = |Rv – ANFISv| (where Rv
(Real value) and ANFISv (ANFIS value)) is very less where (min error=0) (max error=0.0005), and
this result is better with compare to error in FIS.
15. 457 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
Figure 25: The ANFIS editor to Test FIS.
6. Conclusion
This application has attempted to convey how fuzzy system can be employed as effective techniques
for data modeling and analysis. The ANFIS apply either a backpropagation or a combination of
backpropagation and the least-squares method to estimate membership function parameters. The
training error is the difference between the training data output value and the output of the fuzzy
inference system corresponding to the same training data input value. The ANFIS editor plots the
training error versus epochs curve as the system is trained. The checking error is the difference
between the checking data output value, and the output of the fuzzy inference system corresponding to
the same checking data input value, which is the one associated with that checking data output value.
Table 1: Cleanness Training data
No. Time Temperature powder
Real
Value
Result
(FIS)
Error=
Result
(ANFIS)
Error=
1 0.1493 0.108 0.9273 0.5911 0.582 0.0091 0.591 0.0001
2 0.5995 0.8846 0.5154 0.753 0.725 0.028 0.753 0 Min
3 0.0752 0.7195 0.9848 0.8212 0.84 0.0188 0.821 0.0002
4 0.8426 0.7561 0.2094 0.5995 0.588 0.0115 0.599 0.0005 Max
5 0.7407 0.6704 0.1124 0.4893 0.517 0.0277 0.489 0.0003
6 0.9487 0.532 0.3006 0.5976 0.557 0.0406 0.598 0.0004
7 0.5048 0.3364 0.4008 0.4706 0.442 0.0286 0.471 0.0004
8 0.671 0.682 0.4254 0.6493 0.689 0.0397 0.649 0.0003
9 0.9121 0.1212 0.3149 0.4504 0.444 0.0064 0.45 0.0004
10 0.5518 0.1523 0.265 0.3419 0.377 0.0351 0.342 0.0001
11 0.2892 0.0204 0.0929 0.1325 0.128 0.0045min 0.133 0.0005
12 1 0.7937 0.465 0.7948 0.688 0.0454 0.795 0.0002
13 0.0373 1 0.2984 0.5301 0.588 0.0579 0.53 0.0001
14 0.3343 0.1276 0.3098 0.3025 0.288 0.0145 0.302 0.0005
15 0.997 0.4817 0.1067 0.4845 0.425 0.0595 0.485 0.0005
16 0.374 0.6767 0.0603 0.3691 0.326 0.0431 0.369 0.0001
17 0.3168 0.0299 0.2858 0.25 0.310 0.06 0.25 0
18 0.1239 0.7776 0.2569 0.4502 0.412 0.0382 0.45 0.0002
19 0.6983 0.5752 0.3407 0.5714 0.616 0.0446 0.571 0.0004
20 0.1788 0.4409 0.2867 0.3612 0.328 0.0332 0.361 0.0002
21 0.3403 0.2754 0.5568 0.4936 0.458 0.0356 0.494 0.0004
22 0.9196 0.7767 0.8804 0.9988 0.972 0.0268 0.999 0.0002
23 0.512 0.9258 0.5427 0.7604 0.746 0.0144 0.76 0.0004
24 0.6304 0.7507 0.9146 0.9349 0.975 0.0401 0.935 0.0001
25 0.6075 0.4193 0.4324 0.5437 0.535 0.0087 0.544 0.0003
26 0.7155 0.967 0.8428 0.9935 0.974 0.0195 0.993 0.0005
27 0.0301 0.2632 0.8092 0.5502 0.53 0.0202 0.55 0.0002
16. Fuzzy and Adaptive Neuro-Fuzzy Inference System of Washing Machine 458
Table 1: Cleanness Training data - Continued
28 0.5409 0.5494 0.9279 0.848 0.871 0.023 0.848 0
29 0.359 0.239 0.4138 0.406 0.36 0.046 0.406 0
30 0.8475 0.2759 0.2303 0.4419 0.382 0.0599 0.442 0.0001
31 0.3484 0.4377 0.2294 0.3715 0.329 0.0425 0.371 0.0005
32 0.8676 0.956 0.3755 0.769 0.699 0.07 max 0.769 0
33 0.2521 0.0707 0.5815 0.4121 0.381 0.0311 0.412 0.0001
34 0.5958 0.3085 0.4128 0.4906 0.518 0.0274 0.491 0.0004
35 0.9608 0.6096 0.2168 0.5817 0.587 0.0053 0.582 0.0003
36 0.059 0.2095 0.5256 0.3811 0.439 0.0579 0.381 0.0001
37 0.0853 0.6553 1 0.8094 0.84 0.0306 0.809 0.0004
38 0.0211 0.8227 0.4953 0.5723 0.615 0.0427 0.572 0.0003
39 0.6983 0.517 0.0702 0.4006 0.414 0.0134 0.401 0.0004
40 0.6134 0.6707 0.4159 0.6253 0.686 0.0607 0.625 0.0003
41 0.1168 0.3203 0.0352 0.163 0.129 0.034 0.163 0
42 0.8159 0.2405 0.296 0.4577 0.442 0.0157 0.458 0.0003
43 0.6331 0.6192 0.8102 0.8309 0.85 0.0191 0.831 0.0001
44 0.0719 0.6359 0.4303 0.4829 0.531 0.0481 0.483 0.0001
45 0.1091 0.9451 0.0284 0.3791 0.412 0.0329 0.379 0.0001
46 0.1394 0.8634 0.5167 0.6288 0.64 0.0112 0.629 0.0002
47 0.8083 0.9489 0.3708 0.7488 0.689 0.0598 0.749 0.0002
48 0.0947 0.5134 0.7476 0.6213 0.588 0.0333 0.621 0.0003
49 0.2437 0.2861 0.5305 0.4581 0.438 0.0201 0.458 0.0001
50 0.2496 0.6724 0.8133 0.7537 0.706 0.0477 0.754 0.0003
The ANFIS plots the checking error versus epochs curve as the system is trained. When the
checking data option is used with ANFIS, either via the command line, or using the ANFIS editor, the
checking data is applied to the model at each training epoch. The FIS membership function parameters
computed using the ANFIS editor when both training and checking data are loaded are associated with
the training epoch that has a minimum checking error. The checking data is similar enough to the
training data that the checking data error decreases as the training begins and increases at some point in
the training after the data over fitting occurs.
In fact, the main purpose is to have a comparison between FIS and ANFIS with an application
to washing machine. The output of the rules is used to generate the output of the FIS through the output
MFs. The one output of the FIS, number of cleanness, has 5 non linear MFs representing the 5
linguistic variables identified by subsets, and we could use the FIS that has been constructed to
understand the underlying dynamics of relationship being modeled. The surface viewer is very helpful
to understand how the system is going to behave for the entire range of values in the inputs space.
After generated to FIS we got the result for all data by use rule view and the result is less, where (min
error=0.0045) (max error=0.07), but the result from ANFIS very less where (min error=0) (max
error=0.0005). This result is best with compare to error in FIS. After we have performed the program
ANFIS got very less checking error (0.0026402) then the checking data option of ANFIS is useful, and
when we test data we got less Average testing error for checking data (0.0090721) and we got less
Average testing error for training data (2.0654e-006= 0.0053). This meaning the result of ANFIS is
best compare with FIS.
References
[1] E. Ardil, E. Uçar, and P. Sandhu (2009),” Software maintenance severity prediction with
soft computing approaches”. International Journal of Electrical and Electronics Engineering,
Vol. 3, pp. 312-317.
[2] L. Aik Y. Jayakumar (2008), “A Study of Neuro-fuzzy System in Approximation-based
Problems”. Matematika, V.24, No.2, pp.113–130.
17. 459 Rana Waleed Hndoosh, M. S. Saroa, and Sanjeev Kumar
[3] M. Agarwal (2011),”Fuzzy logic control of washing machines”. Department of Mechanical
Engineering Indian Institute of Technology, Kharagpur - 721302, India, pp. 1-5.
[4] S. Alavandar and M. J. Nigam (2009),”Adaptive neuro-fuzzy inference system based control
of six DOF robot manipulator”. Journal of Engineering Science and Technology Review,
Vol. 1, pp. 106–111.
[5] B. A. Cameron (1999),”Detergent considerations for consumers: Laundering in hard
water-how much extra detergent is required? ”. Journal of Extension, Vol.49, pp.46-58.
[6] Y. Chai, L. Jia, and Z. Zhang (2009),”Mamdani model based adaptive neural fuzzy
inference system and its application”. World Academy of Science, Engineering and
Technology Vol. 51, pp. 845-852.
[7] E. Dogan, L. Saltabas E. Yıldırım (2007),”Adaptive neuro-fuzzy inference system
application for estimating suspended sediment load”. International Earthquake Symposium
Kocher. Vol. 5, pp. 537-540.
[8] G. Jandaghi, R. Tehrani, D. Hosseinpour, R. Gholipour and S. Shadkam (2010), “Application
of fuzzy-neural networks in multi-ahead forecast of stock price”. African Journal of
Business Management Vol. 4(6), pp. 903-914.
[9] C. Jose, R. Neil and W. Curt (1999),” Neural and Adaptive Systems”. JOHN WILEY
SONS, INC. New York.
[10] A. Kablan (2009),”Adaptive neuro-fuzzy inference system for financial trading using
intraday seasonality observation model”. World Academy of Science, Engineering and
Technology Vol. 58, pp. 479-488.
[11] T. Kamel and M. Hassan (2009),”Adaptive neuro fuzzy inference system (ANFIS) for fault
classification in the transmission lines”. The Online Journal on Electronics and Electrical
Engineering (OJEEE), Vol. 2, No. 1, pp. 164-169.
[12] A. Kablan and W. L. Ng (2011),”Intraday high-frequency fx trading with adaptive neuro-fuzzy
inference systems”. Int. J. Financial Markets and Derivatives, Vol. 2, Nos. 1/2, pp.68–
87.
[13] V. Marza and A. Seyyedi (2008),”Estimating development time of software projects using a
neuro fuzzy approach”. World Academy of Science, Engineering and Technology , Vol. 46,
pp: 575-579.
[14] R. Milasi, M. Jamali, and C. Lucas (2010),“Intelligent washing machine: A bioinspired and
multi-objective approach “. International Journal of Control, Automation, and Systems, vol.
5, no. 4, pp. 436-443.
[15] T. M. Nazmy, H. El-Messiry and B. Al-Bokhity (2005),” Adaptive neuro-fuzzy inference
system for classification of ecg signals”. Journal of Theoretical and Applied Information
Technology, Vol. 12. No. 2, pp. 1 – 6.
[16] P. Nayak, K. Sudheer, D. Rangan K. Ramasastri (2004),” A neuro-fuzzy computing
technique for modeling hydrological time series”. Journal of Hydrology Vol. 291, pp. 52–66.
[17] D. Ruan and P. P. Wang (1997),”Intelligent Hybrid System: Fuzzy Logic, Neural Network
and Genetic Algorithm”. Kluwer Academic Publishers.
[18] A. Rameshkumar and S. Arumugam (2011), “A neuro-fuzzy integrated system for non-linear
buck and quasi-resonant buck converter”. European Journal of Scientific Research,
Vol.51 No.1, pp.66-78.
[19] S. Sivanandam and S. Deepa (2008),” Principal of Soft Computing”. Wiley India (P) Ltd.
[20] A. Samandar (2011),”A model of adaptive neural-based fuzzy inference system (ANFIS)
for prediction of friction coefficient in open channel flow”. Academic Journals Scientific
Research and Essays, Vol. 6(5), pp. 1020-1027.
[21] J. Shing and R. Jang (1993),”ANFIS: Adaptive network-based fuzzy inference system”.
IEEE Transactions on Systems, Man, and Cybernetics, Vol. 23, No. 3, pp. 665-685.
[22] M. P. Singh, M. K. Sharma and S. Kumar (2009),” Conjugate descent formulation of back
propagation error in feed forward neural network”. ORION, Vol. 25(1), pp. 69-86.