Agenda• Introduction of softcomputing• Course outline• Recap of neural networks The student already familiar with neural network may leave after the introduction of softcomputing
Introduction (1/3)What is Softcomputing ?• The idea of softcomputing was initiated in 1981 when Lofti A.Zadeh published his first paper on soft data analysis “what is softcomputing”, softcomputing. Springer-Verlag Germany/ USA, 1997.• Zedeh, define softcomputing into one multidisciplinary system as the fusion of the fields of Fuzzy Logic, Neuro-computing, Evolutionary computing and Probabilistic Computing.• An essential aspect of soft computing is that its constituent methodologies are, for the most part, complementary and symbiotic rather than competitive and exclusive.• Softcomputing breakdown SC = EC + NC + FL + PCSoftcomputing Evolutionary Neural Fuzzy Logic Probabilistic
Introduction (2/3)What is meant by fusion or hybridization ?• Hybridization create a situation where different entities cooperate advantageously for final outcome• For example, EC can be employed in the design of fuzzy-logic-based systems to improve or optimize their performance. In the reverse direction, the machinery of fuzzy logic can be employed to improve the performance of genetic algorithms.
Introduction (3/3)• Currently, the most visible systems of this hybrid type are Neuro-Fuzzy (NF) systems, Fuzzy-Genetic (FG) systems, Neural-Genetic (NG) systems, Fuzzy-Neural-Genetic (FNG) systems, Fuzzy-Probablistic (FP) systems. Other combinations are also possible.• So we are not concerned with EC, FL and NN in isolation (as in AI, ML) but hybridization is the prime concern here.
Primary Role of Individual Constituents in the Hybridization (1/2)The core of SC consist of several paradigms mainly: neural computing, evolutionary computing, probabilistic computing and fuzzy systems.• Neural computing: the importance of neurocomputing derives in large measure from the fact that NC provides effective algorithms for the purpose of system identification, classification, learning and adaptation.• Evolutionary computing: The primary contribution of evolutionary computing is a machinery for systematic random search. Such search is usually directed at finding an optimum solution to a problem. Genetic algorithms and modes of genetic computing, e.g., genetic programming, may be viewed as special cases of evolutionary computing.
Primary Role of Individual Constituents in the Hybridization (2/2)• Probabilistic computing: the primary contribution of probabilistic computing is the machinery of probability theory and the subsidiary techniques for decision-making under uncertainty.• Fuzzy logic: the primary contribution of fuzzy logic is the machinery of knowledge representation via fuzzy if-then rules and to perform logic inference like FOL with the ability to handle uncertainty and imprecision.
Hard Computing (Classical Soft ComputingArtificial Intelligence) Soft (Computational Intelligence) Hard Vs ComputingPrime desiderata is precision and certainty. It is Exploit tolerance for imprecision andtraditional AI which is based on two principles: uncertainty. The aim is to model thefirstly, represent knowledge in symbolic form remarkable abilities of human mind which(i.e. Letters, words, phrases, signs). Secondly, characteristically exploit the tolerance forsearch the solution with the aid of symbolic imprecision and uncertainty to e.g. understandlogic (e.g. FOL). Despite success of AI for the distorted speech, sloppy handwritten,developing numerous applications (e.g. Expert expressions in natural language and drive asystems, natural language understanding, vehicle in dense traffic, etctheorem proving). It is enable to deal withadvance requirement such as speechrecognition, hardwritten recognition,computer vision, machine translation, learningwith experienceRequire programs to be written Can evolve its own programsDeterministic StochasticRequire exact input Can deal with ambiguous and noisy dataProduce precise answer Produce approximate answers Table: Listed in the table are some differences between hard and soft computing. The list is not exhaustive.
Structure of Soft Computing Computing Methodologies Computing Methodologies Computing Methodologies Fuzzy Systems Neural Computing Soft Computing: Hybrid Systems or Fused SystemProbabilistic Computing Evolutionary Computing
DefinitionLofti A. Zedah, 1992: “softcomputing is an emergingapproach to computing which parallel theremarkable ability of human mind to reason andlearn in the environment of uncertainly andimprecision”
Course Outline (1/2)• Introduction Definition, goals and importance; recap: fuzzy computing, neural computing, genetic algorithm• Fuzzy computing Fuzzy computing: Classical set theory, crisp and non-crisp set, capturing certainty, definition of fuzzy set; graphic interpretations• Neural Computing Biological model, artificial neuron, architectures, learning methods, Taxonomy of NN systems, single and multilayer perceptrons, applications• Evolutionary Computing Genetic algorithms, taxonomy of optimization and evolution techniques: guided random search techniques, calculus-based techniques, genetic algorithms, evolutionary algorithms
Course Outline (2/2)• Associative Memory Description of AM, Examples of Auto and Hetro AM• Adaptive Resonance Theory Recap: supervised and unsupervised learning, back propagation; competitive learning, stability and plasticity dilemma, ART networks, Iterative clustering, Unsupervised ART clustering• Hybrid systems Integration of neural network, fuzzy logic and genetic algorithms, GA based back propagation network, fuzzy back propagation network, fuzzy associative memories
References• Zadeh L. A. Soft Computing and Fuzzy Logic. IEEE Software 11 (6): 48- 58, 1998.• Lofti A.Zadeh. what is softcomputing”, softcomputing. Springer-Verlag Germany/ USA, 1997.• Rajasekaran S., G. A Vijayalaksmi Pai. Neural Network, Fuzzy Logic, and Genetic Algorithms, Prentice Hall, 2005.• K. Naresh, Sinha, M. Gupta. Soft Computing and Intelligent Systems – Theory and Applications, Academic Press, 2000.• Fahreddine Karray. Soft Computing and Intelligent System Design – Theory, Tools and Applications, Addison Weslay, 2004.• Tettamanzi, Andrea, Tomassine. Soft Computing: Integrating Evolutionary, Neural and Fuzzy Systems, Springer, 2001.• J. S. R Jang, C. T. Sun. Neuro-Fuzzy and SoftComputing: A Computational Approach to Learning and Machine Intelligance, Prentice Hall, 1996.