Rule-based expert systems use facts and rules to achieve expert-level competence in solving problems. They consist of a knowledge base containing facts and rules, an inference engine that manipulates the knowledge base to deduce information, and an explanation subsystem. Rule-based systems apply logical rules to the known facts to determine unknown information. Inductive logic programming learns rules by generalizing from examples to cover positive instances while avoiding negative ones.
2.1 Theoretical Basis For Data Communication
What every sophomore EE knows !!! How much data can be put on a wire? What are the limits imposed by a medium?
2.2 Transmission Media
Wires and fibers.
2.3 Wireless Transmission
Radio, microwave, infrared, unguided by a medium.
2.4 The Telephone System
The system invented 100 years ago to carry voice.
2.5 Narrowband ISDN
Mechanisms that can carry voice and data.
2.1 Theoretical Basis For Data Communication
What every sophomore EE knows !!! How much data can be put on a wire? What are the limits imposed by a medium?
2.2 Transmission Media
Wires and fibers.
2.3 Wireless Transmission
Radio, microwave, infrared, unguided by a medium.
2.4 The Telephone System
The system invented 100 years ago to carry voice.
2.5 Narrowband ISDN
Mechanisms that can carry voice and data.
It gives detail description about probability, types of probability, difference between mutually exclusive events and independent events, difference between conditional and unconditional probability and Bayes' theorem
Clustering and Classification Algorithms Ankita DubeyAnkita Dubey
Clustering is a process of partitioning a set of data (or objects) into a set of meaningful sub-classes, called clusters. Help users understand the natural grouping or structure in a data set. Used either as a stand-alone tool to get insight into data distribution or as a preprocessing step for other algorithms.
Parallel Rule Generation For Efficient Classification SystemTalha Ghaffar
Parallel Rule Generation For Efficient Classification System,
genetic algorithms,
divide and conquer approach to classification , Distributed computing to solve classification problem , heterogeneous approach to classification
Talk of Ali Mousavi "Event-Modelling An Engineering Solution for Control and Analysis of Complex Systems" at 116th regular meeting of INCOSE Russian chapter, 14-Sep-2016
2137ad - Characters that live in Merindol and are at the center of main storiesluforfor
Kurgan is a russian expatriate that is secretly in love with Sonia Contado. Henry is a british soldier that took refuge in Merindol Colony in 2137ad. He is the lover of Sonia Contado.
2137ad Merindol Colony Interiors where refugee try to build a seemengly norm...luforfor
This are the interiors of the Merindol Colony in 2137ad after the Climate Change Collapse and the Apocalipse Wars. Merindol is a small Colony in the Italian Alps where there are around 4000 humans. The Colony values mainly around meritocracy and selection by effort.
The perfect Sundabet Slot mudah menang Promo new member Animated PDF for your conversation. Discover and Share the best GIFs on Tenor
Admin Ramah Cantik Aktif 24 Jam Nonstop siap melayani pemain member Sundabet login via apk sundabet rtp daftar slot gacor daftar
The Legacy of Breton In A New Age by Master Terrance LindallBBaez1
Brave Destiny 2003 for the Future for Technocratic Surrealmageddon Destiny for Andre Breton Legacy in Agenda 21 Technocratic Great Reset for Prison Planet Earth Galactica! The Prophecy of the Surreal Blasphemous Desires from the Paradise Lost Governments!
Explore the multifaceted world of Muntadher Saleh, an Iraqi polymath renowned for his expertise in visual art, writing, design, and pharmacy. This SlideShare delves into his innovative contributions across various disciplines, showcasing his unique ability to blend traditional themes with modern aesthetics. Learn about his impactful artworks, thought-provoking literary pieces, and his vision as a Neo-Pop artist dedicated to raising awareness about Iraq's cultural heritage. Discover why Muntadher Saleh is celebrated as "The Last Polymath" and how his multidisciplinary talents continue to inspire and influence.
thGAP - BAbyss in Moderno!! Transgenic Human Germline Alternatives ProjectMarc Dusseiller Dusjagr
thGAP - Transgenic Human Germline Alternatives Project, presents an evening of input lectures, discussions and a performative workshop on artistic interventions for future scenarios of human genetic and inheritable modifications.
To begin our lecturers, Marc Dusseiller aka "dusjagr" and Rodrigo Martin Iglesias, will give an overview of their transdisciplinary practices, including the history of hackteria, a global network for sharing knowledge to involve artists in hands-on and Do-It-With-Others (DIWO) working with the lifesciences, and reflections on future scenarios from the 8-bit computer games of the 80ies to current real-world endeavous of genetically modifiying the human species.
We will then follow up with discussions and hands-on experiments on working with embryos, ovums, gametes, genetic materials from code to slime, in a creative and playful workshop setup, where all paticipant can collaborate on artistic interventions into the germline of a post-human future.
1. Page 1===
Rule-Based Expert Systems
Expert Systems
–One of the most successful applications of AI reasoning
technique using facts and rules
–“AI Programs that achieve expert-level competence in solving
problems by bringing to bear a body of knowledge [Feigenbaum,
McCorduck & Nii 1988]”
Expert systems vs. knowledge-based systems
Rule-based expert systems
–Often based on reasoning with propositional logic Horn
clauses.
2. Page 2===
Rule-Based Expert Systems (2)
Structure of Expert Systems
–Knowledge Base
• Consists of predicate-calculus
facts and rules about subject at
hand.
–Inference Engine
• Consists of all the processes that
manipulate the knowledge base to
deduce information requested by
the user.
–Explanation subsystem
• Analyzes the structure of the
reasoning performed by the system
and explains it to the user.
3. Page 3===
Rule-Based Expert Systems (3)
Knowledge acquisition subsystem
–Checks the growing knowledge base for possible
inconsistencies and incomplete information.
User interface
–Consists of some kind of natural language processing system
or graphical user interfaces with menus.
“Knowledge engineer”
–Usually a computer scientist with AI training.
–Works with an expert in the field of application in order
to represent the relevant knowledge of the expert in a
forms of that can be entered into the knowledge base.
4. Page 4===
Rule-Based Expert Systems (4)
OKREPBAL5.
PYMTINC4.
REPRATING3.
COLLATAPP2.
OKREPPYMTCOLLAT1.
sheet.)balanceexcellentanhasapplicant(TheBAL
expenses.)his/herexceedsincomesapplicant'(TheINC
rating.)creditgoodahasapplicant(TheRATING
amount.)loann thegrater tha
lysufficientiscollateralon theappraisal(TheAPP
.)reputationfinancialgoodahasapplicant(TheREP
payments.)loanthetoableisapplicant(ThePYMT
ry.)satisfactoisloanfor thecollateral(TheCOLLAT
approved.)beshouldloan(TheOK
Example: loan officer in a bank
“Decide whether or not to grant a personal loan to an individual.”
Facts
Rules
5. Page 5===
Rule-Based Expert Systems (5)
To prove OK
– The inference engine searches fro AND/OR proof tree using either
backward or forward chaining.
AND/OR proof tree
– Root node: OK
– Leaf node: facts
– The root and leaves will be connected through the rules.
Using the preceding rule in a backward-chaining
– The user’s goal, to establish OK, can be done either by proving
both BAL and REP or by proving each of COLLAT, PYMT, and REP.
– Applying the other rules, as shown, results in other sets of
nodes to be proved.
7. Page 7===
Rule-Based Expert Systems (7)
Consulting system
–Attempt to answer a user’s query by asking questions about
the truth of propositions that they might know about.
–Backward-chaining through the rule is used to get to
askable questions.
–If a user were to “volunteer” information, bottom-up,
forward chaining through the rules could be used in an
attempt to connect to the proof tree already built.
–The ability to give explanations for a conclusion
• Very important for acceptance of expert system advice.
–Proof tree
• Used to guide the explanation-generation process.
8. Page 8===
Rule-Based Expert Systems (8)
In many applications, the system has access only to
uncertain rules, and the user not be able to answer
questions with certainty.
MYCIN [Shortliffe 1976]: Diagnose bacterial infections.
(.5).a-group-cusstreptococ;(.75)pos-coag-ccusstaphyloco
isinfectionthecausingbemightwhichsmears)orcultureson
seenan those(orther thorganismthat theevidenceisThere:Then
bacterialisinfectiontheoftypeThe4)
andculture,theofstainon theseennotwereOrganisms3)
andinfection,
esoft tissuorskinseriousofevidencehavedoespatientThe2)
and,meningitisistherapyrequireswhichinfectionThe1):If
300Rule
9. Page 9===
Rule-Based Expert Systems (9)
–PROSPECTOR [Duda, Gaschnig & Hart 1979, Campbell, et al.
1982]
• Reason about ore deposits
• If there is pre-intrusive, thorough –going fault system, then
there is
(5, 0.7) a regional environment favorable for porphyry copper
deposit.
–The numbers (.75 and .5 in MYCIN, and 5, 0.7 in PROSPECTOR)
are ways to represent the certainty or strength of a rule.
–The numbers are used by these systems in computing the
certainty of conclusions.
10. Page 10===
Rule Learning
Inductive rule (归纳规则) learning
– Creates new rules about a domain, not derivable from any previous
rules.
– Ex) Neural networks
Deductive rule (演绎规则)learning
– Enhances the efficiency of a system’s performance by deducting
additional rules from previously known domain rules and facts.
– Ex) EBG (explanation-based generalization)•OK –The loan should be approved
•COLLAT– The collateral for the loan is
satisfactory
•PYMT –The applicant is able to make the loan
payment
•REP – The applicant has a good financial
reputation
•APP – The appraisal on the collateral is
sufficiently greater
than the loan amount
•RATING – The applicant has a good credit
rating
11. Page 11===
Learning Propositional Calculus Rules
Train rules from given training set
–Seek a set of rules that covers only positive instances
• Positive instance: OK = 1
• Negative instance: OK = 0
–From training set, we desire to induce rules of the form
–We can make some rules more specific by adding an atom to its
antecedent to make it cover fewer instances.
• Cover: If the antecedent of a rule has value True for an instance in
the training set, we say that the rule covers that instance.
–Adding a rule makes the system using these rules more general.
–Searching for a set of rules can be computationally difficult.
• here, we use “greedy” method which is called separate and
conquer.
OKn 21 }BALINC,RATING,APP,{where i
12. Page 12===
Separate and conquer
–First attempt to find a single rule that covers only
positive instances
• Start with a rule that covers all instances
• Gradually make it more specific by adding atoms to its
antecedent.
–Gradually add rules until the entire set of rules covers all
and only the positive instances.
–Trained rules can be simplified using pruning.
• Operations and noise-tolerant modifications help minimize the
risk of overfitting.
Learning Propositional Calculus Rules (2)
13. Page 13===
Example: loan officer in a bank
–Start with the provisional rule .
• Which cover all instances.
–Add an atom it cover fewer negative instances-working toward
covering only positive ones.
–Decide, which item should we added ?
• From by
Learning Propositional Calculus Rules (3)
OKT
}BALINC,RATING,APP,{
nnr /
.antecedenttheto
ofadditionafter theruletheofantecedentthe
bycoveredinstancepositiveofnumbertotoalthe:
.antecedenttheto
ofadditionafter theruletheofantecedent
by thecoveredinstanceofnumbertotoalthe:
n
n
14. Page 14===
Select that yielding the largest value of
.
Learning Propositional Calculus Rules (4)
r
75.04/3
5.06/3
667.06/4
5.06/3
BAL
INC
RATING
APP
r
r
r
r
OKBAL
So, we select BAL, yielding the provisional rule.
15. Page 15===
Learning Propositional Calculus Rules (4)
Rule covers the positive
instances 3,4, and 7, but also covers the
negative instance 1.
–So, select another atom to make this rule more specific.
We have already decided that the first component
in the antecedent is BAL, so we have to consider
it.
OKBAL
0.12/2
0.13/3
667.03/2
INC
RATING
APP
r
r
r
OKRATINGBAL
We select RATING because
is based on a larger sample.
RATINGr
16. Page 16===
Learning Propositional Calculus Rules
We need more rules which cover positive instance 6.
To learn the next rule, eliminate from the table all of
the positive instances already covered by the first rule.
17. Page 17===
Begin the process all over again with reduced table
–Start with the rule .
Learning Propositional Calculus Rules (5)
OKT
0.01/0
25.04/1
0.03/0
25.04/1
BAL
INC
RATING
APP
r
r
r
r APP=INC=0.25, arbitrarily select APP.
OKAPP
This rule covers negative instances 1, 8, and 9
we need another atom to the antecedent.
0.01/0
5.02/1
5.02/1
BAL
INC
RATING
r
r
r Select RATING, and we get
OKRATINGAPP
This rule covers negative example 9.
OKINCRATINGAPP –Finally we get
which covers only positive instances with first rule, so we
are finished.
19. Page 19===
Generic Separate-and-conquer
algorithm (GSCA)
1. Initialize
2. Initialize empty set of rules
3. repeat the outer loop adds rules until covers all (or most) of the
positive instances
4. Initialize
5. Initialize
6. Repeat the inner loop adds atoms to until covers only (or mainly)
positive instances
7. Select an atom to add to . This is a nondeterministic choice point
that can be used for backtracking.
8.
9. Until covers only (or mainly) positive instances in
10. We add the rule to the set of rules.
11. (the positive instances in covered by )
12. Until covers all (or most) of positive instance in
cur
T
cur
,
cur cur cur
20. Page 20===
Learning First-Order Logic Rules
Inductive logic programming (ILP)
– Concentrate on methods for inductive learning of Horn clauses in
first order predicate calculus (FOPC) and thus PROLOG program.
– FOIL [Quinlan, 1990]
The Objective of ILP
– To learn a program, ,consisting of Horn clauses, ,each of
which is of the form where, the
are atomic formulas that unify with ground atomic facts.
• : should evaluate to True when its variables are bound to
some set of values known to be in the relation we are trying to
learn (positive instance: training set).
• : should evaluate to False when its variables are bound
to some set of values known not to be in the relation (negative
instance).
i ,,,: 21 i
21. Page 21===
We want to cover the positives instances and not
cover negative ones.
Background knowledge
–The ground atomic facts with which the are to unify.
–They are given-as either subsidiary PROLOG programs, which
can be run and evaluated, or explicitly in the form of a list
of facts.
Example: A delivery robot navigating around in a
building finds through experience, that it is easy
to go between certain pairs of locations and not so
easy to go between certain other pairs.
Learning First-Order Logic Rules (2)
22. Page 22===
A, B, C: junctions
All of the other locations:
shops
Junction(x)
–Whether junction or not.
Shop(x,y)
–Whether shop or not which is
connected to junction x.
Learning First-Order Logic Rules (3)
23. Page 23===
Learning First-Order Logic Rules (4)
}CC2,,CC1,,C2C,,C1C,,BB2,,B1B,
,B2B,,B1B,,AA2,,AA1,,A2A,,A1A,
,BC,,AC,,AB,,CB,,CA,,BA,{
Ξ:EasyofinstancesPositive
}CB2,,CB1,,CA2,,CA1,,BA2,,BA1,
,BC2,,BC1,,AC2,,AC1,,AB2,,AB1,
,B2C,,B1C,,A2C,,A1C,,A2B,,A1B,
,C2B,,C1B,,C2A,,C1A,,B2A,,B1A,{
Ξ:EasyofinstancesNegative
We want a learning program to learn a program, Easy(x,y) that
covers the positive instances in but not the negative ones.
Easy(x,y) can use the background subexpressions Junction(x)
and Shop(x,y).
Training set
24. Page 24===
–For all of the locations named in , only the following
pairs give a value True for Shop:
–The following PROLOG program covers all of the positive
instances of the training set and none of the negative ones
Easy(x, y) :- Junction(x), Junction(y)
:- Shop(x, y)
:- Shop(y, x)
Learning First-Order Logic Rules (5)
}CC2,,CC1,,BB2,,BB1,,AA2,,AA1,{
25. Page 25===
Learning process: generalized separate and conquer
algorithm (GSCA)
–Start with a program having a single rule with no body
–Add literals to the body until the rule covers only (or
mainly) positive instances
–Add rules in the same way until the program covers all (or
most) and only (with few exceptions) positive instances.
Learning First-Order Logic Rules (6)
26. Page 26===
–Practical ILP systems restrict the literals in various ways.
–Typical allowed additions are
• Literals used in the background knowledge
• Literals whose arguments are a subset of those in the head of the
clause.
• Literals that introduce a new distinct variable different from those
in the head of the clause.
• A literal that equates a variable in the head of the clause with
another such variable or with a term mentioned in the background
knowledge.
• A literal that is the same (except for its arguments) as that in the
head of the clause.
Learning First-Order Logic Rules (7)
27. Page 27===
Learning First-Order Logic Rules (8)
The literals that we might consider adding to a clause are
ILP version of GSCA
– First, initialize first clause as Easy(x, y) :-
– Add Junction(x), so Easy(x, y) :- Junction(x) covers the following
instances
– Include more literal ‘Junction(y)’ Easy(x, y) :- Junction(x),
Junction(y)
Junction(x), Junction(y), Junction(z)
Shop(x,y), Shop(y,x), Shop(x,z)
Shop(z,y), (x=y)
}C2C,,C1C,,B2B,,B1B,,A2A,,A1A,
,BC,,AC,,AB,,CB,,CA,,BA,{
}C2B,,C1B,,A2B,,A1B,,B2C,,B1C,
,A2C,,A1C,,C2A,,C1A,,B2A,,B1A,{
Positive instances
Negative instances
}BC,,AC,,AB,,CB,,CA,,BA,{
28. Page 28===
–But program does not cover the following positive instances.
–Remove the positive instance covered by Easy(x,y):-Junction(x),
Junction(y) from to form the to be used in next
pass through inner loop.
• : all negative instance in + the positive instance that
are not covered yet.
–Inner loop create another initial clause “Easy(x,y) :-”
• Add literal Shop(x,y) : Easy(x,y) :- Shop(x,y) cover no negative
instances, so we are finished with another pass through inner loop.
• Covered positive instance by this rule ( remove this from )
Learning First-Order Logic Rules (9)
}CC2,,CC1,,C2C,,C1C,,BB2,,BB1,
,B2B,,B1B,,AA2,,AA1,,A2A,,A1A,{
CUR
CUR
}CC2,,CC1,,BB2,,BB1,,AA2,,AA1,{
CUR
29. Page 29===
–Now we have Easy(x,y) :- Junction(x), Junction(y)
:- Shop(x, y)
–To cover following instance
–Add Shop(y, x)
–Then we have Easy(x,y) :- Junction(x), Junction(y)
:- Shop(x, y)
:- Shop(y, x)
–This cover only positive instances.
Learning First-Order Logic Rules (10)
}C2C,,C1C,,B2B,,B1B,,A2A,,A1A,{
30. Page 30===
Explanation-Based Generalization (1)
Example: “Block world”
–General knowledge of the “Block world”.
• Rules
• Fact
• We want to proof
“ ”
• Proof is very simple
31. Page 31===
Explanation-Based Generalization (2)
Explanation: Set of facts used in the proof
–Ex) explanation for “ ” is “
”
–From this explanation, we can make “
”
• Replacing constant ‘A’ by variable ‘x’, then, we have “Green(x)”
• Then we can proof “ ”, as like the case of “
”
• Explanation Based Generalization
Explanation-based generalization (EBG): Generalizing the
explanation by replacing constant by variable
–More rules might slow down the reasoning process, so EBG must be
used with care-possibly by keeping information about the utility
of the learned rules.