11 Fuzzy Rule-Based Models - UNICAMPgomide/courses/IA861/transp/FSE_Chap11.… · 11 Fuzzy...

11 Fuzzy Rule-BasedModels

Fuzzy Systems EngineeringToward Human-Centric Computing

11.1 Fuzzy rules as a vehicle of knowledge representation

11.2 General categories of fuzzy rules and their semantics

11.3 Syntax of fuzzy rules

11.4 Basic functional modules

11.5 Types of rule-based systems and architectures

11.6 Approximation properties of fuzzy rule-based models

11.7 Development of rule-based systems

Contents

Pedrycz and Gomide, FSE 2007

11.8 Parameter estimation procedure for functionalrule-based systems

11.9 Design of rule-based systems: consistency,completeness and the curse of dimensionality

11.10 Course of dimensionality in rule-based systems

11.11 Development scheme of fuzzy rule-based models

11.1 Fuzzy rules as a vehicle ofknowledge representation

Rule ≡ conditional statement

• If ⟨ input variable is A ⟩ then ⟨ output variable is B ⟩

– A and B: descriptors of pieces of knowledge

– rule: expresses a relationship between inputs and outputs

• Example

– If ⟨ the temperature is high ⟩ then ⟨ the electricity demand is high ⟩

• If and then parts ⟨.......⟩ formed by information granules

– sets– rough sets– fuzzy sets

Rule-based system/model (FRBS)

• FRBS is a family of rules of the form

If ⟨ input variable is Ai ⟩ then ⟨ output variable is Bi ⟩

i = 1, 2,..., c

Ai and Bi are information granules

• More complex rules

If ⟨ input variable1 is Ai ⟩ and ⟨ input variable2 is Bi ⟩ and ..... then ⟨ output variable is Zi ⟩

– multidimensional input space (Cartesian product of inputs)– individual inputs aggregated by the and connective– highly parallel, modular granular model

11.2 General categories of fuzzyrules and their semantics

Multi-input multi-output fuzzy rules

• If X1 is A1 and X2 is A2 and ..... and Xn is An

then Y1 is B1 and Y2 is B2 and ..... and Ym is Bm

Xi = variables whose values are fuzzy sets Ai

Yj = variables whose values are fuzzy sets Bj

Ai on Xi, i = 1, 2,...,n

Bj on Yj, j = 1, 2,...,m

• No loss of generality if we assume rules of the form

If X is A and Y is B then Z is C

Certainty-qualified rules

• If X is A and Y is B then Z is C with certaintyµ

µ ∈[0,1]

µ : degree of certainty of the rule

µ = 1 rule is certain

Gradual rules

• the more X is A the more Y is B

– relationships between changes in X and Y

– captures tendency between information granules

• Examples:

the higherthe income, the higherthe taxes

the lower the temperature, the higherenergy consumption

Functional fuzzy rules

• If X is Ai then y = f (x,ai)

f : X → Y

x∈Rn

• Rule: confines the function to the support of granule Ai

f : linear or nonlinear (neural nets, etc..)

• Highly modular models

11.3 Syntax of fuzzy rules

Backus-Naur form (BNF)

⟨ If_then_rule⟩ ::= if ⟨antecedent⟩ then⟨consequent⟩{ ⟨certainty⟩}⟨gradual_rule ⟩ ::= ⟨word⟩ ⟨antecedent⟩⟨word⟩ ⟨consequent⟩

⟨word⟩ ::= ⟨more⟩ { ⟨less⟩}⟨antecedent⟩ ::= ⟨expression⟩⟨consequent⟩ ::= ⟨expression⟩⟨expression⟩ ::= ⟨disjunction⟩{and ⟨disjunction⟩}⟨disjunction⟩ ::= ⟨variable⟩{or⟨variable⟩}

⟨variable⟩ ::= ⟨attribute⟩ is ⟨value⟩⟨certainty⟩ ::= ⟨none⟩{certainty µ∈[0,1]}

Construction of computable representations

Main steps:

1. specification of the fuzzy variables to be used

2. association of the fuzzy variables using fuzzy sets

3. computational formalization of each rule using fuzzyrelations and definition of aggregation operator to combinerules together

11.4 Basic functionalmodules of FRBS

ace Rule Base

Data Base

Fuzzy Inference O

General architecture of FRBS

Fuzzy if-then rules(input-output relationship)

Parametersof the FRBS

Process inputs and rules(approximate reasoning)

Input interface

• (attribute) of (input) is (value)

the temperature of the motor is high

• Canonical (atomic) form

p: X is A temperature (motor) is highX A

fuzzy set

Low Medium High

x (°C)Pedrycz and Gomide, FSE 2007

Multiple fuzzy inputs: conjunctive canonical form

p : X1 is A1 and X2 is A2 and..... and Xn is An conjunctive canonical form

Xi are fuzzy (linguistic) variables

Ai : fuzzy sets on Xi

i = 1, 2, ..., n

Compound proposition induces a fuzzy relation P on X1×X1×... Xn

)()()()()(1

221121 ii

innn xATxtAtxtAxAx,,x,xP

=== KK

p : (X1, X2 , ....., Xn) is P

t (T) = t-norm

0 5 100

(b) Contours of P

Example

• Fuzzy relation associated with (X,Y) is P

• Triangular fuzzy sets A1(x,4,5,6) = A, A2(y,8,10,12) = B

• t-norm: algebraic product

q : X1 is A1 or X2 is A2 or ..... or Xn is An disjunctive canonical form

Xi are fuzzy (linguistic) variables

Ai : fuzzy sets on Xi

i = 1, 2, ..., n

Compound proposition induces a fuzzy relation Q on X1×X1×... Xn

)()()()()(1

221121 ii

innn xASxsAsxsAxAx,,x,xQ

=== KK

q : (X1, X2 , ....., Xn) is Q

s (S) = t-conorm

Multiple fuzzy inputs: disjunctive canonical form

Example

• Fuzzy relation associated with (X,Y) is Q

•Triangular fuzzy sets A1(x,4,5,6) = A, A2(y,8,10,12) = B

• t-conorm: probabilistic sum

0 5 100

(d) Contours of Q

Rule base

• Fuzzy rule: If X is A then Y is B ≡ relationship between X and Y

• Semantics of the rule is given by a fuzzy relation R on X×Y

• R determined by a relational assignment

R(x,y) = f (A(x),B(y)) ∀(x, y)∈X×Y

f : [0,1]2 → [0,1]

• In general f can be

– fuzzy conjunction: ft– fuzzy disjunction: fs– fuzzy implication: fi

Choose a t-norm t and define:

R(x,y) ≡ ft (x,y) = A(x) t B(y) ∀(x,y) ∈ X×Y

Examples:

• t = min

Rc(x,y) ≡ fc (x,y) = min[A(x) t B(y)] (Mamdani)

• t = algebraic product

Rp(x,y) ≡ fp (x,y) = A(x)B(y) (Larsen)

Fuzzy conjunction

Rc(x,y) = min {A(x), B(y)}

∀ (A(x), B(y))∈[0,1]2

Rc(x,y) = min {A(x), B(y)}A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

Example: t = min

Rp(x,y) =A(x)B(y)

∀ (A(x), B(y))∈[0,1]2

Rp(x,y) = A(x)B(y)A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

Example: t = algebraic product

Choose a t-conorm s and define:

Rs(x,y) ≡ fs(x,y) = A(x) s B(y) ∀(x,y) ∈ X×Y

Examples:

• s = max

Rm(x,y) ≡ fm (x,y) = max[A(x) t B(y)]

• s = Lukasiewicz t-conorm

Rl (x,y) ≡ fl (x,y) = min[1, A(x) + B(y)]

Fuzzy disjunction

Example: s = max

Rl (x,y) = max{A(x), B(y)}

∀ (A(x), B(y))∈[0,1]2

Rl (x,y) = max {A(x), B(y)}A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

Example: s = Lukasiewicz

Rc(x,y) = min{1, A(x)+B(y)}

∀ (A(x), B(y))∈[0,1]2

Rc(x,y) = min{1, A(x)+B(y)}A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

Fuzzy implication

• Choose a fuzzy implication fi and define:

Ri(x,y) ≡ fi (x,y) ∀(x,y) ∈ X×Y

• fi : [0,1]2 → [0,1] is a fuzzy implication if:

1. B(y1) ≤ B(y2) ⇒ fi (A(x), B(y1)) ≤ fi (A(x), B(y2)) monotonicity 2nd argument

2. fi (0, B(y)) = 1 dominance of falsity

3. fi (1, B(y)) = B(y) neutrality of truth

• Further requirements may include:

4. A(x1) ≤ A(x2) ⇒ fi (A(x1), B(y)) ≥ fi (A(x2), B(y)) monotonicity 1st argument

5. fi (A(x1), fi (A(x2), B(y)) = fi (A(x2), fi (A(x1), B(y)) exchange

6. fi (A(x), A(x)) = 1 identity

7. fi (A(x), B(y)) = 1 ⇔ A(x) ≤ B(y) boundary condition

8. fi is a continuous function continuity

λ++λ+−=λ )(1

)()1()(11min))()((

yBxA,yB,xAf

]))()(1(1[min))()(( 1 w/www yBxA,yB,xAf +−=

=otherwise0

)()(if1))()((

yBxAyB,xAfa

=otherwise)(

)()(if1))()((

yBxAyB,xAfg

= otherwise)(

)()()(if1

))()((xA

yByBxA

yB,xAfe

)]()(1[max))()(( yB,xAyB,xAfb −=

Name Definition Comment

Lukasiewicz fl(A(x), B(y)) = min [1, 1 − A(x) + B(y)]

Pseudo-Lukasiewicz λ > -1

Pseudo-Lukasiewicz w > 0

Gaines

Gödel

Goguen

Kleene

Reichenbach

Klir-Yuan

)]()()(1))()(( yBxAxAyB,xAfr +−=

))]()((min)(1[max))()(( yB,xA,xAyB,xAfz −=

)()()(1))()(( 2 yBxAxAyB,xAfk +−=

Examples of fuzzy implications

Example: fl = Lukasiewicz

Rl (x,y) = min{1, 1–A(x)+B(y)}

∀ (A(x), B(y))∈[0,1]2

Rl (x,y) = min{1, 1–A(x)+B(y)}A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

Example: fk = Klir–Yuan

Rk (x,y) = 1–A(x)+A(x)2B(y)

∀ (A(x), B(y))∈[0,1]2

Rk (x,y) = 1–A(x)+A(x)2B(y)A(x) = A(x,4,5,6)B(y) = B(y,4,5,6)

• Categories of fuzzy implications:

1. s-implications

zLukasiewic)}()(11min{))(),((

Kleene)]()(1max[))(),((

)()()())(),((

yBxA,yBxAf

yB,xAyBxAf

y,xysBxAyBxAf

×∈∀= YX

2. r-implications

Gödel)()()(

)()(if1))(),((

)()]()(|]10[sup[))(),((

×∈∀≤∈=

yBxAyB

yBxAyBxAf

y,xyBctxA,cyBxAf

Semantics of gradual rules

1.0 1.0

the more X is A, the moreY is B ⇒ B(y) ≥ A(x) ∀x∈X and ∀y∈Y

BRd= { y∈Y |B(y) ≥ A(x)} for each x∈X

Example: Rd = fa = Gaines

=otherwise0

)()(if1),(

xAyByxRd

Rd(x,y)∀ (A(x), B(y))∈[0,1]2

Rd (x,y)A(x) = A(x,3,5,7)B(y) = B(y,3,5,7)

0.40.6

(a) Gradual rule Rd = fa

Main types of rule bases

• Fuzzy rule base ≡ { R1, R2,....,RN} ≡ finite family of fuzzy rules

• Fuzzy rule base can assume various formats:

1. fuzzy graph

Ri: If X is Ai then Y is Bi is a fuzzy granule in X×Y, i = 1,...,N

2. fuzzy implication rule base

Ri: If X is Ai then Y is Bi is fuzzy implication, i = 1,...,N

3. functional fuzzy rule base

Ri: If X is Ai then y = fi(x) is a functional fuzzy rule, i = 1,...,N

Fuzzy graph

• Fuzzy rule base R ≡ collection of rules R1, R2,....,RN

• Each fuzzy rule Ri is a fuzzy granule (point)

• Fuzzy graph ≡ R is a collection of fuzzy granules

• granular approximation of a function

• R= R1 or R2 or....or RN

• general form

ii BARR ×==

)]()([),(1

ytBxASyxR ii

0 2 4 6 8 100

Point P in X×YP = A×B

A is a singleton in XB is a singleton in Y

Granule

0 2 4 6 8 100

Granule G in X×YG = A×B

A is an interval in XB is an interval in Y

Fuzzy granules ≡ fuzzy points

0 5 100

(b) Fuzzy granule R

0 2 4 6 8 100

fuzzy granule R in X×YR = A×B

A is a fuzzy set on XB is a fuzzy set on Y

0 1 2 3 4 5 6 7 8 9 100

(b) Fuzzy granules Ri

0 2 4 6 8 100

A1 A2 A3 A4 A5

Fuzzy rule base as a set fuzzy granules

Ri = Ai×Bi

0 2 4 6 8 10 120

(a) function y = f(x)

1 2 3 4 5 6 7 8 9 10 11 12

(b)Granular approximation of y = f(x)

R5 R6R7

Graph of a function f and its granular approximation R

Ri = Ai×Bi

0 1 2 3 4 5 6 7 8 9 100

(b)Fuzzy rule base as a fuzzy graph (t = min)

R = Union Ri

Fuzzy rule base and fuzzy graph

Example 1

Ri = Ai×Bi ⇒ Ri(x,y) = min [Ai(x), Bi(y)]

R = ∪ Ri ⇒ R(x,y) = max [Ri(x,y), i = 1,..., N ]

Fuzzy rule base and fuzzy graph

Example 2

Ri = Ai t Bi ⇒ Ri(x,y) = Ai(x) Bi(y)

R = ∪ Ri ⇒ R(x,y) = max [Ri(x,y), i = 1,..., N ]

0 1 2 3 4 5 6 7 8 9 100

(d) Fuzzy rule base as a fuzzy graph (t = product)

R = Union Ri

Fuzzy implication

• Fuzzy rule base R ≡ collection of rules R1, R2,....,RN

• Each fuzzy rule Ri is a fuzzy implication

• Fuzzy rule base R is a collection of fuzzy relations

• relation R is obtained using intersection

• R= R1 and R2 and....and RN

• general form

ii BAfRR III

===⇒===

))()((1

yB,xAfTR iii

Fuzzy rule as an implication

0 2 4 6 8 100

(b) Lukasiewicz implication R

0 2 4 6 8 100

fuzzy rule R in X×YR = fl (A,B)Lukasiewicz implication

Fuzzy rule base and fuzzy implication

Example 1a

Ri = fl (A,B)⇒ Ri(x,y) = min [1, 1 –Ai(x) + Bi(y)] Lukasiewicz implication

R = ∩ Ri ⇒ R(x,y) = min [Ri(x,y), i = 1,..., 5] min t-norm

0 1 2 3 4 5 6 7 8 9 100

(b) Fuzzy rule base as Lukasiewicz implication (t = min)

Example 1b

Ri = fl (A,B)⇒ Ri(x,y) = min [1, 1 –Ai(x) + Bi(y)] Lukasiewicz implication

R = ∩ Ri ⇒ R(x,y) = R1(x,y) tl R2(x,y) tl .... tl Ri(x,y) Lukasiewicz t-norm

0 1 2 3 4 5 6 7 8 9 100

(b) Fuzzy rule base as Lukasiewicz implication (t = min)

Example 2a

Ri = fz(A,B)⇒ Ri(x,y) = max [1 –Ai(x), min(Ai(x), Bi(y)] Zadeh implicationR = ∩ Ri ⇒ R(x,y) = min [Ri(x,y), i = 1,..., 5] min t-norm

0 1 2 3 4 5 6 7 8 9 100

(b) Fuzzy rule base as Zadeh implication (t = min)

Example 2b

Ri = fz(A,B)⇒ Ri(x,y) = max [1 –Ai(x), min(Ai(x), Bi(y)] Zadeh implicationR = ∩ Ri ⇒ R(x,y) = R1(x,y) tl R2(x,y) tl .... tl Ri(x,y) Lukasiewicz t-norm

0 1 2 3 4 5 6 7 8 9 100

(d) Fuzzy rule base as Zadeh implication (t = Lukasiewicz)

Data base

• Data base contains definitions of:– universes– scaling functions of input and output variables– granulation of the universes membership functions

• Granulation– granular constructs in the form of fuzzy points– granules along different regions of the universes

• Construction of membership functions– expert knowledge– learning from data

Granulation

granular constructs inthe form of fuzzy points

granules along differentregions of the universes

Fuzzy inference

• Basic idea of inference

0 2 4 6 8 10 120

x = a y = f (x) y = b

b = ProjY (ac ∩ f )

b = ProjY ( I )

Inference involves operations with sets

x = A y = f (x) B = f (A) ={ f (x), x∈A}

B = ProjY (Ac ∩ f )

B = ProjY ( I ) 0 2 4 6 8 10 12

Inference involving sets and relations

x is A(x,y) is Ry is B

B = ProjY (Ac ∩ R )

B = ProjY ( I )

0 2 4 6 8 10 120

Fuzzy inference ands operations with fuzzy sets and relations

X is A (fuzzy set on X)(X,Y) is R (fuzzy relation on X×Y)Y is B (fuzzy set on Y)

B = ProjY (Ac ∩ R )

B = ProjY ( I )

2 4 6 8 10 12

)}()({sup)( y,xtRxAyBx X∈

Fuzzy inference

• Compositional rule of inference

X is A (X,Y) is RY is B

X is A(X,Y) is RY is AoR

RAB o=

procedure FUZZY-INFERENCE (A, R) returns a fuzzy setinput : fuzzy relation: R

fuzzy set: Alocal: x, y: elements of X and Y

t: t-norm

for all x and y doAc(x,y) ← A(x)

for all x and y doI(x,y) ← Ac(x,y) t R(x,y)

B(y) ← supx I(x,y) return B

Fuzzy inference procedure

Example: compositional rule of inference

Example: fuzzy inference with fuzzy graph

11.5 Types of rule-basedsystems and architectures

Linguistic fuzzy models

P: X is A and Y is B input

R1: If X is A1 and Y is B1 then Z is C1

......................Ri: If X is Ai and Y is Bi then Z is Ci rule base

.......................RN: If X is AN and Y is BN then Z is CN

Z: Z is C output

• all fuzzy sets A, B, Ai,s and Bi,sare given• rule and connectives (and, or) with known semantics• membership function of fuzzy set C = ??

min-max fuzzy models

Assume

P: X is A and Y is B P(x,y) = min{A(x), B(y)}

Ri: If X is Ai and Y is Bi then Z is Ci Ri(x,y,z) = min{Ai(x), Bi(y), Ci(z)}

i = 1,..., N

)]}1),(max(),({min[sup)(

,...,Niz,y,xRy,xPzC

===Uoo

Using the compositional rule of inference (t = min)

rulethiofactivationofdegreetheis

}1),(max{}1)max{()(

)Poss()]()([sup

)]}()()()()({sup)]}(),({min[sup)(

=∧==∧=

∧∧=′

∧∧∧∧==′

′=======

iiiy,x

N,,izCλN,,i,CnmzC

zCnmzC

nB,ByByB

mA,AxAxA

zCyBxAyBxAz,y,xRy,xPzC

CRPRPRPC

ooo UUU

procedure MIN-MAX-MODEL ( A,B) returns a fuzzy setlocal: fuzzy sets: Ai, Bi, Ci, i =1,.., N

activation degrees: λi

Initialization C = ∅

for i = 1: N domi = max (min (A, Ai))ni = max (min (B, Bi))λi = min (mi, ni)if λi ≠ 0 then Ci

’ = min (λi , Ci) and C = max(C, Ci’)

return C

min-max fuzzy model processing

Example: min-max fuzzy model processing

Ai Aj Bi Bj A B

Ci Cj 1 1 1

min-max fuzzy model architecture

Poss λ1 Min

A1,B1 C1

Poss λi Min

Ai,Bi Ci

Poss λN Min

AN,BN CN

C (A,B)

Special case: numeric inputs

=otherwise0

otherwise0

if1)( oo yy

yBandxx

Numeric output

dzzzCz

valuesmodalaverageweighted

ationdefuzzificcentroid)(

∫∫

Example

P: X is xo and Y is yo inputs (xo, yo), ∀xo, yo ∈[-2, 2]

R1: If X is A1 and Y is B1 then Z is C1rules

N = 2, centroid defuzzification

-2 -1.5 -1 -0.5 0 0.5 1 1.5 20

(a) Input and output fuzzy sets

-2 -1.5 -1 -0.5 0 0.5 1 1.5 20

(b) Input-output mapping

min-sum fuzzy models

Assume

P: X is A and Y is B P(x,y) = min{A(x), B(y)}

Ri: If X is Ai and Y is Bi then Z is Ci Ri(x,y,z) = min{Ai(x), Bi(y), Ci(z)}

i = 1,..., N

∧∧∧∧=′

iiiy,x

zCyBxAyBxAzC

)]()()()()([sup)(

Using the compositional rule of inference (t = min)

Additive fuzzy models(Kosko, 1992)

Example: min-sum fuzzy model processing

A i A j Bi Bj A B

Ci Cj 1 1 1

’ Cj’

∑Ci’

min-sum fuzzy model architecture

Poss λ1 Min

A1,B1 C1

Poss λi Min

Ai,Bi Ci

Poss λN Min

AN,BN CN

C (A,B)

Example

P: X is xo and Y is yo inputs (xo, yo), ∀xo, yo ∈[-2, 2]

R1: If X is A1 and Y is B1 then Z is C1rules

N = 2 w1 = w2 = 1, centroid defuzzification

-2 -1.5 -1 -0.5 0 0.5 1 1.5 20

(a) Input and output fuzzy sets

-2 -1.5 -1 -0.5 0 0.5 1 1.5 20

(b) Input-output mapping

product-sum fuzzy models

1- Product–probabilistic sum

zCnmzC

2- Product–sum

zCnmzC

(b) Input-output mapping of product-probabilistic sum model

(d) Input-output mapping of product-sum model

3 - Bounded product-bounded sum

}1min{

}10max{

zCnmzC

−+=⊗

′⊕=

⊗⊗=′

(c) Input-output mapping of bounded product-bounded sum model

Functional fuzzy models

P: X is x and Y is y input

R1: If X is A1 and Y is B1 then z= f1 (x,y)......................

Ri: If X is Ai and Y is Bi then z = fi (x,y) rule base.......................

RN: If X is AN and Y is BN then z= fN (x,y)

λi(x,y) = Ai(x) t Bi(y) t = t-norm degree of activation

output∑

λw,y,xfy,xwz

Functional fuzzy model architecture

⊗ w1

f1(x,y)

z (x,y)

f2(x,y)

fN(x,y)

Example 1

P: X is x inputs x ∈ [0, 3]

R1: If X is A1 then z= xrules

R2: If X is A2 then z= – x + 3

0 0.5 1 1.5 2 2.5 30

(a) Antecedent fuzzy sets

0 0.5 1 1.5 2 2.5 30

(b) Consequent functions

∈+−∈+−+∈

=)32[if3

]21[if)3)(()(

]10(if

,xxxAxxA

0 0.5 1 1.5 2 2.5 30

(b) Output of the functional model

output

Example 2

P: X is x inputs x∈ [0, 3]

R1: If X is A1 then y = – sin(2x)

R2: If X is A2 then y = – 0.5x rules

R3: If X is A3 then y = sin(3x)

-5 -4 -3 -2 -1 0 1 2 3 4 50

A1 A2 A3

-5 -4 -3 -2 -1 0 1 2 3 4 5-1.5

1.5(b) output of the functional fuzzy model

output

Example 2

P: X is x inputs x∈ [0, 3]

R1: If X is A1 then y = – 1

R2: If X is A2 then y = x rules

R3: If X is A3 then y = 1

-5 -4 -3 -2 -1 0 1 2 3 4 50

A1 A2 A3

-5 -4 -3 -2 -1 0 1 2 3 4 5-1.5

(c) output of the functional fuzzy model

output

Gradual fuzzy models

Ri: The more Xis Ai the more Zis Ci

i = 1,..., N

xAzCyxR

otherwise0

)()(if1),(

==′=

Gradual fuzzy model architecture

Poss α1 Cα1

Poss αi

Poss αN

C1 C2 1 1

α2 C1

’ C2’

Example: gradual fuzzy model processing

Example

P: X is x inputs x ∈ [0, 3]

R1: The more Xis A1 the more Zis C1

rulesR2: The more Xis A1 the more Zis C1

1 1.5 2 2.5 3 3.5 40

1 1.5 2 2.5 3 3.5 41

output

11.6 Approximation propertiesof fuzzy rule-based models

• FRBS uniformly approximates continuous functions

– any degree of accuracy

– closed and bounded sets

• Universal approximation with (Wang & Mendel, 1992):

– algebraic product t-norm in antecedent

– rule semantics via algebraic product

– rule aggregation via ordinary sum

– Gaussian membership functions

– sup-min compositional rule of inference

– pointwise inputs

– centroid defuzzification

• Universal approximation when (Kosko, 1992):

– min t-norm in antecedent

– rule aggregation via ordinary sum

– symmetric consequent membership functions

(additive models)

• Universal approximation with (Castro, 1995):

– arbitrary t-norm in antecedent

– rule semantics: r-implications or conjunctions

– triangular or trapezoidal membership functions

11.7 Development of rule-basedsystems

Expert-based development

• Knowledge provided by domain experts

– basic concepts and variables

– links between concepts and variables to form rules

• Reflects existing knowledge

– can be readily quantified

– short development time

Example: fuzzy control

FuzzyController

Processre u y+

Ri: If Error is Ai and Change of Error is Bi then Control is Ci

Ri: If e is Ai and de is Bi then u is Ci

Change of Error (de) / Error (e) NM NS ZE PS PM

NB PM NB NB NB NM

NM PM NB NS NM NM

NS PM NS Z NS NM

Z PM NS Z NS NM

PS PM PS Z NS NM

PM PM PM PS PM NM

PB PM PM PM PM NM

Data-driven development

• Given a finite set of input/output pairs

{( xk, yk), k = 1,..., M}

xk = [x1k, x2k,...., xnk] ∈Rn

zk = [xk, yk] ∈Rn+1, k = 1,..., M

• Clustering zk = [xk, yk] ∈Rn+1, k = 1,..., M (e.g. using FCM)

v1, v2,....,vN prototypes/cluster centers

vi ∈ Rn+1, i = 1,..., N

• Idea: fuzzy clusters ≡ fuzzy rules

Example

• Projecting the prototypes in the input and output spaces

v1[y], v2[y],....,vN [y] projections of prototypes in Y

v1[x], v2[x],....,vN [x] projections of prototypes in X

• Ri: If X is Ai then Y is Ci, i = 1,..., N

11.8 Parameter estimation forfunctional rule-basedsystems

• Functional fuzzy rules

• Ri: If Xi1 is Ai1 and ... and Xin is Ain then z= aio + ai1x1 + ....+ainxn

i = 1,..., N

• Given input/output data: {( x1, y1), (x2, y2),....,(xM, yM)}

• Let ai = [aio, ai1, ai2,....,ain]T

• Output of functional models

• Output for linear consequents

∑∑

iikiikk

xλw,,fwy

)()( ax

T ]1[ kikikN

iiikk w,,y xzaz == ∑

then y = Za

Global least squares approach

Mina JG(a) = || y – Za||2

|| y – Za||2 = (y – Za)T (y – Za)

Solution

aopt= Z# y

Z# = (ZT)–1ZT

Local least squares approach

Solution

aiopt= Zi# y

Zi# = (Zi

T)–1ZiT

−=∑=

2)(JMin

11.9 Design issues of FRBS:Consistency andcompleteness

Given input/output data: {( x1, y1), (x2, y2),....,(xM, yM)}

dataconsistencycompletenessaccuracy

Issue: quality of the rules

Completeness of rules

• All data points represented through some fuzzy set

maxi = 1,..., M Ai(xk) > 0 for all k = 1,2,..., M

• Input space completely covered by fuzzy sets

maxi = 1,..., M Ai(xk) > δ for all k = 1,2,..., M

Consistency of rules

• Rules in conflict

– similar or same conditions

– completely different conclusions

Conditions and Conclusions

Similar Conclusions

Different Conclusions

Similar Conditions rules are redundantrules are in

conflict

Different Conditions

different rules; could be eventually

mergeddifferent rules

|})()(||)()({|)cons(1

kjkikjM

iki xAxAyByBj,i −⇒−=∑

Ri: If X is Ai then Y is Bi

Rj: If X is Aj then Y is Bj

⇒ is an implication induced by some t-norm (r-implication)

))}()(Poss())()({Poss()cons(1

kjkikjM

iki yB,yBxA,xAj,i ⇒=∑

Alternatively

1)cons(

11.10 The curse of dimensionalityin rule-based systems

• Curse of dimensionality

– number of variables increase

– exponential growth of the number of rules

• Example

– n variables

– each granulated using p fuzzy sets

– number of different rules = pn

• Scalability challenges

11.11 Development scheme offuzzy rule-based models

Accuracy

Stability

Interpretability Knowledge

Representation

• Spiral model of development

– incremental design, implementation and testing

– multidimensional space of fundamental characteristics

11 Fuzzy Rule-Based Models - UNICAMPgomide/courses/IA861/transp/FSE_Chap11.… · 11 Fuzzy...

Documents

Transcript of 11 Fuzzy Rule-Based Models - UNICAMPgomide/courses/IA861/transp/FSE_Chap11.… · 11 Fuzzy...

Fuzzy Sets and Fuzzy Techniques - Lecture 13 -- Fuzzy ...joakim/course/fuzzy/vt07/lectures/L13_4.pdf · Fuzzy Sets and Fuzzy Techniques L´aszl´o G. Nyu´l Outline Motivation Fuzzy

Fuzzy Regression Models...fuzzy least-squares regression models. Keywords: fuzzy linear regression, fuzzy least-squares regression, fuzzy coefficients, possibilistic regression, term

Lecture 5 Fuzzy expert systems: Fuzzy inference · Fuzzy expert systems: Fuzzy inference ... Pearson Education, 2005 3 Mamdani fuzzy inference ... the fuzzy operator ...

Sistemas Fuzzy Ronaldo Gilberto de Oliveira. Sistemas Fuzzy Sistemas fuzzy estabelecem mapeamentos entre conjuntos fuzzy (hipercubos fuzzy) Sistemas fuzzy.

Fuzzy numbers & Fuzzy Equation.pptx

Chapter 4, Neuro-Fuzzy and Soft Computing: Fuzzy Inference ... · Chapter 4, Neuro-Fuzzy and Soft Computing: Fuzzy Inference Systems Neuro-Fuzzy and Soft Computing: Fuzzy Sets

Fuzzy Bio- Fuzzy Bio---interface: Can fuzzy setinterface ...

Fuzzy Expert Systems and Fuzzy Reasoning - Higher … · Fuzzy expert systems and fuzzy reasoning / by William Siler, ... Fuzzy Sets, and Fuzzy Numbers: I 29 ... 7.9.5 Exercises Iris.par

Introduction to Fuzzy Logic, Fuzzy Systems & Fuzzy …docs.znu.ac.ir/members/bayat_farhad/My Lectures/Fuzzy...Introduction to Fuzzy Logic, Fuzzy Systems & Fuzzy Control By: Dr. Farhad

Fuzzy Logic and Fuzzy Modeling - 123seminarsonly.com · Fuzzy Logic and Fuzzy Modeling Fuzzy Logic: Fuzzy logic deals with fuzzy sets. A fuzzy set or subset is a generalization of

Neuro-Fuzzy Modeling and Controlgraphs, fuzzy interpolation, fuzzy topology, fuzzy rea- soning, fuzzy inferences systems, and fuzzy modeling. The applications, which are multi-disciplinary

Fuzzy Sets and Fuzzy Techniques - Lecture 10 -- Fuzzy ...joakim/course/fuzzy/vt07/lectures/L10_4.pdfFuzzy Sets and Fuzzy Techniques Nataıa Sladoje Introduction Fuzzy Logic Fuzzy Implications

CHAPTER 16 FUZZY LOGIC, FUZZY EXPERT SYSTEMS & FUZZY CONTROLLERS

Fuzzy Logic and Fuzzy Systems - GitHub Pages •Introduction •Fuzzy Sets and Membership Functions •Fuzzy Linguistic Variables •Fuzzy Set Operations and Properties •Fuzzy Rules

Fuzzy Systems - Fuzzy Control

FUZZY RELATIONS, FUZZY GRAPHS, AND FUZZY …libvolume6.xyz/medicalelectronics/btech/semester8/fuzzylogicand... · 3 Important concepts in fuzzy logic • Fuzzy Relations • Fuzzy

DECISION-MAKING IN A FUZZY ENVIRONMENT. - Unicampgomide/courses/CT820/artigos/Decision... · Title: DECISION-MAKING IN A FUZZY ENVIRONMENT. Created Date: 8/9/2002 8:42:48 AM

1 Introduction - Unicampgomide/courses/IA861/transp/FSE_Chap1.pdf1 Introduction Fuzzy Systems Engineering Toward Human-Centric Computing. 1. Digital communities and human-centric systems

10 Fuzzy Modeling: Principles and Methodology - …gomide/courses/IA861/... · 10.1 The architectural blueprint of fuzzy models 10.2 Key phases of the development and use of fuzzy

Fuzzy Rules and Fuzzy Reasoning - Computer Science · Soft Computing: Fuzzy Rules and Fuzzy Reasoning 3 Outline Extension principle Fuzzy relations Fuzzy IF-THEN rules Compositional