Top Banner
Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( J.-S. Roger Jang ( 張張張 張張張 ) ) CS Dept., Tsing Hua Univ., Taiwan CS Dept., Tsing Hua Univ., Taiwan http://www.cs.nthu.edu.tw/~jang http://www.cs.nthu.edu.tw/~jang [email protected] [email protected] Modified by Dan Simon Modified by Dan Simon Fall 2010 Fall 2010 Neuro-Fuzzy and Soft Computing: Fuzzy Sets
35

Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Dec 16, 2015

Download

Documents

Cassie Garrow
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Slides for Fuzzy Sets, Ch. 2 ofNeuro-Fuzzy and Soft Computing

Slides for Fuzzy Sets, Ch. 2 ofNeuro-Fuzzy and Soft Computing

J.-S. Roger Jang (J.-S. Roger Jang (張智星張智星 ))

CS Dept., Tsing Hua Univ., TaiwanCS Dept., Tsing Hua Univ., Taiwanhttp://www.cs.nthu.edu.tw/~janghttp://www.cs.nthu.edu.tw/~jang

[email protected]@cs.nthu.edu.tw

Modified by Dan SimonModified by Dan Simon

Fall 2010Fall 2010

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

Page 2: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

2

Fuzzy Sets: OutlineFuzzy Sets: Outline

Introduction

Basic definitions and terminology

Set-theoretic operations

MF formulation and parameterization• MFs of one and two dimensions

• Derivatives of parameterized MFs

More on fuzzy union, intersection, and complement• Fuzzy complement

• Fuzzy intersection and union

• Parameterized T-norm and T-conorm

Page 3: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

3

A Case for Fuzzy LogicA Case for Fuzzy Logic

“So far as the laws of mathematics refer to reality, they are not certain. And so far as they are certain, they do not refer to reality.”

- Albert Einstein

Page 4: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

4

Probability versus FuzzinessProbability versus Fuzziness

I am thinking of a random shape (circle, square, or triangle). What is the probability that I am thinking of a circle?

Which statement is more accurate?• It is probably a circle.• It is a fuzzy circle.

Page 5: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

5

Two similar but different situations:

• There is a 50% chance that there is an apple in the fridge.

• There is half of an apple in the fridge.

Probability versus FuzzinessProbability versus Fuzziness

Page 6: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

6

ParadoxesParadoxes

A heterological word is one that does not describe itself. For example, “long” is heterological, and “monosyllabic” is heterological.

Is “heterological” heterological?

Page 7: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

7

ParadoxesParadoxes

Bertrand Russell’s barber paradox (1901)

The barber shaves a man if and only if he does not shave himself. Who shaves the barber? …

S: The barber shaves himself

Use t(S) to denote the truth of S

S implies not-S, and not-S implies S

Therefore, t(S) = t(not-S) = 1 – t(S)

t(S) = 0.5

Similarly, “heterological” is 50% heterological

Page 8: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

8

ParadoxesParadoxes

Sorites paradox:

Premise 1: One million grains of sand is a heap

Premise 2: A heap minus one grain is a heap

Question: Is one grain of sand a heap?

Number of grains

“Hea

p-ne

ss”

0

100%

Page 9: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

9

Fuzzy SetsFuzzy Sets

Sets with fuzzy boundaries

A = Set of tall people

Heights5’10’’

1.0

Crisp set A

Membershipfunction

Heights5’10’’ 6’2’’

.5

.9

Fuzzy set A1.0

Page 10: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

10

Membership Functions (MFs)Membership Functions (MFs)

Characteristics of MFs:• Subjective measures

• Not probability functions

Membership

Height5’10’’

.5

.8

.1

“tall” in Asia

“tall” in the US

“tall” in NBA

Page 11: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

11

Fuzzy SetsFuzzy Sets

Formal definition:A fuzzy set A in X is expressed as a set of ordered

pairs:

A x x x XA {( , ( ))| }

Universe oruniverse of discourse

Fuzzy setMembership

function(MF)

A fuzzy set is totally characterized by aA fuzzy set is totally characterized by amembership function (MF).membership function (MF).

Page 12: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

12

Fuzzy Sets with Discrete UniversesFuzzy Sets with Discrete UniversesFuzzy set C = “desirable city to live in”

X = {SF, Boston, LA} (discrete and nonordered)

C = {(SF, 0.9), (Boston, 0.8), (LA, 0.6)}

Fuzzy set A = “sensible number of children”X = {0, 1, 2, 3, 4, 5, 6} (discrete universe)

A = {(0, .1), (1, .3), (2, .7), (3, 1), (4, .6), (5, .2), (6, .1)}

Page 13: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

13

Fuzzy Sets with Cont. UniversesFuzzy Sets with Cont. Universes

Fuzzy set B = “about 50 years old”X = Set of positive real numbers (continuous)

B = {(x, B(x)) | x in X}

B xx

( )

1

150

10

2

Page 14: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

14

Alternative NotationAlternative Notation

A fuzzy set A can be alternatively denoted as follows:

A x xAx X

i i

i

( ) /

A x xA

X

( ) /

X is discrete

X is continuous

Note that and integral signs stand for the union of membership grades; “/” stands for a marker and does not imply division.

Page 15: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

15

Fuzzy PartitionFuzzy Partition

Fuzzy partitions formed by the linguistic values “young”, “middle aged”, and “old”:

lingmf.m

Page 16: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

16

More DefinitionsMore Definitions

Support

Core

Normality

Crossover points

Fuzzy singleton

-cut, strong -cut

Convexity

Fuzzy numbers

Bandwidth

Symmetricity

Open left or right, closed

Page 17: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

17

MF TerminologyMF Terminology

MF

X

.5

1

0Core

Crossover points

Support

- cut

These expressions are all defined in terms of x.

Page 18: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

18

Convexity of Fuzzy SetsConvexity of Fuzzy Sets

A fuzzy set A is convex if for any in [0, 1], A A Ax x x x( ( ) ) min( ( ), ( ))1 2 1 21

A is convex if all its -cuts are convex. (How do you measure the convexity of an -cut?)

convexmf.m

Page 19: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

19

Set-Theoretic OperationsSet-Theoretic Operations

Subset:

Complement:

Union:

Intersection:

for all A BA B x

C A B x x x x xc A B A B ( ) max( ( ), ( )) ( ) ( )

C A B x x x x xc A B A B ( ) min( ( ), ( )) ( ) ( )

A X A x xA A ( ) ( )1

Page 20: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

20

Set-Theoretic OperationsSet-Theoretic Operations

subset.m

fuzsetop.m

Page 21: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

21

MF FormulationMF Formulation

Triangular MF: trimf ( ; , , ) max min , ,0x a c x

x a b cb a c b

Trapezoidal MF: trapmf ( ; , , , ) max min ,1, ,0x a d x

x a b c db a d c

Generalized bell MF: 2

1gbellmf ( ; , , )

1bx a b c

x ca

Gaussian MF:2

1

2gaussmf ( ; , )x c

x c e

Page 22: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

22

MF FormulationMF Formulation

disp_mf.m

Page 23: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

23

MF FormulationMF Formulation

Sigmoidal MF:( )

1sigmf ( ; , )

1 a x cx a c

e

Extensions:

Abs. difference of two sig. MF

(open right MFs)

Product

of two sig. MFs

disp_sig.m

c = crossover pointa controls the slope, and right/left

Page 24: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

24

MF FormulationMF Formulation

L-R (left-right) MF:

,

LR( ; , , )

,

L

R

c xF x c

ax c a b

x cF x c

b

Example: F x xL ( ) max( , ) 0 1 2 F x xR ( ) exp( ) 3

difflr.m

c=65

a=60

b=10

c=25

a=10

b=40

Page 25: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

25

Cylindrical ExtensionCylindrical Extension

Base set A Cylindrical Ext. of A

cyl_ext.m

Page 26: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

26

2D MF Projection2D MF Projection

Two-dimensional

MF

Projection

onto X

Projection

onto Y

R x y( , )

A

yR

x

x y

( )

max ( , )

B

xR

y

x y

( )

max ( , )

project.m

0

0.5

1

X

(a) A Two-dimensional MF

Y

0

0.5

1

X

(b) Projection onto X

Y

0

0.5

1

X

(c) Projection onto Y

Y

Page 27: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

27

2D Membership Functions2D Membership Functions

2dmf.m

Page 28: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

28

Fuzzy Complement N(a) : [0,1][0,1]Fuzzy Complement N(a) : [0,1][0,1]

General requirements of fuzzy complement:• Boundary: N(0)=1 and N(1) = 0

• Monotonicity: N(a) > N(b) if a < b

• Involution: N(N(a)) = a

Two types of fuzzy complements:• Sugeno’s complement (Michio Sugeno):

• Yager’s complement (Ron Yager, Iona College):

N aa

sas( )

1

1

N a aww w( ) ( ) / 1 1

Page 29: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

29

Fuzzy ComplementFuzzy Complement

negation.m

N aa

sas( )

1

1N a aw

w w( ) ( ) / 1 1

Sugeno’s complement: Yager’s complement:

Page 30: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

30

Fuzzy Intersection: T-normFuzzy Intersection: T-norm

Analogous to AND, and INTERSECTION

Basic requirements:• Boundary: T(0, 0) = 0, T(a, 1) = T(1, a) = a

• Monotonicity: T(a, b) T(c, d) if a c and b d

• Commutativity: T(a, b) = T(b, a)

• Associativity: T(a, T(b, c)) = T(T(a, b), c)

Four examples (page 37):• Minimum: Tm(a, b)

• Algebraic product: Ta(a, b)

• Bounded product: Tb(a, b)

• Drastic product: Td(a, b)

Page 31: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

31

T-norm OperatorT-norm Operator

Minimum:Tm(a, b)

Algebraicproduct:Ta(a, b)

Boundedproduct:Tb(a, b)

Drasticproduct:Td(a, b)

tnorm.m

Page 32: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

32

Fuzzy Union: T-conorm or S-normFuzzy Union: T-conorm or S-norm

Analogous to OR, and UNION

Basic requirements:• Boundary: S(1, 1) = 1, S(a, 0) = S(0, a) = a

• Monotonicity: S(a, b) S(c, d) if a c and b d

• Commutativity: S(a, b) = S(b, a)

• Associativity: S(a, S(b, c)) = S(S(a, b), c)

Four examples (page 38):• Maximum: Sm(a, b)

• Algebraic sum: Sa(a, b)

• Bounded sum: Sb(a, b)

• Drastic sum: Sd(a, b)

Page 33: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

33

T-conorm or S-normT-conorm or S-norm

tconorm.m

Maximum:Sm(a, b)

Algebraicsum:

Sa(a, b)

Boundedsum:

Sb(a, b)

Drasticsum:

Sd(a, b)

Page 34: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

34

Generalized DeMorgan’s LawGeneralized DeMorgan’s Law

T-norms and T-conorms are duals which support the generalization of DeMorgan’s law:• T(a, b) = N(S(N(a), N(b))): a and b = not(not a, or not b)

• S(a, b) = N(T(N(a), N(b))): a or b = not(not a, and not b)

Tm(a, b)Ta(a, b)Tb(a, b)Td(a, b)

Sm(a, b)Sa(a, b)Sb(a, b)Sd(a, b)

Page 35: Slides for Fuzzy Sets, Ch. 2 of Neuro-Fuzzy and Soft Computing J.-S. Roger Jang ( 張智星 ) CS Dept., Tsing Hua Univ., Taiwan jang.

Neuro-Fuzzy and Soft Computing: Fuzzy Sets

35

Parameterized T-norm and S-normParameterized T-norm and S-norm

Parameterized T-norms and dual T-conorms have been proposed by several researchers:

• Yager

• Schweizer and Sklar

• Dubois and Prade

• Hamacher

• Frank

• Sugeno

• Dombi