Top Banner
Evolutionary Computation And Applications Deepak Dawar 03/15/22 DD - North Dakota State University 1
52
Welcome message from author
This document is posted to help you gain knowledge. Please leave a comment to let me know what you think about it! Share it to your friends and learn new things together.
Transcript
Page 1: Evolutionary computation and_applications

Evolutionary Computation And

ApplicationsDeepak Dawar

04/15/23 DD - North Dakota State University 1

Page 2: Evolutionary computation and_applications

Problems Galore!

204/15/23 DD - North Dakota State University

Page 3: Evolutionary computation and_applications

The Traveling Salesman

• NP Complete• It is likely that the worst case

running time for any algorithm for the TSP increases exponentially with the number of cities.

304/15/23 DD - North Dakota State University

Page 4: Evolutionary computation and_applications

Evolutionary Algorithms

404/15/23 DD - North Dakota State University

Page 5: Evolutionary computation and_applications

Classes of Search Methods

Search Method

Calculus Based Method

Guided Random Search Method

Enumerative Method

BFSDFS Dynamic Programming

Tabu Search

Hill Climbing

Simulated Anealing

Evolutionary Algorithms

Genetic Algorithms

Fibonacci Sort

Swarm Intelligence

Particle Swarm

Ant Colony

Differential Evolution

04/15/23 DD - North Dakota State University 5

Page 6: Evolutionary computation and_applications

Evolutionary Algorithms

• Emulate evolutionary processes.• Operate on population of individuals.

604/15/23 DD - North Dakota State University

Page 7: Evolutionary computation and_applications

List of Parts for Real Parameter Optimization with EA

• A function to optimize

• A domain in which to optimize

• An Evolutionary Algorithm

704/15/23 DD - North Dakota State University

Page 8: Evolutionary computation and_applications

The Function and The Domain

Function:We want to find the minimum value on the landscape.

8

Global Minimum

04/15/23 DD - North Dakota State University

Page 9: Evolutionary computation and_applications

The Algorithm-Differential Evolution

• Real Parameter Optimizer• Utilizes a pre-specified number of random solutions • Continuously improves them through a series of mutations and re-

combinations• Usually, the number of pre-specified solutions i.e. the population size

does not change during the lifetime of the algorithm

904/15/23 DD - North Dakota State University

Page 10: Evolutionary computation and_applications

Differential Evolution

1004/15/23 DD - North Dakota State University

Page 11: Evolutionary computation and_applications

Important Nomenclature

• D = Dimensionality of the problem• NP = No. of solution vectors in a

population • G = No. of generations the population has to go

through• F = Scaling Factor• Cr = Crossover rate

1104/15/23 DD - North Dakota State University

Page 12: Evolutionary computation and_applications

Initialization

1204/15/23 DD - North Dakota State University

Page 13: Evolutionary computation and_applications

Initial Population

1304/15/23 DD - North Dakota State University

Page 14: Evolutionary computation and_applications

Mutation

• Mutation is a change in the gene characteristics of a chromosome.• Applied to evolutionary computation it means a change in the

parameters of the vector through a perturbation with a random element.

1404/15/23 DD - North Dakota State University

Page 15: Evolutionary computation and_applications

Mutation

• A parent vector from the current generation is called target vector• The mutant vector obtained through differential perturbation is

called donor vector • The offspring obtained through recombination of target and donor is

called trial vector

1504/15/23 DD - North Dakota State University

Page 16: Evolutionary computation and_applications

Mutation

1604/15/23 DD - North Dakota State University

Page 17: Evolutionary computation and_applications

Mutation

1704/15/23 DD - North Dakota State University

Page 18: Evolutionary computation and_applications

Crossover

1804/15/23 DD - North Dakota State University

Page 19: Evolutionary computation and_applications

Create Trial Vector

• Suppose: rand =0.945, Cr =0.9

• If rand < Cr, pick the parameter from the donor

• Else from the parent

• Do this for all 10 parameters

1904/15/23 DD - North Dakota State University

Page 20: Evolutionary computation and_applications

Selection- Choose between Parent and Child/Trial Vector

2004/15/23 DD - North Dakota State University

Page 21: Evolutionary computation and_applications

Control Parameters

• NP, F and Cr are collectively termed as control parameters of DE• The performance of DE is very sensitive to the values of control

parameters• Every problem/function may respond differently to different sets of

control parameters.

2104/15/23 DD - North Dakota State University

Page 22: Evolutionary computation and_applications

Benchmark Functions- IEEE CEC 2013 Test Suite

• State of the art benchmark functions used in CEC Real Parameter Optimization Competitions and Conferences

• Emulate the properties of real world large scale optimization problems

• IEEE CEC Test suites have constantly evolved over time with the advances in the field of Large Scale Global Optimization

• All the problems listed in the Test Suite are minimization problems

2204/15/23 DD - North Dakota State University

Page 23: Evolutionary computation and_applications

Rotated Ackley’s Function

2304/15/23 DD - North Dakota State University

Page 24: Evolutionary computation and_applications

Scaling Factor

Scales the difference of solutions and controls the step size

Many Authors have reported that its effective values lie between [0.4, 1]

though it may ultimately also depend upon the problem landscape

Contradicting results have been reported for what should be good values

for the scaling factor

So what do we do?

04/15/23 DD - North Dakota State University 24

Page 25: Evolutionary computation and_applications

Altering the Scaling Vector

Deterministic - the parameters are altered based on some user defined rules

Adaptive - the parameters are allowed to adapt based on some feedback from

the algorithm

Evolutionary - the parameters are encoded into the solution itself and they

evolve as a part of the general population

04/15/23 DD - North Dakota State University 25

Page 26: Evolutionary computation and_applications

In Our First Paper

• We primarily focus our attention towards deterministic parameter control methods and the control parameter, scale factor (F), in particular.

04/15/23 DD - North Dakota State University 26

Page 27: Evolutionary computation and_applications

Dither

04/15/23 DD - North Dakota State University 27

Page 28: Evolutionary computation and_applications

DETVSF - DE with Time Varying Scale Factor

Linear Reduction

04/15/23 DD - North Dakota State University 28

Page 29: Evolutionary computation and_applications

DEDASF - DE with Dither and Annealed Scale Factor

Non Linear Reduction

04/15/23 DD - North Dakota State University 29

Page 30: Evolutionary computation and_applications

Birds Eye View

04/15/23 DD - North Dakota State University 30

Page 31: Evolutionary computation and_applications

What do we achieve?

04/15/23 DD - North Dakota State University 31

Page 32: Evolutionary computation and_applications

Result 1 - FriedMan’s Test - Ranks

04/15/23 DD - North Dakota State University 32

Page 33: Evolutionary computation and_applications

Result 2 - Hocheberg’s Post Hoc Procedure: significance level 0.1

04/15/23 DD - North Dakota State University 33

Page 34: Evolutionary computation and_applications

Second Paper - Objective

• To detect, classify and count the type of moving vehicles

34Source: http://www.123rf.com/stock-photo/highway.html04/15/23 DD - North Dakota State University

Page 35: Evolutionary computation and_applications

Vehicle Recognition Steps

3504/15/23 DD - North Dakota State University

Page 36: Evolutionary computation and_applications

How to Identify Axles?

• Axles are circular

• Shape recognition algorithm must be employed

3604/15/23 DD - North Dakota State University

Page 37: Evolutionary computation and_applications

Hough Transform

• Is a feature extraction technique used in image analysis• Can be used to detect lines, circles, and ellipses or any shape

represented by a set of parameters• We focus on circle detection

3704/15/23 DD - North Dakota State University

Page 38: Evolutionary computation and_applications

Recognition Example (1)

• Original Image

3804/15/23 DD - North Dakota State University

Page 39: Evolutionary computation and_applications

Recognition Example (1)

• dp (accumulator resolution)=1.25

3904/15/23 DD - North Dakota State University

Page 40: Evolutionary computation and_applications

Recognition Example (2)

4004/15/23 DD - North Dakota State University

Page 41: Evolutionary computation and_applications

Recognition Example (3)

4104/15/23 DD - North Dakota State University

Page 42: Evolutionary computation and_applications

04/15/23 DD - North Dakota State University 42

DEMO

Page 43: Evolutionary computation and_applications

Paper 3 - Object Tracking

04/15/23 DD - North Dakota State University 43

Page 44: Evolutionary computation and_applications

Stages In Object Tracking

• Object Initialization• Appearance model Initialization• Search – Object Localization• Appearance model Updation

04/15/23 DD - North Dakota State University 44

Page 45: Evolutionary computation and_applications

Modeling The Target

• Represent the target as• Vector• Matrix• Histogram• Wavelets

04/15/23 DD - North Dakota State University 45

Page 46: Evolutionary computation and_applications

Modeling – A Difficult Task

• Scene changes• Illumination • Background• Occlusion• Deformation• Noise

04/15/23 DD - North Dakota State University 46

Page 47: Evolutionary computation and_applications

Univariate Gaussian

04/15/23 DD - North Dakota State University 47

Page 48: Evolutionary computation and_applications

Multivariate Gaussian

04/15/23 DD - North Dakota State University 48

Page 49: Evolutionary computation and_applications

Gaussian Mixture

04/15/23 DD - North Dakota State University 49

Page 50: Evolutionary computation and_applications

Segmentation using GMM

04/15/23 DD - North Dakota State University 50

Page 51: Evolutionary computation and_applications

Demo

04/15/23 DD - North Dakota State University 51

Page 52: Evolutionary computation and_applications

04/15/23 DD - North Dakota State University 52

Thank You