An Evolutionary Algorithm Approach to Generate...
Transcript of An Evolutionary Algorithm Approach to Generate...
![Page 1: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/1.jpg)
An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated
Solutions for Wicked Problems
Marcio H. GiacomoniAssistant Professor
Civil and Environmental Engineering
February 16th 2017
Zechman, E.M., M. Giacomoni, and M. Shafiee (2013) “An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated Solutions for Wicked Problems” Engineering Applications of Artificial Intelligence 26(5), 1442-1457.
![Page 2: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/2.jpg)
The University of Texas at San Antonio, One UTSA Circle, San Antonio, TX 782491/3/11 2
UTSA Water Resources Systems Analysis Lab:
PR
OB
LEM
STO
OLS
Simulation ModelsHydrologic and Hydraulic
Water NetworksLand Use Change
Population Growth
Optimization AlgorithmsEvolutionary Computation
Single/multi-objective problems Method for Generating
Alternatives
Data Collection and Analysis
GIS and Remote SensingMonitoring
Sustainability of the Built and Natural
Environments
Drought Management and
Water Conservation
Stormwater Management and
Green Infrastructure
Resilience and Security of Cyber-Physical Systems
![Page 3: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/3.jpg)
Engineering Problems
• Many engineering problems have multiple objectives:
– Pareto front should be identified to represents the trade-off among conflicting objectives
Cost
Effi
cien
cy
Minimize
Max
imiz
e
Tradeoff Curve orNon Dominated Set
![Page 4: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/4.jpg)
Engineering Problems• Real world problems are ill-posed:
– Multiple perspectives (social, environmental, political)
– Some objectives are difficult to model mathematically
It’s White and
Gold!!!
No it’s NOT!!! It’s Blue and Black!!!
![Page 5: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/5.jpg)
Engineering Problems• Real world problems are ill-posed:
– Multiple perspectives (social, environmental, political)
– Some objectives are difficult to model mathematically
![Page 6: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/6.jpg)
Engineering Problems• The fitness landscapes for realistic problems, are often
non-linear, complex, and multi-modal.
𝑀𝑎𝑥𝑖𝑚𝑖𝑧𝑒 𝑧 = 𝑓 𝒙, 𝒚 =1
[𝑎 𝑦 − 𝑏𝑥2 + 𝑐𝑥 − 𝑑 2 + 𝑒 1 − 𝑓 cos 𝑥 cos 𝑦 + log 𝑥2 + 𝑥2 + 1 + 𝑒]
𝑎 = 1 ; b =5.1
4π2; 𝑐 =
5
𝜋; 𝑑 = 6 ; 𝑒 = 10 ; 𝑓 =
1
8𝜋𝑥 × 𝑦 ∈ −5,10 × [0,15]
-5
0
5
10
0
5
10
15
0
0.05
0.1
0.15
0.2
http://www.complexity.org.au/ci_louise/vol05/munteanu/munteanu.html
-5 0 5 100
5
10
15
![Page 7: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/7.jpg)
Modeling to Generate Alternatives• Decision making can be aided through
identification of alternative solutions
Alternative 1Alternative 2
Alternative 3
GOOD SOLUTION
![Page 8: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/8.jpg)
Modeling to Generate Alternatives
Original Problem:Maximize Zk = fk (X) k = 1, …, K . (K – number of objectives)
Subject to gi(X) < bi i = 1, …, M . (M – number of constraints).
Optimal Solution:X*, with objective values of Zk*
New Optimization Problem:Maximize D = j | xj – xj
* | .Subject to gi(X) < bi i = 1, …, M .
fk(X) > T(Zk*) .
Brill, E. D. Jr. (1979). The use of optimization models in public-sector planning.
Management Science, 25(5), 413-422.
![Page 9: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/9.jpg)
Research objective
• Develop an algorithm to identify a set of alternative Pareto fronts that are made up of solutions that map to similar regions of the objective space while mapping to maximallydifferent regions of the decision space.
![Page 10: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/10.jpg)
Multi-objective problems
a1
b1
c1
a1
b1
c1
Objective spaceDecision space
X1
X2
F1
F2
Pareto FrontOr
Non Dominated Set
![Page 11: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/11.jpg)
Multi-objective multi-modal problems
a2
b2
c2
a2
b2
c2
a1
b1
c1
X1
X2
a1
b1
c1
F1
F2
Two Sets of non-dominated solutions:Pareto Front 1 - (a1, b1, and c1) Pareto Front 2 - (a2, b2, and c2)
Objective spaceDecision space
![Page 12: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/12.jpg)
Multi-objective Evolutionary Algorithms to Generate Alternative Non-dominated Sets
• Use a set of populations to converge to alternative sets of non-dominated solutions– Each subpopulation will evolve
one Pareto front that is different in decision space from other subpopulations
– First subpopulation executes a conventional MOEA to find a typical Pareto front
– Secondary subpopulations find alternative Pareto fronts
a2
b2
c2
a1
b1
c1
F1
F2
Objective space
![Page 13: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/13.jpg)
Multi-objective Niching Co-evolutionary Algorithm (MNCA)
Primary subpopulation
f2
f1
Secondary subpopulation
f2
f1
Secondary subpopulation
f2
f1
Zechman, E.M., M. Giacomoni, and E. Shafiee (2013) “An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated Solutions for Wicked Problems” Engineering Applications of Artificial Intelligence 26(5), pp. 1442-1457
• Multiple sub-populations co-evolve to distinct sets of non-dominated solutions
![Page 14: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/14.jpg)
Multi-objective Niching Co-Evolutionary Algorithm (MNCA)
1. Group all solutions into clusters based on proximity in objective space– K-means clustering
2. Distance calculation– The distance of one solution is calculated in decision space to solutions
that fall in the same cluster but in different subpopulations
3. Target Front– A target front is created, based on the first front of non-dominated
solutions from first subpopulation
4. Feasibility Assignment– Label solutions in secondary subpopulations as feasible if they dominate
any point in the target front
5. Selection:– First Subpopulation: NSGA-II operator– Secondary Subpopulations: Crowding Distance and Binary Tournament
• Infeasible: rank and NSGA-II Crowding distance• Feasible: Crowding distance using four solutions
![Page 15: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/15.jpg)
MNCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
F1
F2
Objective space
![Page 16: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/16.jpg)
MNCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
F1
F2
Objective space
![Page 17: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/17.jpg)
MCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
…
Subpopulation 1
SP1
Subpopulation 2
SP2
Subpopulation SPn…
Decision Space
Colors represent different clusters that are formed based on similarities in objective space
![Page 18: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/18.jpg)
MCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
2. Distance calculation– The distance of one solution is calculated in decision space to
solutions that fall in the same cluster but in different subpopulations
![Page 19: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/19.jpg)
Distance calculation
…
Subpopulation 1
SP1
Subpopulation 2
SP2
Subpopulation SPn…
Decision Space
Distance is calculated for each solution to centroid of same cluster in other subpopulations
Solution Red2,i Distance = minimum(Distance to C1, red; Distance to C3, red)
C1, redC3, red
![Page 20: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/20.jpg)
MNCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
2. Distance calculation– The distance of one solution is calculated in decision space to
solutions that fall in the same cluster but in different subpopulations
3. Target Front– A target front is created, based on the first front of non-dominated
solutions from first subpopulation
![Page 21: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/21.jpg)
Target front
F1
F2 Target Front
Zi’ = T(Zi – WPi) + WPi
Zi’ is the a point on the target frontZi is the value of the ith objectiveT is the target reduction (i.e., 80%)WPi is the worst point for the ith objective
Objective space
![Page 22: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/22.jpg)
MNCA Algorithmic steps1. Group all solutions into clusters based on proximity in
objective space– K-means clustering
2. Distance calculation– The distance of one solution is calculated in decision space to
solutions that fall in the same cluster but in different subpopulations
3. Target Front– A target front is created, based on the first front of non-dominated
solutions from first subpopulation
4. Feasibility Assignment– Label solutions in secondary subpopulations as feasible if they
dominate any point in the target front
![Page 23: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/23.jpg)
Target front
F1
F2 Target Front
Zi’ = T(Zi – WPi) + WPi
Zi’ is the a point on the target frontZi is the value of the ith objectiveT is the target reduction (i.e., 80%)WPi is the worst point for the ith objective
F1
F2
Objective spaceObjective space
Infeasible
Feasible
![Page 24: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/24.jpg)
MNCA Algorithmic steps1. Group all solutions into clusters based on proximity in objective
space– K-means clustering
2. Distance calculation– The distance of one solution is calculated in decision space to solutions
that fall in the same cluster but in different subpopulations
3. Target Front– A target front is created, based on the first front of non-dominated
solutions from first subpopulation
4. Feasibility Assignment– Label solutions in secondary subpopulations as feasible if they
dominate any point in the target front5. Selection:
– First Subpopulation: NSGA-II operator– Secondary Subpopulations: Crowding Distance and Binary Tournament
• Infeasible: rank and NSGA-II Crowding distance• Feasible: Crowding distance using four solutions
![Page 25: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/25.jpg)
Crowding Distance
f1
f2
s2a
Infeasible Solutions
s1
f1
f2
s1
s2
s3
s4
b
Feasible Solutions
4
1
a i
i
cd s
2
1
b i
i
cd s
(NSGA-II)
![Page 26: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/26.jpg)
Binary Tournament
F1
F2
Objective space
Infeasible
FeasibleX
Infeasible Feasible
Feasible WINS!!!
![Page 27: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/27.jpg)
Binary Tournament
F1
F2
Objective space
Infeasible
FeasibleX
Feasible FeasibleSame Cluster
Higher Distance WINS!!!
Solutions within the same region of objective space:
Maximize Distance increasing diversity.
![Page 28: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/28.jpg)
Binary Tournament
F1
F2
Objective space
Infeasible
FeasibleX
Feasible Feasible
Higher Modified Crowding Distance
WINS!!!
Different Clusters
Solutions are from different parts of the objective space:
pressure to improve the coverage across the Pareto front.
![Page 29: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/29.jpg)
Binary Tournament
F1
F2
Objective space
Infeasible
FeasibleX
Infeasible Infeasible
Lower Front Rank or Crowding Distance
WINS!!!
![Page 30: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/30.jpg)
Niching-CMA
• Covariance Matrix Adaptation Evolution Strategy Niching Technique.
• Group solutions in niches based on their proximity in both decision and objective space.
• Outperformed other multi-objective and diversity-enhancing methodologies.
O. Shir and T. Beck, “Niching with derandomized evolution strategies in artificial and real-world landscapes,” Natural Computing, vol. 8, pp. 171–196, 2009, 10.1007/s11047-007-9065-5.
![Page 31: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/31.jpg)
Algorithmic Settings
Parameter Setting
Population Size 50
Subpopulations 2
Generations 1000
Mutation 1%
Clusters 5
Target 90% (95%)1
1 95% was used for the function Two-on-One
![Page 32: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/32.jpg)
0.00
0.20
0.40
0.60
0.80
1.00
0.00 0.20 0.40 0.60 0.80 1.00
f2(x
)
f1 (x)
Global Worst Point
Minimize
Minimize
Hypervolume• Represents the size of the space covered by the non-
dominated set• Used as an indicator to measure the quality of a non-
dominated set
![Page 33: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/33.jpg)
Decision Space Diversity• Assess diversity in decision space based on the
distance between all pair of individuals in a population
• Average of the distances between pairs of solutions and is normalized by the diameter of the decision space
O. Shir and T. Beck, “Niching with derandomized evolution strategies in artificial and real-world landscapes,” Natural Computing, vol. 8, pp. 171–196, 2009, 10.1007/s11047-007-9065-5.
![Page 34: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/34.jpg)
Paired Solution Diversity
• New metric to assess set of solutions that are distant in decision space though similar in objective space.
• Pair solution of one subpopulation with solution of another subpopulation that is nearest in objective space, and for each pair, calculating the Euclidean distance in the decision space.
![Page 35: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/35.jpg)
Paired Solution Diversity
a2 b2
c2
a2
b2
c2
a1
b1
c1
X1
X2
a1
b1
c1
F1
F2
Objective space Decision space
d1
d2
d3
1 2 3
3ps
d d ddiversity
a2
b2
c2
a1
b1
c1
X1
X2
Decision space
d1
d2
d3
![Page 36: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/36.jpg)
Test Function Two-on-One
• Two-on-One is a bi-modal problem composed of a fourth degre polynomial with two optima and a second-degree sphere function.
M. Preuss, B. Naujoks, and G. Rudolph, “Pareto Set and EMOA Behavior for Simple Multimodal MultiobjectiveFunctions,” in Parallel Problem Solving from Nature - PPSN IX, 2006, pp. 513–522.
x1
x2
x1
x2
f1
f2
Decision Space Objective Space
f1 f2
![Page 37: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/37.jpg)
Function Two-on-One
Decision SpaceGen # Subpopulation 1 Subpopulation 2
1
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
250
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
500
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
750
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
1000
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
Dec
isio
n S
pac
e D
iver
sity
Hyp
ervo
lum
e
![Page 38: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/38.jpg)
Function Two-on-One
f1
x1
f2
x2
f1
x1
f2
x2
f1
f2
Niching-CMA
-2 0 2-2
-1
0
1
2
0 10 200
1
2
3
4
5
6
Niching-CMA MNCA Subpopulation 1 Subpopulation 2
Decis
ion S
pace
Obje
ctive S
pace
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
-2 0 2-2
-1
0
1
2
0 10 200
1
2
3
4
5
6
0 10 200
1
2
3
4
5
6
0 10 200
1
2
3
4
5
6x1
x2
![Page 39: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/39.jpg)
Test Function Deb99
• Deb99 is a deceptive multi-objective problem that has a global optima difficult to identify and a local optima located in a long flat valley that is easy to find.
M. Preuss, B. Naujoks, and G. Rudolph, “Pareto Set and EMOA Behavior for Simple Multimodal MultiobjectiveFunctions,” in Parallel Problem Solving from Nature - PPSN IX, 2006, pp. 513–522.
X2
g(X2)
F1
F2
Decision Space Objective Space
![Page 40: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/40.jpg)
Deb99 Test Function
First subpopulationSecond subpopulation
![Page 41: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/41.jpg)
Function Deb99
f1
x1
Niching-CMA
0 0.5 10
0.2
0.4
0.6
0.8
1
0 0.5 10
2
4
6
8
10
12
14
f2
Niching-CMA MNCA
Subpopulation 1 Subpopulation 2
Decis
ion S
pace
Obje
ctive S
pace
0 0.5 10
0.2
0.4
0.6
0.8
1
0 0.5 10
0.2
0.4
0.6
0.8
1
0 0.5 10
0.2
0.4
0.6
0.8
1
0 0.5 10
2
4
6
8
10
12
14
0 0.5 10
2
4
6
8
10
12
14
0 0.5 10
2
4
6
8
10
12
14
x2
f1
x1
f2
x2
f1
x1
f2
x2
![Page 42: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/42.jpg)
Lamé Supersphere
• Lamé Supersphere is a multi-modal problem global with spherical geometry in objective space and equidistant parallel lines in decision space.
M. Preuss, B. Naujoks, and G. Rudolph, “Pareto Set and EMOA Behavior for Simple Multimodal MultiobjectiveFunctions,” in Parallel Problem Solving from Nature - PPSN IX, 2006, pp. 513–522.
X1
X2
F1
F2
![Page 43: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/43.jpg)
Function Lame Supersphere
Niching-CMA MCA MNCA Subpopulation 1 Subpopulation 2 Subpopulation 1 Subpopulation 2
Decis
ion S
pace
Obje
ctive S
pace
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
Niching-CMA MCA MNCA Subpopulation 1 Subpopulation 2 Subpopulation 1 Subpopulation 2
Decis
ion S
pace
Obje
ctive S
pace
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 1 1.50
1
2
3
4
5
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
0 0.5 10
0.2
0.4
0.6
0.8
1
1.2
![Page 44: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/44.jpg)
Hypervolume
Test Function Niching CMAMNCA
Subpopulation 1 Subpopulation 2
Two-on-One 169.6 ± 1.9 173.6 ± 0.1 165.6 ± 3.2Deb99 7.95 ± 0.69 9.12 ± 0.01 7.45 ± 0.35
Lamé Superspheres 3.12 ± 0.13 3.19 ± 0.02 2.95 ± 0.14
Decision Space Diversity
Paired Solution Diversity
Test Function Niching CMA MNCATwo-on-One 0.231 ± 0.031 0.298 ± 0.032
Deb99 0.285 ± 0.032 0.359 ± 0.015Lamé Superspheres 0.329 ± 0.039 0.112 ± 0.007
Test Function MCA MNCATwo-on-One 2.158 ± 0.239 2.64 ± 0.49
Deb99 0.23 ± 0.06 0.47 ± 0.08Lamé Superspheres 0.79 ± 0.05 1.59 ± 0.04
![Page 45: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/45.jpg)
o Determine a set of 28 routes to connect 8 cities to maintain objectives: o minimize f1 : Costo minimize f2 : Number of stops
o Given:o Number of requests at each cityo Cost of initial set-upo Cost of each flighto Unit cost for each passengero Potential type of connections:
o Directlyo Indirectly- through multiple-leg
connections
Realistic Planning Problem: Airline Routing
![Page 46: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/46.jpg)
Settings for MNCA
Parameter Setting
Population Size 100
Subpopulations 3
Generations 100
Mutation 1%
Clusters 5
Relaxation coefficient 90%
![Page 47: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/47.jpg)
Distinct sets of non-dominated solutions
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 3
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 1
Sto
ps
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 2
Cost (M$)
![Page 48: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/48.jpg)
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
Twenty five-stop alternative solutions
Subpopulation 1
Subpopulation 3
Subpopulation 2
Subpopulation
90
100
110
120
1 2 3
Co
srt
(M$
)
![Page 49: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/49.jpg)
Distinct sets of non-dominated solutions
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 3
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 1
Sto
ps
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 2
Cost (M$)
![Page 50: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/50.jpg)
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
Eighteen-stop alternative solutions
Subpopulation 1
Subpopulation 3
Subpopulation 2
90
100
110
1 2 3
Co
st (
M$
)
Subpopulation
![Page 51: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/51.jpg)
Distinct sets of non-dominated solutions
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 3
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 1
Sto
ps
Cost (M$)
15
20
25
30
80 100 120 140
Subpopulation 2
Cost (M$)
![Page 52: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/52.jpg)
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
HOU
DFW
CHI
CIN
CLE
BAL
ATL
BOS
Seventeen-stop alternative solutions
Subpopulation 1
Subpopulation 3
Subpopulation 2
90
100
110
120
1 2 3
Co
st (
M$
)
Subpopulation
![Page 53: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/53.jpg)
Where should Osaka Prefecture University be located?
![Page 54: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/54.jpg)
OFU – Problem Formulation 2 decision variables and 4 objective values
f1(x1,x2) = min distance to the nearest elementary school f2(x1,x2) = min distance to the nearest convenience store f3(x1,x2) = min distance to the nearest junior-high schoolf4(x1,x2) = min distance to the nearest railway station
![Page 55: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/55.jpg)
OFU – Algorithm settings
Parameter Setting
Population Size 100
Subpopulations 2
Generations 100
Mutation 1%
Clusters 5
Target 95%
![Page 56: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/56.jpg)
Results - Objective SpaceSubpopulation 1 Subpopulation 2
0
20
0 20 40
0
20
0 20 40
f2 = min distance to the nearest convenience store
f 3 =
min
dis
tan
ce t
o t
he
nea
rest
jun
ior-
hig
h
sch
oo
l
f2 = min distance to the nearest convenience store
f 3 =
min
dis
tan
ce t
o t
he
nea
rest
jun
ior-
hig
h
sch
oo
l
![Page 57: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/57.jpg)
Results - Decision SpaceSubpopulation 1 Subpopulation 2
![Page 58: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/58.jpg)
Conclusions• Results demonstrate the ability of a new
algorithm, MNCA, to identify sets of non-dominated solutions for test problems.
• Outperforms state-of-the-art (Niching-CMA) in diversity algorithms for multi-objective problems.
• A new metric to assess diversity among subpopulations was developed.
• MNCA maximizes diversity in decision space while identifying complete alternative Pareto fronts.
![Page 59: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/59.jpg)
Thank you for your Attention!
![Page 60: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/60.jpg)
Number of ClustersHypervolume Paired Solution Diversity
MCA MNCA
0
50
100
150
200
2 3 4 5Tw
o-o
n-O
ne
Cluster
0.0
1.0
2.0
3.0
4.0
2 3 4 5
Cluster
0
2
4
6
8
10
2 3 4 5
Deb99
Cluster
0.0
0.2
0.4
0.6
0.8
1.0
2 3 4 5Cluster
0
1
2
3
4
2 3 4 5Lam
é S
upers
phere
s
Cluster
0.0
0.2
0.4
0.6
0.8
1.0
2 3 4 5Cluster
![Page 61: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/61.jpg)
Number of Subpopulations Hypervolume Paired Solution Diversity
MCA MNCA
0
50
100
150
200
2 3 4 5 20Tw
o-o
n-O
ne
Subpopulations
0.0
1.0
2.0
3.0
4.0
2 3 4 5 20
Subpopulations
0
2
4
6
8
10
2 3 4 5 20
Deb99
Subpopulations
0.0
0.1
0.2
0.3
0.4
0.5
0.6
2 3 4 5 20
Subpopulation
0
1
2
3
4
2 3 4 5 20
Lam
é S
upers
phere
s
Subpopulations
0.0
0.2
0.4
0.6
0.8
1.0
1.2
2 3 4 5 20Subpopulations
![Page 62: An Evolutionary Algorithm Approach to Generate …engineering.utsa.edu/ataha/wp-content/uploads/sites/38/...An Evolutionary Algorithm Approach to Generate Distinct Sets of Non-Dominated](https://reader033.fdocuments.net/reader033/viewer/2022042914/5f4d1e9ebcca644ed079f24f/html5/thumbnails/62.jpg)
Targets Hypervolume Paired Solution Diversity
0
50
100
150
200
80 85 90 95 97
Tw
o-o
n-O
ne
Target
0.0
1.0
2.0
3.0
4.0
80 85 90 95 97
Target
0
2
4
6
8
10
80 85 90 95 97
Deb99
Target
0.0
0.2
0.4
0.6
0.8
1.0
80 85 90 95 97Target