Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets...

20
Multiobjective Optimization Visualization of Solution Sets in Many-Objective Optimization Facult: Eduardo G. Carrano Frederico G. Guimarães Lucas S. Batista {egcarrano,fredericoguimaraes,lusoba}@ufmg.br www.ppgee.ufmg.br/lusoba Universidade Federal de Minas Gerais Programa de Pós-Graduação em Engenharia Elétrica, Brasil

Transcript of Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets...

Page 1: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Multiobjective OptimizationVisualization of Solution Sets in Many-Objective Optimization

Facult:

Eduardo G. CarranoFrederico G. Guimarães

Lucas S. Batista

{egcarrano,fredericoguimaraes,lusoba}@ufmg.brwww.ppgee.ufmg.br/∼lusoba

Universidade Federal de Minas GeraisPrograma de Pós-Graduação em Engenharia Elétrica, Brasil

Page 2: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Content

1 Visualization of Solution SetsPresentation

2 / 20

Page 3: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Many-objective optimization problem

Multiobjective optimization problem in which m > 3.

minx

f(x) ∈ Rm, x ∈ F

f : X ⊂ Rn 7→ Y ⊂ Rm

F =

gi(x) ≤ 0; i = 1, . . . ,phj(x) = 0; j = 1, . . . ,qx ∈ X

3 / 20

Page 4: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

In a low-dimensional space with two or three objectives, a scatterplot shows the location, distribution, and shape of the approxima-ted front, where each axis directly represents one objective.

From a scatter plot, a decision-maker easily makes choices andpicks up preferred solutions.

However, it cannot be extended to high-dimensional objective spa-ces with more than 3 criteria.

4 / 20

Page 5: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

In order to illustrate the maps:

Consider the well-known test problem DTLZ2, and generated resultsfor m = 2, 3, 5 objectives.

Suppose the solutions have been coloured according to the objec-tive m on which the solution performs “best”.

In this way: 1 = red, 2 = green, 3 = blue, 4 = cyan, 5 = black.

5 / 20

Page 6: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Scatter plot representation:

6 / 20

Page 7: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:

For an m-dimensional objective space, the respective parallel coor-dinate system would contain m parallel axes, each of which repre-sents one objective.

This method can directly show the original objective values of solu-tions.

In the objective space, if objectives of interest are positioned adja-cent to each other, this method can also provide information aboutthe tradeoff relationships between objectives and contour informa-tion of the approximate Pareto front for decision-maker.

7 / 20

Page 8: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:

Parallel coordinates.

8 / 20

Page 9: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:Heatmap.

9 / 20

Page 10: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:

This type of methods uses some more sophisticated mapping tech-niques to perform dimension reduction to the 2-D space.

All mapping methods try to preserve Pareto dominance among indi-viduals and retain local distances between each pair of them.

They are often computationally expensive and not robust as themapping heavily depends on the values of the objective vectors inthe approximate front.

Meanwhile, all kinds of mapping methods cannot avoid losing someimportant information.

Moreover, in this 2-D map, it is still not easy to discover the shapeof the approximate front and tradeoffs between objectives.

10 / 20

Page 11: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:Pairwise coordinate plot.

11 / 20

Page 12: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:PCA map.As the colouring shows, the solutions are overlayed in such a waythat is difficult to distinguish among them; moreover, the informationfrom clusters are lost.

12 / 20

Page 13: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:Self-organizing map.Nearby vectors in the input high-dimensional space are mapped tonearby units (neurons) in SOMs.

13 / 20

Page 14: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Parallel Coordinate System:

Generative Topographical Mapping (GTM).

It is an alternative to the SOM map. Individuals have been broadlyclustered into similar groups, but there is an imperfect separation.

14 / 20

Page 15: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:

Neuroscale

Preserves the local distances, but segregation into distinct regionsis unclear.

15 / 20

Page 16: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:

Sammon mapping (preserves the local distances).

16 / 20

Page 17: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:Radial coordinate visualization.Preserves well the distribution of vectors but it cannot distinguishthe shape of the approximate Pareto fronts.

17 / 20

Page 18: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Popular Visualization Approaches for MaOPs

Visualization Based on Mapping:Isomap.Preserves the intrinsic geometry of solutions when mapping to 2-Dspace, where each solution is linked only to its closest neighbors.

18 / 20

Page 19: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

Presentation

Conclusions

Some of the visualization techniques can lost information;

Each visualization technique has specific properties;

This way, each one can be useful depending on the criterion con-sidered;

The visualization of solution sets in MaO is an open problem!

19 / 20

Page 20: Multiobjective Optimization - Visualization of Solution ...€¦ · Visualization of Solution Sets References Presentation Popular Visualization Approaches for MaOPs In a low-dimensional

Visualization of Solution Sets References

References

David J. Walker & Richard M. Everson & Jonathan E. Fieldsend, Visualising So-lution Sets in Many-objective Optimisation, IEEE TEC, v. 17, no. 2, p. 165–184,2013.

Zhenan He and Gary G. Yen, Visualization and Performance Metric in Many-Objective Optimization, IEEE TEC, v. 20, no. 3, p. 386–402, 2016.

Inicio

20 / 20