Upcoming SlideShare
×

# Multiobjective optimization and trade offs using pareto optimality

12,989 views
12,577 views

Published on

Multiobjective optimization and trade offs using pareto optimality

Published in: Technology
5 Likes
Statistics
Notes
• Full Name
Comment goes here.

Are you sure you want to Yes No
• Thanks

Are you sure you want to  Yes  No
• THANKS

Are you sure you want to  Yes  No
• thanks dude

Are you sure you want to  Yes  No
• Nice work.....
it's really beneficial...

Are you sure you want to  Yes  No
• Presentation is useful

Are you sure you want to  Yes  No
Views
Total views
12,989
On SlideShare
0
From Embeds
0
Number of Embeds
967
Actions
Shares
0
432
5
Likes
5
Embeds 0
No embeds

No notes for slide

### Multiobjective optimization and trade offs using pareto optimality

1. 1. MULTI OBJECTIVE OPTIMIZATION AND TRADE OFFS USING PARETO OPTIMALITY Amogh Mundhekar Nikhil Aphale [University at Buffalo, SUNY]
2. 2. Multi-Objective Optimization
3. 3. Multi-Objective Optimization
4. 4. Multi-Objective Optimization•Involves the simultaneous optimization of severalincommensurable and often competing objectives.•These optimal solutions are termed as Pareto optimalsolutions.•Pareto optimal sets are the solutions that cannot beimproved in one objective function withoutdeteriorating their performance in at least one of therest.•Problems usually Conflicting in nature (Ex: Minimizecost, Maximize Productivity)•Designers are required to resolve Trade-offs.
5. 5. Pareto Optimal means: “Take from Peter to pay Paul”
6. 6. Typical Multi-Objective Optimization FormulationMinimize {f1(x),…….,fn(x)}Twhere fi(x) = ith objective function to be minimized, n = number of objectivesSubject to: g(x) ≤ 0; h(x) = 0; x min ≤ (x) ≤ (x max)
7. 7. Basic Terminology Search space or design space is the set of all possible combinations of the design variables. Pareto Optimal Solution achieves a trade off. They are solutions for which any improvement in one objective results in worsening of atleast one other objective. Pareto Optimal Set: Pareto Optimal Solution is not unique, there exists a set of solutions known as the Pareto Optimal Set. It represents a complete set of solutions for a Multi-Objective Optimization (MOO). Pareto Frontier: A plot of entire Pareto set in the Design Objective Space (with design objectives plotted along each axis) gives a Pareto Frontier.
8. 8. Dominated & Non- Dominated points A Dominated design point, is the one for which there exists at least one feasible design point that is better than it in all design objectives. Non Dominated point is the one, where there does not exist any feasible design point better than it. Pareto Optimal points are non-dominated and hence are also known as Non-dominated points.
9. 9. Challenges in the Multi ObjectiveOptimization problem.Challenge 1: Populate the Pareto SetChallenge 2: Select the Best SolutionChallenge 3: Find the corresponding Design Variables
10. 10. Solution methods for Challenge 1Methods discusses in earlier lectures: Random Sampling Weighting Method Distance Method Constrained Trade-off method
11. 11. Solution methods for Challenge 1Methods discusses to be discussed today: Random Sampling Weighting Method Distance Method Constrained Trade-off method Normal Boundary Intersection method Goal Programming Pareto Genetic Algorithm
12. 12. Weighted Sum Approach
13. 13. Weighted Sum Approach Uses weight functions to reflect the importance of each objective. Involves relative preferences. Inter-criteria preference- Preference among several objectives. (e.g. cost > aesthetique) Intra-criterion preference- Preference within an objective. (e.g. 100< mass <200)
14. 14. Drawbacks of Weighted sum method Finding points on the Pareto front by varying the weighting coefficients yields incorrect outputs. Small changes in ‘w’ may cause dramatic changes in the objective vectors. Whereas large changes in ‘w’ may result in almost unnoticeable changes in the objective vectors. This makes the relation between weights and performance very complicated and non-intuitive. Uneven sampling of the Pareto front. Requires Scaling.
15. 15. Drawbacks of Weighted sum method.. For an even spread of the weights, the optimal solutions in the criterion space are usually not evenly distributed Weighted sum method is essentially subjective, in that a Decision Maker needs to provide the weights. This approach cannot identify all non-dominated solutions. Only solutions located on the convex part of the Pareto front can be found. If the Pareto set is not convex, the Pareto points on the concave parts of the trade-off surface will be missed. Does not provide the means to effectively specify intra- criterion preferences.
16. 16. Normal BoundaryIntersections (NBI)
17. 17. Normal Boundary Intersections (NBI) NBI is a solution methodology developed by Das and Dennis (1998) for generating Pareto surface in non-linear multiobjective optimization problems. This method is independent of the relative scales of the objective functions and is successful in producing an evenly distributed set of points in the Pareto surface given an evenly distributed set of parameters, which is an advantage compared to the most common multiobjective approaches—weighting method and the ε-constraint method. A method for finding several Pareto optimal points for a general nonlinear multi criteria optimization problem, aimed at capturing the tradeoff among the various conflicting objectives.
18. 18. Normal Boundary Intersections (NBI) NBI is a solution methodology developed by Das and Dennis (1998) for generating Pareto surface in non-linear multiobjective optimization problems. This method is independent of the relative scales of the objective functions and is successful in producing an evenly distributed set of points in the Pareto surface given an evenly distributed set of parameters, which is an advantage compared to the most common multiobjective approaches—weighting method and the ε-constraint method. A method for finding several Pareto optimal points for a general nonlinear multi criteria optimization problem, aimed at capturing the tradeoff among the various conflicting objectives.
19. 19. Payoff Matrix (n x n)
20. 20. Pareto Frontier using NBI Where, fN – Nadir point fU – Utopia point
21. 21. Convex Hull of Individual Minima (CHIM) The set of points in objective space that are convex combinations of each row of payoff table, is referred to as the Convex Hull of Individual Minima (CHIM).
22. 22. Formulation of NBI Sub ProblemWhere, n : Normal Vector from CHIM towards the origin D : Represents the set of points on the normal. Beta : Weight The vector constraint F(x) ensures that the point x is actually mapped by F to a point on the normal, while the remaining constraints ensure feasibility of x with respect to the original problem (MOP).
23. 23. NBI algorithm
24. 24. Advantages of NBI Finds a uniform spread of Pareto points. NBI improves on other traditional methods like goal programming in the sense that it never requires any prior knowledge of feasible goals. It improves on multilevel optimization techniques from the tradeoff standpoint, since multilevel techniques usually can only improve only a few of the most important objectives, leaving no compromise for the rest.
25. 25. Goal Programmingzi - WGP + WGP Target value Mi - + dGP dGP
26. 26. History Goal programming was first used by Charnes and Cooper in 1955.The first engineering application of goalprogramming, was by Ignizio in 1962: Designing and placing of the antennas on the second stage of the Saturn V.
27. 27. How this method works?Requirements:1) Choosing either Max or Min the objective2) Setting a target or a goal value for each objective3) Designer specifies - WGP & WGP +Therefore, indicate penalties for deviating from either sidesBasic principle:Minimize the deviation of eachdesign objective from its target value - +Deviational variables dGP & dGP
28. 28. zi - WGP + WGP Target value Mi - + dGP dGP
29. 29. The Game
30. 30. Advantages and disadvantages 1) Simplicity and ease of use 2) It is better than weighted sum method because the designer specify two different values of weights for each objective on the two sides of the target value 1) Specifying weights for the designer preference is not easy 2) What about…?
31. 31. Testing for ParetoWhy the solution was not a Pareto optimal?Because the designer set a pessimistic target value
32. 32. Larbani & Aounini methodGoal programming method: (Program 1) The output of Program 1 is X1Pareto Method: (Program 2) The output of Program 2 is X2 If X1 is a solution of program 2, therefore it is Pareto optimal solution and vice versa
33. 33. Multiobjective Optimization using Pareto Genetic Algorithm
34. 34. Genetic Algorithms (GAs) :Adaptive heuristic search algorithm based on theevolutionary ideas of natural selection.Darvin’s Theory:The individuals who best adapt to the environment arethe ones who will most likely survive.
35. 35. Important Concepts in GAs1. Fitness: Each nondominated point in a model should be equally important and considered an optimal goal. Nondominated rank procedure.
36. 36. 2. Reproductiona. Crossover:Produces new individuals incombining the informationcontained in two or more parents.b. Mutation:Altering individuals with lowprobability of survival.
37. 37. 3. Niche Maintaining variety Genetic Drift
38. 38. 4. Pareto Set Filter Reproduction cannot guarantee that best characteristics of the parents are inherited by their next generation. Some of them maybe Pareto optimal points Filter pools nondominated points ranked 1 at each generation and drops dominated points.
39. 39. NNP: no. ofnondominatedpointsPFS: Pareto setFilter Size
40. 40. Detailed Algorithm Pn= Population Size
41. 41. Constrained Multiobjective Optimization via GAs Transform a constrained optimization problem into an unconstrained one via penalty function method. Minimize F(x) subject to, g(x) <= 0 h(x) = 0 Transform to, Minimize Φ(x) = F(x) + rp P(x) A penalty term is added to the fitness of an infeasible point so that its fitness never attains that of a feasible point.
42. 42. Fuzzy Logic (FL) Penalty Function Method Derives from the fact that classes and concepts for natural phenomenon tend to be fuzzy instead of crisp. Fuzzy Set  A point is identified with its degree of membership in that set. A fuzzy set A in X( a collection of objects) is defined as,μ mapping from X to unit interval [0,1] called as membership A : function  0: worst possible case  1: best possible case
43. 43.  When treating a points violated amount for constraints, a fuzzy quantity- such as the points relationship to feasible zone as very close, close , far, very far- can provide the information required for GA ranking. Fuzzy penalty function For any point k, KD value depends on membership function.
44. 44.  Entire search space is divided into zones. Penalty value increases from zone to zone. Same penalty for points in the same zone.
45. 45.  Advantages of GAs  Doesn’t require gradient information  Only input information required from the given problem is fitness of each point in present model population.  Produce multiple optima rather than single local optima. Disadvantages  Not good when Function evaluation is expensive.  Large computations required.