Planning Algorithms


Published on

Planning Algorithms

Published in: Education, Technology, Real Estate
  • Be the first to comment

  • Be the first to like this

No Downloads
Total views
On SlideShare
From Embeds
Number of Embeds
Embeds 0
No embeds

No notes for slide

Planning Algorithms

  1. 1. Exam Format <ul><li>4 questions </li></ul><ul><ul><li>You must do all questions </li></ul></ul><ul><ul><li>There is choice within some of the questions </li></ul></ul><ul><li>Learning Outcomes: </li></ul><ul><ul><li>Explain the main approaches in classical planning as well as recent methods of planning </li></ul></ul><ul><ul><li>Understand and discuss the advantages and limitations of these approaches </li></ul></ul><ul><ul><li>Apply the presented planning algorithms to unseen examples </li></ul></ul>
  2. 2. Questions <ul><li>Question 1 </li></ul><ul><ul><li>Short essay discussing different planning technologies and their advantages and disadvantages </li></ul></ul><ul><ul><li>LO2: Comparing different planners and discussing their strengths and weaknesses </li></ul></ul><ul><li>Questions 2 and 3 </li></ul><ul><ul><li>Apply the planning algorithms we studied to a particular problem </li></ul></ul><ul><ul><li>LO3: apply an algorithm to an unseen example </li></ul></ul><ul><ul><li>You will have some choice about which algorithms to apply </li></ul></ul><ul><ul><li>Do read the question carefully! </li></ul></ul>
  3. 3. Questions, ctd. <ul><li>Question 4 </li></ul><ul><ul><li>Short answers discussing particular planning algorithms and how they work </li></ul></ul><ul><ul><li>You’ll need to know about things like the Sussman anomaly, mutexes, partial order planning, etc </li></ul></ul><ul><ul><li>Not details of the algorithms, but the ideas that are behind them </li></ul></ul><ul><ul><li>LO1: explain a planning algorithm </li></ul></ul>
  4. 4. Algorithms You Should Know <ul><li>The situation calculus </li></ul><ul><ul><li>Frame problem </li></ul></ul><ul><li>STRIPS </li></ul><ul><ul><li>Sussmann anomaly </li></ul></ul><ul><li>Non-Linear planning / Plan-space planning </li></ul><ul><li>Graphplan </li></ul><ul><li>SATPlan </li></ul><ul><ul><li>The Davis-Putnam procedure </li></ul></ul><ul><ul><li>How to translate a planning problem into a SAT problem </li></ul></ul><ul><li>Hierarchical Planning </li></ul><ul><ul><li>Situation abstraction </li></ul></ul><ul><ul><li>Operator abstraction </li></ul></ul><ul><ul><li>HTNs </li></ul></ul>
  5. 5. 2006 Exam <ul><li>Describe the difference between a state-space and plan-space planner. What are their strengths and weaknesses? What kinds of problems (if any) can one solve but not the other? </li></ul><ul><ul><li>State-space planners build plans by searching in the graph of the state-transition system. Plan-space planners build plans by incrementally adding actions or constraints to a partial plan </li></ul></ul><ul><ul><li>Because of this, a solution is a partial order for which all consistent total orders are executable plans </li></ul></ul><ul><ul><li>Plan-space planners separate the actions in a plan from the order they are done in, so the control strategy of the planner has less influence on the kinds of plans that can be generated </li></ul></ul><ul><ul><li>The plan space makes the reasons for plan structure explicit, so explanation is easier </li></ul></ul><ul><ul><li>The state space is typically assumed to be finite, while the plan space is not </li></ul></ul><ul><ul><li>The search space is simpler, so state-space planners are often faster, and scale better </li></ul></ul><ul><ul><li>Both problems can in theory solve the same set of problems - the differences come from the specific search algorithms of planners, not from the state-space/plan-space approach. (2) </li></ul></ul>
  6. 6. 2006 Exam <ul><li>Hierarchical Task Networks (HTNs) are another planning approach that has been quite successful in some problems. Describe HTN planning, how it differs from classical planning approaches such as STRIPS, and suggest (with reasons) some domains in which it might be particularly appropriate. </li></ul><ul><ul><li>In classical planning the objective is to find a set of actions from a start state to a goal state. In HTN planning it is rather to provide a way of achieving a task or set of tasks. Tasks are divided into primitive tasks that can be executed directly, and non-primitive tasks which must be decomposed. Task decomposition is performed using a library of methods, each of which is a way to turn a more abstract task into a sequence of simpler tasks. Thus HTN planning differs from classical planners in that they are hierarchical rather than working in a flat space, and in the fact that the methods encode very specific information about solving problems, so the planning problem contains far more domain knowledge. HTN planners have been successful in areas where domain experts can fairly easily encode what needs to be done in terms of ``recipes'' to follow. A good example is in computer games. </li></ul></ul>
  7. 7. 2006 Exam: Domain
  8. 8. 2006 Exam <ul><li>Above is a planning domain involving driving vehicles and travelling between locations. Show in detail how STRIPS solves this problem. Assume optimal choices. </li></ul><ul><li>Discuss the reasons why STRIPS is incomplete. Use examples to illustrate problems STRIPS cannot solve, and explain why not </li></ul><ul><ul><li>STRIPS only searches for actions to achieve the preconditions of the last operator added to the plan. This means that interleaving actions from different parts of the plan is impossible. For example, the switching variable values problem is unsolvable by STRIPS because it will make the first assignment, commit to the plan to solve that subgoal, and then be unable to make the second assignment as the value it needs to move has already been overwritten </li></ul></ul>
  9. 9. 2006 Exam <ul><li>Explain the approach used in planning as satisfiability algorithms such as SATPLAN. Contrast it with the approach in the situation calculus. </li></ul><ul><ul><li>The idea in SATplan is to define the initial and goal state, as well as all the operators in propositional logic, and use efficient SAT solvers to find a model of all formulae which then corresponds to a plan. SitCalc uses first order logic rather than propositional logic, and solves the problem by deductive reasoning, rather than simply finding an assignment of values to variables that satisfies the formula </li></ul></ul><ul><li>Show how the initial state and goal in the driving domain above could be represented as a satisfiability problem. How are the planning operators represented? </li></ul><ul><ul><li>At(Jack, here,0)  At(Bulldozer, here,0)  Vehicle(Bulldozer,0)  Mobile(Jack, 0)  Person(Jack,0)  ...  At(Bulldozer, there,1)  At(Jack, here, 1) </li></ul></ul><ul><ul><li>In rules, all variables are instantiated by all possible values up to a particular evaluation depth, so all actions can be applied at any point in the plan. Each rule is an implication (if this is true at time t, then this is true at t+1) </li></ul></ul>
  10. 10. 2006 Exam <ul><li>Draw a plan graph for this problem, showing all the mutexes, and the final plan found. Note that you do not need to show all the smaller plan graphs created before the final one. </li></ul><ul><li>This version of the problem is unsolvable. Show the plan graph for this problem and explain how GraphPlan knows that there is no solution. </li></ul><ul><li>What would STRIPS do on the problem in Part (b)? </li></ul>