SlideShare a Scribd company logo
1 of 7
Download to read offline
JOURNAL OF GUIDANCE, CONTROL, AND DYNAMICS
Vol. 25, No. 1, January– February 2002



                     Direct Trajectory Optimization by a Chebyshev
                                 Pseudospectral Method
                                                    Fariba Fahroo¤ and I. Michael Ross†
                                           Naval Postgraduate School, Monterey, California 93943


                     We present a Chebyshev pseudospectral method for directly solving a generic Bolza optimal control problem
                  with state and control constraints. This method employs Nth-degree Lagrange polynomial approximationsfor the
                  state and control variables with the values of these variables at the Chebyshev– Gauss– Lobatto (CGL) points as
                  the expansion coef cients. This process yields a nonlinear programming problem (NLP) with the state and control
                  values at the CGL points as unknown NLP parameters. Numerical examples demonstrate that this method yields
                  more accurate results than those obtained from the traditional collocation methods.



                          I.   Introduction                                         cients. When the properties of the Chebyshev polynomials are used,

I   N recent years, direct solution methods have been used exten-                   the state equations,performanceindex, and the boundary conditions
    sively in a variety of trajectory optimization problems.1;2 Their               are converted to algebraic or transcendental equations in terms of
advantage over indirect methods, which rely on solving the nec-                     these unknown coef cients. In this manner, conversion of the orig-
essary conditions derived from the Pontryagin et al. minimum                        inal optimal control problem to an NLP is achieved.
principle,3 is that direct method algorithms have better convergence                   Recently, Elnagar et al.8 and Fahroo and Ross9;12;13 have used
properties.In addition,because the necessaryconditionsdo not have                   the idea of expansion of the state and control variables in terms
to be derived, the direct methods can be quickly used to solve a num-               of Lagrange polynomials at suitably chosen points, the Legendre–
ber of practical trajectory optimization problems.                                  Gauss– Lobatto (LGL) nodes. This idea is the basis for pseudospec-
   Direct methods are based on discretizing the control time his-                   tral methods, which are used extensivelyfor solving uid dynamics
tory and/or state variable time history at the nodes of discretization,             problems.14;15 In approximatingoptimal control problems, with this
transforming the optimal control problem to a nonlinear program-                    choice of node points and properties of the Lagrange polynomials,
ming problem (NLP), and then solving the resulting NLP. In direct                   the state equations and the possible state and control constraints are
collocation schemes, which discretize both the control and state                    readily transformed to algebraic equations in terms of values of the
variables, the unknowns are the values of the controls and the states               state and control variables at the nodes. Differential constraints are
at these nodes. The cost function and the state equations can be ex-                imposed only at the LGL points by way of a differentiation opera-
pressed in terms of these values. An interpolation scheme is used                   tor (matrix). In this sense, the pseudospectral methods are different
to obtain the time histories of both the control and the state vari-                from other collocation schemes,1;2;4 where higher-order numerical
ables. In the traditional collocation schemes, piecewise-continuous                 integration techniques are used to approximate the differential con-
polynomials such as linear or cubic splines are used as the inter-                  straints not only at the nodes but at points in between (midpoints,
polating polynomials over each time segment.4;5 Satisfaction of the                 for example, as in Hermite– Simpson).
state differential equations is achieved by using some form of inte-                   In this paper, we present a Chebyshev pseudospectral method
gration scheme over each subinterval, which results in formulation                  and consider differential constraints given in terms of controlled
of defects. One of the popular schemes is the Hermite– Simpson                      differentialinclusions,differential algebraic equations (DAEs), and
rule, which amounts to Simpson’s quadrature rule over the subin-                    ordinarydifferentialequations(ODEs). Our method applies without
tervals (see Ref. 4). Recently, Gauss– Lobatto quadrature rules such                change to all of these types of constraints and, thus, encompasses a
as trapezoidal, Simpson’s, or higher-order rules with Jacobi poly-                  wider range of problems than the usual collocation methods. Note
nomials as the interpolant have also been used for collocation (see                 that, while revising this paper, the parallel work of Elnagar and
Refs. 6 and 7).                                                                     Razzaghi16 came to our attention. We pay homage to their work
   In literature,the choice of polynomialspace for expansionof state                and cite some key differences. The authors of Ref. 16 also propose
and control variables is not limited to piecewise-continuouspolyno-                 a Chebyshev pseuodospectral method for solving a variety of op-
mials and in fact globally orthogonalpolynomials such as Legendre                   timal control problems. One major difference between their work
and Chebyshev polynomials or Lagrange interpolatingpolynomials                      and ours is the way the integral cost function is approximated.They
have been used for approximating the control and state variables in                 employ a cell-averaging technique, whereas we use the Clenshaw–
nonlinear optimal control problems.8¡11 In general, there are two                   Curtis quadrature scheme (see Refs. 17 and 18) for discretizing the
ways to construct a polynomial approximation to the solution y.t /:                 cost function. The focus of their paper is mostly on handling the
One is to use an interpolatingpolynomialbetween the values y.t j / at               discontinuousfunctions, which indeed establishes and validates the
some points t j : The other is to use a series expansion in terms of or-            power and range of applicability of pseudospectral methods to op-
thogonal polynomials. In Refs. 10 and 11, the latter idea is pursued,               timal control problems with discontinuous controls. In our effort to
and both the states and the controlvariablesare expandedin terms of                 show the power of pseudospectral methods, we apply it to a more
Chebyshev polynomials with unknown generalized Fourier coef -                       general class of problems including DAEs and differential inclu-
                                                                                    sions. Thus, in this sense, our paper is complementary to that of
   Received 24 July 2000; revision received 17 May 2001; accepted for               Ref. 16. It should be noted that an earlier version of this present
publication 22 May 2001. This material is declared a work of the U.S.               paper appeared in Ref. 19.
Government and is not subject to copyright protection in the United States.            One notable advantage of using Chebyshev pseudospectral
Copies of this paper may be made for personal or internal use, on condition         method over other direct collocation methods is the high degree of
that the copier pay the $10.00 per-copy fee to the Copyright Clearance
Center, Inc., 222 Rosewood Drive, Danvers, MA 01923; include the code
                                                                                    accuracythat pseudospectralapproximationsoffer.17 One reason for
0731-5090/02 $10.00 in correspondence with the CCC.                                 this is the choice of node points as the Chebyshev– Gauss– Lobatto
   ¤ Associate Professor, Department of Mathematics, Code MA/Ff;                    (CGL) points that result in interpolatingpolynomialsthat are closest
ffahroo@nps.navy.mil. Senior Member AIAA.                                           to the optimal polynomial in the max-norm approximation of any
   † Associate Professor, Department of Aeronautics and Astronautics, Code          function. Also the derivatives of these interpolating polynomials
AA/Ro; imross@nps.navy.mil. Associate Fellow AIAA.                                  can be calculated exactly at these nodes by a differentiation matrix.

                                                                              160
FAHROO AND ROSS                                                                        161


Aside from their popularity in engineering applications,Chebyshev
                                                                                                     µ                                       ¶
                                                                                                             2
polynomials have the added computational advantage in that their                            fl · f                x.t /; x.t /; u.t /; ¿ .t/ · fu
                                                                                                                  P                                                      (10)
corresponding CGL points can be evaluated in closed form. Thus,                                          ¿ f ¡ ¿0
the Chebyshev pseudospectralmethod offers the possibility of rapid                                                                                                       (11)
                                                                                            Ãl · Ã[x.¡1/; x.1/; ¿ f ¡ ¿0 ] · Ãu
trajectory optimization because it does not require the use of ad-
vanced numerical linear algebra techniques that are necessary for                           gl · g[u.t /; x.t/; ¿ .t/] · gu                                              (12)
the calculation of LGL points and weights.20 In the three numeri-
cal examples presented in this paper, the results clearly show that                         To re ect transformation of the time domain, one must use differ-
Chebyshev polynomials are very effective in direct optimization                             ent symbols. However, for the purpose of brevity we retain these
techniques and offer superior results to those of the existing collo-                       symbols. Thus, in this context, one must view x.t /; for example, as
cation methods.
                                                                                                               x[¿ .t/] D xf[.¿ f ¡ ¿0 /t C .¿ f C ¿0 /]=2g
                      II.     Problem Formulation
  Consider the following optimal control problem. Determine the                                           III.     Chebyshev Pseudospectral Method
control function u.¢/ and the correspondingstate trajectory x.¢/ that                          The Chebyshev pseudospectral method is one special case of a
minimize the Bolza cost function:                                                           more general class of spectral methods.15 The basic formulation
                                                Z    ¿f                                     of these methods involves two essential steps: One is to choose a
J [x.¢/; u.¢/; ¿ f ] D M[x.¿ f /; ¿ f ] C                 L[x.¿ /; u.¿ /; ¿ ] d¿    (1)       nite-dimensional space (usually a polynomial space) from which
                                                    ¿0                                      an approximationto the solution of the differentialequationis made.
                                                                                            The other step is to choose a projection operator, which imposes the
where ¿ 2 R, x 2 R n , u 2 R m , M : R n £ R ! R, and L : R n £ R m £
                                                                                            differential equation in the nite-dimensional space. One impor-
R ! R. We assume the dynamic constraints to be given by the
                                                                                            tant feature of spectral methods, which distinguishes them from
following system of controlled differential inclusions:
                                                                                              nite element or nite difference methods, is that the underlying
         fl · f [P .¿ /; x.¿ /; u.¿ /; ¿ ] · fu ;
                 x                                              ¿ 2 [¿0 ; ¿ f ]     (2)     polynomial space is spanned by orthogonal polynomials that are
                                                                                            in nitely differentiableglobal functions. Among examples of these
where f : R n £ R n £ R m £ R ! R n : This formulation generalizes                          orthogonalpolynomials are Legendre and Chebyshev polynomials,
and uni es much of the previous apparently distinct formula-                                which are orthogonal on the interval [¡1; 1]; with respect to an ap-
tions.7;21 For example, if we set the lower and upper bounds equal                          propriate weight function [w.t / D 1 for Legendre polynomials, and
                                                                                                       p
to zero, we get a controlled DAE,                                                           w.t/ D 1= .1 ¡ t 2 / for Chebyshev polynomials of the rst kind].
                                                                                            In pseudospectral methods, the functions are expanded in terms of
            f [P .¿ /; x.¿ /; u.¿ /; ¿ ] D 0;
               x                                             ¿ 2 [¿0 ; ¿ f ]        (3)     interpolating polynomials so that the expansion coef cients are the
                                                                                            values of the functionat the node points. Because an arbitrarychoice
If, in addition, we assume that the Jacobian @f =@ x is nonsingular,
                                                   P
                                                                                            of node points can give very poor results in interpolation, different
then Eq. (3) may be reduced to a controlled ODE,
                                                                                            Gauss quadrature points are chosen to give the best accuracy in
             x.¿ / D f [x.¿ /; u.¿ /; ¿ ];
             P                                             ¿ 2 [¿0 ; ¿ f ]          (4)     interpolation of a function. The derivatives of these interpolating
                                                                                            polynomials at these node points are given exactly by a differenti-
Furthermore, for u 2 U , the following hodograph transformation                             ation matrix. These two important aspects (choice of interpolating
may be used to transform the controlled ODE to an ordinary differ-                          polynomials as the trial functions and Gauss quadrature points) of
ential inclusion:                                                                           pseudospectral methods separate them from the other collocation
                                                                                            methods. In the Chebyshev pseudospectral method, the interpola-
P
x.¿ / 2 f y.¿ / j y.¿ / D f[x.¿ /; u.¿ /; ¿ ]; u 2 U g;                 ¿ 2 [¿0 ; ¿ f ]     tion points are given in closed form,
                                                                                    (5)
                                                                                                                 tk D cos.¼ k = N /;             k D 0; : : : ; N        (13)
We elaborateon these formulations further in the numerical section.
In addition, we assume the boundary conditions to be given by the                              These points lie in the interval [¡1; 1] and are the extrema of the
relations                                                                                   N th-order Chebyshev polynomial TN .t /. The j th-order Chebyshev
                                                                                    (6)     polynomial is expressed by
                 Ãl · Ã[x.¿0 /; x.¿ f /; .¿ f ¡ ¿0 /] · Ã u
where à :   Rn£    Rn
                    £R!             Rp
                               and Ãl and à u 2                Rp
                                                   are constantvec-                                         T j .t / D cos. j cos¡1 t /;              j D 0; : : : ; N   (14)
tors representing the lower and upper bounds of these inequalities.
Possible state and control constraints are formulated as mixed con-                         which yields
straints,                                                                                                                 T j .tk / D cos.¼ k j = N /
 gl · g[x.¿ /; u.¿ /; ¿ ] · gu ;                g : Rn £ R m £ R ! Rr               (7)
                                                                                               Thus, T0 .t / D 1; T1 .t / D t; T2 .t / D 2t 2 ¡ 1; T3 .t / D 4t 3 ¡ 3t , and
where gl and gu 2 R r denote the lower and upper bounds of g.                               so on. These node points have the distribution property that they
Clearly, an equality constraint may be obtained by simply setting                           cluster around the endpoints of the interval. This clustering results
the lower and upper bounds to be equal.Thus, this formulationis not                         in avoidance of the Runge phenomenon, which is the divergence at
only more general, but is also more elegant than the one that sepa-                         the endpointsof interpolationon equispacedinterpolationpoints. In
rately identi es equality and inequality constraintson the states and                       fact, it has been shown that interpolationat the CGL nodes gives the
control variables.                                                                          closest result to the optimal polynomial approximation to a given
   In the numerical approximation of the optimal control problem,                           function. This slight error from optimality is given by the Lebesgue
because the node points (CGL) lie in the computational interval                             constant, which is the smallest for the CGL nodes distribution (see
[¡1; 1]; the problem is transformed to this interval by the linear                          Ref. 17).
transformation for t 2 [t0 ; t N ] D [¡1; 1]:                                                  For approximatingthe continuousequations,we seek polynomial
                                                                                            approximations of the form
                      ¿ D [.¿ f ¡ ¿0 /t C .¿ f C ¿0 /]=2                            (8)
                                                                                                                                       X
                                                                                                                                       N
resulting in the following reformulationof Eqs. (1), (2), (6), and (7):                                                    x N .t/ D         x j Á j .t /                (15)
                                                                                                                                       jD0
J [x.¢/; u.¢/; ¿ f ] D M[x.1/; ¿ f ]
                      ´Z     1                                                                                                         X
                                                                                                                                       N
           ¿ f ¡ ¿0                                                                                                       u N .t/ D          u j Á j .t /                (16)
     C                           L[x.t /; u.t /; ¿ .t/] dt                          (9)
               2            ¡1                                                                                                         jD0
162                                                                                FAHROO AND ROSS


where, for j D 0; 1; : : : ; N ,                                                             For the off-diagonal elements, from Eq. (20) we can easily see that
                                                                                                                                         ´
                                .¡1/    j C1           t2P
                                                .1 ¡ / TN .t/                                            ck .¡1/ j C k              ck              .¡1/ j C k
                    Á j .t/ D                                                                Dk j D                    D
                                  N 2c j            t ¡ tj                                               c j tk ¡ t j               cj       .¡t N ¡ k / ¡ .¡t N ¡ j /
are the Lagrange interpolating polynomials of order N (see the Ap-                                              ´
                                                                                                           ck        .¡1/ j C k       Q
pendix for a derivation), with                                                                       D                            D ¡ Dk j                                             (22)
                            »                                                                              cj        ¡.tk ¡ tQj /
                                                                                                                       Q
                                2;          j D 0; N
                     cj D                                                                         Therefore, we have
                                1;          1· j · N ¡1
                                                                                                                                         Q
                                                                                                                                         Dk j D ¡Dk j                                  (23)
From its interpolating property, the Lagrange polynomials satisfy
the condition                                                                                Additionally,the original matrix D has another symmetry property,
                                            »
                                       1;              if     j Dk                           which can be easily shown by the preceding relationships22 :
                  Á j .tk / D ± jk   D
                                       0;              if     j 6D k                                                             Dk j D ¡D N ¡ k;N ¡ j                                 (24)
Hence, it follows that
                                                                                             Using Eqs. (23) and (24) and denoting the values of the approximate
                   x N .tk / D xk ;                u N .tk / D uk                   (17)     states at the sorted CGL points by
   In other words, the node points are the interpolating points. To                                                    x N ¡ k D x N .t N ¡ k / D x N .tQk / D xk
                                                                                                                                                  Q            Q
express the derivative x N .t/ in terms of x N .t/ at the node points tk ;
                       P
we differentiate Eq. (15), which results in a matrix multiplicationof                        we have
the following form14;15 :
                                                                                                           X
                                                                                                           N                             X
                                                                                                                                         N

                                     X
                                     N                        X
                                                              N                              x N .tk / D
                                                                                             P                       Dk j x N .t j / D          Q             Q                PN
                                                                                                                                                D N ¡ k;N ¡ j x N .tQN ¡ j / D x .tQN ¡ k /
                                                                                                                                                                               Q
                   P  N
              dk D x .tk / D                    P
                                            x j Á j .tk / D          Dk j x j       (18)                    jD0                           jD0
                                     j D0                     j D0                                                                                                                     (25)
                                                                                             or more succinctly, we have
where Dk j are entries of the .N C 1/ £ .N C 1/ differentiation ma-
trix D                                                                                                                            P           PN
                                                                                                                             dk D x N .tk / D x .tQN ¡ k /
                                                                                                                                              Q                                        (26)
                  8          £         ¯            ¤
                                   jCk
                  >.ck =c j / .¡1/
                  > ¯ ¡
                                         .tk ¡ t j / ;                    j 6D k
                                                                                             This result shows that the sorting of the CGL points does not affect
                  >
                  <                 ¢
                                  2
                    ¡tk 2 1 ¡ tk ;                               1· j Dk · N ¡1              the underlying de nitions and formulation of the pseudospectral
D :D [Dk j ] :D                                                                              method. One can now proceed with the formulation of the NLP
                  >.2N 2 C 1/=6;
                  >                                                       j DkD0
                  >
                  :                                                                          with the sorted CGL points. In the formulation to come, we drop
                    ¡.2N 2 C 1/=6;                                        jDkDN              the tilde notation with the understanding that the sorted points are
                                                                                             used as the node points in the differentiation matrix and elsewhere.
                                                                                    (19)
Multiplication by this matrix, transforms a vector of the state vari-                        B.     NLP Formulation
ables at the CGL points to the vector of approximate derivatives at                             The state equationsand the initialand terminalstate conditionsare
these points.                                                                                discretized by rst substituting Eqs. (15), (16), and (18) in Eq. (10)
                                                                                             and collocating at the CGL nodes tk , The state equations are trans-
A.    Modi cation of the Chebyshev Differentiation Matrix                                    formed into the following algebraic inequalities:
    The de nitions of the CGL points and the given differentiation
matrix are the standardones in the literatureon spectralmethods.15;17                              fl · f [2=.¿ f ¡ ¿0 / dk ; xk ; uk ; ¿k ] · fu ;                  k D 0; : : : ; N
However, in our implementation of this method for discretizing op-
timal control problems, it is more convenient to modify these def-                           where dk is as de ned in Eq. (26). The initial and terminal state
initions. The CGL points as de ned by Eq. (13) are from 1 to ¡1,                             conditions are given by
that is, the initial point is 1 and the nal point is ¡1. For trajec-
tory optimization problems, it is more convenient to take the ini-                                                     Ãl · Ã[x0 ; x N ; .¿ f ¡ ¿0 /] · Ã u
tial point at ¡1 and the nal point at 1. This sorting modi es the
de nition of the differentiation matrix in the following sense: Us-                          The control inequality constraints are approximated by
ing the de nition of Eq. (19), we will show that the new matrix with                                                          gl · g.xk ; uk ; ¿k / · gu
                          Q
the sorted points, D is of the opposite sign of the matrix with the
unsorted points, D. To see this, note that in the de nition of ma-                              Next, the cost function in Eq. (9) is discretized: We use the
trix D, the points t0 D 1; t1 ; : : : ; t N ¡ 1 ; t N D ¡1 are used, and for                 Clenshaw– Curtis quadrature scheme (see Ref. 17, chapter 12) to
           Q
matrix D, the sorted points tQ0 D ¡1; : : : ; tQN D 1; are used, that is,                    discretize the integral part of the cost function to a nite sum. The
t N ¡ k D tQk ; k D 0; : : : ; N . For the CGL points, we have the following                 idea is based on nding optimal weights wk for a given set of CGL
symmetry relationship:                                                                       points tk such that the approximation
                            tk D ¡t N ¡ k D ¡tQk                                    (20)                   Z     1                  X
                                                                                                                                    N
                                                                                                                     p.t / dt D              p.tk /wk ;          p.t / 2 P N
which yields
                                                                                                                ¡1                  kD0
               tk ¡ t j D ¡.t N ¡ k ¡ t N ¡ j / D ¡.tQk ¡ tQj /
                                                                                             for P N ; the space of polynomials of degree ·N , is exact. For N
For the elements D00 and D NN ; it can be easily shown that                                  even, the weights are17;18
         Q
         D00 D D NN D ¡D00 ;                       Q
                                                   D NN D D00 D ¡D NN                                                                                  1
                                                                                                                                w0 D w N D                                             (27)
                                                                                                                                                     N2 ¡ 1
                                                                       2
  For the other diagonal elements,                    Dkk D ¡tk 2.1 ¡ tk /,
                                                                      =            from
                                                                                                                             N =2 00
Eq. (20) we have                                                                                                       4X    1        2¼ j s                                           N
                                                                                                  ws D w N ¡ s       D            cos        ;                        s D 1; : : : ;
                     tN ¡ k           Q
                                      t                                                                                N  1 ¡4j 2      N                                               2
                                                                                                                             j D0
             Dkk D ¡           ¢ D ¡ k 2 ¢ D ¡ Dkk
                                               Q                                    (21)
                         2
                  2 1 ¡ tN ¡ k    2 1 ¡ tQk                                                                                                                                            (28)
FAHROO AND ROSS                                                                      163


For N odd, the weights are given by17                                                             Table 1   Comparison of cost functions for various methods
                                                                                                                                       Ã
                                                                                                                and formulations for N = 11
           1
w0 D w N D 2                                                                       (29)          Method                                   Ji      j Ji ¡ Jana j   Np
          N
                                 00
                                                                                                 Analytic solution                  1.253314
                   4 X
                     .N ¡ 1/=2                                                                   Collocation (Simpson)              1.253005       0.000309       34
                                  1         2¼ j s
ws D w N ¡ s     D                      cos                                                      Collocation ( fth-degree GL)       1.253183       0.000131       84
                   N           1 ¡ 4 j2      N                                                   Pseudospectral (CGL)               1.253309       0.000005       34
                       jD0
                                                                                                 Pseudospectral (DAE)               1.253366       0.000052       23
                                                       N ¡1
                                                            (30)
                                                          s D 1; : : : ;
                                                         2
In the preceding summations, the double prime means that the rst                                Let X , Y , and 2 representthe solution vectorto this problemat the
and the last elements have to be halved.                                                    CGL nodes. Then the NLP for this problem is simply to minimize
   Therefore, the cost function in terms of the coef cients                                 ¿ f subject to the equality constraints
                                                                                                                                    p
          X D .x0 ; x1 ; : : : ; x N /;            U D .u0 ; u1 ; : : : ; u N /                                .2=¿ f /D ¤ X ¡          2gY cos 2 D 0              (39)
                                                                                                                                    p
can be discretized as                                                                                          .2=¿ f /D ¤ Y ¡          2gY sin 2 D 0              (40)

                                          ¿ f ¡ ¿0 X
                                                     N
                                                                                            and
 J .X; U; ¿ f / ¼ M.x N ; ¿ f / C                       L.xk ; uk ; ¿k /wk         (31)
                                              2    k D0                                                   X .0/ D Y .0/ D 0;               X .N / ¡ 0:5 D 0
  Thus, the optimal control problemin Eqs. (9– 12) is approximated                          All operations in the preceding equations are array operations, that
by the following nonlinear optimization problem: Find coef cients                           is, term-by-term,whereas the asteriskis used to denote matrix multi-
                                                                                            plication. With this notation, the striking resemblance of the NLP to
          X D .x0 ; x1 ; : : : ; x N /;            U D .u0 ; u1 ; : : : ; u N /             the originalproblemis immediately apparent.The analyticsolutions
                                                                                            to this problem are the equations of a cycloid,
and possibly the nal time ¿ f to minimize
                                                                                                       x.¿ / D .g¿ f =¼ /f¿ ¡ .¿ f =¼ / sin[¼.1 ¡ ¿ =¿ f /]g       (41)
                                        ¿ f ¡ ¿0 X
                                                  N
                                                                                                                  ¡      ¯      ¢
     J N .X; U; ¿ f / D M.x N ; ¿ f / C              L.xk ; uk ; ¿k /wk                                   y.¿ / D 2g¿ 2 ¼ 2 cos2 [.¼ =2/.1 ¡ ¿ =¿ f /]             (42)
                                            2    kD0
                                                                                                                      f

                                                                                   (32)     The optimal control (angle) is given by the following expression:
subject to                                                                                                                                                         (43)
                                                                                                                   µ .¿ / D .¼ =2/.1 ¡ ¿ =¿ f /
     fl · f[2=.¿ f ¡ ¿0 /dk ; xk ; uk ; ¿k ] · fu ;            k D 0; : : : ; N    (33)
                                                                                            From x.¿ f / D 0:5; Eq. (41), and g D 1, the minimum time calculated
                                                                                                                            p
              gl · g.xk ; uk ; ¿k / · gu ;                k D 0; : : : ; N         (34)     to six decimal places is ¿ f D .0:5¼ / D 1:253314:
                                                                                               The Chebyshev pseudospectral method was used for discretiza-
                      Ãl · Ã[x0 ; x N ; .¿ f ¡ ¿0 /] · Ã u                         (35)     tion of the problemand NPSOL 24 was utilized as the NLP solver.The
                                                                                            implementation was performed in MATLAB ® via the use of MEX
From the preceding equations, one can see the simplicity of the                               les. In Table 1, we compare the minimum cost function obtained
method, which retains much of the structure of the continuous                               from our method to the ones from the Simpson collocation method
problem.                                                                                    and a fth-degree Gauss– Lobatto method reported in Ref. 7. All
                                                                                                                       O                       O
                                                                                            reported results are for N D 11 nodes, where N D N C 1: The vari-
                       IV.     Numerical Examples                                           able N p in the last column of Table 1 stands for the total number
                                                                                            of NLP variables, which includes the free nal time as well. Note
   In this section, we present three numerical examples that are in-                        that for the fth-degree Gauss– Lobatto (GL) collocation method
tended to illustrate separate points. In the rst example, we choose                         (done the traditional way), the number of NLP variables are signif-
the benchmark brachistochrone problem discussed in Ref. 7 and                               icantly higher than the pseudospectralmethod for the same number
demonstrate the accuracy of our technique. In the second example,                           of nodes. In any case, it is evident that even for a low number degree
we reformulate the brachistochrone problem as a DAE and show                                of discretization (and number of NLP variables), the Chebyshev
how our method remains unchanged.In the third and nal problem,                              pseudospectral method gives results superior to either of the other
we solve the moon-landing problem23 formulated as a differential                            collocation methods.
inclusion by a hodograph transformation.                                                       In Figs. 1 and 2, we show the time historiesof the state and control
                                                                                                                                            O
                                                                                            variables against the analytic solutions for N D 11. The solid lines
A.    Example 1: Brachistochrone as an ODE                                                  representthe analytic solutionsand ¤ is for the solutionsfrom the nu-
   In this well-known problem, the control problem is formulated                            merical method. The graphs clearly demonstrate the accuracy of the
as nding the shape of a wire so that a bead sliding on the wire                             results from the Chebyshev pseudospectralmethod. Note that from
will reach a given horizontal displacement in minimum time. No                              Ref. 7 the collocation solutions are generally accurate to O.10¡4 /;
frictional forces are considered, and the gravity force is uniform.                         which is about the same order of accuracy for the Chebyshev pseu-
The problem is then to minimize ¿ f subject to the equations                                dospectral method for this number of nodes. However, the order of
                                          p                                                 accuracy in the control for the other collocation methods is about
                                 xD
                                 P            2gy cos µ                            (36)     O.10¡2 / [with a maximum pointwise error at the rst node of about
                                          p                                                 O.10¡1 /], whereas for our method the maximum pointwise error is
                                 yD
                                 P            2gy sin µ                            (37)     of order O.10¡3 /.

with boundary conditions                                                                    B.    Example 2: Brachistochrone as a DAE
                                                                                              Here we eliminate the control variable µ and rewrite Eqs. (36)
                   x.0/ D y.0/ D 0;                   x.¿ f / D 0:5                (38)     and (37) in terms of a single fully implicit DAE [see Eq. (3)]:

The control, angle µ ; is the slope of the wire as a function of time.                                                   x 2 C y 2 D 2gy
                                                                                                                         P     P                                   (44)
164                                                                 FAHROO AND ROSS


                                                                              subject to the equations of motion
                                                                                                                  dh
                                                                                                                     Dv                                    (47)
                                                                                                                  d¿
                                                                                                              dv        T
                                                                                                                 D ¡g C                                    (48)
                                                                                                              d¿        m
                                                                                                               dm     T
                                                                                                                  D¡                                       (49)
                                                                                                               d¿    Isp g

                                                                              where the state variablesh; v, and m are altitude,speed,and mass, re-
                                                                              spectively.The control is providedby the thrust T , which is bounded
                                                                              by

                                                                                                              0 · T · Tmax

                                                                              The other parameters in the problem are g; the gravity of moon (or
                                                                              any planet without an atmosphere), and Isp , the speci c impulse of
                                                                              the propellent.Given any set of initial conditions h 0 ; v0 , and m 0 ; the
                                                                              normalized parameters for the problem were arbitrarily chosen as

                                                                                 Tmax =m 0 g D 1:1;              Isp g =v0 D 1;           h.0/= h 0 D 0:5

                                                                                               v.0/=v0 D ¡0:05;                m.0/= m 0 D 1
     Fig. 1    Time history of x and y for the brachistochrone problem.
                                                                                 Therefore, we have the following normalized initial conditions:

                                                                                   h.0/ D 0:5;             v.0/ D ¡0:05;                m.0/ D 1:0         (50)

                                                                              For soft landing, we must have

                                                                                                     h.¿ f / D 0;           v.¿ f / D 0                    (51)

                                                                                 In addition, for a physically meaningful trajectory, we must have

                                                                                                                m.¿ f / > 0                                (52)

                                                                              The discrete differential inclusion version of these equations for
                                                                              the variables H D [h.t0 /; h.t1 /; : : : ; h.t N /]T , V D [v.t0 /; v.t1 /; : : : ;
                                                                              v.t N /]T , and M D [m.t0 /; m.t1 /; : : : ; m.t N /]T can be formulated as

                                                                                                         .2=¿ f /D ¤ H ¡ V D 0                             (53)

                                                                                           M[.2=¿ f /D ¤ V C g] C Isp g[.2=¿ f /D ¤ M] D 0                 (54)

                                                                                                  0 · ¡Isp g[.2=¿ f /D ¤ M ] · Tmax                        (55)




 Fig. 2       Time history of control µ for the brachistochrone problem.


Thus, there is a reduction in the number of NLP variables by N ,O
the number of CGL points. The DAE constraint is discretized at the
CGL points resulting in
              ¡ ¯ 2¢              ¡ ¯ ¢
              4 ¿ f .D ¤ X /2 C 4 ¿ 2 .D ¤ Y /2 ¡ 2gY D 0
                                    f                                (45)

From Table 1, we see that, although the degree of accuracy for
the cost function is not as high as the original formulation, it is
still better than the results from the other collocation methods. The
accuracy of the solutions is still of the order of O.10¡4 /. Therefore,
the pseudospectral method can handle formulation of the problem
as an DAE without sacri cing accuracy.

C.     Example 3: Moon-Landing Problem as a Differential Inclusion
  The control problem is formulated as maximizing the nal mass
and, hence, minimizing

                                J D ¡m.¿ f /                         (46)         Fig. 3     Phase portrait of h vs v for the moon-landing problem.
FAHROO AND ROSS                                                                                   165


                                                                                        De ning
                                                                                                                                     Y
                                                                                                                                     N
                                                                                                                          w.t / D          .t ¡ tm /
                                                                                                                                     mD0

                                                                                     we easily obtain
                                                                                     w 0 .tk / D .tk ¡ t0 /.tk ¡ t1 /; : : : ; .tk ¡ tk ¡ 1 /.tk ¡ tk C 1 /; : : : ; .tk ¡ t N /
                                                                                                 Y
                                                                                                 N
                                                                                           D              .tk ¡ tm /
                                                                                                 m D0
                                                                                                 m 6D k


                                                                                     Therefore, we have
                                                                                                                                      w.t /      1
                                                                                                                        Ák .t / D
                                                                                                                                    .t ¡ tk / w 0 .tk /
                                                                                        From the de nition of the CGL points that are the extrema of TN
                                                                                                      0
                                                                                     or the zeros of TN .t/, and t0 D 1; t N D ¡1; we can write
                                                                                      0
                                                                                     TN .t/ D .t ¡ t1 /.t ¡ t2 /; : : : ; .t ¡ t N ¡ 1 /

                                                                                                 Y
                                                                                                 N
                                                                                     w.t/ D               .t ¡ tm / D .t ¡ t0 /.t ¡ t1 /; : : : ; .t ¡ t N ¡ 1 /.t ¡ t N /
Fig. 4    Time history of m and control T for the moon-landing problem.                          m D0


                                                                                           D .t 2 ¡ 1/TN .t /
                                                                                                       0

   Figure 3 shows the phase portrait projected into the v – h space
                                                                                     For w 0 .tk /, we use that the Chebyshev polynomials are the eigen-
for 32 CGL points. This problem has at most one switch in the
                                                                                     functions of
control variable (Ref. 22), and the results are shown in Fig. 4. The
                                                                                                             £                ¤
control was calculated from Eq. (49). It is clear that the method has                                          .1 ¡ t 2 /TN ¡ t TN C N 2 TN .t/ D 0
                                                                                                                          00     0
adequately captured the optimal bang– bang structure of the control
with one switch.                                                                     From this expression and the equation for w.t /, we have
                                                                                                                    £                    ¤0
                                 V.       Conclusions                                                 w 0 .t/ D ¡.1 ¡ t 2 /TN
                                                                                                                            0
                                                                                                                                              D N 2 TN .t/ C t TN
                                                                                                                                                                0
                                                                                                                                                                        (A2)
   The simplicity, ef ciency, and versatility of the Chebyshev pseu-
dospectral method allows one to perform rapid and accurate tra-                        Evaluating the preceding expressionat t D tk , k 6D 0, N , and using
                                                                                           0
jectory optimization. A low degree of discretization appears to be                   that TN .tk / D 0, for k D 1; : : : ; N ¡ 1, and TN .tk / D cos.¼ k N = N / D
suf cient to generate good results. Because the CGL points and                       .¡1/k , k D 1; : : : ; N ¡ 1, we have
weights can be quickly evaluated, it suggests that the technique has
a high potential for use in optimal guidance algorithms that require                                 w 0 .tk / D .¡1/k N 2 ;                   k D 1; : : : ; N ¡ 1
a corrective maneuver from the perturbed trajectory. In any case,
reference optimal paths can be easily generated, and the numerical                      For k D 0; N , we use the following identities:
examples indicate that the converged solutions are indeed optimal.
Further tests and analysis are necessary to investigate the stability                                        TN .t0 D 1/ D 1;                   TN .1/ D N 2
                                                                                                                                                 0

and accuracy of the method.
                                                                                              TN .t N D ¡1/ D .¡1/ N ;                          TN .¡1/ D .¡1/ N N 2
                                                                                                                                                 0


         Appendix: Derivation of Lagrange Polynomials                                which give us from Eq. (A2)
                       for CGL Nodes
   We derive the following expressionfor the Lagrange polynomials                                     w 0 .1/ D 2N 2 ;                 w0 .¡1/ D 2.¡1/ N N 2
of order N interpolating a function at the CGL nodes:
                                                                                     Finally, we have
                                                           P
                                      .¡1/k C 1 .1 ¡ t 2 / TN .t/
                    Ák .t/ D                                                                       w.t/ 1          .t 2 ¡ 1/TN .t / .¡1/k
                                                                                                                                0
                                        N k
                                         2c        .t ¡ tk /                         Ák .t / D                   D
                                                                                                  t ¡ tk w k
                                                                                                          0 .t /        .t ¡ tk /    N 2 ck
where                                                                                                       0
                                 »                                                               .1 ¡ t 2 /TN .t / .¡1/k C 1
                                             k D 0; N                                      D
                                     2;                                                             .t ¡ tk /        N 2 ck
                     ck D                                                  (A1)
                                     1;      1· k · N ¡1                             where ck is as de ned in Eq. (A1).
TN .t/ is the Chebyshev polynomialof degree N , and tk are the CGL                                                            References
points over the interval [¡1, 1]:                                                       1 Betts, J. T., “Survey of Numerical Methods for Trajectory Optimization,”

                                                                                     Journal of Guidance, Control, and Dynamics, Vol. 21, No. 2, 1998, pp. 193–
                tk D cos.¼ k = N /;                  k D 0; : : : ; N                207.
                                                                                        2 Hull, D. G., “Conversion of Optimal Control Problems into Parame-

Differentiation is denoted by a prime.                                               ter Optimization Problems,” Journal of Guidance, Control, and Dynamics,
   The general expression for a Lagrange interpolating polynomial                    Vol. 20, No. 1, 1997, pp. 57 – 60.
                                                                                        3 Pontryagin,L. S., Boltyanskii, V. G., Gamkrelidze, R. V., and Mischenko,
at N distinct nodes tk is
                                                                                     E. F., The Mathematical Theory of Optimal Processes, Interscience, New
                        Y .t ¡ tm /
                        N                                                            York, 1962, pp. 1 – 114.
                                                                                        4 Hargraves, C. R., and Paris, S. W., “Direct Trajectory Optimization Using
             Ák .t/ D                         ;         k D 0; : : : ; N
                        m D 0
                                 .tk ¡ tm /                                          Nonlinear Programming and Collocation,” Journal of Guidance, Control,
                        m 6D k                                                       and Dynamics, Vol. 10, No. 4, 1987, pp. 338– 342.
166                                                                   FAHROO AND ROSS


   5 von Stryk, O., “Numerical Solution of Optimal Control Problems by
                                                                                Methods in Fluid Dynamics, Springer-Verlag, New York, 1988.
                                                                                   15 Gottlieb, D., Hussaini, M. Y., and Orszag, S. A., “Theory and Ap-
Direct Collocation,” Optimal Control, edited by R. Bulirsch, A. Miele, and
J. Stoer, Birkh¨ user Verlag, Basel, Switzerland, 1993, pp. 129– 143.
                a                                                               plications of Spectral Methods,” Spectral Methods for PDE’s, edited by
   6 Herman, A. H., and Conway, B. A., “Direct Optimization Using Col-          R. G. Voigt, D. Gottlieb, and M. Y. Hussaini, Society for Industrial and
location Based on High-Order Gauss– Lobatto Quadrature Rules,” Jour-            Applied Mathematics, Philadelphia, 1984, pp. 1 – 54.
                                                                                   16
nal of Guidance, Control, and Dynamics, Vol. 19, No. 3, 1996, pp. 592–                Elnagar, G., and Kazemi, M. A., “Pseudospectral Chebyshev Optimal
599.                                                                            Control of Constrained Nonlinear Dynamical Systems,” ComputationalOp-
   7 Conway, B. A., and Larson, K. M., “Collocation Versus Differential         timization and Applications, Vol. 11, 1998, pp. 195– 217.
Inclusion in Direct Optimization,” Journal of Guidance, Control, and Dy-           17 Trefethen, L. N., Spectral Methods in MATLAB, Society for Industrial

namics, Vol. 21, No. 5, 1998, pp. 780– 785.                                     and Applied Mathematics, Philadelphia, 2000.
   8 Elnagar, J., Kazemi, M. A., and Razzaghi, M., “The Pseudospectral Leg-        18 Davis, P. J., and Rabinowitz, P., Methods of Numerical Integration,

endre Method for Discretizing Optimal Control Problems,” IEEE Transac-          Academic, New York, 1977, p. 68.
tions on Automatic Control, Vol. 40, No. 10, 1995, pp. 1793– 1796.                 19 Fahroo, F., and Ross, I. M., “Direct Trajectory Optimization by Cheby-
   9 Fahroo, F., and Ross, I. M., “Costate Estimation by a Legendre Pseu-       shev Pseudospectral Method,” Proceedings of the American Control Con-
dospectral Method,” Journal of Guidance, Control, and Dynamics, Vol. 24,        ference, Inst. of Electrical and Electronics Engineers, New York, 2000, pp.
No. 2, 2001, pp. 270– 277.                                                      3860– 3864.
   10                                                                              20
      Vlassenbroeck, J., and Van Doreen, R., “A Chebyshev Technique for               Golub, G. H., “Some Modi ed Matrix Eigenvalue Problems,” SIAM
Solving Nonlinear Optimal Control Problems,” IEEE Transaction on Auto-          Review, Vol. 15, No. 2, 1973, pp. 318– 334.
matic Control, Vol. 33, No. 4, 1988, pp. 333– 340.                                 21 Brenan, K. E., “Differential-Algebraic Equations Issues in the Direct
   11 Vlassenbroeck, J., “A Chebyshev Polynomial Method for Optimal Con-        Transcription of Path Constrained Optimal Control Problems,” Annals of
trol with State Constraints,” Automatica, Vol. 24, No. 4, 1988, pp. 499– 506.   Numerical Mathematics, Vol. 1, 1994, pp. 247– 263.
   12 Fahroo,F., and Ross, I. M., “Second Look at ApproximatingDifferential        22 Solomonoff, A., “A Fast Algorithm for Spectral Differentiation,” Jour-

Inclusions,” Journal of Guidance, Control, and Dynamics, Vol. 24, No. 1,        nal of Computational Physics, Vol. 98, 1992, pp. 174– 177.
2001, pp. 131– 133.                                                                23 Knowles, G., An Introduction to Applied Optimal Control, Academic,
   13
      Fahroo, F., and Ross, I. M., “A Spectral Patching Method for Direct       New York, 1981, pp. 50 – 55.
Trajectory Optimization,” American Astronautical Society, Paper AAS 00-            24 Gill, P. E., Murray, W., Saunders, M. A., and Wright, M. A., “User’s

260, 20 – 21 March 2000; also Journal of Astronautical Sciences, Vol. 48,       Guide to NPSOL 5.0: A Fortran Package for Nonlinear Programming,” Stan-
No. 2/3, 2000, pp. 269– 286.                                                    ford Optimization Lab., Technical Rept. SOL 86-1, Stanford Univ., Stanford,
   14 Canuto, C., Hussaini, M. Y., Quarteroni, A., and Zang, T. A., Spectral    CA, July 1998.

More Related Content

Similar to Direct trajectory optimization by a chebyshev pseudospectral method

Cross-checking of numerical-experimental procedures for interface characteriz...
Cross-checking of numerical-experimental procedures for interface characteriz...Cross-checking of numerical-experimental procedures for interface characteriz...
Cross-checking of numerical-experimental procedures for interface characteriz...Diego Scarpa
 
Cfd aero
Cfd aeroCfd aero
Cfd aerofdamec
 
Parameter Estimation using Experimental Bifurcation Diagrams
Parameter Estimation using Experimental Bifurcation DiagramsParameter Estimation using Experimental Bifurcation Diagrams
Parameter Estimation using Experimental Bifurcation DiagramsAndy Salmon
 
An Algebraic Multigrid Solver For Transonic Flow Problems
An Algebraic Multigrid Solver For Transonic Flow ProblemsAn Algebraic Multigrid Solver For Transonic Flow Problems
An Algebraic Multigrid Solver For Transonic Flow ProblemsLisa Muthukumar
 
Review and Assessment of Turbulence Transition Models
Review and Assessment of Turbulence Transition ModelsReview and Assessment of Turbulence Transition Models
Review and Assessment of Turbulence Transition ModelsIJERDJOURNAL
 
Final Paper
Final PaperFinal Paper
Final PaperM M
 
An Exact Branch And Bound Algorithm For The General Quadratic Assignment Problem
An Exact Branch And Bound Algorithm For The General Quadratic Assignment ProblemAn Exact Branch And Bound Algorithm For The General Quadratic Assignment Problem
An Exact Branch And Bound Algorithm For The General Quadratic Assignment ProblemJoe Andelija
 
Approaches To The Solution Of Intertemporal Consumer Demand Models
Approaches To The Solution Of Intertemporal Consumer Demand ModelsApproaches To The Solution Of Intertemporal Consumer Demand Models
Approaches To The Solution Of Intertemporal Consumer Demand ModelsAmy Isleb
 
A Robust Method Based On LOVO Functions For Solving Least Squares Problems
A Robust Method Based On LOVO Functions For Solving Least Squares ProblemsA Robust Method Based On LOVO Functions For Solving Least Squares Problems
A Robust Method Based On LOVO Functions For Solving Least Squares ProblemsDawn Cook
 
ABDO_MLROM_PHYSOR2016
ABDO_MLROM_PHYSOR2016ABDO_MLROM_PHYSOR2016
ABDO_MLROM_PHYSOR2016Mohammad Abdo
 
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...Joe Osborn
 
Piecewise Controller Design for Affine Fuzzy Systems
Piecewise Controller Design for Affine Fuzzy SystemsPiecewise Controller Design for Affine Fuzzy Systems
Piecewise Controller Design for Affine Fuzzy SystemsISA Interchange
 
Piecewise controller design for affine fuzzy systems
Piecewise controller design for affine fuzzy systemsPiecewise controller design for affine fuzzy systems
Piecewise controller design for affine fuzzy systemsISA Interchange
 
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...IRJET Journal
 
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...Jim Jimenez
 

Similar to Direct trajectory optimization by a chebyshev pseudospectral method (20)

Cross-checking of numerical-experimental procedures for interface characteriz...
Cross-checking of numerical-experimental procedures for interface characteriz...Cross-checking of numerical-experimental procedures for interface characteriz...
Cross-checking of numerical-experimental procedures for interface characteriz...
 
Cfd aero
Cfd aeroCfd aero
Cfd aero
 
Parameter Estimation using Experimental Bifurcation Diagrams
Parameter Estimation using Experimental Bifurcation DiagramsParameter Estimation using Experimental Bifurcation Diagrams
Parameter Estimation using Experimental Bifurcation Diagrams
 
An Algebraic Multigrid Solver For Transonic Flow Problems
An Algebraic Multigrid Solver For Transonic Flow ProblemsAn Algebraic Multigrid Solver For Transonic Flow Problems
An Algebraic Multigrid Solver For Transonic Flow Problems
 
Review and Assessment of Turbulence Transition Models
Review and Assessment of Turbulence Transition ModelsReview and Assessment of Turbulence Transition Models
Review and Assessment of Turbulence Transition Models
 
PhysRevE.91.023310.pdf
PhysRevE.91.023310.pdfPhysRevE.91.023310.pdf
PhysRevE.91.023310.pdf
 
Final Paper
Final PaperFinal Paper
Final Paper
 
Characteristics and simulation analysis of nonlinear correlation coefficient ...
Characteristics and simulation analysis of nonlinear correlation coefficient ...Characteristics and simulation analysis of nonlinear correlation coefficient ...
Characteristics and simulation analysis of nonlinear correlation coefficient ...
 
10.1.1.34.7361
10.1.1.34.736110.1.1.34.7361
10.1.1.34.7361
 
An Exact Branch And Bound Algorithm For The General Quadratic Assignment Problem
An Exact Branch And Bound Algorithm For The General Quadratic Assignment ProblemAn Exact Branch And Bound Algorithm For The General Quadratic Assignment Problem
An Exact Branch And Bound Algorithm For The General Quadratic Assignment Problem
 
Numeros complejos y_azar
Numeros complejos y_azarNumeros complejos y_azar
Numeros complejos y_azar
 
gamdependence_revision1
gamdependence_revision1gamdependence_revision1
gamdependence_revision1
 
Approaches To The Solution Of Intertemporal Consumer Demand Models
Approaches To The Solution Of Intertemporal Consumer Demand ModelsApproaches To The Solution Of Intertemporal Consumer Demand Models
Approaches To The Solution Of Intertemporal Consumer Demand Models
 
A Robust Method Based On LOVO Functions For Solving Least Squares Problems
A Robust Method Based On LOVO Functions For Solving Least Squares ProblemsA Robust Method Based On LOVO Functions For Solving Least Squares Problems
A Robust Method Based On LOVO Functions For Solving Least Squares Problems
 
ABDO_MLROM_PHYSOR2016
ABDO_MLROM_PHYSOR2016ABDO_MLROM_PHYSOR2016
ABDO_MLROM_PHYSOR2016
 
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...
A Cell-Based Variational Inequality Formulation Of The Dynamic User Optimal A...
 
Piecewise Controller Design for Affine Fuzzy Systems
Piecewise Controller Design for Affine Fuzzy SystemsPiecewise Controller Design for Affine Fuzzy Systems
Piecewise Controller Design for Affine Fuzzy Systems
 
Piecewise controller design for affine fuzzy systems
Piecewise controller design for affine fuzzy systemsPiecewise controller design for affine fuzzy systems
Piecewise controller design for affine fuzzy systems
 
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...
Development, Optimization, and Analysis of Cellular Automaton Algorithms to S...
 
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...
A Real Coded Genetic Algorithm For Solving Integer And Mixed Integer Optimiza...
 

Recently uploaded

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 

Recently uploaded (20)

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 

Direct trajectory optimization by a chebyshev pseudospectral method

  • 1. JOURNAL OF GUIDANCE, CONTROL, AND DYNAMICS Vol. 25, No. 1, January– February 2002 Direct Trajectory Optimization by a Chebyshev Pseudospectral Method Fariba Fahroo¤ and I. Michael Ross† Naval Postgraduate School, Monterey, California 93943 We present a Chebyshev pseudospectral method for directly solving a generic Bolza optimal control problem with state and control constraints. This method employs Nth-degree Lagrange polynomial approximationsfor the state and control variables with the values of these variables at the Chebyshev– Gauss– Lobatto (CGL) points as the expansion coef cients. This process yields a nonlinear programming problem (NLP) with the state and control values at the CGL points as unknown NLP parameters. Numerical examples demonstrate that this method yields more accurate results than those obtained from the traditional collocation methods. I. Introduction cients. When the properties of the Chebyshev polynomials are used, I N recent years, direct solution methods have been used exten- the state equations,performanceindex, and the boundary conditions sively in a variety of trajectory optimization problems.1;2 Their are converted to algebraic or transcendental equations in terms of advantage over indirect methods, which rely on solving the nec- these unknown coef cients. In this manner, conversion of the orig- essary conditions derived from the Pontryagin et al. minimum inal optimal control problem to an NLP is achieved. principle,3 is that direct method algorithms have better convergence Recently, Elnagar et al.8 and Fahroo and Ross9;12;13 have used properties.In addition,because the necessaryconditionsdo not have the idea of expansion of the state and control variables in terms to be derived, the direct methods can be quickly used to solve a num- of Lagrange polynomials at suitably chosen points, the Legendre– ber of practical trajectory optimization problems. Gauss– Lobatto (LGL) nodes. This idea is the basis for pseudospec- Direct methods are based on discretizing the control time his- tral methods, which are used extensivelyfor solving uid dynamics tory and/or state variable time history at the nodes of discretization, problems.14;15 In approximatingoptimal control problems, with this transforming the optimal control problem to a nonlinear program- choice of node points and properties of the Lagrange polynomials, ming problem (NLP), and then solving the resulting NLP. In direct the state equations and the possible state and control constraints are collocation schemes, which discretize both the control and state readily transformed to algebraic equations in terms of values of the variables, the unknowns are the values of the controls and the states state and control variables at the nodes. Differential constraints are at these nodes. The cost function and the state equations can be ex- imposed only at the LGL points by way of a differentiation opera- pressed in terms of these values. An interpolation scheme is used tor (matrix). In this sense, the pseudospectral methods are different to obtain the time histories of both the control and the state vari- from other collocation schemes,1;2;4 where higher-order numerical ables. In the traditional collocation schemes, piecewise-continuous integration techniques are used to approximate the differential con- polynomials such as linear or cubic splines are used as the inter- straints not only at the nodes but at points in between (midpoints, polating polynomials over each time segment.4;5 Satisfaction of the for example, as in Hermite– Simpson). state differential equations is achieved by using some form of inte- In this paper, we present a Chebyshev pseudospectral method gration scheme over each subinterval, which results in formulation and consider differential constraints given in terms of controlled of defects. One of the popular schemes is the Hermite– Simpson differentialinclusions,differential algebraic equations (DAEs), and rule, which amounts to Simpson’s quadrature rule over the subin- ordinarydifferentialequations(ODEs). Our method applies without tervals (see Ref. 4). Recently, Gauss– Lobatto quadrature rules such change to all of these types of constraints and, thus, encompasses a as trapezoidal, Simpson’s, or higher-order rules with Jacobi poly- wider range of problems than the usual collocation methods. Note nomials as the interpolant have also been used for collocation (see that, while revising this paper, the parallel work of Elnagar and Refs. 6 and 7). Razzaghi16 came to our attention. We pay homage to their work In literature,the choice of polynomialspace for expansionof state and cite some key differences. The authors of Ref. 16 also propose and control variables is not limited to piecewise-continuouspolyno- a Chebyshev pseuodospectral method for solving a variety of op- mials and in fact globally orthogonalpolynomials such as Legendre timal control problems. One major difference between their work and Chebyshev polynomials or Lagrange interpolatingpolynomials and ours is the way the integral cost function is approximated.They have been used for approximating the control and state variables in employ a cell-averaging technique, whereas we use the Clenshaw– nonlinear optimal control problems.8¡11 In general, there are two Curtis quadrature scheme (see Refs. 17 and 18) for discretizing the ways to construct a polynomial approximation to the solution y.t /: cost function. The focus of their paper is mostly on handling the One is to use an interpolatingpolynomialbetween the values y.t j / at discontinuousfunctions, which indeed establishes and validates the some points t j : The other is to use a series expansion in terms of or- power and range of applicability of pseudospectral methods to op- thogonal polynomials. In Refs. 10 and 11, the latter idea is pursued, timal control problems with discontinuous controls. In our effort to and both the states and the controlvariablesare expandedin terms of show the power of pseudospectral methods, we apply it to a more Chebyshev polynomials with unknown generalized Fourier coef - general class of problems including DAEs and differential inclu- sions. Thus, in this sense, our paper is complementary to that of Received 24 July 2000; revision received 17 May 2001; accepted for Ref. 16. It should be noted that an earlier version of this present publication 22 May 2001. This material is declared a work of the U.S. paper appeared in Ref. 19. Government and is not subject to copyright protection in the United States. One notable advantage of using Chebyshev pseudospectral Copies of this paper may be made for personal or internal use, on condition method over other direct collocation methods is the high degree of that the copier pay the $10.00 per-copy fee to the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923; include the code accuracythat pseudospectralapproximationsoffer.17 One reason for 0731-5090/02 $10.00 in correspondence with the CCC. this is the choice of node points as the Chebyshev– Gauss– Lobatto ¤ Associate Professor, Department of Mathematics, Code MA/Ff; (CGL) points that result in interpolatingpolynomialsthat are closest ffahroo@nps.navy.mil. Senior Member AIAA. to the optimal polynomial in the max-norm approximation of any † Associate Professor, Department of Aeronautics and Astronautics, Code function. Also the derivatives of these interpolating polynomials AA/Ro; imross@nps.navy.mil. Associate Fellow AIAA. can be calculated exactly at these nodes by a differentiation matrix. 160
  • 2. FAHROO AND ROSS 161 Aside from their popularity in engineering applications,Chebyshev µ ¶ 2 polynomials have the added computational advantage in that their fl · f x.t /; x.t /; u.t /; ¿ .t/ · fu P (10) corresponding CGL points can be evaluated in closed form. Thus, ¿ f ¡ ¿0 the Chebyshev pseudospectralmethod offers the possibility of rapid (11) Ãl · Ã[x.¡1/; x.1/; ¿ f ¡ ¿0 ] · Ãu trajectory optimization because it does not require the use of ad- vanced numerical linear algebra techniques that are necessary for gl · g[u.t /; x.t/; ¿ .t/] · gu (12) the calculation of LGL points and weights.20 In the three numeri- cal examples presented in this paper, the results clearly show that To re ect transformation of the time domain, one must use differ- Chebyshev polynomials are very effective in direct optimization ent symbols. However, for the purpose of brevity we retain these techniques and offer superior results to those of the existing collo- symbols. Thus, in this context, one must view x.t /; for example, as cation methods. x[¿ .t/] D xf[.¿ f ¡ ¿0 /t C .¿ f C ¿0 /]=2g II. Problem Formulation Consider the following optimal control problem. Determine the III. Chebyshev Pseudospectral Method control function u.¢/ and the correspondingstate trajectory x.¢/ that The Chebyshev pseudospectral method is one special case of a minimize the Bolza cost function: more general class of spectral methods.15 The basic formulation Z ¿f of these methods involves two essential steps: One is to choose a J [x.¢/; u.¢/; ¿ f ] D M[x.¿ f /; ¿ f ] C L[x.¿ /; u.¿ /; ¿ ] d¿ (1) nite-dimensional space (usually a polynomial space) from which ¿0 an approximationto the solution of the differentialequationis made. The other step is to choose a projection operator, which imposes the where ¿ 2 R, x 2 R n , u 2 R m , M : R n £ R ! R, and L : R n £ R m £ differential equation in the nite-dimensional space. One impor- R ! R. We assume the dynamic constraints to be given by the tant feature of spectral methods, which distinguishes them from following system of controlled differential inclusions: nite element or nite difference methods, is that the underlying fl · f [P .¿ /; x.¿ /; u.¿ /; ¿ ] · fu ; x ¿ 2 [¿0 ; ¿ f ] (2) polynomial space is spanned by orthogonal polynomials that are in nitely differentiableglobal functions. Among examples of these where f : R n £ R n £ R m £ R ! R n : This formulation generalizes orthogonalpolynomials are Legendre and Chebyshev polynomials, and uni es much of the previous apparently distinct formula- which are orthogonal on the interval [¡1; 1]; with respect to an ap- tions.7;21 For example, if we set the lower and upper bounds equal propriate weight function [w.t / D 1 for Legendre polynomials, and p to zero, we get a controlled DAE, w.t/ D 1= .1 ¡ t 2 / for Chebyshev polynomials of the rst kind]. In pseudospectral methods, the functions are expanded in terms of f [P .¿ /; x.¿ /; u.¿ /; ¿ ] D 0; x ¿ 2 [¿0 ; ¿ f ] (3) interpolating polynomials so that the expansion coef cients are the values of the functionat the node points. Because an arbitrarychoice If, in addition, we assume that the Jacobian @f =@ x is nonsingular, P of node points can give very poor results in interpolation, different then Eq. (3) may be reduced to a controlled ODE, Gauss quadrature points are chosen to give the best accuracy in x.¿ / D f [x.¿ /; u.¿ /; ¿ ]; P ¿ 2 [¿0 ; ¿ f ] (4) interpolation of a function. The derivatives of these interpolating polynomials at these node points are given exactly by a differenti- Furthermore, for u 2 U , the following hodograph transformation ation matrix. These two important aspects (choice of interpolating may be used to transform the controlled ODE to an ordinary differ- polynomials as the trial functions and Gauss quadrature points) of ential inclusion: pseudospectral methods separate them from the other collocation methods. In the Chebyshev pseudospectral method, the interpola- P x.¿ / 2 f y.¿ / j y.¿ / D f[x.¿ /; u.¿ /; ¿ ]; u 2 U g; ¿ 2 [¿0 ; ¿ f ] tion points are given in closed form, (5) tk D cos.¼ k = N /; k D 0; : : : ; N (13) We elaborateon these formulations further in the numerical section. In addition, we assume the boundary conditions to be given by the These points lie in the interval [¡1; 1] and are the extrema of the relations N th-order Chebyshev polynomial TN .t /. The j th-order Chebyshev (6) polynomial is expressed by Ãl · Ã[x.¿0 /; x.¿ f /; .¿ f ¡ ¿0 /] · à u where à : Rn£ Rn £R! Rp and Ãl and à u 2 Rp are constantvec- T j .t / D cos. j cos¡1 t /; j D 0; : : : ; N (14) tors representing the lower and upper bounds of these inequalities. Possible state and control constraints are formulated as mixed con- which yields straints, T j .tk / D cos.¼ k j = N / gl · g[x.¿ /; u.¿ /; ¿ ] · gu ; g : Rn £ R m £ R ! Rr (7) Thus, T0 .t / D 1; T1 .t / D t; T2 .t / D 2t 2 ¡ 1; T3 .t / D 4t 3 ¡ 3t , and where gl and gu 2 R r denote the lower and upper bounds of g. so on. These node points have the distribution property that they Clearly, an equality constraint may be obtained by simply setting cluster around the endpoints of the interval. This clustering results the lower and upper bounds to be equal.Thus, this formulationis not in avoidance of the Runge phenomenon, which is the divergence at only more general, but is also more elegant than the one that sepa- the endpointsof interpolationon equispacedinterpolationpoints. In rately identi es equality and inequality constraintson the states and fact, it has been shown that interpolationat the CGL nodes gives the control variables. closest result to the optimal polynomial approximation to a given In the numerical approximation of the optimal control problem, function. This slight error from optimality is given by the Lebesgue because the node points (CGL) lie in the computational interval constant, which is the smallest for the CGL nodes distribution (see [¡1; 1]; the problem is transformed to this interval by the linear Ref. 17). transformation for t 2 [t0 ; t N ] D [¡1; 1]: For approximatingthe continuousequations,we seek polynomial approximations of the form ¿ D [.¿ f ¡ ¿0 /t C .¿ f C ¿0 /]=2 (8) X N resulting in the following reformulationof Eqs. (1), (2), (6), and (7): x N .t/ D x j Á j .t / (15) jD0 J [x.¢/; u.¢/; ¿ f ] D M[x.1/; ¿ f ] ´Z 1 X N ¿ f ¡ ¿0 u N .t/ D u j Á j .t / (16) C L[x.t /; u.t /; ¿ .t/] dt (9) 2 ¡1 jD0
  • 3. 162 FAHROO AND ROSS where, for j D 0; 1; : : : ; N , For the off-diagonal elements, from Eq. (20) we can easily see that ´ .¡1/ j C1 t2P .1 ¡ / TN .t/ ck .¡1/ j C k ck .¡1/ j C k Á j .t/ D Dk j D D N 2c j t ¡ tj c j tk ¡ t j cj .¡t N ¡ k / ¡ .¡t N ¡ j / are the Lagrange interpolating polynomials of order N (see the Ap- ´ ck .¡1/ j C k Q pendix for a derivation), with D D ¡ Dk j (22) » cj ¡.tk ¡ tQj / Q 2; j D 0; N cj D Therefore, we have 1; 1· j · N ¡1 Q Dk j D ¡Dk j (23) From its interpolating property, the Lagrange polynomials satisfy the condition Additionally,the original matrix D has another symmetry property, » 1; if j Dk which can be easily shown by the preceding relationships22 : Á j .tk / D ± jk D 0; if j 6D k Dk j D ¡D N ¡ k;N ¡ j (24) Hence, it follows that Using Eqs. (23) and (24) and denoting the values of the approximate x N .tk / D xk ; u N .tk / D uk (17) states at the sorted CGL points by In other words, the node points are the interpolating points. To x N ¡ k D x N .t N ¡ k / D x N .tQk / D xk Q Q express the derivative x N .t/ in terms of x N .t/ at the node points tk ; P we differentiate Eq. (15), which results in a matrix multiplicationof we have the following form14;15 : X N X N X N X N x N .tk / D P Dk j x N .t j / D Q Q PN D N ¡ k;N ¡ j x N .tQN ¡ j / D x .tQN ¡ k / Q P N dk D x .tk / D P x j Á j .tk / D Dk j x j (18) jD0 jD0 j D0 j D0 (25) or more succinctly, we have where Dk j are entries of the .N C 1/ £ .N C 1/ differentiation ma- trix D P PN dk D x N .tk / D x .tQN ¡ k / Q (26) 8 £ ¯ ¤ jCk >.ck =c j / .¡1/ > ¯ ¡ .tk ¡ t j / ; j 6D k This result shows that the sorting of the CGL points does not affect > < ¢ 2 ¡tk 2 1 ¡ tk ; 1· j Dk · N ¡1 the underlying de nitions and formulation of the pseudospectral D :D [Dk j ] :D method. One can now proceed with the formulation of the NLP >.2N 2 C 1/=6; > j DkD0 > : with the sorted CGL points. In the formulation to come, we drop ¡.2N 2 C 1/=6; jDkDN the tilde notation with the understanding that the sorted points are used as the node points in the differentiation matrix and elsewhere. (19) Multiplication by this matrix, transforms a vector of the state vari- B. NLP Formulation ables at the CGL points to the vector of approximate derivatives at The state equationsand the initialand terminalstate conditionsare these points. discretized by rst substituting Eqs. (15), (16), and (18) in Eq. (10) and collocating at the CGL nodes tk , The state equations are trans- A. Modi cation of the Chebyshev Differentiation Matrix formed into the following algebraic inequalities: The de nitions of the CGL points and the given differentiation matrix are the standardones in the literatureon spectralmethods.15;17 fl · f [2=.¿ f ¡ ¿0 / dk ; xk ; uk ; ¿k ] · fu ; k D 0; : : : ; N However, in our implementation of this method for discretizing op- timal control problems, it is more convenient to modify these def- where dk is as de ned in Eq. (26). The initial and terminal state initions. The CGL points as de ned by Eq. (13) are from 1 to ¡1, conditions are given by that is, the initial point is 1 and the nal point is ¡1. For trajec- tory optimization problems, it is more convenient to take the ini- Ãl · Ã[x0 ; x N ; .¿ f ¡ ¿0 /] · Ã u tial point at ¡1 and the nal point at 1. This sorting modi es the de nition of the differentiation matrix in the following sense: Us- The control inequality constraints are approximated by ing the de nition of Eq. (19), we will show that the new matrix with gl · g.xk ; uk ; ¿k / · gu Q the sorted points, D is of the opposite sign of the matrix with the unsorted points, D. To see this, note that in the de nition of ma- Next, the cost function in Eq. (9) is discretized: We use the trix D, the points t0 D 1; t1 ; : : : ; t N ¡ 1 ; t N D ¡1 are used, and for Clenshaw– Curtis quadrature scheme (see Ref. 17, chapter 12) to Q matrix D, the sorted points tQ0 D ¡1; : : : ; tQN D 1; are used, that is, discretize the integral part of the cost function to a nite sum. The t N ¡ k D tQk ; k D 0; : : : ; N . For the CGL points, we have the following idea is based on nding optimal weights wk for a given set of CGL symmetry relationship: points tk such that the approximation tk D ¡t N ¡ k D ¡tQk (20) Z 1 X N p.t / dt D p.tk /wk ; p.t / 2 P N which yields ¡1 kD0 tk ¡ t j D ¡.t N ¡ k ¡ t N ¡ j / D ¡.tQk ¡ tQj / for P N ; the space of polynomials of degree ·N , is exact. For N For the elements D00 and D NN ; it can be easily shown that even, the weights are17;18 Q D00 D D NN D ¡D00 ; Q D NN D D00 D ¡D NN 1 w0 D w N D (27) N2 ¡ 1 2 For the other diagonal elements, Dkk D ¡tk 2.1 ¡ tk /, = from N =2 00 Eq. (20) we have 4X 1 2¼ j s N ws D w N ¡ s D cos ; s D 1; : : : ; tN ¡ k Q t N 1 ¡4j 2 N 2 j D0 Dkk D ¡ ¢ D ¡ k 2 ¢ D ¡ Dkk Q (21) 2 2 1 ¡ tN ¡ k 2 1 ¡ tQk (28)
  • 4. FAHROO AND ROSS 163 For N odd, the weights are given by17 Table 1 Comparison of cost functions for various methods à and formulations for N = 11 1 w0 D w N D 2 (29) Method Ji j Ji ¡ Jana j Np N 00 Analytic solution 1.253314 4 X .N ¡ 1/=2 Collocation (Simpson) 1.253005 0.000309 34 1 2¼ j s ws D w N ¡ s D cos Collocation ( fth-degree GL) 1.253183 0.000131 84 N 1 ¡ 4 j2 N Pseudospectral (CGL) 1.253309 0.000005 34 jD0 Pseudospectral (DAE) 1.253366 0.000052 23 N ¡1 (30) s D 1; : : : ; 2 In the preceding summations, the double prime means that the rst Let X , Y , and 2 representthe solution vectorto this problemat the and the last elements have to be halved. CGL nodes. Then the NLP for this problem is simply to minimize Therefore, the cost function in terms of the coef cients ¿ f subject to the equality constraints p X D .x0 ; x1 ; : : : ; x N /; U D .u0 ; u1 ; : : : ; u N / .2=¿ f /D ¤ X ¡ 2gY cos 2 D 0 (39) p can be discretized as .2=¿ f /D ¤ Y ¡ 2gY sin 2 D 0 (40) ¿ f ¡ ¿0 X N and J .X; U; ¿ f / ¼ M.x N ; ¿ f / C L.xk ; uk ; ¿k /wk (31) 2 k D0 X .0/ D Y .0/ D 0; X .N / ¡ 0:5 D 0 Thus, the optimal control problemin Eqs. (9– 12) is approximated All operations in the preceding equations are array operations, that by the following nonlinear optimization problem: Find coef cients is, term-by-term,whereas the asteriskis used to denote matrix multi- plication. With this notation, the striking resemblance of the NLP to X D .x0 ; x1 ; : : : ; x N /; U D .u0 ; u1 ; : : : ; u N / the originalproblemis immediately apparent.The analyticsolutions to this problem are the equations of a cycloid, and possibly the nal time ¿ f to minimize x.¿ / D .g¿ f =¼ /f¿ ¡ .¿ f =¼ / sin[¼.1 ¡ ¿ =¿ f /]g (41) ¿ f ¡ ¿0 X N ¡ ¯ ¢ J N .X; U; ¿ f / D M.x N ; ¿ f / C L.xk ; uk ; ¿k /wk y.¿ / D 2g¿ 2 ¼ 2 cos2 [.¼ =2/.1 ¡ ¿ =¿ f /] (42) 2 kD0 f (32) The optimal control (angle) is given by the following expression: subject to (43) µ .¿ / D .¼ =2/.1 ¡ ¿ =¿ f / fl · f[2=.¿ f ¡ ¿0 /dk ; xk ; uk ; ¿k ] · fu ; k D 0; : : : ; N (33) From x.¿ f / D 0:5; Eq. (41), and g D 1, the minimum time calculated p gl · g.xk ; uk ; ¿k / · gu ; k D 0; : : : ; N (34) to six decimal places is ¿ f D .0:5¼ / D 1:253314: The Chebyshev pseudospectral method was used for discretiza- Ãl · Ã[x0 ; x N ; .¿ f ¡ ¿0 /] · à u (35) tion of the problemand NPSOL 24 was utilized as the NLP solver.The implementation was performed in MATLAB ® via the use of MEX From the preceding equations, one can see the simplicity of the les. In Table 1, we compare the minimum cost function obtained method, which retains much of the structure of the continuous from our method to the ones from the Simpson collocation method problem. and a fth-degree Gauss– Lobatto method reported in Ref. 7. All O O reported results are for N D 11 nodes, where N D N C 1: The vari- IV. Numerical Examples able N p in the last column of Table 1 stands for the total number of NLP variables, which includes the free nal time as well. Note In this section, we present three numerical examples that are in- that for the fth-degree Gauss– Lobatto (GL) collocation method tended to illustrate separate points. In the rst example, we choose (done the traditional way), the number of NLP variables are signif- the benchmark brachistochrone problem discussed in Ref. 7 and icantly higher than the pseudospectralmethod for the same number demonstrate the accuracy of our technique. In the second example, of nodes. In any case, it is evident that even for a low number degree we reformulate the brachistochrone problem as a DAE and show of discretization (and number of NLP variables), the Chebyshev how our method remains unchanged.In the third and nal problem, pseudospectral method gives results superior to either of the other we solve the moon-landing problem23 formulated as a differential collocation methods. inclusion by a hodograph transformation. In Figs. 1 and 2, we show the time historiesof the state and control O variables against the analytic solutions for N D 11. The solid lines A. Example 1: Brachistochrone as an ODE representthe analytic solutionsand ¤ is for the solutionsfrom the nu- In this well-known problem, the control problem is formulated merical method. The graphs clearly demonstrate the accuracy of the as nding the shape of a wire so that a bead sliding on the wire results from the Chebyshev pseudospectralmethod. Note that from will reach a given horizontal displacement in minimum time. No Ref. 7 the collocation solutions are generally accurate to O.10¡4 /; frictional forces are considered, and the gravity force is uniform. which is about the same order of accuracy for the Chebyshev pseu- The problem is then to minimize ¿ f subject to the equations dospectral method for this number of nodes. However, the order of p accuracy in the control for the other collocation methods is about xD P 2gy cos µ (36) O.10¡2 / [with a maximum pointwise error at the rst node of about p O.10¡1 /], whereas for our method the maximum pointwise error is yD P 2gy sin µ (37) of order O.10¡3 /. with boundary conditions B. Example 2: Brachistochrone as a DAE Here we eliminate the control variable µ and rewrite Eqs. (36) x.0/ D y.0/ D 0; x.¿ f / D 0:5 (38) and (37) in terms of a single fully implicit DAE [see Eq. (3)]: The control, angle µ ; is the slope of the wire as a function of time. x 2 C y 2 D 2gy P P (44)
  • 5. 164 FAHROO AND ROSS subject to the equations of motion dh Dv (47) d¿ dv T D ¡g C (48) d¿ m dm T D¡ (49) d¿ Isp g where the state variablesh; v, and m are altitude,speed,and mass, re- spectively.The control is providedby the thrust T , which is bounded by 0 · T · Tmax The other parameters in the problem are g; the gravity of moon (or any planet without an atmosphere), and Isp , the speci c impulse of the propellent.Given any set of initial conditions h 0 ; v0 , and m 0 ; the normalized parameters for the problem were arbitrarily chosen as Tmax =m 0 g D 1:1; Isp g =v0 D 1; h.0/= h 0 D 0:5 v.0/=v0 D ¡0:05; m.0/= m 0 D 1 Fig. 1 Time history of x and y for the brachistochrone problem. Therefore, we have the following normalized initial conditions: h.0/ D 0:5; v.0/ D ¡0:05; m.0/ D 1:0 (50) For soft landing, we must have h.¿ f / D 0; v.¿ f / D 0 (51) In addition, for a physically meaningful trajectory, we must have m.¿ f / > 0 (52) The discrete differential inclusion version of these equations for the variables H D [h.t0 /; h.t1 /; : : : ; h.t N /]T , V D [v.t0 /; v.t1 /; : : : ; v.t N /]T , and M D [m.t0 /; m.t1 /; : : : ; m.t N /]T can be formulated as .2=¿ f /D ¤ H ¡ V D 0 (53) M[.2=¿ f /D ¤ V C g] C Isp g[.2=¿ f /D ¤ M] D 0 (54) 0 · ¡Isp g[.2=¿ f /D ¤ M ] · Tmax (55) Fig. 2 Time history of control µ for the brachistochrone problem. Thus, there is a reduction in the number of NLP variables by N ,O the number of CGL points. The DAE constraint is discretized at the CGL points resulting in ¡ ¯ 2¢ ¡ ¯ ¢ 4 ¿ f .D ¤ X /2 C 4 ¿ 2 .D ¤ Y /2 ¡ 2gY D 0 f (45) From Table 1, we see that, although the degree of accuracy for the cost function is not as high as the original formulation, it is still better than the results from the other collocation methods. The accuracy of the solutions is still of the order of O.10¡4 /. Therefore, the pseudospectral method can handle formulation of the problem as an DAE without sacri cing accuracy. C. Example 3: Moon-Landing Problem as a Differential Inclusion The control problem is formulated as maximizing the nal mass and, hence, minimizing J D ¡m.¿ f / (46) Fig. 3 Phase portrait of h vs v for the moon-landing problem.
  • 6. FAHROO AND ROSS 165 De ning Y N w.t / D .t ¡ tm / mD0 we easily obtain w 0 .tk / D .tk ¡ t0 /.tk ¡ t1 /; : : : ; .tk ¡ tk ¡ 1 /.tk ¡ tk C 1 /; : : : ; .tk ¡ t N / Y N D .tk ¡ tm / m D0 m 6D k Therefore, we have w.t / 1 Ák .t / D .t ¡ tk / w 0 .tk / From the de nition of the CGL points that are the extrema of TN 0 or the zeros of TN .t/, and t0 D 1; t N D ¡1; we can write 0 TN .t/ D .t ¡ t1 /.t ¡ t2 /; : : : ; .t ¡ t N ¡ 1 / Y N w.t/ D .t ¡ tm / D .t ¡ t0 /.t ¡ t1 /; : : : ; .t ¡ t N ¡ 1 /.t ¡ t N / Fig. 4 Time history of m and control T for the moon-landing problem. m D0 D .t 2 ¡ 1/TN .t / 0 Figure 3 shows the phase portrait projected into the v – h space For w 0 .tk /, we use that the Chebyshev polynomials are the eigen- for 32 CGL points. This problem has at most one switch in the functions of control variable (Ref. 22), and the results are shown in Fig. 4. The £ ¤ control was calculated from Eq. (49). It is clear that the method has .1 ¡ t 2 /TN ¡ t TN C N 2 TN .t/ D 0 00 0 adequately captured the optimal bang– bang structure of the control with one switch. From this expression and the equation for w.t /, we have £ ¤0 V. Conclusions w 0 .t/ D ¡.1 ¡ t 2 /TN 0 D N 2 TN .t/ C t TN 0 (A2) The simplicity, ef ciency, and versatility of the Chebyshev pseu- dospectral method allows one to perform rapid and accurate tra- Evaluating the preceding expressionat t D tk , k 6D 0, N , and using 0 jectory optimization. A low degree of discretization appears to be that TN .tk / D 0, for k D 1; : : : ; N ¡ 1, and TN .tk / D cos.¼ k N = N / D suf cient to generate good results. Because the CGL points and .¡1/k , k D 1; : : : ; N ¡ 1, we have weights can be quickly evaluated, it suggests that the technique has a high potential for use in optimal guidance algorithms that require w 0 .tk / D .¡1/k N 2 ; k D 1; : : : ; N ¡ 1 a corrective maneuver from the perturbed trajectory. In any case, reference optimal paths can be easily generated, and the numerical For k D 0; N , we use the following identities: examples indicate that the converged solutions are indeed optimal. Further tests and analysis are necessary to investigate the stability TN .t0 D 1/ D 1; TN .1/ D N 2 0 and accuracy of the method. TN .t N D ¡1/ D .¡1/ N ; TN .¡1/ D .¡1/ N N 2 0 Appendix: Derivation of Lagrange Polynomials which give us from Eq. (A2) for CGL Nodes We derive the following expressionfor the Lagrange polynomials w 0 .1/ D 2N 2 ; w0 .¡1/ D 2.¡1/ N N 2 of order N interpolating a function at the CGL nodes: Finally, we have P .¡1/k C 1 .1 ¡ t 2 / TN .t/ Ák .t/ D w.t/ 1 .t 2 ¡ 1/TN .t / .¡1/k 0 N k 2c .t ¡ tk / Ák .t / D D t ¡ tk w k 0 .t / .t ¡ tk / N 2 ck where 0 » .1 ¡ t 2 /TN .t / .¡1/k C 1 k D 0; N D 2; .t ¡ tk / N 2 ck ck D (A1) 1; 1· k · N ¡1 where ck is as de ned in Eq. (A1). TN .t/ is the Chebyshev polynomialof degree N , and tk are the CGL References points over the interval [¡1, 1]: 1 Betts, J. T., “Survey of Numerical Methods for Trajectory Optimization,” Journal of Guidance, Control, and Dynamics, Vol. 21, No. 2, 1998, pp. 193– tk D cos.¼ k = N /; k D 0; : : : ; N 207. 2 Hull, D. G., “Conversion of Optimal Control Problems into Parame- Differentiation is denoted by a prime. ter Optimization Problems,” Journal of Guidance, Control, and Dynamics, The general expression for a Lagrange interpolating polynomial Vol. 20, No. 1, 1997, pp. 57 – 60. 3 Pontryagin,L. S., Boltyanskii, V. G., Gamkrelidze, R. V., and Mischenko, at N distinct nodes tk is E. F., The Mathematical Theory of Optimal Processes, Interscience, New Y .t ¡ tm / N York, 1962, pp. 1 – 114. 4 Hargraves, C. R., and Paris, S. W., “Direct Trajectory Optimization Using Ák .t/ D ; k D 0; : : : ; N m D 0 .tk ¡ tm / Nonlinear Programming and Collocation,” Journal of Guidance, Control, m 6D k and Dynamics, Vol. 10, No. 4, 1987, pp. 338– 342.
  • 7. 166 FAHROO AND ROSS 5 von Stryk, O., “Numerical Solution of Optimal Control Problems by Methods in Fluid Dynamics, Springer-Verlag, New York, 1988. 15 Gottlieb, D., Hussaini, M. Y., and Orszag, S. A., “Theory and Ap- Direct Collocation,” Optimal Control, edited by R. Bulirsch, A. Miele, and J. Stoer, Birkh¨ user Verlag, Basel, Switzerland, 1993, pp. 129– 143. a plications of Spectral Methods,” Spectral Methods for PDE’s, edited by 6 Herman, A. H., and Conway, B. A., “Direct Optimization Using Col- R. G. Voigt, D. Gottlieb, and M. Y. Hussaini, Society for Industrial and location Based on High-Order Gauss– Lobatto Quadrature Rules,” Jour- Applied Mathematics, Philadelphia, 1984, pp. 1 – 54. 16 nal of Guidance, Control, and Dynamics, Vol. 19, No. 3, 1996, pp. 592– Elnagar, G., and Kazemi, M. A., “Pseudospectral Chebyshev Optimal 599. Control of Constrained Nonlinear Dynamical Systems,” ComputationalOp- 7 Conway, B. A., and Larson, K. M., “Collocation Versus Differential timization and Applications, Vol. 11, 1998, pp. 195– 217. Inclusion in Direct Optimization,” Journal of Guidance, Control, and Dy- 17 Trefethen, L. N., Spectral Methods in MATLAB, Society for Industrial namics, Vol. 21, No. 5, 1998, pp. 780– 785. and Applied Mathematics, Philadelphia, 2000. 8 Elnagar, J., Kazemi, M. A., and Razzaghi, M., “The Pseudospectral Leg- 18 Davis, P. J., and Rabinowitz, P., Methods of Numerical Integration, endre Method for Discretizing Optimal Control Problems,” IEEE Transac- Academic, New York, 1977, p. 68. tions on Automatic Control, Vol. 40, No. 10, 1995, pp. 1793– 1796. 19 Fahroo, F., and Ross, I. M., “Direct Trajectory Optimization by Cheby- 9 Fahroo, F., and Ross, I. M., “Costate Estimation by a Legendre Pseu- shev Pseudospectral Method,” Proceedings of the American Control Con- dospectral Method,” Journal of Guidance, Control, and Dynamics, Vol. 24, ference, Inst. of Electrical and Electronics Engineers, New York, 2000, pp. No. 2, 2001, pp. 270– 277. 3860– 3864. 10 20 Vlassenbroeck, J., and Van Doreen, R., “A Chebyshev Technique for Golub, G. H., “Some Modi ed Matrix Eigenvalue Problems,” SIAM Solving Nonlinear Optimal Control Problems,” IEEE Transaction on Auto- Review, Vol. 15, No. 2, 1973, pp. 318– 334. matic Control, Vol. 33, No. 4, 1988, pp. 333– 340. 21 Brenan, K. E., “Differential-Algebraic Equations Issues in the Direct 11 Vlassenbroeck, J., “A Chebyshev Polynomial Method for Optimal Con- Transcription of Path Constrained Optimal Control Problems,” Annals of trol with State Constraints,” Automatica, Vol. 24, No. 4, 1988, pp. 499– 506. Numerical Mathematics, Vol. 1, 1994, pp. 247– 263. 12 Fahroo,F., and Ross, I. M., “Second Look at ApproximatingDifferential 22 Solomonoff, A., “A Fast Algorithm for Spectral Differentiation,” Jour- Inclusions,” Journal of Guidance, Control, and Dynamics, Vol. 24, No. 1, nal of Computational Physics, Vol. 98, 1992, pp. 174– 177. 2001, pp. 131– 133. 23 Knowles, G., An Introduction to Applied Optimal Control, Academic, 13 Fahroo, F., and Ross, I. M., “A Spectral Patching Method for Direct New York, 1981, pp. 50 – 55. Trajectory Optimization,” American Astronautical Society, Paper AAS 00- 24 Gill, P. E., Murray, W., Saunders, M. A., and Wright, M. A., “User’s 260, 20 – 21 March 2000; also Journal of Astronautical Sciences, Vol. 48, Guide to NPSOL 5.0: A Fortran Package for Nonlinear Programming,” Stan- No. 2/3, 2000, pp. 269– 286. ford Optimization Lab., Technical Rept. SOL 86-1, Stanford Univ., Stanford, 14 Canuto, C., Hussaini, M. Y., Quarteroni, A., and Zang, T. A., Spectral CA, July 1998.