This document discusses constrained optimization problems in control systems. It introduces three types of constraints: 1) point constraints 2) differential equation constraints and 3) isoperimetric constraints. The Lagrange multiplier method is used to extend the necessary conditions for unconstrained problems to problems with constraints. Constrained problems are transformed into an augmented function involving Lagrange multipliers to determine the constrained extrema. Examples demonstrate applying this method to problems with different constraint types.