SlideShare a Scribd company logo
1 of 11
Download to read offline
SINGLE VARIABLE OPTIMIZATION
1. DEFINITION OF LOCAL MAXIMA AND LOCAL MINIMA
1.1. Note on open and closed intervals.
1.1.1. Open interval. If a and b are two numbers with a < b, then the open interval from a to b is
the collection of all numbers which are both larger than a and smaller than b. The open interval
consists of all numbers between a and b. A compact way of writing this is a < x < b. We denote an
open interval with parentheses as (a, b).
1.1.2. Closed interval. If a and b are two numbers with a < b, then the closed interval from a to b
is the collection of all numbers which are both greater than or equal to a and less than or equal to
b. The closed interval consists of all points between a and b including a and b. A compact way of
writing this is a ≤ x ≤ b. We denote a closed interval with brackets as [a, b].
1.1.3. Half-open intervals. Intervals that are closed on one end and open on the other are called
half-open intervals. We can denote these as half open on the right or the left and use a mixture of
brackets and parentheses as appropriate.
1.2. Max-min theorem for continuous functions.
Theorem 1. If f is continuous at every point of a closed interval [a, b] ⊂ R, then f assumes both an absolute
maximum value M and an absolute minimum value m somewhere in [a, b]. That is, there are numbers x1
and x2 in [a, b] with f(x1) = m, f(x2) = M, and m ≤ f(x) ≤ M for every other x in [a, b].
1.3. Absolute (global) extreme values.
1.3.1. Absolute maximum. Let f be a function with domain D. Then f has an absolute maximum
value on D at a point c if
f (x) ≤ f (c) for all x D (1)
1.3.2. Absolute minimum. Let f be a function with domain D. Then f has an absolute minimum value
on D at a point d if
f (x) ≥ f (d) for all x D (2)
1.4. Local extreme values.
1.4.1. Local maximum. Consider a real valued function f defined with domain D. Then f is said to
have a local maximum at an interior point x∗
D if there exists a real number δ > 0 such that
f (x) ≤ f (x∗
) for all x satisfying x − x∗
< δ (3)
Date: August 19, 2005.
1
2 SINGLE VARIABLE OPTIMIZATION
1.4.2. Local minimum. Consider a real valued function f defined with domain D. Then f is said to
have a local minimum at an interior point ˜x D if there exists a real number δ > 0 such that
f (x) ≥ f (˜x) ∀ x satisfying x − ˜x < δ (4)
1.5. Strict maxima and minima, optimal points, and extreme points. If the value of f at x* is
strictly larger than at any other point in the interval, the x* is a strict maximum point. Similarly ˜x
is a strict minimum point if f (x) > f (˜x) for all x in the interval, x = ˜x . We often refer to maxima
and minima as optimal points or extreme points.
2. EXTREME POINTS AND DERIVATIVES
2.1. A first derivative test for extreme points. Let f be a real valued function defined on a domain
D. If f has a local maximum or a local minimum at an interior point c ε D, and if f’ is defined at c,
then
f (c) =
d f (·)
dx
| c = 0. (5)
Proof. To show that f’(c) is zero at a local extremum, we show first that f’(c) cannot be positive and
second that it cannot be negative. The only number that is neither positive or negative is zero, so
that is what f’(c) must be. Suppose that f has a local maximum value at x = c so that f(x) - f(c) ≤ 0
for all values of x sufficiently close to c. Since c is an interior point of f’s domain, f’(c) is defined by
the two-sided limit
lim
x → c
f (x) − f (c)
x − c
. (6)
This means that the right-hand side and left-hand side limits both exist at c and equal f’(c). When
we examine these limits separately, we find that
f (c) = lim
x → c+
f (x) − f (c)
x − c
≤ 0
because
(x − c) > 0 and f (x) ≤ f (c)
(7)
Similarly,
f (c) = lim
x → c−
f (x) − f (c)
x − c
≥ 0
because
(x − c) < 0 and f (x) ≤ f (c)
(8)
Together 7 and 8 imply that f’(c) = 0. The proof for minimum values is similar.
2.2. Implication of theorem 2. The only places where a function f can possibly have an extreme
value (local or global) are
a: interior points where f’(·) = 0,
b: interior points where f’(·) is undefined,
c: endpoints of the domain of f.
SINGLE VARIABLE OPTIMIZATION 3
2.3. Critical (stationary) points. An interior point of the domain of a function f where f’ is zero
or undefined is a critical (stationary) point of f. The only domain points where a function f can
assume extreme values are critical points and endpoints.
2.4. Graphical illustration of extreme points.
2.4.1. A relative maximum. Figure 1 shows the relative maximum of a function.
FIGURE 1. Relative maximum of function y = 20 + 10x − 0.5x2
5 5 10 15 20 25
x
40
20
20
40
60
80
f x
f’ x
2.4.2. A relative minimum. Figure 2 shows the relative minimum of a function.
FIGURE 2. Relative minimum of function y = 20 − 2x − 0.1x2
10 10 20 30
x
5
15
20
30
40
f x
f’ x
2.5. Examples of finding relative maximums and minimums.
4 SINGLE VARIABLE OPTIMIZATION
2.5.1. Example 1. Find the absolute maximum and minimum values of f(x) = x2
, x ∈ [−2, 1].
The only critical value of f(x) is at x = 0 because f’(·) = 2x = 0 ⇒ x = 0. At x = 0, f(x) = 0. The
endpoint values are f(-2) = 4 and f(1) = 1. So the function has an absolute maximum value of 4 at x
= -2 and an absolute minimum value of 0 at x = 0. Figure 3 shows the graph of example 1.
FIGURE 3. Maximum and minimum of function y = x2
, x ∈ [−2, 1]
3 2 1 1 2 3
x
2
4
6
f x
f’ x
2.5.2. Example 2. Find the absolutemaximum and minimum values of f (x) = 8 x − x4
, x ∈ [−2, 1].
Setting the derivative equal to zero we obtain
8 − 4x3
= 0
⇒ 4x3
= 8
⇒ x3
= 2
⇒ x = 2
1
3
=
3
√
2
This point is not in the given domain. So we check the endpoints. This yields f(−2) = −32 and
f(1) = 7. So the absolute maximum is 7 at x = 1 and the absolute minimum is -32 at x = -2. Figure
4 shows the graph of example 2.
2.6. Increasing and decreasing functions.
2.6.1. Definitions of increasing and decreasing functions. Let f be a function defined on an interval I
and let x1 and x2 be any two points in I.
a: f increases on I if x1 < x2 ⇒ f(x1) < f(x2).
b: f decreases on I if x1 < x2 ⇒ f(x2) < f(x1).
2.6.2. First derivative test for increasing and decreasing functions. Suppose that f is continuous on [a,
b] and differentiable on (a, b).
a: If f ( ) > 0 at each point of (a, b), then f increases on [a, b].
b: If f < 0 at each point of (a, b), then f decreases on [a, b].
SINGLE VARIABLE OPTIMIZATION 5
FIGURE 4. Maximum and minimum of function y = 8 − x2
, x ε [−2, 1]
3 2 1 1 21 3
2 3
x
30
20
10
10
f x
f’ x
3. TESTS FOR LOCAL EXTREME VALUES
3.1. Necessary versus sufficient conditions.
While the zero derivative condition (critical value) is necessary for a maximum or minimum, it
is clear that it is not sufficient. In other words, while all local extreme points are critical values, not
all critical values are extreme points. Consider the three different cases below.
3.2. Types of critical points.
3.2.1. Unique global minimum. First consider a function where there is a unique global minimum,
so that a relative minimum is also the global minimum. The function y = x2
−10x+60 is a parabola
that has a global minimum at x = 5. The graph of this function is given in figure 5.
3.2.2. Unique global maximum. Now consider a case where the relative maximum is a global maxi-
mum. The function y = 6x − x2
is a parabola that has a global maximum at x = 3. The graph of this
function is given in figure 6.
3.2.3. Local maxima and minima but no global extreme values over the entire domain (in this case the real
numbers). Now consider a case where the function has local maxima and minima and there are no
global maximums or minimums. Specifically consider the function y = 50−6x+1/18x3
. The graph
of this function is given in figure 7. The relative maximum is at x = -6 and the relative minimum is
at x = 6.
3.2.4. No relative maxima or minima at critical points. Consider the case where the first derivative is
equal to zero but there is no relative maximum or minimum. Such a point is called an inflection
point. The second derivative is zero at this point. A graph of a function with an inflection point at
a critical value is given in figure 8.
3.3. The first derivative test for local extreme values.
6 SINGLE VARIABLE OPTIMIZATION
FIGURE 5. Global minimum of function y = x2
− 10x + 60
15 10 5 5 10 15 20 25
x
100
200
300
400
f x
f’ x
FIGURE 6. Global maximum of function y = 6x − x2
15 10 5 5 10 15 20
x
150
100
50
50
f x
f’ x
3.3.1. Local extreme values at critical points (points where f’(c ) = 0).
a: If f’( ) changes from positive to negative at c (f’(c) > 0 for x < c and f’(c) < 0 for x > c), then
f has a local maximum value at c. This case in shown in figure 9.
b: If f’( ) changes from negative to positive at c, (f’( ) < 0 for x < c and f’( ) > 0 for x > c), then
f has a local minimum value at c. This case in shown in figure 10.
c: If f’( ) does not change sign at c (f’ has the same sign on both sides of c), then f has no local
extreme value at c. This case in shown in figure 11.
3.3.2. Local extreme values at endpoints.
a: At the left endpoint a, if f’ < 0 (f’ > 0) for x > a, then f has a local maximum (minimum) at
a. The case with the minimum or maximum at the left end point is shown in figure 12
SINGLE VARIABLE OPTIMIZATION 7
FIGURE 7. Relative minimum and maximum of function y = 50 − 6x + 1/18x3
15 10 5 5 10 15 20
x
50
50
100
150 f x
f’ x 1
f’ x 2
FIGURE 8. Inflection Point of function y = 3x3
+ 200
20 15 10 5 5 10 15 20
x
3000
2000
1000
1000
2000
3000
f x
f’ x
b: At the right endpoint b, if f’ < 0 (f’ > 0) for x < b, then f has a local minimum (maximum)
at b. This case is shown in figure 13.
3.4. The second derivative test for local extreme values.
3.4.1. The second derivative test.
1. If f’(c) = 0 and f”(c) < 0, then f has a local maximum at x = c.
2. If f’(c) = 0 and f”(c) > 0, then f has a local minimum at x = c.
3.4.2. Sufficient condition for a maximum or minimum. For some integer n ≥ 1, let f have a continuous
nth
derivative in the open interval (a,b). Suppose also that for some interior point c ∈ (a,b) we have
8 SINGLE VARIABLE OPTIMIZATION
FIGURE 9. A local maximum with f’(c) = 0 and with f’(c) undefined
Local Max
f’ c 0
f’ 0 f’ 0
c
Local Max
f’ c is undefined
f’ 0 f’ 0
c
FIGURE 10. A local minimum with f’(c) = 0 and with f’(c) undefined
Local Min
f’ c 0
f’ 0 f’ 0
c
Local Min
f’ c is undefined
f’ 0 f’ 0
c
FIGURE 11. No Local Extreme Value
No Extreme
f’ c 0
f’ 0 f’ 0
c
No Extreme
f’ c is undefined
f’ 0 f’ 0
c
f (c) = f (c) = ... = fn−1
= 0, but fn
(c) = 0 (9)
Then for n even, f has a local minimum at c if fn
(c) > 0, and a local maximum if fn
(c) < 0. If
n is odd, there is neither a local maximum nor a local minimum at c.
3.4.3. Examples.
a: Consider a case where the function has a global minimum.
SINGLE VARIABLE OPTIMIZATION 9
FIGURE 12. A local minimum and maximum at left endpoints
Local Max
f’ 0
a
Local Min
f’ 0
a
FIGURE 13. A local minimum and maximum at right endpoints
Local Min
f’ 0
b
Local Max
f’ 0
b
y = f(x) = x2
f (x) = 2x = 0
⇒ x = 0 is an extreme point
f (x) = 2 which is not zero (n is even) and positive
⇒ x = 0 is a local minimum
Figure 14 shows the graph for the example in part a.
b: Consider a case where the function has a global maximum.
y = f(x) = 6x − x2
f (x) = 6 − 2x = 0
⇒ x = 3 is an extreme point
f (x) = −2 which is not zero (n is even) and negative
⇒ x = 3 is a local maximum
Figure 15 shows the graph for the example in part b.
10 SINGLE VARIABLE OPTIMIZATION
FIGURE 14. Local minimum of function y = x2
]
3 2 1 1 2 3
x
2
4
6
8
f x
f’ x
FIGURE 15. Global maximum of function y = 6x − x2
15 10 5 5 10 15 20
x
150
100
50
50
f x
f’ x
c: Consider a case where the function has no global maximum nor global minimum.
y = f(x) = x3
f (x) = 3x2
= 0
⇒ x = 0 is an extreme point
f (x) = 6x which is zero at zero (n is even)
f (x) = 6 which is not zero but positive (n is odd)
⇒ x = 0 is neither a local maximum nor a local minimum
Figure 16 shows the graph for example c.
SINGLE VARIABLE OPTIMIZATION 11
FIGURE 16. Function which has no global maximum nor global minimum y = x3
20 15 10 5 5 10 15 20
x
3000
2000
1000
1000
2000
3000
f x
f’ x
3.4.4. Partial converse of second derivative test. Suppose f (a) exists. If f has a local minimum at a,
then f (a) ≥ 0; if f has a local maximum at a, then f (a) ≤ 0.

More Related Content

What's hot

5.2 first and second derivative test
5.2 first and second derivative test5.2 first and second derivative test
5.2 first and second derivative testdicosmo178
 
Lecture 15 max min - section 4.2
Lecture 15   max min - section 4.2Lecture 15   max min - section 4.2
Lecture 15 max min - section 4.2njit-ronbrown
 
Extreme values of a function & applications of derivative
Extreme values of a function & applications of derivativeExtreme values of a function & applications of derivative
Extreme values of a function & applications of derivativeNofal Umair
 
Bostock and Chandler chapter3 functions
Bostock and Chandler chapter3 functionsBostock and Chandler chapter3 functions
Bostock and Chandler chapter3 functionsSarah Sue Calbio
 
L19 increasing &amp; decreasing functions
L19 increasing &amp; decreasing functionsL19 increasing &amp; decreasing functions
L19 increasing &amp; decreasing functionsJames Tagara
 
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)Minhas Kamal
 
Iteration method-Solution of algebraic and Transcendental Equations.
Iteration method-Solution of algebraic and Transcendental Equations.Iteration method-Solution of algebraic and Transcendental Equations.
Iteration method-Solution of algebraic and Transcendental Equations.AmitKumar8151
 
Increasing and decreasing functions ap calc sec 3.3
Increasing and decreasing functions ap calc sec 3.3Increasing and decreasing functions ap calc sec 3.3
Increasing and decreasing functions ap calc sec 3.3Ron Eick
 
Lesson 4.1 Extreme Values
Lesson 4.1 Extreme ValuesLesson 4.1 Extreme Values
Lesson 4.1 Extreme ValuesSharon Henry
 
Numerical solutions of algebraic equations
Numerical solutions of algebraic equationsNumerical solutions of algebraic equations
Numerical solutions of algebraic equationsAvneet Singh Lal
 
Lesson 3 Oct 30
Lesson 3 Oct 30Lesson 3 Oct 30
Lesson 3 Oct 30ingroy
 
Application of derivatives
Application of derivatives Application of derivatives
Application of derivatives Seyid Kadher
 
Bisection method in maths 4
Bisection method in maths 4Bisection method in maths 4
Bisection method in maths 4Vaidik Trivedi
 
Lecture 8 section 3.2 polynomial equations
Lecture 8   section 3.2 polynomial equationsLecture 8   section 3.2 polynomial equations
Lecture 8 section 3.2 polynomial equationsnjit-ronbrown
 

What's hot (20)

5.2 first and second derivative test
5.2 first and second derivative test5.2 first and second derivative test
5.2 first and second derivative test
 
Lecture 15 max min - section 4.2
Lecture 15   max min - section 4.2Lecture 15   max min - section 4.2
Lecture 15 max min - section 4.2
 
Extreme values of a function & applications of derivative
Extreme values of a function & applications of derivativeExtreme values of a function & applications of derivative
Extreme values of a function & applications of derivative
 
Bostock and Chandler chapter3 functions
Bostock and Chandler chapter3 functionsBostock and Chandler chapter3 functions
Bostock and Chandler chapter3 functions
 
Unit 1.7
Unit 1.7Unit 1.7
Unit 1.7
 
L19 increasing &amp; decreasing functions
L19 increasing &amp; decreasing functionsL19 increasing &amp; decreasing functions
L19 increasing &amp; decreasing functions
 
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)
Numerical Method Analysis: Algebraic and Transcendental Equations (Non-Linear)
 
Iteration method-Solution of algebraic and Transcendental Equations.
Iteration method-Solution of algebraic and Transcendental Equations.Iteration method-Solution of algebraic and Transcendental Equations.
Iteration method-Solution of algebraic and Transcendental Equations.
 
Unit 2.6
Unit 2.6Unit 2.6
Unit 2.6
 
Ch 2
Ch 2Ch 2
Ch 2
 
Wati lg
Wati lgWati lg
Wati lg
 
Increasing and decreasing functions ap calc sec 3.3
Increasing and decreasing functions ap calc sec 3.3Increasing and decreasing functions ap calc sec 3.3
Increasing and decreasing functions ap calc sec 3.3
 
Unit 2.5
Unit 2.5Unit 2.5
Unit 2.5
 
Lesson 4.1 Extreme Values
Lesson 4.1 Extreme ValuesLesson 4.1 Extreme Values
Lesson 4.1 Extreme Values
 
Numerical solutions of algebraic equations
Numerical solutions of algebraic equationsNumerical solutions of algebraic equations
Numerical solutions of algebraic equations
 
3.1
3.13.1
3.1
 
Lesson 3 Oct 30
Lesson 3 Oct 30Lesson 3 Oct 30
Lesson 3 Oct 30
 
Application of derivatives
Application of derivatives Application of derivatives
Application of derivatives
 
Bisection method in maths 4
Bisection method in maths 4Bisection method in maths 4
Bisection method in maths 4
 
Lecture 8 section 3.2 polynomial equations
Lecture 8   section 3.2 polynomial equationsLecture 8   section 3.2 polynomial equations
Lecture 8 section 3.2 polynomial equations
 

Similar to Opt simple single_000

SECTION 7.3 word.docx
SECTION 7.3 word.docxSECTION 7.3 word.docx
SECTION 7.3 word.docxLMinhTm26
 
Application of derivatives
Application of derivativesApplication of derivatives
Application of derivativesindu thakur
 
maxima & Minima thoeyr&solved.Module-4pdf
maxima & Minima thoeyr&solved.Module-4pdfmaxima & Minima thoeyr&solved.Module-4pdf
maxima & Minima thoeyr&solved.Module-4pdfRajuSingh806014
 
Calculus- Basics
Calculus- BasicsCalculus- Basics
Calculus- BasicsRabin BK
 
Applications of Differentiation
Applications of DifferentiationApplications of Differentiation
Applications of DifferentiationJoey Valdriz
 
01. Functions-Theory & Solved Examples Module-4.pdf
01. Functions-Theory & Solved Examples Module-4.pdf01. Functions-Theory & Solved Examples Module-4.pdf
01. Functions-Theory & Solved Examples Module-4.pdfRajuSingh806014
 
Maxima & Minima
Maxima & MinimaMaxima & Minima
Maxima & MinimaArun Umrao
 
Maxima & Minima of Functions - Differential Calculus by Arun Umrao
Maxima & Minima of Functions - Differential Calculus by Arun UmraoMaxima & Minima of Functions - Differential Calculus by Arun Umrao
Maxima & Minima of Functions - Differential Calculus by Arun Umraossuserd6b1fd
 
CHAP6 Limits and Continuity.pdf
CHAP6 Limits and Continuity.pdfCHAP6 Limits and Continuity.pdf
CHAP6 Limits and Continuity.pdfmekkimekki5
 
Mac2311 study guide-tcm6-49721
Mac2311 study guide-tcm6-49721Mac2311 study guide-tcm6-49721
Mac2311 study guide-tcm6-49721Glicerio Gavilan
 
Chapter 4 review
Chapter 4 reviewChapter 4 review
Chapter 4 reviewgregcross22
 
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docx
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docxMATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docx
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docxTatianaMajor22
 
1.  Write an equation in standard form of the parabola that has th.docx
1.  Write an equation in standard form of the parabola that has th.docx1.  Write an equation in standard form of the parabola that has th.docx
1.  Write an equation in standard form of the parabola that has th.docxKiyokoSlagleis
 

Similar to Opt simple single_000 (20)

SECTION 7.3 word.docx
SECTION 7.3 word.docxSECTION 7.3 word.docx
SECTION 7.3 word.docx
 
Application of derivatives
Application of derivativesApplication of derivatives
Application of derivatives
 
Lemh105
Lemh105Lemh105
Lemh105
 
Twinkle
TwinkleTwinkle
Twinkle
 
Unit 1.2
Unit 1.2Unit 1.2
Unit 1.2
 
maxima & Minima thoeyr&solved.Module-4pdf
maxima & Minima thoeyr&solved.Module-4pdfmaxima & Minima thoeyr&solved.Module-4pdf
maxima & Minima thoeyr&solved.Module-4pdf
 
Chap07
Chap07Chap07
Chap07
 
Calculus- Basics
Calculus- BasicsCalculus- Basics
Calculus- Basics
 
Applications of Differentiation
Applications of DifferentiationApplications of Differentiation
Applications of Differentiation
 
01. Functions-Theory & Solved Examples Module-4.pdf
01. Functions-Theory & Solved Examples Module-4.pdf01. Functions-Theory & Solved Examples Module-4.pdf
01. Functions-Theory & Solved Examples Module-4.pdf
 
Functions
FunctionsFunctions
Functions
 
Day 1a examples
Day 1a examplesDay 1a examples
Day 1a examples
 
Maxima & Minima
Maxima & MinimaMaxima & Minima
Maxima & Minima
 
Maxima & Minima of Functions - Differential Calculus by Arun Umrao
Maxima & Minima of Functions - Differential Calculus by Arun UmraoMaxima & Minima of Functions - Differential Calculus by Arun Umrao
Maxima & Minima of Functions - Differential Calculus by Arun Umrao
 
CHAP6 Limits and Continuity.pdf
CHAP6 Limits and Continuity.pdfCHAP6 Limits and Continuity.pdf
CHAP6 Limits and Continuity.pdf
 
Mac2311 study guide-tcm6-49721
Mac2311 study guide-tcm6-49721Mac2311 study guide-tcm6-49721
Mac2311 study guide-tcm6-49721
 
Chapter 4 review
Chapter 4 reviewChapter 4 review
Chapter 4 review
 
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docx
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docxMATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docx
MATH 107 FINAL EXAMINATIONMULTIPLE CHOICE1. Deter.docx
 
Função afim resumo teórico e exercícios - celso brasil
Função afim   resumo teórico e exercícios - celso brasilFunção afim   resumo teórico e exercícios - celso brasil
Função afim resumo teórico e exercícios - celso brasil
 
1.  Write an equation in standard form of the parabola that has th.docx
1.  Write an equation in standard form of the parabola that has th.docx1.  Write an equation in standard form of the parabola that has th.docx
1.  Write an equation in standard form of the parabola that has th.docx
 

More from sheetslibrary

Organizationandmanagement 101113012453-phpapp01
Organizationandmanagement 101113012453-phpapp01Organizationandmanagement 101113012453-phpapp01
Organizationandmanagement 101113012453-phpapp01sheetslibrary
 
Griffin11ech01 150122062422-conversion-gate01
Griffin11ech01 150122062422-conversion-gate01Griffin11ech01 150122062422-conversion-gate01
Griffin11ech01 150122062422-conversion-gate01sheetslibrary
 
Chapter7foundationsofplanningppt07 100224000005-phpapp01
Chapter7foundationsofplanningppt07 100224000005-phpapp01Chapter7foundationsofplanningppt07 100224000005-phpapp01
Chapter7foundationsofplanningppt07 100224000005-phpapp01sheetslibrary
 
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01sheetslibrary
 
Chapter02 130706024358-phpapp02
Chapter02 130706024358-phpapp02Chapter02 130706024358-phpapp02
Chapter02 130706024358-phpapp02sheetslibrary
 
Ch2managementhistory 130304100224-phpapp02
Ch2managementhistory 130304100224-phpapp02Ch2managementhistory 130304100224-phpapp02
Ch2managementhistory 130304100224-phpapp02sheetslibrary
 
Ch1introductiontomanagementandorganizations 130304095937-phpapp01
Ch1introductiontomanagementandorganizations 130304095937-phpapp01Ch1introductiontomanagementandorganizations 130304095937-phpapp01
Ch1introductiontomanagementandorganizations 130304095937-phpapp01sheetslibrary
 
Introduction to calculus
Introduction to calculusIntroduction to calculus
Introduction to calculussheetslibrary
 
Business math by md aziz
Business math by md azizBusiness math by md aziz
Business math by md azizsheetslibrary
 
Business math by mahmud
Business math by mahmudBusiness math by mahmud
Business math by mahmudsheetslibrary
 
Real number-classification
Real number-classificationReal number-classification
Real number-classificationsheetslibrary
 
Properties of-logarithms
Properties of-logarithmsProperties of-logarithms
Properties of-logarithmssheetslibrary
 
Non linearequationsmatlab
Non linearequationsmatlabNon linearequationsmatlab
Non linearequationsmatlabsheetslibrary
 

More from sheetslibrary (20)

Organizationandmanagement 101113012453-phpapp01
Organizationandmanagement 101113012453-phpapp01Organizationandmanagement 101113012453-phpapp01
Organizationandmanagement 101113012453-phpapp01
 
Griffin11ech01 150122062422-conversion-gate01
Griffin11ech01 150122062422-conversion-gate01Griffin11ech01 150122062422-conversion-gate01
Griffin11ech01 150122062422-conversion-gate01
 
Chapter7foundationsofplanningppt07 100224000005-phpapp01
Chapter7foundationsofplanningppt07 100224000005-phpapp01Chapter7foundationsofplanningppt07 100224000005-phpapp01
Chapter7foundationsofplanningppt07 100224000005-phpapp01
 
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01
Chapter6decisionmakingtheessenceofthemanagersjobppt06 100223215436-phpapp01
 
Chapter02 130706024358-phpapp02
Chapter02 130706024358-phpapp02Chapter02 130706024358-phpapp02
Chapter02 130706024358-phpapp02
 
Ch2managementhistory 130304100224-phpapp02
Ch2managementhistory 130304100224-phpapp02Ch2managementhistory 130304100224-phpapp02
Ch2managementhistory 130304100224-phpapp02
 
Ch1introductiontomanagementandorganizations 130304095937-phpapp01
Ch1introductiontomanagementandorganizations 130304095937-phpapp01Ch1introductiontomanagementandorganizations 130304095937-phpapp01
Ch1introductiontomanagementandorganizations 130304095937-phpapp01
 
Singlevaropt
SinglevaroptSinglevaropt
Singlevaropt
 
Introduction to calculus
Introduction to calculusIntroduction to calculus
Introduction to calculus
 
Intro diffcall3b
Intro diffcall3bIntro diffcall3b
Intro diffcall3b
 
Business math by md aziz
Business math by md azizBusiness math by md aziz
Business math by md aziz
 
Business math by mahmud
Business math by mahmudBusiness math by mahmud
Business math by mahmud
 
02 basics i-handout
02 basics i-handout02 basics i-handout
02 basics i-handout
 
Sets
SetsSets
Sets
 
Real number-classification
Real number-classificationReal number-classification
Real number-classification
 
Properties of-logarithms
Properties of-logarithmsProperties of-logarithms
Properties of-logarithms
 
Non linearequationsmatlab
Non linearequationsmatlabNon linearequationsmatlab
Non linearequationsmatlab
 
New doc 11
New doc 11New doc 11
New doc 11
 
Media,265106,en
Media,265106,enMedia,265106,en
Media,265106,en
 
Mc ty-surds-2009-1
Mc ty-surds-2009-1Mc ty-surds-2009-1
Mc ty-surds-2009-1
 

Recently uploaded

ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYKayeClaireEstoconing
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Mark Reed
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Celine George
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Celine George
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...JhezDiaz1
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for BeginnersSabitha Banu
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersSabitha Banu
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxnelietumpap1
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Celine George
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfSpandanaRallapalli
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxMaryGraceBautista27
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Celine George
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPCeline George
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 

Recently uploaded (20)

ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITYISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
ISYU TUNGKOL SA SEKSWLADIDA (ISSUE ABOUT SEXUALITY
 
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxYOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptx
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)Influencing policy (training slides from Fast Track Impact)
Influencing policy (training slides from Fast Track Impact)
 
Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17Field Attribute Index Feature in Odoo 17
Field Attribute Index Feature in Odoo 17
 
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONTHEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATION
 
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
Incoming and Outgoing Shipments in 3 STEPS Using Odoo 17
 
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
ENGLISH 7_Q4_LESSON 2_ Employing a Variety of Strategies for Effective Interp...
 
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...
 
Full Stack Web Development Course for Beginners
Full Stack Web Development Course  for BeginnersFull Stack Web Development Course  for Beginners
Full Stack Web Development Course for Beginners
 
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...
 
DATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginnersDATA STRUCTURE AND ALGORITHM for beginners
DATA STRUCTURE AND ALGORITHM for beginners
 
Q4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptxQ4 English4 Week3 PPT Melcnmg-based.pptx
Q4 English4 Week3 PPT Melcnmg-based.pptx
 
Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17Difference Between Search & Browse Methods in Odoo 17
Difference Between Search & Browse Methods in Odoo 17
 
ACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdfACC 2024 Chronicles. Cardiology. Exam.pdf
ACC 2024 Chronicles. Cardiology. Exam.pdf
 
Science 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptxScience 7 Quarter 4 Module 2: Natural Resources.pptx
Science 7 Quarter 4 Module 2: Natural Resources.pptx
 
Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17Computed Fields and api Depends in the Odoo 17
Computed Fields and api Depends in the Odoo 17
 
What is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERPWhat is Model Inheritance in Odoo 17 ERP
What is Model Inheritance in Odoo 17 ERP
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptxFINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
 

Opt simple single_000

  • 1. SINGLE VARIABLE OPTIMIZATION 1. DEFINITION OF LOCAL MAXIMA AND LOCAL MINIMA 1.1. Note on open and closed intervals. 1.1.1. Open interval. If a and b are two numbers with a < b, then the open interval from a to b is the collection of all numbers which are both larger than a and smaller than b. The open interval consists of all numbers between a and b. A compact way of writing this is a < x < b. We denote an open interval with parentheses as (a, b). 1.1.2. Closed interval. If a and b are two numbers with a < b, then the closed interval from a to b is the collection of all numbers which are both greater than or equal to a and less than or equal to b. The closed interval consists of all points between a and b including a and b. A compact way of writing this is a ≤ x ≤ b. We denote a closed interval with brackets as [a, b]. 1.1.3. Half-open intervals. Intervals that are closed on one end and open on the other are called half-open intervals. We can denote these as half open on the right or the left and use a mixture of brackets and parentheses as appropriate. 1.2. Max-min theorem for continuous functions. Theorem 1. If f is continuous at every point of a closed interval [a, b] ⊂ R, then f assumes both an absolute maximum value M and an absolute minimum value m somewhere in [a, b]. That is, there are numbers x1 and x2 in [a, b] with f(x1) = m, f(x2) = M, and m ≤ f(x) ≤ M for every other x in [a, b]. 1.3. Absolute (global) extreme values. 1.3.1. Absolute maximum. Let f be a function with domain D. Then f has an absolute maximum value on D at a point c if f (x) ≤ f (c) for all x D (1) 1.3.2. Absolute minimum. Let f be a function with domain D. Then f has an absolute minimum value on D at a point d if f (x) ≥ f (d) for all x D (2) 1.4. Local extreme values. 1.4.1. Local maximum. Consider a real valued function f defined with domain D. Then f is said to have a local maximum at an interior point x∗ D if there exists a real number δ > 0 such that f (x) ≤ f (x∗ ) for all x satisfying x − x∗ < δ (3) Date: August 19, 2005. 1
  • 2. 2 SINGLE VARIABLE OPTIMIZATION 1.4.2. Local minimum. Consider a real valued function f defined with domain D. Then f is said to have a local minimum at an interior point ˜x D if there exists a real number δ > 0 such that f (x) ≥ f (˜x) ∀ x satisfying x − ˜x < δ (4) 1.5. Strict maxima and minima, optimal points, and extreme points. If the value of f at x* is strictly larger than at any other point in the interval, the x* is a strict maximum point. Similarly ˜x is a strict minimum point if f (x) > f (˜x) for all x in the interval, x = ˜x . We often refer to maxima and minima as optimal points or extreme points. 2. EXTREME POINTS AND DERIVATIVES 2.1. A first derivative test for extreme points. Let f be a real valued function defined on a domain D. If f has a local maximum or a local minimum at an interior point c ε D, and if f’ is defined at c, then f (c) = d f (·) dx | c = 0. (5) Proof. To show that f’(c) is zero at a local extremum, we show first that f’(c) cannot be positive and second that it cannot be negative. The only number that is neither positive or negative is zero, so that is what f’(c) must be. Suppose that f has a local maximum value at x = c so that f(x) - f(c) ≤ 0 for all values of x sufficiently close to c. Since c is an interior point of f’s domain, f’(c) is defined by the two-sided limit lim x → c f (x) − f (c) x − c . (6) This means that the right-hand side and left-hand side limits both exist at c and equal f’(c). When we examine these limits separately, we find that f (c) = lim x → c+ f (x) − f (c) x − c ≤ 0 because (x − c) > 0 and f (x) ≤ f (c) (7) Similarly, f (c) = lim x → c− f (x) − f (c) x − c ≥ 0 because (x − c) < 0 and f (x) ≤ f (c) (8) Together 7 and 8 imply that f’(c) = 0. The proof for minimum values is similar. 2.2. Implication of theorem 2. The only places where a function f can possibly have an extreme value (local or global) are a: interior points where f’(·) = 0, b: interior points where f’(·) is undefined, c: endpoints of the domain of f.
  • 3. SINGLE VARIABLE OPTIMIZATION 3 2.3. Critical (stationary) points. An interior point of the domain of a function f where f’ is zero or undefined is a critical (stationary) point of f. The only domain points where a function f can assume extreme values are critical points and endpoints. 2.4. Graphical illustration of extreme points. 2.4.1. A relative maximum. Figure 1 shows the relative maximum of a function. FIGURE 1. Relative maximum of function y = 20 + 10x − 0.5x2 5 5 10 15 20 25 x 40 20 20 40 60 80 f x f’ x 2.4.2. A relative minimum. Figure 2 shows the relative minimum of a function. FIGURE 2. Relative minimum of function y = 20 − 2x − 0.1x2 10 10 20 30 x 5 15 20 30 40 f x f’ x 2.5. Examples of finding relative maximums and minimums.
  • 4. 4 SINGLE VARIABLE OPTIMIZATION 2.5.1. Example 1. Find the absolute maximum and minimum values of f(x) = x2 , x ∈ [−2, 1]. The only critical value of f(x) is at x = 0 because f’(·) = 2x = 0 ⇒ x = 0. At x = 0, f(x) = 0. The endpoint values are f(-2) = 4 and f(1) = 1. So the function has an absolute maximum value of 4 at x = -2 and an absolute minimum value of 0 at x = 0. Figure 3 shows the graph of example 1. FIGURE 3. Maximum and minimum of function y = x2 , x ∈ [−2, 1] 3 2 1 1 2 3 x 2 4 6 f x f’ x 2.5.2. Example 2. Find the absolutemaximum and minimum values of f (x) = 8 x − x4 , x ∈ [−2, 1]. Setting the derivative equal to zero we obtain 8 − 4x3 = 0 ⇒ 4x3 = 8 ⇒ x3 = 2 ⇒ x = 2 1 3 = 3 √ 2 This point is not in the given domain. So we check the endpoints. This yields f(−2) = −32 and f(1) = 7. So the absolute maximum is 7 at x = 1 and the absolute minimum is -32 at x = -2. Figure 4 shows the graph of example 2. 2.6. Increasing and decreasing functions. 2.6.1. Definitions of increasing and decreasing functions. Let f be a function defined on an interval I and let x1 and x2 be any two points in I. a: f increases on I if x1 < x2 ⇒ f(x1) < f(x2). b: f decreases on I if x1 < x2 ⇒ f(x2) < f(x1). 2.6.2. First derivative test for increasing and decreasing functions. Suppose that f is continuous on [a, b] and differentiable on (a, b). a: If f ( ) > 0 at each point of (a, b), then f increases on [a, b]. b: If f < 0 at each point of (a, b), then f decreases on [a, b].
  • 5. SINGLE VARIABLE OPTIMIZATION 5 FIGURE 4. Maximum and minimum of function y = 8 − x2 , x ε [−2, 1] 3 2 1 1 21 3 2 3 x 30 20 10 10 f x f’ x 3. TESTS FOR LOCAL EXTREME VALUES 3.1. Necessary versus sufficient conditions. While the zero derivative condition (critical value) is necessary for a maximum or minimum, it is clear that it is not sufficient. In other words, while all local extreme points are critical values, not all critical values are extreme points. Consider the three different cases below. 3.2. Types of critical points. 3.2.1. Unique global minimum. First consider a function where there is a unique global minimum, so that a relative minimum is also the global minimum. The function y = x2 −10x+60 is a parabola that has a global minimum at x = 5. The graph of this function is given in figure 5. 3.2.2. Unique global maximum. Now consider a case where the relative maximum is a global maxi- mum. The function y = 6x − x2 is a parabola that has a global maximum at x = 3. The graph of this function is given in figure 6. 3.2.3. Local maxima and minima but no global extreme values over the entire domain (in this case the real numbers). Now consider a case where the function has local maxima and minima and there are no global maximums or minimums. Specifically consider the function y = 50−6x+1/18x3 . The graph of this function is given in figure 7. The relative maximum is at x = -6 and the relative minimum is at x = 6. 3.2.4. No relative maxima or minima at critical points. Consider the case where the first derivative is equal to zero but there is no relative maximum or minimum. Such a point is called an inflection point. The second derivative is zero at this point. A graph of a function with an inflection point at a critical value is given in figure 8. 3.3. The first derivative test for local extreme values.
  • 6. 6 SINGLE VARIABLE OPTIMIZATION FIGURE 5. Global minimum of function y = x2 − 10x + 60 15 10 5 5 10 15 20 25 x 100 200 300 400 f x f’ x FIGURE 6. Global maximum of function y = 6x − x2 15 10 5 5 10 15 20 x 150 100 50 50 f x f’ x 3.3.1. Local extreme values at critical points (points where f’(c ) = 0). a: If f’( ) changes from positive to negative at c (f’(c) > 0 for x < c and f’(c) < 0 for x > c), then f has a local maximum value at c. This case in shown in figure 9. b: If f’( ) changes from negative to positive at c, (f’( ) < 0 for x < c and f’( ) > 0 for x > c), then f has a local minimum value at c. This case in shown in figure 10. c: If f’( ) does not change sign at c (f’ has the same sign on both sides of c), then f has no local extreme value at c. This case in shown in figure 11. 3.3.2. Local extreme values at endpoints. a: At the left endpoint a, if f’ < 0 (f’ > 0) for x > a, then f has a local maximum (minimum) at a. The case with the minimum or maximum at the left end point is shown in figure 12
  • 7. SINGLE VARIABLE OPTIMIZATION 7 FIGURE 7. Relative minimum and maximum of function y = 50 − 6x + 1/18x3 15 10 5 5 10 15 20 x 50 50 100 150 f x f’ x 1 f’ x 2 FIGURE 8. Inflection Point of function y = 3x3 + 200 20 15 10 5 5 10 15 20 x 3000 2000 1000 1000 2000 3000 f x f’ x b: At the right endpoint b, if f’ < 0 (f’ > 0) for x < b, then f has a local minimum (maximum) at b. This case is shown in figure 13. 3.4. The second derivative test for local extreme values. 3.4.1. The second derivative test. 1. If f’(c) = 0 and f”(c) < 0, then f has a local maximum at x = c. 2. If f’(c) = 0 and f”(c) > 0, then f has a local minimum at x = c. 3.4.2. Sufficient condition for a maximum or minimum. For some integer n ≥ 1, let f have a continuous nth derivative in the open interval (a,b). Suppose also that for some interior point c ∈ (a,b) we have
  • 8. 8 SINGLE VARIABLE OPTIMIZATION FIGURE 9. A local maximum with f’(c) = 0 and with f’(c) undefined Local Max f’ c 0 f’ 0 f’ 0 c Local Max f’ c is undefined f’ 0 f’ 0 c FIGURE 10. A local minimum with f’(c) = 0 and with f’(c) undefined Local Min f’ c 0 f’ 0 f’ 0 c Local Min f’ c is undefined f’ 0 f’ 0 c FIGURE 11. No Local Extreme Value No Extreme f’ c 0 f’ 0 f’ 0 c No Extreme f’ c is undefined f’ 0 f’ 0 c f (c) = f (c) = ... = fn−1 = 0, but fn (c) = 0 (9) Then for n even, f has a local minimum at c if fn (c) > 0, and a local maximum if fn (c) < 0. If n is odd, there is neither a local maximum nor a local minimum at c. 3.4.3. Examples. a: Consider a case where the function has a global minimum.
  • 9. SINGLE VARIABLE OPTIMIZATION 9 FIGURE 12. A local minimum and maximum at left endpoints Local Max f’ 0 a Local Min f’ 0 a FIGURE 13. A local minimum and maximum at right endpoints Local Min f’ 0 b Local Max f’ 0 b y = f(x) = x2 f (x) = 2x = 0 ⇒ x = 0 is an extreme point f (x) = 2 which is not zero (n is even) and positive ⇒ x = 0 is a local minimum Figure 14 shows the graph for the example in part a. b: Consider a case where the function has a global maximum. y = f(x) = 6x − x2 f (x) = 6 − 2x = 0 ⇒ x = 3 is an extreme point f (x) = −2 which is not zero (n is even) and negative ⇒ x = 3 is a local maximum Figure 15 shows the graph for the example in part b.
  • 10. 10 SINGLE VARIABLE OPTIMIZATION FIGURE 14. Local minimum of function y = x2 ] 3 2 1 1 2 3 x 2 4 6 8 f x f’ x FIGURE 15. Global maximum of function y = 6x − x2 15 10 5 5 10 15 20 x 150 100 50 50 f x f’ x c: Consider a case where the function has no global maximum nor global minimum. y = f(x) = x3 f (x) = 3x2 = 0 ⇒ x = 0 is an extreme point f (x) = 6x which is zero at zero (n is even) f (x) = 6 which is not zero but positive (n is odd) ⇒ x = 0 is neither a local maximum nor a local minimum Figure 16 shows the graph for example c.
  • 11. SINGLE VARIABLE OPTIMIZATION 11 FIGURE 16. Function which has no global maximum nor global minimum y = x3 20 15 10 5 5 10 15 20 x 3000 2000 1000 1000 2000 3000 f x f’ x 3.4.4. Partial converse of second derivative test. Suppose f (a) exists. If f has a local minimum at a, then f (a) ≥ 0; if f has a local maximum at a, then f (a) ≤ 0.