Eigen values and eigen vectors in matrices and calculus are explained in a simple and understandable manner for all college students who are studying engineering first year
5. More Math
Page 5
not
Thus we want a solutions to 𝐴 − 𝜆𝐼 𝑥 = 0 other than 𝑥 = 0
Recall:
Theorem: any invertible matrix − 𝐴 − 𝜆𝐼 − only has one solution.
Therefore, 𝐴 − 𝜆𝐼 needs to not be invertible.
noninvertible matrices all have a determinant of 0.
Thus det 𝐴 − 𝜆𝐼 needs to equal 0.
Now we move forward by finding 𝜆 such that det | 𝐴 − 𝜆𝐼 | = 0
and
6. What are eigenvalues?
• Given a matrix, A, x is the eigenvector and is the
corresponding eigenvalue if Ax = x
• A must be square and the determinant of A - I must be
equal to zero
Ax - x = 0 iff (A - I) x = 0
• Trivial solution is if x = 0
• The nontrivial solution occurs when det(A - I) = 0
• Are eigenvectors unique?
• If x is an eigenvector, then x is also an eigenvector and is
an eigenvalue
A(x) = (Ax) = (x) = (x)
9. Calculating the Eigenvectors/values
• Expand the det(A - I) = 0 for a 2 x 2 matrix
• For a 2 x 2 matrix, this is a simple quadratic equation with two solutions
(maybe complex)
• This “characteristic equation” can be used to solve for x
0
0
0
det
0
1
0
0
1
det
det
21
12
22
11
22
11
2
21
12
22
11
22
21
12
11
22
21
12
11
a
a
a
a
a
a
a
a
a
a
a
a
a
a
a
a
a
a
I
A
21
12
22
11
2
22
11
22
11
4 a
a
a
a
a
a
a
a
10. Eigenvalue example
• Consider,
• The corresponding eigenvectors can be computed as
• For = 0, one possible solution is x = (2, -1)
• For = 5, one possible solution is x = (1, 2)
5
,
0
)
4
1
(
0
2
2
4
1
)
4
1
(
0
4
2
2
1
2
2
21
12
22
11
22
11
2
a
a
a
a
a
a
A
0
0
1
2
2
4
1
2
2
4
0
5
0
0
5
4
2
2
1
5
0
0
4
2
2
1
4
2
2
1
0
0
0
0
0
4
2
2
1
0
y
x
y
x
y
x
y
x
y
x
y
x
y
x
y
x
21. Page 21
The Eigenvectors and Eigenvalues of A and A-1
If 𝜆 is an eigenvalue of A, then 1/𝜆 is an eigenvalue of A-1.
The corresponding eigenvectors are the same.
22. Page 22
The Eigenvectors and Eigenvalues of A and AT
The Eigenvalues of A and AT are the same, but eigenvectors are different.
26. Observe that a 2x2 matrix may have
only one eigenvalue.
Eigenvalues can also be complex numbers.
These facts should not be surprising,
since eigenvalues are solutions of
polynomials.
27. Page 27
Finding Eigenvalues in Real Applications
The eigenvalues of a matrix A can be determined by finding the roots of the characteristic polynomial. Explicit
algebraic formulas for the roots of a polynomial exist only if the degree n is 4 or less. Therefore, for matrices of
order 5 or more, the eigenvalues and eigenvectors cannot be obtained by an explicit algebraic formula and must
be computed by approximate numerical methods.
We would expect that for larger matrices a computer would be used to factor the characteristic polynomials. In
reality, this method is unreliable as roundoff errors cause unpredictable results. Furthermore, before computing
the characteristic polynomial, we need to compute the determinant, also a very expensive process. Efficient,
accurate methods to compute eigenvalues and eigenvectors of arbitrary matrices were not known until the
advent of the QR algorithm in 1961.
Question: how then are eigenvalues found?
Answer: Via iterative processes that transform matrix A into a matrix that is almost an upper triangular
matrix. The more iterations, the better approximation.
Once the value of an eigenvalue is known, the corresponding eigenvectors can be found by finding non-zero
solutions of the eigenvalue equation, that becomes a system of linear equations with known coefficients.
28. Page 28
Example Compute the eigenvalues and eigenvectors for matrix A. How about A2 , A-1 , and A + 4I ?
𝐴 =
2 −1
−1 2