SlideShare a Scribd company logo
Analysis of Algorithms and Complexity
Andres Mendez-Vazquez
Email: amendez@gdl.cinvestav.mx
Office Hours
3:00-4:00 PM Monday and
Wednesday Room 365
Contents
1 Overview 1
2 Texts 1
3 Prerequisites 2
4 Course Requirements 2
4.1 English . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
4.2 Exams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
4.3 Homework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
5 Subjects 3
1 Overview
In this class, you will learn to analyze and understand the computational complexity of different data structures and
algorithms in Computer Science. For this, we will learn to use the asymptotic notation to analyze and understand their
computational complexity. Examples of these methods are minimum spanning trees, greedy algorithms, probabilistic
algorithms, etc. Finally, we will look at the fact that the universe of polynomial algorithms is smaller than the universe
of the non-polynomial algorithms. For this, we will learn when an algorithm is Non-Polynomial (NP) by transforming
it to an already well known NP-Complete algorithm.
2 Texts
The required text for this course is:
• Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein, Introduction to Algorithms,
Third Edition (MIT Press, 2009).
In addition you can consult the following texts:
• S. Dasgupta, C. H. Papadimitriou, and U. V. Vazirani, Algorithms, First Edition (McGraw-Hill Education, 2006).
• Rajeev Motwani and Prabhakar Raghavan, Randomized Algorithms, Cambridge University Press, New York,
NY, USA.
• R. Sedgewick, K. Wayne, Algorithms (Addison-Wesley Professional, 2011).
1
3 PREREQUISITES 2
• Russ Miller and Laurence Boxer. 2005. Algorithms Sequential and Parallel: A Unified Approach (Charles River
Media Computer Engineering (Hardcover)). Charles River Media, Inc., Rockland, MA, USA.
• Mark de Berg, Otfried Cheong, Marc van Kreveld, and Mark Overmars. 2008. Computational Geometry:
Algorithms and Applications (3rd edition). Telos, Santa Clara, CA, USA.
In addition to a lot of papers.
3 Prerequisites
Discrete mathematics, basic probability and data structures.
4 Course Requirements
The requirements of the course are
Requirement % of Grade Date
1. Midterm #1 15% Jan 31
2. MIDTERM #2 15% Feb 31
3. MIDTERM #3 15% March 28
3. Final 15% April 30
4. HOMEWORKS 20% TBA
5. Project 20% TBA
4.1 English
We will use English to teach the class. However you can ask in Spanish, I reserve the right to answer in English or
Spanish.
4.2 Exams
We will have three exams in this course, and you have five hours per test. Blank pages will be provided.
No makeup test unless medical issues with letter by the doctor.
4.3 Homework
We will have homework with four problems in each. You will use the format of IEEE style latex class at single column
for the homeworks. No other format will be accepted. It needs to have the following format:
1. Name and date must be at the first page.
2. Each problem must be stated before the solution.
It will no accepted in other way. They will be uploaded in the web place for the class. The programming assignments
need to work in order to be graded.
-
Late Homeworks will have 0 automatically.
5 SUBJECTS 3
5 Subjects
In this course, we will cover the following subjects:
1. Foundations
(a) The Role of Algorithms in Computing
(b) Growth of Functions
(c) Divide-and- Conquer
(d) Recurrences
(e) Probabilistic Analysis and Randomized Algorithms
2. Sorting
(a) Heapsort
i. For Priority Queues
(b) Quicksort
i. Definition
ii. Expected time complexity
(c) Sorting in Linear Time
i. Counting Sort
ii. Radix Sort
iii. Bucket Sort
(d) Lower bounds for sorting under comparisons
3. Median and Order Statistics
(a) Definition
(b) Expected time for the i-th statistics
(c) The Worst Case for the i-th statistics
4. Basic Data Structures
(a) Elementary Data Structures
(b) Hash Table
i. Definition
(c) Binary Search Trees
i. Definition
ii. Insertion and Deletions
iii. Rotations
(d) Red-Black Trees
i. Well balanced trees
5. Advanced Techniques
(a) Dynamic Programming
i. Introduction
ii. Optimality of the subproblems
iii. Avoiding the recursion
5 SUBJECTS 4
iv. Examples:
A. Longest Common subsequence
B. Matrix Chain Multiplication
(b) Greedy Algorithms
i. Introduction
ii. Defining the Greedy Choice
iii. Examples:
A. Knapsack Problem
B. Scheduling
C. Hoffman Codes
(c) Amortized Analysis
i. Introduction
ii. Aggregated Method
iii. Accounting Method
iv. Potential Method
v. Examples:
A. Dynamic Tables
B. Move-to-Front
6. Advanced Data Structures
(a) Skip Lists - A probabilistic Data Structure
(b) B-Trees - Fast Access to indexes
(c) Fibonacci Heaps - Better Priority Queues
7. Graph Algorithms
(a) Elementary Graph Algorithms
(b) Minimum Spanning Trees
i. Prim and Kruskal
(c) Single-Source Shortest Paths
i. Bellman-Ford
ii. Dijkstra’s Algorithms
(d) All-Pairs Shortest Paths
i. Dynamic Programming Solution
ii. Floyd-Warshall
iii. Johnson’s Algorithm
(e) Maximum Flow
i. Introduction
ii. Ford-Fulkerson
iii. Edmond-Karp
8. Selected Topics
(a) Multi-threaded Algorithms
i. Introduction
ii. Multi-Threading Model
5 SUBJECTS 5
iii. Hierarchy of Complexities
iv. Example
A. Parallel Fibonacci
B. Parallel Matrix Multiplication
C. Parallel Merge Sort
(b) Matrix Based Algorithms
i. The Holy Grail - The Strassen’s Algorithm
ii. Lower Upper Decomposition
iii. Applications
(c) String Matching
i. Introduction
ii. Rabin-Karp
(d) Computational Geometry
i. Representation
ii. Segment Intersection
iii. Convex Hull
9. NP-Completeness
(a) Definitions
(b) Encodings
(c) Polynomial Time Verification
(d) Polynomial Reduction
(e) NP-Hard
(f) NP-Complete proofs
(g) A family of NP-Problems
10. Dealing with NP-Problems
(a) Backtracking
(b) Branch-and-Bound
(c) Approximation Algorithms
i. Approximation Ratios
ii. Problems
A. Vertex Cover
B. Traveling Salesman Problem
C. Set Covering Problem

More Related Content

What's hot

Computer Science XII - Hissan 2078
Computer Science XII - Hissan 2078Computer Science XII - Hissan 2078
Computer Science XII - Hissan 2078
YEP Nepal
 
May 29, 2015
May 29, 2015May 29, 2015
May 29, 2015khyps13
 
Analysis Table of English Paper 9th Class
Analysis Table of English Paper 9th Class  Analysis Table of English Paper 9th Class
Analysis Table of English Paper 9th Class
Ghulam Mujtaba
 
2003 book discrete_mathematics
2003 book discrete_mathematics2003 book discrete_mathematics
2003 book discrete_mathematics
VladimirMoyanoFiguer
 
Saturation Index of π(D(r,s))
Saturation Index of π(D(r,s))Saturation Index of π(D(r,s))
Saturation Index of π(D(r,s))
ijcoa
 
March 2, 2015
March 2, 2015March 2, 2015
March 2, 2015khyps13
 
Permutations and combinations ppt
Permutations and combinations pptPermutations and combinations ppt
Permutations and combinations ppt
Priya !!!
 
1 canara bank-po-sample-paper-2009
1 canara bank-po-sample-paper-20091 canara bank-po-sample-paper-2009
1 canara bank-po-sample-paper-2009
Kumar Nirmal Prasad
 
Introduction to gre quant
Introduction to gre quantIntroduction to gre quant
Introduction to gre quant
Crack The Quant
 
Unit 4 Fourth Grade 2012 2013
Unit 4 Fourth Grade 2012 2013Unit 4 Fourth Grade 2012 2013
Unit 4 Fourth Grade 2012 2013Isaac_Schools_5
 
Multiplicative number theory i.classical theory cambridge
Multiplicative number theory i.classical theory cambridgeMultiplicative number theory i.classical theory cambridge
Multiplicative number theory i.classical theory cambridgeManuel Jesùs Saavedra Jimènez
 

What's hot (15)

Arguments
ArgumentsArguments
Arguments
 
Computer Science XII - Hissan 2078
Computer Science XII - Hissan 2078Computer Science XII - Hissan 2078
Computer Science XII - Hissan 2078
 
May 29, 2015
May 29, 2015May 29, 2015
May 29, 2015
 
Analysis Table of English Paper 9th Class
Analysis Table of English Paper 9th Class  Analysis Table of English Paper 9th Class
Analysis Table of English Paper 9th Class
 
2003 book discrete_mathematics
2003 book discrete_mathematics2003 book discrete_mathematics
2003 book discrete_mathematics
 
Saturation Index of π(D(r,s))
Saturation Index of π(D(r,s))Saturation Index of π(D(r,s))
Saturation Index of π(D(r,s))
 
March 2, 2015
March 2, 2015March 2, 2015
March 2, 2015
 
Permutations and combinations ppt
Permutations and combinations pptPermutations and combinations ppt
Permutations and combinations ppt
 
1 canara bank-po-sample-paper-2009
1 canara bank-po-sample-paper-20091 canara bank-po-sample-paper-2009
1 canara bank-po-sample-paper-2009
 
Introduction to gre quant
Introduction to gre quantIntroduction to gre quant
Introduction to gre quant
 
Muhammad Arif CV
Muhammad Arif CVMuhammad Arif CV
Muhammad Arif CV
 
Unit 4 Fourth Grade 2012 2013
Unit 4 Fourth Grade 2012 2013Unit 4 Fourth Grade 2012 2013
Unit 4 Fourth Grade 2012 2013
 
M.Sc_Syllabus
M.Sc_SyllabusM.Sc_Syllabus
M.Sc_Syllabus
 
Multiplicative number theory i.classical theory cambridge
Multiplicative number theory i.classical theory cambridgeMultiplicative number theory i.classical theory cambridge
Multiplicative number theory i.classical theory cambridge
 
World war ii timeline assignment rubric
World war ii timeline assignment rubricWorld war ii timeline assignment rubric
World war ii timeline assignment rubric
 

Similar to Analysis of Algorithms Syllabus

The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
YanNaingSoe33
 
2018 syllabus
2018 syllabus2018 syllabus
2018 syllabus
sunilSunilmech345
 
Algorithms - Jeff Erickson.pdf
Algorithms - Jeff Erickson.pdfAlgorithms - Jeff Erickson.pdf
Algorithms - Jeff Erickson.pdf
Hannah Baker
 
Algorithm Design and Complexity - Course 1&2
Algorithm Design and Complexity - Course 1&2Algorithm Design and Complexity - Course 1&2
Algorithm Design and Complexity - Course 1&2
Traian Rebedea
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.pptbutest
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.pptbutest
 
Linear Algebra_ Theory_Jim Hefferon
Linear Algebra_ Theory_Jim HefferonLinear Algebra_ Theory_Jim Hefferon
Linear Algebra_ Theory_Jim Hefferon
Bui Loi
 
Data stuctures
Data stucturesData stuctures
Data stucturesshadshaf
 
Data structures and algorisms
Data structures and algorismsData structures and algorisms
Data structures and algorismsAhmed Farag
 
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELERSTRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
Bahzad5
 
Ideas about a Bachelor in Machine Learning/Data Sciences
Ideas about a Bachelor in Machine Learning/Data SciencesIdeas about a Bachelor in Machine Learning/Data Sciences
Ideas about a Bachelor in Machine Learning/Data Sciences
Andres Mendez-Vazquez
 
Testing Scientific Thinking Skills protocol
Testing Scientific Thinking Skills protocolTesting Scientific Thinking Skills protocol
Testing Scientific Thinking Skills protocol
jdomen44
 
number theory Rosen
number theory Rosen   number theory Rosen
number theory Rosen
Vui Lên Bạn Nhé
 
Recursive algorithms in depth - Geek gap webinar #2
Recursive algorithms in depth - Geek gap webinar #2Recursive algorithms in depth - Geek gap webinar #2
Recursive algorithms in depth - Geek gap webinar #2
junior Teudjio
 
Classifying Non-Referential It for Question Answer Pairs
Classifying Non-Referential It for Question Answer PairsClassifying Non-Referential It for Question Answer Pairs
Classifying Non-Referential It for Question Answer Pairs
Jinho Choi
 
A First Course In With Applications Complex Analysis
A First Course In With Applications Complex AnalysisA First Course In With Applications Complex Analysis
A First Course In With Applications Complex Analysis
Elizabeth Williams
 
Amet University- B.Sc Data Science Syllabus
Amet University-  B.Sc Data Science SyllabusAmet University-  B.Sc Data Science Syllabus
Amet University- B.Sc Data Science Syllabus
ametinstitute
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical features
IJwest
 

Similar to Analysis of Algorithms Syllabus (20)

Gate
GateGate
Gate
 
The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
The Design and Analysis of Computer Algorithms [Aho, Hopcroft & Ullman 1974-0...
 
2018 syllabus
2018 syllabus2018 syllabus
2018 syllabus
 
Algorithms - Jeff Erickson.pdf
Algorithms - Jeff Erickson.pdfAlgorithms - Jeff Erickson.pdf
Algorithms - Jeff Erickson.pdf
 
Algorithm Design and Complexity - Course 1&2
Algorithm Design and Complexity - Course 1&2Algorithm Design and Complexity - Course 1&2
Algorithm Design and Complexity - Course 1&2
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
 
MLlecture1.ppt
MLlecture1.pptMLlecture1.ppt
MLlecture1.ppt
 
Linear Algebra_ Theory_Jim Hefferon
Linear Algebra_ Theory_Jim HefferonLinear Algebra_ Theory_Jim Hefferon
Linear Algebra_ Theory_Jim Hefferon
 
Data stuctures
Data stucturesData stuctures
Data stuctures
 
Data structures and algorisms
Data structures and algorismsData structures and algorisms
Data structures and algorisms
 
4th sem
4th sem4th sem
4th sem
 
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELERSTRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
STRUCTURAL ANALYSIS NINTH EDITION R. C. HIBBELER
 
Ideas about a Bachelor in Machine Learning/Data Sciences
Ideas about a Bachelor in Machine Learning/Data SciencesIdeas about a Bachelor in Machine Learning/Data Sciences
Ideas about a Bachelor in Machine Learning/Data Sciences
 
Testing Scientific Thinking Skills protocol
Testing Scientific Thinking Skills protocolTesting Scientific Thinking Skills protocol
Testing Scientific Thinking Skills protocol
 
number theory Rosen
number theory Rosen   number theory Rosen
number theory Rosen
 
Recursive algorithms in depth - Geek gap webinar #2
Recursive algorithms in depth - Geek gap webinar #2Recursive algorithms in depth - Geek gap webinar #2
Recursive algorithms in depth - Geek gap webinar #2
 
Classifying Non-Referential It for Question Answer Pairs
Classifying Non-Referential It for Question Answer PairsClassifying Non-Referential It for Question Answer Pairs
Classifying Non-Referential It for Question Answer Pairs
 
A First Course In With Applications Complex Analysis
A First Course In With Applications Complex AnalysisA First Course In With Applications Complex Analysis
A First Course In With Applications Complex Analysis
 
Amet University- B.Sc Data Science Syllabus
Amet University-  B.Sc Data Science SyllabusAmet University-  B.Sc Data Science Syllabus
Amet University- B.Sc Data Science Syllabus
 
Question Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical featuresQuestion Classification using Semantic, Syntactic and Lexical features
Question Classification using Semantic, Syntactic and Lexical features
 

More from Andres Mendez-Vazquez

2.03 bayesian estimation
2.03 bayesian estimation2.03 bayesian estimation
2.03 bayesian estimation
Andres Mendez-Vazquez
 
05 linear transformations
05 linear transformations05 linear transformations
05 linear transformations
Andres Mendez-Vazquez
 
01.04 orthonormal basis_eigen_vectors
01.04 orthonormal basis_eigen_vectors01.04 orthonormal basis_eigen_vectors
01.04 orthonormal basis_eigen_vectors
Andres Mendez-Vazquez
 
01.03 squared matrices_and_other_issues
01.03 squared matrices_and_other_issues01.03 squared matrices_and_other_issues
01.03 squared matrices_and_other_issues
Andres Mendez-Vazquez
 
01.02 linear equations
01.02 linear equations01.02 linear equations
01.02 linear equations
Andres Mendez-Vazquez
 
01.01 vector spaces
01.01 vector spaces01.01 vector spaces
01.01 vector spaces
Andres Mendez-Vazquez
 
06 recurrent neural_networks
06 recurrent neural_networks06 recurrent neural_networks
06 recurrent neural_networks
Andres Mendez-Vazquez
 
05 backpropagation automatic_differentiation
05 backpropagation automatic_differentiation05 backpropagation automatic_differentiation
05 backpropagation automatic_differentiation
Andres Mendez-Vazquez
 
Zetta global
Zetta globalZetta global
Zetta global
Andres Mendez-Vazquez
 
01 Introduction to Neural Networks and Deep Learning
01 Introduction to Neural Networks and Deep Learning01 Introduction to Neural Networks and Deep Learning
01 Introduction to Neural Networks and Deep Learning
Andres Mendez-Vazquez
 
25 introduction reinforcement_learning
25 introduction reinforcement_learning25 introduction reinforcement_learning
25 introduction reinforcement_learning
Andres Mendez-Vazquez
 
Neural Networks and Deep Learning Syllabus
Neural Networks and Deep Learning SyllabusNeural Networks and Deep Learning Syllabus
Neural Networks and Deep Learning Syllabus
Andres Mendez-Vazquez
 
Introduction to artificial_intelligence_syllabus
Introduction to artificial_intelligence_syllabusIntroduction to artificial_intelligence_syllabus
Introduction to artificial_intelligence_syllabus
Andres Mendez-Vazquez
 
Ideas 09 22_2018
Ideas 09 22_2018Ideas 09 22_2018
Ideas 09 22_2018
Andres Mendez-Vazquez
 
20 k-means, k-center, k-meoids and variations
20 k-means, k-center, k-meoids and variations20 k-means, k-center, k-meoids and variations
20 k-means, k-center, k-meoids and variations
Andres Mendez-Vazquez
 
18.1 combining models
18.1 combining models18.1 combining models
18.1 combining models
Andres Mendez-Vazquez
 
17 vapnik chervonenkis dimension
17 vapnik chervonenkis dimension17 vapnik chervonenkis dimension
17 vapnik chervonenkis dimension
Andres Mendez-Vazquez
 
A basic introduction to learning
A basic introduction to learningA basic introduction to learning
A basic introduction to learning
Andres Mendez-Vazquez
 
Introduction Mathematics Intelligent Systems Syllabus
Introduction Mathematics Intelligent Systems SyllabusIntroduction Mathematics Intelligent Systems Syllabus
Introduction Mathematics Intelligent Systems Syllabus
Andres Mendez-Vazquez
 
Introduction Machine Learning Syllabus
Introduction Machine Learning SyllabusIntroduction Machine Learning Syllabus
Introduction Machine Learning Syllabus
Andres Mendez-Vazquez
 

More from Andres Mendez-Vazquez (20)

2.03 bayesian estimation
2.03 bayesian estimation2.03 bayesian estimation
2.03 bayesian estimation
 
05 linear transformations
05 linear transformations05 linear transformations
05 linear transformations
 
01.04 orthonormal basis_eigen_vectors
01.04 orthonormal basis_eigen_vectors01.04 orthonormal basis_eigen_vectors
01.04 orthonormal basis_eigen_vectors
 
01.03 squared matrices_and_other_issues
01.03 squared matrices_and_other_issues01.03 squared matrices_and_other_issues
01.03 squared matrices_and_other_issues
 
01.02 linear equations
01.02 linear equations01.02 linear equations
01.02 linear equations
 
01.01 vector spaces
01.01 vector spaces01.01 vector spaces
01.01 vector spaces
 
06 recurrent neural_networks
06 recurrent neural_networks06 recurrent neural_networks
06 recurrent neural_networks
 
05 backpropagation automatic_differentiation
05 backpropagation automatic_differentiation05 backpropagation automatic_differentiation
05 backpropagation automatic_differentiation
 
Zetta global
Zetta globalZetta global
Zetta global
 
01 Introduction to Neural Networks and Deep Learning
01 Introduction to Neural Networks and Deep Learning01 Introduction to Neural Networks and Deep Learning
01 Introduction to Neural Networks and Deep Learning
 
25 introduction reinforcement_learning
25 introduction reinforcement_learning25 introduction reinforcement_learning
25 introduction reinforcement_learning
 
Neural Networks and Deep Learning Syllabus
Neural Networks and Deep Learning SyllabusNeural Networks and Deep Learning Syllabus
Neural Networks and Deep Learning Syllabus
 
Introduction to artificial_intelligence_syllabus
Introduction to artificial_intelligence_syllabusIntroduction to artificial_intelligence_syllabus
Introduction to artificial_intelligence_syllabus
 
Ideas 09 22_2018
Ideas 09 22_2018Ideas 09 22_2018
Ideas 09 22_2018
 
20 k-means, k-center, k-meoids and variations
20 k-means, k-center, k-meoids and variations20 k-means, k-center, k-meoids and variations
20 k-means, k-center, k-meoids and variations
 
18.1 combining models
18.1 combining models18.1 combining models
18.1 combining models
 
17 vapnik chervonenkis dimension
17 vapnik chervonenkis dimension17 vapnik chervonenkis dimension
17 vapnik chervonenkis dimension
 
A basic introduction to learning
A basic introduction to learningA basic introduction to learning
A basic introduction to learning
 
Introduction Mathematics Intelligent Systems Syllabus
Introduction Mathematics Intelligent Systems SyllabusIntroduction Mathematics Intelligent Systems Syllabus
Introduction Mathematics Intelligent Systems Syllabus
 
Introduction Machine Learning Syllabus
Introduction Machine Learning SyllabusIntroduction Machine Learning Syllabus
Introduction Machine Learning Syllabus
 

Recently uploaded

Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation & Control
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Teleport Manpower Consultant
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
Osamah Alsalih
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
ydteq
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
zwunae
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
SyedAbiiAzazi1
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
BrazilAccount1
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Soumen Santra
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
FluxPrime1
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
bakpo1
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
Investor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptxInvestor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptx
AmarGB2
 

Recently uploaded (20)

Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdfTop 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
Top 10 Oil and Gas Projects in Saudi Arabia 2024.pdf
 
MCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdfMCQ Soil mechanics questions (Soil shear strength).pdf
MCQ Soil mechanics questions (Soil shear strength).pdf
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
一比一原版(IIT毕业证)伊利诺伊理工大学毕业证成绩单专业办理
 
14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application14 Template Contractual Notice - EOT Application
14 Template Contractual Notice - EOT Application
 
AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTSHeap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
Heap Sort (SS).ppt FOR ENGINEERING GRADUATES, BCA, MCA, MTECH, BSC STUDENTS
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
Investor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptxInvestor-Presentation-Q1FY2024 investor presentation document.pptx
Investor-Presentation-Q1FY2024 investor presentation document.pptx
 

Analysis of Algorithms Syllabus

  • 1. Analysis of Algorithms and Complexity Andres Mendez-Vazquez Email: amendez@gdl.cinvestav.mx Office Hours 3:00-4:00 PM Monday and Wednesday Room 365 Contents 1 Overview 1 2 Texts 1 3 Prerequisites 2 4 Course Requirements 2 4.1 English . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 4.2 Exams . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 4.3 Homework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2 5 Subjects 3 1 Overview In this class, you will learn to analyze and understand the computational complexity of different data structures and algorithms in Computer Science. For this, we will learn to use the asymptotic notation to analyze and understand their computational complexity. Examples of these methods are minimum spanning trees, greedy algorithms, probabilistic algorithms, etc. Finally, we will look at the fact that the universe of polynomial algorithms is smaller than the universe of the non-polynomial algorithms. For this, we will learn when an algorithm is Non-Polynomial (NP) by transforming it to an already well known NP-Complete algorithm. 2 Texts The required text for this course is: • Thomas H. Cormen, Charles E. Leiserson, Ronald L. Rivest, and Clifford Stein, Introduction to Algorithms, Third Edition (MIT Press, 2009). In addition you can consult the following texts: • S. Dasgupta, C. H. Papadimitriou, and U. V. Vazirani, Algorithms, First Edition (McGraw-Hill Education, 2006). • Rajeev Motwani and Prabhakar Raghavan, Randomized Algorithms, Cambridge University Press, New York, NY, USA. • R. Sedgewick, K. Wayne, Algorithms (Addison-Wesley Professional, 2011). 1
  • 2. 3 PREREQUISITES 2 • Russ Miller and Laurence Boxer. 2005. Algorithms Sequential and Parallel: A Unified Approach (Charles River Media Computer Engineering (Hardcover)). Charles River Media, Inc., Rockland, MA, USA. • Mark de Berg, Otfried Cheong, Marc van Kreveld, and Mark Overmars. 2008. Computational Geometry: Algorithms and Applications (3rd edition). Telos, Santa Clara, CA, USA. In addition to a lot of papers. 3 Prerequisites Discrete mathematics, basic probability and data structures. 4 Course Requirements The requirements of the course are Requirement % of Grade Date 1. Midterm #1 15% Jan 31 2. MIDTERM #2 15% Feb 31 3. MIDTERM #3 15% March 28 3. Final 15% April 30 4. HOMEWORKS 20% TBA 5. Project 20% TBA 4.1 English We will use English to teach the class. However you can ask in Spanish, I reserve the right to answer in English or Spanish. 4.2 Exams We will have three exams in this course, and you have five hours per test. Blank pages will be provided. No makeup test unless medical issues with letter by the doctor. 4.3 Homework We will have homework with four problems in each. You will use the format of IEEE style latex class at single column for the homeworks. No other format will be accepted. It needs to have the following format: 1. Name and date must be at the first page. 2. Each problem must be stated before the solution. It will no accepted in other way. They will be uploaded in the web place for the class. The programming assignments need to work in order to be graded. - Late Homeworks will have 0 automatically.
  • 3. 5 SUBJECTS 3 5 Subjects In this course, we will cover the following subjects: 1. Foundations (a) The Role of Algorithms in Computing (b) Growth of Functions (c) Divide-and- Conquer (d) Recurrences (e) Probabilistic Analysis and Randomized Algorithms 2. Sorting (a) Heapsort i. For Priority Queues (b) Quicksort i. Definition ii. Expected time complexity (c) Sorting in Linear Time i. Counting Sort ii. Radix Sort iii. Bucket Sort (d) Lower bounds for sorting under comparisons 3. Median and Order Statistics (a) Definition (b) Expected time for the i-th statistics (c) The Worst Case for the i-th statistics 4. Basic Data Structures (a) Elementary Data Structures (b) Hash Table i. Definition (c) Binary Search Trees i. Definition ii. Insertion and Deletions iii. Rotations (d) Red-Black Trees i. Well balanced trees 5. Advanced Techniques (a) Dynamic Programming i. Introduction ii. Optimality of the subproblems iii. Avoiding the recursion
  • 4. 5 SUBJECTS 4 iv. Examples: A. Longest Common subsequence B. Matrix Chain Multiplication (b) Greedy Algorithms i. Introduction ii. Defining the Greedy Choice iii. Examples: A. Knapsack Problem B. Scheduling C. Hoffman Codes (c) Amortized Analysis i. Introduction ii. Aggregated Method iii. Accounting Method iv. Potential Method v. Examples: A. Dynamic Tables B. Move-to-Front 6. Advanced Data Structures (a) Skip Lists - A probabilistic Data Structure (b) B-Trees - Fast Access to indexes (c) Fibonacci Heaps - Better Priority Queues 7. Graph Algorithms (a) Elementary Graph Algorithms (b) Minimum Spanning Trees i. Prim and Kruskal (c) Single-Source Shortest Paths i. Bellman-Ford ii. Dijkstra’s Algorithms (d) All-Pairs Shortest Paths i. Dynamic Programming Solution ii. Floyd-Warshall iii. Johnson’s Algorithm (e) Maximum Flow i. Introduction ii. Ford-Fulkerson iii. Edmond-Karp 8. Selected Topics (a) Multi-threaded Algorithms i. Introduction ii. Multi-Threading Model
  • 5. 5 SUBJECTS 5 iii. Hierarchy of Complexities iv. Example A. Parallel Fibonacci B. Parallel Matrix Multiplication C. Parallel Merge Sort (b) Matrix Based Algorithms i. The Holy Grail - The Strassen’s Algorithm ii. Lower Upper Decomposition iii. Applications (c) String Matching i. Introduction ii. Rabin-Karp (d) Computational Geometry i. Representation ii. Segment Intersection iii. Convex Hull 9. NP-Completeness (a) Definitions (b) Encodings (c) Polynomial Time Verification (d) Polynomial Reduction (e) NP-Hard (f) NP-Complete proofs (g) A family of NP-Problems 10. Dealing with NP-Problems (a) Backtracking (b) Branch-and-Bound (c) Approximation Algorithms i. Approximation Ratios ii. Problems A. Vertex Cover B. Traveling Salesman Problem C. Set Covering Problem