1. DSA - Introduction.pptx

DataStructuresandAlgorithms (CS-2001)
KALINGAINSTITUTEOFINDUSTRIAL
TECHNOLOGY
SchoolofComputer Engineering
Lecture Note
4 Credit
Strictlyforinternal circulation (within KIIT)andreferenceonly.Notforoutsidecirculation without permission

Function
10
School of ComputerEngineering
• The program becomes large and complex
• A lengthy program can be coded separately into
sub-programs called as Functions
• For repetition of certain part of code

FunctionDefinition
10
The general form of function definition statement in Cis as follows:
return_data_type function_name(data_type variable1,...) Function header
{
declarations;
statements;
return(expression);
}
 function_name:
 This is the name given to the function
 it follows the same naming rules as that for any valid variable in C.
 return_data_type:
 This specifies the type of data given back to the calling construct by the function
after it executes its specific task.
Function Body

calsum ( int x, int y,int z )
{
int d ;
d = x + y + z ;
return d ;
}
PassingValuesbetween Function
11
int main()
{
int a, b, c, sum;
printf ( "nEnter any three numbers " ) ;
scanf ( "%d %d %d", &a, &b, &c ) ;
sum = calsum ( a, b, c ) ;
printf ( "nSum = %d", sum ) ;
return 0;
}

int calsum ( int x, int y,int z )
{
int d ;
d = x + y + z ;
return d ;
}
PassingValuesbetween Function
11
int main()
{
int a, b, c, sum;
printf ( "nEnter any three numbers " ) ;
scanf ( "%d %d %d", &a, &b, &c ) ;
sum = calsum ( a, b, c ) ;
printf ( "nSum = %d", sum ) ;
return 0;
}
 a, b, c are calledactual arguments
 x, y and z are called formal
arguments
 main is the calling function and
calsumis the calledfunction

Functionreturn statement
12

Functionreturn statement
12
There is no restriction on the number of return statements that may be present in a
function. Also, the return statement need not always be present at the end of the called
function. The following program illustrates these facts.
int fun( )
{
char ch ;
printf ( "n Enter any alphabet " ) ;
scanf ( "%c", &ch ) ;
if ( ch >= 65 &&ch <= 90 )
return ( ch ) ;
else
return ( ch + 32 ) ;
}

ScopeRuleof Functions
13
display ( int j )
{
int k = 35 ;
printf ( "n%d", j ) ;
printf ( "n%d", k ) ;
}
int main( )
{
int i = 20 ;
display ( i ) ;
return 0;
}
In this program is it necessary to pass the value of
the variable i to the function display( )? Will it not
become automatically available to the function
display( )? No.Because by default the scope of a
variable is local to the function in which it is defined.
The presence of i is known only to the function
main( ) and not to any other function. Similarly, the
variable k is local to the function display( ) and
hence it is not available to main( ). That is why to
make the value of i available to display( ) we have to
explicitly pass it to display( ). Likewise, if we want k
to be available to main( ) we will have to return it to
main( ) using the return statement. In general we
can say that the scope of a variable is local to the
function in which it is defined.

FunctionCallby ValueandCallby Reference
14
Whenever we called a function and passed something to it we have always
passed the ‘values’ of variables to the called function. Such function calls are
called ‘calls by value’. By this what we mean is, on calling a function we are
passing values of variables to it. The examples of call by value are shown below:
sum=calsum( a,b,c) ;
We have also learnt that variables are stored somewhere in memory. So instead
of passing the value of a variable, can we not pass the location number (also
called address) of the variable to a function? If we were able to do so it would
become a ‘callbyreference’.
Arguments can generally be passed to functions in one of the two ways:
 sending the values of the arguments
 sending the addresses of the arguments

FunctionCallby ValueandCallby Reference
15
swapByValue ( int x, int y )
{
int t ;
t = x ;
x = y ;
y = t ;
printf ( "nx = %d y = %d", x, y ) ;
}
int main( )
{
int a = 10, b = 20 ;
swapByValue( a, b );
printf ( "na = %d b = %d", a, b ) ;
return 0;
}
Call by Value
}
swapByRef ( int *x,int*y )
{
int t ;
t = *x;
*x = *y ;
*y = t ;
printf ( "nx = %d y = %d", *x, *y ) ;
int main( )
{
int a = 10, b = 20 ;
swapByRef( &a, &b ) ;
printf ( "na = %d b = %d", a, b ) ;
return 0;
}
Call by Reference

Pointers
Storing Variable in Memory
16
The value inside a box indicates
the value in that memory location.
The value under a box is the
memory address of that box.

Pointers
16
 When we declare a variable and initialize it,
 int quantity = 179 ;
quantity variable
179 value
5000 address
Since memory address are simple
numbers they can be assigned to
some other variables
Pointers

Pointers
16
• Pointer is an entity which contains memory address
• Pointers can be used to access data stored in memory
• There are two operators for pointers
• address operator ‘&’
• Dereference operator ‘*’ (value of operator)

Pointers
16

Accessing Address of a Variable
16
main( )
{
int i=3;
printf(“n Address of i = %u”,&i);
printf(“n Value of i = %d”,i);
}
OUTPUT :
Address of i = 6485
Value of i =3

Declaring pointer Variables
16
 The declaration is done as follows
data_type *pt_name;
 * tells that pt_name is a pointer variable
 pt_name needs memory location
 pt_name points to a variable of type data_type
 Remember data_type tells the type of data pointer will point to and not the
value of pt_name
 Example
 int *p;
 float *x;

Initialization of pointer variables
16
 int quantity;
int *p; //declaration
p=&quantity; //initialization
 int x, *p=&x; // all steps in one
 // Assignment of NULL or 0 (zero)
int *p=NULL;
int *p=0;
 // this is invalid, absolute address
int *p=5360;

Accessing Variable Through its
Pointer
16
 * operator known as
 Indirection operator
 Dereference operator
 Example
int a,*p, n; //declaration
a=179; // variable assignment
p=&a; // pointer initialization
n=*p; //value at address operator
 When * is placed at declaration it is used creating a pointer
 * placed on right hand side of expression it returns the value at a
address. In this case it will return 179

Accessing Variable Through its
Pointer
16
#include<stdio.h>
main()
{
int a=10;
int *ptr;
printf("a before = %d",a);
ptr=&a;
printf("nvalue of ptr = %u", ptr);
*ptr=85;
printf("nnew a is = %d",a);
getch();
}

16

Chain of Pointers
16

Pointer Expression
16
 Following statements are valid
y=*p1 * *p2;
sum=sum+*p1;
z=5*(-(*p2))/ *p1;
 Two pointers cannot be used for division or
multiplication

Pointer Increments and Scale Factors
16
 Pointers can be incremented like
 p1=p1+2;
 p1=p1+1;
 Expression like
 p1++
 will cause pointer to next value of its type

Structure
Arrays allow to define type of variables that can hold several data items of the same kind. Similarly
structure is another user defined data type available in C that allows to combine data items of
different kinds.
Structuresare used to represent a record.Suppose you want to keep track of your books in a
library. You might want to track the following attributes about each book −
 Title
 Author
 Subject
 Book ID
Defining the Structure:
struct [structuretag]
{
member definition;
member definition;
...
member definition;
}[one or more structure variables];
struct Books
{
char title[50];
char author[50];
char subject[100];
int book_id;
}book;
Book Structure
/* Declare Book1 of type Book */
struct BooksBook1;
struct BooksBook2;
Book1.title =“DSA”;
Book2.book_id =6495700;
AccessStructureElements
16

Union
Unions are quite similar to the structures in C. Union is also a derived type as
structure. Union can be defined in same manner as structures just the keyword
used in defining union in union where keyword used in defining structure was
struct.
You can define a union with many members, but only one member can contain a
value at any given time. Unions provide an efficient way of using the same
memorylocation for multiple-purpose.
Defining the Union:
union [uniontag]
{
member definition;
member definition;
...
member definition;
}[one or more union variables];
union Data
{
int i;
float f;
char str[20];
}data;
Data Union
struct Data data;
data.i =10;
data.f =34.72;
data.str =“CProgramming”
AccessUnionElements
17

Differenceb/w Structure& Union
Structure Union
Instructureeachmemberget separate spacein
memory.Takebelow example.
struct student
{
int rollno;
char
gender;
float marks;
} s1;
Thetotal memoryrequired to store a structure
variable isequal to the sumof sizeof all the
members.Inabove case7 bytes (2+1+4) will
be required to store structurevariable s1.
Inunion,the total memoryspaceallocated is
equal to the memberwith largest size.All other
memberssharethe samememoryspace.Thisis
the biggest difference between structureand
union.
union student
{
int rollno;
char
gender;
float marks;
}s1;
Inabove example variable marksisof float type
and have largest size(4 bytes). Sothe total
memoryrequired to store unionvariable s1is4
bytes.
18

Differenceb/w Structure&Union continue…
Structure Union
Pictorial Representation
19

Differenceb/w Structure&Union cont…
Structure Union
We canaccessany memberin any sequence.
s1.rollno = 20;
s1.marks= 90.0;
printf(“%d”,s1.rollno);
We canaccessonly that variable whosevalue is
recently stored.
s1.rollno = 20;
s1.marks= 90.0;
printf(“%d”,s1.rollno);
The above code will show erroneous output. The
value of rollno is lost as most recently we have
stored value in marks. This is because all the
memberssharesamememoryspace.
All the members can be initialized
while declaring the variable of structure.
Only first member can be initialized while
declaring the variable of union. In above
example, we can initialize only variable rollno at
the time of declaration of variable.
20

Pointers
int i = 10;
What thedeclaration tells theC compiler?
 Reserve space in memory to hold the integer value
 Associate the name i with this memory location
 Store the value 10 at this location
Memory Map
10
i
XXXXX (e.g.6458)
LocationName
Value at Location
LocationNumber
Code Snippet
#include<stdio.h>
intmain()
{
intintVariable=10;
printf(“AddressofintVariable=%u”,&intVariable);
printf(“ValueofintVariable=%d”, intVariable);
return0;
}
Apointer is a variable whose value is the address of another variable, i.e., direct address of the memory location. Like any
variable or constant, you must declare a pointer before using it to store any variable address. The general form of a pointer
variable declaration is− type *var-name;
21

Pointers cont…
CodeSnippet1
#include<stdio.h>
intmain()
{
inti =10;
int*j;
j =&i;
return0;
}
Memory Map
i
10
6458
j
6458
7455
CodeSnippet2
#include<stdio.h>
intmain()
{
inti =10, *j,**k;
j =&i;
k =&j;
return0;
}
Memory Map
i
10
6458
j
6458
7455
k
7455
8452
22

Pointerscont…NULLPointers
It is always a good practice to assign a NULLvalue to a pointer variable in case you do not have an exact address to be
assigned. This is done at the time of variable declaration. Apointer that is assigned NULLis called a null pointer.
The NULLpointer is a constant with a value of zero defined in several standard libraries.
Code Snippet
#include<stdio.h>
intmain()
{
int*ptr =NULL;
printf("Thevalue ofptr is :%un", ptr );
return 0;
}
Null Pointer Checking
1. if (ptr == null) or if (ptr <> null)
2. If (ptr) or if ( !ptr)
Commonlydonemistakes
int c,*pc;
pc=c; /* pc is address whereas, c is not an address. */
*pc=&c; /* &c is address whereas, *pc is not an address. */
23

DynamicMemory Allocation
24
The exact size of array is unknown until the compile time i.e. time when a compiler compiles code
written in a programming language into a executable form. The size of array you have declared
initially can be sometimes insufficientandsometimes morethanrequired.
What?
The process of allocating memory during program execution is called dynamic memory allocation. It
also allows a program to obtain more memory space, while running or to release space when no
space is required.
Differencebetweenstatic anddynamic memoryallocation
Sr # Static Memory Allocation Dynamic Memory Allocation
1 User requested memory will be allocated
at compile time that sometimes insufficient
and sometimesmorethan required.
Memory isallocated while executing the
program.
2 Memory sizecan‟tbe modified while
execution.
Memory sizecanbe modified while
execution.

DynamicMemoryAllocation cont…
Functionsavailable in Cfor memory management
Sr # Function Description
1 void *calloc(int num,int size) Allocates anarray of numelementseach of whichsize
in bytes will be size.
2 void free(void *address) Releasesa block of memoryblock specified by address.
3 void *malloc(int num) Allocates anarray of numbytes and leave them
initialized.
4 void *realloc(void *address,
int newsize)
Re-allocates memoryextending it upto new size.
25

DynamicMemoryAllocation Example
pi=(int *) malloc(sizeof(int));
pj=(float*) malloc(sizeof(float));
free(pi);
free(pj);
#include<stdio.h>
#include<stdlib.h>
int main()
{
int*pi;
float*pj;
*pi =10;
*pj =3.56;
printf(“integer=%d, float=%f”,*pi,*pj);
return 0;
}
if(!pi|| !pj)
{
printf(“Insufficient Memory”);
return;
}
#include <stdio.h>
#include <stdlib.h>
int main()
{
int*pi;
float *pj;
pi=(int*)malloc(sizeof(int));
pj=(float*)malloc(sizeof(float));
*pi =10;
*pj=3.56;
printf(“integer=%d, float=%f”,*pi,*pj);
free(pi);
free(pj);
return0;
}
I
M
H
IMH : Insufficient Memory Handling
26

DMAreallocExample
#include <stdio.h>
#include <stdlib.h>
int main()
{
char *mem_allocation;
/* memory is allocated dynamically */
mem_allocation = malloc( 20 *sizeof(char));
if( mem_allocation== NULL )
{
printf("Couldn't able to allocaterequested memoryn"); return;
}
else
{
strcpy( mem_allocation,“dynamic memory allocationfor realloc function");
}
printf("Dynamically allocatedmemory content : %sn", mem_allocation );
mem_allocation=realloc(mem_allocation,100*sizeof(char));
if( mem_allocation== NULL )
{
printf("Couldn't able to allocaterequested memoryn");
}
else
{
strcpy( mem_allocation,"spaceis extended upto 100 characters");
}
printf("Resizedmemory : %sn", mem_allocation );
free(mem_allocation);
return 0;
}
CProgram illustrating the usage of realloc
27

Differencebetweencallocand malloc
Sr # malloc calloc
1 It allocates only single block of
requested memory
It allocates multiple blocks of
requested memory
2 doesn‟tinitializes the allocated
memory.It containsgarbage values.
initializes the allocated memoryto
zero
3 int *ptr;
ptr = malloc( 20 * sizeof(int));
Forthe above, 20*2 bytes of
memoryonly allocated inoneblock.
Total= 40 bytes
int *ptr;
Ptr = calloc( 20, 20 * sizeof(int));
Forthe above, 20 blocksof memory
will be created and eachcontains
20*2 bytes of memory.
Total= 800 bytes
28

Algorithm Specification
29
An algorithm is a finite set of instructions that, if followed, accomplishes a particular task. In
addition, all algorithms must satisfy the following criteria:
1. Input.There are zero or more quantities that are externally supplied.
2. Output.At least one quantity isproduced.
3. Definiteness.Each instruction is clear and unambiguous.
4. Finiteness.If we trace out the instructions of an algorithm, then for all cases, the algorithm
terminates after a finite number of steps.
5. Effectiveness. Every instruction must be basic enough to be carried out, in principle, by a
person using only pencil and paper. It is not enough that each operation be definite as in (3); it
also must befeasible.
Differencebetweenanalgorithm&program– program does not have to satisfy the 4th condition.
Describing Algorithm
1. NaturalLanguage–e.g. English, Chinese - Instructions must be definite and effectiveness.
2. Graphicsrepresentation–e.g.Flowchart- work well only if the algorithm is small and simple.
3. PseudoLanguage -
• Readable
• Instructions must be definite and effectiveness
4. CombiningEnglishand C

AlgorithmSpecification cont…
DescribingAlgorithm – Natural Language
Problem- Design an algorithm to add two
numbers anddisplay result.
Step 1 −START
Step 2 − declare three integers a, b &c
Step 3 − define values of a &b
Step 4 − add values of a &b
Step 5 − store output of step 4 to c
Step 6− print c
Step 7 −STOP
Note - Writing step numbers, is
optional.
Problem - Design an algorithm find the
largest data value of a set of given positive
data values
Step 1 −START
Step 2 − input NUM
Step 3 –LARGE= NUM
Step 4− While (NUM >=0)
if (NUM > LARGE)then
LARGE= NUM
input NUM
Step 5 – display “Largest Value is:”, LARGE
Step 6 −STOP
30

DescribingAlgorithm – Flowchart
Problem–Write an algorithm to determine a student’s final grade and indicate whether it is passing of failing.
The final grade is calculated as the average of five marks.
Start
Input
M1 to M5
Grade = (M1 + M2 + M3 + M4 + M5) / 5
IsGrade < 4.0
Print “Pass”
Print “Fail”
Stop
31

PseudoLanguage
32
The Pseudo language is neither an algorithm nor a program. It is an abstract form of a program. It consists of
English like statements which perform the specific operations. It employs programming-like statements to
depict the algorithm and no standard format (language independent) is followed. The statements are carried out
in a order &followings are the commonly used statements.
Statement Purpose General Format
Input Get Information INPUT: Nameof variable
e.g. INPUT:user_name
Process Performanatomic activity Variable  arithmetic expression
e.g. x  2 or x  x + 1 or a  b * c
Decision Choosebetweendifferent alternatives
IF(condition ismet)then
statement(s)
ENDIF
IF(condition ismet)THEN
statement(s)
ELSE
statements
(s) ENDIF
e.g.
IF(amount< 100) THEN
interestRate .06
ENDIF
e.g.
IF(amount< 100) THEN
interestRate  .06
ELSE
interestRate .10
ENDIF

PseudoLanguage cont…
33
Statement Purpose General Format
Repetition Performa stepmultiple times REPEAT
statement(s)
UNTIL (conditionis met)
WHILE (conditionismet)
statement(s)
ENDWHILE
e.g.
count 0
REPEAT
ADD1 to count
OUTPUT:count
UNTIL(count < 10)
OUTPUT:“TheEnd”
e.g.
count 0
WHILE(count< 10)
ADD1 to count
OUTPUT: count
ENDWHILE
OUTPUT:“TheEnd”
Output Display information OUTPUT: Nameof variable
e.g. OUTPUT: user_name
OUTPUT: message
OUTPUT:„Credit Limit‟limit

PseudoLanguage Guidelines
Guidelines Explanation
Write only onestatementper line Eachstatementinpseudocodeshouldexpressjustoneactionfor thecomputer.If thetasklist isproperly
drawn, thenin mostcaseseachtask will correspondto oneline of pseudocode.
Task List Pseudo code
Readname,hours worked, rate of pay INPUT:name,hoursWorked,payRate
gross= hoursworked * rate of pay gross hoursWorked* payRate
Write name, hoursworked, gross OUTPUT:name,hoursWorked,gross
Capitalize initial keyword Intheexample above notethewords:INPUT and OUTPUT. Theseare justa few of thekeywordsto use,
othersinclude:IF, ELSE,REPEAT, WHILE, UNTIL, ENDIF
Indentto show hierarchy Eachdesignstructure usesa particular indentation pattern.
 Sequence - Keepstatementsinsequenceall starting in the samecolumn
 Selection - Indentstatementsthat fall insideselectionstructure,but notthekeywordsthat form the
selection
 Loop - Indentstatementsthat fall insidetheloop but notkeywordsthat form theloop
INPUT:name,grossPay,taxes
IF(taxes > 0)
net grossPay– taxes
ELSE
net grossPay
ENDIF
OUTPUT:name,net
34

PseudocodeGuidelines cont…
35
Guidelines Explanation
Endmultilinestructures INPUT:name,grossPay,taxes
IF(taxes > 0)
net grossPay– taxes
ELSE
net grossPay
ENDIF
OUTPUT:name,net
WatchtheIF/ELSE/ENDIFasconstructedabove,theENDIFisin line with theIF.Thesameapplies for
WHILE/ENDWHILEetc…
Keepstatementslanguage
independent
Resisttheurge to write inwhatever language youare mostcomfortable with, inthelong runyouwill save
time.Rememberyouare describinga logic plan to develop a program, youare not programming!

PseudoLanguage Example
36
1. Problem- Design the pseudo code to add two numbers and display the average.
INPUT: x, y
sum  x + y
average  sum / 2
OUTPUT: ‘Average is:’average
2. Problem- Design the pseudo code to calculate &display the area of a circle
INPUT: radius
area 3.14 *radius *radius
OUTPUT: ‘Area of the circle is ‘area
2. Problem- Design the pseudo code to calculate &display the largest among 2 numbers
INPUT: num1, num2
max num1
IF (num2 > num 1) THEN
max  num2
ENDIF
OUTPUT: ‘Largest among 2 numbers is’max

Example- Translatinga Probleminto anAlgorithm – CombiningEnglishandC
 Problem - Devise a program that sorts a set of n>= 1 integers
 Step I – Concept– looks good but not an algorithm
 From those integers that are currently unsorted, find the smallest and place it next in the sorted list – selection sort
 Step II – An algorithm,written in Cand English
for (i= 0; i< n; i++)
{
Examine list[i] to list[n-1] and suppose that the smallest integer is list[min];
Interchange list[i] and list[min];
}
 Optional Step III – Coding– translating the algorithm to Cprogram
void sort(int *a, int n) {
for (i= 0; i< n; i++) {
int j=i;
for (int k= i+1; k< n; k++) {
if (a[k]< a[j]) {
j = k; int temp=a[i]; a[i]=a[j]; a[j]=temp;
}
}
}
}
37

Translatinga Probleminto anAlgorithm cont… Correctness Proof
 Theorem
 Function sort(a, n) correctly sorts a set of n>= 1 integers. The result
remains in a[0], ..., a[n-1] such that a[0]<= a[1]<=...<=a[n-1].
 Proof
For i= q, following the execution of lines, we have a[q]<= a[r], q< r< =n-1.
For i> q, observing, a[0], ..., a[q] are unchanged.
Hence, increasing i, for i= n-2, we have a[0]<= a[1]<= ...<=a[n-1]
38

RecursiveAlgorithm
A recursive algorithm is an algorithm which calls itself. In general, recursive computer
programs require more memory and computation compared with iterative algorithms, but
they are simpler and for many cases a natural way of thinking about the problem. There
are 2 types of recursive functions.
Directrecursion Function Indirectrecursion Function
Functions call themselves e.g. function α
calls α
Functions call other functions that invoke the calling
function again e.g. a function α calls a function β that in
turn calls the original function α.
Example–
int fibo (int n)
{
if (n==1 || n==2)
return 1;
else
return (fibo(n-1)+fibo(n-2));
}
Example–
int func1(int n)
{
if (n<=1)
return 1;
else
return func2(n);
}
int func2(int n)
{
return func1(n);
}
39

RecursiveAlgorithm cont…
 When is recursionanappropriatemechanism?
 The problem itself is defined recursively
 Statements: if-else and while can be written recursively
 Art of programming
 Whyrecursivealgorithms ?
 Powerful, express an complex process very clearly
 Properties - Arecursive function can go infinite like a loop. To avoid infinite running of
recursive function, there are two properties that a recursive function must have −
 Basecriteria− There must be at least one base criteria or condition, such that,
when this condition is met the function stops calling itself recursively.
 Progressivecriteria− The recursive calls should progress in such a way that each
time a recursive call is made it comes closer to the base criteria.
 Implementation- Many programming languages implement recursion by means of
stack.
40

RecursiveImplementationof Fibonacci
#include<stdio.h>
void Fibonacci(int);
int main()
{
int k,n;
long int i=0,j=1,f;
printf("Enter the range of the Fibonacci series: ");
scanf("%d",&n);
printf("Fibonacci Series: ");
printf("%d %d ",0,1);
Fibonacci(n);
return 0;
}
//continuation ofprogram
void Fibonacci(int n)
{
static long intfirst=0,second=1,sum;
if(n>0)
{
}
}
Base Criteria
sum = first+ second;
first = second;
second = sum;
printf("%ld ",sum);
Fibonacci(n-1); Progressive Criteria
41

AlgorithmAnalysis
We design an algorithm to get solution of a given problem. Aproblem can be
solved in more than one ways.
Hence, many solution algorithms can be derived for a given problem. Next step
is to analyze those proposed solution algorithms and implement the best
suitable.
42

AlgorithmAnalysis cont…
stages, before
 A priori analysis − This is theoretical analysis of an algorithm. Efficiency of
algorithm is measured by assuming that all other factors e.g. processor speed,
are constant and have no effect on implementation.
 A posterior analysis − This is empirical analysis (by means of direct and
indirect observation or experience) of an algorithm. The selected algorithm is
implemented using programming language. This is then executed on target
computer machine. In this analysis, actual statistics like running time and space
required and arecollected.
Focus
43
Efficiency of an algorithm can be analyzed at two different
implementation and after implementation, as mentioned below −
Apriori analysis

Algorithm Complexity
Suppose X is an algorithm and n is the size of input data, the time and
space used by the Algorithm Xare the two main factors which decide the
efficiency of X.
 TimeFactor−The time is measured by counting the number of key
operations such as comparisons in sorting algorithm
 SpaceFactor−The space is measured by counting the maximum
memory space required by the algorithm.
The complexity of an algorithm f(n) gives the running time and / or
storage space required by the algorithm in terms of n as the size of input
data.
44

SpaceComplexity
45
Space complexity of an algorithm represents the amount of memory space required by the
algorithm in its life cycle. Space required by an algorithm is equal to the sum of the following two
components −
 Afixed part that is a space required to store certain data and variables, that are independent of
the size of the problem. For example simple variables &constant used, program size etc.
 Avariable part is a space required by variables, whose size depends on the size of the problem.
For example dynamic memory allocation, recursion stack space etc.
Space complexity SC(P) of any algorithm P is SC(P) = FP + VP (I) where FP is the fixed part and
VP(I) is the variable part of the algorithm which depends on instance characteristic I. Following is a
simple example that tries to explain the concept −
Algorithm: SUM(A,B)
Step 1 - START
Step 2 - C←A+ B+10
3 variables and data type of each variable is int, So VP(3)
= 3*2 = 6 bytes (No. of characteristic i.e. I = 3)
1 constant (i.e. 10) and it is int, so FP = 1*2 = 2 bytes
Step 3 - Stop So - SC(SUM) = FP + VP(3) = 2 + 6 = 8 bytes

SpaceComplexity cont…
Example 1
int square(int a)
{
return a*a;
}
In above piece of code, it requires 2 bytes of
memory to store variable 'a' and another 2
bytes of memory is used for return value.
That means, totally it requires 4 bytes of
memory to complete its execution. And this
4 bytes of memory is fixed for any input
value of 'a'. This space complexity is said to
be ConstantSpaceComplexity.
If any algorithm requires a fixed amount of
space for all input values then that space
complexity is said to be Constant Space
said to be Linear Space Complexity
Complexity
Example 2
int sum(int a[], int n)
{
}
int sum= 0, i;
for(i = 0; i < n; i++) {sum = sum +A[i];}
return sum;
In above piece of code it requires -
• 2*n bytes of memory to store array variable ‘a[]’
• 2 bytes of memory for integer parameter 'n‘
• 4 bytes of memory for local integer variables 'sum'
and 'i' (2 bytes each)
• 2 bytes of memory for return value.
That means, totally it requires '2n+8' bytes of memory to
complete its execution. Here, the amount of memory depends
on the input value of 'n'. This space complexity is said to be
LinearSpace Complexity.
If the amount of space required by an algorithm is increased
with the increase of input value, then that space complexity is
46

TimeComplexity
Time Complexity of an algorithm represents the amount of time required by the
algorithm to run to completion. Time requirements can be defined as a numerical
function T(n), where T(n) can be measured as number of steps * time taken by
each steps
For example, addition of two n-bit integers takes n steps. Consequently, the total
computational time is T(n) = c*n, where c is the time taken for addition of two bits.
Here, we observe that T(n) grows linearly as input size increases.
considered constant.
to defining the mathematical
Asymptotic analysis
Asymptotic analysis of an algorithm, refers
foundation/framing of its run-timeperformance.
Asymptotic analysis are input bound i.e., if there's no input to the algorithm it is
concluded to work in a constant time. Other than the "input" all other factors are
47

TimeComplexitycont…Asymptotic analysis
Asymptoticanalysisrefers to computing the running time of any
operation in mathematical units of computation.
For example,
- Running time of one operation is computed as f(n)
- May be for another operation it is computed as g(n2)
Usually, time required by an algorithm falls under three types –
 BestCase− Minimum time required for program execution.
 Average Case− Average time required for program execution.
 WorstCase− Maximum time required for program execution.
48

TimeComplexitycont…Best,AverageandWorst
Caseexamples
 BestCase − The 1st item of the array equals to k
 AverageCase− Match at n/2
 WorstCase − The last position of the array equals to k
Example1: Travelfrom KanyakumaritoSrinagar
 WorstCase− Yougo to Ahemdabad and then you take a east go to
Guhwati and then again take a west and go to Srinagar.
 AverageCase − You go normal route highways only to reach there.
Best Case − Take every short cut possible leave the national
highway if you need to take state highway, district road if you need to
but you have to get to Srinagar with least possible distance
Example2: Sequential Searchfor k in anarray of nintegers
49

TimeComplexitycont…Asymptotic Notations
Following are commonly used asymptotic notations used in calculating running
time complexity of an algorithm.
Ο Notation – “Big Oh” - The Ο(n) is the formal way to express the upper
bound of an algorithm's running time. It measures the worst case time
complexity or longest amount of time an algorithm can possibly take to
complete.
Ω Notation – “Omega” - The Ω(n) is the formal way to express the lower
bound of an algorithm's running time. It measures the best case time
complexityor best amountof time an algorithm can possibly take to complete.
θ Notation –“Theta” - The θ(n) is the formal way to express both the lower
boundandupperboundof an algorithm's running time.
50

TimeComplexitycont…AsymptoticNotations cont…
Time-SpaceTradeOff
The best algorithm to solve a given problem is one that requires less space in memory and takes less time
to complete its execution. But in practice it is not always possible to achieve both these objectives. As we
know there may be more than one approach to solve a particular problem. One approach may take more
space but takes less time to complete its execution while the other approach may take less space but takes
more time to complete its execution. We may have to sacrifice one at the cost of the other. If space is our
constraint, then we have to choose a program that requires less space at the cost of more execution time.
On the other hand if time is our constraint then we have to choose a program that takes less time to
complete its execution at the cost of more space.
Sr # Algorithm Time Complexity
Best Average Worst
1 Bubble Sort Ω(n) Θ(n2) O(n2)
2 Insertion Sort Ω(n2) Θ(n2) O(n2)
3 Quick Sort Ω(n log n) Θ(n log n) O(n2)
4 Merge Sort Ω(n log n) Θ(n log n) O(n log n)
5 Heap Sort Ω(n log n) Θ(n log n) O(n2)
51

TimeComplexityRules
52
 Time complexity of a function (or set of statements) is considered as O(1) if it
doesn’t contain loop, recursion and call to any other non-constant time
function. Example:
void swap(int *x, int*y)
{
int temp;
temp=*x;
*x=*y;
*y=temp;
}
Time complexity of swap function= Total number of simple statements = 4 =
constant =O(1)
Note-
ConstantTime- algorithm runs in a fixed amount of time, it just means that it isn't proportional to the length/size/magnitude of the
input. i.e., for any input, it can be computed in the same amount of time (even if that amount of time is really long).

TimeComplexityRulesfor Loops
 Aloop or recursion that runs a constant number of times is also considered as
O(1). Example-
int i;
for (i = 1; i <= c; i++) / / c is a constant
{
/ / some O(1) expressions
}
 Time Complexity of a loop is considered as O(n)if the loop variables i is
incremented / decremented by a constant amount c. Example-
for (i = 1; i <= n; i = i+c)
{
}
53

TimeComplexityRulesforLoops cont…
 Time Complexity of a loop is considered as O(logn)if the loop variables i is
multiplied or divided by a constant amount c. Example-
for (i = 1; i <= n; i=i*c)
{
}
 Time Complexity of a loop is considered as O(log log n) if the loop variables i
if the loop variables is reduced / increased exponentially by a constant
amount c. Example-
Example 1 Example 2
Here cisa constantgreater than1
for (i = 2; i <= n;i=pow(i,c))
{
/ / someO(1)expressions
}
//Here funissqrt or cuberoot or any other constantroot
for (i = n;i > 0; i = fun(i))
{
}
54

 Time complexity of nested loops is equal to the number of times the innermost
statement is executed that is nothing but the multiplication of outer loop complexity
into inner loop complexity.
Sr # Program Segment Time Complexity Explanation
1 int i, j, k;
for (i = 1; i <=m; i ++)
{
for (j = 1; j <=n; j ++)
{
k=k+1;
}
}
O(m*n)
If m= n,thenO(n2)
Outer for mtimesand inner for n
times,sototal m*n times
2 int i, j, k;
for (i = n;i >1; i =i-2)
{
for (j = 1; j <=n; j=j+3)
{
k=k+1;
}
}
O(n2) Outer loop approx n times and
inner approx n times, so total n2
times.
55

3 int i, j, k;
for (i = n;i >1; i =i*2)
{
for (j = 1; j <=n; j++)
{
k=k+1;
}
}
O(nlog n) Outer loop approx log ntimes,inner
loop ntimes,sototal nlog ntimes.
4 int i, j, k;
for (i = 1; i<=n; i=i*2)
{
for (j =n; j>=1; j=j/2)
{
k= k +1;
}
}
O((log n)2) Outer loop approx log ntimesand
innerloop approx log ntimes,sototal
((log n)2times.
56

1 for (int i = 1; i <=m; i += c)
{
}
for (int i = 1; i <=n; i += c)
{
}
O(m+n)
If m=n, then
O(2n)=O(n
)
Firstfor outer i loop O(m),secondfor
inneri loop O(n)times,sototal
O(m+n) times
5 for (i = 1; i<=n; i++)
{
for (j =1; j<=100; j++)
{
Simple-Statements;
}
}
O(n) Theouter loop executesapprox. n
times,and theinnermost100 times.
Here n=O(n) and 100=O(1) constant
time.Sototal = O(n)*O(1) = O(n)
 When there are consecutive loops, the time complexity is calculated as sum of time
complexities of individual loops and final time complexity is the higher order term in
terms of n (the one which is larger than others for larger value of n)
57

2 for (int i = 1; i <=n; i *= 2)
{
}
for (int i = 1; i <=n; i ++)
{
}
O(n) First for outer i log n times, second inner i it
is n times. Now total=log n + n = O(n) as n
isasymptotically larger thanlog n.
3 int i, j, k,l;
for (i = 1; i <=n; i ++)
{
for (j = 1; j <=n; j=j*2) {p=i+j;}
}
for (k= n;k>=1; k=k/3)
{ q=k+p; }
for (l = n;l >=1; l=l-2)
{ q=k+p; }
O(nlog n) Nestedfor-ij loop isexecuted nlog
ntimes.kloop log ntimes,l loop
ntimes.Sototal= nlog n+ log n+ n=
O(nlog n)asnlog n> n> logn
1<logn< n<n<nlogn<n2<n3<....<2n<3n<...<nn
58

TimeComplexityRulesfor Recursion
1 Factorial of a number
int Factorial (int n)
{
if n== 0 then
return 0;
else
return n* Factorial(n – 1)
}
O(n) comparison,multiplication and subtraction
are simplestatementsand eachtakes1
unitof time.SoT(n)= T(n-1)+ 3 if n> 0
T(0)= 1 if n= 0
SoT(n)= T(n-1)+ 3
= T(n-2)+ 6
= T(n-k)+ 3k
Whenk= n,T(n)= T(0)+ 3n
= 3n+ 1
SoT(n)= O(n)
2 Fibonacci Sequence
int Fib(int n)
{
if n<= 1then
return1;
else
return Fib(n-1)+ Fib (n–2)
}
?? ??
59

Sr # Program Segment Space
Complexit
y
Explanation
1 int sum(intx, int y, int z)
{
int r = x + y + z;
return r;
}
O(1) requires 3 unitsof spacefor theparameters
and 1 for thelocal variable, and thisnever
changes,sothisisO(1).
2 int sum(inta[], int n){
int r = 0;
for (int i = 0; i < n;++i) {
r += a[i];
}
return r;
}
O(n) requires nunitsfor a, plusspacefor n,r and
i, soit's O(n).
3 void matrixAdd(int a[], int b[], int c[], int n){
for (int i = 0; i < n;++i) {
c[i] = a[i] + b[j]
}
}
O(n) requires nunitsfor a, b and cplusspacefor
n,and i, soit'sO(n).
SpaceComplexity Rules
60

Summary
Detailed Lessons
Functions,Structuresand Unions,Pointers,DynamicMemory Allocation, Algorithm
Specification, Spaceand TimeComplexity
Howwasthejourney?
61

int a = 0, b = 0;
for (i = 0; i < N; i++) {
a = a + rand();
}
for (j = 0; j < M; j++) {
b = b + rand();
}
Find time complexity

int a = 0;
for (i = 0; i < N; i++) {
for (j = N; j > i; j--) {
a = a + i + j;
}
}
Find time complexity

62

Assignments
1. Find the time complexity of the following code segment
 for (i = 1; i <= n; i = i*2)
{
for (j = n; j >= 1; j = j/2) {some statement }
}
 for (j= c; j > 0; j--) / / consider c as const
{
some statement
}
 for (i = n; i <= 1; i = i/c) / / consider c as const
{
/ / some statement
}
2. Write an recursive algorithm to print from 1 to n (where n > 1)
3. Write an recursive algorithm to find the kth smallest element of a set S
4. Write an recursive algorithm to sum the list of numbers
63

5. Find the space complexity of the following code segment
int Factorial (int n)
{
if n== 0 then
return 0;
else
return n *Factorial(n – 1)
}
6. Find the time and space complexity of the following code segment
 int Fib(intn)
{
if n <= 1then
return 1;
else
return Fib(n-1) + Fib (n – 2)
}
64
Assignments

HomeWork(HW)
 Find the time and space complexity of the following code segment
 int GCD(int x, inty)
{
if y == 0 then
return x
else if x >= y ANDy > 0
return GCD(y, x % y)
else
return 0;
}
65

HomeWork(HW)
 Find the time and space complexity of the following code segment
void matrixAddition(int a[][], int b[][], int c[][], int n)
{
int i,j;
for (i = 0; i < n; ++i)
{
for (j = 0; j < n; ++j)
{
c[i][j] = a[i][j] +b[i][j];
}
}
}
66

SupplementaryReading
 Watch thefollowing video
 https://www.youtube.com/watch?v=8syQKTdgdzc
 https://www.youtube.com/watch?v=AL7yO-I5kFU
 http://nptel.ac.in/courses/106102064/1
 Read the following
 https://www.tutorialspoint.com/data_structures_algorithms/
67

F
AQ
 What is Information - If we arrange some data in an appropriate sequence,
then it forms a Structure and gives us a meaning. This meaning is called
Information . The basic unit of Information in Computer Science is a bit,
Binary Digit. So, we found two things in Information: One is Data and the
other isStructure.
 Whatis Data Structure?
1. Adata structure is a systematic way of organizing and accessing data.
2. Adata structure tries to structure data!
 Usually more than one piece of data
 Should define legal operations on the data
 The data might be grouped together (e.g. in an linked list)
3. When we define a data structure we are in fact creating a new data type
of our own.
 i.e. using predefined types or previously user defined types.
Such new types are then used to reference variables type within a
program
68

FAQcont…
 WhyData Structures?
1. Data structures study how data are stored in a computer so that
operations can be implemented efficiently
2. Data structures are especially important when you have a large amount of
information
3. Conceptual and concrete ways to organize data for efficient storage and
manipulation.
 ADT
1. Abstract Data Types (ADT's) are a model used to understand the design of
a data structure
2. 'Abstract' implies that we give an implementation-independent view of the
data structure
3. ADTsspecify the type of data stored and the operations that support the
data
4. Viewing a data structure as an ADTallows a programmer to focus on an
idealized model of the data and its operations
69

FAQcont…
 Time Complexity of algorithm - Time complexity of an algorithm signifies
the total time required by the program to run till its completion. The time
complexity of algorithms is most commonly expressed using the big O
notation. Time Complexity is most commonly estimated by counting the
number of elementary functions performed by the algorithm. And since the
algorithm's performance may vary with different types of input data, hence
for an algorithm we usually use the worst-case Time complexity of an
algorithm because that is the maximum time taken for any input size.
 Types ofNotationsforTime Complexity
1. Big Oh denotes "fewer than or the same as" <expression> iterations.
2. Big Omega denotes "more than or the same as" <expression> iterations.
3. Big Theta denotes "the same as" <expression> iterations.
4. Little Oh denotes "fewer than" <expression> iterations.
5. Little Omega denotes "more than" <expression> iterations. idealized
model of the data and its operations
70

1. DSA - Introduction.pptx

More Related Content

Similar to 1. DSA - Introduction.pptx

Recently uploaded

1. DSA - Introduction.pptx