Algorithm design and analysis
In the design and analysis of an algorithm, we need to consider two-term Time complexity and Space complexity. without analyzing the time and space complexity we cannot analyze the performance of an algorithm and also cannot design the steps of an algorithm.
To design an algorithm we must consider the steps in a sequence so that it should have low time and space complexity.
Performance Analysis of Algorithm
Time complexity - Time complexity is used to estimate the running time of the algorithm in terms of the size of input data. for this purpose, we need to use a notation called big 'O' notation.
Space complexity - Space complexity is used to measure the defined extra space consumed by the algorithm except for input data. this is also considered in terms of input size and big 'O' notation is also used to measure the space complexity of an algorithm.
To calculate time and space complexity we use these notations.
- Big Oh notation
- Omega notation
- Theta notation
Big On notation
The function f(n) = O(g(n)) (consider as "f of n is big oh of g of n") if and only if there exist positive constants c and m such that f(n) =m.
The function 3n+2 = O(n) as 3n+2 =2
The function 6*2^n+(n*n) = O(2^n) as 6*2^n+(n*n) = 4.
so we can write O(1) to mean a computing time that is a constant. O(n) is a linear, O(n*n) is called quadric, O(n*n*n) is called cubic and O(2*n) is called exponential. if there is an algorithm that takes time O(log N), it is considered to be faster than O(n).
The function f(n) = Ω(g(n)) (consider as "f of n is omega of g of n"). if and only if there exist positive constants a and b such that f(n) >= a*g(n) for all n,n>=b.
The function 3n + 2 = Ω(n) as 3n+2 >= 3n for all n >= 1.
The function 6*(2^n)+(n*n) = Ω(2^n) as 6*2^n+(n*n) >= 6*(2^n) for all n >= 1.
The function f(n) = Θ(g(n)) (consider as "f of n is theta of g of n"). if and only if there exist positive constants c and m such that c*g(n) = 3n for all n>=1 and 3n+2 =2.
The function 6*(2^n)+(n*n) = Θ(2^n).
How to count the number of steps in the algorithm.
To count the number of steps that are needed by a program to solve a particular problem has two ways. in the first approach we introduce a new variable, count into the program. this is a global variable that has initially a value of 0. so each time a statement is executed in the original program then this count is incremented by the step count of that statement.
Algorithm Sum(a, n)
s = 0
count = count + 1 [count is global variable that has initially set to 0]
for i = 1 to n do
count = count + 1 [ for FOR loop]
s = s + a[i]
count = count + 1 [for s]
count = count + 1[for last time of for]
count = count + 1[for the return]
Cases to consider to analyzing an algorithm
Choosing an input to consider when analyzing an algorithm can have a significant impact on how an algorithm will perform. for example, if the input list is already sorted, some sorting algorithms will perform well, but on another side, some may perform very poorly. also if we have a list that has randomly arranged instead of in a sporting manner. then there are some algorithms that perform well but others may not. hence we need to consider multiple input sets while analyzing the algorithm as given below.
Best case input - This case occurs when the input set allows an algorithm to perform in a very short time. with this input, the algorithm takes minimum time to execute. so in this case algorithm needs to do the least amount of work to execute. let's say we have a list of items and we need to find the item from a list. so the best case is if the item is available at the first position. so the algorithm needs to do the least work because the item is found in the very first position. so this is the best case for the algorithm.
Worst case input - This case occurs when the input set that we give to the algorithm takes a very long time to perform. it is a very useful case because using the worst-case analysis we can define the worst scenario of an algorithm. that gives us an idea of the long time that an algorithm takes to perform in every case. let's say we have a list of items and we need to find out an item from that list. so what happens if the item is present at the last position of the list. so this is a worst-case scenario for an algorithm and it will take the most time to perform.
Average case input - This represents the input set that allows an algorithm to deliver average performance. doing average-case analysis is a four-step process. these steps are as under
the number of different groups into which all possible input sets can be divided is determined.
the probability that the input will come from each of these groups has been determined.
Design of algorithm
To design an algorithm we need to follow some rules to make an algorithm work and have low complexity. as we know an algorithm is a finite set of instructions to solve a particular problem. so to solve a particular task using an algorithm must need to satisfy the following criteria
- Input - given by the user (this could be 0 or more)
- Output - At least one output is produced by the algorithm
- Definiteness - Each instruction is unambiguous and clear.
- Finiteness - A algorithm always needs to terminate after a finite number of steps for every input.
- Effectiveness - every instruction that we are using must always be in basic form so one can easily understand the meaning.
For an algorithm time, the duration for which the given input is generating the result, and the space it uses to store the steps are two major factors to measure the efficiency of an algorithm. the complexity of an algorithm is the function that gives the time and space complexity of that algorithm in terms of input size.
To represent the algorithm of a problem we have two parts in the first part we have a paragraph that tells the purpose of the algorithm that identifies the variables that occur in the algorithm. and in the second part consist of the list of step that needs to execute.
Key points to writing an algorithm
For Assigning set A = 1, LOC = 1 and MAX = A (assign from left to right)
For comments [comments that were never included in the program to execute]
All variables in the algorithm should be written in Capital letters
For assignment =
Comparison =, !=
For input READ - Input variables
For Output WRITE - Output variables
Let's write some algorithms to understand the design of the algorithm.
Algorithm to write the sum of two numbers
Read A and B
Set SUM = A + B
Algorithm to write a maximum of two numbers
Read A and B
If A > B, then
Set MAX = A
Set MAX = B
[End of If structure]
Here in both examples, we have written the steps to get the sum of two numbers and find the maximum of two numbers. as we stated above in the first part we have to use the keywords to tell the purpose of the line just like Ready, Set, Write, Exit, If, Else. and in the second part, we have included the steps that are to be executed.
Some key points to writing an algorithm
- Read - read the input data from the user
- Set - Use the Assignments on the data
- Write - print the data on the screen
- Exit - exit from the program
- If - check for the condition if true then execute a line
- Else - If the conditions are false then execute a line
- [End of If structure] - comment for the users always included in the [ ] parentheses.