Professional Documents
Culture Documents
Akachukwu Chichebe, M.
M.ENG/SEET/2007/1874 Supervised by Dr. A. M. Aibinu and Engr. Dr. M. N. Nwohu 20th February, 2014
Presentation Outline
Abstract. Introduction. Problem Statement. Motivation. Research Objectives. Research Methodology. Literature Review. Formulation. Method and Mathematical Model. Performance Analysis. Conclusion. References.
Abstract
This research shall present the Development of a Hybrid Genetic/K-Means Algorithm for Unmanned Aerial Vehicle (UAV) Route Optimization. There is a serious concern on achieving the necessary balance between the available on-board energy and the operational goals of range and endurance so as to meet up with mission requirements. This work is aimed at optimizing the performance of the UAV by minimizing the travel route in a multi-destination mission employing a hybrid of Genetic Algorithm (GA) and K-Means Algorithm. The Hybrid GA/K-Means Technique was benchmarked with the GA-Roulette Wheel Selection Method. The result shows that the Hybrid GA/K-Means Technique greatly outperforms the GA-Roulette Wheel Selection Method.
Introduction
An unmanned aerial vehicle (UAV), commonly known as a drone is an aircraft without a human pilot on board. UAV, have been found indispensable for various applications where human intervention is considered difficult or dangerous (Koo et al,. 2002). Three main important characteristics of any UAV/aircraft are, range (how far), endurance (how long) and what can it carry (payload).
UAV Systems
Source: Office of the US Secretary of Defence, UAV Systems Roadmap 2005-2030
Uses: Scientific research Commercial aerial surveillance. Domestic policing. Agriculture. Search and rescue. Remote sensing. Transportation. Armed attacks. The factors that determine range, endurance and payload are power, weight and efficiency (Ashwin Ravi, 2010). This has necessitated the need to optimize these parameters applying artificial intelligence techniques such as Genetic Algorithm (GA).
Genetic Algorithm (GA) is a random universal evolutionary search technique that imitates the principle of biological evolution. A multipath that searches many peaks in parallel, hence reducing the possibility of local minimum trapping. Works with a bit string encoding instead of the real parameters. The coding of parameter will help the genetic operator to evolve the current state into the next state with minimum computations. Evaluates the fitness of each string to guide its search instead of the optimization function.
GA are helpful and proficient when: The search space is big and/or complicated. Domain knowledge is rare and Mathematical analysis is lacking. Traditional search methods fall short of requirements.
INITIALIZE POPULATION
EVALUATE FITNESS
SELECTION
CROSSOVER
NO
MUTATION
FITNESS EVALUATION
YES
END
K-means clustering is a technique for sorting/grouping items into K groups. The grouping is done by minimizing the sum of squared distances (Euclidean distances) between items and the corresponding centroid. A clustered scatter plot.
Black dots = data points. Blue dots = centroids which define the partitions. Red lines = partitions created by the k-means algorithm.
Start
SOME APPLICATIONS
Traffic Anomaly Detection. GPS Lane Finding. Colour Image Segmentation. Monitoring over Moving Objects. Prediction of Students Academic Performance.
Generate a new partition by assigning each point to the closest cluster centres
YES
NO End
Problem Statement
Various attempts have been reported about the use of GA in route optimization in engineering related problems. Despite the promising results obtained, the reproduction process, one of the most critical processes in GA evolution process has been shown to decide the success or failure of the algorithm. GA selection methods during reproduction are plagued with different shortcomings.
Motivation
Three main important characteristics pertaining to any UAV/aircraft are, range (how far), endurance (how long) and what can it carry (payload). The factors that determine range, endurance and payload are power, weight and efficiency. A motivating factor is the idea of combining the Genetic Algorithm and the K-Means clustering algorithm to optimize the UAVs route. Thereby ensuring that it always takes the shortest path in order to efficiently minimise fuel and power consumption.
Research Objectives
The aims and objectives of this thesis are: 1) To formulate an appropriate GA/K-Means hybridization technique. 2) To develop a MATLAB based algorithm for route optimization. 3) To evaluate the performance of the developed algorithm on UAV route optimization as a case study. 4) To develop a MATLAB based Graphical User Interface for UAV route optimization.
Research Methodology
Review of literatures related to UAVs and some previous works done by researchers as concerns system optimization techniques using GA and Kmeans Algorithms. Development working principles of the K-Means and GA. Integrating GA and K-Means to achieve the proposed hybrid system. Highlighting the approaches and techniques used to implement the proposed GA/K-Means hybrid method and data analysis of the work. Applying the newly developed and optimized to the UAV route optimization. Benchmarking results with a normal GA Roulette Wheel Selection method.
S/N Genetic Algorithms 1 Work with a coding of the parameter set 2 Search from a population of points 3 Use payoff (objective function) information 4 Use probabilistic transition rules
Engineering Applications of GA
S/N Author(s) Research Work Results
GA for optimization of word GA employing the FFT instance can length coefficients in a be used for most DSP tasks pipelined FFT processor needing real time operation.
Erentok and A hybrid optimization method GA optimization results were Ziolkowski to analyse metamaterial-based employed to get the upper and (2007) electrically small antennas lower solution space bounds that were needed to compute the maximum total radiated power . Benachaiba et al., (2007) A novel technique for the parameters optimization of the Unified Power Quality Conditioner (UPQC) using Genetic Algorithm (GA). It was shown that parameters optimized by GA gave to UPQC a better strength and additional efficiency. Modified GA is faster and more accurate than Error-and-Trial method and conventional GA, FGPSS optimized with modified GA can improve stability of hydroelectricity scheme
Wang et al., A modified GA based (2008) optimization design of fuzzy governor power system (FGPSS) stabilizer for hydrogenerator unit
Hai and Instruction scheduling for low GA is a superior technique for the Binh (2013) power using GA. problem of scheduling for low power, with a large search space and an intricate optimal solution.
10
11
12
Zhang et Continuous K-means al., (2008) monitoring over moving objects using threshold-based k-means monitoring (TKM).
The explanation of the proposed methodology is as highlighted in step 1-9 herewith. 1) Initialize. The initial population of candidate solutions is generally created arbitrarily across the domain. The initial population size (N); Population growth rate (r); Mutation rate () and number of generations (n).
1 = .0 1
. . (1)
2) Fitness function evaluation: Evaluate the fitness values of the candidate solutions within the initialized population. 3) Selection Using K-Means. Define and choose the number of clusters k needed. Selection allots more copies of those solutions with superior fitness values thereby imposing the survival-of-the-fittest apparatus on the candidate solutions.
points from their respective cluster centres. a) Calculate Centroid. Re-compute the new k centroids after allotting each point to a cluster. 0 = ( 0 )2 +( 0 )2 .(3)
4) 5)
6)
Recombine. Two or more parental solutions are recombined to generate new, probably superior solutions (i.e. offspring). Elitism. Implemented so that the best solution of every generation is copied to the next so that the possibility of its destruction through a genetic operator is eliminated. Crossover. This work adopts the two point crossover technique. In the two point crossover technique, two points are randomly selected as the cut-points and exchanges the right parts of two parents to generate offspring.
7) Mutate. Mutation locally but arbitrarily alters a solution (i.e. offspring). It usually involves one or more changes being made to an individuals trait or traits. 8) Replace. The original parental population is replaced by the created offspring population (solution). 9) Repeat. Reiterate steps 28 pending convergence or a predefined ending condition is met.
Recombine parents for two offspring; Compute fitness of offspring; Insert offspring in new generation END FOR UNTIL population has converged END
Experimental Setup
UAV Route Graphical User Interface (GUI) Description
Experimental Setup
The UAV is to travel between 5 locations not far apart along the earth surface.
5 D5
D3
D4
D2
D1
0 0
D0 1 2 3 4 5
Assumptions
The distance between any two points are symmetrical and are on a flat plane. There are no changes in the elevation value of the points in consideration. The distance between any two points is not greater than 20 kilometres.
0 =
( 0 )2 +( 0 )2
(3)
Equation (3) is the Euclidean distance formula. The distance from one location to another is computed using (3) and the distance matrix obtained is as stated in table below
D0 D0 0 D1 1.4142 D2 3.6065 D3 4.1231 D4 5.6569 D5 7.0711
D1
D2 D3 D4 D5
1.4142
3.6065 4.1231 5.6569 7.0711
0
2.2361 3 4.2426 5.6569
2.2361
0 2.2361 2.2361 3.6056
3
2.2361 0 3 4.1231
4.2426
2.2361 3 0 1.4142
5.6569
3.6056 4.1231 1.4142 0
Performance Analysis
The performance of the developed algorithm is analysed based on the following varying input factors/parameters; Generation size. Size of population. Mutation rate. Growth rate.
10
20
Observation. Low Generation sizes results in high and unsteady values of average travelled distance thus reducing the effectiveness and efficiency of the algorithm. High Generation sizes results in high computing time. Hence generation size 6 is chosen as the optimal value because it presented an optimal solution with a relative low computing time.
20
30
40
0 0 13.0095
0 0 13.0095 0 0
50
100
Observation. Since population size defines the number of chromosomes in a population (in one generation), few chromosomes imply GA has a few possibilities to implement crossover and only a small portion of search space is explored( this hangs the computer each time it is ran) too many chromosomes slow down the GA process. thus, in this the population size of 40 is selected because further increase in population does not help in solving the process faster.
0.25
0.2
0.15
0 13.0218 0.0551
0.0030 13.0095 0 0
0.1
Observation. the computation time is not affected by the mutation rate. the randomness presented by mutation aids in searching for global optima solutions and avoiding getting stuck in local optima as was the case while using the mutation value of 0.15. Too high mutation rates results in almost random search in the population hence mutation rate of 0.2 gives lowest standard deviation and variance with respect to the computational time implying consistency. The convergence of all but one of the mutation rate samples to a global optima supports that the presented novel method is efficient, reliable and effective.
0.1
0.15
0.23
0.33
0.5
Observation. computational time increases with growth rate. all sampled growth rates presented a near-steady value of average travelled distance and average worst travelled implying reliability, effectiveness and efficiency. growth rate of 0.23 is chosen because it presented the lowest standard deviation and variance with respect to the computational time implying consistency. the convergence of all but one of the growth rate samples to a global optima supports that the presented novel method is efficient, reliable and effective.
1 2 3 4 5 6 7 8 9 10
Population Size 40.0000 40.0000 40.0000 40.0000 40.0000 40.0000 40.0000 40.0000 40.0000 40.0000
Generation Size 6 6 6 6 6 6 6 6 6 6
Mutation Rate 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2
Growth Rate 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23
Best Distance 13.0465 13.0341 13.0095 13.0465 13.0341 13.0465 13.0218 13.0218 13.0095 13.0095
Worst Distance 18.7412 18.6919 18.7412 18.7412 18.7042 18.7412 18.7289 18.7289 18.7166 18.7412
Average Distance 16.1703 16.0449 15.9464 16.2083 15.8120 16.0943 16.0448 15.9357 15.9998 15.8634
* GA-Roulette Wheel = 30% convergence to global optima and 70% convergence to local optima whereas GA/K-Means = 100% convergence to global optima.
1 2 3 4 5 6 7 8 9 10
Population Size 20.0000 20.0000 20.0000 20.0000 20.0000 20.0000 20.0000 20.0000 20.0000 20.0000
Generation Size 6 6 6 6 6 6 6 6 6 6
Mutation Rate 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2 0.2
Growth Rate 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23 0.23
Best Distance 13.3571 13.3112 13.2205 13.2077 13.4439 13.0840 13.6789 13.3196 13.1954 13.1209
Worst Distance 18.6919 18.6057 18.5553 18.7289 18.7166 18.7412 18.7042 18.6673 18.5677 18.7166
Average Distance 16.2327 16.2744 16.6058 16.5590 16.9363 16.0792 16.7968 16.1944 16.1850 16.0070
* GA-Roulette Wheel = Varying convergences to local optima for each of the simulations, whereas GA/K-Means = 90% convergence to global optima.
Conclusion
In this research work, 1) An appropriate GA/K-Means hybridization technique has been evolved. 2) A MATLAB based algorithm for route optimization has been developed. 3) Evaluation of the performance of the developed algorithm has been done using UAV route optimization as a case study. 4) A MATLAB based Graphical User Interface for UAV route optimization has been developed.
Benchmarking the Hybrid GA/K-Means Technique with the GA-Roulette Wheel Selection Method has shown that the Hybrid GA/K-Means Technique greatly outperforms the GA-Roulette Wheel Selection Method. It was confirmed that Optimal parameters such as generation of 6, population of 40 , growth rate of 0.23 and mutation rate of 0.2 are optimal in determining appropriate UAV route. Therefore the proposed GA/K-means algorithm can efficiently be used for route optimization.(UAV as a case study).
Recommendation Further research be conducted on the application of the developed algorithm to UAV power optimization. This is because power required by a UAV determines its efficiency. The algorithm should be applied to larger distances so as to evaluate the effect of Earths spherical or surface. This is because flat-Earth formulas for calculating the distance between any two points start giving conspicuous errors when the distance is more than about 20 kilometres even though the circumference of the Earth is about 40,000 kilometres.
Contribution to Knowledge. A new method for UAV route optimization have been developed employing a hybrid of GA/K-means algorithm. A new concept of Polygamous selection for GA reproduction process was developed GUI for UAV route optimization was also developed. Publications in international conference and papers submitted to journal.
A Novel Algorithm
Hybrid
Genetic-K-Means Journal
Review of the Engineering Conference Completed Applications of K-Means Algorithm . Awaiting submission
Polygamy Selection Method in K- Journal Means Algorithm for UAV route Optimization. Unmanned Aerial Vehicle (UAV) Power Conference Optimization Using a Hybrid of Genetic Algorithm and K-Means Algorithm
A.He, K. K. Bae, T. R. Newman, J. Gaeddert, K. Kim, R. Menon, L. MoralesTirado, J. J. Neel, Y. Zhao, J. H. Reed, and W. H. Tranter, A survey of artificial intelligence for cognitive radios, IEEE Trans. Veh. Technol., vol. 59, no. 4, pp. 15781592, May 2010. Ashwin Ravi, UAV power plant performance evaluation MSc Thesis Faculty of the Graduate College of the Oklahoma State University, 2010 (page 2). Aycan Erentok and Richard W. Ziolkowski, A Hybrid Optimization Method to Analyze Metamaterial-Based Electrically Small Antennas IEEE transactions on antennas and propagation, vol. 55, no. 3, pp 731-741 March 2007. Babita R. Jose, P. Mythili and J. Mathew. GA-based Optimization of Sigma-delta Modulators for Wireless Transceivers Engineering Letter, 16:4, EL_16_4_02. November 2008. Chellali Benachaiba, Ottmane Abdelkhalek, Samira Dib, Mohamed Haidas. Optimization of parameters of the unified power quality conditioner using genetic algorithm method ISSN 1392 124X information technology and control, Vol.36, No.2, 2007
References
G.C. Chen, and J.S. Yu, Particle Swarm Optimization Neural Network and Its Application in Soft-Sensing Modeling, Lecture Notes in Computer Science Vol. 3611, pp. 610 617, 2005. Jamaluddin Hishamuddin Genetic Algorithm Faculty of Mechanical Engineering Unuversiti Teknologi Malaysia. 2007, (page 4). Mingdong WANG, Xianlin LIU and Jilai YU, Modified GA based optimization design of fuzzy governor power system stabilizer for hydro-generator unit Istanbul university Journal of electrical & electronics engineering. vol. 8 no. 2 pp 607-616, 2008. M. Zhao, Z. Chen, and F. Blaabjerg. Application of genetic algorithm in electrical system optimization for offshore wind farms Nanjing China, 6-9 April 2008. Nasri Sulaiman and Tughrul Arslan, Non-Uniform search domain based Genetic algorithm for the optimization of real time FFT Processor architectures, 2006 IEEE Congress on Evolutionary Computation. Vancouver, BC, Canada July 16-21, 2006. Olesya Peshko Global Optimization Genetic Algorithms McMaster University Hamilton, Ontario ppt presentation 2007 page 25
Rajib Kumar Bhattacharjya. Introduction To Genetic Algorithms Department of Civil Engineering. Indian Institute of Technology Guwahati. 19 October 2012 S.F. Ding, L. Xu, C.Y. Su, et al., Using Genetic Algorithm to Optimize Artificial Neural Networks, Journal of Convergence Information Technology, Vol. 5, pp. 54-62, 2010 Sidhartha Panda and N. P. Padhy. Comparison of Particle Swarm Optimization and Genetic Algorithm for TCSC-based Controller Design. International Journal of Computer Science and Engineering Vol. 1, No 1. 2008. T. J. Koo, D. H. Shim, O. Shakernia, B. Sinopoli, F. Hoffmann, S. Sastry, Hierarchical Hybrid System Design on Berkeley UAV. Robotics and Intelligent Machines Laboratory, University of California at Berkeley, 2002 (page 1). Tor D. Wager and Thomas E. Nichols, Optimization of experimental design in fMRI: a general framework using a genetic algorithm. NeuroImage 18 pp 293309, 2003.