Properly configuring Evolutionary Algorithms (EAs) is a challenging task made difficult by many different details that affect EAs' performance, such as the properties of the fitness function, time and computational constraints, and many others. EAs' meta-optimization methods, in which a metaheuristic is used to tune the parameters of another (lower-level) metaheuristic which optimizes a given target function, most often rely on the optimization of a single property of the lower-level method. In this paper, we show that by using a multi-objective genetic algorithm to tune an EA, it is possible not only to find good parameter sets considering more objectives at the same time but also to derive generalizable results which can provide guidelines for designing EA-based applications. In particular, we present a general framework for multi-objective meta-optimization, to show that "going multi-objective" allows one to generate configurations that, besides optimally fitting an EA to a given problem, also perform well on previously unseen ones.
Electrical distribution network is constantly ageing worldwide. Therefore, probability of cable faults is increasing over time. Fast recovering of damaged networks is of vital importance and a quick and automatic identification of the failure source may help to promptly recover the functionality of the network. The scenario we are taking into consideration is a vast number of recording devices spread across a network that constantly monitor low voltage cables. When the current of a cable reaches a very high value, data is sent to a central server which analyses it through a variant of a Variational Auto Encoder (VAE), a deep neural network. This VAE has been trained by using historical data collected from several hundreds of faults recorded, but in which only a handful of them has been labelled by an on-site analysis of the fault. Data used for training is simply the recorded levels of voltages and currents, after a simple pre-processing step. The final goal is to let the network distinguish if the fault occurred in a point of the cable, on a joint, or at the pot-end located at the termination. A preliminary evaluation of its ability to generalise over the non-labelled samples shows encouraging results.
Too often, when comparing a set of optimization algorithms, little effort, if any at all, is spent for finding the parameter settings which let them perform at their best on a given optimization task. Within this context, automatizing the choice of their parameter settings can be seen as a way to perform fair comparisons between optimization algorithms. In this paper we first compare the performances of two standard PSO versions using the "standard" parameters suggested in the literature. Then, we automatically tune the parameter values of both algorithms using a meta-optimization environment, to allow the two versions to perform at their best. As expected, results obtained by the optimized version are substantially better than those obtained with the standard settings. Moreover, they generalize well on other functions, allowing one to draw interesting conclusions regarding the PSO parameter settings that are commonly used in the literature.
We used a meta-optimization environment to compare two reference versions of the Particle Swarm Optimization (PSO) algorithm, namely Standard PSO 2006 and Standard PSO 2011, on the CEC 2013 benchmark. We first compared the performances of the two standard PSO versions using the parameter sets suggested in the literature. Then, we automatically tuned the parameter values of both algorithms, to allow the two versions to perform at their best.
It has been largely proven that population-based metaheuristics such as Particle Swarm Optimization (PSO) are severely affected by the choice of their parameters. In this paper, we use a multi-objective parameter tuning method called EMOPaT (Evolutionary Multi-Objective Parameter Tuning) to optimize PSO when dealing with a real-world optimization task: the localization of an object acquired by a laser scanner in the form of a point cloud. We want to optimize both the time needed to reach a quality threshold and the final alignment between the point cloud and a reference model of the object. Our system is able to generate “fast” and “precise” versions of PSO and, among all the possible configurations which lie between the fastest and the most precise, the ones that give the best trade-offs between precision and speed.
Evolutionary Algorithms (EAs) and other metaheuristics are greatly affected by the choice of their parameters, not only as regards the precision of the solutions found, but also for repeatability, robustness, speed of convergence, and other properties. Most of these performance criteria are often conflicting with one another. In our work, we see the problem of EAs' parameter selection and tuning as a multi-objective optimization problem, in which the criteria to be optimized are precision and speed of convergence. We propose EMOPaT (Evolutionary Multi-Objective Parameter Tuning), a method that uses a well-known multi-objective optimization algorithm (NSGA-II) to find a front of non-dominated parameter sets which produce good results according to these two metrics. By doing so, we can provide three kinds of results: (i) a method that is able to adapt parameters to a single function, (ii) a comparison between Differential Evolution (DE) and Particle Swarm Optimization (PSO) that takes into consideration both precision and speed, and (iii) an insight into how parameters of DE and PSO affect the performance of these EAs on different benchmark functions.
In this paper, we describe a method for recognizing objects in the form of point clouds acquired with a laser scanner. This method is fully implemented on GPU and uses bio-inspired metaheuristics, namely PSO or DE, to evolve the rigid transformation that best aligns some references extracted from a dataset to the target point cloud. We compare the performance of our method with an established method based on Fast Point Feature Histograms (FPFH). The results prove that FPFH is more reliable under simple and controlled situations, but PSO and DE are more robust with respect to common problems as noise or occlusions.
The performance of an evolutionary algorithm strongly depends on the choice of the parameters which regulate its behavior. In this paper, two evolutionary algorithms (Particle Swarm Optimization and Differential Evolution) are used to find the optimal configuration of parameters for Differential Evolution. We tested our approach on four benchmark functions, and the comparison with an exhaustive search demonstrated its effectiveness. Then, the same method was used to tune the parameters of Differential Evolution in solving a real-world problem: the automatic localization of the hippocampus in histological brain images. The results obtained consistently outperformed the ones achieved using manually-tuned parameters. Thanks to a GPU-based implementation, our tuner is up to 8 times faster than the corresponding sequential version.
In this paper, a GPU-based implementation of Differential Evolution (DE) and Particle Swarm Optimization (PSO) in CUDA is used to automatically tune the parameters of PSO.
Motivation RNA molecules specifically enriched in the neuropil of neuronal cells and in particular in dendritic spines are of great interest for neurobiology in virtue of their involvement in synaptic structure and plasticity. The systematic recognition of such molecules is therefore a very important task. High resolution images of RNA in situ hybridization experiments contained in the Allen Brain Atlas (ABA) represent a very rich resource to identify them and have been so far exploited for this task through human-expert analysis. However, software tools that may automatically address the same objective are not very well developed. Results In this study we describe an automatic method for exploring in situ hybridization data and discover neuropil-enriched RNAs in the mouse hippocampus. We called it Hippo-ATESC (Automatic Texture Extraction from the Hippocampal region using Soft Computing). Bioinformatic validation showed that the Hippo-ATESC is very efficient in the recognition of RNAs which are manually identified by expert curators as neuropil-enriched on the same image series. Moreover, we show that our method can also highlight genes revealed by microdissection-based methods but missed by human visual inspection. We experimentally validated our approach by identifying a non-coding transcript enriched in mouse synaptosomes. The code is freely available on the web at http://ibislab.ce.unipr.it/software/hippo/.
This paper describes a novel system for detecting and classifying human activities based on a multi-sensor approach. The aim of this research is to create a loosely structured environment, where activity is constantly monitored and automatically classified, transparently to the subjects who are observed. The system uses four calibrated cameras installed in the room which is being monitored and a body-mounted wireless accelerometer on each person, exploiting the features of different sensors to maximize recognition accuracy, improve scalability and reliability. The algorithms on which the system is based, as well as its structure, are aimed at analyzing and classifying complex movements (like walking, sitting, jumping, running, falling, etc.) of potentially multiple people at the same time. Here, we describe a preliminary application, in which action classification is mostly aimed at detecting falls. Several instances of a hybrid classifier based on Support Vector Machines and Hierarchical Temporal Memories, a recent bio-inspired computational paradigm, are used to detect potentially dangerous activities of each person in the environment. If such an activity is detected and if the person “in danger” is wearing the accelerometer, the system localizes and activates it to receive data and then performs a more reliable fall detection using a specifically trained classifier. The opportunity to turn on the accelerometer on-demand makes it possible to extend its battery life. Besides and beyond surveillance, this system could also be used for the assessment of the degree of independence of elderly people or, in rehabilitation, to assist patients during recovery.
In this paper, a GPU-based implementation of Differential Evolution (DE) and Particle Swarm Optimization (PSO) in CUDA is used to automatically tune the parameters of PSO. The parameters were tuned over a set of 8 problems and then tested over 20 problems to assess the generalization ability of the tuners. We compare the results obtained using such parameters with the 'standard' ones proposed in the literature and the ones obtained by state-of-the-art tuning methods (irace). The results are comparable to the ones suggested for the standard version of PSO (SPSO), and the ones obtained by irace, while the GPU implementation makes tuning time acceptable. To the best of our knowledge, this is the first time that a general purpose library of GPU-based metaheuristics is used to solve this problem, as well as being one of the few cases where DE and PSO are both used as tuners.
This paper describes a method to estimate the body pose of a human from the point cloud obtained from a depth sensor. It uses Differential Evolution to find the best match between a candidate pose, represented by an instance of a 42-parameter articulated model of a human, and the point cloud. The results, compared to other four state-of-the art methods on a publicly available dataset, show that the method has good ability to estimate the pose of a person and to track him in video sequences. The entire method, from Differential Evolution to fitness computation, is run on nVIDIA GPUs. Thanks to its massively parallel implementation in CUDA-C, it produces pose estimates in real time.
Evolutionary Computation techniques and other metaheuristics have been increasingly used in the last years for solving many real-world tasks that can be formulated as optimization problems. Among their numerous strengths, a major one is their natural predisposition to parallelization.In this paper, we introduce libCudaOptimize, an open source library which implements some metaheuristics for continuous optimization: presently Particle Swarm Optimization, Differential Evolution, Scatter Search, and Solis& Wets local search. This library allows users either to apply these metaheuristics directly to their own fitness function or to extend it by implementing their own parallel optimization techniques. The library is written in CUDA-C to make extensive use of parallelization, as allowed by Graphics Processing Units.After describing the library, we consider two practical case studies: the optimization of a fitness function for the automatic localization of anatomical brain structures in histological images, and the parallel implementation of Simulated Annealing as a new module, which extends the library while keeping code compatibility with it, so that the new method can be readily available for future use within the library as an alternative optimization technique.
This paper presents a system for detecting and classifying road signs from video sequences in real time. A model-based approach is used in which a prototype of the sign to be detected is transformed and matched to the image using evolutionary techniques. Then, the sign detected in the previous phase is classified by a neural network. Our system makes extensive use of the parallel computing capabilities offered by modern graphics cards and the CUDA architecture for both detection and classification. We compare detection results achieved by GPU-based parallel versions of Differential Evolution and Particle Swarm Optimization, and classification results obtained by Learning Vector Quantization and Multi-layer Perceptron. The method was tested over two real sequences taken from a camera mounted on-board a car and was able to correctly detect and classify around 70% of the signs at 17.5 fps, a similar result in shorter time, compared to the best results obtained on the same sequences so far.
The Allen Brain Atlas (ABA) is a cellular-resolution, genome-wide map of gene expression in the mouse brain which allows users to compare gene expression patterns in neuroanatomical structures. The correct localization of the structures is the first step to carry on this comparison in an automatic way. In this paper we present a completely automatic tool for the localization of the hippocampus that can be easily adapted also to other subcortical structures. This goal is achieved in two distinct phases. The first phase, called "best reference slice selection", is performed by comparing the image of the brain with a reference Atlas provided by ABA using a two-step affine registration. By doing so the system is able to automatically find to which brain section the image corresponds and wherein the image the hippocampus is roughly located. The second phase, the proper "hippocampus localization", is based on a method that combines Particle Swarm Optimization (PSO) and a novel technique inspired by Active Shape Models (ASMs). The hippocampus is found by adapting a deformable model derived statistically, in order to make it overlap with the hippocampus image. Experiments on a test set of 120 images yielded a perfect or good localization in 89.2% of cases.
Automatically detecting objects in images or video sequences is one of the most relevant and frequently tackled tasks in computer vision and pattern recognition.The starting point for this work is a very general model-based approach to object detection. The problem is turned into a global continuous optimization one: given a parametric model of the object to be detected within an image, a function is maximized, which represents the similarity between the model and a region of the image under investigation.In particular, in this work, the optimization problem is tackled using Particle Swarm Optimization (PSO) and Differential Evolution (DE). We compare the performances of these optimization techniques on two real-world paradigmatic problems, onto which many other real-world object detection problems can be mapped: hippocampus localization in histological images and human body pose estimation in video sequences. In the former, a 2D deformable model of a section of the hippocampus is fit to the corresponding region of a histological image, to accurately localize such a structure and analyze gene expression in specific sub-regions. In the latter, an articulated 3D model of a human body is matched against a set of images of a human performing some action, taken from different perspectives, to estimate the subject's posture in space.Given the significant computational burden imposed by this approach, we implemented PSO and DE as parallel algorithms within the nVIDIATM CUDA computing architecture. (C) 2012 Elsevier B. V. All rights reserved.
In this paper we compare GPU-based implementations of three metaheuristics: Particle Swarm Optimization, Differential Evolution, and Scatter Search. A GPU-based implementation, obviously, does not change the general properties of the algorithms. As well, we give for granted that GPU-based implementation of both algorithm and fitness function produces a significant speed-up with respect to a sequential implementation. Accordingly, the main goal of this work has been to fairly assess the efficiency of the GPU-based implementations of the three metaheuristics, based on the statistical analysis of the results they obtain in optimizing a benchmark of twenty functions within a prefixed limited time.
We perform a two-step segmentation of the hippocampus in histological images. First, we maximize the overlap of an empirically-derived parametric Deformable Model with two crucial landmark sub-structures in the brain image using Differential Evolution. Then, the points located in the previous step determine the region where a thresholding technique based on Otsu's method is to be applied. Finally, the segmentation is expanded employing Random Forest in the regions not covered by the model. Our approach showed an average segmentation accuracy of the 92.25% and 92.11% on test sets comprising 15 real and 15 synthetic images, respectively.
Stefano Cagnoni合作论文数Department of Engineering and Architecture, University of Parma20
Monica Mordonini合作论文数Department of Computer Engineering, University of Parma1