Experimental Methods for the Analysis of Optimization Algorithms

Experimental Methods for the Analysis of Optimization Algorithms
Author: Thomas Bartz-Beielstein
Publisher: Springer Science & Business Media
Total Pages: 469
Release: 2010-11-02
Genre: Computers
ISBN: 3642025382

In operations research and computer science it is common practice to evaluate the performance of optimization algorithms on the basis of computational results, and the experimental approach should follow accepted principles that guarantee the reliability and reproducibility of results. However, computational experiments differ from those in other sciences, and the last decade has seen considerable methodological research devoted to understanding the particular features of such experiments and assessing the related statistical methods. This book consists of methodological contributions on different scenarios of experimental analysis. The first part overviews the main issues in the experimental analysis of algorithms, and discusses the experimental cycle of algorithm development; the second part treats the characterization by means of statistical distributions of algorithm performance in terms of solution quality, runtime and other measures; and the third part collects advanced methods from experimental design for configuring and tuning algorithms on a specific class of instances with the goal of using the least amount of experimentation. The contributor list includes leading scientists in algorithm design, statistical design, optimization and heuristics, and most chapters provide theoretical background and are enriched with case studies. This book is written for researchers and practitioners in operations research and computer science who wish to improve the experimental assessment of optimization algorithms and, consequently, their design.

Experiments

Experiments
Author: C. F. Jeff Wu
Publisher: John Wiley & Sons
Total Pages: 562
Release: 2011-09-20
Genre: Mathematics
ISBN: 1118211537

Praise for the First Edition: "If you . . . want an up-to-date, definitive reference written by authors who have contributed much to this field, then this book is an essential addition to your library." —Journal of the American Statistical Association Fully updated to reflect the major progress in the use of statistically designed experiments for product and process improvement, Experiments, Second Edition introduces some of the newest discoveries—and sheds further light on existing ones—on the design and analysis of experiments and their applications in system optimization, robustness, and treatment comparison. Maintaining the same easy-to-follow style as the previous edition while also including modern updates, this book continues to present a new and integrated system of experimental design and analysis that can be applied across various fields of research including engineering, medicine, and the physical sciences. The authors modernize accepted methodologies while refining many cutting-edge topics including robust parameter design, reliability improvement, analysis of non-normal data, analysis of experiments with complex aliasing, multilevel designs, minimum aberration designs, and orthogonal arrays. Along with a new chapter that focuses on regression analysis, the Second Edition features expanded and new coverage of additional topics, including: Expected mean squares and sample size determination One-way and two-way ANOVA with random effects Split-plot designs ANOVA treatment of factorial effects Response surface modeling for related factors Drawing on examples from their combined years of working with industrial clients, the authors present many cutting-edge topics in a single, easily accessible source. Extensive case studies, including goals, data, and experimental designs, are also included, and the book's data sets can be found on a related FTP site, along with additional supplemental material. Chapter summaries provide a succinct outline of discussed methods, and extensive appendices direct readers to resources for further study. Experiments, Second Edition is an excellent book for design of experiments courses at the upper-undergraduate and graduate levels. It is also a valuable resource for practicing engineers and statisticians.

Optimal Design of Experiments

Optimal Design of Experiments
Author: Friedrich Pukelsheim
Publisher: SIAM
Total Pages: 527
Release: 2006-04-01
Genre: Mathematics
ISBN: 0898716047

Optimal Design of Experiments offers a rare blend of linear algebra, convex analysis, and statistics. The optimal design for statistical experiments is first formulated as a concave matrix optimization problem. Using tools from convex analysis, the problem is solved generally for a wide class of optimality criteria such as D-, A-, or E-optimality. The book then offers a complementary approach that calls for the study of the symmetry properties of the design problem, exploiting such notions as matrix majorization and the Kiefer matrix ordering. The results are illustrated with optimal designs for polynomial fit models, Bayes designs, balanced incomplete block designs, exchangeable designs on the cube, rotatable designs on the sphere, and many other examples.

Theory and Principled Methods for the Design of Metaheuristics

Theory and Principled Methods for the Design of Metaheuristics
Author: Yossi Borenstein
Publisher: Springer Science & Business Media
Total Pages: 287
Release: 2013-12-19
Genre: Computers
ISBN: 3642332064

Metaheuristics, and evolutionary algorithms in particular, are known to provide efficient, adaptable solutions for many real-world problems, but the often informal way in which they are defined and applied has led to misconceptions, and even successful applications are sometimes the outcome of trial and error. Ideally, theoretical studies should explain when and why metaheuristics work, but the challenge is huge: mathematical analysis requires significant effort even for simple scenarios and real-life problems are usually quite complex. In this book the editors establish a bridge between theory and practice, presenting principled methods that incorporate problem knowledge in evolutionary algorithms and other metaheuristics. The book consists of 11 chapters dealing with the following topics: theoretical results that show what is not possible, an assessment of unsuccessful lines of empirical research; methods for rigorously defining the appropriate scope of problems while acknowledging the compromise between the class of problems to which a search algorithm is applied and its overall expected performance; the top-down principled design of search algorithms, in particular showing that it is possible to design algorithms that are provably good for some rigorously defined classes; and, finally, principled practice, that is reasoned and systematic approaches to setting up experiments, metaheuristic adaptation to specific problems, and setting parameters. With contributions by some of the leading researchers in this domain, this book will be of significant value to scientists, practitioners, and graduate students in the areas of evolutionary computing, metaheuristics, and computational intelligence.

Uncertainty Management in Simulation-Optimization of Complex Systems

Uncertainty Management in Simulation-Optimization of Complex Systems
Author: Gabriella Dellino
Publisher: Springer
Total Pages: 282
Release: 2015-06-29
Genre: Business & Economics
ISBN: 1489975470

​This book aims at illustrating strategies to account for uncertainty in complex systems described by computer simulations. When optimizing the performances of these systems, accounting or neglecting uncertainty may lead to completely different results; therefore, uncertainty management is a major issues in simulation-optimization. Because of its wide field of applications, simulation-optimization issues have been addressed by different communities with different methods, and from slightly different perspectives. Alternative approaches have been developed, also depending on the application context, without any well-established method clearly outperforming the others. This editorial project brings together — as chapter contributors — researchers from different (though interrelated) areas; namely, statistical methods, experimental design, stochastic programming, global optimization, metamodeling, and design and analysis of computer simulation experiments. Editors’ goal is to take advantage of such a multidisciplinary environment, to offer to the readers a much deeper understanding of the commonalities and differences of the various approaches to simulation-based optimization, especially in uncertain environments. Editors aim to offer a bibliographic reference on the topic, enabling interested readers to learn about the state-of-the-art in this research area, also accounting for potential real-world applications to improve also the state-of-the-practice. Besides researchers and scientists of the field, the primary audience for the proposed book includes PhD students, academic teachers, as well as practitioners and professionals. Each of these categories of potential readers present adequate channels for marketing actions, e.g. scientific, academic or professional societies, internet-based communities, and authors or buyers of related publications.​

Black Box Optimization, Machine Learning, and No-Free Lunch Theorems

Black Box Optimization, Machine Learning, and No-Free Lunch Theorems
Author: Panos M. Pardalos
Publisher: Springer Nature
Total Pages: 388
Release: 2021-05-27
Genre: Mathematics
ISBN: 3030665151

This edited volume illustrates the connections between machine learning techniques, black box optimization, and no-free lunch theorems. Each of the thirteen contributions focuses on the commonality and interdisciplinary concepts as well as the fundamentals needed to fully comprehend the impact of individual applications and problems. Current theoretical, algorithmic, and practical methods used are provided to stimulate a new effort towards innovative and efficient solutions. The book is intended for beginners who wish to achieve a broad overview of optimization methods and also for more experienced researchers as well as researchers in mathematics, optimization, operations research, quantitative logistics, data analysis, and statistics, who will benefit from access to a quick reference to key topics and methods. The coverage ranges from mathematically rigorous methods to heuristic and evolutionary approaches in an attempt to equip the reader with different viewpoints of the same problem.

Learning and Intelligent Optimization

Learning and Intelligent Optimization
Author: Giuseppe Nicosia
Publisher: Springer
Total Pages: 483
Release: 2013-11-26
Genre: Computers
ISBN: 3642449735

This book constitutes the proceedings of the 7th International Conference on Learning and Optimization, LION 7, which was held in Catania, Italy, in January 2013. The 49 contributions presented in this volume were carefully reviewed and selected from 101 submissions. They explore the intersections and uncharted territories between machine learning, artificial intelligence, mathematical programming and algorithms for hard optimization problems.

Statistical and Computational Techniques in Manufacturing

Statistical and Computational Techniques in Manufacturing
Author: J. Paulo Davim
Publisher: Springer Science & Business Media
Total Pages: 294
Release: 2012-03-06
Genre: Technology & Engineering
ISBN: 364225859X

In recent years, interest in developing statistical and computational techniques for applied manufacturing engineering has been increased. Today, due to the great complexity of manufacturing engineering and the high number of parameters used, conventional approaches are no longer sufficient. Therefore, in manufacturing, statistical and computational techniques have achieved several applications, namely, modelling and simulation manufacturing processes, optimization manufacturing parameters, monitoring and control, computer-aided process planning, etc. The present book aims to provide recent information on statistical and computational techniques applied in manufacturing engineering. The content is suitable for final undergraduate engineering courses or as a subject on manufacturing at the postgraduate level. This book serves as a useful reference for academics, statistical and computational science researchers, mechanical, manufacturing and industrial engineers, and professionals in industries related to manufacturing engineering.

A Guide to Experimental Algorithmics

A Guide to Experimental Algorithmics
Author: Catherine C. McGeoch
Publisher: Cambridge University Press
Total Pages: 273
Release: 2012-01-30
Genre: Computers
ISBN: 1107001730

This is a guidebook for those who want to use computational experiments to support their work in algorithm design and analysis. Numerous case studies and examples show how to apply these concepts. All the necessary concepts in computer architecture and data analysis are covered so that the book can be used by anyone who has taken a course or two in data structures and algorithms.