Machine Learning Control – Taming Nonlinear Dynamics and Turbulence

Machine Learning Control – Taming Nonlinear Dynamics and Turbulence
Author: Thomas Duriez
Publisher: Springer
Total Pages: 229
Release: 2016-11-02
Genre: Technology & Engineering
ISBN: 3319406248

This is the first textbook on a generally applicable control strategy for turbulence and other complex nonlinear systems. The approach of the book employs powerful methods of machine learning for optimal nonlinear control laws. This machine learning control (MLC) is motivated and detailed in Chapters 1 and 2. In Chapter 3, methods of linear control theory are reviewed. In Chapter 4, MLC is shown to reproduce known optimal control laws for linear dynamics (LQR, LQG). In Chapter 5, MLC detects and exploits a strongly nonlinear actuation mechanism of a low-dimensional dynamical system when linear control methods are shown to fail. Experimental control demonstrations from a laminar shear-layer to turbulent boundary-layers are reviewed in Chapter 6, followed by general good practices for experiments in Chapter 7. The book concludes with an outlook on the vast future applications of MLC in Chapter 8. Matlab codes are provided for easy reproducibility of the presented results. The book includes interviews with leading researchers in turbulence control (S. Bagheri, B. Batten, M. Glauser, D. Williams) and machine learning (M. Schoenauer) for a broader perspective. All chapters have exercises and supplemental videos will be available through YouTube.

Iterative Learning Control

Iterative Learning Control
Author: David H. Owens
Publisher: Springer
Total Pages: 473
Release: 2015-10-31
Genre: Technology & Engineering
ISBN: 1447167724

This book develops a coherent and quite general theoretical approach to algorithm design for iterative learning control based on the use of operator representations and quadratic optimization concepts including the related ideas of inverse model control and gradient-based design. Using detailed examples taken from linear, discrete and continuous-time systems, the author gives the reader access to theories based on either signal or parameter optimization. Although the two approaches are shown to be related in a formal mathematical sense, the text presents them separately as their relevant algorithm design issues are distinct and give rise to different performance capabilities. Together with algorithm design, the text demonstrates the underlying robustness of the paradigm and also includes new control laws that are capable of incorporating input and output constraints, enable the algorithm to reconfigure systematically in order to meet the requirements of different reference and auxiliary signals and also to support new properties such as spectral annihilation. Iterative Learning Control will interest academics and graduate students working in control who will find it a useful reference to the current status of a powerful and increasingly popular method of control. The depth of background theory and links to practical systems will be of use to engineers responsible for precision repetitive processes.

Learning for Adaptive and Reactive Robot Control

Learning for Adaptive and Reactive Robot Control
Author: Aude Billard
Publisher: MIT Press
Total Pages: 425
Release: 2022-02-08
Genre: Technology & Engineering
ISBN: 0262367017

Methods by which robots can learn control laws that enable real-time reactivity using dynamical systems; with applications and exercises. This book presents a wealth of machine learning techniques to make the control of robots more flexible and safe when interacting with humans. It introduces a set of control laws that enable reactivity using dynamical systems, a widely used method for solving motion-planning problems in robotics. These control approaches can replan in milliseconds to adapt to new environmental constraints and offer safe and compliant control of forces in contact. The techniques offer theoretical advantages, including convergence to a goal, non-penetration of obstacles, and passivity. The coverage of learning begins with low-level control parameters and progresses to higher-level competencies composed of combinations of skills. Learning for Adaptive and Reactive Robot Control is designed for graduate-level courses in robotics, with chapters that proceed from fundamentals to more advanced content. Techniques covered include learning from demonstration, optimization, and reinforcement learning, and using dynamical systems in learning control laws, trajectory planning, and methods for compliant and force control . Features for teaching in each chapter: applications, which range from arm manipulators to whole-body control of humanoid robots; pencil-and-paper and programming exercises; lecture videos, slides, and MATLAB code examples available on the author’s website . an eTextbook platform website offering protected material[EPS2] for instructors including solutions.

Real-time Iterative Learning Control

Real-time Iterative Learning Control
Author: Jian-Xin Xu
Publisher: Springer Science & Business Media
Total Pages: 204
Release: 2008-12-12
Genre: Technology & Engineering
ISBN: 1848821751

Real-time Iterative Learning Control demonstrates how the latest advances in iterative learning control (ILC) can be applied to a number of plants widely encountered in practice. The book gives a systematic introduction to real-time ILC design and source of illustrative case studies for ILC problem solving; the fundamental concepts, schematics, configurations and generic guidelines for ILC design and implementation are enhanced by a well-selected group of representative, simple and easy-to-learn example applications. Key issues in ILC design and implementation in linear and nonlinear plants pervading mechatronics and batch processes are addressed, in particular: ILC design in the continuous- and discrete-time domains; design in the frequency and time domains; design with problem-specific performance objectives including robustness and optimality; design in a modular approach by integration with other control techniques; and design by means of classical tools based on Bode plots and state space.

Iterative Learning Control

Iterative Learning Control
Author: Zeungnam Bien
Publisher: Springer Science & Business Media
Total Pages: 384
Release: 2012-12-06
Genre: Technology & Engineering
ISBN: 1461556295

Iterative Learning Control (ILC) differs from most existing control methods in the sense that, it exploits every possibility to incorporate past control informa tion, such as tracking errors and control input signals, into the construction of the present control action. There are two phases in Iterative Learning Control: first the long term memory components are used to store past control infor mation, then the stored control information is fused in a certain manner so as to ensure that the system meets control specifications such as convergence, robustness, etc. It is worth pointing out that, those control specifications may not be easily satisfied by other control methods as they require more prior knowledge of the process in the stage of the controller design. ILC requires much less information of the system variations to yield the desired dynamic be haviors. Due to its simplicity and effectiveness, ILC has received considerable attention and applications in many areas for the past one and half decades. Most contributions have been focused on developing new ILC algorithms with property analysis. Since 1992, the research in ILC has progressed by leaps and bounds. On one hand, substantial work has been conducted and reported in the core area of developing and analyzing new ILC algorithms. On the other hand, researchers have realized that integration of ILC with other control techniques may give rise to better controllers that exhibit desired performance which is impossible by any individual approach.

Data-Driven Science and Engineering

Data-Driven Science and Engineering
Author: Steven L. Brunton
Publisher: Cambridge University Press
Total Pages: 615
Release: 2022-05-05
Genre: Computers
ISBN: 1009098489

A textbook covering data-science and machine learning methods for modelling and control in engineering and science, with Python and MATLAB®.

Iterative Learning Control

Iterative Learning Control
Author: Yangquan Chen
Publisher: Springer
Total Pages: 0
Release: 2007-10-03
Genre: Technology & Engineering
ISBN: 1846285399

This book provides readers with a comprehensive coverage of iterative learning control. The book can be used as a text or reference for a course at graduate level and is also suitable for self-study and for industry-oriented courses of continuing education. Ranging from aerodynamic curve identification robotics to functional neuromuscular stimulation, Iterative Learning Control (ILC), started in the early 80s, is found to have wide applications in practice. Generally, a system under control may have uncertainties in its dynamic model and its environment. One attractive point in ILC lies in the utilisation of the system repetitiveness to reduce such uncertainties and in turn to improve the control performance by operating the system repeatedly. This monograph emphasises both theoretical and practical aspects of ILC. It provides some recent developments in ILC convergence and robustness analysis. The book also considers issues in ILC design. Several practical applications are presented to illustrate the effectiveness of ILC. The applied examples provided in this monograph are particularly beneficial to readers who wish to capitalise the system repetitiveness to improve system control performance.

Control Systems and Reinforcement Learning

Control Systems and Reinforcement Learning
Author: Sean Meyn
Publisher: Cambridge University Press
Total Pages: 453
Release: 2022-06-09
Genre: Business & Economics
ISBN: 1316511960

A how-to guide and scientific tutorial covering the universe of reinforcement learning and control theory for online decision making.

Iterative Learning Control for Deterministic Systems

Iterative Learning Control for Deterministic Systems
Author: Kevin L. Moore
Publisher: Springer Science & Business Media
Total Pages: 158
Release: 2012-12-06
Genre: Technology & Engineering
ISBN: 1447119126

The material presented in this book addresses the analysis and design of learning control systems. It begins with an introduction to the concept of learning control, including a comprehensive literature review. The text follows with a complete and unifying analysis of the learning control problem for linear LTI systems using a system-theoretic approach which offers insight into the nature of the solution of the learning control problem. Additionally, several design methods are given for LTI learning control, incorporating a technique based on parameter estimation and a one-step learning control algorithm for finite-horizon problems. Further chapters focus upon learning control for deterministic nonlinear systems, and a time-varying learning controller is presented which can be applied to a class of nonlinear systems, including the models of typical robotic manipulators. The book concludes with the application of artificial neural networks to the learning control problem. Three specific ways to neural nets for this purpose are discussed, including two methods which use backpropagation training and reinforcement learning. The appendices in the book are particularly useful because they serve as a tutorial on artificial neural networks.