Download Adaptive Dynamic Programming for Control: Algorithms and by Huaguang Zhang, Derong Liu, Yanhong Luo, Ding Wang PDF

By Huaguang Zhang, Derong Liu, Yanhong Luo, Ding Wang

There are many tools of good controller layout for nonlinear platforms. In looking to transcend the minimal requirement of balance, Adaptive Dynamic Programming in Discrete Time methods the tough subject of optimum regulate for nonlinear structures utilizing the instruments of adaptive dynamic programming (ADP). the diversity of structures taken care of is vast; affine, switched, singularly perturbed and time-delay nonlinear platforms are mentioned as are the makes use of of neural networks and strategies of price and coverage new release. The textual content beneficial properties 3 major elements of ADP within which the equipment proposed for stabilization and for monitoring and video games enjoy the incorporation of optimum regulate equipment:
• infinite-horizon keep an eye on for which the trouble of fixing partial differential Hamilton–Jacobi–Bellman equations at once is conquer, and facts only if the iterative worth functionality updating series converges to the infimum of the entire price capabilities bought via admissible regulate legislations sequences;
• finite-horizon keep watch over, carried out in discrete-time nonlinear platforms exhibiting the reader tips on how to receive suboptimal keep an eye on suggestions inside of a set variety of regulate steps and with effects extra simply utilized in actual platforms than these often won from infinite-horizon keep watch over;
• nonlinear video games for which a couple of combined optimum rules are derived for fixing video games either whilst the saddle element doesn't exist, and, while it does, warding off the life stipulations of the saddle aspect.
Non-zero-sum video games are studied within the context of a unmarried community scheme during which regulations are got ensuring method balance and minimizing the person functionality functionality yielding a Nash equilibrium.
In order to make the insurance compatible for the coed in addition to for the professional reader, Adaptive Dynamic Programming in Discrete Time:
• establishes the elemental idea concerned basically with each one bankruptcy dedicated to a sincerely identifiable regulate paradigm;
• demonstrates convergence proofs of the ADP algorithms to deepen knowing of the derivation of balance and convergence with the iterative computational tools used; and
• exhibits how ADP tools will be positioned to exploit either in simulation and in actual functions.
This textual content might be of substantial curiosity to researchers attracted to optimum keep watch over and its purposes in operations learn, utilized arithmetic computational intelligence and engineering. Graduate scholars operating up to speed and operations learn also will locate the guidelines offered the following to be a resource of strong tools for furthering their study.

Show description

Read Online or Download Adaptive Dynamic Programming for Control: Algorithms and Stability PDF

Best system theory books

Stability Analysis and Design for Nonlinear Singular Systems

Singular platforms that are also known as descriptor structures, semi-state platforms, differential- algebraic structures or generalized state-space structures have attracted a lot consciousness due to their huge purposes within the Leontief dynamic version, electric and mechanical types, and so on. This monograph awarded updated examine advancements and references on balance research and layout of nonlinear singular platforms.

Adaptive Dynamic Programming for Control: Algorithms and Stability

There are numerous equipment of good controller layout for nonlinear platforms. In looking to transcend the minimal requirement of balance, Adaptive Dynamic Programming in Discrete Time techniques the difficult subject of optimum keep an eye on for nonlinear structures utilizing the instruments of adaptive dynamic programming (ADP).

Essentials of Systems Analysis and Design

For classes in structures research and layout, established a transparent presentation of data, equipped round the structures improvement existence cycle version   This briefer model of the authors’ hugely profitable smooth method research and layout is a transparent presentation of data, equipped round the structures improvement existence cycle version.

The Biased Mind: How Evolution Shaped our Psychology Including Anecdotes and Tips for Making Sound Decisions

Utilizing a wealth of anecdotes, info from educational literature, and unique examine, this very available little ebook highlights how all of us fight to deal with the maelstrom of decisions, affects and studies that come our method. The authors have slogged via piles of dry learn papers to supply many magnificent nuggets of data and magnificent insights.

Extra resources for Adaptive Dynamic Programming for Control: Algorithms and Stability

Example text

5, the value function sequence {Vi } is a nondecreasing sequence satisfying limi→∞ Vi (x(k)) = J ∗ (x(k)), hence the relation Vi−1 (x(k + 1)) ≤ J ∗ (x(k + 1)) holds for any i. Thus, we obtain Vi (x(k)) ≤ x T (k)Qx(k) + W (u(k)) + J ∗ (x(k + 1)). 37) Let i → ∞; we have J ∗ (x(k)) ≤ x T (k)Qx(k) + W (u(k)) + J ∗ (x(k + 1)). 38) Since u(k) in the above equation is chosen arbitrarily, the following equation holds: J ∗ (x(k)) ≤ inf x T (k)Qx(k) + W (u(k)) + J ∗ (x(k + 1)) . 39) On the other hand, for any i the value function sequence satisfies Vi (x(k)) = min x T (k)Qx(k) + W (u(k)) + Vi−1 (x(k + 1)) .

Mach Learn 8:257–277 89. Tsitsiklis JN (1995) Efficient algorithms for globally optimal trajectories. IEEE Trans Autom Control 40(9):1528–1538 90. Uchida K, Fujita M (1992) Finite horizon H∞ control problems with terminal penalties. IEEE Trans Autom Control 37(11):1762–1767 91. Vamvoudakis KG, Lewis FL (2010) Online actor-critic algorithm to solve the continuoustime infinite horizon optimal control problem. Automatica 46:878–888 92. Venayagamoorthy GK, Harley RG, Wunsch DG (2002) Comparison of heuristic dynamic programming and dual heuristic programming adaptive critics for neurocontrol of a turbogenerator.

Costa OLV, Tuesta EF (2003) Finite horizon quadratic optimal control and a separation principle for Markovian jump linear systems. IEEE Trans Autom Control 48:1836–1842 29. Dalton J, Balakrishnan SN (1996) A neighboring optimal adaptive critic for missile guidance. Math Comput Model 23:175–188 30. Dreyfus SE, Law AM (1977) The art and theory of dynamic programming. Academic Press, New York 31. Engwerda J (2008) Uniqueness conditions for the affine open-loop linear quadratic differential game. Automatica 44(2):504–511 32.

Download PDF sample

Rated 4.48 of 5 – based on 27 votes