|
1 Introduction to Synchronization in Nature and Physics and Cooperative Control for Multi-Agent Systems on Graphs |
|
|
1 | (22) |
|
1.1 Synchronization in Nature and Social Systems |
|
|
1 | (9) |
|
1.1.1 Animal Motion in Collective Groups |
|
|
3 | (1) |
|
1.1.2 Communication Graphs and Implementing Reynolds' Rules |
|
|
4 | (4) |
|
1.1.3 Leadership in Animal Groups on the Move |
|
|
8 | (2) |
|
1.2 Networks of Coupled Dynamical Systems in Nature and Science |
|
|
10 | (9) |
|
1.2.1 Collective Motion in Biological and Social Systems, Physics and Chemistry, and Engineered Systems |
|
|
10 | (2) |
|
1.2.2 Graph Topologies and Structured Information Flow in Collective Groups |
|
|
12 | (7) |
|
1.3 Cooperative Control of Multi-Agent Systems on Communication Graphs |
|
|
19 | (4) |
|
|
19 | (4) |
|
2 Algebraic Graph Theory and Cooperative Control Consensus |
|
|
23 | (52) |
|
2.1 Algebraic Graph Theory |
|
|
24 | (10) |
|
2.1.1 Graph Theory Basics |
|
|
25 | (1) |
|
|
26 | (2) |
|
2.1.3 Eigenstructure of Graph Laplacian Matrix |
|
|
28 | (5) |
|
2.1.4 The Fiedler Eigenvalue |
|
|
33 | (1) |
|
2.2 Systems on Communication Graphs and Consensus |
|
|
34 | (1) |
|
2.3 Consensus with Single-Integrator Dynamics |
|
|
35 | (10) |
|
2.3.1 Distributed Control Protocols for Consensus |
|
|
35 | (6) |
|
2.3.2 Consensus Value for Balanced Graphs---Average Consensus |
|
|
41 | (2) |
|
|
43 | (1) |
|
2.3.4 Non-Scalar Node States |
|
|
44 | (1) |
|
2.4 Motion Invariants for First-Order Consensus |
|
|
45 | (2) |
|
2.4.1 Graph Motion Invariant and `Internal Forces' |
|
|
45 | (1) |
|
2.4.2 Center of Gravity Dynamics and Shape Dynamics |
|
|
46 | (1) |
|
2.5 Consensus with First-Order Discrete-Time Dynamics |
|
|
47 | (6) |
|
2.5.1 Perron Discrete-Time Systems |
|
|
47 | (2) |
|
2.5.2 Normalized Protocol Discrete-Time Systems |
|
|
49 | (2) |
|
2.5.3 Average Consensus Using Two Parallel Protocols at Each Node |
|
|
51 | (2) |
|
2.6 Higher-Order Consensus: Linear Systems on Graphs |
|
|
53 | (2) |
|
2.7 Second-Order Consensus T |
|
|
55 | (7) |
|
2.7.1 Analysis of Second-Order Consensus Using Position/Velocity Local Node States |
|
|
55 | (4) |
|
2.7.2 Analysis of Second-Order Consensus Using Position/Velocity Global State |
|
|
59 | (1) |
|
2.7.3 Formation Control Second-Order Protocol |
|
|
60 | (2) |
|
2.8 Matrix Analysis of Graphs |
|
|
62 | (5) |
|
2.8.1 Irreducible Matrices and Frobenius Form |
|
|
63 | (2) |
|
2.8.2 Stochastic Matrices |
|
|
65 | (1) |
|
|
66 | (1) |
|
2.9 Lyapunov Functions for Cooperative Control on Graphs |
|
|
67 | (3) |
|
2.10 Conclusions and Setting for the Subsequent Chapters |
|
|
70 | (5) |
|
|
70 | (5) |
|
Part I Local Optimal Design for Cooperative Control in Multi-Agent Systems on Graphs |
|
|
|
3 Riccati Design for Synchronization of Continuous-Time Systems |
|
|
75 | (32) |
|
3.1 Duality, Stability, and Optimality for Cooperative Control |
|
|
75 | (1) |
|
3.2 State Feedback Design of Cooperative Control Protocols |
|
|
76 | (8) |
|
3.2.1 Synchronization of Multi-Agent Systems on Graphs |
|
|
77 | (2) |
|
3.2.2 Cooperative SVFB Control |
|
|
79 | (4) |
|
3.2.3 Local Riccati Design of Synchronizing Protocols |
|
|
83 | (1) |
|
3.3 Region of Synchronization |
|
|
84 | (2) |
|
3.4 Cooperative Observer Design |
|
|
86 | (3) |
|
3.5 Duality for Cooperative Systems on Graphs |
|
|
89 | (2) |
|
3.6 Cooperative Dynamic Regulators for Synchronization |
|
|
91 | (5) |
|
3.6.1 Neighborhood Controller and Neighborhood Observer |
|
|
91 | (2) |
|
3.6.2 Neighborhood Controller and Local Observer |
|
|
93 | (2) |
|
3.6.3 Local Controller and Neighborhood Observer |
|
|
95 | (1) |
|
|
96 | (11) |
|
|
104 | (3) |
|
4 Riccati Design for Synchronization of Discrete-Time Systems |
|
|
107 | (34) |
|
|
108 | (1) |
|
4.2 State Feedback Design of Discrete-Time Cooperative Controls |
|
|
108 | (4) |
|
4.2.1 Synchronization of Discrete-Time Multi-Agent Systems on Graphs |
|
|
109 | (3) |
|
4.3 Synchronization Region |
|
|
112 | (1) |
|
4.4 Local Riccati Design of Synchronizing Protocols |
|
|
112 | (4) |
|
4.5 Robustness Property of Local Riccati Design |
|
|
116 | (2) |
|
4.6 Application to Real Graph Matrix Eigenvalues and Single-Input Systems |
|
|
118 | (3) |
|
4.6.1 Case of Real Graph Eigenvalues |
|
|
118 | (1) |
|
4.6.2 Case of Single-Input Agent Dynamics |
|
|
119 | (1) |
|
4.6.3 Mahler Measure, Graph Condition Number, and Graph Channel Capacity |
|
|
120 | (1) |
|
4.7 Cooperative Observer Design |
|
|
121 | (7) |
|
4.7.1 Distributed Neighborhood Observer Dynamics |
|
|
122 | (2) |
|
|
124 | (1) |
|
4.7.3 Local Riccati Cooperative Observer Design |
|
|
124 | (3) |
|
4.7.4 Duality on Graphs for Discrete-Time Cooperative Systems |
|
|
127 | (1) |
|
4.8 Cooperative Dynamic Regulators for Synchronization |
|
|
128 | (4) |
|
4.8.1 Neighborhood Controller and Neighborhood Observer |
|
|
128 | (1) |
|
4.8.2 Neighborhood Controller and Local Observer |
|
|
129 | (1) |
|
4.8.3 Local Controller and Neighborhood Observer |
|
|
130 | (2) |
|
|
132 | (4) |
|
4.9.1 Example 4.1. Importance of Weighting in Control and Observer Protocols |
|
|
132 | (2) |
|
4.9.2 Example 4.2. Three Cooperative Dynamic Regulator Designs |
|
|
134 | (2) |
|
|
136 | (5) |
|
|
140 | (1) |
|
5 Cooperative Globally Optimal Control for Multi-Agent Systems on Directed Graph Topologies |
|
|
141 | (40) |
|
5.1 Stability, Local Optimality, and Global Optimality for Synchronization Control on Graphs |
|
|
142 | (1) |
|
|
143 | (1) |
|
5.3 Partial Asymptotic Stability |
|
|
144 | (3) |
|
5.4 Inverse Optimal Control |
|
|
147 | (6) |
|
|
148 | (1) |
|
|
149 | (4) |
|
5.5 Optimal Cooperative Control for Quadratic Performance Index and Single-Integrator Agent Dynamics |
|
|
153 | (5) |
|
5.5.1 Optimal Cooperative Regulator |
|
|
153 | (3) |
|
5.5.2 Optimal Cooperative Tracker |
|
|
156 | (2) |
|
5.6 Optimal Cooperative Control for Quadratic Performance Index and Linear Time-Invariant Agent Dynamics |
|
|
158 | (6) |
|
5.6.1 Optimal Cooperative Regulator |
|
|
158 | (3) |
|
5.6.2 Optimal Cooperative Tracker |
|
|
161 | (3) |
|
5.7 Constraints on Graph Topology |
|
|
164 | (3) |
|
|
165 | (1) |
|
5.7.2 Detail Balanced Graphs |
|
|
165 | (1) |
|
5.7.3 Directed Graphs with Simple Laplacian |
|
|
166 | (1) |
|
5.8 Optimal Cooperative Control for General Digraphs: Performance Index with Cross-Weighting Terms |
|
|
167 | (11) |
|
5.8.1 Optimal Cooperative Regulator---Single-Integrator Agent Dynamics |
|
|
168 | (2) |
|
5.8.2 Optimal Cooperative Tracker---Single-Integrator Agent Dynamics |
|
|
170 | (1) |
|
5.8.3 Condition for Existence of Global Optimal Control with Cross-weighting Terms in the Performance Index |
|
|
171 | (1) |
|
5.8.4 General Linear Time-Invariant Systems---Cooperative Regulator |
|
|
172 | (3) |
|
5.8.5 General Linear Time-Invariant Systems---Cooperative Tracker |
|
|
175 | (3) |
|
|
178 | (3) |
|
|
179 | (2) |
|
6 Graphical Games: Distributed Multiplayer Games on Graphs |
|
|
181 | (40) |
|
6.1 Introduction: Games, RL, and PI |
|
|
182 | (1) |
|
6.2 Synchronization and Node Error Dynamics |
|
|
183 | (3) |
|
|
183 | (1) |
|
6.2.2 Synchronization and Node Error Dynamics |
|
|
184 | (2) |
|
6.3 Cooperative Multiplayer Games on Graphs |
|
|
186 | (6) |
|
6.3.1 Cooperative Performance Index |
|
|
186 | (2) |
|
6.3.2 Global and Local Performance Objectives: Cooperation and Competition |
|
|
188 | (1) |
|
|
188 | (4) |
|
6.4 Interactive Nash Equilibrium |
|
|
192 | (3) |
|
6.5 Stability and Solution of Graphical Games |
|
|
195 | (5) |
|
6.5.1 Coupled Riccati Equations |
|
|
196 | (2) |
|
6.5.2 Stability and Solution for Cooperative Nash Equilibrium |
|
|
198 | (2) |
|
6.6 PI Algorithms for Cooperative Multiplayer Games |
|
|
200 | (11) |
|
|
200 | (1) |
|
6.6.2 PI Solution for Graphical Games |
|
|
201 | (4) |
|
6.6.3 PI Solution for Graphical Games |
|
|
205 | (1) |
|
|
206 | (1) |
|
6.6.5 Action NN and Online Learning |
|
|
207 | (4) |
|
|
211 | (4) |
|
6.7.1 Position and Velocity Regulated to Zero |
|
|
213 | (1) |
|
6.7.2 All the Nodes Synchronize to the Curve Behavior of the Leader Node |
|
|
213 | (2) |
|
|
215 | (6) |
|
|
215 | (6) |
|
Part II Distributed Adaptive Control for Multi-Agent Cooperative Systems |
|
|
|
7 Graph Laplacian Potential and Lyapunov Functions for Multi-Agent Systems |
|
|
221 | (14) |
|
7.1 Graph Laplacian Potential |
|
|
222 | (1) |
|
7.2 Laplacian Potential for Undirected Graphs |
|
|
223 | (5) |
|
7.2.1 Laplacian Potential for Directed Graphs |
|
|
225 | (3) |
|
7.3 Lyapunov Analysis for Cooperative Regulator Problems |
|
|
228 | (7) |
|
7.3.1 Consensus of Single Integrator Cooperative Systems |
|
|
229 | (2) |
|
7.3.2 Synchronization of Passive Nonlinear Systems |
|
|
231 | (3) |
|
|
234 | (1) |
|
8 Cooperative Adaptive Control for Systems with First-Order Nonlinear Dynamics |
|
|
235 | (24) |
|
8.1 Synchronization Control Formulation and Error Dynamics |
|
|
236 | (5) |
|
8.1.1 Graph Theory Basics |
|
|
236 | (1) |
|
8.1.2 Synchronization Control Problem |
|
|
237 | (1) |
|
8.1.3 Synchronization Error Dynamics |
|
|
238 | (1) |
|
8.1.4 Synchronization Control Design |
|
|
239 | (2) |
|
8.2 Adaptive Design and Distributed Tuning Law |
|
|
241 | (8) |
|
8.3 Relation of Error Bounds to Graph Structural Properties |
|
|
249 | (1) |
|
|
250 | (9) |
|
|
256 | (3) |
|
9 Cooperative Adaptive Control for Systems with Second-Order Nonlinear Dynamics |
|
|
259 | (20) |
|
9.1 Sliding Variable Cooperative Control Formulation and Error Dynamics |
|
|
260 | (5) |
|
9.1.1 Cooperative Tracking Problem for Synchronization of Multi-Agent Systems |
|
|
260 | (2) |
|
9.1.2 Sliding Mode Tracking Error |
|
|
262 | (1) |
|
9.1.3 Synchronization Control Design and Error Dynamics |
|
|
263 | (2) |
|
9.2 Cooperative Adaptive Design and Distributed Tuning Laws |
|
|
265 | (8) |
|
|
273 | (6) |
|
|
278 | (1) |
|
10 Cooperative Adaptive Control for Higher-Order Nonlinear Systems |
|
|
279 | (26) |
|
10.1 Sliding Variable Control Formulation and Error Dynamics |
|
|
280 | (5) |
|
10.1.1 Synchronization for Nonlinear Higher-Order Cooperative Systems |
|
|
280 | (3) |
|
10.1.2 Local Neighborhood Error Dynamics |
|
|
283 | (1) |
|
10.1.3 Communication Graph Structure and the Graph Lyapunov Equation |
|
|
284 | (1) |
|
10.2 Distributed Control Structure |
|
|
285 | (6) |
|
10.2.1 Sliding Mode Error Variables and Performance Lyapunov Equation |
|
|
285 | (2) |
|
10.2.2 Local NN Approximators for Unknown Nonlinearities |
|
|
287 | (3) |
|
10.2.3 Distributed Control Law Structure |
|
|
290 | (1) |
|
10.3 Distributed Tuning Laws for Cooperative Adaptive Control |
|
|
291 | (6) |
|
|
297 | (8) |
|
|
303 | (2) |
Index |
|
305 | |