A Linear Systems Primer

Panos J. Antsaklis Anthony N. Michel A Linear Systems Primer Birkh¨auser Boston • Basel • Berlin Panos J. Antsaklis...

Author: Panos J. Antsaklis | Anthony N. Michel

93 downloads 1810 Views 3MB Size Report

This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!

Report copyright / DMCA form

DOWNLOAD PDF

Panos J. Antsaklis Anthony N. Michel

A Linear Systems Primer

Birkh¨auser Boston • Basel • Berlin

Panos J. Antsaklis Department of Electrical Engineering University of Notre Dame Notre Dame, IN 46556 U.S.A.

Anthony N. Michel Department of Electrical Engineering University of Notre Dame Notre Dame, IN 46556 U.S.A.

Cover design by Mary Burgess. Mathematics Subject Classification (2000): 34A30, 34H05, 93-XX, 93-01, 93Axx, 93A30, 93Bxx, 93B03, 93B05, 93B07, 93B10, 93B11, 93B12, 93B15, 93B17, 93B18, 93B20, 93B25, 93B50, 93B55, 93B60, 93Cxx, 93C05, 93C15, 93C35, 93C55, 93C57, 93C62, 93Dxx, 93D05, 93D15, 93D20, 93D25, 93D30 Library of Congress Control Number: 2007905134 ISBN-13: 978-0-8176-4460-4

e-ISBN-13: 978-0-8176-4661-5

Printed on acid-free paper. c 2007 Birkhauser ¨ Boston All rights reserved. This work may not be translated or copied in whole or in part without the written permission of the publisher (Birkh¨auser Boston, c/o Springer Science+Business Media LLC, 233 Spring Street, New York, NY 10013, USA), except for brief excerpts in connection with reviews or scholarly analysis. Use in connection with any form of information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed is forbidden. The use in this publication of trade names, trademarks, service marks and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights.

www.birkhauser.com

(MP)

To our Families

To Melinda and our daughter Lily and to my parents Dr. Ioannis and Marina Antsaklis —Panos J. Antsaklis

And to our Students

To Leone and our children Mary, Kathy, John, Tony, and Pat —Anthony N. Michel

Preface

Brief Description The purpose of this book is to provide an introduction to system theory with emphasis on control theory. It is intended to be the textbook of a typical one-semester course introduction to systems primarily for ﬁrst-year graduate students in engineering, but also in mathematics, physics, and the rest of the sciences. Prerequisites for such a course include undergraduate-level diﬀerential equations and linear algebra, Laplace transforms, and modeling ideas of, say, electric circuits and simple mechanical systems. These topics are typically covered in the usual undergraduate curricula in engineering and sciences. The goal of this text is to provide a clear understanding of the fundamental concepts of systems and control theory, to highlight appropriately the principal results, and to present material suﬃciently broad so that the reader will emerge with a clear picture of the dynamical behavior of linear systems and their advantages and limitations. Organization and Coverage This primer covers essential concepts and results in systems and control theory. Since a typical course that uses this book may serve students with diﬀerent educational experiences, from diﬀerent disciplines and from diﬀerent educational systems, the ﬁrst chapters are intended to build up the understanding of the dynamical behavior of systems as well as provide the necessary mathematical background. Internal and external system descriptions are described in detail, including state variable, impulse response and transfer function, polynomial matrix, and fractional representations. Stability, controllability, observability, and realizations are explained with the emphasis always being on fundamental results. State feedback, state estimation, and eigenvalue assignment are discussed in detail. All stabilizing feedback controllers are also parameterized using polynomial and fractional system representations. The emphasis in this primer is on time-invariant systems, both continuous and

viii

Preface

discrete time. Although time-varying systems are studied in the ﬁrst chapter, for a full coverage the reader is encouraged to consult the companion book titled Linear Systems 1 that oﬀers detailed descriptions and additional material, including all the proofs of the results presented in this book. In fact, this primer is based on the more complete treatment of Linear Systems, which can also serve as a reference for researchers in the ﬁeld. This primer focuses more on course use of the material, with emphasis on a presentation that is more transparent, without sacriﬁcing rigor, and emphasizes those results that are considered to be fundamental in systems and control and are accepted as important and essential topics of the subject. Contents In a typical course on Linear Systems, the depth of coverage will vary depending on the goals set for the course and the background of the students. We typically cover the material in the ﬁrst three chapters in about six to seven weeks or about half of the semester; we spend about four to ﬁve weeks covering Chapters 4–8 on stability, controllability, and realizations; and we spend the remaining time in the course on state feedback, state estimation, and feedback control presented in Chapters 9–10. This book contains over 175 examples and almost 160 exercises. A Solutions Manual is available to course instructors from the publisher. Answers to selected exercises are given at the end of this book. By the end of Chapter 3, the students should have gained a good understanding of the role of inputs and initial conditions in the response of systems that are linear and time-invariant and are described by state-variable internal descriptions for both continuous- and discrete-time systems; should have brushed up and acquired background in diﬀerential and diﬀerence equations, matrix algebra, Laplace and z transforms, vector spaces, and linear transformations; should have gained understanding of linearization and the generality and limitations of the linear models used; should have become familiar with eigenvalues, system modes, and stability of an equilibrium; should have an understanding of external descriptions, impulse responses, and transfer functions; and should have learned how sampled data system descriptions are derived. Depending on the background of the students, in Chapter 1, one may want to deﬁne the initial value problem, discuss examples, brieﬂy discuss existence and uniqueness of solutions of diﬀerential equations, identify methods to solve linear diﬀerential equations, and derive the state transition matrix. Next, in Chapter 2, one may wish to discuss the system response, introduce the impulse response, and relate it to the state-space descriptions for both continuousand discrete-time cases. In Chapter 3, one may consider to study in detail the response of the systems to inputs and initial conditions. Note that it is 1

P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006.

Preface

ix

possible to start the coverage of the material with Chapter 3 going back to Chapters 1 and 2 as the need arises. A convenient way to decide the particular topics from each chapter that need to be covered is by reviewing the Summary and Highlights sections at the end of each chapter. The Lyapunov stability of an equilibrium and the input/output stability of linear time-invariant systems, along with stability, controllability and observability, are fundamental system properties and are covered in Chapters 4 and 5. Chapter 6 describes useful forms of the state space representations such as the Kalman canonical form and the controller form. They are used in the subsequent chapters to provide insight into the relations between input and output descriptions in Chapter 7. In that chapter the polynomial matrix representation, an alternative internal description, is also introduced. Based on the results of Chapters 5–7, Chapter 8 discusses realizations of transfer functions. Chapter 9 describes state feedback, pole assignment, optimal control, as well as state observers and optimal state estimation. Chapter 10 characterizes all stabilizing controllers and discusses feedback problems using matrix fractional descriptions of the transfer functions. Depending on the interest and the time constraints, several topics may be omitted completely without loss of continuity. These topics may include, for example, parts of Section 6.4 on controller and observer forms, Section 7.4 on poles and zeros, Section 7.5 on polynomial matrix descriptions, some of the realization algorithms in Section 8.4, sections in Chapter 9 on state feedback and state observers, and all of Chapter 10. The appendix collects selected results on linear algebra, ﬁelds, vector spaces, eigenvectors, the Jordan canonical form, and normed linear spaces, and it addresses numerical analysis issues that arise when computing solutions of equations. Simulating the behavior of dynamical systems, performing analysis using computational models, and designing systems using digital computers, although not central themes of this book, are certainly encouraged and often required in the examples and in the Exercise sections in each chapter. One could use one of several software packages speciﬁcally designed to perform such tasks that come under the label of control systems and signal processing, and work in diﬀerent operating system environments; or one could also use more general computing languages such as C, which is certainly a more tedious undertaking. Such software packages are readily available commercially and found in many university campuses. In this book we are not endorsing any particular one, but we are encouraging students to make their own informed choices. Acknowledgments We are indebted to our students for their feedback and constructive suggestions during the evolution of this book. We are also grateful to colleagues

x

Preface

who provided useful feedback regarding what works best in the classroom in their particular institutions. Special thanks go to Eric Kuehner for his expert preparation of the manuscript. This project would not have been possible without the enthusiastic support of Tom Grasso, Birkh¨auser’s Computational Sciences and Engineering Editor, who thought that such a companion primer to Linear Systems was an excellent idea. We would also like to acknowledge the help of Regina Gorenshteyn, Associate Editor at Birkh¨ auser. It was a pleasure writing this book. Our hope is that students enjoy reading it and learn from it. It was written for them.

Notre Dame, IN Spring 2007

Panos J. Antsaklis Anthony N. Michel

Contents

Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . vii 1

2

System Models, Diﬀerential Equations, and Initial-Value Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2 Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2.1 Notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.2.2 Continuous Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3 Initial-Value Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3.1 Systems of First-Order Ordinary Diﬀerential Equations 1.3.2 Classiﬁcation of Systems of First-Order Ordinary Diﬀerential Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.3.3 nth-Order Ordinary Diﬀerential Equations . . . . . . . . . . . . 1.4 Examples of Initial-Value Problems . . . . . . . . . . . . . . . . . . . . . . . . 1.5 Solutions of Initial-Value Problems: Existence, Continuation, Uniqueness, and Continuous Dependence on Parameters . . . . . . 1.6 Systems of Linear First-Order Ordinary Diﬀerential Equations 1.6.1 Linearization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.6.2 Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.7 Linear Systems: Existence, Uniqueness, Continuation, and Continuity with Respect to Parameters of Solutions . . . . . . . . . . 1.8 Solutions of Linear State Equations . . . . . . . . . . . . . . . . . . . . . . . . 1.9 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1.10 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

1 1 6 7 7 8 9 10 11 13 17 20 21 24 27 28 32 33 33 34

An Introduction to State-Space and Input–Output Descriptions of Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 2.2 State-Space Description of Continuous-Time Systems . . . . . . . . 47

xii

Contents

2.3 State-Space Description of Discrete-Time Systems . . . . . . . . . . . 2.4 Input–Output Description of Systems . . . . . . . . . . . . . . . . . . . . . . 2.4.1 External Description of Systems: General Considerations 2.4.2 Linear Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . 2.4.3 The Dirac Delta Distribution . . . . . . . . . . . . . . . . . . . . . . . 2.4.4 Linear Continuous-Time Systems . . . . . . . . . . . . . . . . . . . . 2.5 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2.6 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .

50 56 56 60 65 68 71 73 73 74

3

Response of Continuous- and Discrete-Time Systems . . . . . . 77 3.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 77 3.2 Solving x˙ = Ax and x˙ = Ax + g(t): The State Transition Matrix Φ(t, t0 ) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 3.2.1 The Fundamental Matrix . . . . . . . . . . . . . . . . . . . . . . . . . . . 78 3.2.2 The State Transition Matrix . . . . . . . . . . . . . . . . . . . . . . . . 82 3.2.3 Nonhomogeneous Equations . . . . . . . . . . . . . . . . . . . . . . . . 84 3.3 The Matrix Exponential eAt , Modes, and Asymptotic Behavior of x˙ = Ax . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 3.3.1 Properties of eAt . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 85 3.3.2 How to Determine eAt . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86 3.3.3 Modes, Asymptotic Behavior, and Stability . . . . . . . . . . . 94 3.4 State Equation and Input–Output Description of Continuous-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100 3.4.1 Response of Linear Continuous-Time Systems . . . . . . . . . 100 3.4.2 Transfer Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 3.4.3 Equivalence of State-Space Representations . . . . . . . . . . . 105 3.5 State Equation and Input–Output Description of Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108 3.5.1 Response of Linear Discrete-Time Systems . . . . . . . . . . . . 108 3.5.2 The Transfer Function and the z-Transform . . . . . . . . . . 112 3.5.3 Equivalence of State-Space Representations . . . . . . . . . . . 115 3.5.4 Sampled-Data Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 116 3.5.5 Modes, Asymptotic Behavior, and Stability . . . . . . . . . . . 121 3.6 An Important Comment on Notation . . . . . . . . . . . . . . . . . . . . . . 126 3.7 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127 3.8 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 130 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 131

4

Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 141 4.2 The Concept of an Equilibrium . . . . . . . . . . . . . . . . . . . . . . . . . . . . 142 4.3 Qualitative Characterizations of an Equilibrium . . . . . . . . . . . . . 144

Contents

xiii

4.4 4.5 4.6 4.7 4.8

Lyapunov Stability of Linear Systems . . . . . . . . . . . . . . . . . . . . . . 148 The Lyapunov Matrix Equation . . . . . . . . . . . . . . . . . . . . . . . . . . . 153 Linearization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164 Input–Output Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 170 Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173 4.8.1 Preliminaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 173 4.8.2 Linear Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 176 4.8.3 The Lyapunov Matrix Equation . . . . . . . . . . . . . . . . . . . . . 179 4.8.4 Linearization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185 4.8.5 Input–Output Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186 4.9 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188 4.10 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191 5

Controllability and Observability: Fundamental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195 5.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195 5.2 A Brief Introduction to Reachability and Observability . . . . . . . 195 5.2.1 Reachability and Controllability . . . . . . . . . . . . . . . . . . . . . 196 5.2.2 Observability and Constructibility . . . . . . . . . . . . . . . . . . . 200 5.2.3 Dual Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203 5.3 Reachability and Controllability . . . . . . . . . . . . . . . . . . . . . . . . . . . 204 5.3.1 Continuous-Time Time-Invariant Systems . . . . . . . . . . . . 205 5.3.2 Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213 5.4 Observability and Constructibility . . . . . . . . . . . . . . . . . . . . . . . . . 218 5.4.1 Continuous-Time Time-Invariant Systems . . . . . . . . . . . . 219 5.4.2 Discrete-Time Time-Invariant Systems . . . . . . . . . . . . . . . 225 5.5 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230 5.6 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233

6

Controllability and Observability: Special Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237 6.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237 6.2 Standard Forms for Uncontrollable and Unobservable Systems 237 6.2.1 Standard Form for Uncontrollable Systems . . . . . . . . . . . 238 6.2.2 Standard Form for Unobservable Systems . . . . . . . . . . . . 241 6.2.3 Kalman’s Decomposition Theorem . . . . . . . . . . . . . . . . . . . 244 6.3 Eigenvalue/Eigenvector Tests for Controllability and Observability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248 6.4 Controller and Observer Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250 6.4.1 Controller Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251 6.4.2 Observer Forms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263

xiv

Contents

6.5 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269 6.6 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272 7

Internal and External Descriptions: Relations and Properties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 7.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 7.2 Relations Between State-Space and Input–Output Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277 7.3 Relations Between Lyapunov and Input–Output Stability . . . . . 281 7.4 Poles and Zeros . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282 7.4.1 Smith and Smith–McMillan Forms . . . . . . . . . . . . . . . . . . . 283 7.4.2 Poles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 284 7.4.3 Zeros . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286 7.4.4 Relations Between Poles, Zeros, and Eigenvalues of A . . 290 7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292 7.5.1 A Brief Introduction to Polynomial and Fractional Descriptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294 7.5.2 Coprimeness and Common Divisors . . . . . . . . . . . . . . . . . . 298 7.5.3 Controllability, Observability, and Stability . . . . . . . . . . . 303 7.5.4 Poles and Zeros . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304 7.6 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306 7.7 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309

8

Realization Theory and Algorithms . . . . . . . . . . . . . . . . . . . . . . . . 313 8.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313 8.2 State-Space Realizations of External Descriptions . . . . . . . . . . . . 313 8.2.1 Continuous-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . 314 8.2.2 Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315 8.3 Existence and Minimality of Realizations . . . . . . . . . . . . . . . . . . . 316 8.3.1 Existence of Realizations . . . . . . . . . . . . . . . . . . . . . . . . . . . 316 8.3.2 Minimality of Realizations . . . . . . . . . . . . . . . . . . . . . . . . . . 317 8.3.3 The Order of Minimal Realizations . . . . . . . . . . . . . . . . . . 321 8.3.4 Minimality of Realizations: Discrete-Time Systems . . . . 323 8.4 Realization Algorithms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324 8.4.1 Realizations Using Duality . . . . . . . . . . . . . . . . . . . . . . . . . 324 8.4.2 Realizations in Controller/Observer Form . . . . . . . . . . . . 326 8.4.3 Realizations with Matrix A Diagonal . . . . . . . . . . . . . . . . 339 8.4.4 Realizations Using Singular-Value Decomposition . . . . . . 341 8.5 Polynomial Matrix Realizations . . . . . . . . . . . . . . . . . . . . . . . . . . . 343 8.6 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345

Contents

xv

8.7 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346 9

State Feedback and State Observers . . . . . . . . . . . . . . . . . . . . . . . 351 9.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351 9.2 Linear State Feedback . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 352 9.2.1 Continuous-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . 352 9.2.2 Eigenvalue Assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355 9.2.3 The Linear Quadratic Regulator (LQR): Continuous-Time Case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369 9.2.4 Input–Output Relations . . . . . . . . . . . . . . . . . . . . . . . . . . . . 372 9.2.5 Discrete-Time Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 376 9.2.6 The Linear Quadratic Regulator (LQR): Discrete-Time Case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 377 9.3 Linear State Observers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378 9.3.1 Full-Order Observers: Continuous-Time Systems . . . . . . 378 9.3.2 Reduced-Order Observers: Continuous-Time Systems . . 383 9.3.3 Optimal State Estimation: Continuous-Time Systems . . 385 9.3.4 Full-Order Observers: Discrete-Time Systems . . . . . . . . . 387 9.3.5 Reduced-Order Observers: Discrete-Time Systems . . . . . 391 9.3.6 Optimal State Estimation: Discrete-Time Systems . . . . . 391 9.4 Observer-Based Dynamic Controllers . . . . . . . . . . . . . . . . . . . . . . . 392 9.4.1 State-Space Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393 9.4.2 Transfer Function Analysis . . . . . . . . . . . . . . . . . . . . . . . . . 397 9.5 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 400 9.6 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 403 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 404 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405

10 Feedback Control Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411 10.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411 10.2 Interconnected Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411 10.2.1 Systems Connected in Parallel and in Series . . . . . . . . . . 411 10.2.2 Systems Connected in Feedback Conﬁguration . . . . . . . . 413 10.3 Parameterization of All Stabilizing Feedback Controllers . . . . . . 422 10.3.1 Stabilizing Feedback Controllers Using Polynomial MFDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423 10.3.2 Stabilizing Feedback Controllers Using Proper and Stable MFDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 426 10.4 Two Degrees of Freedom Controllers . . . . . . . . . . . . . . . . . . . . . . . 431 10.4.1 Internal Stability . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 432 10.4.2 Response Maps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435 10.4.3 Controller Implementations . . . . . . . . . . . . . . . . . . . . . . . . . 439 10.4.4 Some Control Problems . . . . . . . . . . . . . . . . . . . . . . . . . . . . 445

xvi

Contents

10.5 Summary and Highlights . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 447 10.6 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451 Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 452 A

Appendix . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 455 A.1 Vector Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 455 A.1.1 Fields . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 455 A.1.2 Vector Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 456 A.2 Linear Independence and Bases . . . . . . . . . . . . . . . . . . . . . . . . . . . 460 A.2.1 Linear Subspaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 460 A.2.2 Linear Independence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 461 A.2.3 Linear Independence of Functions of Time . . . . . . . . . . . . 462 A.2.4 Bases . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 463 A.3 Linear Transformations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 464 A.3.1 Linear Equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 465 A.3.2 Representation of Linear Transformations by Matrices . 466 A.3.3 Solving Linear Algebraic Equations . . . . . . . . . . . . . . . . . . 469 A.4 Equivalence and Similarity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 471 A.4.1 Change of Bases: Vector Case . . . . . . . . . . . . . . . . . . . . . . . 471 A.4.2 Change of Bases: Matrix Case . . . . . . . . . . . . . . . . . . . . . . 472 A.4.3 Equivalence and Similarity of Matrices . . . . . . . . . . . . . . . 473 A.5 Eigenvalues and Eigenvectors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 474 A.5.1 Characteristic Polynomial . . . . . . . . . . . . . . . . . . . . . . . . . . 474 A.5.2 The Cayley–Hamilton Theorem and Applications . . . . . . 475 A.5.3 Minimal Polynomials . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477 A.6 Diagonal and Jordan Canonical Form of Matrices . . . . . . . . . . . . 478 A.7 Normed Linear Spaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 483 A.8 Some Facts from Matrix Algebra . . . . . . . . . . . . . . . . . . . . . . . . . . 486 A.9 Numerical Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487 A.9.1 Solving Linear Algebraic Equations . . . . . . . . . . . . . . . . . . 488 A.9.2 Singular Values and Singular Value Decomposition . . . . 491 A.9.3 Least-Squares Problem . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 496 A.10 Notes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497 References . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497

Solutions to Selected Exercises . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 499 Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 505

1 System Models, Diﬀerential Equations, and Initial-Value Problems

1.1 Introduction The dynamical behavior of systems can be understood by studying their mathematical descriptions. The ﬂight path of an airplane subject to certain engine thrust, rudder and elevator angles, and particular wind conditions, or the behavior of an automobile on cruise control when climbing a certain hill, can be predicted using mathematical descriptions of the pertinent behavior. Mathematical equations, typically diﬀerential or diﬀerence equations, are used to describe the behavior of processes and to predict their responses to certain inputs. Although computer simulation is an excellent tool for verifying predicted behavior, and thus for enhancing our understanding of processes, it is certainly not an adequate substitute for generating the information captured in a mathematical model, when such a model is available. This chapter develops mathematical descriptions for linear continuoustime and linear discrete-time ﬁnite-dimensional systems. Since such systems are frequently the result of a linearization process of nonlinear systems, or the result of the modeling process of physical systems in which the nonlinear eﬀects have been suppressed or neglected, the origins of these linear systems are frequently nonlinear systems. For this reason, here and in Chapter 4, when we deal with certain qualitative aspects (such as existence, uniqueness, continuation, and continuity with respect to parameters of solutions of system equations, stability of an equilibrium, and so forth), we consider linear as well as nonlinear system models, although the remainder of the book deals exclusively with linear systems. In this chapter, mathematical models and classiﬁcation of models are discussed in the remainder of this Introduction, Section 1.1. In Section 1.2, we provide some of the notation used and recall certain facts concerning continuous functions. In Section 1.3 we present the initial-value problem and we give several speciﬁc examples in Section 1.4. In Section 1.5 we present results that ensure the existence, continuation, and uniqueness of solutions of initial-value problems and results that ensure that the solutions of inital-value problems

2

1 System Models, Diﬀerential Equations, and Initial-Value Problems

depend continuously on initial conditions and system parameters. In this section we also present the Method of Successive Approximations to determine solutions of intial-value problems. The results in Section 1.5 pertain to differential equations that in general are nonlinear. In Section 1.6 we address linearization of such equations and we provide several speciﬁc examples. We utilize the results of Section 1.5 to establish in Section 1.7 conditions for the existence, uniqueness, continuation, and continuity with respect to initial conditions and parameters of solutions of initial-value problems determined by linear ordinary diﬀerential equations. In Section 1.8 we determine the solutions of linear ordinary diﬀerential equations and introduce for the ﬁrst time the notions of state and state transition matrix. We also present the variations of constants formula for solving linear nonhomogeneous ordinary diﬀerential equations, and we introduce the notions of homogeneous and particular solutions. Summarizing, the purpose of Sections 1.3 to 1.8 is to provide material dealing with ordinary diﬀerential equations and initial-value problems that is essential in the study of continuous-time ﬁnite-dimensional systems. This material will enable us to introduce the state-space equations representation of continuous-time ﬁnite-dimensional systems. This introduction will be accomplished in the next chapter. Physical Processes, Models, and Mathematical Descriptions A systematic study of (physical) phenomena usually begins with a modeling process. Examples of models include diagrams of electric circuits consisting of interconnections of resistors, inductors, capacitors, transistors, diodes, voltage or current sources, and so on; mechanical circuits consisting of interconnections of point masses, springs, viscous dampers (dashpots), applied forces, and so on; verbal characterizations of economic and societal systems; among others. Next, appropriate laws or principles are invoked to generate equations that describe the models (e.g., Kirchhoﬀ’s current and voltage laws, Newton’s laws, conservation laws, and so forth). When using an expression such as “we consider a system described by ordinary diﬀerential equations,” we will have in mind a phenomenon described by an appropriate set of ordinary diﬀerential equations (not the description of the physical phenomenon itself). A physical process (physical system) will typically give rise to several different models, depending on what questions are being asked. For instance, in the study of the voltage-current characteristics of a transistor (the physical process), one may utilize a circuit (the model) that is valid at low frequencies or a circuit (a second model) that is valid at high frequencies; alternatively, if semiconductor impurities are of interest, a third model, quite diﬀerent from the preceding two, is appropriate. Over the centuries, a great deal of progress has been made in developing mathematical descriptions of physical phenomena (using models of such phenomena). In doing so, we have invoked laws (or principles) of physics,

1.1 Introduction

3

chemistry, biology, economics, and so on, to derive mathematical expressions (usually equations) that characterize the evolution (in time) of the variables of interest. The availability of such mathematical descriptions enables us to make use of the vast resources oﬀered by the many areas of applied and pure mathematics to conduct qualitative and quantitative studies of the behavior of processes. A given model of a physical process may give rise to several diﬀerent mathematical descriptions. For example, when applying Kirchhoﬀ’s voltage and current laws to the low-frequency transistor model mentioned earlier, one can derive a set of diﬀerential and algebraic equations, a set consisting of only diﬀerential equations, or a set of integro-diﬀerential equations, and so forth. This process of mathematical modeling, “from a physical phenomenon to a model to a mathematical description,” is essential in science and engineering. To capture phenomena of interest accurately and in tractable mathematical form is a demanding task, as can be imagined, and requires a thorough understanding of the physical process involved. For this reason, the mathematical description of complex electrical systems, such as power systems, is typically accomplished by electrical engineers, the equations of ﬂight dynamics of an aircraft are derived by aeronautical engineers, the equations of chemical processes are arrived at by chemists and chemical engineers, and the equations that characterize the behavior of economic systems are provided by economists. In most nontrivial cases, this type of modeling process is close to an art form since a good mathematical description must be detailed enough to accurately describe the phenomena of interest and at the same time simple enough to be amenable to analysis. Depending on the applications on hand, a given mathematical description of a process may be further simpliﬁed before it is used in analysis and especially in design procedures. For example, using the ﬁnite element method, one can derive a set of ﬁrst-order diﬀerential equations that describe the motion of a space antenna. Typically, such mathematical descriptions contain hundreds of diﬀerential equations. Whereas all these equations are quite useful in simulating the motion of the antenna, a lower order model is more suitable for the control design that, for example, may aim to counteract the eﬀects of certain disturbances. Simpler mathematical models are required mainly because of our inability to deal eﬀectively with hundreds of variables and their interactions. In such simpliﬁed mathematical descriptions, only those variables (and their interactions) that have signiﬁcant eﬀects on the phenomena of interest are included. A point that cannot be overemphasized is that the mathematical descriptions we will encounter characterize processes only approximately. Most often, this is the case because the complexity of physical systems deﬁes exact mathematical formulation. In many other cases, however, it is our own choice that a mathematical description of a given process approximate the actual phenomena by only a certain desired degree of accuracy. As discussed earlier, this is done in the interest of mathematical simplicity. For example, in the description of RLC circuits, one could use nonlinear diﬀerential equations that take into consideration parasitic eﬀects in the capacitors; however, most often it

4

1 System Models, Diﬀerential Equations, and Initial-Value Problems

suﬃces to use linear ordinary diﬀerential equations with constant coeﬃcients to describe the voltage-current relations of such circuits, since typically such a description provides an adequate approximation and since it is much easier to work with linear rather than nonlinear diﬀerential equations. In this book it will generally be assumed that the mathematical description of a system in question is given. In other words, we assume that the modeling of the process in question has taken place and that equations describing the process are given. Our main objective will be to present a theory of an important class of systems—ﬁnite-dimensional linear systems—by studying the equations representing such systems. Classiﬁcation of Systems For our purposes, a comprehensive classiﬁcation of systems is not particularly illuminating. However, an enumeration of the more common classes of systems encountered in engineering and science may be quite useful, if for no other reason than to show that the classes of systems considered in this book, although very important, are quite specialized. As pointed out earlier, the particular set of equations describing a given system will in general depend on the eﬀects one wishes to capture. Thus, one can speak of lumped parameter or ﬁnite-dimensional systems and distributed parameter or inﬁnite-dimensional systems; continuous-time and discrete-time systems; linear and nonlinear systems; time-varying and time-invariant systems; deterministic and stochastic systems; appropriate combinations of the above, called hybrid systems; and perhaps others. The appropriate mathematical settings for ﬁnite-dimensional systems are ﬁnite-dimensional vector spaces, and for inﬁnite-dimensional systems they are most often inﬁnite-dimensional linear spaces. Continuous-time ﬁnitedimensional systems are usually described by ordinary diﬀerential equations or certain kinds of integral equations, whereas discrete-time ﬁnite-dimensional systems are usually characterized by ordinary diﬀerence equations or discretetime counterparts to those integral equations. Equations used to describe inﬁnite-dimensional systems include partial diﬀerential equations, Volterra integro-diﬀerential equations, functional diﬀerential equations, and so forth. Hybrid system descriptions involve two or more diﬀerent types of equations. Nondeterministic systems are described by stochastic counterparts to those equations (e.g., Ito diﬀerential equations). In a broader context, not addressed in this book, most of the systems described by the equations enumerated generate dynamical systems. It has become customary in the engineering literature to use the term “dynamical system” rather loosely, and it has even been applied to cases where the original deﬁnition does not exactly ﬁt. (For a discussion of general dynamical systems, refer, e.g., to Michel et al [5].) We will address in this book dynamical systems determined by ordinary diﬀerential equations or ordinary diﬀerence equations, considered next.

1.1 Introduction

5

Finite-Dimensional Systems The dynamical systems we will be concerned with are continuous-time and discrete-time ﬁnite-dimensional systems—primarily linear systems. However, since such systems are frequently a consequence of a linearization process, it is important when dealing with fundamental qualitative issues that we have an understanding of the origins of such linear systems. In particular, when dealing with questions of existence and uniqueness of solutions of the equations describing a class of systems, and with stability properties of such systems, we may consider nonlinear models as well. Continuous-time ﬁnite-dimensional dynamical systems that we will consider are described by equations of the form x˙ i = fi (t, x1 , . . . , xn , u1 , . . . , um ), yi = gi (t, x1 , . . . , xn , u1 , . . . , um ),

i = 1, . . . , n, i = 1, . . . , p,

(1.1a) (1.1b)

where ui , i = 1, . . . , m, denote inputs or stimuli; yi , i = 1, . . . , p, denote outputs or responses; xi , i = 1, . . . , n, denote state variables; t denotes time; x˙ i denotes the time derivative of xi ; fi , i = 1, . . . , n, are real-valued functions of 1 + n + m real variables; and gi , i = 1, . . . , p, are real-valued functions of 1 + n + m real variables. A complete description of such systems will usually also require a set of initial conditions xi (t0 ) = xi0 , i = 1, . . . , n, where t0 denotes initial time. We will elaborate later on restrictions that need to be imposed on the fi , gi , and ui and on the origins of the term “state variables.” Equations (1.1a) and (1.1b) can be represented in vector form as x˙ = f (t, x, u),

(1.2a)

y = g(t, x, u),

(1.2b)

where x is the state vector with components xi , u is the input vector with components ui , y is the output vector with components yi , and f and g are vector-valued functions with components fi and gi , respectively. We call (1.2a) a state equation and (1.2b) an output equation. Important special cases of (1.2a) and (1.2b) are the linear time-varying state equation and output equation given by x˙ = A(t)x + B(t)u, y = C(t)x + D(t)u,

(1.3a) (1.3b)

where A, B, C, and D are real n × n, n × m, p × n, and p × m matrices, respectively, whose elements are time-varying. Restrictions on these matrices will be provided later. Linear time-invariant state and output equations given by x˙ = Ax + Bu, y = Cx + Du

(1.4a) (1.4b)

6

1 System Models, Diﬀerential Equations, and Initial-Value Problems

constitute important special cases of (1.3a) and (1.3b), respectively. Equations (1.3) and (1.4) may arise in the modeling process, or they may be a consequence of linearization of (1.1). Discrete-time ﬁnite-dimensional dynamical systems are described by equations of the form xi (k + 1) = fi (k, x1 (k), . . . , xn (k), u1 (k), . . . , um (k))

i = 1, . . . , n,

(1.5a)

yi (k) = gi (k, x1 (k), . . . , xn (k), u1 (k), . . . , um (k))

i = 1, . . . , p,

(1.5b)

or in vector form, x(k + 1) = f (k, x(k), u(k)),

(1.6a)

y(k) = g(k, x(k), u(k)),

(1.6b)

where k is an integer that denotes discrete time and all other symbols are deﬁned as before. A complete description of such systems involves a set of initial conditions x(k0 ) = xk0 , where k0 denotes initial time. The corresponding linear time-varying and time-invariant state and output equations are given by x(k + 1) = A(k)x(k) + B(k)u(k), y(k) = C(k)x(k) + D(k)u(k)

(1.7a) (1.7b)

x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k),

(1.8a) (1.8b)

and

respectively, where all symbols in (1.7) and (1.8) are deﬁned as in (1.3) and (1.4), respectively. This type of system characterization is called state-space description or state-variable description or internal description of ﬁnite-dimensional systems. Another way of describing continuous-time and discrete-time ﬁnitedimensional dynamical systems involves operators that establish a relationship between the system inputs and outputs. Such characterization is called input– output description or external description of a system. In Chapter 2, we will address both the state-variable description and the input–output description of ﬁnite-dimensional systems. Before we can do this, however, we will require some background material concerning ordinary diﬀerential equations.

1.2 Preliminaries We will employ a consistent notation and use certain facts from the calculus, analysis, and linear algebra. We will summarize this type of material, as needed, in various sections. This is the ﬁrst such section.

1.2 Preliminaries

7

1.2.1 Notation Let V and W be sets. Then V ∪W, V ∩W, V −W , and V ×W denote the union, intersection, diﬀerence, and Cartesian product of V and W , respectively. If V is a subset of W , we write V ⊂ W ; if x is an element of V , we write x ∈ V ; and if x is not an element of V , we write x ∈ V . We let V , ∂V, V¯ , and int V denote the complement, boundary, closure, and interior of V , respectively. Let φ denote the empty set, R the real numbers, R+ = {x ∈ R : x ≥ 0} (i.e., R+ denotes the set of nonnegative real numbers), Z the integers, and Z + = {x ∈ Z : x ≥ 0}. We will let J ⊂ R denote open, closed, or half-open intervals. Thus, for a, b ∈ R, a ≤ b, J may be of the form J = (a, b) = {x ∈ R : a < x < b}, J = [a, b] = {x ∈ R : a ≤ x ≤ b}, J = [a, b) = {x ∈ R : a ≤ x < b}, or J = (a, b] = {x ∈ R : a < x ≤ b}. Let Rn denote the real n-space. If x ∈ Rn , then ⎡ ⎤ x1 ⎢ .. ⎥ x=⎣ . ⎦ xn and xT = (x1 , . . . , xn ) denotes the transpose of the vector x. Also, let Rm×n denote the set of m × n real matrices. If A ∈ Rm×n , then ⎡ ⎤ a11 a12 · · · a1n ⎢ a21 a22 · · · a2n ⎥ ⎥ A = [aij ] = ⎢ ⎣ ⎦ am1 am2 · · · amn and AT = [aji ] ∈ Rn×m denotes the transpose of the matrix A. Similarly, we let C n denote the set of n-vectors with complex components and C m×n denote the set of m × n matrices with complex elements. Let f : V → W denote a mapping or function from a set V into a set W , and denote by D(f ) and R(f ) the domain and the range of f , respectively. Also, let f −1 : R(f ) → D(f ), if it exists, denote the inverse of f . 1.2.2 Continuous Functions First, let J ⊂ R denote an open interval and consider a function f : J → R. Recall that f is said to be continuous at the point t0 ∈ J if limt→t0 f (t) = f (t0 ) exists; i.e., if for every > 0 there exists a δ > 0 such that |f (t) − f (t0 )| < whenever |t − t0 | < δ and t ∈ J. The function f is said to be continuous on J, or simply continuous, if it is continuous at each point in J. In the above deﬁnition, δ depends on the choice of t0 and ; i.e., δ = δ(, t0 ). If at each t0 ∈ J it is true that there is a δ > 0, independent of t0 [i.e., δ = δ()], such that |f (t) − f (t0 )| < whenever |t − t0 | < δ and t ∈ J, then f is said to be uniformly continuous (on J).

8

1 System Models, Diﬀerential Equations, and Initial-Value Problems

Let C(J, R) {f : J → R | f is continuous on J}. Now suppose that J contains one or both endpoints. Then continuity is interpreted as being one-sided at these points. For example, if J = [a, b], then f ∈ C(J, R) will mean that f ∈ C((a, b), R) and that limt→a+ f (t) = f (a) and limt→b− f (t) = f (b) exist. With k any positive integer, and with J an open interval, we will use the notation C k (J, R) {f : J → R | the derivative f (j) exists on J and f (j) ∈ C(J, R) for j = 0, 1, . . . , k, where f (0) f } and we will call f in this case a C k -function. Also, we will call f a piecewise C k -function if f ∈ C k−1 (J, R) and f (k−1) has continuous derivatives for all t ∈ J, with the possible exception of a ﬁnite set of points where f (k) may have jump discontinuities. As before, when J contains one or both endpoints, then the existence and continuity of derivatives is one-sided at these points. For any subset D of the n-space Rn with nonempty interior, we can deﬁne C(D, R) and C k (D, R) in a similar manner as before. Thus, f ∈ C(D, R) indicates that at every point x0 = (x10 , . . . , xn0 )T ∈ D, limx→x0 f (x) = f (x0 ) exists, or equivalently, at every x0 ∈ D it is true that for every > 0 there exists a δ = δ(, x0 ) > 0 such that |f (x) − f (x0 )| < whenever |x1 − x10 | + · · · + |xn − xn0 | < δ and x ∈ D. Also, we deﬁne C k (D, R) as ∂j f k ∈ C(D, R), i1 + · · · + in = j, C (D, R) {f : D → R i1 ∂x1 . . . ∂xinn j = 1, . . . , k, and f ∈ C(D, R)} (i.e., i1 , . . . , in take on all possible positive integer values such that their sum is j). When D contains its boundary (or part of its boundary), then the continuj ity of f and the existence and continuity of partial derivatives of f, i1∂ f in , ∂x1 ...∂xn

i1 + · · · + in = j, j = 1, . . . , k, will have to be interpreted in the appropriate way at the boundary points. Recall that if K ⊂ Rn , K = φ, and K is compact (i.e., K is closed and bounded), and if f ∈ C(K, R), then f is uniformly continuous (on K) and f attains its maximum and minimum on K. Finally, let D be a subset of Rn with nonempty interior and let f : D → m R . Then f = (f1 , . . . , fm )T where fi : D → R, i = 1, . . . , m. We say that f ∈ C(D, Rm ) if fi ∈ C(D, R), i = 1, . . . , m, and that for some positive integer k, f ∈ C k (D, Rm ) if fi ∈ C k (D, R), i = 1, . . . , m.

1.3 Initial-Value Problems In this section we make precise the meaning of several concepts that arise in the study of continuous-time ﬁnite-dimensional dynamical systems.

1.3 Initial-Value Problems

9

1.3.1 Systems of First-Order Ordinary Diﬀerential Equations Let D ⊂ Rn+1 denote a domain, i.e., an open, nonempty, and connected subset of Rn+1 . We call Rn+1 the (t, x)-space, and we denote elements of Rn+1 by (t, x) and elements of Rn by x = (x1 , . . . , xn )T . Next, we consider the functions fi ∈ C(D, R), i = 1, . . . , n, and if xi is a function of t, we let n (n) xi = ddtxni denote the nth derivative of xi with respect to t (provided that it exists). In particular, when n = 1, we usually write (1)

xi

= x˙ i =

dxi . dt

We call the system of equations given by x˙ i = fi (t, x1 , . . . , xn ),

i = 1, . . . , n,

(1.9)

a system of n ﬁrst-order ordinary diﬀerential equations. By a solution of the system of equations (1.9), we shall mean n continuously diﬀerentiable functions φ1 , . . . , φn deﬁned on an interval J = (a, b) [i.e., φ ∈ C 1 (J, Rn )] such that (t, φ1 (t), . . . , φn (t)) ∈ D for all t ∈ J and such that φ˙ i (t) = fi (t, φ1 (t), . . . , φn (t)),

i = 1, . . . , n,

for all t ∈ J. Next, we let (t0 , x10 , . . . , xn0 ) ∈ D. Then the initial-value problem associated with (1.9) is given by x˙ i = fi (t, x1 , . . . , xn ), xi (t0 ) = xi0 ,

i = 1, . . . , n, i = 1, . . . , n.

(1.10)

A set of functions {φ1 , . . . , φn } is a solution of the initial-value problem (1.10) if {φ1 , . . . , φn } is a solution of (1.9) on some interval J containing t0 and if (φ1 (t0 ), . . . , φn (t0 )) = (x10 , . . . , xn0 ). In Figure 1.1 the solution of a hypothetical initial-value problem is depicted ˙ ) = f (τ, x graphically when n = 1. Note that φ(τ ˜) = tan α, where α is the slope of the line L that is tangent to the plot of the curve φ(t) vs. t, at the point (τ, x˜). In dealing with systems of equations, we will utilize the vector notation x = (x1 , . . . , xn )T , x0 = (x10 , . . . , xn0 )T , φ = (φ1 , . . . , φn )T , f (t, x) = (f1 (t, x1 , . . . , xn ), . . . , fn (t, x1 , . . . , xn ))T = (f1 (t, x), . . . , fn (t, x))T , x˙ = t t t (x˙ 1 , . . . , x˙ n )T , and t0 f (s, φ(s))ds = [ t0 f1 (s, φ(s))ds, . . . , t0 fn (s, φ(s))ds]T . With the above notation we can express the system of ﬁrst-order ordinary diﬀerential equations (1.9) by x˙ = f (t, x) and the initial-value problem (1.10) by

(1.11)

10

1 System Models, Diﬀerential Equations, and Initial-Value Problems x Solution φ

L

~ x α

Domain D

t τ

a

b

Figure 1.1. Solution of an initial-value problem when n = 1

x˙ = f (t, x),

x(t0 ) = x0 .

(1.12)

We leave it to the reader to prove that the initial-value problem (1.12) can be equivalently expressed by the integral equation

t f (s, φ(s))ds, (1.13) φ(t) = x0 + t0

where φ denotes a solution of (1.12). 1.3.2 Classiﬁcation of Systems of First-Order Ordinary Diﬀerential Equations Systems of ﬁrst-order ordinary diﬀerential equations have been classiﬁed in many ways. We enumerate here some of the more important cases. If in (1.11), f (t, x) ≡ f (x) for all (t, x) ∈ D, then x˙ = f (x).

(1.14)

We call (1.14) an autonomous system of ﬁrst-order ordinary diﬀerential equations. If (t + T, x) ∈ D whenever (t, x) ∈ D and if f (t, x) = f (t + T, x) for all (t, x) ∈ D, then (1.11) assumes the form x˙ = f (t, x) = f (t + T, x).

(1.15)

We call such an equation a periodic system of ﬁrst-order diﬀerential equations with period T . The smallest T > 0 for which (1.15) is true is called the least period of this system of equations. When in (1.11), f (t, x) = A(t)x, where A(t) = [aij (t)] is a real n × n matrix with elements aij that are deﬁned and at least piecewise continuous on a t-interval J, then we have x˙ = A(t)x

(1.16)

1.3 Initial-Value Problems

11

and refer to (1.16) as a linear homogeneous system of ﬁrst-order ordinary diﬀerential equations. If for (1.16), A(t) is deﬁned for all real t, and if there is a T > 0 such that A(t) = A(t + T ) for all t, then we have x˙ = A(t)x = A(t + T )x.

(1.17)

This system is called a linear periodic system of ﬁrst-order ordinary diﬀerential equations. Next, if in (1.11), f (t, x) = A(t)x + g(t), where A(t) is as deﬁned in (1.16), and g(t) = [g1 (t), . . . , gn (t)]T is a real n-vector with elements gi that are deﬁned and at least piecewise continuous on a t-interval J, then we have x˙ = A(t)x + g(t).

(1.18)

In this case we speak of a linear nonhomogeneous system of ﬁrst-order ordinary diﬀerential equations. Finally, if in (1.11), f (t, x) = Ax, where A = [aij ] ∈ Rn×n , then we have x˙ = Ax.

(1.19)

This type of system is called a linear, autonomous, homogeneous system of ﬁrst-order ordinary diﬀerential equations. 1.3.3 nth-Order Ordinary Diﬀerential Equations Thus far we have been concerned with systems of ﬁrst-order ordinary diﬀerential equations. It is also possible to characterize initial-value problems by means of nth-order ordinary diﬀerential equations. To this end we let h be a real function that is deﬁned and continuous on a domain D of the real (t, y, . . . , yn )-space [i.e., D ⊂ Rn+1 , D is a domain, and h ∈ C(D, R)]. Then y (n) = h(t, y, y (1) , . . . , y (n−1) )

(1.20)

is an nth-order ordinary diﬀerential equation. A solution of (1.20) is a function φ ∈ C n (J, R) that satisﬁes (t, φ(t), φ(1) (t), . . . , φ(n−1) (t)) ∈ D for all t ∈ J and φ(n) (t) = h(t, φ(t), φ(1) (t), . . . , φ(n−1) (t)) for all t ∈ J, where J = (a, b) is a t-interval. Now for a given (t0 , x10 , . . . , xn0 ) ∈ D, the initial -value problem for (1.20) is y (n) = h(t, y, y (1) , . . . , y (n−1) ), y(t0 ) = x10 , . . . , y (n−1) (t0 ) = xn0 .

(1.21)

12

1 System Models, Diﬀerential Equations, and Initial-Value Problems

A function φ is a solution of (1.21) if φ is a solution of (1.20) on some interval containing t0 and if φ(t0 ) = x10 , . . . , φ(n−1) (t0 ) = xn0 . As in the case of systems of ﬁrst-order ordinary diﬀerential equations, we can point to several important special cases. Speciﬁcally, we consider equations of the form y (n) + an−1 (t)y (n−1) + · · · + a1 (t)y (1) + a0 (t)y = g(t),

(1.22)

where ai ∈ C(J, R), i = 0, 1, . . . , n − 1, and g ∈ C(J, R). We refer to (1.22) as a linear nonhomogeneous ordinary diﬀerential equation of order n. If in (1.22) we let g(t) ≡ 0, then y (n) + an−1 (t)y (n−1) + · · · + a1 (t)y (1) + a0 (t)y = 0.

(1.23)

We call (1.23) a linear homogeneous ordinary diﬀerential equation of order n. If in (1.23) we have ai (t) ≡ ai , i = 0, 1, . . . , n − 1, then y (n) + an−1 y (n−1) + · · · + a1 y (1) + a0 y = 0,

(1.24)

and we call (1.24) a linear, autonomous, homogeneous ordinary diﬀerential equation of order n. As in the case of systems of ﬁrst-order ordinary diﬀerential equations, we can deﬁne periodic and linear periodic ordinary diﬀerential equations of order n in the obvious way. It turns out that the theory of nth-order ordinary diﬀerential equations can be reduced to the theory of a system of n ﬁrst-order ordinary diﬀerential equations. To demonstrate this, we let y = x1 , y (1) = x2 , . . . , y (n−1) = xn in (1.21). We now obtain the system of ﬁrst-order ordinary diﬀerential equations x˙ 1 = x2 x˙ 2 = x3 .. .

(1.25)

x˙ n = h(t, x1 , . . . , xn ) that is deﬁned for all (t, x1 , . . . , xn ) ∈ D. Assume that φ = (φ1 , . . . , φn )T is a (n−1) , solution of (1.25) on an interval J. Since φ2 = φ˙ 1 , φ3 = φ˙ 2 , . . . , φn = φ1 and since (1)

(n−1)

h(t, φ1 (t), . . . , φn (t)) = h(t, φ1 (t), φ1 (t), . . . , φ1 =

(t))

(n) φ1 (t),

it follows that the ﬁrst component φ1 of the vector φ is a solution of (1.20) on the interval J. Conversely, if φ1 is a solution of (1.20) on J, then the vector (φ, φ(1) , . . . , φ(n−1) )T is clearly a solution of (1.25). More(n−1) over, if φ1 (t0 ) = x10 , . . . , φ1 (t0 ) = xn0 , then the vector φ satisﬁes T φ(t0 ) = x0 = (x10 , . . . , xn0 ) .

1.4 Examples of Initial-Value Problems

13

1.4 Examples of Initial-Value Problems We now give several speciﬁc examples of initial-value problems. Example 1.1. The mechanical system of Figure 1.2 consists of two point masses M1 and M2 that are acted upon by viscous damping forces (determined by viscous damping constants B, B1 , and B2 ), spring forces (speciﬁed by the spring constants K, K1 , and K2 ), and external forces f1 and f2 . The initial displacements of M1 and M2 at t0 = 0 are given by y1 (0) and y2 (0), respectively, and their initial velocities are given by y˙1 (0) and y˙ 2 (0). The arrows in Figure 1.2 indicate positive directions of displacement for M1 and M2 .

Figure 1.2. An example of a mechanical circuit

Newton’s second law yields the following coupled second-order ordinary diﬀerential equations that describe the motions of the masses in Figure 1.2 (letting y (2) = d2 y/dt2 = y¨), M1 y¨1 + (B + B1 )y˙1 + (K + K1 )y1 − B y˙ 2 − Ky2 = f1 (t) M2 y¨2 + (B + B2 )y˙2 + (K + K2 )y2 − B1 y˙ 1 − Ky1 = −f2 (t)

(1.26)

with initial data y1 (0), y2 (0), y˙ 1 (0), and y˙ 2 (0). Letting x1 = y1 , x2 = y˙ 1 , x3 = y2 , and x4 = y˙ 2 , we can express (1.26) equivalently by the system of ﬁrst-order ordinary diﬀerential equations ⎤⎡ ⎤ ⎡ ⎤ ⎡ 0 1 0 0 x1 x˙ 1 −(K1 +K) −(B1 +B) ⎥⎢ ⎥ K B ⎢ x˙ 2 ⎥ ⎢ x ⎥ ⎢ 2⎥ M1 M1 M1 M1 ⎢ ⎥=⎢ ⎥⎢ ⎣ x˙ 3 ⎦ ⎣ 0 0 0 1 ⎦ ⎣ x3 ⎦ −(K+K2 ) −(B+B2 ) K B x˙ 4 x4 M2 M2 M2 M2 ⎤ ⎡ 0 ⎢ M1 f1 (t) ⎥ 1 ⎥ +⎢ (1.27) ⎦ ⎣ 0 −1 M2 f2 (t) with initial data given by x(0) = (x1 (0), x2 (0), x3 (0), x4 (0))T .

14

1 System Models, Diﬀerential Equations, and Initial-Value Problems

Example 1.2. Using the node voltages v1 , v2 , and v3 and applying Kirchhoﬀ’s current law, we can describe the behavior of the electric circuit given in Figure 1.3 by the system of ﬁrst-order ordinary diﬀerential equations ⎤ ⎡ ⎡ ⎤ ⎡ ⎤ ⎡ v ⎤ 1 1 1 1 + 0 − v˙ 1 R2 R1 C1 R2 C1 ⎥ v1 ⎢ C1 R1 ⎣v˙ 2 ⎦ = ⎢− 1 R2 R2 ⎥ ⎣v2 ⎦ + ⎣ v ⎦ . (1.28) 1 1 1 − + − R1 C1 ⎣ C1 R1 R2 L R2 C1 L ⎦ v˙ 3 v3 0 1 1 − 0 R2 C2

R2 C2

To complete the description of this circuit, we specify the initial data at t0 = 0, given by v1 (0), v2 (0), and v3 (0).

+ v –

v1

R1

v2

R2

C1

L v3 C2

Figure 1.3. An example of an electric circuit

Example 1.3. Figure 1.4 represents a simpliﬁed model of an armature voltagecontrolled dc servomotor consisting of a stationary ﬁeld and a rotating armature and load. We assume that all eﬀects of the ﬁeld are negligible in the description of this system. The various parameters and variables in Figure 1.4 are ea = externally applied armature voltage, ia = armature current, Ra = resistance of the armature winding, La = armature winding inductance, em = back-emf voltage induced by the rotating armature winding, B = viscous damping due to bearing friction, J = moment of inertia of the armature and load, and θ = shaft position. The back-emf voltage (with the polarity as shown) is given by ˙ (1.29) em = Kθ θ, where Kθ > 0 is a constant, and the torque T generated by the motor is given by (1.30) T = K T ia . Application of Newton’s second law and Kirchhoﬀ’s voltage law yields J θ¨ + B θ˙ = T (t) and

(1.31)

1.4 Examples of Initial-Value Problems

15

Figure 1.4. An example of an electro-mechanical system circuit

La

dia + Ra ia + em = ea . dt

(1.32)

˙ and x3 = ia yields the Combining (1.29) to (1.32) and letting x1 = θ, x2 = θ, system of ﬁrst-order ordinary diﬀerential equations ⎤⎡ ⎤ ⎡ ⎤ ⎡ ⎤ ⎡ 0 1 0 x1 0 x˙ 1 ⎣x˙ 2 ⎦ = ⎣0 −B/J KT /J ⎦ ⎣x2 ⎦ + ⎣ 0 ⎦ . (1.33) 0 −Kθ /La −Ra /La x˙ 3 x3 ea /La A suitable set of initial data for (1.33) is given by t0 ˙ (x1 (0), x2 (0), x3 (0))T = (θ(0), θ(0), ia (0))T .

=

0 and

Example 1.4. A much studied ordinary diﬀerential equation is given by x ¨ + f (x)x˙ + g(x) = 0,

(1.34)

where f ∈ C 1 (R, R) and g ∈ C 1 (R, R). When f (x) ≥ 0 for all x ∈ R and xg(x) > 0 for all x = 0, then (1.34) is called the Lienard Equation. This equation can be used to represent, e.g., RLC circuits with nonlinear circuit elements. Another important special case of (1.34) is the van der Pol Equation given by (1.35) x ¨ − (1 − x2 )x˙ + x = 0, where > 0 is a parameter. This equation has been used to represent certain electronic oscillators. If in (1.34), f (x) ≡ 0, we obtain

16

1 System Models, Diﬀerential Equations, and Initial-Value Problems

x¨ + g(x) = 0.

(1.36)

When xg(x) > 0 for all x = 0, then (1.36) represents various models of socalled “mass on a nonlinear spring.” In particular, if g(x) = k(1 + a2 x2 )x, where k > 0 and a2 > 0 are parameters, then g represents the restoring force of a hard spring. If g(x) = k(1 − a2 x2 )x, where k > 0 and a2 > 0 are parameters, then g represents the restoring force of a soft spring. Finally, if g(x) = kx, then g represents the restoring force of a linear spring. (See Figures 1.5 and 1.6.)

Figure 1.5. Mass on a nonlinear spring

Figure 1.6. Mass on a nonlinear spring

For another special case of (1.34), let f (x) ≡ 0 and g(x) = k sin x, where k > 0 is a parameter. Then (1.34) assumes the form x¨ + k sin x = 0.

(1.37)

This equation describes the motion of a point mass moving in a circular path about the axis of rotation normal to a constant gravitational ﬁeld, as shown in Figure 1.7. The parameter k depends on the radius l of the circular path, the

1.5 Existence, Uniqueness, and Dependence on Parameters of Solutions

17

gravitational acceleration g, and the mass. The symbol x denotes the angle of deﬂection measured from the vertical. The present model is called a simple pendulum.

Figure 1.7. Model of a simple pendulum

Letting x1 = x and x2 = x, ˙ the second-order ordinary diﬀerential equation (1.34) can be represented by the system of ﬁrst-order ordinary diﬀerential equations given by x˙ 1 = x2 , x˙ 2 = −f (x1 )x2 − g(x1 ).

(1.38)

The required initial data for (1.38) are given by x1 (0) and x2 (0).

1.5 Solutions of Initial-Value Problems: Existence, Continuation, Uniqueness, and Continuous Dependence on Parameters The following examples demonstrate that it is necessary to impose restrictions on the right-hand side of equation (1.11) to ensure the existence and uniqueness of solutions of the initial-value problem (1.12). Example 1.5. For the initial-value problem, x˙ = g(x),

x(0) = 0,

(1.39)

18

1 System Models, Diﬀerential Equations, and Initial-Value Problems

where x ∈ R, and

g(x) =

1, x = 0, 0, x = 0,

there exists no diﬀerentiable function φ that satisﬁes (1.39). Hence, no solution exists for this initial-value problem (in the sense deﬁned in this chapter).

Example 1.6. The initial-value problem x˙ = x1/3 ,

x(t0 ) = 0,

(1.40)

where x ∈ R, has at least two solutions given by φ1 (t) = [ 23 (t − t0 )]3/2 and φ2 (t) = 0 for t ≥ t0 . Example 1.7. The initial-value problem x˙ = ax,

x(t0 ) = x0 ,

(1.41)

where x ∈ R, has a unique solution given by φ(t) = ea(t−t0 ) x(t0 ) for t ≥ t0 . The following result provides a set of suﬃcient conditions for the existence of solutions of initial-value problem (1.12). Theorem 1.8. Let f ∈ C(D, Rn ). Then for any (t0 , x0 ) ∈ D, the initial-value problem (1.12) has a solution deﬁned on [t0 , t0 + c) for some c > 0. For a proof of Theorem 1.8, which is called the Cauchy–Peano Existence Theorem, refer to [1, Section 1.6]. The next result provides a set of suﬃcient conditions for the uniqueness of solutions for the initial-value problem (1.12). Theorem 1.9. Let f ∈ C(D, Rn ). Assume that for every compact set K ⊂ D, f satisﬁes the Lipschitz condition f (t, x) − f (t, y) ≤ LK x − y

(1.42)

for all (t, x), (t, y) ∈ K where LK > 0 is a constant depending only on K. Then (1.12) has at most one solution on any interval [t0 , t0 + c), c > 0. For a proof of Theorem 1.9, refer to [1, Section 1.8]. In particular, if f ∈ C 1 (D, Rn ), then the local Lipschitz condition (1.42) is automatically satisﬁed. Now let φ be a solution of (1.11) on an interval J. By a continuation or extension of φ, we mean an extension φ0 of φ to a larger interval J0 in such a way that the extension solves (1.11) on J0 . Then φ is said to be continued or extended to the larger interval J0 . When no such continuation is possible, then φ is called noncontinuable.

1.5 Existence, Uniqueness, and Dependence on Parameters of Solutions

19

Example 1.10. The scalar diﬀerential equation x˙ = x2

(1.43)

1 deﬁned on J = (−1, 1). This solution is continuable has a solution φ(t) = 1−t to the left to −∞ and is not continuable to the right.

Example 1.11. The diﬀerential equation x˙ = x1/3 ,

(1.44)

where x ∈ R, has a solution ψ(t) ≡ 0 on J = (−∞, 0). This solution is continuable to the right in more than one way. For example, both ψ1 (t) ≡ 0 3/2 and ψ2 (t) = ( 2t are solutions of (1.44) for t ≥ 0. 3) In the next result, ∂D denotes the boundary of a domain D and ∂J denotes the boundary of an interval J. Theorem 1.12. If f ∈ C(D, Rn ) and if φ is a solution of (1.11) on an open interval J, then φ can be continued to a maximal open interval J ∗ ⊃ J in such a way that (t, φ(t)) tends to ∂D as t → ∂J ∗ when ∂D is not empty and |t| + |φ(t)| → ∞ if ∂D is empty. The extended solution φ∗ on J ∗ is noncontinuable. For a proof of Theorem 1.12, refer to [1, Section 1.7]. When D = J ×Rn for some open interval J and f satisﬁes a Lipschitz condition there (with respect to x), we have the following very useful continuation result. Theorem 1.13. Let f ∈ C(J × Rn , Rn ) for some open interval J ⊂ R and let f satisfy a Lipschitz condition on J × Rn (with respect to x). Then for any (t0 , x0 ) ∈ J × Rn , the initial-value problem (1.12) has a unique solution that exists on the entire interval J. For a proof of Theorem 1.13, refer to [1, Section 1.8]. In the next result we address initial-value problems that exhibit dependence on some parameter λ ∈ G ⊂ Rm given by x˙ = f (t, x, λ), x(τ ) = ξλ ,

(1.45)

where f ∈ C(J × Rn × G, Rn ), J ⊂ R is an open interval, and ξλ depends continuously on λ.

20

1 System Models, Diﬀerential Equations, and Initial-Value Problems

Theorem 1.14. Let f ∈ C(J × Rn × G, Rn ), where J ⊂ R is an open interval and G ⊂ Rm . Assume that for each pair of compact subsets J0 ⊂ J and G0 ⊂ G, there exists a constant L = LJ0 ,G0 > 0 such that for all (t, λ) ∈ J0 × G0 , x, y ∈ Rn , the Lipschitz condition f (t, x, λ) − f (t, y, λ) ≤ L x − y

(1.46)

is true. Then the initial-value problem (1.45) has a unique solution φ(t, τ, λ), where φ ∈ C(J × J × G, Rn ). Furthermore, if D is a set such that for all λ0 ∈ D there exists > 0 such that [λ0 − , λ0 + ] ∩ D ⊂ D, then φ(t, τ, λ) → φ(t, τ0 , λ0 ) uniformly for t0 ∈ J0 as (τ, λ) → (τ0 , λ0 ), where J0 is any compact subset of J. (Recall that the upper bar denotes closure of a set.) For a proof of Theorem 1.14, refer to [1, Section 1.9]. Note that Theorem 1.14 applies in the case of Example 1.7 and that the solution φ(t) of (1.41) depends continuously on the parameter a and the initial conditions x(t0 ) = x0 . When Theorem 1.9 is satisﬁed, it is possible to approximate the unique solutions of the initial-value problem (1.12) arbitrarily closely, using the method of successive approximations (also known as Picard iterations). Let f ∈ C(D, Rn ), let K ⊂ D be a compact set, and let (t0 , x0 ) ∈ K. Successive approximations for (1.12), or equivalently for (1.13), are deﬁned as φ0 (t) = x0 ,

t

φm+1 (t) = x0 +

f (s, φm (s))ds,

m = 0, 1, 2, . . .

(1.47)

t0

for t0 ≤ t ≤ t0 + c, for some c > 0. Theorem 1.15. If f ∈ C(D, Rn ) and if f is Lipschitz continuous on some compact set K ⊂ D with constant L (with respect to x), then the successive approximations φm , m = 0, 1, 2, . . . given in (1.47) exist on [t0 , t0 + c], are continuous there, and converge uniformly, as m → ∞, to the unique solution φ of (1.12). (Thus, for every > 0 there exists N = N () such that for all t ∈ [t0 , t0 + c], φ(t) − φm (t) < whenever m > N ().) For the proof of Theorem 1.15, refer to [1, Section 1.8].

1.6 Systems of Linear First-Order Ordinary Diﬀerential Equations In this section we will address linear ordinary diﬀerential equations of the form x˙ = A(t)x + g(t) (1.48) and

1.6 Systems of Linear First-Order Ordinary Diﬀerential Equations

21

x˙ = A(t)x

(1.49)

x˙ = Ax + g(t)

(1.50)

x˙ = Ax,

(1.51)

and and where x ∈ Rn , A(t) = [aij (t)] ∈ C(R, Rn×n ), g ∈ C(R, Rn ), and A ∈ Rn×n . Linear equations of the type enumerated above may arise in a natural manner in the modeling process of physical systems (see Section 1.4 for speciﬁc examples) or in the process of linearizing equations of the form (1.11) or (1.14) or some other kind of form. 1.6.1 Linearization We consider the system of ﬁrst-order ordinary diﬀerential equations given by x˙ = f (t, x),

(1.52)

where f : R × D → Rn and D ⊂ Rn is some domain. Linearization About a Solution φ If f ∈ C 1 (R × D, Rn ) and if φ is a given solution of (1.52) deﬁned for all t ∈ R, then we can linearize (1.52) about φ in the following manner. Deﬁne δx = x − φ(t) so that d(δx) δ x˙ = f (t, x) − f (t, φ(t)) dt = f (t, δx + φ(t)) − f (t, φ(t)) ∂f (t, φ(t))δx + F (t, δx), = ∂x

(1.53)

T where ∂f ∂x (t, x) denotes the Jacobian matrix of f (t, x) = (f1 (t, x), . . . , fn (t, x)) T with respect to x = (x1 , . . . , xn ) ; i.e.,

⎡

∂f1 ∂x1 (t, x)

···

∂f ⎢ .. (t, x) = ⎣ . ∂x ∂fn (t, x) · · · ∂x1

⎤ ∂f1 ∂xn (t, x) ⎥ .. ⎦ . ∂fn (t, x) ∂xn

and

(1.54)

∂f (t, φ(t))δx. (1.55) ∂x It turns out that F (t, δx) is o( δx ) as δx → 0 uniformly in t on compact subsets of R; i.e., for any compact subset I ⊂ R, we have F (t, δx) [f (t, δx + φ(t)) − f (t, φ(t)] −

22

1 System Models, Diﬀerential Equations, and Initial-Value Problems

F (t, δx) sup = 0. δx δx→0 t∈I lim

For a proof of this assertion, we refer the reader to [1, Section 1.11]. Letting ∂f (t, φ(t)) = A(t), ∂x we obtain from (1.53) the equation d(δx) δ x˙ = A(t)δx + F (t, δx). dt

(1.56)

Associated with (1.56) we have the linear diﬀerential equation z˙ = A(t)z,

(1.57)

called the linearized equation of (1.52) about the solution φ. In applications, the linearization (1.57) of (1.52), about a given solution φ, is frequently used as a means of approximating a nonlinear process by a linear one (in the vicinity of φ). In Chapter 4, where we will study the stability properties of equilibria of (1.52) [which are speciﬁc kinds of solutions of (1.52)], we will show under what conditions it makes sense to deduce qualitative properties of a nonlinear process from its linearization. Of special interest is the case when in (1.52), f is independent of t, i.e., x˙ = f (x)

(1.58)

and φ is a constant solution of (1.58), say, φ(t) = x0 for all t ∈ R. Under these conditions we have d(δx) δ x˙ = Aδx + F (δx), (1.59) dt where F (δx) lim =0 (1.60) δx δx→0 and A denotes the Jacobian ∂f ∂x (x0 ). Again, associated with (1.59) we have the linear diﬀerential equation z˙ = Az, called the linearized equation of (1.58) about the solution φ(t) ≡ x0 . Linearization About a Solution φ and an Input ψ We can generalize the above to equations of the form x˙ = f (t, x, u),

(1.61)

1.6 Systems of Linear First-Order Ordinary Diﬀerential Equations

23

where f : R × D1 × D2 → Rn and D1 ⊂ Rn , D2 ⊂ Rm are some domains. If f ∈ C 1 (R × D1 × D2 , Rn ) and if φ(t) is a given solution of (1.61) that we assume to exist for all t ∈ R and that is determined by the initial condition x0 and the given speciﬁc function ψ ∈ C(R, Rm ), i.e., ˙ = f (t, φ(t), ψ(t)), φ(t)

t ∈ R,

then we can linearize (1.61) in the following manner. Deﬁne δx = x − φ(t) and δu = u − ψ(t). Then d(δx) ˙ = f (t, x, u) − f (t, φ(t), ψ(t)) = δ x˙ = x˙ − φ(t) dt = f (t, δx + φ(t), δu + ψ(t)) − f (t, φ(t), ψ(t)) ∂f ∂f (t, φ(t), ψ(t))δx + (t, φ(t), ψ(t))δu = ∂x ∂u + F1 (t, δx, u) + F2 (t, δu),

(1.62)

where F1 (t, δx, u) = f (t, δx + φ(t), u) − f (t, φ(t), u) −

∂f (t, φ(t), ψ(t))δx ∂x

is o(||δx||) as δx → 0, uniformly in t on compact subsets of R for ﬁxed u [i.e., for ﬁxed u and for any compact subset I ⊂ R, lim supt∈I F1 (t,δx,u) = δx δx→0

0], where F2 (t, δu) = f (t, φ(t), δu + ψ(t)) − f (t, φ(t), ψ(t)) −

∂f (t, φ(t), ψ(t))δu ∂u

is o( δu ) as δu → 0, uniformly in t on compact subsets of R [i.e., for any (t,δu) compact subset I ⊂ R, limδu→0 supt∈I F2δu = 0], and where ∂f ∂x (·) and ∂f ∂u (·) denote the Jacobian matrix of f with respect to x and the Jacobian matrix of f with respect to u, respectively. Letting ∂f ∂f (t, φ(t), ψ(t)) = A(t) and (t, φ(t), ψ(t)) = B(t), ∂x ∂u we obtain from (1.62), d(δx) = δ x˙ = A(t)δx + B(t)δu + F1 (t, δx, u) + F2 (t, δu). dt

(1.63)

Associated with (1.63), we have z˙ = A(t)z + B(t)v.

(1.64)

We call (1.64) the linearized equation of (1.61) about the solution φ and the input function ψ.

24

1 System Models, Diﬀerential Equations, and Initial-Value Problems

As in the case of the linearization of (1.52) by (1.49), the linearization (1.64) of system (1.61) about a given solution φ and a given input ψ is often used in attempting to capture the qualitative properties of a nonlinear process by a linear process (in the vicinity of φ and ψ). In doing so, great care must be exercised to avoid erroneous conclusions. The motivation of linearization is of course very obvious: much more is known about linear ordinary diﬀerential equations than about nonlinear ones. For example, the explicit forms of the solutions of (1.51) and (1.50) are known; the structures of the solutions of (1.49), (1.48), and (1.64) are known; the qualitative properties of the solutions of linear equations are known; and so forth. 1.6.2 Examples We now consider some speciﬁc cases. Example 1.16. We consider the simple pendulum discussed in Example 1.4 and described by the equation x¨ + k sin x = 0,

(1.65)

where k > 0 is a constant. Letting x1 = x and x2 = x, ˙ (1.65) can be expressed as x˙ 1 = x2 , x˙ 2 = −k sin x1 .

(1.66)

It is easily veriﬁed that φ1 (t) ≡ 0 and φ2 (t) ≡ 0 is a solution of (1.66). Letting f1 (x1 , x2 ) = x2 and f2 (x1 , x2 ) = −k sin x1 , the Jacobian of f (x1 , x2 ) = (f1 (x1 , x2 ), f2 (x1 , x2 ))T evaluated at (x1 , x2 )T = (0, 0)T is given by 0 1 0 1 J(0) A = = . −k cos x1 0 x1 =0 −k 0 x2 =0

The linearized equation of (1.66) about the solution φ1 (t) ≡ 0, φ2 (t) ≡ 0 is given by 0 1 z1 z˙1 = . z˙2 z2 −k 0 Example 1.17. The system of equations x˙ 1 = ax1 − bx1 x2 − cx21 , x˙ 2 = dx2 − ex1 x2 − f x22

(1.67)

1.6 Systems of Linear First-Order Ordinary Diﬀerential Equations

25

describes the growth of two competing species (e.g., two species of small ﬁsh) that prey on each other (e.g., the adult members of one species prey on the young members of the other species, and vice versa). In (1.67) a, b, c, d, e, and f are positive parameters and it is assumed that x1 ≥ 0 and x2 ≥ 0. For (1.67), φ1 (t) = φ1 (t, 0, 0) ≡ 0 and φ2 (t) = φ2 (t, 0, 0) ≡ 0, t ≥ 0, is a solution of (1.67). A simple computation yields ∂f a0 (0) = , A= 0d ∂x and thus the system of equations z˙1 a0 z1 = z˙2 z2 0d constitutes the linearized equation of (1.67) about the solution φ1 (t) = 0, φ2 (t) = 0, t ≥ 0. Example 1.18. Consider a unit mass subjected to an inverse square law force ﬁeld, as depicted in Figure 1.8. In this ﬁgure, r denotes radius and θ denotes angle, and it is assumed that the unit mass (representing, e.g., a satellite) can thrust in the radial and in the tangential directions with thrusts u1 and u2 , respectively. The equations that govern this system are given by k + u1 , r2 1 −2θ˙r˙ + u2 . θ¨ = r r r¨ = rθ˙2 −

(1.68)

u1 m=1 r θ

u2

Figure 1.8. A unit mass subjected to an inverse square law force ﬁeld

˙ When r(0) = r0 , r(0) ˙ = 0, θ(0) = θ0 , θ(0) = ω0 , and u1 (t) ≡ 0, u2 (t) ≡ 0 for t ≥ 0, it is easily veriﬁed that the system of equations (1.68) has as a solution the circular orbit given by

26

1 System Models, Diﬀerential Equations, and Initial-Value Problems

r(t) ≡ r0 = constant, ˙ = ω0 = constant θ(t)

(1.69)

for all t ≥ 0, which implies that θ(t) = ω0 t + θ0 ,

(1.70)

where ω0 = (k/r03 )1/2 . ˙ the equations of motion If we let x1 = r, x2 = r, ˙ x3 = θ, and x4 = θ, (1.68) assume the form x˙ 1 = x2 , x˙ 2 = x1 x24 −

k + u1 , x21

x˙ 3 = x4 , 2x2 x4 u2 x˙ 4 = − + . x1 x1

(1.71)

The linearized equation of (1.71) about the solution (1.70) [with u1 (t) ≡ 0, u2 (t) ≡ 0] is given by ⎤ ⎡ ⎤ ⎡ ⎤⎡ ⎤ ⎡ 0 1 0 0 0 0 z˙1 z1 ⎢ z˙2 ⎥ ⎢ 3ω02 0 0 2r0 ω0 ⎥ ⎢ z2 ⎥ ⎢ 1 0 ⎥ v1 ⎥ ⎢ ⎥=⎢ ⎥⎢ ⎥ + ⎢ . ⎣ z˙3 ⎦ ⎣ 0 0 0 1 ⎦ ⎣ z3 ⎦ ⎣ 0 0 ⎦ v2 0 0 r10 0 0 −2ω z˙4 z4 r0 0 Example 1.19. In this example we consider systems described by equations of the form x˙ + Af (x) + Bg(x) = u, (1.72) where x ∈ Rn , A = [aij ] ∈ Rn×n , B = [bij ] ∈ Rn×n with aii > 0, bii > 0, 1 ≤ i ≤ n, f, g ∈ C 1 (Rn , Rn ), u ∈ C(R+ , Rn ), and f (x) = 0, g(x) = 0 if and only if x = 0. Equation (1.72) can be used to model a great variety of physical systems. In particular, (1.72) has been used to model a large class of integrated circuits consisting of (nonlinear) transistors and diodes, (linear) capacitors and resistors, and current and voltage sources. (Figure 1.9 gives a symbolic representation of such circuits.) For such circuits, we assume that f (x) = [f1 (x1 ), . . . , fn (xn )]T . If u(t) = 0 for all t ≥ 0, then φi (t) = 0, t ≥ 0, 1 ≤ i ≤ n, is a solution of (1.72). The system of equations (1.72) can be expressed equivalently as x˙ i = −

n j=1

fj (xj ) gj (xj ) + bij aij xj + ui , xj xj

(1.73)

1.7 Existence, Uniqueness, Continuation, and Continuity of Solutions

27

Figure 1.9. Integrated circuit

i = 1, . . . , n. The linearized equation of (1.73) about the solution φi (t) = 0, and the input ui (t) = 0, t ≥ 0, i = 1, . . . , n, is given by z˙i = −

n aij fj (0) + bij gj (0) zj + vi ,

(1.74)

j=1

where fj (0) =

dfj dxj (0)

and gj (0) =

dgj dxj (0), i

= 1, . . . , n.

1.7 Linear Systems: Existence, Uniqueness, Continuation, and Continuity with Respect to Parameters of Solutions In this section we address nonhomogeneous systems of ﬁrst-order ordinary diﬀerential equations given by x˙ = A(t)x + g(t),

(1.75)

where x ∈ Rn , A(t) = [aij (t)] is a real n × n matrix and g is a real n-vectorvalued function. Theorem 1.20. Suppose that A ∈ C(J, Rn×n ) and g ∈ C(J, Rn ), where J is some open interval. Then for any t0 ∈ J and any x0 ∈ Rn , equation (1.75) has a unique solution satisfying x(t0 ) = x0 . This solution exists on the entire interval J and is continuous in (t, t0 , x0 ). Proof. The function f (t, x) = A(t)x + g(t) is continuous in (t, x), and moreover, for any compact subinterval J0 ⊂ J, there is an L0 ≥ 0 such that f (t, x) − f (t, y) 1 = A(t)(x − y) 1 ≤ A(t) 1 x − y 1 n ≤ max |aij (t)| x − y 1 ≤ L0 x − y 1 i=1

1≤j≤n

for all (t, x), (t, y) ∈ J0 ×Rn , where L0 is deﬁned in the obvious way. Therefore, f satisﬁes a Lipschitz condition on J0 × Rn .

28

1 System Models, Diﬀerential Equations, and Initial-Value Problems

If (t0 , x0 ) ∈ J0 × Rn , then the continuity of f implies the existence of solutions (Theorem 1.8), whereas the Lipschitz condition implies the uniqueness of solutions (Theorem 1.9). These solutions exist for the entire interval J0 (Theorem 1.13). Since this argument holds for any compact subinterval J0 ⊂ J, the solutions exist and are unique for all t ∈ J. Furthermore, the solutions are continuous with respect to t0 and x0 (Theorem 1.14 modiﬁed for the case where A and g do not depend on any parameters λ). For the case when in (1.75) the matrix A and the vector g depend continuously on parameters λ and μ, respectively, it is possible to modify Theorem 1.20, and its proof, in the obvious way to show that the unique solutions of the system of equations x˙ = A(t, λ)x + g(t, μ)

(1.76)

are continuous in λ and μ as well. [Assume that A ∈ C(J × Rl , Rn×n ) and g ∈ C(J × Rm , Rn ) and follow a procedure that is similar to the proof of Theorem 1.20.]

1.8 Solutions of Linear State Equations In this section we determine the speciﬁc form of the solutions of systems of linear ﬁrst-order ordinary diﬀerential equations. We will revisit this topic in much greater detail in Chapter 3. Homogeneous Equations We begin by considering linear homogeneous systems x˙ = A(t)x,

(1.77)

where A ∈ C(R, Rn×n ). By Theorem 1.20, for every x0 ∈ Rn , (1.77) has a unique solution that exists for all t ∈ R. We will now use Theorem 1.15 to derive an expression for the solution φ(t, t0 , x0 ) for (1.77) for t ∈ R with φ(t0 , t0 , x0 ) = x0 . In this case the successive approximations given in (1.47) assume the form φ0 (t, t0 , x0 ) = x0 ,

t

φ1 (t, t0 , x0 ) = x0 +

A(s)x0 ds, t0

t

φ2 (t, t0 , x0 ) = x0 + ···

A(s)φ1 (s, t0 , x0 )ds, t0

t

φm (t, t0 , x0 ) = x0 +

A(s)φm−1 (s, t0 , x0 )ds, t0

1.8 Solutions of Linear State Equations

29

or

t

φm (t, t0 , x0 ) = x0 +

A(s1 )x0 ds1 + t0

s1

A(s1 ) t0

sm−1

t0

t

s1

A(s1 )

+ t0

A(sm )x0 dsm · · · ds1

t0

t

t

= I+ A(s1 )ds1 + A(s1 )

A(s2 )x0 ds2 ds1 + · · ·

t0

A(s2 ) · · ·

t0

t0

s1

A(s1 ) t0

t

+

t

A(s2 )ds2 ds1 + · · ·

t0

sm−1

A(s2 ) · · ·

t0

s1

A(sm )dsm · · · ds1 x0 ,

t0

(1.78) where I denotes the n × n identity matrix. By Theorem 1.15, the sequence {φm }, m = 0, 1, 2, . . . determined by (1.78) converges uniformly, as m → ∞, to the unique solution φ(t, t0 , x0 ) of (1.77) on compact subsets of R. We thus have φ(t, t0 , x0 ) = Φ(t, t0 )x0 , (1.79) where

Φ(t, t0 ) = I +

t

A(s1 )ds1 + t0 t

+

t0

t

s1

+

A(s1 ) t0

A(s2 )ds2 ds1 t0

s2

A(s3 )ds3 ds2 ds1 + · · ·

A(s2 ) t0

s1

s1

A(s1 ) t0

A(s1 )

t

t0

sm−1

A(s2 ) . . . t0

A(sm )dsm dsm−1 · · · ds1 + · · · .

t0

(1.80) Expression (1.80) is called the Peano–Baker series. From expression (1.80) we immediately note that Φ(t, t) = I.

(1.81)

Furthermore, by diﬀerentiating expression (1.80) with respect to time andsubstituting into (1.77), we obtain that ˙ t0 ) = A(t)Φ(t, t0 ). Φ(t,

(1.82)

From (1.79) it is clear that once the initial data are speciﬁed and once the n × n matrix Φ(t, t0 ) is known, the entire behavior of system (1.77) evolving in time t is known. This has motivated the state terminology: x(t0 ) = x0 is the state of the system (1.77) at time t0 , φ(t, t0 , x0 ) is the state of the system (1.77) at time t, the solution φ is called the state vector of (1.77), the components of φ are called the state variables of (1.77), and the matrix Φ(t, t0 ) that maps x(t0 ) into φ(t, t0 , x0 ) is called the state transition matrix

30

1 System Models, Diﬀerential Equations, and Initial-Value Problems

for (1.77). Also, the vector space containing the state vectors is called the state space for (1.77). We can specialize the preceding discussion to linear systems of equations x˙ = Ax.

(1.83)

In this case the mth term in (1.80) assumes the form

t

t0

s1

A(s1 )

A(s2 ) t0

sm−1

A(s3 ) . . .

m

s2

t0 t s1

s2

=A

sm−1

... t0

t0

A(sm )dsm · · · ds1

t0

t0

1dsm · · · ds1 =

t0

Am (t − t0 )m , m!

and expression (1.78) for φm assumes now the form m Ak (t − t0 )k x0 . φm (t, t0 , x0 ) = I + k! k=1

We conclude once more from Theorem 1.15 that {φm } converges uniformly as m → ∞ to the unique solution φ(t, t0 , x0 ) of (1.83) on compact subsets of R. We have ∞ Ak (t − t0 )k x0 φ(t, t0 , x0 ) = I + k! k=1

= Φ(t, t0 )x0 Φ(t − t0 )x0 ,

(1.84)

where Φ(t − t0 ) denotes the state transition matrix for (1.83). [Note that by writing Φ(t, t0 ) = Φ(t − t0 ), we have used a slight abuse of notation.] By ∞ k making the analogy with the scalar ea = 1 + k=1 ak! , usage of the notation ∞ Ak e =I+ k! A

(1.85)

k=1

should be clear. We call eA a matrix exponential. In Chapter 3 we will explore several ways of determining eA for a given A. Nonhomogeneous Equations Next, we consider linear nonhomogeneous systems of ordinary diﬀerential equations x˙ = A(t)x + g(t), (1.86) where A ∈ C(R, Rn×n ) and g ∈ C(R, Rn ). Again, by Theorem 1.20, for every x0 ∈ Rn , (1.86) has a unique solution that exists for all t ∈ R. Instead of deriving the complete solution of (1.86) for a given set of initial data

1.8 Solutions of Linear State Equations

31

x(t0 ) = x0 , we will guess the solution and verify that it indeed satisﬁes (1.86). To this end, let us assume that the solution is of the form

t φ(t, t0 , x0 ) = Φ(t, t0 )x0 + Φ(t, s)g(s)ds, (1.87) t0

where Φ(t, t0 ) denotes the state transition matrix for (1.77). To show that (1.87) is indeed the solution of (1.86), we ﬁrst let t = t0 . In view of (1.81) and (1.87), we have φ(t0 , t0 , x0 ) = x0 . Next, by diﬀerentiating both sides of (1.87) and by using (1.81), (1.82), and (1.87), we have

t ˙ t0 , x0 ) = Φ(t, ˙ s)g(s)ds ˙ t0 )x0 + Φ(t, t)g(t) + Φ(t, φ(t,

t0 t

= A(t)Φ(t, t0 )x0 + g(t) +

A(t)Φ(t, s)g(s)ds t0

t

= A(t)[Φ(t, t0 )x0 +

Φ(t, s)g(s)ds] + g(t) t0

= A(t)φ(t, t0 , x0 ) + g(t); i.e., φ(t, t0 , x0 ) given in (1.87) satisﬁes (1.86). Therefore, φ(t, t0 , x0 ) is the unique solution of (1.86). Equation (1.87) is called the variation of constants formula, which is discussed further in Chapter 3. In the exercise section of Chapter 3 (refer to Exercise 3.13), we ask the reader (with hints) to derive the variation of constants formula (1.87), using a change of variables. We note that when x0 = 0, (1.87) reduces to

t φ(t, t0 , 0) φp (t) = Φ(t, s)g(s)ds (1.88) t0

and when x0 = 0 but g(t) = 0 for all t ∈ R, (1.87) reduces to φ(t, t0 , x0 ) φh (t) = Φ(t, t0 )x0 .

(1.89)

Therefore, the total solution of (1.86) may be viewed as consisting of a component that is due to the initial conditions (t0 , x0 ) and another component that is due to the forcing term g(t). This type of separation is in general possible only in linear systems of diﬀerential equations. We call φp a particular solution of the nonhomogeneous system (1.86) and φh the homogeneous solution. From (1.87) it is clear that for given initial conditions x(t0 ) = x0 and given forcing term g(t), the behavior of system (1.86), summarized by φ, is known for all t. Thus, φ(t, t0 , x0 ) speciﬁes the state vector of (1.86) at time t. The components φi of φ, i = 1, . . . , n, represent the state variables for (1.86), and the vector space that contains the state vectors is the state space for (1.86). Before closing this section, it should be pointed out that in applications the matrix A(t) and the vector g(t) in (1.86) may be only piecewise continuous rather than continuous, as assumed above [i.e., A(t) and g(t) may have

32

1 System Models, Diﬀerential Equations, and Initial-Value Problems

(at most) a ﬁnite number of discontinuities over any ﬁnite time interval]. In such cases, the derivative of x with respect to t [i.e., the right-hand side in (1.86)] will be discontinuous at a ﬁnite number of instants over any ﬁnite time interval; however, the state itself, x, will still be continuous at these instants [i.e., the solutions of (1.86) will still be continuous over R]. In such cases, all the results presented concerning existence, uniqueness, continuation of solutions, and so forth, as well as the explicit expressions of solutions of (1.86), are either still valid or can be modiﬁed in the obvious way. For example, should g(t) experience a discontinuity at, say, t1 > t0 , then expression (1.87) will be modiﬁed to read as follows:

t Φ(t, s)g(s)ds, t0 ≤ t < t1 , (1.90) φ(t, t0 , x0 ) = Φ(t, t0 )x0 + t0 t

φ(t, t1 , x1 ) = Φ(t, t1 )x1 +

Φ(t, s)g(s)ds,

t ≥ t1 ,

(1.91)

t1

where x1 = limt→t− φ(t, t0 , x0 ). 1

1.9 Summary and Highlights •

Initial-value problem x˙ = f (t, x), or

x(t0 ) = x0

(1.12)

f (s, φ(s))ds,

(1.13)

t

φ(t) = x0 + t0

•

where φ(t) is a solution of (1.12). Successive approximations φ0 (t) = x0 ,

t

φm+1 (t) = x0 +

f (s, φm (s))ds,

m = 0, 1, 2, . . . .

(1.47)

t0

•

Under certain conditions (see Theorem 1.15) φm , m = 1, 2, converges uniformly (on compact sets) as m → ∞ to the unique solution of (1.12). Linearization Given is x˙ = f (t, x) and a solution φ. The Jacobian matrix is ⎤ ⎡ ∂f1 ∂f1 ∂x1 (t, x) · · · ∂xn (t, x) ∂f ⎥ ⎢ .. .. (t, x) = ⎣ (1.54) ⎦. . . ∂x ∂fn ∂fn ∂x1 (t, x) · · · ∂xn (t, x) For A(t) =

∂f ∂x (t, φ(t)),

z˙ = A(t)z is the linearized equation about the solution φ.

(1.57)

References

•

•

33

Existence and uniqueness of solutions of x˙ = A(t)x + g(t).

(1.75)

x˙ = A(t)x + g(t),

(1.86)

See Theorem 1.20. The solution of with x(t0 ) = x0 , is given by the variation of constants formula

t φ(t, t0 , x0 ) = Φ(t, t0 )x0 + Φ(t, s)g(s)ds,

(1.87)

t0

where the state transition matrix Φ(t, t0 ) is given by

t

t

s1 Φ(t, t0 ) = I + A(s1 )ds1 + A(s1 ) A(s2 )ds2 ds1 + · · · t0

•

t0

the Peano–Baker series. In the time-invariant case x˙ = Ax, φ(t, t0 , x0 ) = I +

(1.80)

t0

∞ Ak (t − t0 )k

k!

k=1

x0

= Φ(t, t0 )x0 Φ(t − t0 )x0

(1.84)

= eA(t−t0 ) x0 , where eA = I +

∞ Ak k=1

k!

.

(1.85)

1.10 Notes For a classic reference on ordinary diﬀerential equations, see Coddington and Levinson [3]. Other excellent sources include Brauer and Nohel [2], Hartman [4], and Simmons [7]. Our treatment of ordinary diﬀerential equations in this chapter was greatly inﬂuenced by Miller and Michel [6].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. F. Brauer and J.A. Nohel, Qualitative Theory of Ordinary Diﬀerential Equations, Benjamin, New York, NY, 1969. 3. E.A. Coddington and N. Levinson, Theory of Ordinary Diﬀerential Equations, McGraw-Hill, New York, NY, 1955.

34

1 System Models, Diﬀerential Equations, and Initial-Value Problems

4. P. Hartman, Ordinary Diﬀerential Equations, Wiley, New York, NY, 1964. 5. A.N. Michel, K. Wang, and B. Hu, Qualitative Theory of Dynamical Systems, 2nd Edition, Marcel Dekker, New York, NY, 2001. 6. R.K. Miller and A.N. Michel, Ordinary Diﬀerential Equations, Academic Press, New York, NY, 1982. 7. G.F. Simmons, Diﬀerential Equations, McGraw-Hill, New York, NY, 1972.

Exercises 1.1. (Hamiltonian dynamical systems) Conservative dynamical systems, also called Hamiltonian dynamical systems, are those systems that contain no energy-dissipating elements. Such systems with n degrees of freedom can be characterized by means of a Hamiltonian function H(p, q), where q T = (q1 , . . . , qn ) denotes n generalized position coordinates and pT = (p1 , . . . , pn ) denotes n generalized momentum coordinates. We assume that H(p, q) is of the form H(p, q) = T (q, q) ˙ + W (q), (1.92) where T denotes the kinetic energy and W denotes the potential energy of the system. These energy terms are obtained from the path-independent line integrals

q˙

T (q, q) ˙ =

0

q

f (η)T dη =

W (q) = 0

q˙

p(q, ξ)T dξ =

n

pi (q, ξ)dξi ,

i=1 n q

fi (η)dηi ,

0

(1.93)

0

(1.94)

i=1

where fi , i = 1, . . . , n, denote generalized potential forces. For the integral (1.93) to be path-independent, it is necessary and suﬃcient that ˙ ˙ ∂pj (q, q) ∂pi (q, q) = , i, j = 1, . . . , n. (1.95) ∂ q˙j ∂ q˙i A similar statement can be made about (1.94). Conservative dynamical systems are described by the system of 2n ordinary diﬀerential equations ∂H (p, q), i = 1, . . . , n, ∂pi ∂H p˙ i = − (p, q), i = 1, . . . , n. ∂qi q˙i =

(1.96)

Note that if we compute the derivative of H(p, q) with respect to t for (1.96) [along the solutions qi (t), pi (t), i = 1, . . . , n], then we obtain, by the chain rule,

Exercises

35

∂H ∂H dH (p(t), q(t)) = (p, q)p˙i + (p, q)q˙i dt ∂pi ∂qi i=1 i=1 n

=

n

n i=1

=−

∂H ∂H ∂H ∂H (p, q) (p, q) + (p, q) (p, q) ∂pi ∂qi ∂qi ∂pi i=1 n

−

n ∂H i=1

∂pi

(p, q)

n ∂H ∂H ∂H (p, q) + (p, q) (p, q) ≡ 0. ∂qi ∂p ∂qi i i=1

In other words, in a conservative system (1.96), the Hamiltonian, i.e., the total energy, will be constant along the solutions (1.96). This constant is determined by the initial data (p(0), q(0)). (a) In Figure 1.10, M1 and M2 denote point masses; K1 , K2 , K denote spring constants; and x1 , x2 denote the displacements of the masses M1 and M2 . Use the Hamiltonian formulation of dynamical systems described above to derive a system of ﬁrst-order ordinary diﬀerential equations that characterize this system. Verify your answer by using Newton’s second law of motion to derive the same system of equations. Assume that x1 (0), x˙ 1 (0), x2 (0), and x˙ 2 (0) are given.

Figure 1.10. Example of a conservative dynamical system

(b) In Figure 1.11, a point mass M is moving in a circular path about the axis of rotation normal to a constant gravitational ﬁeld (this is called the simple pendulum problem). Here l is the radius of the circular path, g is the gravitational acceleration, and θ denotes the angle of deﬂection measured from the vertical. Use the Hamiltonian formulation of dynamical systems described above to derive a system of ﬁrst-order ordinary diﬀerential equations that characterize this system. Verify your answer by using Newton’s second law of motion to derive the same system of equations. Assume that ˙ θ(0) and θ(0) are given. (c) Determine a system of ﬁrst-order ordinary diﬀerential equations that characterizes the two-link pendulum depicted in Figure 1.12. Assume that θ1 (0), θ2 (0), θ˙1 (0), and θ˙2 (0) are given. 1.2. (Lagrange’s equation) If a dynamical system contains elements that dissipate energy, such as viscous friction elements in mechanical systems and

36

1 System Models, Diﬀerential Equations, and Initial-Value Problems

Figure 1.11. Simple pendulum

1

m1

θ1

2

g

m2

θ2 g

Figure 1.12. Two link pendulum

resistors in electric circuits, then we can use Lagrange’s equation to describe such systems. (In the following, we use some of the same notation used in Exercise 1.1.) For a system with n degrees of freedom, this equation is given by ∂D ∂L d ∂L (q, q) ˙ + (q, q) ˙ − (q) ˙ = fi , i = 1, . . . , n, (1.97) dt ∂ q˙i ∂q ∂ q˙i where q T = (q1 , . . . , qn ) denotes the generalized position vector. The function L(q, q) ˙ is called the Lagrangian and is deﬁned as L(q, q) ˙ = T (q, q) ˙ − W (q), i.e., the diﬀerence between the kinetic energy T and the potential energy W . The function D(q) ˙ denotes Rayleigh’s dissipation function, which we shall assume to be of the form D(q) ˙ =

n n 1 βij q˙i q˙j , 2 i=1 j=1

Exercises

37

where [βij ] is a positive semideﬁnite matrix (i.e., [βij ] is symmetric and all of its eigenvalues are nonnegative). The dissipation function D represents onehalf the rate at which energy is dissipated as heat. It is produced by friction in mechanical systems and by resistance in electric circuits. Finally, fi in (1.97) denotes an applied force and includes all external forces associated with the qi coordinate. The force fi is deﬁned as being positive when it acts to increase the value of the coordinate qi . (a) In Figure 1.13, M1 and M2 denote point masses; K1 , K2 , K denote spring constants; y1 , y2 denote the displacements of masses M1 and M2 , respectively; and B1 , B2 , B denote viscous damping coeﬃcients. Use the Lagrange formulation of dynamical systems described above to derive two second-order diﬀerential equations that characterize this system. Transform these equations into a system of ﬁrst-order ordinary diﬀerential equations. Verify your answer by using Newton’s second law of motion to derive ˙ y2 (0), and y(0) ˙ are the same system equations. Assume that y1 (0), y(0), given.

Figure 1.13. An example of a mechanical system with energy dissipation

(b) Consider the capacitor microphone depicted in Figure 1.14. Here we have a capacitor constructed from a ﬁxed plate and a moving plate with mass M . The moving plate is suspended from the ﬁxed frame by a spring with a spring constant K and has some damping expressed by the damping constant B. Sound waves exert an external force f (t) on the moving plate. The output voltage vs , which appears across the resistor R, will reproduce electrically the sound-wave patterns that strike the moving plate. When f (t) ≡ 0 there is a charge q0 on the capacitor. This produces a force of attraction between the plates that stretches the spring. When sound waves exert a force on the moving plate, there will be a resulting motion displacement x that is measured from the equilibrium position. The distance between the plates will then be x0 − x, and the charge on the plates will be q0 + q. When displacements are small, the expression for the capacitance is given approximately by

38

1 System Models, Diﬀerential Equations, and Initial-Value Problems

A x0 − x with C0 = A/x0 , where > 0 is the dielectric constant for air and A is the area of the plate. Use the Lagrange formulation of dynamical systems to derive two secondorder ordinary diﬀerential equations that characterize this system. Transform these equations into a system of ﬁrst-order ordinary diﬀerential equations. Verify your answer by using Newton’s laws of motion and Kirchhoﬀ’s voltage/current laws. Assume that x(0), x(0), ˙ q(0), and q(0) ˙ are given. C=

Figure 1.14. Capacitor microphone

(c) Use the Lagrange formulation to derive a system of ﬁrst-order diﬀerential equations for the system given in Example 1.3. 1.3. Find examples of initial-value problems for which (a) no solutions exist; (b) more than one solution exists; (c) one or more solutions exist, but cannot be continued for all t ∈ R; and (d) unique solutions exist for all t ∈ R. 1.4. (Numerical solution of ordinary diﬀerential equations—Euler’s method ) An approximation to the solution of the scalar initial-value problem y˙ = f (t, y),

y(t0 ) = y0

(1.98)

is given by Euler’s method , yk+1 = yk + hf (tk , yk ),

k = 0, 1, 2, . . . ,

(1.99)

where h = tk+1 − tk is the (constant) integration step. The interpretation of this method is that the area below the solution curve is approximated by a sequence of sums of rectangular areas. This method is also called the forward rectangular rule (of integration).

Exercises

39

(a) Use Euler’s method to determine the solution of the initial-value problem y˙ = 3y,

y(t0 ) = 5,

t0 = 0,

t0 ≤ t ≤ 10.

(b) Use Euler’s method to determine the solution of the initial-value problem y¨ = t(y) ˙ 2 − y2,

y(t0 ) = 1,

y(t ˙ 0 ) = 0,

t0 = 0, t0 ≤ t ≤ 10.

Hint: In both cases, use h = 0.2. For part (b), let y = x1 , x˙ 1 = x2 , x˙ 2 = tx22 − x21 , and apply (1.99), appropriately adjusted to the vector case. In both cases, plot yk vs. tk , k = 0, 1, 2, . . . . Remark:. Euler’s method yields arbitrarily close approximations to the solutions of (1.98), by making h suﬃciently small, assuming inﬁnite (computer) word length. In practice, however, where truncation errors (quantization) and round-oﬀ errors (ﬁnite precision operations) are a reality, extremely small values of h may lead to numerical instabilities. Therefore, Euler’s method is of limited value as a means of solving initial-value problems numerically. 1.5. (Numerical solution of ordinary diﬀerential equations—Runge–Kutta methods) The Runge–Kutta family of integration methods are among the most widely used techniques to solve initial-value problems (1.98). A simple version is given by yi+1 = yi + k, where k=

1 (k1 + 2k2 + 2k3 + k4 ) 6

with k1 = hf (ti , yi ), 1 1 k2 = hf (ti + h, yi + k1 ), 2 2 1 1 k3 = hf (ti + h, yi + k2 ), 2 2 k4 = hf (ti + h, yi + k3 ), and ti+1 = ti + h, y(t0 ) = y0 . The idea of this method is to probe ahead (in time) by one-half or by a whole step h to determine the values of the derivative at several points, and then to form a weighted average. Runge–Kutta methods can also be applied to higher order ordinary differential equations. For example, after a change of variables, suppose that a second-order diﬀerential equation has been changed to a system of two ﬁrstorder diﬀerential equations, say, x˙ 1 = f1 (t, x1 , x2 ),

x1 (t0 ) = x10 ,

x˙ 2 = f2 (t, x1 , x2 ),

x2 (t0 ) = x20 .

(1.100)

40

1 System Models, Diﬀerential Equations, and Initial-Value Problems

In solving (1.100), a simple version of the Runge–Kutta method is given by yi+1 = yi + k, where yi = (x1i , x2i )T and k = (k, l)T with k=

1 (k1 + 2k2 + 2k3 + k4 ), 6

l=

1 (l1 + 2l2 + 2l3 + l4 ) 6

and k1 = hf1 (ti , x1i , x2i ), k2 = hf1 (ti + k3 = hf1 (ti +

1 2 h, x1i 1 2 h, x1i

l1 = hf2 (ti , x1i , x2i ), + +

1 2 k1 , x2i 1 2 k2 , x2i

+ +

1 2 l1 ), l2 1 2 l2 ), l3

k4 = hf1 (ti + h, x1i + k3 , x2i + l3 ),

= hf2 (ti + 12 h, x1i + 12 k1 , x2i + 12 l1 ), = hf2 (ti + 12 h, x1i + 12 k2 , x2i + 12 l2 ),

l4 = hf2 (ti + h, x1i + k3 , x2i + l3 ).

Use the Runge–Kutta method described above to obtain numerical solutions to the initial-value problems given in parts (a) and (b) of Exercise 1.4. Plot your data. Remark: Since Runge–Kutta methods do not use past information, they constitute attractive starting methods for more eﬃcient numerical integration schemes (e.g., predictor–corrector methods) . We note that since there are no built-in accuracy measures in the Runge–Kutta methods, signiﬁcant computational eﬀorts are frequently expended to achieve a desired accuracy. 1.6. (Numerical solution of ordinary diﬀerential equations—Predictor– Corrector methods) A common predictor–corrector technique for solving initial-value problems determined by ordinary diﬀerential equations, such as (1.98), is the Milne method, which we now summarize. In this method, y˙ i−1 denotes the value of the ﬁrst derivative at time ti−1 , where ti is the time for the ith iteration step, y˙ i−2 is similarly deﬁned, and yi+1 represents the value of y to be determined. The details of the Milne method are: 1. yi+1,p = yi−3 + 4h 3 (2y˙ i−2 − y˙ i−1 + 2y˙ i ) 2. y˙ i+1,p = f (ti+1 , yi+1,p ) 3. yi+1,c = yi−1 + h3 (y˙i−1 + 4y˙ i + y˙ i+1,p ) 4. y˙ i+1,c = f (ti+1 , yi+1,c ) 5. yi+1,c = yi−1 + h3 (y˙i−1 + 4y˙ i + y˙ i+1,c )

(predictor ) (corrector ) (iterating corrector )

The ﬁrst step is to obtain a predicted value of yi+1 and then to substitute yi+1,p into the given diﬀerential equation to obtain a predicted value of y˙i+1,p , as indicated in the second equation above. This predicted value, y˙ i+1,p is then used in the second equation, the corrector equation, to obtain a corrected value of yi+1 . The corrected value, yi+1,c is next substituted into the diﬀerential equation to obtain an improved value of y˙i+1 , and so on. If necessary, an

Exercises

41

iteration process involving the fourth and ﬁfth equations continues until successive values of yi+1 diﬀer by less than the value of some desirable tolerance. With yi+1 determined to the desired accuracy, the method steps forward one h increment. A more complicated predictor–corrector method that is more reliable than the Milne method is the Adams–Bashforth–Moulton method, the essential equations of which are h (55y˙ i − 59y˙ i−1 + 37y˙ i−2 − 9y˙ i−3 ), 24 h yi+1,c = yi + (9y˙ i+1 + 19y˙ i − 5y˙ i−1 + y˙ i−2 ), 24 where in the corrector equation, y˙ i+1 denotes the predicted value. The application of predictor–corrector methods to systems of ﬁrst-order ordinary diﬀerential equations is straightforward. For example, the application of the Milne method to the second-order system in (1.100) yields from the predictor step yi+1,p = yi +

xk,i+1,p = xk,i−3 +

4h (2x˙ k,i−2 − x˙ k,i−1 + 2x˙ k,i ), 3

k = 1, 2.

Then x˙ k,i+1,p = fk (ti+1 , x1,i+1,p , x2,i+1,p ),

k = 1, 2,

and the corrector step assumes the form xk,i+1,c = xk,i−1 +

h (x˙ k,i−1 + 4x˙ k,i + x˙ k,i+1 ), 3

k = 1, 2,

and x˙ k,i+1,c = fk (ti+1 , x1,i+1,c , x2,i+1,c ),

k = 1, 2.

Use the Milne method and the Adams–Bashforth–Moulton method described above to obtain numerical solutions to the initial-value problems given in parts (a) and (b) of Exercise 1.4. To initiate the algorithm, refer to the Remark in Exercise 1.5. Remark. Derivations and convergence properties of numerical integration schemes, such as those discussed here and in Exercises 1.4 and 1.5, can be found in many of the standard texts on numerical analysis. 1.7. Use Theorem 1.15 to solve the initial-value problem x˙ = ax+ t, x(0) = x0 for t ≥ 0. Here a ∈ R. 1.8. Consider the initial-value problem x˙ = Ax,

x(0) = x0 ,

(1.101)

where x ∈ R and A ∈ R . Let λ1 , λ2 denote the eigenvalues of A; i.e., λ1 and λ2 are the roots of the equation det(A − λI) = 0, where det denotes determinant, λ is a scalar, and I denotes the 2 × 2 identity matrix. Make speciﬁc choices of A to obtain the following cases: 2

2×2

42

1. λ1 2. λ1 3. λ1 4. λ1 5. λ1 6. λ1 7. λ1 8. λ1

1 System Models, Diﬀerential Equations, and Initial-Value Problems

> 0, λ2 > 0, and λ1 = λ2 < 0, λ2 < 0, and λ1 = λ2 = λ2 > 0 = λ2 < 0 > 0, λ2 < 0 √ = α + iβ, λ2 = α − iβ, i = −1, α > 0 = α + iβ, λ2 = α − iβ, α < 0 = iβ, λ2 = −iβ

Using t as a parameter, plot φ2 (t, 0, x0 ) vs. φ1 (t, 0, x0 ) for 0 ≤ t ≤ tf for every case enumerated above. Here [φ1 (t, t0 , x0 ), φ2 (t, t0 , x0 )]T = φ(t, t0 , x0 ) denotes the solution of (1.101). On your plots, indicate increasing time t by means of arrows. Plots of this type are called trajectories for (1.101), and suﬃciently many plots (using diﬀerent initial conditions and suﬃciently large tf ) make up a phase portrait for (1.101). Generate a phase portrait for each case given above. 1.9. Write two ﬁrst-order ordinary diﬀerential equations for the van der Pol Equation (1.35) by choosing x1 = x and x2 = x˙ 1 . Determine by simulation phase portraits (see Exercise 1.8) for this example for the cases = 0.05 and = 10 (refer also to Exercises 1.5 and 1.6 for numerical methods for solving diﬀerential equations). The periodic solution to which the trajectories of (1.35) tend to is an example of a limit cycle. 1.10. Consider a system whose state-space description is given by √ x˙ = −k1 k2 x + k2 u(t), √ y = k1 x. Linearize this system about the nominal solution √ u0 ≡ 0, 2 x0 (t) = 2 k − k1 k2 t, where x0 (0) = k. 1.11. For (1.36) consider the hard, linear, and soft spring models given by g(x) = k(1 + a2 x2 )x, g(x) = kx, g(x) = k(1 − a2 x2 )x, respectively, where k > 0 and a2 > 0. Write two ﬁrst-order ordinary diﬀerential equations for (1.36) by choosing x1 = x and x2 = x. ˙ Pick speciﬁc values for k and a2 . Determine by simulation phase portraits (see Exercise 1.8) for this example for the above three cases.

Exercises

43

1.12. (a) Show that xT = (0, 0) is a solution of the system of equations x˙ 1 = x21 + x22 + x2 cos x1 , x˙ 2 = (1 + x1 )x1 + (1 + x2 )x2 + x1 sin x2 . Linearize this system about the point xT = (0, 0). By means of computer simulations, compare solutions corresponding to diﬀerent initial conditions in the vicinity of the origin of the above system of equations and its linearization. (b) Linearize the (bilinear control) system x ¨ + (3 + x˙ 2 )x˙ + (1 + x + x2 )u = 0 about the solution x = 0, x˙ = 0, and the input u(t) ≡ 0. As in part (a), compare (by means of computer simulations) solutions of the above equation with corresponding solutions of its linearization. (c) In the circuit given in Figure 1.15, vi (t) is a voltage source and the non3 linear resistor obeys the relation iR = 1.5vR [vi (t) is the circuit input and vR (t) is the circuit output]. Derive the diﬀerential equation for this circuit. Linearize this diﬀerential equation for the case when the circuit operates about the point vi = 14. i R (t)

1Ω

+

+ vi (t) –

vR (t)

1F –

Figure 1.15. Nonlinear circuit

1.13. (Inverted pendulum) The inverted pendulum on a moving carriage subjected to an external force μ(t) is depicted in Figure 1.16. The moment of inertia with respect to the center of gravity is J, and the coeﬃcient of friction of the carriage (see Figure 1.16) is F . From Figure 1.17 we obtain the following equations for the dynamics of this system

44

1 System Models, Diﬀerential Equations, and Initial-Value Problems m L

(Center of gravity)

φ Carriage M μ (t)

(Pivot)

S F

Figure 1.16. Inverted pendulum

Y mg φ μ

H

Mg

Figure 1.17. Force diagram of the inverted pendulum

d2 (S + L sin φ) H, dt2 d2 m 2 (L cos φ) Y − mg, dt d2 φ J 2 = LY sin φ − LH cos φ, dt d2 S dS M 2 = μ(t) − H − F . dt dt m

(1.102a) (1.102b) (1.102c) (1.102d)

Assuming that m << M , (1.102d) reduces to M

d2 S dS . = μ(t) − F 2 dt dt

(1.102e)

Eliminating H and Y from (1.102a) to (1.102c), we obtain (J + mL2 )φ¨ = mgL sin φ − mLS¨ cos φ.

(1.102f)

Exercises

45

Thus, the system of Figure 1.16 is described by the equations φ¨ − (g/L ) sin φ + (1/L )S¨ cos φ = 0, M S¨ + F S˙ = μ(t),

(1.102g)

where

J + mL2 mL denotes the eﬀective pendulum length. Linearize system (1.102g) about φ = 0. L =

1.14. (Simple pendulum) A system of ﬁrst-order ordinary diﬀerential equations that characterize the simple pendulum considered in Exercise 1.1b is given by x2 x˙ 1 = , x˙ 2 − gl sin x1 ˙ speciﬁed. A where x1 θ and x2 θ˙ with x1 (0) = θ(0) and x2 (0) = θ(0) linearized model of this system about the solution x = [0, 0]T is given by x˙ 1 x1 01 = . x˙ 2 x2 − gl 0 Let g = 10 (m/sec2 ) and l = 1 (m). (a) For the case when x(0) = [θ0 , 0]T with θ0 = π/18, π/12, π/6, and π/3, plot the states for t ≥ 0 for the nonlinear model. (b) Repeat (a) for the linear model. (c) Compare the results in (a) and (b).

2 An Introduction to State-Space and Input–Output Descriptions of Systems

2.1 Introduction State-space representations provide detailed descriptions of the internal behavior of a system, whereas input–output descriptions of systems emphasize external behavior and a system’s interaction with this behavior. In this chapter we address the state-space description of systems, which is an internal description of systems, and the input–output description of systems, also called the external description of systems. We will address continuous-time systems described by ordinary diﬀerential equations and discrete-time systems described by ordinary diﬀerence equations. We will emphasize linear systems. For such systems, the input–output descriptions involve the convolution integral for the continuous-time case and the convolution sum for the discrete-time case. This chapter is organized into three parts. In the ﬁrst of these (Section 2.2), we develop the state-space description of continuous-time systems, whereas in the second part (Section 2.3), we present the state-space representation of discrete-time systems. In the third part (Section 2.4), we address the input– output description of both continuous-time and discrete-time systems. Required background material for this chapter includes certain essentials in ordinary diﬀerential equations and linear algebra. This material can be found in Chapter 1 and the appendix, respectively.

2.2 State-Space Description of Continuous-Time Systems Let us consider once more systems described by equations of the form x˙ = f (t, x, u), y = g(t, x, u),

(2.1a) (2.1b)

where x ∈ Rn , y ∈ Rp , u ∈ Rm , f : R×Rn ×Rm → Rn , and g : R×Rn ×Rm → Rp . Here t denotes time and u and y denote system input and system output,

48

2 Introduction to State-Space and Input–Output Descriptions of Systems

respectively. Equation (2.1a) is called the state equation, (2.1b) is called the output equation, and (2.1a) and (2.1b) constitute the state-space description of continuous-time ﬁnite-dimensional systems. The system input may be a function of t only (i.e., u : R → Rm ), or as in the case of feedback control systems, it may be a function of t and x (i.e., u : R × Rn → Rm ). In either case, for a given (i.e., speciﬁed) u, we let f (t, x, u) = F (t, x) and rewrite (2.1a) as x˙ = F (t, x).

(2.2)

Now according to Theorems 1.13 and 1.14, if F ∈ C(R × Rn , Rn ) and if for any compact subinterval J0 ⊂ R there is a constant LJ0 such that ˜ for all t ∈ J0 and for all x, x˜ ∈ Rn , F (t, x) − F (t, x˜) ≤ LJ0 x − x then the following statements are true: 1. For any (t0 , x0 ) ∈ R×Rn , (2.2) has a unique solution φ(t, t0 , x0 ) satisfying φ(t0 , t0 , x0 ) = x0 that exists for all t ∈ R. 2. The solution φ is continuous in t, t0 , and x0 . 3. If F depends continuously on parameters (say, λ ∈ Rl ) and if x0 depends continuously on λ, the solution φ is continuous in λ as well. Thus, if the above conditions are satisﬁed, then for a given t0 , x0 , and u, (2.1a) will have a unique solution that exists for t ∈ R. Therefore, as already discussed in Section 1.8, φ(t, t0 , x0 ) characterizes the state of the system at time t. Moreover, under these conditions, the system will have a unique response for t ∈ R, determined by (2.1b). We usually assume that g ∈ C(R × Rn × Rm , Rp ) or that g ∈ C 1 (R × Rn × Rm , Rp ). An important special case of (2.1) is systems described by linear timevarying equations of the form x˙ = A(t)x + B(t)u, y = C(t)x + D(t)u,

(2.3a) (2.3b)

where A ∈ C(R, Rn×n ), B ∈ C(R, Rn×m ), C ∈ C(R, Rp×n ), and D ∈ C(R, Rp×m ). Such equations may arise in the modeling process of a physical system, or they may be a consequence of a linearization process, as discussed in Section 1.6. By applying the results of Section 1.7, we see that for every initial condition x(t0 ) = x0 and for every given input u : R → Rm , system (2.3a) possesses a unique solution that exists for all t ∈ R and that is continuous in (t, t0 , x0 ). Moreover, if A and B depend continuously on parameters, say, λ ∈ Rl , then the solutions will be continuous in the parameters as well. Indeed, in accordance with (1.87), this solution is given by

t

φ(t, t0 , x0 ) = Φ(t, t0 )x0 +

Φ(t, s)B(s)u(s)ds, t0

(2.4)

2.2 State-Space Description of Continuous-Time Systems

49

where Φ(t, t0 ) denotes the state transition matrix of the system of equations x˙ = A(t)x.

(2.5)

By using (2.3b) and (2.4) we obtain the system response as

t

y(t) = C(t)Φ(t, t0 )x0 + C(t)

Φ(t, s)B(s)u(s)ds + D(t)u(t).

(2.6)

t0

When in (2.3), A(t) ≡ A, B(t) ≡ B, C(t) ≡ C, and D(t) ≡ D, we have the important linear time-invariant case given by x˙ = Ax + Bu, y = Cx + Du.

(2.7a) (2.7b)

In accordance with (1.84), (1.85), (1.87), and (2.4), the solution of (2.7a) is given by

t A(t−t0 ) φ(t, t0 , x0 ) = e x0 + eA(t−s) Bu(s)ds (2.8) t0

and the response of the system is given by

t A(t−t0 ) x0 + C eA(t−s) Bu(s)ds + Du(t). y(t) = Ce

(2.9)

t0

Linearity We have referred to systems described by the linear equations (2.3) [resp., (2.7)] as linear systems. In the following discussion, we establish precisely in what sense this linearity is to be understood. To this end, for (2.3) we ﬁrst let y1 and y2 denote system outputs that correspond to system inputs given by u1 and u2 , respectively, under the condition that x0 = 0. By invoking (2.6), it is clear that the system output corresponding to the system input u = α1 u1 +α2 u2 , where α1 and α2 are real scalars, is given by y = α1 y1 +α2 y2 ; i.e.,

t Φ(t, s)B(s)[α1 u1 (s) + α2 u2 (s)]ds + D(t)[α1 u1 (t) + α2 u2 (t)] y(t) = C(t) t0

t

= α1 C(t)

t

Φ(t, s)B(s)u1 (s)ds + α2 C(t) t0

Φ(t, s)B(s)u2 (s)ds t0

+ α1 D(t)u1 (t) + α2 D(t)u2 (t) = α1 y1 (t) + α2 y2 (t).

(2.10)

Next, for (2.3) we let y1 and y2 denote system outputs that correspond to (1) (2) initial conditions x0 and x0 , respectively, under the condition that u(t) = 0

50

2 Introduction to State-Space and Input–Output Descriptions of Systems

for all t ∈ R. Again, by invoking (2.6), it is clear that the system output (1) (2) corresponding to the initial condition x0 = α1 x0 + α2 x0 , where α1 and α2 are real scalars, is given by y = α1 y1 + α2 y2 ; i.e., (1)

(2)

y(t) = C(t)Φ(t, t0 )[α1 x0 + α2 x0 ] (1)

(2)

= α1 C(t)Φ(t, t0 )x0 + α2 C(t)Φ(t, t0 )x0 = α1 y1 (t) + α2 y2 (t).

(2.11)

Equations (2.10) and (2.11) show that for systems described by the linear equations (2.3) [and, hence, by (2.7)], a superposition principle holds in terms of the input u and the corresponding output y of the system under the assumption of zero initial conditions, and in terms of the initial conditions x0 and the corresponding output y under the assumption of zero input. It is important to note, however, that such a superposition principle will in general not hold under conditions that combine nontrivial inputs and nontrivial initial conditions. For example, with x0 = 0 given, and with inputs u1 and u2 resulting in corresponding outputs y1 and y2 in (2.3), it does not follow that the input α1 u1 + α2 u2 will result in an output α1 y1 + α2 y2 .

2.3 State-Space Description of Discrete-Time Systems State-Space Representation The state-space description of discrete-time ﬁnite-dimensional dynamical systems is given by equations of the form xi (k + 1) = fi (k, x1 (k), . . . , xn (k), u1 (k), . . . , um (k)) i = 1, . . . , n, (2.12a) yi (k) = gi (k, x1 (k), . . . , xn (k), u1 (k), . . . , um (k)) i = 1, . . . , p, (2.12b) for k = k0 , k0 +1, . . . , where k0 is an integer. (In the following discussion, we let Z denote the set of integers and we let Z + denote the set of nonnegative integers.) Letting x(k)T = (x1 (k), . . . , xn (k)), f (·)T = (f1 (·), . . . , fn (·)), u(k)T = (u1 (k), . . . , um (k)), y(k)T = (y1 (k), . . . , yp (k)), and g(·)T = (g1 (·), . . . , gm (·)), we can rewrite (2.12) more compactly as x(k + 1) = f (k, x(k), u(k)),

(2.13a)

y(k) = g(k, x(k), u(k)).

(2.13b)

Throughout this section we will assume that f : Z × Rn × Rm → Rn and g : Z × Rn × Rm → Rp . Since f is a function, for given k0 , x(k0 ) = x0 , and for given u(k), k = k0 , k0 + 1, . . . , (2.13a) possesses a unique solution x(k) that exists for all k = k0 , k0 + 1, . . . . Furthermore, under these conditions, y(k) is uniquely deﬁned for k = k0 , k0 + 1, . . . .

2.3 State-Space Description of Discrete-Time Systems

51

As in the case of continuous-time ﬁnite-dimensional systems [see (2.1)], k0 denotes initial time, k denotes time, u(k) denotes the system input (evaluated at time k), y(k) denotes the system output or system response (evaluated at time k), x(k) characterizes the state (evaluated at time k), xi (k), i = 1, . . . , n, denote the state variables, (2.13a) is called the state equation, and (2.13b) is called the output equation. A moment’s reﬂection should make it clear that in the case of discrete-time ﬁnite-dimensional dynamical systems described by (2.13), questions concerning existence, uniqueness, and continuation of solutions are not an issue, as was the case in continuous-time systems. Furthermore, continuity with respect to initial data x(k0 ) = x0 , or with respect to system parameters, is not an issue either, provided that f (·) and g(·) have appropriate continuity properties. In the case of continuous-time systems described by ordinary diﬀerential equations [see (2.1)], we allow time t to evolve “forward” and “backward.” Note, however, that in the case of discrete-time systems described by (2.13), we restrict the evolution of time k in the forward direction to ensure uniqueness of solutions. (We will revisit this issue in more detail in Chapter 3.) Special important cases of (2.13) are linear time-varying systems given by x(k + 1) = A(k)x(k) + B(k)u(k), y(k) = C(k)x(k) + D(k)u(k),

(2.14a) (2.14b)

where A : Z → Rn×n , B : Z → Rn×m , C : Z → Rp×n , and D : Z → Rp×m . When A(k) ≡ A, B(k) ≡ B, C(k) ≡ C, and D(k) ≡ D, we have linear timeinvariant systems given by x(k + 1) = Ax(k) + Bu(k),

(2.15a)

y(k) = Cx(k) + Du(k).

(2.15b)

As in the case of continuous-time ﬁnite-dimensional dynamical systems, many qualitative properties of discrete-time ﬁnite-dimensional systems can be studied in terms of initial-value problems given by x(k + 1) = f (k, x(k)),

x(k0 ) = x0 ,

(2.16)

where x ∈ Rn , f : Z × Rn → Rn , k0 ∈ Z, and k = k0 , k0 + 1, · · · . We call the equation x(k + 1) = f (k, x(k)), (2.17) a system of ﬁrst-order ordinary diﬀerence equations. Special important cases of (2.17) include autonomous systems described by x(k + 1) = f (x(k)), periodic systems given by

(2.18)

52

2 Introduction to State-Space and Input–Output Descriptions of Systems

x(k + 1) = f (k, x(k)) = f (k + K, x(k))

(2.19)

for ﬁxed K ∈ Z + and for all k ∈ Z, linear homogeneous systems given by x(k + 1) = A(k)x(k),

(2.20)

linear periodic systems characterized by x(k + 1) = A(k)x(k) = A(k + K)x(k)

(2.21)

for ﬁxed K ∈ Z + and for all k ∈ Z, linear nonhomogeneous systems x(k + 1) = A(k)x(k) + g(k),

(2.22)

and linear, autonomous, homogeneous systems characterized by x(k + 1) = Ax(k).

(2.23)

In these equations all symbols used are deﬁned in the obvious way by making reference to the corresponding systems of ordinary diﬀerential equations (see Subsection 1.3.2). Diﬀerence Equations of Order n Thus far we have addressed systems of ﬁrst-order diﬀerence equations. As in the continuous-time case, it is also possible to characterize initial-value problems by nth-order ordinary diﬀerence equations, say, y(k + n) = h(k, y(k), y(k + 1), . . . , y(k + n − 1)),

(2.24)

where h : Z × Rn → R, n ∈ Z + , k = k0 , k0 + 1, . . . . By specifying an initial time k0 ∈ Z and by specifying y(k0 ), y(k0 + 1), . . . , y(k0 + n − 1), we again have an initial-value problem given by y(k + n) = h(k, y(k), y(k + 1), . . . , y(k + n − 1)), y(k0 ) = x10 , . . . , y(k0 + n − 1) = xn0 .

(2.25)

We call (2.24) an nth-order ordinary diﬀerence equation, and we note once more that in the case of initial-value problems described by such equations, there are no diﬃcult issues involving the existence, uniqueness, and continuation of solutions. We can reduce the study of (2.25) to the study of initial-value problems determined by systems of ﬁrst-order ordinary diﬀerence equations. To accomplish this, we let in (2.25) y(k) = x1 (k), y(k + 1) = x2 (k), . . . , y(k + n − 1) = xn (k). We now obtain the system of ﬁrst-order ordinary diﬀerence equations x1 (k + 1) = x2 (k), ··· xn−1 (k + 1) = xn (k), xn (k + 1) = h(k, x1 (k), . . . , xn (k)).

(2.26)

2.3 State-Space Description of Discrete-Time Systems

53

Equations (2.26), together with the initial data xT0 = (x10 , . . . , xn0 ), are equivalent to the initial-value problem (2.25) in the sense that these two problems will generate identical solutions [and in the sense that the transformation of (2.25) into (2.26) can be reversed unambiguously and uniquely]. As in the case of systems of ﬁrst-order ordinary diﬀerence equations, we can point to several important special cases of nth-order ordinary diﬀerence equations, including equations of the form y(k + n) + an−1 (k)y(k + n − 1) + · · · + a1 (k)y(k + 1) + a0 (k)y(k) = g(k), (2.27) y(k + n) + an−1 (k)y(k + n − 1) + · · · + a1 (k)y(k + 1) + a0 (k)y(k) = 0,

(2.28)

and y(k + n) + an−1 y(k + n − 1) + · · · + a1 y(k + 1) + a0 y(k) = 0.

(2.29)

We call (2.27) a linear nonhomogeneous ordinary diﬀerence equation of order n, we call (2.28) a linear homogeneous ordinary diﬀerence equation of order n, and we call (2.29) a linear, autonomous, homogeneous ordinary diﬀerence equation of order n. As in the case of systems of ﬁrst-order ordinary diﬀerence equations, we can deﬁne periodic and linear periodic ordinary diﬀerence equations of order n in the obvious way. Solutions of State Equations Returning now to linear homogeneous systems x(k + 1) = A(k)x(k),

(2.30)

we observe that x(k + 2) = A(k + 1)x(k + 1) = A(k + 1)A(k)x(k) ··· x(n) = A(n − 1)A(n − 2) · · · A(k + 1)A(k)x(k) =

n−1

A(j)x(k);

j=k

i.e., the state of the system at time n is related to the state at time k by means of the n × n matrix n−1 j=k A(j) (as can easily be proved by induction). This suggests that the state transition matrix for (2.30) is given by Φ(n, k) =

n−1

A(j),

n > k,

(2.31)

j=k

and that Φ(k, k) = I.

(2.32)

54

2 Introduction to State-Space and Input–Output Descriptions of Systems

As in the continuous-time case, the solution to the initial-value problem x(k + 1) = A(k)x(k) x(k0 ) = xk0 ,

k0 ∈ Z,

(2.33)

A(j)xk0 , n > k0 .

(2.34)

is now given by x(n) = Φ(n, k0 )xk0 =

n−1 j=k0

Continuing, let us next consider initial-value problems determined by linear nonhomogeneous systems (2.22), x(k + 1) = A(k)x(k) + g(k), x(k0 ) = xk0 .

(2.35)

Then x(k0 + 1) = A(k0 )x(k0 ) + g(k0 ), x(k0 + 2) = A(k0 + 1)x(k0 + 1) + g(k0 + 1) = A(k0 + 1)A(k0 )x(k0 ) + A(k0 + 1)g(k0 ) + g(k0 + 1), x(k0 + 3) = A(k0 + 2)x(k0 + 2) + g(k0 + 2) = A(k0 + 2)A(k0 + 1)A(k0 )x(k0 ) + A(k0 + 2)A(k0 + 1)g(k0 ) + A(k0 + 2)g(k0 + 1) + g(k0 + 2) = Φ(k0 + 3, k0 )xk0 + Φ(k0 + 3, k0 + 1)g(k0 ) + Φ(k0 + 3, k0 + 2)g(k0 + 1) + Φ(k0 + 3, k0 + 3)g(k0 + 2), and so forth. For k ≥ k0 + 1, we easily obtain the expression for the solution of (2.35) as k−1 x(k) = Φ(k, k0 )xk0 + Φ(k, j + 1)g(j). (2.36) j=k0

In the time-invariant case x(k + 1) = Ax(k) + g(k), x(k0 ) = xk0 ,

(2.37)

the solution is again given by (2.36) where now the state transition matrix Φ(k, k0 ) = Ak−k0 ,

k ≥ k0 ,

(2.38)

in view of (2.31) and (2.32). The solution of (2.37) is then x(k) = Ak−k0 xk0 +

k−1 j=k0

Ak−(j+1) g(j),

k > k0 .

(2.39)

2.3 State-Space Description of Discrete-Time Systems

55

We note that when xk0 = 0, (2.36) reduces to xp (k) =

k−1

Φ(k, j + 1)g(j),

(2.40)

j=k0

and when xk0 = 0 but g(k) ≡ 0, then (2.36) reduces to xh (k) = Φ(k, k0 )xk0 .

(2.41)

Therefore, the total solution of (2.35) consists of the sum of its particular solution, xp (k), and its homogeneous solution, xh (k). System Response Finally, we observe that in view of (2.14b) and (2.36), the system response of the system (2.14), is of the form y(k) = C(k)Φ(k, k0 )xk0 + C(k)

k−1

Φ(k, j + 1)B(j)u(j)

j=k0

+ D(k)u(k),

k > k0 ,

(2.42)

and y(k0 ) = C(k0 )xk0 + D(k0 )u(k0 ).

(2.43)

In the time-invariant case, in view of (2.39), the system response of the system (2.15) is y(k) = CAk−k0 xk0 + C

k−1

Ak−(j+1) B(j)u(j) + Du(k),

k > k0 ,

(2.44)

j=k0

and y(k0 ) = Cxk0 + Du(k0 ).

(2.45)

Discrete-time systems, as discussed above, arise in several ways, including the numerical solution of ordinary diﬀerential equations (see, e.g., our discussion in Exercise 1.4 of Euler’s method ); the representation of sampled-data systems at discrete points in time (which will be discussed in further detail in Chapter 3); in the modeling process of systems that are deﬁned only at discrete points in time (e.g., digital computer systems); and so forth. As a speciﬁc example of a discrete-time system we consider a second-order section digital ﬁlter in direct form, x1 (k + 1) = x2 (k), x2 (k + 1) = ax1 (k) + bx2 (k) + u(k), y(k) = x1 (k),

(2.46a) (2.46b)

k ∈ Z , where x1 (k) and x2 (k) denote the state variables, u(k) denotes the input, and y(k) denotes the output of the digital ﬁlter. We depict system (2.46) in block diagram form in Figure 2.1. +

56

2 Introduction to State-Space and Input–Output Descriptions of Systems

Figure 2.1. Second-order section digital ﬁlter in direct form

2.4 Input–Output Description of Systems This section consists of four subsections. First we consider rather general aspects of the input–output description of systems. Because of their simplicity, we address the characterization of linear discrete-time systems next. In the third subsection we provide a foundation for the impulse response of linear continuous-time systems. Finally, we address the external description of linear continuous-time systems. 2.4.1 External Description of Systems: General Considerations The state-space representation of systems presupposes knowledge of the internal structure of the system. When this structure is unknown, it may still be possible to arrive at a system description—an external description—that relates system inputs to system outputs. In linear system theory, a great deal of attention is given to relating the internal description of systems (the state representation) to the external description (the input–output description). In the present context, we view system inputs and system outputs as elements of two real vector spaces U and Y , respectively, and we view a system as being represented by an operator T that relates elements of U to elements of Y . For u ∈ U and y ∈ Y we will assume that u : R → Rm and y : R → Rp in the case of continuous-time systems, and that u : Z → Rm and y : Z → Rp in the case of discrete-time systems. If m = p = 1, we speak of a singleinput/single-output (SISO) system. Systems for which m > 1, p > 1, are called multi-input/multi-output (MIMO) systems. For continuous-time systems we deﬁne vector addition (on U ) and multiplication of vectors by scalars (on U ) as (2.47) (u1 + u2 )(t) = u1 (t) + u2 (t) and (αu)(t) = αu(t)

(2.48)

for all u1 , u2 ∈ U, α ∈ R, and t ∈ R. We similarly deﬁne vector addition and multiplication of vectors by scalars on Y . Furthermore, for discrete-time

2.4 Input–Output Description of Systems

57

systems we deﬁne these operations on U and Y analogously. In this case the elements of U and Y are real sequences that we denote, e.g., by u = {uk } or u = {u(k)}. (It is easily veriﬁed that under these rather general conditions, U and Y satisfy all the axioms of a vector space, both for the continuous-time case and the discrete-time case.) In the continuous-time case as well as in the discrete-time case the system is represented by T : U → Y , and we write y = T (u).

(2.49)

In the subsequent development, we will impose restrictions on the vector spaces U, Y , and on the operator T , as needed. Linearity. If T is a linear operator, the system is called a linear system. In this case we have y = T (α1 u1 + α2 u2 ) = α1 T (u1 ) + α2 T (u2 ) = α1 y1 + α2 y2

(2.50)

for all α1 , α2 ∈ R and u1 , u2 ∈ U where yi = T (ui ) ∈ Y , i = 1, 2, and y ∈ Y . Equation (2.50) represents the well-known principle of superposition of linear systems. With or Without Memory. We say that a system is memoryless, or without memory, if its output for each value of the independent variable (t or k) is dependent only on the input evaluated at the same value of the independent variable [e.g., y(t1 ) depends only on u(t1 ) and y(k1 ) depends only on u(k1 )]. An example of such a system is the resistor circuit shown in Figure 2.2, where the current i(t) = u(t) denotes the system input at time t and the voltage across the resistor, v(t) = Ri(t) = y(t), denotes the system output at time t.

Figure 2.2. Resistor circuit

A system that is not memoryless is said to have memory. An example of a continuous-time system with memory is the capacitor circuit shown in Figure 2.3, where the current i(t) = u(t) represents the system input at time t and the voltage across the capacitor,

58

2 Introduction to State-Space and Input–Output Descriptions of Systems

1 y(t) = v(t) = C

t

i(τ )dτ, −∞

denotes the system output at time t. Another example of a continuous-time system with memory is described by the scalar equation y(t) = u(t − 1),

t ∈ R,

and an example of a discrete-time system with memory is characterized by the scalar equation y(n) =

n

x(k),

n, k ∈ Z.

k=−∞

Figure 2.3. Capacitor circuit

Causality. A system is said to be causal if its output at any time, say t1 (or k1 ), depends only on values of the input evaluated for t ≤ t1 (for k ≤ k1 ). Thus, y(t1 ) depends only on u(t), t ≤ t1 [or y(k1 ) depends only on u(k), k ≤ k1 ]. Such a system is referred to as being nonanticipative since the system output does not anticipate future values of the input. To make the above concept a bit more precise, we deﬁne the function uτ : R → Rm for u ∈ U by

u(t), t ≤ τ, uτ (t) = 0, t > τ, and we similarly deﬁne the function yτ : R → Rp for y ∈ Y . A system that is represented by the mapping y = T (u) is said to be causal if and only if (T (u))τ = (T (uτ ))τ

for all τ ∈ R, for all u ∈ U .

Equivalently, this system is causal if and only if for u, v ∈ U and uτ = vτ it is true that (T (u))τ = (T (v))τ for all τ ∈ R.

2.4 Input–Output Description of Systems

59

For example, the discrete-time system described by the scalar equation y(n) = u(n) − u(n + 1),

n ∈ Z,

is not causal. Neither is the continuous-time system characterized by the scalar equation y(t) = x(t + 1), t ∈ R. It should be pointed out that systems that are not causal are by no means useless. For example, causality is not of fundamental importance in imageprocessing applications where the independent variable is not time. Even when time is the independent variable, noncausal systems may play an important role. For example, in the processing of data that have been recorded (such as speech, meteorological data, demographic data, and stock market ﬂuctuations), one is not constrained to processing the data causally. An example of this would be the smoothing of data over a time interval, say, by means of the system M 1 u(n − k). y(n) = 2M + 1 k=−M

Time-Invariance. A system is said to be time-invariant if a time shift in the input signal causes a corresponding time shift in the output signal. To make this concept more precise, for ﬁxed α ∈ R, we introduce the shift operator Qα : U → U as Qα u(t) = u(t − α), u ∈ U, t ∈ R. A system that is represented by the mapping y = T (u) is said to be timeinvariant if and only if T Qα (u) = Qα (T (u)) = Qα (y) for any α ∈ R and any u ∈ U . If a system is not time-invariant, it is said to be time-varying. For example, a system described by the relation y(t) = cos u(t) is time-invariant. To see this, consider the inputs u1 (t) and u2 (t) = u1 (t − t0 ). Then y1 (t) = cos u1 (t), y2 (t) = cos u2 (t) = cos u1 (t − t0 ) and y1 (t − t0 ) = cos u1 (t − t0 ) = y2 (t). As a second example, consider a system described by the relation y(n) = nu(n) and consider two inputs u1 (n) and u2 (n) = u1 (n − n0 ). Then

60

2 Introduction to State-Space and Input–Output Descriptions of Systems

y1 (n) = nu1 (n) and y2 (n) = nu2 (n) = nu1 (n − n0 ). However, if we shift the output y1 (n) by n0 , we obtain y1 (n − n0 ) = (n − n0 )u1 (n − n0 ) = y2 (n). Therefore, this system is not time-invariant. 2.4.2 Linear Discrete-Time Systems In this subsection we investigate the representation of linear discrete-time systems. We begin our discussion by considering SISO systems. In the following, we employ the discrete-time impulse (or unit pulse or unit sample), which is deﬁned as

0, n = 0, n ∈ Z, δ(n) = (2.51) 1, n = 0. Note that if {p(n)} denotes the unit step sequence, i.e.,

1, n ≥ 0, n ∈ Z, p(n) = 0, n < 0, n ∈ Z,

(2.52)

then δ(n) = p(n) − p(n − 1)

and p(n) =

∞ k=0

0,

δ(n − k), n ≥ 0, n < 0.

(2.53)

Furthermore, note that an arbitrary sequence {x(n)} can be expressed as x(n) =

∞

x(k)δ(n − k).

(2.54)

k=−∞

We can easily show that a transformation T : U → Y determined by the equation ∞ y(n) = h(n, k)u(k), (2.55) k=−∞

where y {y(k)} ∈ Y , u {u(k)} ∈ U , and h : Z × Z → R, is a linear transformation. Also, we note that for (2.55) to make any sense, we need to impose restrictions on {h(n, k)} and {u(k)}. For example, if for every ﬁxed older Inequaln, {h(n, k)} ∈ l2 and {u(k)} ∈ l2 = U , then it follows from the H¨ ity (resp., Schwarz Inequality), see Section A.7, that (2.55) is well deﬁned. There are of course other conditions that one might want to impose on (2.55).

2.4 Input–Output Description of Systems

∞

61

For example, if for every ﬁxed n, k=−∞ |h(n, k)| < ∞ (i.e., for every ﬁxed n, {h(n, k)} ∈ l1 ) and if supk∈Z |u(k)| < ∞ (i.e., {u(k)} ∈ l∞ ), then (2.55) is also well deﬁned. We shall now elaborate on the suitability of (2.55) to represent linear discrete-time systems. To this end, we will agree once and for all that, in the ensuing discussion, all assumptions on {h(n, k)} and {u(k)} are satisﬁed that ensure that (2.55) is well deﬁned. We will view y ∈ Y and u ∈ U as system outputs and system inputs, respectively, and we will let T : U → Y denote a linear transformation that relates u to y. We ﬁrst consider the case when u(k) = 0 for k < k0 , k, k0 ∈ Z. Also, we assume that for k > n ≥ k0 , the inputs u(k) do not contribute to the system output at time n (i.e., the system is causal ). Under these assumptions, and in view of the linearity of T , and by invoking the representation of signals yn = {y(n)}, n ∈ Z, ∞ by (2.54), we obtain for the expression y(n) = T ( k=−∞ u(k)δ(n − k)) = T ( k=k0 u(k)δ(n − k)) = n n k=k0 u(k)T (δ(n − k)) = k=k0 h(n, k)u(k), n ≥ k0 , and y(n) = 0, n < k0 , where T (δ(n − k)) (T δ)(n − k) h(n, k) represents the response of T to a unit pulse (resp., discrete-time impulse or unit sample) occurring at n = k. When the assumptions in the preceding discussion are no longer valid, then a diﬀerent argument than the one given above needs to be used to arrive at the system representation. Indeed, for inﬁnite sums, the interchanging of the order of the summation operation with the linear transformation T is no longer valid. We refer the reader to a paper by I. W. Sandberg (“A Representation Theorem for Linear Systems,” IEEE Transactions on Circuits and Systems—I, Vol. 45, No. 5, pp. 578–580, May 1998) for a derivation of the representation of general linear discrete-time systems. In that paper it is shown that an extra term needs to be added to the right-hand side of equation (2.55), even in the representation of general, linear, time-invariant, causal, discretetime systems. [In the proof, the Hahn–Banach Theorem (which is concerned with the extension of bounded linear functionals) is employed and the extra −cl −1 ∞ u(k)δ(n−k)+ k=cl +1 u(k)δ(n− required term is given by liml→∞ T ( k=−∞ k)] with cl → ∞ as l → ∞. For a statement and proof of the Hahn–Banach Theorem, refer, e.g., to A. N. Michel and C. J. Herget, Applied Algebra and Functional Analysis, Dover, New York, 1993, pp. 367–370.) In that paper it is also pointed out, however, that cases with such extra nonzero terms are not necessarily of importance in applications. In particular, if inputs and outputs are deﬁned (to be nonzero) on just the non-negative integers, then for causal systems no additional term is needed (or more speciﬁcally, the extra term is zero), as seen in our earlier argument. In any event, throughout this book we will concern ourselves with linear discrete-time systems that can be represented by equation (2.55) for the single-input/single-output case (and appropriate generalizations for multi-input/multi-output cases). Next, suppose that T represents a time-invariant system. This means that if {h(n, 0)} is the response to {δ(n)}, then by time invariance, the response

62

2 Introduction to State-Space and Input–Output Descriptions of Systems

to {δ(n − k)} is simply {h(n − k, 0)}. By a slight abuse of notation, we let h(n − k, 0) h(n − k). Then (2.55) assumes the form y(n) =

∞

u(k)h(n − k).

(2.56)

k=−∞

Expression (2.56) is called a convolution sum and is written more compactly as y(n) = u(n) ∗ h(n). Now by a substitution of variables, we obtain for (2.56) the alternative expression ∞ y(n) = h(k)u(n − k), k=−∞

and therefore, we have y(n) = u(n) ∗ h(n) = h(n) ∗ u(n); i.e., the convolution operation ∗ commutes. As a speciﬁc example, consider a linear, time-invariant, discrete-time system with unit impulse response given by n a ,n≥0 h(n) = = an p(n), 0 < a < 1, 0, n < 0 where p(n) is the unit step sequence given in (2.52). It is an easy matter to show that the response of this system to an input given by u(n) = p(n) − p(n − N ) is y(n) = 0, n < 0, n 1 − 1−(n+1) 1 − an+1 y(n) = , an−k = an = −1 1−a 1−a

0 ≤ n < N,

k=0

and y(n) =

N −1 k=0

an−k = an

1 − a−N an−N +1 − an+1 , = −1 1−a 1−a

N ≤ n.

Proceeding, with reference to (2.55) we note that h(n, k) represents the system output at time n due to a δ-function input applied at time k. Now if system (2.55) is causal, then its output will be identically zero before an input is applied. Hence, a linear system (2.55) is causal if and only if

2.4 Input–Output Description of Systems

63

h(n, k) = 0 for all n < k. Therefore, when the system (2.55) is causal, we have in fact n

y(n) =

h(n, k)u(k).

(2.57a)

k=−∞

We can rewrite (2.57a) as y(n) =

k 0 −1

h(n, k)u(k) +

k=−∞

n

h(n, k)u(k)

k=k0

y(k0 − 1) +

n

h(n, k)u(k).

(2.57b)

k=k0

We say that the discrete-time system described by (2.55) is at rest at k = k0 ∈ Z if u(k) = 0 for k ≥ k0 implies that y(k) = 0 for k ≥ k0 . Accordingly, if system (2.55) is known to be at rest at k = k0 , we have y(n) =

∞

h(n, k)u(k).

k=k0

Furthermore, if system (2.55) is known to be causal and at rest at k = k0 , its input–output description assumes the form [in view of (2.57b)] y(n) =

n

h(n, k)u(k).

(2.58)

k=k0

If now, in addition, system (2.55) is also time-invariant, (2.58) becomes y(n) =

n

h(n − k)u(k) =

k=k0

n

h(k)u(n − k),

(2.59)

k=k0

which is a convolution sum. [Note that in (2.59) we have slightly abused the notation for h(·), namely that h(n − k) = h(n − k, 0)(= h(n, k).] Next, turning to linear, discrete-time, MIMO systems, we can generalize (2.55) to ∞ H(n, k)u(k), (2.60) y(n) = k=−∞

where y : Z → R , u : Z → R , and ⎡ ⎤ h11 (n, k) h12 (n, k) · · · h1m (n, k) ⎢ h21 (n, k) h22 (n, k) · · · h2m (n, k) ⎥ ⎥, H(n, k) = ⎢ ⎣ ··· ⎦ ··· ··· ··· hp1 (n, k) hp2 (n, k) · · · hpm (n, k) p

m

(2.61)

64

2 Introduction to State-Space and Input–Output Descriptions of Systems

where hij (n, k) represents the system response at time n of the ith component of y due to a discrete-time impulse δ applied at time k at the jth component of u, whereas the inputs at all other components of u are being held zero. The matrix H is called the discrete-time unit impulse response matrix of the system. Similarly, it follows that the system (2.60) is causal if and only if H(n, k) = 0 for all n < k, and that the input–output description of linear, discrete-time, causal systems is given by n H(n, k)u(k). (2.62) y(n) = k=−∞

A discrete-time system described by (2.60) is said to be at rest at k = k0 ∈ Z if u(k) = 0 for k ≥ k0 implies that y(k) = 0 for k ≥ k0 . Accordingly, if system (2.60) is known to be at rest at k = k0 , we have y(n) =

∞

H(n, k)u(k).

(2.63)

k=k0

Moreover, if a linear discrete-time system that is at rest at k0 is known to be causal, then its input–output description reduces to y(n) =

n

H(n, k)u(k).

(2.64)

k=k0

Finally, as in (2.56), it is easily shown that the unit impulse response H(n, k) of a linear, time-invariant, discrete-time MIMO system depends only on the diﬀerence of n and k; i.e., by a slight abuse of notation we can write H(n, k) = H(n − k, 0) H(n − k)

(2.65)

for all n and k. Accordingly, linear, time-invariant, causal, discrete-time MIMO systems that are at rest at k = k0 are described by equations of the form n H(n − k)u(k). (2.66) y(n) = k=k0

We conclude by supposing that the system on hand is described by (2.14) under the assumption that x(k0 ) = 0; i.e., the system is at rest at k = k0 . Then, according to (2.42) and (2.43), we obtain ⎧ ⎪ ⎨C(n)Φ(n, k + 1)B(k), n > k, H(n, k) = D(n), (2.67) n = k, ⎪ ⎩ 0, n < k.

2.4 Input–Output Description of Systems

Furthermore, for the time-invariant case, we obtain ⎧ n−(k+1) ⎪ B, n > k, ⎨CA H(n − k) = D, n = k, ⎪ ⎩ 0, n < k.

65

(2.68)

2.4.3 The Dirac Delta Distribution For any linear time-invariant operator P from C(R, R) to itself, we say that P admits an integral representation if there exists an integrable function (in the Riemann or Lebesgue sense), gp : R → R, such that for any f ∈ C(R, R),

∞ (P f )(x) = (f ∗ gp )(x) f (τ )gp (x − τ )dτ. −∞

We call gp a kernel of the integral representation of P . For the identity operator I [deﬁned by If = f for any f ∈ C(R, R)] an integral representation for which gp is a function in the usual sense does not exist (see, e.g., Z. Szmydt, Fourier Transformation and Linear Diﬀerential Equations, D. Reidel Publishing Company, Boston, 1977). However, there exists a sequence of functions {φn } such that for any f ∈ C(R, R), (If )(x) = f (x) = lim (f ∗ φn )(x).

(2.69)

n→∞

To establish (2.69) we make use of functions {φn } given by

n(1 − n|x|), if |x| ≤ n1 , φn (x) = 0, if |x| > n1 , n = 1, 2, 3, . . . . A plot of φn is depicted in Figure 2.4. In Antsaklis and Michel [1], the following useful property of φn is proved. y

n y = φ n (x)

–1/n

1/n

Figure 2.4. Generation of n delta distribution

x

66

2 Introduction to State-Space and Input–Output Descriptions of Systems

Lemma 2.1. Let f be a continuous real-valued function deﬁned on R, and let φn be deﬁned as above (Figure 2.4). Then for any a ∈ R,

∞ lim f (τ )φn (a − τ )dτ = f (a). (2.70) n→∞

−∞

The above result, when applied to (2.69), now allows us to deﬁne a generalized function δ (also called a distribution) as the kernel of a formal or symbolic integral representation of the identity operator I; i.e.,

∞ f (τ )φn (x − τ )dτ (2.71) f (x) = lim n→∞ −∞

∞ f (τ )δ(x − τ )dτ (2.72) −∞

= f ∗ δ(x).

(2.73)

It is emphasized that the expression (2.72) is not an integral at all (in the Riemann or Lebesgue sense) but only a symbolic representation. The generalized function δ is called the unit impulse or the Dirac delta distribution. In applications we frequently encounter functions f ∈ C(R+ , R). If we extend f to be deﬁned on all of R by letting f (x) = 0 for x < 0, then (2.70) becomes

∞ f (τ )φn (a − τ )dτ = f (a) (2.74) lim n→∞

0

for any a > 0, where we have used the fact that in the proof of Lemma 2.1, we need f to be continuous only in a neighborhood of a (refer to [1]). Therefore, for f ∈ C(R+ , R), (2.71) to (2.74) yield

∞

∞ lim f (τ )φn (t − τ )dτ f (τ )δ(t − τ )dτ = f (t) (2.75) n→∞

0

0

for any t > 0. Since the φn are even functions, we have φn (t − τ ) = φn (τ − t), which allows for the representation δ(t − τ ) = δ(τ − t). We obtain from (2.75) that

∞

∞ f (τ )φn (τ − t)dτ f (τ )δ(τ − t)dτ = f (t) lim n→∞

0

0

for any t > 0. Changing the variable τ = τ − t, we obtain

∞

∞ lim f (τ + t)φn (τ )dτ f (τ + t)δ(τ )dτ = f (t) n→∞

−t

−t

for any t > 0. Taking the limit t → 0+ , we obtain

∞

∞ lim f (τ + t)φn (τ )dτ f (τ )δ(τ )dτ = f (0), n→∞

0−

0−

(2.76)

2.4 Input–Output Description of Systems

67

∞ where 0− f (τ )δ(τ )dτ is not an integral but a symbolic representation of ∞ limn→∞ 0− f (τ + t)φn (τ )dτ . Now let s denote a complex variable. If in (2.75) and (2.76) we let f (τ ) = e−sτ , τ > 0, then we obtain the Laplace transform

∞

∞ −sτ lim e φn (τ )dτ e−sτ δ(τ )dτ = 1. (2.77) n→∞

0−

0−

Symbolically we denote (2.77) by L(δ) = 1,

(2.78)

and we say that the Laplace transform of the unit impulse function or the Dirac delta distribution is equal to one. Next, we point out another important property of δ. Consider a (timeinvariant) operator P and assume that P admits an integral representation with kernel gP . If in (2.75) we let f = gP , we have lim (P φn )(t) = gP (t),

n→∞

(2.79)

and we write this (symbolically) as P δ = gP .

(2.80)

This shows that the impulse response of a linear, time-invariant, continuoustime system with integral representation is equal to the kernel of the integral representation of the system. Next, for any linear time-varying operator P from C(R, R) to itself, we say that P admits an integral representation if there exists an integrable function (in the Riemann or Lebesgue sense), gP : R × R → R, such that for any f ∈ C(R, R),

∞

(P f )(η) = −∞

f (τ )gP (η, τ )dτ.

(2.81)

Again, we call gP a kernel of the integral representation of P . It turns out that the impulse response of a linear, time-varying, continuous-time system with integral representation is again equal to the kernel of the integral representation of the system. To see this, we ﬁrst observe that if h ∈ C(R × R, R), and if in Lemma 2.1 we replace f ∈ C(R, R) by h, then all the ensuing relationships still hold, with obvious modiﬁcations. In particular, as in (2.71), we have for all t ∈ R,

∞

∞ h(t, τ )φn (η − τ )dτ h(t, τ )δ(η − τ )dτ = h(t, η). (2.82) lim n→∞

−∞

−∞

Also, as in (2.75), we have

∞ lim h(t, τ )φn (η − τ )dτ n→∞

0

0

∞

h(t, τ )δ(η − τ )dτ = h(t, η)

(2.83)

68

2 Introduction to State-Space and Input–Output Descriptions of Systems

for η > 0. Now let h(t, τ ) = gP (t, τ ). Then (2.82) yields

∞

∞ lim gP (t, τ )φn (η − τ )dτ gP (t, τ )δ(η − τ )dτ = gP (t, η), (2.84) n→∞

−∞

−∞

which establishes our assertion. The common interpretation of (2.84) is that gP (t, η) represents the response of the system at time t due to an impulse applied at time η. 2.4.4 Linear Continuous-Time Systems We let P denote a linear time-varying operator from C(R, Rm ) U to C(R, Rp ) = Y , and we assume that P admits an integral representation given by

∞

y(t) = (P u)(t) = −∞

HP (t, τ )u(τ )dτ,

(2.85)

where HP : R × R → Rp×m , u ∈ U , and y ∈ Y and where HP is assumed to be integrable. This means that each element of HP , hPij : R × R → R is integrable (in the Riemann or Lebesgue sense). Now let y1 and y2 denote the response of system (2.85) corresponding to the input u1 and u2 , respectively, let α1 and α2 be real scalars, and let y denote the response of system (2.85) corresponding to the input α1 u1 + α2 u2 = u. Then

∞ HP (t, τ )[α1 u1 (τ ) + α2 u2 (τ )]dτ y = P (u) = P (α1 u1 + α2 u2 ) = −∞

∞

∞ HP (t, τ )u1 (τ )dτ + α2 HP (t, τ )u2 (τ )dτ = α1 −∞

−∞

= α1 P (u1 ) + α2 P (u2 ) = α1 y1 + α2 y2 ,

(2.86)

which shows that system (2.85) is indeed a linear system in the sense deﬁned in (2.50). Next, we let all components of u(τ ) in (2.85) be zero, except for the jth component. Then the ith component of y(t) in (2.85) assumes the form

∞ hPij (t, τ )uj (τ )dτ. (2.87) yi (t) = −∞

According to the results of the previous subsection [see (2.84)], hPij (t, τ ) denotes the response of the ith component of the output of system (2.85), measured at time t, due to an impulse applied to the jth component of the input of system (2.85), applied at time τ , whereas all of the remaining components of the input are zero. Therefore, we call HP (t, τ ) = [hPij (t, τ )] the impulse response matrix of system (2.85).

2.4 Input–Output Description of Systems

69

Now suppose that it is known that system (2.85) is causal. Then its output will be identically zero before an input is applied. It follows that system (2.85) is causal if and only if HP (t, τ ) = 0 for all t < τ . Therefore, when system (2.85) is causal, we have in fact that

t

y(t) = −∞

HP (t, τ )u(τ )dτ.

(2.88)

We can rewrite (2.88) as

t0

y(t) = −∞

t

HP (t, τ )u(τ )dτ +

HP (t, τ )u(τ )dτ t0

t

y(t0 ) +

HP (t, τ )u(τ )dτ.

(2.89)

t0

We say that the continuous-time system (2.85) is at rest at t = t0 if u(t) = 0 for t ≥ t0 implies that y(t) = 0 for t ≥ t0 . Note that our problem formulation mandates that the system be at rest at t0 = −∞. Also, note that if a system (2.85) is known to be causal and to be at rest at t = t0 , then according to (2.89) we have

t

y(t) =

HP (t, τ )u(τ )dτ.

(2.90)

t0

Next, suppose that it is known that the system (2.85) is time-invariant. This means that if in (2.87) hPij (t, τ ) is the response yi at time t due to an impulse applied at time τ at the jth component of the input [i.e., uj (τ ) = δ(t)], with all other input components set to zero, then a −τ time shift in the input [i.e., uj (t − τ ) = δ(t − τ )] will result in a corresponding −τ time shift in the response, which results in hPij (t− τ, 0). Since this argument holds for all t, τ ∈ R and for all i = 1, . . . , p, and j = 1, . . . , m, we have HP (t, τ ) = HP (t − τ, 0). If we deﬁne (using a slight abuse of notation) HP (t − τ, 0) = HP (t − τ ), then (2.85) assumes the form

∞ y(t) = HP (t − τ )u(τ )dτ. (2.91) −∞

Note that (2.91) is consistent with the deﬁnition of the integral representation of a linear time-invariant operator introduced in the previous subsection. The right-hand side of (2.91) is the familiar convolution integral of HP and u and is written more compactly as y(t) = (HP ∗ u)(t).

(2.92)

70

2 Introduction to State-Space and Input–Output Descriptions of Systems

We note that since HP (t− τ ) represents responses at time t due to impulse inputs applied at time τ , then HP (t) represents responses at time t due to impulse function inputs applied at τ = 0. Therefore, a linear time-invariant system (2.91) is causal if and only if HP (t) = 0 for all t < 0. If it is known that the linear time-invariant system (2.91) is causal and is at rest at t0 , then we have

t

t y(t) = HP (t − τ )u(τ )dτ = HP (τ )u(t − τ )dτ. (2.93) t0

t0

In this case it is customary to choose, without loss of generality, t0 = 0. We thus have

t y(t) = HP (t − τ )u(τ )dτ, t ≥ 0. (2.94) 0

If we take the Laplace transform of both sides of (2.94), provided it exists, we obtain % P (s)ˆ u(s), (2.95) yˆ(s) = H ˆ P (s)], uˆ(s) = [ˆ % P (s) = [h where yˆ(s) = [ˆ y1 (s), . . . , yˆp (s)]T , H u1 (s), . . . , u ˆm (s)]T ij ˆ P (s) denote the Laplace transforms of yi (t), where the yˆi (s), u ˆj (s), and h ij uj (t), and hP ij (t), respectively [see Chapter 3 for more details concerning % P (s) represents Laplace transforms]. Consistent with (2.78), we note that H % P (s) the Laplace transform of the impulse response matrix HP (t). We call H a transfer function matrix. Now suppose that the input–output relation of a system is speciﬁed by the state and output equations (2.3), repeated here as x˙ = A(t)x + B(t)u,

(2.96a)

y = C(t)x + D(t)u.

(2.96b)

If we assume that x(t0 ) = 0 so that the system is at rest at t0 = 0, we obtain for the response of this system,

t C(t)Φ(t, τ )B(τ )u(τ )dτ + D(t)u(t) (2.97) y(t) = t0 t

[C(t)Φ(t, τ )B(τ ) + D(t)δ(t − τ )]u(τ )dτ,

=

(2.98)

t0

where in (2.98) we have made use of the interpretation of δ given in Subsection 2.4.3. Comparing (2.98) with (2.90), we conclude that the impulse response matrix for system (2.96) is given by

C(t)Φ(t, τ )B(τ ) + D(t)δ(t − τ ), t ≥ τ, (2.99) HP (t, τ ) = 0, t < τ.

2.5 Summary and Highlights

71

Finally, for time-invariant systems described by the state and output equations (2.7), repeated here as x˙ = Ax + Bu,

(2.100a)

y = Cx + Du,

(2.100b)

we obtain for the impulse response matrix the expression

CeA(t−τ ) B + Dδ(t − τ ), t ≥ τ, HP (t − τ ) = 0, t < τ, or, as is more commonly written,

CeAt B + Dδ(t), t ≥ 0, HP (t) = 0, t < 0.

(2.101)

(2.102)

We will pursue the topics of this section further in Chapter 3.

2.5 Summary and Highlights Internal Descriptions •

The response of the time-varying continuous-time system x˙ = A(t)x + B(t)u,

y = C(t)x + D(t)u,

(2.3)

with x(t0 ) = x0 is given by

t

y(t) = C(t)Φ(t, t0 )x0 + C(t)

Φ(t, s)B(s)u(s)ds + D(t)u(t).

(2.6)

t0

•

The response of the time-invariant continuous-time system x˙ = Ax + Bu,

y = Cx + Du,

(2.7)

eA(t−s) Bu(s)ds + Du(t).

(2.9)

is given by

t

y(t) = CeA(t−t0 ) x0 + C t0

•

The response of the discrete-time system x(k + 1) = A(k)x(k) + B(k)u(k), with x(k0 ) = xk0 is given by

y(k) = C(k)x(k) + D(k)u(k), (2.14)

72

2 Introduction to State-Space and Input–Output Descriptions of Systems

y(k) = C(k)Φ(k, k0 )xk0 + C(k)

k−1

Φ(k, j + 1)B(j)u(j)

j=k0

+ D(k)u(k),

k > k0

(2.42)

and y(k0 ) = C(k0 )xk0 + D(k0 )u(k0 ),

(2.43)

where the state transition matrix Φ(k, k0 ) =

k−1

A(j),

k > k0 ,

(2.31)

j=k0

Φ(k0 , k0 ) = I.

(2.32)

In the time-invariant case x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k),

(2.15)

with x(k) = xk0 , the system response is given by k−1

y(k) = CAk−k0 xk0 + C

Ak−(j+1) B(j)u(j) + Du(k),

k > k0 , (2.44)

j=k0

and y(k0 ) = Cxk0 + Du(k0 ).

(2.45)

External Descriptions • •

Properties: Linearity (2.50); with memory; causality; time-invariance The input–output description of a linear, discrete-time, causal, timeinvariant system that is at rest at k = k0 is given by y(n) =

n

h(n − k)u(k) =

k=k0

•

n

h(k)u(n − k).

(2.59)

k=k0

h(n − k)(= h(n − k, 0)) is the discrete-time unit impulse response of the system. For the discrete-time, time-invariant system x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k),

the discrete-time unit impulse response (for the ⎧ n−(k+1) ⎪ B, ⎨CA H(n − k) = D, ⎪ ⎩ 0,

MIMO case) is n > k, n = k, n < k.

(2.68)

References

•

73

The unit impulse (Dirac delta distribution) δ(t) satisﬁes

b

f (τ )δ(t − τ )dτ = f (t), a

•

where a < t < b [see (2.75)]. The input–output description of a linear, continuous-time, causal, timeinvariant system that is at rest at t = t0 is given by

t

t HP (t − τ )u(τ )dτ = HP (τ )u(t − τ )dτ. (2.93) y(t) = t0

•

t0

HP (t − τ )(= HP (t − τ, 0)) is the continuous-time unit impulse response of the system. For the time-invariant system x˙ = Ax + Bu

y = Cx + Du,

the continuous-time unit impulse response is

CeA(t−τ ) B + Dδ(t − τ ), HP (t − τ ) = 0,

t ≥ τ, t < τ.

(2.100)

(2.101)

2.6 Notes An original standard reference on linear systems is by Zadeh and Desoer [7]. Of the many excellent texts on this subject, the reader may want to refer to Brockett [2], Kailath [5], and Chen [3]. For more recent texts on linear systems, consult, e.g., Rugh [6] and DeCarlo [4]. The presentation in this book relies mostly on the recent text by Antsaklis and Michel [1].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. R.W. Brockett, Finite Dimensional Linear Systems, Wiley, New York, NY, 1970. 3. C.T. Chen, Linear System Theory and Design, Holt, Rinehart and Winston, New York, NY, 1984. 4. R.A. DeCarlo, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1989. 5. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 6. W.J. Rugh, Linear System Theory, Second Edition, Prentice-Hall, Englewood Cliﬀs, NJ, 1996. 7. L.A. Zadeh and C.A. Desoer, Linear System Theory - The State Space Approach, McGraw-Hill, New York, NY, 1963.

74

2 Introduction to State-Space and Input–Output Descriptions of Systems

Exercises 2.1. (a) For the mechanical system given in Exercise 1.2a, we view f1 and f2 as making up the system input vector, and y1 and y2 the system output vector. Determine a state-space description for this system. (b) For the same mechanical system, we view f1 + 5f2 as the (scalar-valued) system input and we view 8y1 +10y2 as the (scalar-valued) system output. Determine a state-space description for this system. (c) For part (a), determine the input–output description of the system. (d) For part (b), determine the input–output description of the system. 2.2. In Example 1.3, we view ea and θ as the system input and output, respectively. (a) Detemine a state-space representation for this system. (b) Determine the input–output description of this system. 2.3. For the second-order section digital ﬁlter in direct form, given in Figure 2.1, determine the input–output description, where x1 (k) and u(k) denote the output and input, respectively. 2.4. In the circuit of Figure 2.5, vi (t) and v0 (t) are voltages (at time t) and R1 and R2 are resistors. There is also an ideal diode that acts as a short circuit when vi is positive and as an open circuit when vi is negative. We view vi and v0 as the system input and output, respectively. (a) Determine an input–output description of this system. (b) Is this system linear? Is it time-varying or time-invariant? Is it causal? Explain your answers.

+ +

R1

–

Diode

i(t)

v i (t)

+ R2

–

v 0 (t) –

Figure 2.5. Diode circuit

2.5. We consider the truncation operator given by y(t) = Tτ (u(t)) as a system, where τ ∈ R is ﬁxed, u and y denote system input and output, respectively, t denotes time, and Tτ (·) is speciﬁed by

Exercises

Tτ (u(t)) =

75

u(t) t ≤ τ, 0 t > τ.

Is this system causal? Is it linear? Is it time-invariant? What is its impulse response? 2.6. We consider the shift operator given by y(t) = Qτ (u(t)) = u(t − τ ) as a system, where τ ∈ R is ﬁxed, u and y denote system input and system output, respectively, and t denotes time. Is this system causal? Is it linear? Is it time-invariant? What is its impulse response? 2.7. Consider the system whose input–output description is given by y(t) = min{u1 (t), u2 (t)}, where u(t) = [u1 (t), u2 (t)]T denotes the system input and y(t) is the system output. Is this system linear? 2.8. Suppose it is known that a linear system has impulse response given by h(t, τ ) = exp(−|t − τ |). Is this system causal? Is it time-invariant? 2.9. Consider a system with input–output description given by y(k) = 3u(k + 1) + 1,

k ∈ Z,

where y and u denote the output and input, respectively (recall that Z denotes the integers). Is this system causal? Is it linear? 2.10. Use expression (2.54), x(n) =

∞

x(k)δ(n − k),

k=−∞

and δ(n) = p(n) − p(n − 1) to express the system response y(n) due to any input u(k), as a function of the unit step response of the system [i.e., due to u(k) = p(k)].

4 Stability

Dynamical systems, either occurring in nature or man made, usually function in some speciﬁed mode. The most common such modes are operating points that frequently turn out to be equilibria. In this chapter we will concern ourselves primarily with the qualitative behavior of equilibria. Most of the time, we will be interested in the asymptotic stability of an equilibrium (operating point), which means that when the state of a given system is displaced (disturbed) from its desired operating point (equilibrium), the expectation is that the state will eventually return to the equilibrium. For example, in the case of an automobile under cruise control, traveling at the desired constant speed of 50 mph (which determines the operating point, or equilibrium condition), perturbations due to hill climbing (hill descending), will result in decreasing (increasing) speeds. In a properly designed cruise control system, it is expected that the car will return to its desired operating speed of 50 mph. Another qualitative characterization of dynamical systems is the expectation that bounded system inputs will result in bounded system outputs, and that small changes in inputs will result in small changes in outputs. System properties of this type are referred to as input–output stability. Such properties are important for example in tracking systems, where the output of the system is expected to follow a desired input. Frequently, it is possible to establish a connection between the input–output stability properties and the Lyapunov stability properties of an equilibrium. In the case of linear systems, this connection is well understood. This will be addressed in Section 7.3.

4.1 Introduction In this chapter we present a brief introduction to stability theory. We are concerned primarily with linear systems and systems that are a consequence of linearizations of nonlinear systems. As in the other chapters of this book, we consider ﬁnite-dimensional continuous-time systems and ﬁnite-dimensional

142

4 Stability

discrete-time systems described by systems of ﬁrst-order ordinary diﬀerential equations and systems of ﬁrst-order ordinary diﬀerence equations, respectively. In Section 4.2 we introduce the concept of equilibrium of dynamical systems described by systems of ﬁrst-order ordinary diﬀerential equations, and in Section 4.3 we give deﬁnitions of various types of stability in the sense of Lyapunov (including stability, uniform stability, asymptotic stability, uniform asymptotic stability, exponential stability, and instability). In Section 4.4 we establish conditions for the various Lyapunov stability and instability types enumerated in Section 4.3 for linear systems x˙ = Ax. Most of these results are phrased in terms of the properties of the state transition matrix for such systems. In Section 4.5 we introduce the Second Method of Lyapunov, also called the Direct Method of Lyapunov, to establish necessary and suﬃcient conditions for various Lyapunov stability types of an equilibrium for linear systems x˙ = Ax. These results, which are phrased in terms of the system parameters [coeﬃcients of the matrix A], give rise to the Lyapunov matrix equation. In Section 4.6 we use the Direct Method of Lyapunov in deducing the asymptotic stability and instability of an equilibrium of nonlinear autonomous systems x˙ = Ax + F (x) from the stability properties of their linearizations w˙ = Aw. In Section 4.7 we establish necessary and suﬃcient conditions for the input–output stability (more precisely, for the bounded input/bounded output stability) of continuous-time, linear, time-invariant systems. These results involve the system impulse response matrix. The stability results presented in Sections 4.2 through and including Section 4.7 pertain to continuous-time systems. In Section 4.8 we present analogous stability results for discrete-time systems.

4.2 The Concept of an Equilibrium In this section we concern ourselves with systems of ﬁrst-order autonomous ordinary diﬀerential equations, x˙ = f (x),

(4.1)

where x ∈ Rn . When discussing global results, we shall assume that f : Rn → Rn , while when considering local results, we may assume that f : B(h) → Rn for some h > 0, where B(h) = {x ∈ Rn : x < h} and · denotes a norm on Rn . Unless otherwise stated, we shall assume that for every (t0 , x0 ), t0 ∈ R+ , the initial-value problem x˙ = f (x),

x(t0 ) = x0

(4.2)

possesses a unique solution φ(t, t0 , x0 ) that exists for all t ≥ t0 and that depends continuously on the initial data (t0 , x0 ). Refer to Section 1.5 for

4.2 The Concept of an Equilibrium

143

conditions that ensure that (4.2) has these properties. Since (4.1) is timeinvariant, we may assume without loss of generality that t0 = 0 and we will denote the solutions of (4.1) by φ(t, x0 ) (rather than φ(t, t0 , x0 )) with x(0) = x0 . Deﬁnition 4.1. A point xe ∈ Rn is called an equilibrium point of (4.1), or simply an equilibrium of (4.1), if f (xe ) = 0. We note that φ(t, xe ) = xe

for all t ≥ 0;

i.e., the equilibrium xe is the unique solution of (4.1) with initial data given by φ(0, xe ) = xe . We will usually assume that in a given discussion, unless otherwise stated, the equilibrium of interest is located at the origin of Rn . This assumption can be made without loss of generality by noting that if xe = 0 is an equilibrium point of (4.1), i.e., f (xe ) = 0, then by letting w = x − xe , we obtain the transformed system w˙ = F (w) (4.3) with F (0) = 0, where F (w) = f (w + xe ).

(4.4)

Since the above transformation establishes a one-to-one correspondence between the solutions of (4.1) and (4.3), we may assume henceforth that the equilibrium of interest for (4.1) is located at the origin. This equilibrium, x = 0, will be referred to as the trivial solution of (4.1). Before concluding this section, it may be fruitful to consider some speciﬁc cases. Example 4.2. In Example 1.4 we considered the simple pendulum given in Figure 1.7. Letting x1 = x and x2 = x˙ in (1.37), we obtain the system of equations x˙ 1 = x2 , x˙ 2 = −k sin x1 ,

(4.5)

where k > 0 is a constant. Physically, the pendulum has two equilibrium points: one where the mass M is located vertically at the bottom of the ﬁgure (i.e., at 6 o’clock) and the other where the mass is located vertically at the top of the ﬁgure (i.e., at 12 o’clock). The model of this pendulum, however, described by (4.5), has countably inﬁnitely many equilibrium points that are located in R2 at the points (πn, 0)T , n = 0, ±1, ±2, . . . .

144

4 Stability

Example 4.3. The linear, autonomous, homogenous system of ordinary differential equations x˙ = Ax (4.6) has a unique equilibrium that is at the origin if and only if A is nonsingular. Otherwise, (4.6) has nondenumerably many equilibria. [Refer to Chapter 1 for the deﬁnitions of symbols in (4.6).]

Example 4.4. Assume that for x˙ = f (x),

(4.7)

f is continuously diﬀerentiable with respect to all of its arguments, and let ∂f (x) , J(xe ) = ∂x x=xe where ∂f /∂x denotes the n × n Jacobian matrix deﬁned by ∂f ∂fi = . ∂x ∂xj If f (xe ) = 0 and J(xe ) is nonsingular, then xe is an equilibrium of (4.7).

Example 4.5. The system of ordinary diﬀerential equations given by x˙ 1 = k + sin(x1 + x2 ) + x1 , x˙ 2 = k + sin(x1 + x2 ) − x1 , with k > 1, has no equilibrium points at all.

4.3 Qualitative Characterizations of an Equilibrium In this section we consider several qualitative characterizations that are of fundamental importance in systems theory. These characterizations are concerned with various types of stability properties of an equilibrium and are referred to in the literature as Lyapunov stability. Throughout this section, we consider systems of equations x˙ = f (x),

(4.8)

and we assume that (4.8) possesses an equilibrium at the origin. We thus have f (0) = 0.

4.3 Qualitative Characterizations of an Equilibrium

145

Deﬁnition 4.6. The equilibrium x = 0 of (4.8) is said to be stable if for every > 0, there exists a δ() > 0 such that φ(t, x0 ) < for all t ≥ 0

(4.9)

x0 < δ().

(4.10)

whenever In Deﬁnition 4.6, · denotes any one of the equivalent norms on Rn , and (as in Chapters 1 and 2) φ(t, x0 ) denotes the solution of (4.8) with initial condition x(0) = x0 . The notation δ() indicates that δ depends on the choice of . In words, Deﬁnition 4.6 states that by choosing the initial points in a suﬃciently small spherical neighborhood, when the equilibrium x = 0 of (4.8) is stable, we can force the graph of the solution for t ≥ 0 to lie entirely inside a given cylinder. This is depicted in Figure 4.1 for the case x ∈ R2 .

Figure 4.1. Stability of an equilibrium

Deﬁnition 4.7. The equilibrium x = 0 of (4.8) is said to be asymptotically stable if (i) it is stable, (ii) there exists an η > 0 such that lim φ(t, x0 ) = 0 whenever x0 < η. t→∞

The set of all x0 ∈ Rn such that φ(t, x0 ) → 0 as t → ∞ is called the domain of attraction of the equilibrium x = 0 of (4.8). Also, if for (4.8) condition (ii) is true, then the equilibrium x = 0 is said to be attractive. Deﬁnition 4.8. The equilibrium x = 0 of (4.8) is exponentially stable if there exists an α > 0, and for every > 0, there exists a δ() > 0, such that φ(t, x0 ) ≤ eαt for all t ≥ 0 whenever ||x0 || < δ().

146

4 Stability φ(t)

εe –α(t – t0 ) ε δ t

t0

–εe –α(t – t0 )

Figure 4.2. An exponentially stable equilibrium

Figure 4.2 shows the behavior of a solution in the vicinity of an exponentially stable equilibrium x = 0. Deﬁnition 4.9. The equilibrium x = 0 of (4.8) is unstable if it is not stable. In this case, there exists an > 0, and a sequence xm → 0 of initial points and a sequence {tm } such that φ(tm , xm ) ≥ for all m, tm ≥ 0. If x = 0 is an unstable equilibrium of (4.8), then it still can happen that all the solutions tend to zero with increasing t. This indicates that instability and attractivity of an equilibrium are compatible concepts. We note that the equilibrium x = 0 of (4.8) is necessarily unstable if every neighborhood of the origin contains initial conditions corresponding to unbounded solutions (i.e., solutions whose norm grows to inﬁnity on a sequence tm → ∞). However, it can happen that a system (4.8) with unstable equilibrium x = 0 may have only bounded solutions. The concepts that we have considered thus far pertain to local properties of an equilibrium. In the following discussion, we consider global characterizations of an equilibrium. Deﬁnition 4.10. The equilibrium x = 0 of (4.8) is asymptotically stable in the large if it is stable and if every solution of (4.8) tends to zero as t → ∞. When the equilibrium x = 0 of (4.8) is asymptotically stable in the large, its domain of attraction is all of Rn . Note that in this case, x = 0 is the only equilibrium of (4.8). Deﬁnition 4.11. The equilibrium x = 0 of (4.8) is exponentially stable in the large if there exists α > 0 and for any β > 0, there exists k(β) > 0 such that φ(t, x0 ) ≤ k(β) x0 e−αt for all t ≥ 0 whenever x0 < β.

4.3 Qualitative Characterizations of an Equilibrium

147

We conclude this section with a few speciﬁc cases. The scalar diﬀerential equation x˙ = 0

(4.11)

has for any initial condition x(0) = x0 the solution φ(t, x0 ) = x0 ; i.e., all solutions are equilibria of (4.11). The trivial solution is stable; however, it is not asymptotically stable. The scalar diﬀerential equation x˙ = ax

(4.12)

has for every x(0) = x0 the solution φ(t, x0 ) = x0 eat , and x = 0 is the only equilibrium of (4.12). If a > 0, this equilibrium is unstable, and when a < 0, this equilibrium is exponentially stable in the large. As mentioned earlier, a system x˙ = f (x)

(4.13)

can have all solutions approaching an equilibrium, say, x = 0, without this equilibrium being asymptotically stable. An example of this type of behavior is given by the nonlinear system of equations x21 (x2 − x1 ) + x52 , (x21 + x22 )[1 + (x21 + x22 )2 ] x22 (x2 − 2x1 ) x˙ 2 = 2 . (x1 + x22 )[1 + (x21 + x22 )2 ]

x˙ 1 =

For a detailed discussion of this system, refer to [6], pp. 191–194, cited at the end of this chapter. Before proceeding any further, a few comments are in order concerning the reasons for considering equilibria and their stability properties as well as other types of stability that we will encounter. To this end we consider linear time-invariant systems given by x˙ = Ax + Bu,

(4.14a)

y = Cx + Du,

(4.14b)

where all symbols in (4.14) are deﬁned as in (2.7). The usual qualitative analysis of such systems involves two concepts, internal stability and input– output stability. In the case of internal stability, the output equation (4.14b) plays no role whatsoever, the system input u is assumed to be identically zero, and the focus of the analysis is concerned with the qualitative behavior of the solutions of linear time-invariant systems x˙ = Ax (4.15)

148

4 Stability

near the equilibrium x = 0. This is accomplished by making use of the various types of Lyapunov stability concepts introduced in this section. In other words, internal stability of system (4.14) concerns the Lyapunov stability of the equilibrium x = 0 of system (4.15). In the case of input–output stability, we view systems as operators determined by (4.14) that relate outputs y to inputs u and the focus of the analysis is concerned with qualitative relations between system inputs and system outputs. We will address this type of stability in Section 4.7.

4.4 Lyapunov Stability of Linear Systems In this section we ﬁrst study the stability properties of the equilibrium x = 0 of linear autonomous homogeneous systems x˙ = Ax,

t ≥ 0.

(4.16)

Recall that x = 0 is always an equilibrium of (4.16) and that x = 0 is the only equilibrium of (4.16) if A is nonsingular. Recall also that the solution of (4.16) for x(0) = x0 is given by φ(t, x0 ) = Φ(t, 0)x0 = Φ(t − 0, 0)x0 Φ(t)x0 = eAt x0 , where in the preceding equation, a slight abuse of notation has been used. We ﬁrst consider some of the basic properties of system (4.16). Theorem 4.12. The equilibrium x = 0 of (4.16) is stable if and only if the solutions of (4.16) are bounded, i.e., if and only if sup Φ(t) k < ∞, t≥t0

where Φ(t) denotes the matrix norm induced by the vector norm used on Rn and k denotes a constant. Proof. Assume that the equilibrium x = 0 of (4.16) is stable. Then for = 1 there is a δ = δ(1) > 0 such that φ(t, x0 ) < 1 for all t ≥ 0 and all x0 with x0 ≤ δ. In this case φ(t, x0 ) = Φ(t)x0 = [Φ(t)(x0 δ)/ x0 ] ( x0 /δ) < x0 /δ for all x0 = 0 and all t ≥ 0. Using the deﬁnition of matrix norm [refer to Section A.7], it follows that Φ(t) ≤ δ −1 ,

t ≥ 0.

We have proved that if the equilibrium x = 0 of (4.16) is stable, then the solutions of (4.16) are bounded.

4.4 Lyapunov Stability of Linear Systems

149

Conversely, suppose that all solutions φ(t, x0 ) = Φ(t)x0 are bounded. Let {e1 , . . . , en } denote the natural basis for n-space, and let φ(t, ej ) < βj for all t ≥ 0. Then for any vector x0 = nj=1 αj ej we have that φ(t, x0 ) =

n

αj φ(t, ej ) ≤

j=1

≤ (max βj ) j

n

|αj |βj

j=1 n

|αj | ≤ k x0

j=1

for some constant k > 0 for t ≥ 0. For given > 0, we choose δ = /k. Thus, if x0 < δ, then φ(t, x0 ) < k x0 < for all t ≥ 0. We have proved that if the solutions of (4.16) are bounded, then the equilibrium x = 0 of (4.16) is stable. Theorem 4.13. The following statements are equivalent. (i) The equilibrium x = 0 of (4.16) is asymptotically stable. (ii) The equilibrium x = 0 of (4.16) is asymptotically stable in the large. (iii) limt→∞ Φ(t) = 0. Proof. Assume that statement (i) is true. Then there is an η > 0 such that when x0 ≤ η, then φ(t, x0 ) → 0 as t → ∞. But then we have for any x0 = 0 that φ(t, x0 ) = φ(t, ηx0 / x0 )( x0 /η) → 0 as t → ∞. It follows that statement (ii) is true. Next, assume that statement (ii) is true. For any > 0, there must exist a T () > 0 such that for all t ≥ T () we have that φ(t, x0 ) = Φ(t)x0 < . To see this, let {e1 , . . . , en } be the natural basis for Rn . Thus, for some ﬁxed n constant k > 0, if x0 = (α1 , . . . , αn )T and if x0 ≤ 1, then x0 = j=1 αj ej n and j=1 |αj | ≤ k. For each j, there is a Tj () such that Φ(t)ej < /k and t ≥ Tj (). Deﬁne T () = max{Tj () : j = 1, . . . , n}. For x0 ≤ 1 and t ≥ T (), we have that Φ(t)x0 =

n j=1

αj Φ(t)ej ≤

n

|αj |(/k) ≤ .

j=1

By the deﬁnition of the matrix norm [see the appendix], this means that Φ(t) ≤ for t ≥ T (). Therefore, statement (iii) is true. Finally, assume that statement (iii) is true. Then Φ(t) is bounded in t for all t ≥ 0. By Theorem 4.12, the equilibrium x = 0 is stable. To prove asymptotic stability, ﬁx > 0. If x0 < η = 1, then φ(t, x0 ) ≤ Φ(t) x0 → 0 as t → ∞. Therefore, statement (i) is true. This completes the proof.

150

4 Stability

Theorem 4.14. The equilibrium x = 0 of (4.16) is asymptotically stable if and only if it is exponentially stable. Proof. The exponential stability of the equilibrium x = 0 implies the asymptotic stability of the equilibrium x = 0 of systems (4.13) in general and, hence, for systems (4.16) in particular. Conversely, assume that the equilibrium x = 0 of (4.16) is asymptotically stable. Then there is a δ > 0 and a T > 0 such that if x0 ≤ δ, then Φ(t + T )x0 < δ/2 for all t ≥ 0. This implies that Φ(t + T ) ≤

1 if t ≥ 0. 2

(4.17)

From Theorem 3.9 (iii) we have that Φ(t − τ ) = Φ(t − σ)Φ(σ − τ ) for any t, σ, and τ . Therefore, Φ(t + 2T ) = Φ(t + 2T − t − T )Φ(t + T ) ≤

1 , 4

in view of (4.17). By induction, we obtain for t ≥ 0 that Φ(t + nT ) ≤ 2−n .

(4.18)

Now let α = (ln2)/T . Then (4.18) implies that for 0 ≤ t < T we have that φ(t + nT, x0 ) ≤ 2 x0 2−(n+1) = 2 x0 e−α(n+1)T ≤ 2 x0 e−α(t+nT ) ,

which proves the result.

Even though the preceding results require knowledge of the state transition matrix Φ(t) of (4.16), they are quite useful in the qualitative analysis of linear systems. In view of the above results, we can state the following equivalent deﬁnitions. The equilibrium x = 0 of (4.16) is stable if and only if there exists a ﬁnite positive constant γ, such that for any x0 , the corresponding solution satisﬁes the inequality φ(t, x0 ) ≤ γ x0 , t ≥ 0. Furthermore, in view of the above results, if the equilibrium x = 0 of (4.16) is asymptotically stable, then in fact it must be globally asymptotically stable, and exponentially stable in the large. In this case there exist ﬁnite constants γ ≥ 1 and λ > 0 such that φ(t, x0 ) ≤ γe−λt x0 for t ≥ 0 and x0 ∈ Rn .

4.4 Lyapunov Stability of Linear Systems

151

We now continue our investigation of system (4.16) by referring to the discussion in Subsection 3.3.2 [refer to (3.23) to (3.39)] concerning the use of the Jordan canonical form to compute exp(At). We let J = P −1 AP and deﬁne x = P y. Then (4.16) yields y˙ = P −1 AP y = Jy.

(4.19)

It is easily veriﬁed (the reader is asked to do so in the Exercises section) that the equilibrium x = 0 of (4.16) is stable (resp., asymptotically stable or unstable) if and only if y = 0 of (4.19) is stable (resp., asymptotically stable or unstable). In view of this, we can assume without loss of generality that the matrix A in (4.16) is in Jordan canonical form, given by A = diag[J0 , J1 , . . . , Js ], where J0 = diag[λ1 , . . . , λk ] and Ji = λk+i Ii + Ni for the Jordan blocks J1 , . . . , Js . As in (3.33), (3.34), (3.38), and (3.39), we have ⎤ ⎡ Jt e 0 0 ⎥ ⎢ eJ1 t ⎥ ⎢ eAt = ⎢ ⎥, .. ⎦ ⎣ . Js t 0 e where eJ0 t = diag[eλ1 t , . . . , eλk t ]

(4.20)

⎡

and eJi t

⎤ 1 t t2 /2 · · · tni −1 /(ni − 1)! ⎢ 0 1 t · · · tni −2 /(ni − 2)! ⎥ ⎢ ⎥ = eλk+i t ⎢ . . . ⎥ .. ⎣ .. .. .. ⎦ . 0 0 0 ··· 1

(4.21)

for i = 1, . . . , s. Now suppose that Reλi ≤ β for all i = 1, . . . , k. Then it is clear that limt→∞ ( eJ0 t /eβt ) < ∞, where eJ0 t is the matrix norm induced by one of the equivalent vector norms deﬁned on Rn . We write this as eJ0 t = O(eβt ). Similarly, if β = Reλk+i , then for any > 0 we have that eJi t = O(tni −1 eβt ) = O(e(β+ )t ). From the foregoing it is now clear that eAt ≤ K for some K > 0 if and only if all eigenvalues of A have nonpositive real parts, and the eigenvalues with zero real part occur in the Jordan form only in J0 and not in any of the Jordan blocks Ji , 1 ≤ i ≤ s. Hence, by Theorem 4.12, the equilibrium x = 0 of (4.16) is under these conditions stable.

152

4 Stability

Now suppose that all eigenvalues of A have negative real parts. From the preceding discussion it is clear that there is a constant K > 0 and an α > 0 such that eAt ≤ Ke−αt , and therefore, φ(t, x0 ) ≤ Ke−αt x0 for all t ≥ 0 and for all x0 ∈ Rn . It follows that the equilibrium x = 0 is asymptotically stable in the large, in fact exponentially stable in the large. Conversely, assume that there is an eigenvalue λi with a nonnegative real part. Then either one term in (4.20) does not tend to zero, or else a term in (4.21) is unbounded as t → ∞. In either case, eAt x(0) will not tend to zero when the initial condition x(0) = x0 is properly chosen. Hence, the equilibrium x = 0 of (4.16) cannot be asymptotically stable (and, hence, it cannot be exponentially stable). Summarizing the above, we have proved the following result. Theorem 4.15. The equilibrium x = 0 of (4.16) is stable, if and only if all eigenvalues of A have nonpositive real parts, and every eigenvalue with zero real part has an associated Jordan block of order one. The equilibrium x = 0 of (4.16) is asymptotically stable in the large, in fact exponentially stable in the large, if and only if all eigenvalues of A have negative real parts. A direct consequence of the above result is that the equilibrium x = 0 of (4.16) is unstable if and only if at least one of the eigenvalues of A has either positive real part or has zero real part that is associated with a Jordan block of order greater than one. At this point, it may be appropriate to take note of certain conventions concerning matrices that are used in the literature. It should be noted that some of these are not entirely consistent with the terminology used in Theorem 4.15. Speciﬁcally, a real n × n matrix A is called stable or a Hurwitz matrix if all its eigenvalues have negative real parts. If at least one of the eigenvalues has a positive real part, then A is called unstable. A matrix A, which is neither stable nor unstable, is called critical, and the eigenvalues with zero real parts are called critical eigenvalues. We conclude our discussion concerning the stability of (4.16) by noting that the results given above can also be obtained by directly using the facts established in Subsection 3.3.3, concerning modes and asymptotic behavior of time-invariant systems. Example 4.16. We consider the system (4.16) with 01 A= . −1 0 The eigenvalues of A are λ1 , λ2 = ±j. According to Theorem 4.15, the equilibrium x = 0 of this system is stable. This can also be veriﬁed by computing the solution of this system for a given set of initial data x(0)T = (x1 (0), x2 (0)), φ1 (t, x0 ) = x1 (0) cos t + x2 (0) sin t, φ2 (t, x0 ) = −x1 (0) sin t + x2 (0) cos t,

4.5 The Lyapunov Matrix Equation

153

t ≥ 0, and then applying Deﬁnition 4.6.

Example 4.17. We consider the system (4.16) with 01 A= . 00 The eigenvalues of A are λ1 = 0, λ2 = 0. According to Theorem 4.15, the equilibrium x = 0 of this system is unstable. This can also be veriﬁed by computing the solution of this system for a given set of initial data x(0)T = (x1 (0), x2 (0)), φ1 (t, x0 ) = x1 (0) + x2 (0)t, φ2 (t, x0 ) = x2 (0), t ≥ 0, and then applying Deﬁnition 4.9. (Note that in this example, the entire x1 -axis consists of equilibria.)

Example 4.18. We consider the system (4.16) with 2.8 9.6 A= . 9.6 −2.8 The eigenvalues of A are λ1 , λ2 = ±10. According to Theorem 4.15, the equilibrium x = 0 of this system is unstable.

Example 4.19. We consider the system (4.16) with −1 0 A= . −1 −2 The eigenvalues of A are λ1 , λ2 = −1, −2. According to Theorem 4.15, the equilibrium x = 0 of this system is exponentially stable.

4.5 The Lyapunov Matrix Equation In Section 4.4 we established a variety of stability results that require explicit knowledge of the solutions of (4.16). In this section we will develop stability criteria for (4.16) with arbitrary matrix A. In doing so, we will employ Lyapunov’s Second Method (also called Lyapunov’s Direct Method ) for the case of linear systems (4.16). This method utilizes auxiliary real-valued functions

154

4 Stability

v(x), called Lyapunov functions, that may be viewed as generalized energy functions or generalized distance functions (from the equilibrium x = 0), and the stability properties are then deduced directly from the properties of v(x) and its time derivative v(x), ˙ evaluated along the solutions of (4.16). A logical choice of Lyapunov function is v(x) = xT x = x 2 , which represents the square of the Euclidean distance of the state from the equilibrium x = 0 of (4.16). The stability properties of the equilibrium are then determined by examining the properties of v(x), ˙ the time derivative of v(x) along the solutions of (4.16), which we repeat here, x˙ = Ax.

(4.22)

This derivative can be determined without explicitly solving for the solutions of (4.22) by noting that v(x) ˙ = x˙ T x + xT x˙ = (Ax)T x + xT (Ax) = xT (AT + A)x. If the matrix A is such that v(x) ˙ is negative for all x = 0, then it is reasonable to expect that the distance of the state of (4.22) from x = 0 will decrease with increasing time, and that the state will therefore tend to the equilibrium x = 0 of (4.22) with increasing time t. It turns out that the Lyapunov function used in the above discussion is not suﬃciently ﬂexible. In the following discussion, we will employ as a “generalized distance function” the quadratic form given by v(x) = xT P x,

P = PT,

(4.23)

where P is a real n × n matrix. The time derivative of v(x) along the solutions of (4.22) is determined as v(x) ˙ = x˙ T P x + xT P x˙ = xT AT P x + xT P Ax = xT (AT P + P A)x; i.e., v˙ = xT Cx,

(4.24)

C = AT P + P A.

(4.25)

where T

Note that C is real and C = C. The system of equations given in (4.25) is called the Lyapunov Matrix Equation. We recall that since P is real and symmetric, all its eigenvalues are real. Also, we recall that P is said to be positive deﬁnite (resp., positive semidefinite) if all its eigenvalues are positive (resp., nonnegative), and it is called indeﬁnite if P has eigenvalues of opposite sign. The concepts of negative definite and negative semideﬁnite (for P ) are similarly deﬁned. Furthermore,

4.5 The Lyapunov Matrix Equation

155

we recall that the function v(x) given in (4.23) is said to be positive deﬁnite, positive semideﬁnite, indeﬁnite, and so forth, if P has the corresponding deﬁniteness properties. Instead of solving for the eigenvalues of a real symmetric matrix to determine its deﬁniteness properties, there are more eﬃcient and direct methods of accomplishing this. We now digress to discuss some of these. Let G = [gij ] be a real n×n matrix (not necessarily symmetric). Recall that the minors of G are the matrix itself and the matrix obtained by removing successively a row and a column. The principal minors of G are G itself and the matrices obtained by successively removing an ith row and an ith column, and the leading principal minors of G are G itself and the minors obtained by successively removing the last row and the last column. For example, if G = [gij ] ∈ R3×3 , then the principal minors are ⎡ ⎤ g11 g12 g13 g11 g12 ⎣ g21 g22 g23 ⎦ , , [g11 ], g21 g22 g31 g32 g33 g11 g13 g22 g23 , , [g22 ], [g33 ]. g31 g33 g32 g33 The ﬁrst three matrices above are the leading principal minors of G. On the other hand, the matrix g21 g22 g31 g32 is a minor but not a principal minor. The following results, due to Sylvester, allow eﬃcient determination of the deﬁniteness properties of a real, symmetric matrix. Proposition 4.20. (i) A real symmetric matrix P = [pij ] ∈ Rn×n is positive deﬁnite if and only if the determinants of its leading principal minors are positive, i.e., if and only if p p p11 > 0, det 11 12 > 0, . . . , det P > 0. p12 p22 (ii) A real symmetric matrix P is positive semideﬁnite if and only if the determinants of all of its principal minors are nonnegative. Still digressing, we consider next the quadratic form v(w) = wT Gw,

G = GT ,

where G ∈ Rn×n . Now recall that there exists an orthogonal matrix Q such that the matrix P deﬁned by P = Q−1 GQ = QT GQ

156

4 Stability

is diagonal. Therefore, if we let w = Qx, then v(Qx) v(x) = xT QT GQx = xT P x, where P is in the form given by P = diag[Λi ] i = 1, . . . , p, where Λi = diag λi . From this, we immediately obtain the following useful result. Proposition 4.21. Let P = P T ∈ Rn×n , let λM (P ) and λm (P ) denote the largest and smallest eigenvalues of P , respectively, and let · denote the Euclidean norm. Then λm (P ) x 2 ≤ v(x) = xT P x ≤ λM (P ) x 2 for all x ∈ Rn (refer to [1]).

(4.26)

Let c1 λm (P ) and c2 = λM (P ). Clearly, v(x) is positive deﬁnite if and only if c2 ≥ c1 > 0, v(x) is positive semideﬁnite if and only if c2 ≥ c1 ≥ 0, v(x) is indeﬁnite if and only if c2 > 0, c1 < 0, and so forth. We are now in a position to prove several results. Theorem 4.22. The equilibrium x = 0 of (4.22) is stable if there exists a real, symmetric, and positive deﬁnite n × n matrix P such that the matrix C given in (4.25) is negative semideﬁnite. Proof. Along any solution φ(t, x0 ) φ(t) of (4.22) with φ(0, x0 ) = φ(0) = x0 , we have

t

t d φ(η)T P φ(η)dη = xT0 P x0 + φ(η)T Cφ(η)dη φ(t)T P φ(t) = xT0 P x0 + dη 0 0 for all t ≥ 0. Since P is positive deﬁnite and C is negative semideﬁnite, we have φ(t)T P φ(t) − xT0 P x0 ≤ 0 for all t ≥ 0, and there exist c2 ≥ c1 > 0 such that c1 φ(t) 2 ≤ φ(t)T P φ(t) ≤ xT0 P x0 ≤ c2 x0 2 for all t ≥ 0. It follows that φ(t) ≤ (c2 /c1 )1/2 x0 for all t ≥ 0 and for any x0 ∈ Rn . Therefore, the equilibrium x = 0 of (4.22) is stable (refer to Theorem 4.12).

4.5 The Lyapunov Matrix Equation

157

Example 4.23. For the system given in Example 4.16 we choose P = I, and we compute C = AT P + P A = AT + A = 0. According to Theorem 4.22, the equilibrium x = 0 of this system is stable (as expected from Example 4.16). Theorem 4.24. The equilibrium x = 0 of (4.22) is exponentially stable in the large if there exists a real, symmetric, and positive deﬁnite n × n matrix P such that the matrix C given in (4.25) is negative deﬁnite. Proof. We let φ(t, x0 ) φ(t) denote an arbitrary solution of (4.22) with φ(0) = x0 . In view of the hypotheses of the theorem, there exist constants c2 ≥ c1 > 0 and c3 ≥ c4 > 0 such that c1 φ(t) 2 ≤ v(φ(t)) = φ(t)T P φ(t) ≤ c2 φ(t) 2 and −c3 φ(t) 2 ≤ v(φ(t)) ˙ = φ(t)T Cφ(t) ≤ −c4 φ(t) 2 for all t ≥ 0 and for any x0 ∈ Rn . Then d [φ(t)T P φ(t)] ≤ (−c4 /c2 )φ(t)T P φ(t) dt = (−c4 /c2 )v(φ(t))

v(φ(t)) ˙ =

for all t ≥ t0 . This implies, after multiplication by the appropriate integrating factor, and integrating from 0 to t, that v(φ(t)) = φ(t)T P φ(t) ≤ xT0 P x0 e−(c4 /c2 )t or or

c1 φ(t) 2 ≤ φ(t)T P φ(t) ≤ c2 x0 2 e−(c4 /c2 )t 1

φ(t) ≤ (c2 /c1 )1/2 x0 e− 2 (c4 /c2 )t ,

t ≥ 0.

This inequality holds for all x0 ∈ R . Therefore, the equilibrium x = 0 of (4.22) is exponentially stable in the large (refer to Sections 4.3 and 4.4). n

In Figure 4.3 we provide an interpretation of Theorem 4.24 for the twodimensional case (n = 2). The curves Ci , called level curves, depict loci where v(x) is constant; i.e., Ci = {x ∈ R2 : v(x) = xT P x = ci }, i = 0, 1, 2, 3, . . . . When the hypotheses of Theorem 4.24 are satisﬁed, trajectories determined by (4.22) penetrate level curves corresponding to decreasing values of ci as t increases, tending to the origin as t becomes arbitrarily large.

158

4 Stability

Figure 4.3. Asymptotic stability

Example 4.25. For the system given in Example 4.19, we choose 1 0 P = , 0 0.5 and we compute the matrix

4.5 The Lyapunov Matrix Equation

C = AT P + P A =

159

−2 0 . 0 −2

According to Theorem 4.24, the equilibrium x = 0 of this system is exponentially stable in the large (as expected from Example 4.19). Theorem 4.26. The equilibrium x = 0 of (4.22) is unstable if there exists a real, symmetric n × n matrix P that is either negative deﬁnite or indeﬁnite such that the matrix C given in (4.25) is negative deﬁnite. Proof. We ﬁrst assume that P is indeﬁnite. Then P possesses eigenvalues of either sign, and every neighborhood of the origin contains points where the function v(x) = xT P x is positive and negative. Consider the neighborhood B() = {x ∈ Rn : x < }, where · denotes the Euclidean norm, and let G = {x ∈ B() : v(x) < 0}. On the boundary of G we have either x = or v(x) = 0. In particular, note that the origin x = 0 is on the boundary of G. Now, since the matrix C is negative deﬁnite, there exist constants c3 > c4 > 0 such that ˙ ≤ −c4 x 2 −c3 x 2 ≤ xT Cx = v(x) for all x ∈ Rn . Let φ(t, x0 ) φ(t) and let x0 = φ(0) ∈ G. Then v(x0 ) = −a < 0. The solution φ(t) starting at x0 must leave the set G. To see this, note that as long as φ(t) ∈ G, v(φ(t)) ≤ −a since v(x) ˙ < 0 in G. Let −c = sup{v(x) ˙ : x ∈ G and v(x) ≤ −a}. Then c > 0 and

t

t v(φ(s))ds ˙ ≤ −a − cds v(φ(t)) = v(x0 ) + 0

0

= −a − tc, t ≥ t0 . This inequality shows that φ(t) must escape the set G (in ﬁnite time) because v(x) is bounded from below on G. But φ(t) cannot leave G through the surface determined by v(x) = 0 since v(φ(t)) ≤ −a. Hence, it must leave G through the sphere determined by x = . Since the above argument holds for arbitrarily small > 0, it follows that the origin x = 0 of (4.22) is unstable. Next, we assume that P is negative deﬁnite. Then G as deﬁned is all of B(). The proof proceeds as above.

160

4 Stability

The proof of Theorem 4.26 shows that for > 0 suﬃciently small when P is negative deﬁnite, all solutions φ(t) of (4.22) with initial conditions x0 ∈ B() will tend away from the origin. This constitutes a severe case of instability, called complete instability. Example 4.27. For the system given in Example 4.18, we choose −0.28 −0.96 P = , −0.96 0.28 and we compute the matrix C = AT P + P A =

−20 0 . 0 −20

The eigenvalues of P are ±1. According to Theorem 4.26, the equilibrium x = 0 of this system is unstable (as expected from Example 4.18). In applying the results derived thus far in this section, we start by choosing (guessing) a matrix P having certain desired properties. Next, we solve for the matrix C, using (4.25). If C possesses certain desired properties (i.e., it is negative deﬁnite), we draw appropriate conclusions by applying one of the preceding theorems of this section; if not, we need to choose another matrix P . This points to the principal shortcoming of Lyapunov’s Direct Method, when applied to general systems. However, in the special case of linear systems described by (4.22), it is possible to construct Lyapunov functions of the form v(x) = xT P x in a systematic manner. In doing so, one ﬁrst chooses the matrix C in (4.25) (having desired properties), and then one solves (4.25) for P . Conclusions are then drawn by applying the appropriate results of this section. In applying this construction procedure, we need to know conditions under which (4.25) possesses a (unique) solution P for a given C. We will address this topic next. We consider the quadratic form v(x) = xT P x,

P = PT,

(4.27)

and the time derivative of v(x) along the solutions of (4.22), given by v(x) ˙ = xT Cx,

C = CT ,

(4.28)

where C = AT P + P A

(4.29)

and where all symbols are as deﬁned in (4.23) to (4.25). Our objective is to determine the as yet unknown matrix P in such a way that v(x) ˙ becomes a preassigned negative deﬁnite quadratic form, i.e., in such a way that C is a preassigned negative deﬁnite matrix.

4.5 The Lyapunov Matrix Equation

161

Equation (4.29) constitutes a system of n(n + 1)/2 linear equations. We need to determine under what conditions we can solve for the n(n + 1)/2 elements, pik , given C and A. To this end, we choose a similarity transformation Q such that ¯ QAQ−1 = A, (4.30) or equivalently,

¯ A = Q−1 AQ,

(4.31)

where A¯ is similar to A and Q is a real n × n nonsingular matrix. From (4.31) and (4.29) we obtain ¯ T (Q−1 )T P Q−1 + (Q−1 )T P Q−1 A¯ = (Q−1 )T CQ−1 (A)

(4.32)

or ¯ T P¯ + P¯ A¯ = C, ¯ (A)

P¯ = (Q−1 )T P Q−1 ,

C¯ = (Q−1 )T CQ−1 .

(4.33)

In (4.33), P and C are subjected to a congruence transformation and P¯ and C¯ have the same deﬁniteness properties as P and C, respectively. Since every real n × n matrix can be triangularized (refer to [1]), we can choose Q in such ¯ij = 0 for i > j. Note that in this a fashion that A¯ = [¯ aij ] is triangular ; i.e., a ¯ To case the eigenvalues of A, λ1 , . . . , λn , appear in the main diagonal of A. simplify our notation, we rewrite (4.33) in the form (4.29) by dropping the bars, i.e., (4.34) AT P + P A = C, C = C T , and we assume that A = [aij ] has been triangularized ; i.e., aij = 0 for i > j. Since the eigenvalues λ1 , . . . , λn appear in the diagonal of A, we can rewrite (4.34) as 2λ1 p11 = c11 a12 p11 + (λ1 + λ2 )p12 = c12 ···························

(4.35)

Note that λ1 may be a complex number; in which case, c11 will also be complex. Since this system of equations is triangular, and since its determinant is equal to 2n λ1 . . . λn (λi + λj ), (4.36) i<j

the matrix P can be determined (uniquely) if and only if this determinant is not zero. This is true when all eigenvalues of A are nonzero and no two of them are such that λi + λj = 0. This condition is not aﬀected by a similarity transformation and is therefore also valid for the original system of equations (4.29).

162

4 Stability

We summarize the above discussion in the following lemma. Lemma 4.28. Let A ∈ Rn×n and let λ1 , . . . , λn denote the (not necessarily distinct) eigenvalues of A. Then (4.34) has a unique solution for P corresponding to each C ∈ Rn×n if and only if λi = 0, λi + λj = 0 for all i, j.

(4.37)

To construct v(x), we must still check the deﬁniteness of P . This can be done in a purely algebraic way; however, in the present case, it is much easier to apply the results of this section and argue as follows: (a) If all the eigenvalues λi of A have negative real parts, then the equilibrium x = 0 of (4.22) is exponentially stable in the large, and if C in (4.29) is negative deﬁnite, then P must be positive deﬁnite. To prove this, we note that if P is not positive deﬁnite, then for δ > 0 and suﬃciently small, (P − δI) has at least one negative eigenvalue, whereas the function v(x) = xT (P − δI)x has a negative deﬁnite derivative; i.e., 1 (x) = xT [C − δ(A + AT )]x < 0 v(L)

for all x = 0. By Theorem 4.26, the equilibrium x = 0 of (4.22) is unstable. We have arrived at a contradiction. Therefore, P must be positive deﬁnite. (b) If A has eigenvalues with positive real parts and no eigenvalues with zero real parts, we can use a similarity transformation x = Qy in such a way that Q−1 AQ is a block diagonal matrix of the form diag[A1 , A2 ], where all the eigenvalues of A1 have positive real parts, whereas all eigenvalues of A2 have negative real parts (refer to [1]). (If A does not have any eigenvalues with negative real parts, then we take A = A1 ). By the result established in (a), noting that all eigenvalues of −A1 have negative real parts, given any negative deﬁnite matrices C1 and C2 , there exist positive deﬁnite matrices P1 and P2 such that (−AT1 )P1 + P1 (−A1 ) = C1 ,

AT2 P2 + P2 A2 = C2 .

Then w(y) = y T P y, with P = diag[−P1 , P2 ] is a Lyapunov function for the system y˙ = Q−1 AQy (and, hence, for the system x˙ = Ax), which satisﬁes the hypotheses of Theorem 4.26. Therefore, the equilibrium x = 0 of system (4.22) is unstable. If A does not have any eigenvalues with negative real parts, then the equilibrium x = 0 of system (4.22) is completely unstable.] In the above proof, we did not invoke Lemma 4.28. We note, however, that if additionally, (4.37) is true, then we can construct the Lyapunov function for (4.22) in a systematic manner. Summarizing the above discussion, we can now state the main result of this subsection.

4.5 The Lyapunov Matrix Equation

163

Theorem 4.29. Assume that the matrix A [for system (4.22)] has no eigenvalues with real part equal to zero. If all the eigenvalues of A have negative real parts, or if at least one of the eigenvalues of A has a positive real part, then there exists a quadratic Lyapunov function v(x) = xT P x,

P = PT,

whose derivative along the solutions of (4.22) is deﬁnite (i.e., it is either negative deﬁnite or positive deﬁnite). This result shows that when A is a stable matrix (i.e., all the eigenvalues of A have negative real parts), then for system (4.22) the conditions of Theorem 4.24 are also necessary conditions for exponential stability in the large. Moreover, in the case when the matrix A has at least one eigenvalue with positive real part and no eigenvalues on the imaginary axis, then the conditions of Theorem 4.26 are also necessary conditions for instability. Example 4.30. We consider the system (4.22) with 01 A= . −1 0 The eigenvalues of A are λ1 , λ2 = ±j, and therefore condition (4.37) is violated. According to Lemma 4.28, the Lyapunov matrix equation AT P + P A = C does not possess a unique solution for a given C. We now verify this for two speciﬁc cases. (i) When C = 0, we obtain 0 −1 p11 p12 p p 01 −2p12 + 11 12 = p12 p22 p12 p22 p11 − p22 1 0 −1 0 00 = , 00

p11 − p22 2p12

or p12 = 0 and p11 = p22 . Therefore, for any a ∈ R, the matrix P = aI is a solution of the Lyapunov matrix equation. In other words, for C = 0, the Lyapunov matrix equation has in this example denumerably many solutions. (ii) When C = −2I, we obtain −2p12 −2 0 p11 − p22 = , p11 − p22 2p12 0 −2 or p11 = p22 and p12 = 1 and p12 = −1, which is impossible. Therefore, for C = −2I, the Lyapunov matrix equation has in this example no solutions at all.

164

4 Stability

It turns out that if all the eigenvalues of matrix A have negative real parts, then we can compute P in (4.29) explicitly. Theorem 4.31. If all eigenvalues of a real n × n matrix A have negative real parts, then for each matrix C ∈ Rn×n , the unique solution of (4.29) is given by

∞

P =

T

eA t (−C)eAt dt.

(4.38)

0

Proof. If all eigenvalues of A have negative real parts, then (4.37) is satisﬁed and therefore (4.29) has a unique solution for every C ∈ Rn×n . To verify that (4.38) is indeed this solution, we ﬁrst note that the right-hand side of (4.38) is well deﬁned, since all eigenvalues of A have negative real parts. Substituting the right-hand side of (4.38) for P into (4.29), we obtain

∞

∞ T T AT eA t (−C)eAt dt + eA t (−C)eAt Adt AT P + P A = 0

0 ∞ d AT t At [e (−C)e ]dt = dt 0 ∞ T = eA t (−C)eAt = C, 0

which proves the theorem.

4.6 Linearization In this section we consider nonlinear, ﬁnite-dimensional, continuous-time dynamical systems described by equations of the form w˙ = f (w),

(4.39)

where f ∈ C 1 (Rn , Rn ). We assume that w = 0 is an equilibrium of (4.39). In accordance with Subsection 1.6.1, we linearize system (4.39) about the origin to obtain x˙ = Ax + F (x), (4.40) x ∈ Rn , where F ∈ C(Rn , Rn ) and where A denotes the Jacobian of f (w) evaluated at w = 0, given by A=

∂f (0), ∂w

(4.41)

and where F (x) = o( x ) as

x → 0.

(4.42)

Associated with (4.40) is the linearization of (4.39), given by y˙ = Ay.

(4.43)

4.6 Linearization

165

In the following discussion, we use the results of Section 4.5 to establish criteria that allow us to deduce the stability properties of the equilibrium w = 0 of the nonlinear system (4.39) from the stability properties of the equilibrium y = 0 of the linear system (4.43). Theorem 4.32. Let A ∈ Rn×n be a Hurwitz matrix (i.e., all of its eigevnalues have negative real parts), let F ∈ C(Rn , Rn ), and assume that (4.42) holds. Then the equilibrium x = 0 of (4.40) [and, hence, of (4.39)] is exponentially stable. Proof. Theorem 4.29 applies to (4.43) since all the eigenvalues of A have negative real parts. In view of that theorem (and the comments following Lemma 4.28), there exists a symmetric, real, positive deﬁnite n × n matrix P such that (4.44) P A + AT P = C, where C is negative deﬁnite. Consider the Lyapunov function v(x) = xT P x.

(4.45)

The derivative of v with respect to t along the solutions of (4.40) is given by v(x) ˙ = x˙ T P x + xT P x˙ = (Ax + F (x))T P x + xT P (Ax + F (x)) = xT Cx + 2xT P F (x).

(4.46)

Now choose γ < 0 such that xT Cx ≤ 3γ x 2 for all x ∈ Rn . Since it is assumed that (4.42) holds, there is a δ > 0 such that if x ≤ δ, then P F (x) ≤ −γ x for all x ∈ B(δ) = {x ∈ Rn : x ≤ δ}. Therefore, for all x ∈ B(δ), we obtain, in view of (4.46), the estimate v(x) ˙ ≤ 3γ x 2 −2γ x 2 = γ x 2 .

(4.47)

Now let α = minx=δ v(x). Then α > 0 (since P is positive deﬁnite). Take λ ∈ (0, α), and let Cλ = {x ∈ B(δ) = {x ∈ Rn : x < δ} : v(x) ≤ λ}.

(4.48)

Then Cλ ⊂ B(δ). [This can be shown by contradiction. Suppose that Cλ is not entirely inside B(δ). Then there is a point x¯ ∈ Cλ that lies on the boundary of B(δ). At this point, v(¯ x) ≥ α > λ. We have thus arrived at a contradiction.] The set Cλ has the property that any solution of (4.40) starting in Cλ at t = 0 will stay in Cλ for all t ≥ 0. To see this, we let φ(t, x0 ) φ(t) and we recall ˙ ≤ 0 implies that that v(x) ˙ ≤ γ x 2 , γ < 0, x ∈ B(δ) ⊃ Cλ . Then v(φ(t)) v(φ(t)) ≤ v(x0 ) ≤ λ for all t ≥ t0 ≥ 0. Therefore, φ(t) ∈ Cλ for all t ≥ t0 ≥ 0. We now proceed in a similar manner as in the proof of Theorem 4.24 to complete this proof. In doing so, we ﬁrst obtain the estimate

166

4 Stability

v(φ(t)) ˙ ≤ (γ/c2 )v(φ(t)),

(4.49)

where γ is given in (4.47) and c2 is determined by the relation c1 x 2 ≤ v(x) = xT P x ≤ c2 x 2 .

(4.50)

Following now in an identical manner as was done in the proof of Theorem 4.22, we have 1

1

φ(t) ≤ (c2 /c1 ) 2 x0 e 2 (γ/c2 )t ,

t ≥ 0,

(4.51)

whenever x0 ∈ B(r ), where r has been chosen suﬃciently small so that B(r ) ⊂ Cλ . This proves that the equilibrium x = 0 of (4.40) is exponentially stable. It is important to recognize that Theorem 4.32 is a local result that yields suﬃcient conditions for the exponential stability of the equilibrium x = 0 of (4.40); it does not yield conditions for exponential stability in the large. The proof of Theorem 4.32, however, enables us to determine an estimate of the domain of attraction of the equilibrium x = 0 of (4.39), involving the following steps: 1. Determine an equilibrium, xe , of (4.39) and transform (4.39) to a new system that translates xe to the origin x = 0 (refer to Section 4.2). 2. Linearize (4.39) about the origin and determine F (x), A, and the eigenvalues of A. 3. If all eigenvalues of A have negative real parts, choose a negative deﬁnite matrix C and solve the Lyapunov matrix equation C = AT P + P A. 4. Determine the Lyapunov function v(x) = xT P x. 5. Compute the derivative of v along the solutions of (4.40), given by v(x) ˙ = xT Cx + 2xT P F (x). 6. Determine δ > 0 such that v(x) ˙ < 0 for all x ∈ B(δ) − {0}. 7. Determine the largest λ = λM such that CλM ⊂ B(δ), where Cλ = {x ∈ Rn : v(x) < λ}. 8. CλM is a subset of the domain of attraction of the equilibrium x = 0 of (4.40) and, hence, of (4.39).

4.6 Linearization

167

The above procedure may be repeated for diﬀerent choices of matrix C given in step (3), resulting in diﬀerent matrices Pi , which in turn may result in diﬀerent estimates for the domain of attraction, Cλi M , i ∈ Λ, where Λ is an index set. The union of the sets Cλi M Di , D = ∪i Di , is also a subset of the domain of attraction of the equilibrium x = 0 of (4.39). Theorem 4.33. Assume that A is a real n × n matrix that has at least one eigenvalue with positive real part and no eigenvalue with zero real part. Let F ∈ C(Rn , Rn ), and assume that (4.42) holds. Then the equilibrium x = 0 of (4.40) [and, hence, of (4.39)] is unstable. Proof. We use Theorem 4.29 to choose a real, symmetric n × n matrix P such that the matrix P A + AT P = C is negative deﬁnite. The matrix P is not positive deﬁnite, or even positive semideﬁnite (refer to the comments following Lemma 4.28). Hence, the function v(x) = xT P x is negative at some points arbitrarily close to the origin. The derivative of v(x) with respect to t along the solutions of (4.40) is given by (4.46). As in the proof of Theorem 4.32, we can choose a γ < 0 such that xT Cx ≤ 3γ x 2 for all x ∈ Rn , and in view of (4.42) we can choose a δ > 0 such that P F (x) ≤ −γ x for all x ∈ B(δ). Therefore, for all x ∈ B(δ), we obtain that v(x) ˙ ≤ 3γ x 2 −2γ x 2 = γ x 2 . Now let G = {x ∈ B(δ) : v(x) < 0}. The boundary of G is made up of points where v(x) = 0 and where x = δ. Note in particular that the equilibrium x = 0 of (4.40) is in the boundary of G. Now following an identical procedure as in the proof of Theorem 4.26, we show that any solution φ(t) of (4.40) with φ(0) = x0 ∈ G must escape G in ﬁnite time through the surface determined by x = δ. Since the above argument holds for arbitrarily small δ > 0, it follows that the origin x = 0 of (4.40) is unstable. Before concluding this section, we consider a few speciﬁc cases. Example 4.34. The Lienard Equation is given by w ¨ + f (w)w˙ + w = 0,

(4.52)

where f ∈ C 1 (R, R) with f (0) > 0. Letting x1 = w and x2 = w, ˙ we obtain x˙ 1 = x2 , x˙ 2 = −x1 − f (x1 )x2 . Let xT = (x1 , x2 ), f (x)T = (f1 (x), f2 (x)), and let

(4.53)

168

4 Stability

⎡ J(0) = A = ⎣

∂f1 ∂f1 ∂x1 (0) ∂x2 (0) ∂f2 ∂f2 ∂x1 (0) ∂x2 (0)

⎤ ⎦=

0 1 . −1 −f (0)

Then x˙ = Ax + [f (x) − Ax] = Ax + F (x), where

0 F (x) = . [f (0) − f (x1 )] x2

The origin x = 0 is clearly an equilibrium of (4.52) and hence of (4.53). The eigenvalues of A are given by −f (0) ± f (0)2 − 4 λ1 , λ2 = , 2 and therefore, A is a Hurwitz matrix. Also, (4.42) holds. Therefore, all the conditions of Theorem 4.32 are satisﬁed. We conclude that the equilibrium x = 0 of (4.53) is exponentially stable.

Example 4.35. We consider the system given by x˙ 1 = −x1 + x1 (x21 + x22 ), x˙ 2 = −x2 + x2 (x21 + x22 ).

(4.54)

The origin is clearly an equilibrium of (4.54). Also, the system is already in the form (4.40) with −1 0 x1 (x21 + x22 ) A= , F (x) = , 0 −1 x2 (x21 + x22 ) and condition (4.42) is clearly satisﬁed. The eigenvalues of A are λ1 = −1, λ2 = −1. Therefore, all conditions of Theorem 4.32 are satisﬁed and we conclude that the equilibrium xT = (x1 , x2 ) = 0 is exponentially stable; however, we cannot conclude that this equilibrium is exponentially stable in the large. Accordingly, we seek to determine an estimate for the domain of attraction of this equilibrium. We choose C = −I (where I ∈ R2×2 denotes the identity matrix), and we solve the matrix equation AT P + P A = C to obtain P = (1/2)I, and therefore, 1 v(x1 , x2 ) = xT P x = (x21 + x22 ). 2 Along the solutions of (4.54) we obtain v(x ˙ 1 , x2 ) = xT Cx + 2xT P F (x) = −(x21 + x22 ) + (x21 + x22 )2 .

4.6 Linearization

169

Clearly, v(x ˙ 1 , x2 ) < 0 when (x1 , x2 ) = (0, 0) and x21 + x22 < 1. In the language of the proof of Theorem 4.32, we can therefore choose δ = 1. Now let C1/2 = {x ∈ R2 : v(x1 , x2 ) =

1 2 1 (x1 + x22 ) < }. 2 2

Then clearly, C1/2 ⊂ B(δ), δ = 1, in fact C1/2 = B(δ). Therefore, the set {x ∈ R2 : x21 +x22 < 1} is a subset of the domain of attraction of the equilibrium (x1 , x2 )T = 0 of system (4.54).

Example 4.36. The diﬀerential equation governing the motion of a pendulum is given by θ¨ + a sin θ = 0, (4.55) where a > 0 is a constant (refer to Chapter 1). Letting θ = x1 and θ˙ = x2 , we obtain the system description x˙ 1 = x2 , x˙ 2 = −a sin x1 . (1)

(4.56)

(2)

The points xe = (0, 0)T and xe = (π, 0)T are equilibria of (4.56). (1)

(i) Linearizing (4.56) about the equilibrium xe , we put (4.56) into the form (4.40) with 01 A= . −a 0 √ The eigenvalues of A are λ1 , λ2 = ±j a. Therefore, the results of this section (Theorem 4.32 and 4.33) are not applicable in the present case. (ii) In (4.56), we let y1 = x1 − π and y2 = x2 . Then (4.56) assumes the form y˙ 1 = y2 , y˙ 2 = −a sin(y1 + π).

(4.57)

The point (y1 , y2 )T = (0, 0)T is clearly an equilibrium of system (4.57). Linearizing about this equilibrium, we put (4.57) into the form (4.40), where 0 01 . A= , F (y1 , y2 ) = −a(sin(y1 + π) + y1 ) a0 The eigenvalues of A are λ1 , λ2 = a, −a. All conditions of Theorem 4.33 (2) are satisﬁed, and we conclude that the equilibrium xe = (π, 0)T of system (4.56) is unstable.

170

4 Stability

4.7 Input–Output Stability We now turn our attention to systems described by the state equations x˙ = Ax + Bu, y = Cx + Du,

(4.58)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . In the preceding sections of this chapter we investigated the internal stability properties of system (4.58) by studying the Lyapunov stability of the trivial solution of the associated system w˙ = Aw. (4.59) In this approach, system inputs and system outputs played no role. To account for these, we now consider the external stability properties of system (4.58), called input–output stability: Every bounded input of a system should produce a bounded output. More speciﬁcally, in the present context, we say that system (4.58) is bounded-input/bounded-output (BIBO) stable, if for zero initial conditions at t = 0, every bounded input deﬁned on [0, ∞) gives rise to a bounded response on [0, ∞). Matrix D does not aﬀect the BIBO stability of (4.58). Accordingly, we will consider without any loss of generality the case where D ≡ 0; i.e., throughout this section we will concern ourselves with systems described by equations of the form x˙ = Ax + Bu, y = Cx.

(4.60)

We will say that the system (4.60) is BIBO stable if there exists a constant c > 0 such that the conditions x(0) = 0, ||u(t)|| ≤ 1,

t ≥ 0,

imply that y(t) ≤ c for all t ≥ 0. (The symbol · denotes the Euclidean norm.) Recall that for system (4.60) the impulse response matrix is given by H(t) = CeAt B, t ≥ 0, = 0, t < 0,

(4.61)

and the transfer function matrix is given by % H(s) = C(sI − A)−1 B.

(4.62)

Theorem 4.37. The system (4.60) is BIBO stable if and only if there exists a ﬁnite constant L > 0 such that for all t,

t H(t − τ ) dτ ≤ L. (4.63) 0

4.7 Input–Output Stability

171

Proof. The ﬁrst part of the proof of Theorem 4.37 (suﬃciency) is straightforward. Indeed, if u(t) ≤ 1 for all t ≥ 0 and if (4.63) is true, then we have for all t ≥ 0 that

t y(t) = H(t − τ )u(τ )dτ 0

t H(t − τ )u(τ ) dτ ≤ 0

t H(t − τ ) u(τ ) dτ ≤ 0

t H(t − τ ) dτ ≤ L. ≤ 0

Therefore, system (4.60) is BIBO stable. In proving the second part of Theorem 4.37 (necessity), we simplify matters by ﬁrst considering in (4.60) the single-variable case (n = 1) with the input– output description given by

t h(t − τ )u(τ )dτ. (4.64) y(t) = 0

For purposes of contradiction, we assume that the system is BIBO stable, but no ﬁnite L exists such that (4.63) is satisﬁed. Another way of stating this is that for every ﬁnite L, there exists t1 = t1 (L), t1 > 0, such that

t1 |h(t1 , τ )|dτ > L. 0

We now choose in particular the input given by ⎧ ⎪ ⎨+1 if h(t − τ ) > 0, u(t) = 0 if h(t − τ ) = 0, ⎪ ⎩ −1 if h(t − τ ) < 0,

(4.65)

0 ≤ t ≤ t1 . Clearly, |u(t)| ≤ 1 for all t ≥ 0. The output of the system at t = t1 due to the above input, however, is

t1

t1 h(t1 − τ )u(τ )dτ = |h(t1 − τ )|dτ > L, y(t1 ) = 0

0

which contradicts the assumption that the system is BIBO stable. The above can now be generalized to the multivariable case. In doing so, we apply the single-variable result to every possible pair of input and output vector components, we make use of the fact that the sum of a ﬁnite number of bounded sums will be bounded, and we recall that a vector is bounded if and only if each of its components is bounded. We leave the details to the reader.

172

4 Stability

In the preceding argument we made the tacit assumption that u is continuous, or piecewise continuous. However, our particular choice of u may involve nondenumerably many switchings (discontinuities) over a given ﬁnitetime interval. In such cases, u is no longer piecewise continuous; however, it is measurable (in the Lebesgue sense). This generalization can be handled, although in a broader mathematical setting that we do not wish to pursue here. The interested reader may want to refer, e.g., to the books by Desoer and Vidyasagar [5], Michel and Miller [13], and Vidyasagar [20] and the papers by Sandberg [17] to [19] and Zames [21], [22] for further details. From Theorem 4.37 and from (4.61) it follows readily that a necessary and suﬃcient condition for the BIBO stability of system (4.60) is the condition

∞ H(t) dt < ∞. (4.66) 0

Corollary 4.38. Assume that the equilibrium w = 0 of (4.59) is exponentially stable. Then system (4.60) is BIBO stable. Proof. Under the hypotheses of the corollary, we have

t

t H(t − τ )dτ ≤ H(t − τ ) dτ 0 0

t CΦ(t − τ )B dτ ≤ C B = 0

t

Φ(t − τ ) dτ.

0

Since the equilibrium w = 0 of (4.59) is exponentially stable, there exist δ > 0, λ > 0 such that Φ(t, τ ) ≤ δe−λ(t−τ ) , t ≥ τ . Therefore,

t

t H(t − τ ) dτ ≤ C B δe−λ(t−τ ) dτ 0

0

≤ ( C B δ)/λ L for all τ, t with t ≥ τ . It now follows from Theorem 4.37 that system (4.60) is BIBO stable. In Section 7.3 we will establish a connection between the BIBO stability of (4.60) and the exponential stability of the trivial solution of (4.59). ˆ ij (s)] % Next, we recall that a complex number sp is a pole of H(s) = [h ˆ ij (sp )| = ∞. If each entry of H(s) % has if for some pair (i, j), we have |h only poles with negative real values, then, as shown in Chapter 3, each entry of H(t) = [hij (t)] has a sum of exponentials with exponents with real part negative. It follows that the integral

∞ H(t) dt 0

% is ﬁnite, and any realization of H(s) will result in a system that is BIBO stable.

4.8 Discrete-Time Systems

Now conversely, if

∞

173

H(t) dt

0

is ﬁnite, then the exponential terms in any entry of H(t) must have nega% tive real parts. But then every entry of H(s) has poles whose real parts are negative. We have proved the following result. Theorem 4.39. The system (4.60) is BIBO stable if and only if all poles of % the transfer function H(s) given in (4.62) have only poles with negative real parts.

Example 4.40. A system with H(s) = 1/s is not BIBO stable. To see this consider a step input. The response is then given by y(t) = t, t ≥ 0, which is not bounded.

4.8 Discrete-Time Systems In this section we address the Lyapunov stability of an equilibrium of discretetime systems (internal stability) and the input–output stability of discretetime systems (external stability). We establish results for discrete-time systems that are analogous to practically all the stability results that we presented for continuous-time systems. This section is organized into ﬁve subsections. In the ﬁrst subsection we provide essential preliminary material. In the second and third subsections we establish results for the stability, instability, asymptotic stability, and exponential stability of an equilibrium and boundedness of solutions of systems described by linear autonomous ordinary diﬀerence equations. These results are used to develop Lyapunov stability results for linearizations of nonlinear systems described by ordinary diﬀerence equations in the fourth subsection. In the last subsection we present results for the input–output stability of linear time-invariant discrete-time systems. 4.8.1 Preliminaries We concern ourselves here with ﬁnite-dimensional discrete-time systems described by diﬀerence equations of the form x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k),

(4.67)

174

4 Stability

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , k ≥ k0 , and k, k0 ∈ Z + . Since (4.67) is time-invariant, we will assume without loss of generality that k0 = 0, and thus, x : Z + → Rn , y : Z + → Rp , and u : Z + → Rm . The internal dynamics of (4.67) under conditions of no input are described by equations of the form x(k + 1) = Ax(k). (4.68) Such equations may arise in the modeling process, or they may be the consequence of the linearization of nonlinear systems described by equations of the form x(k + 1) = g(x(k)), (4.69) where g : Rn → Rn . For example, if g ∈ C 1 (Rn , Rn ), then in linearizing (4.69) about, e.g., x = 0, we obtain x(k + 1) = Ax(k) + f (x(k)), where A = ∂f ∂x (x)

x=0

(4.70)

and where f : Rn → Rn is o(||x||) as a norm of x (e.g.,

the Euclidean norm) approaches zero. Recall that this means that given > 0, there is a δ > 0 such that f (x) < x for all x < δ. As in Section 4.7, we will study the external qualitative properties of system (4.67) by means of the BIBO stability of such systems. Consistent with the deﬁnition of input–output stability of continuous-time systems, we will say that the system (4.67) is BIBO stable if there exists a constant L > 0 such that the conditions x(0) = 0, u(k) ≤ 1,

k ≥ 0,

imply that y(k) ≤ L for all k ≥ 0. We will study the internal qualitative properties of system (4.67) by studying the Lyapunov stability properties of an equilibrium of (4.68). Since system (4.69) is time-invariant, we will assume without loss of generality that k0 = 0. As in Chapters 1 and 2, we will denote for a given set of initial data x(0) = x0 the solution of (4.69) by φ(k, x0 ). When x0 is understood or of no importance, we will frequently write φ(k) in place of φ(k, x0 ). Recall that for system (4.69) [as well as systems (4.67), (4.68), and (4.70)], there are no particular diﬃculties concerning the existence and uniqueness of solutions, and furthermore, as long as g in (4.69) is continuous, the solutions will be continuous with respect to initial data. Recall also that in contrast to systems described by ordinary diﬀerential equations, the solutions of systems described by ordinary diﬀerence equations [such as (4.69)] exist only in the forward direction of time (k ≥ 0). We say that xe ∈ Rn is an equilibrium of system (4.69) if φ(k, xe ) ≡ xe for all k ≥ 0, or equivalently, g(xe ) = xe .

(4.71)

4.8 Discrete-Time Systems

175

As in the continuous-time case, we will assume without loss of generality that the equilibrium of interest will be the origin; i.e., xe = 0. If this is not the case, then we can always transform (similarly as in the continuous-time case) system (4.69) into a system of equations that has an equilibrium at the origin. Example 4.41. The system described by the equation x(k + 1) = x(k)[x(k) − 1] has two equilibria, one at xe1 = 0 and another at xe2 = 1.

Example 4.42. The system described by the equations x1 (k + 1) = x2 (k), x2 (k + 1) = −x1 (k) has an equilibrium at xTe = (0, 0). Throughout this section we will assume that the function g in (4.69) is continuous, or if required, continuously diﬀerentiable. The various deﬁnitions of Lyapunov stability of the equilibrium x = 0 of system (4.69) are essentially identical to the corresponding deﬁnitions of Lyapunov stability of an equilibrium of continuous-time systems described by ordinary diﬀerential equations, replacing t ∈ R+ by k ∈ Z + . We will concern ourselves with stability, instability, asymptotic stability, and exponential stability of the equilibrium x = 0 of (4.69). We say that the equilibrium x = 0 of (4.69) is stable if for every > 0 there exists a δ = δ() > 0 such that φ(k, x0 ) < for all k ≥ 0 whenever x0 < δ. If the equilibrium x = 0 of (4.69) is not stable, it is said to be unstable. We say that the equilibrium x = 0 of (4.69) is asymptotically stable if (i) it is stable and (ii) there exists an η > 0 such that if x0 < η, then limk→∞ φ(k, x0 ) = 0. If the equilibrium x = 0 satisﬁes property (ii), it is said to be attractive, and we call the set of all x0 ∈ Rn for which x = 0 is attractive the domain of attraction of this equilibrium. If x = 0 is asymptotically stable and if its domain of attraction is all of Rn , then it is said to be asymptotically stable in the large or globally asymptotically stable. We say that the equililbrium x = 0 of (4.69) is exponentially stable if there exists an α > 0 and for every > 0, there exists a δ() > 0, such that φ(k, x0 ) ≤ e−αk for all k ≥ 0 whenever x0 < δ(). The equilibrium x = 0 of (4.69) is exponentially stable in the large if there exists α > 0 and for any β > 0, there exists k(β) > 0 such that φ(t, x0 ) ≤ k(β) x0 e−αk for all k > 0 whenever x0 < β. Finally, we say that a solution of (4.69) through x0 is bounded if there is a constant M such that φ(k, x0 ) ≤ M for all k ≥ 0.

176

4 Stability

4.8.2 Linear Systems In proving some of the results of this section, we require a result for system (4.68) that is analogous to Theorem 3.1. As in the proof of that theorem, we note that the linear combination of solutions of system (4.68) is also a solution of system (4.68), and hence, the set of solutions {φ : Z + × Rn → Rn } constitutes a vector space (over F = R or F = C). The dimension of this vector space is n. To show this, we choose a set of linearly independent vectors x10 , . . . , xn0 in the n-dimensional x-space (Rn or C n ) and we show, in an identical manner as in the proof of Theorem 3.1, that the set of solutions φ(k, xi0 ), i = 1, . . . , n, is linearly independent and spans the set of solutions of system (4.68). (We ask the reader in the Exercise section to provide the details of the proof of the above assertions.) This yields the following result. Theorem 4.43. The set of solutions of system (4.68) over the time interval Z + forms an n-dimensional vector space. Incidentally, if in particular we choose φ(k, ei ), i = 1, . . . , n, where ei , i = 1, . . . , n, denotes the natural basis for Rn , and if we let Φ(k, k0 = 0) Φ(k) = [φ(k, e1 ), . . . , φ(k, en )], then it is easily veriﬁed that the n × n matrix Φ(k) satisﬁes the matrix equation Φ(k + 1) = AΦ(k),

Φ(0) = I,

and that Φ(k) = Ak , k ≥ 0 [i.e., Φ(k) is the state transition matrix for system (4.68)]. Theorem 4.44. The equilibrium x = 0 of system (4.68) is stable if and only if the solutions of (4.68) are bounded. Proof. Assume that the equilibrium x = 0 of (4.68) is stable. Then for = 1 there is a δ > 0 such that φ(k, x0 ) < 1 for all k ≥ 0 and all x0 ≤ δ. In this case φ(k, x0 ) = Ak x0 = Ak x0 δ/ x0 ( x0 /δ) < x0 /δ for all x0 = 0 and all k ≥ 0. Using the deﬁnition of matrix norm [refer to Section A.7] it follows that Ak ≤ δ −1 , k ≥ 0. We have proved that if the equilibrium x = 0 of (4.68) is stable, then the solutions of (4.68) are bounded. Conversely, suppose that all solutions φ(k, x0 ) = Ak x0 are bounded. Let 1 {e , . . . , en } denote the natural basisfor n-space and let φ(k, ej ) < βj for n all k ≥ 0. Then for any vector x0 = j=1 αj ej we have that φ(k, x0 ) =

n

αj φ(k, ej ) ≤

j=1

≤ c x0 ,

n j=1

k ≥ 0,

|αj |βj ≤ (max βj ) j

n j=1

|αj |

4.8 Discrete-Time Systems

177

for some constant c. For given > 0, we choose δ = /c. Then, if x0 < δ, we have φ(k, x0 ) < c x0 < for all k ≥ 0. We have proved that if the solutions of (4.68) are bounded, then the equilibrium x = 0 of (4.68) is stable. Theorem 4.45. The following statements are equivalent: (i) The equilibrium x = 0 of (4.68) is asymptotically stable, (ii) The equilibrium x = 0 of (4.68) is asymptotically stable in the large, (iii) limk→∞ Ak = 0. Proof. Assume that statement (i) is true. Then there is an η > 0 such that when x0 ≤ η, then φ(k, x0 ) → 0 as k → ∞. But then we have for any x0 = 0 that φ(k, x0 ) = Ak x0 = [Ak (ηx0 / x0 )] x0 /η → 0 as k → ∞. It follows that statement (ii) is true. Next, assume that statement (ii) is true. Then for any > 0 there must exist a K = K() such that for all k ≥ K we have that φ(k, x0 ) = Ak x0 < for a ﬁxed . To see this, let {e1 , . . . , en } be the natural basis for Rn . Thus, n constant c > 0, if x0 = (α1 , . . . , αn )T and if x0 ≤ 1, then x0 = j=1 αj ej n and j=1 |αj | ≤ c. For each j there is a Kj = Kj () such that Ak ej < /c for k ≥ Kj . Deﬁne K = K() = max{Kj () : j = 1, . . . , n}. For x0 ≤ 1 and k ≥ K we have that Ak x0 =

n j=1

αj Ak ej ≤

n

|αj |(/c) ≤ .

j=1

By the deﬁnition of matrix norm [see Section A.7], this means that Ak ≤ for k > K. Therefore, statement (iii) is true. Finally, assume that statement (iii) is true. Then Ak is bounded for all k ≥ 0. By Theorem 4.44, the equilibrium x = 0 is stable. To prove asymptotic stability, ﬁx > 0. If x0 < η = 1, then φ(k, x0 ) ≤ Ak x0 → 0 as k → ∞. Therefore, statement (i) is true. This completes the proof. Theorem 4.46. The equilibrium x = 0 of (4.68) is asymptotically stable if and only if it is exponentially stable. Proof. The exponential stability of the equilibrium x = 0 implies the asymptotic stability of the equilibrium x = 0 of systems (4.69) in general and, hence, for systems (4.68) in particular. Conversely, assume that the equilibrium x = 0 of (4.68) is asymptotically stable. Then there is a δ > 0 and a K > 0 such that if x0 ≤ δ, then Φ(k + K)x0 ≤

δ 2

178

4 Stability

for all k ≥ 0. This implies that Φ(k + K) ≤

1 2

if k ≥ 0.

(4.72)

From Section 3.5.1 we have that Φ(k − l) = Φ(k − s)Φ(s − l) for any k, l, s. Therefore, Φ(k + 2K) = Φ[(k + 2K) − (k + K)]Φ(k + K) ≤

1 4

in view of (4.72). By induction we obtain for k ≥ 0 that Φ(k + nK) ≤ 2−n . Let α =

(ln 2) K .

(4.73)

Then (4.73) implies that for 0 ≤ k < K we have that (k + nK, x0 ) ≤ 2 x0 2−(n+1) = 2 x0 e−α(n+1)K ≤ 2 x0 e−α(k+nK) ,

which proves the result.

To arrive at the next result, we make reference to the results of Subsection 3.5.5. Speciﬁcally, by inspecting the expressions for the modes of system (4.68) given in (3.131) and (3.132), or by utilizing the Jordan canonical form of A [refer to (3.135) and (3.136)], the following result is evident. Theorem 4.47. (i) The equilibrium x = 0 of system (4.68) is asymptotically stable if and only if all eigenvalues of A are within the unit circle of the complex plane (i.e., if λ1 , . . . , λn denote the eigenvalues of A, then |λj | < 1, j = 1, . . . , n). In this case we say that the matrix A is Schur stable, or simply, the matrix A is stable. (ii) The equilibrium x = 0 of system (4.68) is stable if and only if |λj | ≤ 1, j = 1, . . . , n, and for each eigenvalue with |λj | = 1 having multiplicity nj > 1, it is true that lim

z→λj

dnj −1−l [(z − λj )nj (zI − A)−1 ] dz nj −1−l

= 0,

l = 1, . . . , nj − 1.

(iii) The equilibrium x = 0 of system (4.68) is unstable if and only if the conditions in (ii) above are not true. Alternatively, it is evident that the equilibrium x = 0 of system (4.68) is stable if and only if all eigenvalues of A are within or on the unit circle of the complex plane, and every eigenvalue that is on the unit circle has an associated Jordan block of order 1.

4.8 Discrete-Time Systems

179

Example 4.48. (i) For the system in Example 4.42 we have 01 A= . −1 0 √ The eigenvalues of A are λ1 , λ2 = ± −1. According to Theorem 4.47, the equilibrium x = 0 of the system is stable, and according to Theorem 4.44 the matrix Ak is bounded for all k ≥ 0. (ii) For system (4.68) let 0 −1/2 A= . −1 0 √ The eigenvalues of A are λ1 , λ2 = ±1/ 2. According to Theorem 4.47, the equilibrium x = 0 of the system is asymptotically stable, and according to Theorem 4.45, limk→∞ Ak = 0. (iii) For system (4.68) let 0 −1/2 A= . −3 0 The eigenvalues of A are λ1 , λ2 = ± 3/2. According to Theorem 4.47, the equilibrium x = 0 of the system is unstable, and according to Theorem 4.44, the matrix Ak is not bounded with increasing k. (iv) For system (4.68) let

A=

11 . 01

The matrix A is a Jordan block of order 2 for the eigenvalue λ = 1. Accordingly, the equilibrium x = 0 of the system is unstable (refer to the remark following Theorem 4.47) and the matrix Ak is unbounded with increasing k.

4.8.3 The Lyapunov Matrix Equation In this subsection we obtain another characterization of stable matrices by means of the Lyapunov matrix equation. Returning to system (4.68) we choose as a Lyapunov function v(x) = xT Bx, B = B T ,

(4.74)

and we evaluate the ﬁrst forward diﬀerence of v along the solutions of (4.68) as

180

4 Stability

Dv(x(k)) v(x(k + 1)) − v(x(k)) = x(k + 1)T Bx(k + 1) − x(k)T Bx(k) = x(k)T AT BAx(k) − x(k)T Bx(k) = x(k)T (AT BA − B)x(k), and therefore, Dv(x) = xT (AT BA − B)x −xT Cx, where AT BA − B = C,

C T = C.

(4.75)

Theorem 4.49. (i) The equilibrium x = 0 of system (4.68) is stable if there exists a real, symmetric, and positive deﬁnite matrix B such that the matrix C given in (4.75) is negative semideﬁnite. (ii) The equilibrium x = 0 of system (4.68) is asymptotically stable in the large if there exists a real, symmetric, and positive deﬁnite matrix B such that the matrix C given in (4.75) is negative deﬁnite. (iii) The equilibrium x = 0 of system (4.68) is unstable if there exists a real, symmetric matrix B that is either negative deﬁnite or indeﬁnite such that the matrix C given in (4.75) is negative deﬁnite. In proving Theorem 4.49 one can follow a similar approach as in the proofs of Theorems 4.22, 4.24 and 4.26. We leave the details to the reader as an exercise. In applying Theorem 4.49, we start by choosing (guessing) a matrix B having certain desired properties and we then solve for the matrix C, using equation (4.75). If C possesses certain desired properties (i.e., it is negative deﬁnite), we can draw appropriate conclusions by applying one of the results given in Theorem 4.49; if not, we need to choose another matrix B. This approach is not very satisfactory, and in the following we will derive results that will allow us (as in the case of continuous-time systems) to construct Lyapunov functions of the form v(x) = xT Bx in a systematic manner. In doing so, we ﬁrst choose a matrix C in (4.75) that is either negative deﬁnite or positive deﬁnite, and then we solve (4.75) for B. Conclusions are then made by applying Theorem 4.49. In applying this construction procedure, we need to know conditions under which (4.75) possesses a (unique) solution B for any deﬁnite (i.e., positive or negative deﬁnite) matrix C. We will address this issue next. We ﬁrst show that if A is stable, i.e., if all eigenvalues of matrix A [in system (4.68)] are inside the unit circle of the complex plane, then we can compute B in (4.75) explicitly. To show this, we assume that in (4.75) C is a given matrix and that A is stable. Then (AT )k+1 BAk+1 − (AT )k BAk = (AT )k CAk , and summing from k = 0 to l yields

4.8 Discrete-Time Systems AT BA−B +(AT )2 BA2 −AT BA+· · ·+(AT )l+1 BAl+1 −(AT )l BAl =

l

181

(AT )k CAk

k=0

or (AT )l+1 BAl+1 − B =

l

(AT )k CAk .

k=0

Letting l → ∞, we obtain B=−

∞

(AT )k CAk .

(4.76)

k=0

It is easy to verify that (4.76) is a solution of (4.75). We have ∞ ∞ T T k k −A (A ) CA A + (AT )k CAk = C k=0

k=0

or −AT CA + C − (AT )2 CA2 + AT CA − (AT )3 CA3 + (AT )2 CA2 − · · · = C. Therefore (4.76) is a solution of (4.75). Furthermore, if C is negative deﬁnite, then B is positive deﬁnite. Combining the above with Theorem 4.49(ii) we have the following result. Theorem 4.50. If there is a positive deﬁnite and symmetric matrix B and a negative deﬁnite and symmetric matrix C satisfying (4.75), then the matrix A is stable. Conversely, if A is stable, then, given any symmetric matrix C, (4.75) has a unique solution, and if C is negative deﬁnite, then B is positive deﬁnite. Next, we determine conditions under which the system of equations (4.75) has a (unique) solution B = B T ∈ Rn×n for a given matrix C = C T ∈ Rn×n . To accomplish this, we consider the more general equation A1 XA2 − X = C,

(4.77)

where A1 ∈ Rm×m , A2 ∈ Rn×n , and X and C are m × n matrices. Lemma 4.51. Let A1 ∈ Rm×m and A2 ∈ Rn×n . Then (4.77) has a unique solution X ∈ Rm×n for a given C ∈ Rm×n if and only if no eigenvalue of A1 is a reciprocal of an eigenvalue of A2 . Proof. We need to show that the condition on A1 and A2 is equivalent to the condition that A1 XA2 = X implies X = 0. Once we have proved that A1 XA2 = X has the unique solution X = 0, then it can be shown that (4.77) has a unique solution for every C, since (4.77) is a linear equation.

182

4 Stability

Assume ﬁrst that the condition on A1 and A2 is satisﬁed. Now A1 XA2 = X implies that Ak−j XAk−j = X and 1 2 Aj1 X = Ak1 XAk−j 2

for k ≥ j ≥ 0.

Now for a polynomial of degree k, p(λ) =

k

aj λj ,

j=0

we deﬁne the polynomial of degree k, p∗ (λ) =

k

aj λk−j = λk p(1/λ),

j=0

from which it follows that p(A1 )X = Ak1 Xp∗ (A2 ). Now let φi (λ) be the characteristic polynomial of Ai , i = 1, 2. Since φ1 (λ) and φ∗2 (λ) are relatively prime, there are polynomials p(λ) and q(λ) such that p(λ)φ1 (λ) + q(λ)φ∗2 (λ) = 1. Now deﬁne φ(λ) = q(λ)φ∗2 (λ) and note that φ∗ (λ) = q ∗ (λ)φ2 (λ). It follows that φ∗ (A2 ) = 0 and φ(A1 ) = I. From this it follows that A1 XA2 = X implies X = 0. To prove the converse, we assume that λ is an eigenvalue of A1 and λ−1 is an eigenvalue of A2 (and, hence, is also an eigenvalue of AT2 ). Let A1 x1 = λx1 and AT2 x2 = λ−1 x2 , x1 = 0 and x2 = 0. Deﬁne X = (x21 x1 , x22 x1 , . . . , x2n x1 ). Then X = 0 and A1 XA2 = X. To construct v(x) by using Lemma 4.51, we must still check the deﬁniteness of B. To accomplish this, we use Theorem 4.49. 1. If all eigenvalue of A [for system (4.68)] are inside the unit circle of the complex plane, then no reciprocal of an eigenvalue of A is an eigenvalue, and Lemma 4.51 gives another way of showing that (4.75) has a unique solution B for each C if A is stable. If C is negative deﬁnite, then B is positive deﬁnite. This can be shown as was done for the case of linear ordinary diﬀerential equations. 2. Suppose that at least one of the eigenvalues of A is outside the unit circle in the complex plane and that A has no eigenvalues on the unit circle. As in the case of linear diﬀerential equations (4.22) (Section 4.5), we use a similarity transformation x = Qy in such a way that Q−1 AQ = diag[A1 , A2 ], where all eigenvalues of A1 are outside the unit circle while all eigenvalues

4.8 Discrete-Time Systems

183

of A2 are within the unit circle. We then proceed identically as in the case of linear diﬀerential equations to show that under the present assumptions there exists for system (4.68) a Lyapunov function that satisﬁes the hypotheses of Theorem 4.49(iii). Therefore, the equilibrium x = 0 of system (4.68) is unstable. If A does not have any eigenvalues within the unit circle, then the equilibrium x = 0 of (4.68) is completely unstable. In this proof, Lemma 4.51 has not been invoked. If additionally, the hypotheses of Lemma 4.51 are true (i.e., no reciprocal of an eigenvalue of A is an eigenvalue of A), then we can construct the Lyapunov function for system (4.68) in a systematic manner. Summarizing the above discussion, we have proved the following result. Theorem 4.52. Assume that the matrix A for system (4.68) has no eigenvalues on the unit circle in the complex plane. If all the eigenvalues of the matrix A are within the unit circle of the complex plane, or if at least one eigenvalue is outside the unit circle of the complex plane, then there exists a Lyapunov function of the form v(x) = xT Bx, B = B T , whose ﬁrst forward diﬀerence along the solutions of system (4.68) is deﬁnite (i.e., it is either negative deﬁnite or positive deﬁnite). Theorem 4.52 shows that when all the eigenvalues of A are within the unit circle, then for system (4.68), the conditions of Theorem 4.49(ii) are also necessary conditions for exponential stability in the large. Furthermore, when at least one eigenvalue of A is outside the unit circle and no eigenvalues are on the unit circle, then the conditions of Theorem 4.49(iii) are also necessary conditions for instability. We conclude this subsection with some speciﬁc examples. Example 4.53. (i) For system (4.68), let 01 A= . −1 0 Let B = I, which is positive deﬁnite. From (4.75) we obtain 0 −1 01 10 00 C = AT A − I = − = . 1 0 −1 0 01 00 It follows from Theorem 4.49(i) that the equilibrium x = 0 of this system is stable. This is the same conclusion that was made in Example 4.48. (ii) For system (4.68), let 0 − 21 . A= −1 0 Choose

184

4 Stability

8 B=

3

0

0

5 3

,

which is positive deﬁnite. From (4.75) we obtain 8 8 0 −1 0 0 0 − 12 −1 0 T 3 3 C = A BA − B = − = , − 12 0 0 53 0 53 −1 0 0 −1 which is negative deﬁnite. It follows from Theorem 4.49(ii) that the equilibrium x = 0 of this system is asymptotically stable in the large. This is the same conclusion that was made in Example 4.48(ii). (iii) For system (4.68), let 0 − 21 . A= −3 0

−1 0 C= , 0 −1

Choose

which is negative deﬁnite. From (4.75) we obtain 0 −3 b11 b12 b11 b12 0 − 12 − C = AT BA − B = − 21 0 b12 b22 −3 0 b12 b22 or

1 (9b22 − b11 ) −1 0 2 b12 = , 1 0 −1 ( 14 b11 − b22 ) 2 b12

which yields

−8 0 B= , 0 −1

which is also negative deﬁnite. It follows from Theorem 4.49(iii) that the equilibrium x = 0 of this system is unstable. This conclusion is consistent with the conclusion made in Example 4.48(iii). (iv) For system (4.68), let 1 1 . A= 3 03 The eigenvalues of A are λ1 = 13 and λ2 = 3. According to Lemma 4.51, for a given C, (4.77) does not have a unique solution in this case since λ1 = 1/λ2 . For purposes of illustration, we choose C = −I. Then 1 1 b11 b12 b11 b12 0 1 T 3 3 −I = A BA − B = = b12 b22 b12 b22 13 03 or

⎡ ⎣

− 89 b11 1 3 b11

1 3 b11

b11 + 6b12 + 8b22

⎤

⎦ = −1 0 , 0 −1

which shows that for C = −I, (4.77) does not have any solution (for B) at all.

4.8 Discrete-Time Systems

185

4.8.4 Linearization In this subsection we determine conditions under which the stability properties of the equilibrium w = 0 of the linear system w(k + 1) = Aw(k)

(4.78)

determine the stability properties of the equilibrium x = 0 of the nonlinear system x(k + 1) = Ax(k) + f (x(k)), (4.79) under the assumption that f (x) = o( x ) as x → 0 (i.e., given > 0, there exists δ > 0 such that f (x(k)) < x(k) for all k ≥ 0 and all x(k) < δ). [Refer to the discussion concerning (4.68) to (4.70) in Subsection 4.8.1.] Theorem 4.54. Assume that f ∈ C(Rn , Rn ) and that f (x) is o( x ) as x → 0. (i) If A is stable (i.e., all the eigenvalues of A are within the unit circle of the complex plane), then the equilibrium x = 0 of system (4.79) is asymptotically stable. (ii) If at least one eigenvalue of A is outside the unit circle of the complex plane and no eigenvalue is on the unit circle, then the equilibrium x = 0 of system (4.79) is unstable. In proving Theorem 4.54 one can follow a similar approach as in the proofs of Theorems 4.32 and 4.33. We leave the details to the reader as an exercise. Before concluding this subsection, we consider some speciﬁc examples. Example 4.55. (i) Consider the system 1 x1 (k + 1) = − x2 (k) + x1 (k)2 + x2 (k)2 , 2 x2 (k + 1) = −x1 (k) + x1 (k)2 + x2 (k)2 .

(4.80)

Using the notation of (4.79), we have

0 − 21 A= , −1 0

⎡ f (x1 , x2 ) = ⎣

x21 + x22 x21

+

⎤ ⎦.

x22

The linearization of (4.80) is given by w(k + 1) = Aw(k).

(4.81)

From Example 4.48(ii) [and Example 4.53(ii)], it follows that the equilibrium w = 0 of (4.81) is asymptotically stable. Furthermore, in the present case f (x) = o( x ) as x → 0. Therefore, in view of Theorem 4.54, the equilibrium x = 0 of system (4.80) is asymptotically stable.

186

4 Stability

(ii) Consider the system 1 x1 (k + 1) = − x2 (k) + x1 (k)3 + x2 (k)2 , 2 x2 (k + 1) = −3x1 (k) + x41 (k) − x2 (k)5 .

(4.82)

Using the notation of (4.78) and (4.79), we have in the present case ⎤ ⎡ 3 x1 + x22 1 0 −2 ⎦. A= , f (x1 , x2 ) = ⎣ −3 0 x41 − x52 Since A is unstable [refer to Example 4.53(iii) and Example 4.48(iii)] and since f (x) = o( x ) as x → 0, it follows from Theorem 4.54 that the equilibrium x = 0 of system (4.82) is unstable.

4.8.5 Input–Output Stability We conclude this chapter by considering the input–output stability of discretetime systems described by equations of the form x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k),

(4.83)

where all matrices and vectors are deﬁned as in (4.67). Throughout this subsection we will assume that k0 = 0, x(0) = 0, and k ≥ 0. As in the continuous-time case, we say that system (4.83) is BIBO stable if there exists a constant c > 0 such that the conditions x(0) = 0, u(k) ≤ 1,

k ≥ 0,

imply that y(k) ≤ c for all k ≥ 0. The results that we will present involve the impulse response matrix of (4.83) given by CAk−1 B, k > 0, (4.84) H(k) = 0, k ≤ 0, and the transfer function matrix given by % H(z) = C(zI − A)−1 B. Recall that y(n) =

n

H(n − k)u(k).

(4.85)

(4.86)

k=0

Associated with system (4.83) is the free dynamical system described by the equation p(k + 1) = Ap(k). (4.87)

4.8 Discrete-Time Systems

187

Theorem 4.56. The system (4.83) is BIBO stable if and only if there exists a constant L > 0 such that for all n ≥ 0, n

H(k) ≤ L.

(4.88)

k=0

As in the continous-time case, the ﬁrst part of the proof of Theorem 4.56 (suﬃciency) is straightforward. Speciﬁcally, if u(k) ≤ 1 for all k ≥ 0 and if (4.88) is true, then we have for all n ≥ 0, y(n) = ≤

n

H(n − k)u(k) ≤

k=0 n

n

H(n − k)u(k)

k=0

H(n − k) u(k) ≤

k=0

n

H(n − k) ≤ L.

k=0

Therefore, system (4.83) is BIBO stable. In proving the second part of Theorem 4.56 (necessity), we simplify matters by ﬁrst considering in (4.83) the single-variable case (n = 1) with the system description given by y(t) =

t

h(t − k)u(k),

t > 0.

(4.89)

k=0

For purposes of contradiction, we assume that the system is BIBO stable, but no ﬁnite L exists such that (4.88) is satisﬁed. Another way of expressing the last assumption is that for any ﬁnite L, there exists t = k1 (L) k1 such that k1

|h(k1 − k)| > L.

k=0

We now choose in particular the input u given by ⎧ ⎪ ⎨+1 if h(t − k) > 0, u(k) = 0 if h(t − k) = 0, ⎪ ⎩ −1 if h(t − k) < 0, 0 ≤ k ≤ k1 . Clearly, |u(k)| ≤ 1 for all k ≥ 0. The output of the system at t = k1 due to the above input, however, is y(k1 ) =

k1 k=0

h(k1 − k)u(k) =

k1

|h(k1 − k)| > L,

k=0

which contradicts the assumption that the system is BIBO stable.

188

4 Stability

The above can now be extended to the multivariable case. In doing so we apply the single-variable result to every possible pair of input and output vector components, we make use of the fact that the sum of a ﬁnite number of bounded sums will be bounded, and we note that a vector is bounded if and only if each of its components is bounded. We leave the details to the reader. Next, as in the case of continuous-time systems, we note that the asymptotic stability of the equilibrium p = 0 of system (4.87) implies the BIBO stability of system (4.83) since the sum

∞ k=1

k−1

CA

B ≤

∞

C Ak−1 B

k=1

is ﬁnite. % ˆ ij (z)] if for = [h Next, we recall that a complex number zp is a pole of H(z) % ˆ some (i, j) we have |hij (zp )| = ∞. If each entry of H(z) has only poles with modulus (magnitude) less than 1, then, as shown in Chapter 3, each entry of H(k) = [hij (k)] consists of a sum of convergent terms. It follows that under these conditions the sum ∞ H(k) k=0

% is ﬁnite, and any realization of H(z) will result in a system that is BIBO stable. Conversely, if ∞ H(k) k=0

is ﬁnite, then the terms in every entry of H(k) must be convergent. But then % every entry of H(z) has poles whose modulus is within the unit circle of the complex plane. We have proved the ﬁnal result of this section. Theorem 4.57. The time-invariant system (4.83) is BIBO stable if and only if the poles of the transfer function % H(z) = C(zI − A)−1 B are within the unit circle of the complex plane.

4.9 Summary and Highlights In this chapter we ﬁrst addressed the stability of an equilibrium of continuoustime ﬁnite-dimensional systems. In doing so, we ﬁrst introduced the concept of equilibrium and deﬁned several types of stability in the sense of Lyapunov (Sections 4.2 and 4.3). Next, we established several stability conditions of

4.10 Notes

189

an equilibrium for linear systems x˙ = Ax, t ≥ 0 in terms of the state transition matrix in Theorems 4.12–4.14 and in terms of eigenvalues in Theorem 4.15 (Section 4.4). Next, we established various stability conditions that are phrased in terms of the Lyapunov matrix equation (4.25) for system x˙ = Ax (Section 4.5). The existence of Lyapunov functions for x˙ = Ax of the form xT P x is established in Theorem 4.29. In Section 4.6 we established conditions under which the asymptotic stability and the instability of an equilibrium for a nonlinear time-invariant system can be deduced via linearization; see Theorems 4.32 and 4.33. Next, we addressed the input–output stability of time-invariant linear, continuous-time, ﬁnite-dimensional systems (Section 4.7). For such systems we established several conditions for bounded input/bounded output stability (BIBO stability); see Theorems 4.37 and 4.39. The chapter is concluded with Section 4.8, where we addressed the Lyapunov stability and the input–output stability of linear, time-invariant, discrete-time systems. For such systems, we established results that are analogous to the stability results of continuous-time systems. The stability of an equilibrium is expressed in terms of the state transition matrix in Theorem 4.45, in terms of the eigenvalues in Theorem 4.47, and in terms of the Lyapunov Matrix Equation in Theorems 4.49 and 4.50. The existence of Lypunov functions of the form xT P x for x(k + 1) = Ax(k) is established in Theorem 4.52. Stability results based on linearization are presented in Theorem 4.54 and for BIBO stability in Theorems 4.56 and 4.57.

4.10 Notes The initial contributions to stability theory that took place toward the end of the nineteenth century are primarily due to physicists and mathematicians (Lyapunov [11]), whereas input–output stability is the brainchild of electrical engineers (Sandberg [17] to [19], Zames [21], [22]). Sources with extensive coverage of Lyapunov stability theory include, e.g., Hahn [6], Khalil [8], LaSalle [9], LaSalle and Lefschetz [10], Michel and Miller [13], Michel et al. [14], Miller and Michel [15], and Vidyasagar [20]. Input–output stability is addressed in great detail in Desoer and Vidyasagar [5], Vidyasagar [20], and Michel and Miller [13]. For a survey that traces many of the important developments of stability in feedback control, refer to Michel [12]. In the context of linear systems, sources on both Lyapunov stability and input–output stability can be found in numerous texts, including Antsaklis and Michel [1], Brockett [2], Chen [3], DeCarlo [4], Kailath [7], and Rugh [16]. In developing our presentation, we found the texts by Antsaklis and Michel [1], Brockett [2], Hahn [6], LaSalle [9], and Miller and Michel [15] especially helpful. In this chapter, we addressed various types of Lyapunov stability and bounded input/bounded output stability of time-invariant systems. In the

190

4 Stability

various stability concepts for such systems, the initial time t0 (resp., k0 ) plays no signiﬁcant role, and for this reason, we chose without loss of generality t0 = 0 (resp., k0 = 0). In the case of time-varying systems, this is in general not true, and in deﬁning the various Lyapunov stability concepts and the concept of bounded input/bounded output stability, one has to take into account the eﬀects of initial time. In doing so, we have to distinguish between uniformity and nonuniformity when deﬁning the various types of Lyapunov stability of an equilibrium and the BIBO stability of a system. For a treatment of the Lyapunov stability and the BIBO stablity of the time-varying counterparts of systems (4.14), (4.15) and (4.67), (4.68), we refer the reader to Chapter 6 in Antsaklis and Michel [1]. We conclude by noting that there are graphical criteria (i.e., frequency domain criteria), such as, the Leonhard–Mikhailov criterion, and algebraic criteria, such as the Routh–Hurwitz criterion and the Schur–Cohn criterion, which yield necessary and suﬃcient conditions for the asymptotic stability of the equilibrium x = 0 for system (4.15) and (4.68). For a presentation of these results, the reader should consult Chapter 6 in Antsaklis and Michel [1] and Michel [12].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. R.W. Brockett, Finite Dimensional Linear Systems, Wiley, New York, NY, 1970. 3. C.T. Chen, Linear System Theory and Design, Holt, Rinehart and Winston, New York, NY, 1984. 4. R.A. DeCarlo, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1989. 5. C.A. Desoer and M. Vidyasagar, Feedback Systems: Input–Output Properties, Academic Press, New York, NY, 1975. 6. W. Hahn, Stability of Motion, Springer-Verlag, New York, NY, 1967. 7. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 8. H.K. Khalil, Nonlinear Systems, Macmillan, New York, NY, 1992. 9. J.P. LaSalle, The Stability and Control of Discrete Processes, Springer-Verlag, New York, NY, 1986. 10. J.P. LaSalle and S. Lefschetz, Stability by Liapunov’s Direct Method, Academic Press, New York, NY, 1961. 11. M.A. Liapounoﬀ, “Probl`eme g´en´erale de la stabilit´e de mouvement,” Ann. Fac. Sci. Toulouse, Vol. 9, 1907, pp. 203–474. (Translation of a paper published in Comm. Soc. Math. Kharkow 1893, reprinted in Ann. Math. Studies, Vol. 17, 1949, Princeton, NJ). 12. A.N. Michel, “Stability: the common thread in the evolution of feedback control,” IEEE Control Systems, Vol. 16, 1996, pp. 50–60. 13. A.N. Michel and R.K. Miller, Qualitative Analysis of Large Scale Dynamical Systems, Academic Press, New York, NY, 1977. 14. A.N. Michel, K. Wang, and B. Hu, Qualitative Theory of Dynamical Systems, Second Edition, Marcel Dekker, New York, NY, 2001.

Exercises

191

15. R.K. Miller and A.N. Michel, Ordinary Diﬀerential Equations, Academic Press, New York, NY, 1982. 16. W.J. Rugh, Linear System Theory, Second Edition, Prentice-Hall, Englewood Cliﬀs, NJ, 1999. 17. I.W. Sandberg, “On the L2 -boundedness of solutions of nonlinear functional equations,” Bell Syst. Tech. J., Vol. 43, 1964, pp. 1581–1599. 18. I.W. Sandberg, “A frequency-domain condition for stability of feedback systems containing a single time-varying nonlinear element,” Bell Syst. Tech. J., Vol. 43, 1964, pp. 1601–1608. 19. I.W. Sandberg, “Some results on the theory of physical systems governed by nonlinear functional equations,” Bell Syst. Tech. J., Vol. 44, 1965, pp. 871–898. 20. M. Vidyasagar, Nonlinear Systems Analysis, 2d edition, Prentice Hall, Englewood Cliﬀs, NJ, 1993. 21. G. Zames, “On the input–output stability of time-varying nonlinear feedback systems, Part I,” IEEE Trans. on Automat. Contr., Vol. 11, 1966, pp. 228–238. 22. G. Zames, “On the input–output stability of time-varying nonlinear feedback systems, Part II,” IEEE Trans. on Automat. Contr., Vol. 11, 1966, pp. 465–476.

Exercises 4.1. Determine the set of equilibrium points of a system described by the diﬀerential equations x˙ 1 = x1 − x2 + x3 , x˙ 2 = 2x1 + 3x2 + x3 , x˙ 3 = 3x1 + 2x2 + 2x3 . 4.2. Determine the set of equilibria of a system described by the diﬀerential equations x˙ 1 = x2 ,

0, x1 sin(1/x1 ), when x1 = x˙ 2 = 0, when x1 = 0. 4.3. Determine the equilibrium points and their stability properties of a system described by the ordinary diﬀerential equation x˙ = x(x − 1)

(4.90)

by solving (4.90) and then applying the deﬁnitions of stability, asymptotic stability, etc. 4.4. Prove that the equilibrium x = 0 of (4.16) is stable (resp., asymptotically stable or unstable) if and only if y = 0 of (4.19) is stable (resp., asymptotically stable or unstable).

192

4 Stability

4.5. Apply Proposition 4.20 to determine the deﬁniteness properties of the matrix A given by ⎡ ⎤ 1 2 1 A = ⎣ 2 5 −1 ⎦ . 1 −1 10 4.6. Use Theorem 4.26 to prove that the trivial solution of the system 34 x1 x˙ 1 = x˙ 2 x2 21 is unstable. 4.7. Determine the equilibrium points of a system described by the diﬀerential equation x˙ = −x + x2 , and determine the stability properties of the equilibrium points, if applicable, by using Theorem 4.32 or 4.33. 4.8. The system described by the diﬀerential equations x˙ 1 = x2 + x1 (x21 + x22 ), x˙ 2 = −x1 + x2 (x21 + x22 )

(4.91)

has an equilibrium at the origin xT = (x1 , x2 ) = (0, 0). Show that the trivial solution of the linearization of system (4.91) is stable. Prove that the equilibrium x = 0 of system (4.91) is unstable. (This example shows that the assumptions on the matrix A in Theorems 4.32 and 4.33 are absolutely essential.) 4.9. Use Corollary 4.38 to analyze the stability properties of the system given by x˙ = Ax + Bu, y = Cx, −1 0 A= , 1 −1

1 B= , −1

C = [0, 1].

4.10. Determine all equilibrium points for the discrete-time systems given by (a) x1 (k + 1) = x2 (k) + |x1 (k)|, x2 (k + 1) = −x1 (k) + |x2 (k)|.

Exercises

193

(b) x1 (k + 1) = x1 (k)x2 (k) − 1, x2 (k + 1) = 2x1 (k)x2 (k) + 1. 4.11. Prove Theorem 4.43. 4.12. Determine the stability properties of the trivial solution of the discretetime system given by the equations cos θ sin θ x1 (k) x1 (k + 1) = − sin θ cos θ x2 (k + 1) x2 (k) with θ ﬁxed. 4.13. Analyze the stability of the equilibrium x = 0 of the system described by the scalar-valued diﬀerence equation x(k + 1) = sin[x(k)]. 4.14. Analyze the stability of the equilibrium x = 0 of the system described by the diﬀerence equations x1 (k + 1) = x1 (k) + x2 (k)[x1 (k)2 + x2 (k)2 ], x2 (k + 1) = x2 (k) − x1 (k)[x1 (k)2 + x2 (k)2 ]. 4.15. Determine a basis of the solution space of the system 01 x1 (k) x1 (k + 1) = . x2 (k + 1) x2 (k) −6 5 Use your answer in analyzing the stability of the trivial solution of this system. 4.16. Let A ∈ Rn×n . Prove that part (iii) of Theorem 4.45 is equivalent to the statement that all eigenvalues of A have modulus less than 1; i.e., lim Ak = 0

k→∞

if and only if for any eigenvalue λ of A, it is true that |λ| < 1. 4.17. Use Theorem 4.44 to show that the equilibrium x = 0 of the system ⎡ ⎤ 1 1 1 ··· 1 ⎢ 0 1 1 ··· 1 ⎥ ⎥ x(k + 1) = ⎢ ⎣ · · · · · · · · · · · · · · · ⎦ x(k) 0 0 0 ··· 1 is unstable.

194

4 Stability

4.18. (a) Use Theorem 4.47 to determine the stability of the equilibrium x = 0 of the system ⎡ ⎤ 1 1 −2 x(k + 1) = ⎣ 0 1 3 ⎦ x(k). 0 9 −1 (b) Use Theorem 4.47 to determine the stability of the equilibrium x = 0 of the system ⎡ ⎤ 1 0 −2 x(k + 1) = ⎣ 0 1 3 ⎦ x(k). 0 9 −1 4.19. Apply Theorems 4.24 and 4.49 to show that if the equilibrium x = 0 (x ∈ Rn ) of the system x(k + 1) = eA x(k) is asymptotically stable, then the equilibrium x = 0 of the system x˙ = Ax is also asymptotically stable. 4.20. Apply Theorem 4.49 to show that the trivial solution of the system given by x1 (k + 1) 02 x1 (k) = x2 (k + 1) x2 (k) 20 is unstable. 4.21. Determine the stability of the equilibrium x = 0 of the scalar-valued system given by 1 2 x(k + 1) = x(k) + sin x(k). 2 3 4.22. Analyze the stability properties of the discrete-time system given by 1 x(k + 1) = x(k) + u(k) 2 1 y(k) = x(k) 2 where x, y, and u are scalar-valued variables. Is this system BIBO stable? 4.23. Prove Theorem 4.47. 4.24. Prove Theorem 4.49 by following a similar approach as was used in the proofs of Theorems 4.22, 4.24, and 4.26. 4.25. Prove Theorem 4.54 by following a similar approach as was used in the proofs of Theorems 4.32 and 4.33.

5 Controllability and Observability: Fundamental Results

5.1 Introduction The principal goals of this chapter are to introduce the system properties of controllability and observability (and of reachability and constructibility), which play a central role in the study of state feedback controllers and state observers, and in establishing the relations between internal and external system representations, topics that will be studied in Chapters 7, 8, and 9. State controllability refers to the ability to manipulate the state by applying appropriate inputs (in particular, by steering the state vector from one vector value to any other vector value in ﬁnite time). Such is the case, for example, in satellite attitude control, where the satellite must change its orientation. State observability refers to the ability to determine the state vector of the system from knowledge of the input and the corresponding output over some ﬁnite time interval. Since it is frequently diﬃcult or impossible to measure the state of a system directly (for example, internal temperatures and pressures in an internal combustion engine), it is very desirable to determine such states by observing the inputs and outputs of the system over some ﬁnite time interval. In Section 5.2, the concepts of reachability and controllability and observability and constructibility are introduced, using discrete-time time-invariant systems. Discrete-time systems are selected for this exposition because the mathematical development is much simpler in this case. In subsection 5.2.3 the concept of duality is also introduced. Reachability and controllability are treated in detail in Section 5.3 and observability and constructibility in Section 5.4 for both continuous-time and discrete-time time-invariant systems.

5.2 A Brief Introduction to Reachability and Observability Reachability and controllability are introduced ﬁrst, followed by observability and constructibility. These important system concepts are more easily

196

5 Controllability and Observability: Fundamental Results

explained in the discrete-time case, and this is the approach taken in this section. Duality is also discussed at the end of the section. 5.2.1 Reachability and Controllability The concepts of state reachability (or controllability-from-the-origin) and controllability (or controllability-to-the-origin) are introduced here and are discussed at length in Section 5.3. In the case of time-invariant systems, a state x1 is called reachable if there exists an input that transfers the state of the system x(t) from the zero state to x1 in some ﬁnite time T . The deﬁnition of reachability for the discrete-time case is completely analogous. Figure 5.1 shows that diﬀerent control inputs u1 (t) and u2 (t) may force the state of a continuous-time system to reach the value x1 from the origin at diﬀerent ﬁnite times T1 and T2 , following diﬀerent paths. Note that reachability refers to the ability of the system to reach x1 from the origin in some ﬁnite time; it speciﬁes neither the exact time it takes to achieve this nor the trajectory to be followed. x(t) x1 u1 (t) u2 (t) 0

T1

T2

t

Figure 5.1. A reachable state x1

A state x0 is called controllable if there exists an input that transfers the state from x0 to the zero state in some ﬁnite time T . See Figure 5.2. The deﬁnition of controllability for the discrete-time case is completely analogous. Similar to reachability, controllability speciﬁes neither the time it takes to achieve the transfer nor the trajectory to be followed. We note that when particular types of trajectories to be followed are of interest, then one seeks particular control inputs that will achieve such transfers. This leads to various control problem formulations, including the Linear Quadratic (Optimal) Regulator (LQR). The LQR problem is discussed in Chapter 9. Section 5.3 shows that reachability always implies controllability, but controllability implies reachability only when the state transition matrix Φ of the system is nonsingular. This is always true for continuous-time systems, but is

5.2 A Brief Introduction to Reachability and Observability

197

x(t)

x0 u2 (t) u1(t) 0

T2

T1

t

Figure 5.2. A controllable state x0

true for discrete-time systems only when the matrix A of the system is nonsingular. If the system is state reachable, then there always exists an input that transfers any state x0 to any other state x1 in ﬁnite time. In the time-invariant case, a system is reachable (or controllable-from-theorigin) if and only if its controllability matrix C, C [B, AB, . . . , An−1 B] ∈ Rn×mn ,

(5.1)

has full row rank n; that is, rank C = n. The matrices A ∈ Rn×n and B ∈ Rn×m come from either the continuous-time state equations x˙ = Ax + Bu

(5.2)

or the discrete-time state equations x(k + 1) = Ax(k) + Bu(k),

(5.3)

k ≥ k0 = 0. Alternatively, we say that the pair (A, B) is reachable. The matrix C should perhaps more appropriately be called the “reachability matrix” or the “controllability-from-the-origin matrix.” The term “controllability matrix,” however, has been in use for some time and is expected to stay in use. Therefore, we shall call C the “controllability matrix,” having in mind the “controllability-from-the-origin matrix.” We shall now discuss reachability and controllability for discrete-time timeinvariant systems (5.3). If the state x(k) in (5.3) is expressed in terms of the initial vector x(0), then (see Subsection 3.5.1) x(k) = Ak x(0) +

k−1

Ak−(i+1) Bu(i)

(5.4)

i=0

for k > 0. Rewriting the summation in terms of matrix-vector multiplication, it follows that it is possible to transfer the state from some value x(0) = x0 to some x1 in n steps, that is, x(n) = x1 , if there exists an n-step input sequence {u(0), u(1), . . . , u(n − 1)} that satisﬁes the equation

198

5 Controllability and Observability: Fundamental Results

x1 − An x0 = Cn Un ,

(5.5)

where Cn [B, AB, . . . , An−1 B] = C [see (5.1)] and Un [uT (n − 1), uT (n − 2), . . . , uT (0)]T .

(5.6)

From the theory of linear algebraic equations, (5.5) has a solution Un if and only if (5.7) x1 − An x0 ∈ R(C), where R(C) = range(C). Note that it is not necessary to take more than n steps in the control sequence, since if this transfer cannot be accomplished in n steps, it cannot be accomplished at all. This follows from the Cayley–Hamilton Theorem, in view of which it can be shown that R(Cn ) = R(Ck ) for k ≥ n. Also note that R(Cn ) includes R(Ck ) for k < n [i.e., R(Cn ) ⊃ R(Ck ), k < n]. (See Exercise 5.1.) It is now easy to see that the system (5.3) or the pair (A, B) is reachable (controllable-from-the-origin), if and only if rank C = n, since in this case R(C) = Rn , the entire state space. Note that x1 ∈ R(C) is the condition for a particular state x1 to be reachable from the zero state. Since R(C) contains all such states, it is called the reachable subspace of the system. It is also clear from (5.5) that if the system is reachable, any state x0 can be transferred to any other state x1 in n steps. In addition, the input that accomplishes this transfer is any solution Un of (5.5). Note that, depending on x1 and x0 , this transfer may be accomplished in fewer than n steps (see Section 5.3).

01 Example 5.1. Consider x(k + 1) = Ax(k)+ Bu(k), where A = , B= 11 0 . Here the controllability (-from-the-origin) matrix C is C = [B, AB] = 1 01 with rank C = 2. Therefore, the system [or the pair (A, B)] is reachable, 11 meaning that any state x1 can be reached from the zero state in a ﬁnite number of steps by applying at most n inputs {u(0), u(1), . . . , u(n−1)} (presently, n = a a 01 u(1) 2). To see this, let x1 = . Then (5.5) implies that = or b 11 u(0) b u(1) −1 1 a b−a = = . Thus, the control u(0) = a, u(1) = b − a u(0) 10 b a a will transfer the state from the origin at k = 0 to the state at k = 2. b 0 0 To verify this, we observe that x(1) = Ax(0) + Bu(0) = a= and 1 a a 0 a . x(2) = Ax(1) + Bu(1) = + (b − a) = b a 1 Reachability of the system also implies that a state x1 can be reached from any other state x0 in at most n = 2 steps. To illustrate this, let

5.2 A Brief Introduction to Reachability and Observability

199

1 a 11 1 x(0) = . Then (5.5) implies that x1 − A2 x0 = − = 1 b 12 1 a−2 01 u(1) u(1) b−a−1 = . Solving, = , which will drive b−3 11 u(0) u(0) a−2 1 a the state from at k = 0 to at k = 2. 1 b Notice that in general the solution Un of (5.5) is not unique; i.e., many inputs can accomplish the transfer from x(0) = x0 to x(n) = x1 , each corresponding to a particular state trajectory. In control problems, particular inputs are frequently selected that, in addition to transferring the state, satisfy additional criteria, such as, e.g., minimization of an appropriate performance index (optimal control). A system [or the pair (A, B)] is controllable, or controllable-to-the-origin, when any state x0 can be driven to the zero state in a ﬁnite number of steps. From (5.5) we see that a system is controllable when An x0 ∈ R(C) for any x0 . If rank A = n, a system is controllable when rank C = n, i.e., when the reachability condition is satisﬁed. In this case the n × mn matrix A−n C = [A−n B, . . . , A−1 B]

(5.8)

is of interest and the system is controllable if and only if rank(A−n C) = rank C = n. If, however, rank A < n, then controllability does not imply reachability (see Section 5.3). Example 5.2. The system in Example 5.1 is controllable (-to-the-origin). 11 a 2 To see this, we let, x1 = 0 in (5.5) and write −A x0 = − = 1 2 b a u(1) 01 u(1) . From this we obtain [B, AB] = , where x0 = b u(0) 11 u(0) u(1) −1 1 11 a 0 −1 a −b =− = = , which is the u(0) 10 12 b −1 −1 b −a − b a 0 input that will drive the state from at k = 0 to at k = 2. b 0 Example 5.3. The system x(k + 1) = 0 is controllable since any state, say, x(0) = [ ab ], can be transferred to the zero state in one step. In this system, however, the input u does not aﬀect the state at all! This example shows that reachability is a more useful concept than controllability for discretetime systems. It should be pointed out that nothing has been said up to now about maintaining the desired system state after reaching it [refer to (5.5)]. Zeroing

200

5 Controllability and Observability: Fundamental Results

the input for k ≥ n, i.e., letting u(k) = 0 for k ≥ n, will not typically work, unless Ax1 = x1 . In general a state starting at x1 , will remain at x1 for all k ≥ n if and only if there exists an input u(k), k ≥ n, such that x1 = Ax1 + Bu(k),

(5.9)

that is, if and only if (I − A)x1 ∈ R(B). Clearly, there are states for which this condition may not be satisﬁed. 5.2.2 Observability and Constructibility In Section 5.4, deﬁnitions for state observability and constructibility are given, and appropriate tests for these concepts are derived. It is shown that observability always implies constructibility, whereas constructibility implies observability only when the state transition matrix Φ of the system is nonsingular. Whereas this is always true for continuous-time systems, it is true for discretetime systems only when the matrix A of the system is nonsingular. If a system is state observable, then its present state can be determined from knowledge of the present and future outputs and inputs. Constructibility refers to the ability of determining the present state from present and past outputs and inputs, and as such, it is of greater interest in applications. In the time-invariant case a system [or a pair (A, C)] is observable if and only if its observability matrix O, where ⎤ ⎡ C ⎢ CA ⎥ ⎥ ⎢ (5.10) O⎢ ⎥ ∈ Rpn×n , .. ⎦ ⎣ . CAn−1 has full column rank; i.e., rank O = n. The matrices A ∈ Rn×n and C ∈ Rp×n are given by the system description x˙ = Ax + Bu,

y = Cx + Du

(5.11)

in the continuous-time case, and by the system description x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k),

(5.12)

with k ≥ k0 = 0, in the discrete-time case. We shall now brieﬂy discuss observability and constructibility for the discrete-time time-invariant case. As in the case of reachability and controllability, this discussion will provide insight into the underlying concepts and will clarify what these imply for a system.

5.2 A Brief Introduction to Reachability and Observability

201

If the output in (5.12) is expressed in terms of the initial vector x(0), then y(k) = CAk x(0) +

k−1

CAk−(i+1) Bu(i) + Du(k)

(5.13)

i=0

for k > 0 (see Section 3.5). This implies that y˜(k) = CAk x0

(5.14)

for k ≥ 0, where y˜(k) y(k) −

k−1

CAk−(i+1) Bu(i) + Du(k)

i=0

for k > 0, y˜(0) y(0)−Du(0), and x0 = x(0). In (5.14) x0 is to be determined assuming that the system parameters are given and the inputs and outputs are measured. Note that if u(k) = 0 for k ≥ 0, then the problem is simpliﬁed, since y˜(k) = y(k) and since the output is generated only by the initial condition x0 . It is clear that the ability of determining x0 from output and input measurements depends only on the matrices A and C, since the left-hand side of (5.14) is a known quantity. Now if x(0) = x0 is known, then all x(k), k ≥ 0, can be determined by means of (5.12). To determine x0 , we apply (5.14) for k = 0, . . . , n − 1. Then (5.15) Y(0,n−1 = On x0 , where On [C T , (CA)T , . . . , (CAn−1 )T ]T = O [as in (5.10)] and Y(0,n−1 [˜ y T (0), . . . , y˜T (n − 1)]T . Now (5.15) always has a solution x0 , by construction. A system is observable if the solution x0 is unique, i.e., if it is the only initial condition that, together with the given input sequence, can generate the observed output sequence. From the theory of linear systems of equations, (5.15) has a unique solution x0 if and only if the null space of O consists of only the zero vector, i.e., Null(O) = N (O) = {0}, or equivalently, if and only if the only x ∈ Rn that satisﬁes Ox = 0 (5.16) is the zero vector. This is true if and only if rank O = n. Thus, a system is observable if and only if rank O = n. Any nonzero state vector x ∈ Rn that satisﬁes (5.16) is said to be an unobservable state, and N (O) is said to be the unobservable subspace. Note that any such x satisﬁes CAk x = 0 for k = 0, 1, . . . , n − 1. If rank O < n, then all vectors x0 that satisfy (5.15) are given by x0 = x0p + x0h , where x0p is a particular solution and x0h is any vector in N (O). Any of these state vectors, together with the given inputs, could have generated the measured outputs.

202

5 Controllability and Observability: Fundamental Results

To determine x0 from (5.15) it is not necessary to use more than n values for y˜(k), k = 0, . . . , n − 1, or to observe y(k) for more than n steps in the future. This is true because, in view of the Cayley–Hamilton Theorem, it can be shown that N (On ) = N (Ok ) for k ≥ n. Note also that N (On ) is included in N (Ok ) (N (On ) ⊂ N (Ok )) for k < n. Therefore, in general, one has to observe the output for n steps (see Exercise 5.1). Example 5.4. Consider the system x(k + 1) = Ax(k), y(k) = Cx(k), where 01 C 01 A = and C = [0 1]. Here, O = = with rank O = 2. 11 CA 11 Therefore, the system [or the pair (A, C)] is observable. This means that x(0) can uniquely be determined from n = 2 output measurements (in the present y(0) 01 x1 (0) cases, the input is zero). In fact, in view of (5.15), = x2 (0) y(1) 11 x1 (0) −1 1 y(0) y(1) − y(0) or = = . x2 (0) 10 y(1) y(0) Example 5.5. Consider the system x(k + 1) = Ax(k), y(k) = Cx(k), where 10 C 10 A= and C = [1 0]. Here, O = = with rank O = 1. There11 CA 10 0 fore, the system is not observable. Note that a basis for N (O) is , which 1 0 in view of (5.16) implies that all state vectors of the form , c ∈ R, are c y(0) 10 x1 (0) . For a sounobservable. Relation (5.15) implies that = x2 (0) y(1) 10 lution x(0) to exist, as it must, we have that y(0) = y(1) = a. Thus, this system will generate an identical output for k ≥ 0. Accordingly, all x(0) that satisfy x1 (0) a 0 a (5.15) and can generate this output are given by = + = , 0 c c x2 (0) where c ∈ R. In general, a system (5.12) [or a pair (A, C)] is constructible if the only vector x that satisﬁes x = Ak x ˆ with C x ˆ = 0 for every k ≥ 0 is the zero vector. When A is nonsingular, this condition can be stated more simply, namely, that the system is constructible if the only vector x that satisﬁes CA−k x = 0 for every k ≥ 0 is the zero vector. Compare this with the condition CAk x = 0, k ≥ 0, for x to be an unobservable state; or with the condition that a system is observable if the only vector x that satisﬁes CAk x = 0 for every k ≥ 0 is the zero vector. In view of (5.14), the above condition for a system to be constructible is the condition for the existence of a unique solution x0 when past outputs and inputs are used. This, of course, makes sense since constructibility refers to determining the present state from knowledge

5.2 A Brief Introduction to Reachability and Observability

203

of past outputs and inputs. Therefore, when A is nonsingular, the system is constructible if and only if the pn × n matrix ⎤ ⎡ CA−n ⎥ ⎢ OA−n = ⎣ ... ⎦ (5.17) CA−1

has full rank, since in this case the only x that satisﬁes CA−k x = 0 for every k ≥ 0 is x = 0. Note that if the system is observable, then it is also constructible; however, if it is constructible, then it is also observable only when A is nonsingular (see Section 5.3). Example 5.6. Consider the (unobservable) in Example 5.5. Since A system 10 10 10 −2 is nonsingular, OA = = . Since rank OA−2 = 1 < 2, 10 −2 1 10 the system [or the pair (A, C)] is not constructible. This can also be seen from the relation CA−k x = 0, k ≥ 0, that has nonzero solutions x, since C = [1, 0] = CA−1 = CA−2 = · · · = CA−k for k ≥ 0, which implies that any 0 x= , c ∈ R, is a solution. c

5.2.3 Dual Systems Consider the system described by x˙ = Ax + Bu,

y = Cx + Du,

(5.18)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . The dual system of (5.18) is deﬁned as the system x˙ D = AD xD + BD uD ,

yD = CD xD + DD uD ,

(5.19)

where AD = AT , BD = C T , CD = B T , and DD = DT . Lemma 5.7. System (5.18), denoted by {A, B, C, D}, is reachable (controllable) if and only if its dual {AD , BD , CD , DD } in (5.19) is observable (constructible), and vice versa. Proof. System {A, B, C, D} is reachable if and only if C [B, AB, . . . , An−1 B] has full rank n, and its dual is observable if and only if ⎤ ⎡ BT ⎢ B T AT ⎥ ⎥ ⎢ OD ⎢ ⎥ .. ⎦ ⎣ . B T (AT )n−1

204

5 Controllability and Observability: Fundamental Results

T has full rank n. Since OD = C, {A, B, C, D} is reachable if and only if {AD , BD , CD , DD } is observable. Similarly, {A, B, C, D} is observable if and only if {AD , BD , CD , DD } is reachable. Now {A, B, C, D} is controllable if and only if its dual is constructible, and vice versa, since it is shown in Sections 5.3 and 5.4, that a continuous-time system is controllable if and only if it is reachable; it is constructible if and only if it is observable.

For the discrete-time time-invariant case, the dual system is again deﬁned as AD = AT , BD = C T , CD = B T , and DD = DT . That such a system is reachable if and only if its dual is observable can be shown in exactly the same way as in the proof of Lemma 5.7. That such a system is controllable if and only if its dual is constructible in the case when A is nonsingular is because in this case the system is reachable if and only if it is controllable; and the same holds for observability and constructibility. The proof for the case when A is singular involves the controllable and unconstructible subspaces of a system and its dual. We omit the details. The reader is encouraged to complete this proof after studying Sections 5.3 and 5.4. Figure 5.3 summarizes the relationships between reachability (observability) and controllability (constructibility) for continuous- and discrete-time systems.

Reachability

Dual

Observability

Controllability

Dual

Constructibility

Figure 5.3. In continuous-time systems, reachability (observability) always implies and is implied by controllability (constructibility). In discrete-time systems, reachability (observability) always implies but in general is not implied by controllability (constructibility).

5.3 Reachability and Controllability The objective here is to study the important properties of state controllability and reachability when a system is described by a state-space representation. In the previous section, a brief introduction to these concepts was given for discrete-time systems, and it was shown that a system is completely reachable if and only if the controllability (-from-the-origin) matrix C in (5.1) has full rank n (rank C = n). Furthermore, it was shown that the input sequence necessary to accomplish the transfer can be determined directly from C by solving

5.3 Reachability and Controllability

205

a system of linear algebraic equations (5.5). In a similar manner, we would like to derive tests for reachability and controllability and determine the necessary system inputs to accomplish the state transfer for the continuous-time case. We note, however, that whereas the test for reachability can be derived by a number of methods, the appropriate sequence of system inputs to use cannot easily be determined directly from C, as was the case for discrete-time systems. For this reason, we use an approach that utilizes ranges of maps, in particular, the range of an important n × n matrix—the reachability Gramian. The inputs that accomplish the desired state transfer can be determined directly from this matrix. 5.3.1 Continuous-Time Time-Invariant Systems We consider the state equation x˙ = Ax + Bu,

(5.20)

where A ∈ Rn×n , B ∈ Rn×m , and u(t) ∈ Rm is (piecewise) continuous. The state at time t is given by

t x(t) = Φ(t, t0 )x(t0 ) + Φ(t, τ )Bu(τ )dτ, (5.21) t0

where Φ(t, τ ) is the state transition matrix of the system, and x(t0 ) = x0 denotes the state at initial time. Here (5.22) Φ(t, τ ) = Φ(t − τ, 0) = exp[(t − τ )A] = eA(t−τ ) . We are interested in using the input to transfer the state from x0 to some other value x1 at some ﬁnite time t1 > t0 , [i.e., x(t1 ) = x1 in (5.21)]. Because of time invariance, the diﬀerence t1 − t0 = T , rather than the individual times t0 and t1 , is important. Accordingly, we can always take t0 = 0 and t1 = T . Equation (5.21) assumes the form

x1 − e

AT

T

x0 =

eA(T −τ ) Bu(τ )dτ,

(5.23)

0

and clearly, there exists u(t), t ∈ [0, T ], that satisﬁes (5.23) if and only if such transfer of the state is possible. Letting x ˆ1 x1 − eAT x0 , we note that the u(t) that transfers the state from x0 at time 0 to x1 at time T will also cause the state to reach x ˆ1 at T , starting from the origin at 0 (i.e., x(0) = 0). For the time-invariant system (5.20), we introduce the following concepts. Deﬁnition 5.8. (i) A state x1 is reachable if there exists an input u(t), t ∈ [0, T ], that transfers the state x(t) from the origin at t = 0 to x1 in some ﬁnite time T .

206

5 Controllability and Observability: Fundamental Results

(ii) The set of all reachable states Rr is the reachable subspace of the system x˙ = Ax + Bu, or of the pair (A, B). (iii) The system x˙ = Ax + Bu, or the pair (A, B) is (completely state) reach able if every state is reachable, i.e., if Rr = Rn . Regarding (ii), note that the set of all reachable states x1 contains the origin and constitutes a linear subspace of the state space (Rn , R). A reachable state is sometimes also called controllable-from-the-origin. Additionally, there are also states deﬁned to be controllable-to-the-origin or simply controllable; see the deﬁnition later in this section. Deﬁnition 5.9. The n× n reachability Gramian of the time-invariant system x˙ = Ax + Bu is

T T e(T −τ )A BB T e(T −τ )A dτ. (5.24) Wr (0, T ) 0

Note that Wr is symmetric and positive semideﬁnite for every T > 0; i.e., Wr = WrT and Wr ≥ 0 (show this). It can now be shown in [1, p. 230, Lemma 3.2.1] that the reachable subspace of the system (5.20) is exactly the range of the reachability Gramian Wr in (5.24). Let the n × mn controllability (-from-the-origin) matrix be C [B, AB, . . . , An−1 B].

(5.25)

The range of Wr (0, T ), denoted by R(Wr (0, T )), is independent of T ; i.e., it is the same for any ﬁnite T (> 0), and in particular, it is equal to the range of the controllability matrix C. Thus, the reachable subspace Rr of system (5.20), which is the set of all states that can be reached from the origin in ﬁnite time, is given by the range of C, R(C), or the range of Wr (0, T ), R(Wr (0, T )), for some ﬁnite (and therefore for any) T > 0. This is stated as Lemma 5.10 below; for the proof, see [1, p. 236, Lemma 3.2.10]. Lemma 5.10. R(Wr (0, T )) = R(C) for every T > 0.

01 0 Example 5.11. For the system x˙ = Ax + Bu with A = and B = , 0 0 1 1t t and eAt B = . The reachability Gramian is we have eAt = 0 1 1 1 3 1 2 T (T − τ )2 T − τ T T −τ T T [T −τ, 1]dτ = 0 dτ = 31 2 2 . Wr (0, T ) = 0 1 T −τ 1 T 2T 1 T 4 = 0 for any T > 0, rank Wr (0, T ) = n and (A, B) Since det Wr (0, T ) = 12 01 is reachable. Note that C = [B, AB] = and that R(Wr (0, T )) = R(C) = 10 2 R , as expected (Lemma 5.10).

5.3 Reachability and Controllability

207

1 0 10 If B = , instead of , then C = [B, AB] = and (A, B) 0 1 00 1 and the reachability matrix is is not reachable. In this case eAt B = 0 T 1 0 T 0 dτ = . Notice again that R(C) = R(Wr (0, T )) for Wr (0, T ) = 0 00 0 0 every T > 0. The following theorems and corollaries 5.12 to 5.15 contain the main reachability results. Their proofs may be found in [1, p. 237, Chapter 3], starting with Theorem 2.11. Theorem 5.12. Consider the system x˙ = Ax + Bu, and let x(0) = 0. There exists an input u that transfers the state to x1 in ﬁnite time if and only if x1 ∈ R(C), or equivalently, if and only if x1 ∈ R(Wr (0, T )) for some ﬁnite (and therefore for any) T . Thus, the reachable subspace Rr = R(C) = R(Wr (0, T )). Furthermore, an appropriate u that will accomplish this transfer in time T is given by T u(t) = B T eA (T −t) η1 (5.26) with η1 such that Wr (0, T )η1 = x1 and t ∈ [0, T ].

Note that in (5.26) no restrictions are imposed on time T , other than T be ﬁnite. T can be as small as we wish; i.e., the transfer can be accomplished in a very short time indeed. Corollary 5.13. The system x˙ = Ax + Bu, or the pair (A, B), is (completely state) reachable, if and only if rank C = n,

(5.27)

rank Wr (0, T ) = n

(5.28)

or equivalently, if and only if

for some ﬁnite (and therefore for any) T .

Theorem 5.14. There exists an input u that transfers the state of the system x˙ = Ax + Bu from x0 to x1 in some ﬁnite time T if and only if x1 − eAT x0 ∈ R(C),

(5.29)

or equivalently, if and only if x1 − eAT x0 ∈ R(Wr (0, T )). Such an input is given by

(5.30)

208

5 Controllability and Observability: Fundamental Results

u(t) = B T eA

T

(T −t)

η1

(5.31)

with t ∈ [0, T ], where η1 is a solution of Wr (0, T )η1 = x1 − eAT x0 .

(5.32)

The above theorem leads to the next result, which establishes the importance of reachability in determining an input u to transfer the state from any x0 to any x1 in ﬁnite time. Corollary 5.15. Let the system x˙ = Ax + Bu be (completely state) reachable, or the pair (A, B) be reachable. Then there exists an input that will transfer any state x0 to any other state x1 in some ﬁnite time T . Such input is given by T u(t) = B T eA (T −t) Wr−1 (0, T )[x1 − eAT x0 ] (5.33) for t ∈ [0, T ].

There are many diﬀerent control inputs u that can accomplish the transfer from x0 to x1 in time T . It can be shown that the input u given by (5.33) accomplishes this transfer while expending a minimum amount of energy; T in fact, u minimizes the cost functional 0 u(τ ) 2 dτ , where u(t) [uT (t)u(t)]1/2 denotes the Euclidean norm of u(t).

01 0 Example 5.16. The system x˙ = Ax + Bu with A = and B = is 00 1 reachable (see Example 5.11). A control input u(t) that will transfer any state x0 to any other state x1 in some ﬁnite time T is given by (see Corollary 5.15 and Example 5.11) T

Wr−1 (0, T )[x1 − eAT x0 ] 1T 12/T 3 −6/T 2 − x0 . x = [T − t, 1] 1 0 1 −6/T 2 4/T

u(t) = B T eA

(T −t)

Example 5.17. For the (scalar) system x˙ = −ax + bu, determine u(t) that will transfer the state from x(0) = x0 to the origin in T sec; i.e., x(T ) = 0. We shall apply Corollary 5.15. The reachability Gramian is Wr (0, T ) = T T −(T −τ )a −(T −τ )a 1 e bbe dτ = e−2aT b2 0 e2aτ dτ = e−2aT b2 2a [e2aT − 1] = 0 2 b −2aT ]. (Note [see (5.36) below] that the controllability Gramian is 2a [1 − e b2 2aT − 1].) Now in view of (5.33), we have Wc (0, T ) = 2a [e 2a 1 [−e−aT x0 ] 2 b 1 − e−2aT 2a e−2aT 1 2a =− eat x0 . eaT x0 = − b 1 − e−2aT b e2aT − 1

u(t) = be−(T −t)a

5.3 Reachability and Controllability

209

To verify that this u(t) accomplishes the desired transfer, we compute x(t) = t t −at aτ t aτ −at −at eAt x0 + 0 eA(t−τ ) Bu(τ )dτ = e x + e e bu(τ )dτ = e [x + e b× 0 0 0 0 2at 1 aτ − 2a dτ = e−at 1 − ee2aT −1 b e2aT −1 × e −1 x0 . Note that x(T ) = 0, as desired, and also that x(0) = x0 . The above expression shows also that for t > T , the state does not remain at the origin. An important point to notice here is that as T → 0, the control magnitude |u| → ∞. Thus, although it is (theoretically) possible to accomplish the desired transfer instantaneously, this will require inﬁnite control magnitude. In general the faster the transfer, the larger the control magnitude required. We now introduce the concept of a controllable state. Deﬁnition 5.18. (i) A state x0 is controllable if there exists an input u(t), t ∈ [0, T ], which transfers the state x(t) from x0 at t = 0 to the origin in some ﬁnite time T . (ii) The set of all controllable states Rc , is the controllable subspace of the system x˙ = Ax + Bu, or of the pair (A, B). (iii) The system x˙ = Ax + Bu, or the pair (A, B), is (completely state) con trollable if every state is controllable, i.e., if Rc = Rn . We shall now establish the relationship between reachability and controllability for the continuous-time time-invariant systems (5.20). In view of (5.23), x0 is controllable when there exists u(t), t ∈ [0, T ], so that

T

−eAT x0 =

eA(T −τ ) Bu(τ )dτ

0

or when e x0 ∈ R(Wr (0, T )) [1, p. 230, Lemma 3.2.1], or equivalently, in view of Lemma 5.10, when (5.34) eAT x0 ∈ R(C) AT

for some ﬁnite T . Recall that x1 is reachable when x1 ∈ R(C).

(5.35)

We require the following result. Lemma 5.19. If x ∈ R(C), then Ax ∈ R(C); i.e., the reachable subspace Rr = R(C) is an A-invariant subspace. Proof. If x ∈ R(C), this means that there exists a vector α such that [B, AB, . . . , An−1 B]α = x. Then Ax = [AB, A2 B, . . . , An B]α. In view of the Cayley–Hamilton Theorem, An can be expressed as a linear combination of An−1 , . . . , A, I, which implies that Ax = Cβ for some appropriate vector β. Therefore, Ax ∈ R(C).

210

5 Controllability and Observability: Fundamental Results

Theorem 5.20. Consider the system x˙ = Ax + Bu. (i) A state x is reachable if and only if it is controllable. (ii) Rc = Rr . (iii) The system (2.3), or the pair (A, B), is (completely state) reachable if and only if it is (completely state) controllable. Proof. Let x be reachable, that is, x ∈ R(C). Premultiply x by eAT = ∞ (i) k k 2 k k=0 (T /k!)A and notice that, in view of Lemma 5.19, Ax, A x, . . . , A x ∈ AT R(C). Therefore, e x ∈ R(C) for any T that, in view of (5.34), implies AT that x is also controllable. If now x is controllable, & AT ' i.e., e x ∈ R(C), then −AT −AT e x = x will also be in R(C). , the vector e premultiplying by e Therefore, x is also reachable. Note that the second part of (i), that controllability implies reachability, is true because the inverse (eAT )−1 = e−AT does exist. This is in contrast to the discrete-time case where the state transition matrix Φ(k, 0) is nonsingular if and only if A is nonsingular [nonreversibility of time in discrete-time systems]. Parts (ii) and (iii) of the theorem follow directly from (i). The reachability Gramian for the time-invariant case, Wr (0, T ), was deﬁned in (5.24). For completeness the controllability Gramian is deﬁned below. Deﬁnition 5.21. The controllability Gramian in the time-invariant case is the n × n matrix

T T e−Aτ BB T e−A τ dτ. (5.36) Wc (0, T ) 0

We note that Wr (0, T ) = eAT Wc (0, T )eA

T

T

,

which can be veriﬁed directly. Additional Criteria for Reachability and Controllability We ﬁrst recall the deﬁnition of a set of linearly independent functions of time and consider in particular n complex-valued functions fi (t), i = 1, . . . , n, where fiT (t) ∈ C m . Recall that the set of functions fi , i = 1, . . . , n, is linearly dependent on a time interval [t1 , t2 ] over the ﬁeld of complex numbers C if there exist complex numbers ai , i = 1, . . . , n, not all zero, such that a1 f1 (t) + · · · + an fn (t) = 0 for all t in [t1 , t2 ]; otherwise, the set of functions is said to be linearly independent on [t1 , t2 ] over the ﬁeld of complex numbers. It is possible to test linear independence using the Gram matrix of the functions fi .

5.3 Reachability and Controllability

211

Lemma 5.22. Let F (t) ∈ C n×m be a matrix with fi (t) ∈ C 1×m in its ith row. Deﬁne the Gram matrix of fi (t), i = 1, . . . , n, by

t2 F (t)F ∗ (t)dt, (5.37) W (t1 , t2 ) t1

where (·)∗ denotes the complex conjugate transpose. The set fi (t), i = 1, . . . , n, is linearly independent on [t1 , t2 ] over the ﬁeld of complex numbers if and only if the Gram matrix W (t1 , t2 ) is nonsingular, or equivalently, if and only if the Gram determinant det W (t1 , t2 ) = 0. Proof. (Necessity) Assume the set fi , i = 1, . . . , n, is linearly independent but W (t1 , t2 ) is singular. Then there exists some nonzero α ∈ C 1×n so that t αW (t1 , t2 ) = 0, from which αW (t1 , t2 )α∗ = t12 (αF (t))(αF (t))∗ dt = 0. Since (αF (t))(αF (t))∗ ≥ 0 for all t, this implies that αF (t) = 0 for all t in [t1 , t2 ], which is a contradiction. Therefore, W (t1 , t2 ) is nonsingular. (Suﬃciency) Assume that W (t1 , t2 ) is nonsingular but the set fi , i = 1×n 1, . . . , n, is linearly dependent. Then there t2 exists∗ some nonzero α ∈ C so that αF (t) = 0. Then αW (t1 , t2 ) = t1 αF (t)F (t)dt = 0, which is a contradiction. Therefore, the set fi , i = 1, . . . , n, is linearly independent. We now introduce a number of additional tests for reachability and controllability of time-invariant systems. Some earlier results are also repeated here for convenience. Theorem 5.23. The system x˙ = Ax+ Bu is reachable (controllable-from-theorigin) (i) if and only if rank Wr (0, T ) = n where

T

Wr (0, T )

for some ﬁnite T > 0, T

e(T −τ )A BB T e(T −τ )A dτ,

(5.38)

0

the reachability Gramian; or (ii) if and only if the n rows of eAt B

(5.39)

are linearly independent on [0, ∞) over the ﬁeld of complex numbers; or alternatively, if and only if the n rows of (sI − A)−1 B are linearly independent over the ﬁeld of complex numbers; or (iii) if and only if rank C = n, where C [B, A, B, . . . , A

n−1

B], the controllability matrix; or

(5.40)

(5.41)

212

5 Controllability and Observability: Fundamental Results

(iv) if and only if rank[si I − A, B] = n

(5.42)

for all complex numbers si ; or alternatively, for si , i = 1, . . . , n, the eigenvalues of A. Proof. Parts (i) and (ii) were proved in Corollary 5.13. In part (ii), rank Wr (0, T ) = n implies and is implied by the linear independence of the n rows of e(T −t)A B on [0, T ] over the ﬁeld of complex numbers, in view of Lemma 5.22, or by the linear independence of the n rows of etˆA B, where tˆ T − t, on [0, T ]. Therefore, the system is reachable if and only if the n rows of eAt B are linearly independent on [0, ∞) over the ﬁeld of complex numbers. Note that the time interval can be taken to be [0, ∞) since in [0, T ], T can be taken to be any ﬁnite positive real number. To prove the second part of (ii), recall that L(eAt B) = (sI − A)−1 B and that the Laplace transform is a one-to-one linear operator. Part (iv) will be proved later in Section 6.3. Since reachability implies and is implied by controllability, the criteria developed in the theorem for reachability are typically used to test the controllability of a system as well.

01 0 Example 5.24. For the system x˙ = Ax+Bu, where A = and B = 00 1 (as in Example 5.11), we shall verify Theorem 5.23. The system is reachable since 1 3 1 2 T T (i) the reachability Gramian Wr (0, T ) = 31 2 2 has rank Wr (0, T ) = T T 2 2 = n forany T > 0, or since t At (ii) e B = has rows that are linearly independent on [0, ∞) over the 1 ﬁeld of complex numbers (since a1 × t + a2 × 1 = 0, where a1 and a2 are complex numbers implies that a1 = a2 = 0). Similarly, the rows of 2 1/s (sI − A)−1 B = are linearly independent over the ﬁeld of complex 1/s numbers. Also, since 01 (iii) rank C = rank[B, AB] = rank = 2 = n, or 1 0 s −1 0 (iv) rank[si I − A, B] = rank i = 2 = n for si = 0, i = 1, 2, the 0 si 1 eigenvalues of A. 1 0 If B = in place of , then 0 1

5.3 Reachability and Controllability

(i) Wr (0, T ) =

T 0 0 0

213

(see Example 5.11) with rank Wr (0, T ) = 1 < 2 = n,

1 1/s and (sI − A)−1 B = , neither of which has rows that 0 0 are linearly over the complex numbers. Also, independent 10 (iii) rank C = = 1 < 2 = n, and 00 s −1 1 (iv) rank[si I − A, B] = rank i = 1 < 2 = n for si = 0. 0 si 0 and

(ii) eAt B =

Based on any of the above tests, it is concluded that the system is not reachable.

5.3.2 Discrete-Time Systems The response of discrete-time systems was studied in Section 3.5. We consider systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

k ≥ k0 ,

(5.43)

where A ∈ Rn×n and B ∈ Rn×m . The state x(k) is given by x(k) = Φ(k, k0 )x(k0 ) +

k−1

Φ(k, i + 1)Bu(i),

(5.44)

i=k0

where the state transition matrix is Φ(k, k0 ) = Ak−k0 ,

k ≥ k0 .

(5.45)

Let the state at time k0 be x0 . For the state at some time k1 > k0 to assume the value x1 , an input u must exist that satisﬁes x(k1 ) = x1 in (5.44). For the time-invariant system the elapsed time k1 − k0 is of interest, and we therefore take k0 = 0 and k1 = K. Recalling that Φ(k, 0) = Ak , for the state x1 to be reached from x(0) = x0 in K steps, i.e., x(K) = x1 , an input u must exist that satisﬁes x1 = AK x0 +

K−1

AK−(i+1) Bu(i),

(5.46)

i=0

when K > 0, or x1 = AK x0 + CK UK ,

(5.47)

where CK [B, AB, . . . , AK−1 B]

(5.48)

214

5 Controllability and Observability: Fundamental Results

and UK [uT (K − 1), uT (K − 2), . . . , uT (0)]T .

(5.49)

The deﬁnitions of reachable state x1 , reachable subspace Rr , and a system being (completely state) reachable, or the pair (A,B) being reachable, are the same as in the continuous-time case (see Deﬁnition 5.8, and use integer K in place of real time T ). To determine the ﬁnite input sequence for discrete-time systems that will accomplish a desired state transfer, if such a sequence exists, one does not have to deﬁne matrices comparable with the reachability Gramian Wr , as in the case for continuous-time systems, but we can work directly with the controllability matrix Cn = C; see also the introductory discussion in Section 5.2.1. In particular, we have the following result. Theorem 5.25. Consider the system x(k + 1) = Ax(k) + Bu(k) given in (5.43), and let x(0) = 0. There exists an input u that transfers the state to x1 in ﬁnite time if and only if x1 ∈ R(C). In this case, x1 is reachable and Rr = R(C). An appropriate input sequence {u(k)}, k = 0, . . . , n − 1, that accomplishes this transfer in n steps is determined by Un [uT (n − 1), uT (n − 2), . . . , uT (0)]T , which is a solution to the equation (5.50) CUn = x1 . Henceforth, with an abuse of language, we will refer to Un as a control sequence, when in fact we actually have in mind {u(k)}. Proof. In view of (5.47), x1 can be reached from the origin in K steps if and only if x1 = CK UK has a solution UK , or if and only if x1 ∈ R(CK ). Furthermore, all input sequences that accomplish this are solutions to the equation x1 = CK UK . For x1 to be reachable we must have x1 ∈ R(CK ) for some ﬁnite K. This range, however, cannot increase beyond the range of Cn = C; i.e., R(CK ) = R(Cn ) for K ≥ n [see Exercise 5.1]. This follows from the Cayley–Hamilton Theorem, which implies that any vector x in R(CK ), K ≥ n, can be expressed as a linear combination of B, AB, . . . , An−1 B. Therefore, x ∈ R(Cn ). It is of course possible to have x1 ∈ R(CK ) with K < n, for a particular x1 ; however, in this case x1 ∈ R(Cn ), since CK is a subset of Cn . Thus, x1 is reachable if and only if it is in the range of Cn = C. Clearly, any Un that accomplishes the transfer satisﬁes (5.50). As pointed out in the above proof, for given x1 we may have x1 ∈ R(CK ) for some K < n. In this case the transfer can be accomplished in fewer than n steps, and appropriate inputs are obtained by solving the equation CK UK = x1 .

5.3 Reachability and Controllability

215

Corollary 5.26. The system x(k + 1) = Ax(k) + Bu(k) in (5.43) is (completely state) reachable, or the pair (A, B) is reachable, if and only if rank C = n.

(5.51)

Proof. Apply Theorem 5.25, noting that R(C) = Rr = Rn if and only if rank C = n. Theorem 5.27. There exists an input u that transfers the state of the system x(k + 1) = Ax(k) + Bu(k) in (5.43) from x0 to x1 in some ﬁnite number of steps K, if and only if x1 − AK x0 ∈ R(CK ). (5.52) Such an input sequence UK [uT (K − 1), uT (K − 2), . . . , uT (0)]T is determined by solving the equation CK UK = x1 − AK x0 . Proof. The proof follows directly from (5.47).

(5.53)

The above theorem leads to the following result that establishes the importance of reachability in determining u to transfer the state from any x0 to any x1 in a ﬁnite number of steps. Corollary 5.28. Let the system x(k + 1) = Ax(k) + Bu(k) given in (5.43) be (completely state) reachable or the pair (A, B) be reachable. Then there exists an input sequence that transfers the state from any x0 to any x1 in a ﬁnite number of steps. Such input is determined by solving Eq. (5.54). Proof. Consider (5.47). Since (A, B) is reachable, rank Cn = rank C = n and R(C) = Rn . Then CUn = x1 − An x0 (5.54) always has a solution Un = [uT (n − 1), . . . , uT (0)]T for any x0 and x1 . This input sequence transfers the state from x0 to x1 in n steps. Note that, in view of Theorem 5.27, for particular x0 and x1 , the state transfer may be accomplished in K < n steps, using (5.53). Example 5.29. Consider the system in Example 5.1, namely, x(k + 1) = Ax(k) + Bu(k), where A = [ 01 11 ] and B = [ 01 ]. Since rank C = rank[B, AB] = rank [ 01 11 ] = 2 = n, the system is reachable and any state x0 can be trans a a0 ferred to any other state x1 in two steps. Let x1 = , x0 = . b0 b 01 u(1) a 11 a0 u(1) Then (5.54) implies that = − or = 11 u(0) b 12 b0 u(0) b − 1 − b0 −1 1 a 01 a0 = . This agrees with the results − b0 a − a0 − b 0 10 b 11

216

5 Controllability and Observability: Fundamental Results

obtained in Example 5.1. In view of (5.53), if x1 and x0 are chosen so that a 01 a0 a − b0 x1 − Ax0 = − = is in the R(C1 ) = R(B) = b 1 1 b b − a0 − b 0 0 0 span , then the state transfer can be achieved in one step. For exam1 1 0 0 0 and x0 = , then Bu(0) = u(0) = x1 − Ax0 = ple, if x1 = 3 1 1 2 implies that the transfer from x0 to x1 can be accomplished in this case in 1 < 2 = n steps with u(0) = 2.

Example 5.30. Consider the system x(k +1) = Ax(k) + Bu(k) with A = 01 0 01 and B = . Since C = [B, AB] = has full rank, there exists 00 1 10 an input sequence that will transfer the state from any x(0) = x0 to any u(1) x(n) = x1 (in n steps), given by (5.54), U2 = = C −1 (x1 − A2 x0 ) = u(0) 01 (x1 − x0 ). Compare this with Example 5.16, where the continuous-time 10 system had the same system parameters A and B. Additional Criteria for Reachability. Note that completely analogous results to Theorem 5.23(ii)–(iv) exist for the discrete-time case. We now turn to the concept of controllability. The deﬁnitions of controllable state x0 , controllable subspace Rc , and a system being (completely state) controllable, or the pair (A,B) being controllable are similar to the corresponding concepts given in Deﬁnition 5.18 for the case of continuous-time systems. We shall now establish the relationship between reachability and controllability for the discrete-time time-invariant systems x(k + 1) = Ax(k) + Bu(k) in (5.43). Consider (5.46). The state x0 is controllable if it can be steered to the origin x1 = 0 in a ﬁnite number of steps K. That is, x0 is controllable if and only if −AK x0 = CK UK (5.55) for some ﬁnite positive integer K, or when AK x0 ∈ R(CK )

(5.56)

for some K. Recall that x1 is reachable when x1 ∈ R(C).

(5.57)

Theorem 5.31. Consider the system x(k + 1) = Ax(k) + Bu(k) in (5.43). (i) If state x is reachable, then it is controllable.

5.3 Reachability and Controllability

217

(ii) Rr ⊂ Rc . (iii) If the system is (completely state) reachable, or the pair (A, B) is reachable, then the system is also (completely state) controllable, or the pair (A, B) is controllable. Furthermore, if A is nonsingular, then relations (i) and (iii) become if and only if statements, since controllability also implies reachability, and relation (ii) becomes an equality; i.e., Rc = Rr . Proof. (i) If x is reachable, then x ∈ R(C). In view of Lemma 5.19, R(C) is an A-invariant subspace and so An x ∈ R(C), which in view of (5.56), implies that x is also controllable. Since x is an arbitrary vector in Rr , this implies (ii). If R(C) = Rn , the whole state space, then An x for any x is in R(C) and so any vector x is also controllable. Thus, reachability implies controllability. Now, if A is nonsingular, then A−n exists. If x is controllable, i.e., An x ∈ R(C), then x ∈ R(C), i.e., x is also reachable. This can be seen by noting that A−n can be written as a power series in terms of A, which in view of Lemma 5.19, implies that A−n (An x) = x is also in R(C). Matrix A being nonsingular is the necessary and suﬃcient condition for the state transition matrix Φ(k, k0 ) to be nonsingular, which in turn is the condition for time reversibility in discrete-time systems. Recall that reversibility in time may not be present in such systems since Φ(k, k0 ) may be singular. In contrast to this, in continuous-time systems, Φ(t, t0 ) is always nonsingular. This causes diﬀerences in behavior between continuous- and discrete-time systems and implies that in discrete-time systems controllability may not imply reachability (see Theorem 5.31). Note that, in view of Theorem 5.20, in the case of continuous-time systems, it is not only reachability that always implies controllability, but also vice versa, controllability always implies reachability. When A is nonsingular, the input that will transfer the state from x0 at k = 0 to x1 = 0 in n steps can be determined using (5.54). In particular, one needs to solve [A−n C]Un = [A−n B, . . . , A−1 B]Un = −x0

(5.58)

for Un = [uT (n − 1), . . . , uT (0)]T . Note that x0 is controllable if and only if −An x0 ∈ R(C), or if and only if x0 ∈ R(A−n C) for A nonsingular. Clearly, in the case of controllability (and under the assumption that A is nonsingular), the matrix A−n C is of interest, instead of C [see also (5.8)]. In particular, a system is controllable if and only if rank(A−n C) = rank C = n. Example 5.32.Consider the system x(k + 1) = Ax(k) +Bu(k), where A = 11 1 11 and B = . Since rank C = rank[B, AB] = rank = 1 < 2 = n, 01 0 00 this system is not (completely) reachable (controllable-from-the-origin). All

218

5 Controllability and Observability: Fundamental Results

1 1 , where α ∈ R since is a basis 0 0 for the R(C) = Rr , the reachability subspace. In view of (5.56) and the Cayley–Hamilton Theorem, all controllable states 1 x0 satisfy A2 x0 ∈ R(C); i.e., all controllable states are of the form α , 0 where α ∈ R. This veriﬁes Theorem 5.31 for the case when A is nonsingular. Note that presently Rr = Rc . reachable states are of the form α

Example 5.33.Consider the system x(k + 1) = Ax(k) +Bu(k), where A = 01 1 10 and B = . Since rank C = rank[B, AB] = rank = 1 < 2 = n, 00 0 00 the is not (completely) All reachable states are of the form system reachable. 1 1 α , where α ∈ R since is a basis for R(C) = Rr , the reachability 0 0 subspace. To determine the controllable subspace Rc , consider (5.56) for K = n, in −1 view of the Cayley–Hamilton Theorem. Note that A C cannot be used in the 00 0 2 present case, since A is singular. Since A x0 = x = ∈ R(C), any 00 0 0 state x0 will be a controllable state; i.e., the system is (completely) controllable and Rc = Rn . This veriﬁes Theorem 5.31 and illustrates that controllability does not in general imply reachability. Note that (5.54) can be used to determine the control sequence that will drive any state x0 to the origin (x1 = 0). In particular, 10 u(1) 0 = = −A2 x0 . CUn = 00 u(0) 0 Therefore, u(0) = α and u(1) = 0, where α ∈ R will drive any state to the 01 x01 origin. To verify this, we consider x(1) = Ax(0) + Bu(0) = + 00 x02 01 x02 + α 1 1 x02 + α and x(2) = Ax(1) + Bu(1) = + 0= α= 0 00 0 0 0 0 . 0

5.4 Observability and Constructibility In applications, the state of a system is frequently required but not accessible. Under such conditions, the question arises whether it is possible to determine the state by observing the response of the system to some input over some

5.4 Observability and Constructibility

219

period of time. It turns out that the answer to this question is aﬃrmative if the system is observable. Observability refers to the ability of determining the present state x(t0 ) from knowledge of current and future system outputs, y(t), and system inputs, u(t), t ≥ t0 . Constructibility refers to the ability of determining the present state x(t0 ) from knowledge of current and past system outputs, y(t), and system inputs, u(t), t ≤ t0 . Observability was brieﬂy addressed in Section 5.2. In this section this concept is formally deﬁned and the (present) state is explicitly determined from input and output measurements. 5.4.1 Continuous-Time Time-Invariant Systems We shall now study observability and constructibility for time-invariant systems described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(5.59)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , D ∈ Rp×m , and u(t) ∈ Rm is (piecewise) continuous. As was shown in Section 3.3, the output of this system is given by

t At CeA(t−τ ) Bu(τ )dτ + Du(t). (5.60) y(t) = Ce x(0) + 0

We recall that the initial time can always be taken to be t0 = 0. We will ﬁnd it convenient to rewrite (5.60) as y˜(t) = CeAt x0 , where y˜(t) y(t) −

t 0

(5.61)

CeA(t−τ ) Bu(τ )dτ + Du(t) and x0 = x(0).

Deﬁnition 5.34. A state x is unobservable if the zero-input response of the system (5.59) is zero for every t ≥ 0, i.e., if CeAt x = 0

for every t ≥ 0.

(5.62)

The set of all unobservable states x, Ro¯, is called the unobservable subspace of (5.59). System (5.59) is (completely state) observable, or the pair (A, C) is observable, if the only state x ∈ Rn that is unobservable is x = 0, i.e., if Ro¯ = {0}. Deﬁnition 5.34 states that a state is unobservable precisely when it cannot be distinguished as an initial condition at time 0 from the initial condition x(0) = 0. This is because in this case the output is the same as if the initial condition were the zero vector. Note that the set of all unobservable states contains the zero vector and it can be shown to be a linear subspace. We now deﬁne the observability Gramian.

220

5 Controllability and Observability: Fundamental Results

Deﬁnition 5.35. The observability Gramian of system (5.59) is the n × n matrix

T T Wo (0, T ) eA τ C T CeAτ dτ. (5.63) 0

We note that Wo is symmetric and positive semideﬁnite for every T > 0; i.e., Wo = WoT and Wo ≥ 0 (show this). Recall that the pn × n observability matrix ⎡ ⎤ C ⎢ CA ⎥ ⎢ ⎥ (5.64) O⎢ ⎥ .. ⎣ ⎦ . CAn−1 was deﬁned in Section 5.2. We now show that the null space of Wo (0, T ), denoted by N (Wo (0, T )), is independent of T ; i.e., it is the same for any T > 0, and in particular, it is equal to the null space of the observability matrix O. Thus, the unobservable subspace Ro¯ of the system is given by the null space of O, N (O), or the null space of Wo (0, T ), N (Wo (0, T )) for some ﬁnite (and therefore for all) T > 0. Lemma 5.36. N (O) = N (Wo (0, T )) for every T > 0. Proof. If x ∈ N (O), then Ox = 0. Thus, CAk x = 0 for all 0 ≤ k ≤ n−1, which is also true for every k > n − 1, in view of the Cayley–Hamilton Theorem. ∞ (tk /k!)Ai ]x = 0 for every ﬁnite t. Therefore, in view Then CeAt x = C[Σk=0 of (5.63), Wo (0, T )x = 0 for every T > 0; i.e., x ∈ N (Wo (0, T )) for every T > 0. Now let x ∈ N (Wo (0, T )) for some T > 0, so that xT W (0, T )x = T CeAτ x 2 dτ = 0, or CeAt x = 0 for every t ∈ [0, T ]. Taking derivatives 0 of the last equation with respect to t and evaluating at t = 0, we obtain Cx = CAx = · · · = CAk x = 0 for every k > 0. Therefore, CAk x = 0 for every k ≥ 0, i.e., Ox = 0 or x ∈ N (O). Theorem 5.37. A state x is unobservable if and only if x ∈ N (O),

(5.65)

x ∈ N (Wo (0, T ))

(5.66)

or equivalently, if and only if

for some ﬁnite (and therefore for all) T > 0. Thus, the unobservable subspace R¯0 = N (O) = N (Wo (0, T )) for some T > 0. Proof. If x is unobservable, (5.62) is satisﬁed. Taking derivatives with respect to t and evaluating at t = 0, we obtain Cx = CAx = · · · = CAk x = 0 for k > 0 or CAk x = 0 for every k ≥ 0. Therefore, Ox = 0 and (5.65) is satisﬁed.

5.4 Observability and Constructibility

221

Assume now that Ox = 0; i.e., CAk x = 0 for 0 ≤ k ≤ n − 1, which is also true for every k > n − 1, in view of the Cayley–Hamilton Theorem. Then ∞ (tk /k!)Ai ]x = 0 for every ﬁnite t; i.e., (5.62) is satisﬁed and CeAt x = C[Σk=0 x is unobservable. Therefore, x is unobservable if and only if (5.65) is satisﬁed. In view of Lemma 5.36, (5.66) follows. Clearly, x is observable if and only if Ox = 0 or Wo (0, T )x = 0 for some T > 0. Corollary 5.38. The system (5.59) is (completely state) observable, or the pair (A, C) is observable, if and only if rank O = n,

(5.67)

rank Wo (0, T ) = n

(5.68)

or equivalently, if and only if

for some ﬁnite (and therefore for all) T > 0. If the system is observable, the state x0 at t = 0 is given by

T

x0 = Wo−1 (0, T )

eA

T

τ

C T y˜(τ )dτ .

(5.69)

0

Proof. The system is observable if and only if the only vector that satisﬁes (5.62) or (5.65) is the zero vector. This is true if and only if the null space is empty, i.e., if and only if (5.67) or (5.68) are true. To determine the state x0 at t = 0, given the output and input values over some interval [0, T ], we T premultiply (5.61) by eA τ C T and integrate over [0, T ] to obtain

T

eA

Wo (0, T )x0 =

T

τ

C T y˜(τ )dτ,

(5.70)

0

in view of (5.63). When the system is observable, (5.70) has the unique solution (5.69). Note that T > 0, the time span over which the input and output are observed, is arbitrary. Intuitively, one would expect in practice to have diﬃculties in evaluating x0 accurately when T is small, using any numerical method. Note that for very small T, ||Wo (0, T )|| can be very small, which can lead to numerical diﬃculties in solving (5.70). Compare this with the analogous case for reachability, where small T leads in general to large values in control action. It is clear that if the state at some time t0 is determined, then the state x(t) at any subsequent time is easily determined, given u(t), t ≥ t0 . Alternative methods to (5.69) to determine the state of the system when the system is observable are provided in Section 9.3 on state observers.

222

5 Controllability and Observability: Fundamental Results

01 Example 5.39. (i) Consider the system x˙ = Ax, y = Cx, where A = 00 1t At At and C = [1, 0]. Here e = and Ce = [1, t]. The observ01 T 1 T 1 τ [1 τ ]dτ = 0 dτ = ability Gramian is then Wo (0, T ) = 0 τ τ τ2 1 2 T 2T 1 4 1 2 1 3 . Notice that det Wo (0, T ) = 12 T = 0 for any T > 0, i.e., 2T 3T rank Wo (0, T ) = 2 = n for any T > 0, and therefore (Corollary 5.38), the systemis observable. Alternatively, note that the observability maC 10 trix O = = and rank O = 2 = n. Clearly, in this case CA 0 1 0 N (O) = N (Wo (0, T )) = , which veriﬁes Lemma 5.36. 0 01 (ii) If A = , as before, but C = [0, 1], in place of [1, 0], then CeAt = 00 T 0 [0, 1]dτ = [0, 1] and the observability Gramian is Wo (0, T ) = 0 1 0 0 . We have rank Wo (0, T ) = 1 < 2 = n, and the system is not 0T completely observable. In view of Theorem 5.37, all unobservable states α x ∈ N (Wo (0, T )) and are therefore of the form , α ∈ R. Alter0 C 01 natively, the observability matrix O = = . Note that CA 00 1 . N (O) = N (W0 (0, T )) = span 0 Observability utilizes future output measurements to determine the present state. In (re)constructibility, past output measurements are used. Constructibility is deﬁned in the following, and its relation to observability is determined. Deﬁnition 5.40. A state x is unconstructible if the zero-input response of the system (5.59) is zero for all t ≤ 0; i.e., CeAt x = 0

for every t ≤ 0.

(5.71)

The set of all unconstructible states x, Rcn , is called the unconstructible subspace of (5.59). The system (5.59) is (completely state) (re)constructible, or the pair (A, C) is (re)constructible, if the only state x ∈ Rn that is unconstructible is x = 0; i.e., Rcn = {0}. We shall now establish a relationship between observability and constructibility for the continuous-time time-invariant systems (5.59). Recall that x is unobservable if and only if

5.4 Observability and Constructibility

CeAt x = 0

for every t ≥ 0.

223

(5.72)

Theorem 5.41. Consider the system x˙ = Ax + Bu, y = Cx + Du given in (5.59). (i) A state x is unobservable if and only if it is unconstructible. (ii) Ro¯ = Rcn . (iii) The system, or the pair (A, C), is (completely state) observable if and only if it is (completely state) (re)constructible. Proof. (i) If x is unobservable, then CeAt x = 0 for every t ≥ 0. Taking derivatives with respect to t and evaluating at t = 0, we obtain Cx = CAx = k x = 0 for k > 0 or CAk x = 0 for every k ≥ 0. This, in view of · · · = CA ∞ At Ce x = k=0 (tk /k!)CAk x, implies that CeAt x = 0 for every t ≤ 0; i.e., x is unconstructible. The converse is proved in a similar manner. Parts (ii) and (iii) of the theorem follow directly from (i). The observability Gramian for the time-invariant case, Wo (0, T ), was deﬁned in (5.63). The constructibility Gramian is now deﬁned. Deﬁnition 5.42. The constructibility Gramian of system (5.59) is the n × n matrix

T T Wcn (0, T ) eA (τ −T ) C T CeA(τ −T ) dτ. (5.73) 0

Note that Wo (0, T ) = eA

T

T

Wcn (0, T )eAT ,

(5.74)

as can be veriﬁed directly. Additional Criteria for Observability and Constructibility We shall now use Lemma 5.22 to develop additional tests for observability and constructibility. These are analogous to the corresponding results established for reachability and controllability in Theorem 5.23. Theorem 5.43. The system x˙ = Ax + Bu, y = Cx + Du is observable (i) if and only if rank Wo (0, T ) = n (5.75) T AT τ T Aτ C Ce dτ , the observfor some ﬁnite T > 0, where W0 (0, T ) 0 e ability Gramian, or

224

5 Controllability and Observability: Fundamental Results

(ii) if and only if the n columns of CeAt

(5.76)

are linearly independent on [0, ∞) over the ﬁeld of complex numbers, or alternatively, if and only if the n columns of C(sI − A)−1

(5.77)

are linearly independent over the ﬁeld of complex numbers, or (iii) if and only if rank O = n, ⎡ ⎤ C ⎢ CA ⎥ ⎢ ⎥ where O ⎢ ⎥, the observability matrix, or .. ⎣ ⎦ .

(5.78)

CAn−1 (iv) if and only if

si I − A =n rank C

(5.79)

for all complex numbers si , or alternatively, for all eigenvalues of A. Proof. The proof of this theorem is completely analogous to the (dual) results on reachability (Theorem 5.23) and is omitted. Since it was shown (in Theorem 5.41) that observability implies and is implied by constructibility, the tests developed in the theorem for observability are typically also used to test for constructibility.

01 and 00 C = [1, 0], as in Example 5.39(i). We shall verify (i) to (iv) of Theorem 5.43 for this case. T 12 T 2 (i) For the observability Gramian, Wo (0, T ) = 1 2 1 3 , we have 2T 3T rank Wo (0, T ) = 2 = n for any T > 0. (ii) The columns of CeAt = [1, t] are linearly independent on [0, ∞) over the ﬁeld of complex numbers, since a1 × 1 + a2 × t = 0 implies that the complex numbers a2 must both be zero. Similarly, the columns of a1 and C(sI − A)−1 = 1s , s12 are linearly independent over the ﬁeld of complex numbers. C 10 (iii) rank O = rank = rank = 2 = n. CA 01 ⎡ ⎤ si −1 s I −A (iv) rank i = rank ⎣ 0 si ⎦ = 2 = n for si = 0, i = 1, 2, the C 1 0 eigenvalues of A. Example 5.44. Consider the system x˙ = Ax, y = Cx, where A =

5.4 Observability and Constructibility

Consider again A =

01 00

225

but C = [0, 1] [in place of [1, 0], as in Exam-

ple 5.39(ii)]. The system is not observable for the reasons given below. 0 0 (i) Wo (0, T ) = with rank Wo (0, T ) = 1 < 2 = n. 0T At (ii) Ce = [0, 1] and its columns are not linearly independent. Similarly, the −1 = [0, 1s ] are columns of C(sI − A) not linearly independent. C 01 (iii) rank O = rank = rank = 1 < 2 = n. CA 0⎤0 ⎡ si −1 si I − A = rank ⎣ 0 si ⎦ = 1 < 2 = n for si = 0 an eigenvalue of (iv) rank C 0 1 A.

5.4.2 Discrete-Time Time-Invariant Systems We consider systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k),

k ≥ k0 ,

(5.80)

where A ∈ Rn×n , C ∈ Rn×m , C ∈ Rp×n , D ∈ Rp×m . The output y(k) for k > k0 is given by y(k) = C(k)Φ(k, k0 )x(k0 ) +

k−1

C(k)Φ(k, i + 1)B(i)u(i) + D(k)u(k), (5.81)

i=k0

where the state transition matrix Φ(k, k0 ) is given by Φ(k, k0 ) = Ak−k0 ,

k ≥ k0 .

(5.82)

Observability and (re)constructibility for discrete-time systems are deﬁned as in the continuous-time case. Observability refers to the ability to uniquely determine the state from knowledge of current and future outputs and inputs, whereas constructibility refers to the ability to determine the state from knowledge of current and past outputs and inputs. Without loss of generality, we take k0 = 0. Then y(k) = CAk x(0) +

k−1

CAk−(i+1) Bu(i) + Du(k)

(5.83)

i=0

for k > 0 and y(0) = Cx(0) + Du(0). Rewrite as (5.84) y˜(k) = CAk x0 k−1 k−(i+1) for k ≥ 0, where y˜(k) y(k) − Bu(i) + Du(k) for k > 0 i=0 CA and y˜(0) y(0), and x0 = x(0).

226

5 Controllability and Observability: Fundamental Results

Deﬁnition 5.45. A state x is unobservable if the zero-input response of system (5.80) is zero for all k ≥ 0, i.e., if CAk x = 0

for every k ≥ 0.

(5.85)

The set of all unobservable states x, Ro¯, is called the unobservable subspace of (5.80). The system (5.80) is (completely state) observable, or the pair (A, C) is observable, if the only state x ∈ Rn that is unobservable is x = 0, i.e., if Ro¯ = {0}. The pn × n observability matrix O was deﬁned in (5.64). Let N (O) denote the null space of O. Theorem 5.46. A state x is unobservable if and only if x ∈ N (O);

(5.86)

i.e., the unobservable subspace Ro¯ = N (O). Proof. If x ∈ N (O), then Ox = 0 or CAk x = 0 for 0 ≤ k ≤ n − 1. This statement is also true for k > n − 1, in view of the Cayley–Hamilton Theorem. Therefore, (5.85) is satisﬁed and x is unobservable. Conversely, if x is unobservable, then (5.85) is satisﬁed and Ox = 0. Clearly, x is observable if and only if Ox = 0. Corollary 5.47. The system (5.80) is (completely state) observable, or the pair (A, C) is observable, if and only if rank O = n.

(5.87)

If the system is observable, the state x0 at k = 0 can be determined as the unique solution of [Y0,n−1 − Mn U0,n−1 ] = Ox0 , (5.88) where Y0,n−1 [y T (0), y T (1), . . . , y T (n − 1)]T is a pn × 1 matrix, U0,n−1 [uT (0), uT (1), . . . , uT (n − 1)]T is an mn × 1 matrix, and Mn is the pn × mn matrix given by ⎡ D 0 ⎢ CB D ⎢ ⎢ .. .. Mn ⎢ . . ⎢ ⎣ CAn−2 B CAn−3 B CAn−1 B CAn−2 B

··· 0 ··· 0 . . .. . . ··· D · · · CB

0 0 .. . D

⎤ ⎥ ⎥ ⎥ ⎥. ⎥ ⎦

5.4 Observability and Constructibility

227

Proof. The system is observable if and only if the only vector that satisﬁes (5.85) is the zero vector. This is true if and only if N (O) = {0}, or if (5.87) is true. To determine the state x0 , apply (5.83) for k = 0, 1, . . . , n − 1, and rearrange in a form of a system of linear equations to obtain (5.88). The matrix Mn deﬁned above has the special structure of a Toeplitz matrix. Note that a matrix T is Toeplitz if its (i, j)th entry depends on the value i − j; that is, T is “constant along the diagonals.” Additional Criteria for Observability. Note that completely analogous results to Theorem 5.43(ii)–(iv) exist for the discrete-time case. Constructibility refers to the ability to determine uniquely the state x(0) from knowledge of current and past outputs and inputs. This is in contrast to observability, which utilizes future outputs and inputs. The easiest way to deﬁne constructibility is by the use of (5.84), where x(0) = x0 is to be determined from past data y˜(k), k ≤ 0. Note, however, that for k ≤ 0, Ak may not exist; in fact, it exists only when A is nonsingular. To avoid making restrictive assumptions, we shall deﬁne unconstructible states in a slightly diﬀerent way than anticipated. Unfortunately, this deﬁnition is not very transparent. It turns out that by using this deﬁnition, an unconstructible state can be related to an unobservable state in a manner analogous to the way a controllable state was related to a reachable state in Section 5.3 (see also the discussion of duality in Section 5.2). Deﬁnition 5.48. A state x is unconstructible if for every k ≥ 0, there exists x ˆ ∈ Rn such that ˆ, C x ˆ = 0. (5.89) x = Ak x The set of all unconstructible states, Rcn , is called the unconstructible subspace. The system (5.80) is (completely state) constructible, or the pair (A, C) is constructible, if the only state x ∈ Rn that is unconstructible is x = 0, i.e., if Rcn = {0}. Note that if A is nonsingular, then (5.89) simply states that x is unconstructible if CA−k x = 0 for every k ≥ 0 (compare this with Deﬁnition 5.45 of an unobservable state). The results that can be derived for constructibility are simply dual to the results on controllability. They are presented brieﬂy below, but ﬁrst, a technical result must be established. Lemma 5.49. If x ∈ N (O), then Ax ∈ N (O); i.e., the unobservable subspace Ro¯ = N (O) is an A-invariant subspace. Proof. Let x ∈ N (O), so that Ox = 0. Then CAk x = 0 for 0 ≤ k ≤ n − 1. This statement is also true for k > n − 1, in view of the Cayley–Hamilton Theorem. Therefore, OAx = 0; i.e., Ax ∈ N (O). Theorem 5.50. Consider the system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k) given in (5.80).

228

5 Controllability and Observability: Fundamental Results

(i) If a state x is unconstructible, then it is unobservable. (ii) Rcn ⊂ Ro¯. (iii) If the system is (completely state) observable, or the pair (A, C) is observable, then the system is also (completely state) constructible, or the pair (A, C) is constructible. If A is nonsingular, then relations (i) and (iii) are if and only if statements. In this case, constructibility also implies observability. Furthermore, in this case, (ii) becomes an equality; i.e., Rcn = Ro¯. Proof. This theorem is dual to Theorem 5.31, which relates reachability and controllability in the discrete-time case. To verify (i), assume that x satisﬁes (5.89) and premultiply by C to obtain Cx = CAk xˆ for every k ≥ 0. Note ˆ = 0 for that Cx = 0 since for k = 0, x = x ˆ, and C x ˆ = 0. Therefore, CAk x every k ≥ 0; i.e., x ˆ ∈ N (O). In view of Lemma 5.49, x = Ak x ˆ ∈ N (O), and thus, x is unobservable. Since x is arbitrary, we have also veriﬁed (ii). When the system is observable, Ro¯ is empty, which in view of (ii), implies that Rcn ¯ = {0} or that the system is constructible. This proves (iii). Alternatively, one could also prove this directly: Assume that the system is observable but not constructible. Then there exist x, xˆ = 0, which satisfy (5.89). As above, this implies that xˆ ∈ N (O), which is a contradiction since the system is observable. Consider now the case when A is nonsingular and let x be unobservable. ˆ = 0. Then, in view of Lemma 5.49, x ˆ A−k x is also in N (O); i.e., C x k Therefore, x = A x ˆ is unconstructible, in view of Deﬁnition 5.48. This implies also that Ro¯ ⊂ Rcn , and therefore, Ro¯ = Rcn , which proves that in the present case constructibility also implies observability.

Example 5.51. Consider the system in Example 5.5, x(k+1) = Ax(k), y(k) = 10 10 Cx(k), where A = and C = [1, 0]. As shown, rank O = rank = 11 10 1 < 2 = n; i.e., the system is not observable. All unobservable states are of 0 0 the form α , where α ∈ R since is a basis for N (O) = Ro¯, the 1 1 unobservable subspace. −k In Example 5.6 it was shown that all the states x that satisfyCA x=0 0 for every k ≥ 0, i.e., all the unconstructible states, are given by α , α ∈ R. 1 This veriﬁes Theorem 5.50(i) and (ii) for the case when A is nonsingular.

Example 5.52. Consider the system x(k + 1) = Ax(k), y(k) = Cx(k), where 00 10 A= and C = [1, 0]. The observability matrix O = is of rank 1, 10 00

5.4 Observability and Constructibility

229

and the system is not observable. In fact, all states of the form therefore, 0 0 α are unobservable states since is a basis for N (O). 1 1 To check constructibility, the deﬁning relations (5.89) must be used since 0 ˆ, A is singular. C x ˆ = [1, 0]ˆ x = 0 implies x ˆ= . Substituting into x = Ak x β we obtain for k = 0, x = xˆ, and x = 0 for k ≥ 1. Therefore, the only unconstructible state is x = 0, which implies that the system is constructible (although it is unobservable). This means that the initial state x(0) can be uniquely determined from past measurements. In fact, from x(k + 1) = Ax(k) x1 (0) 00 x1 (−1) and y(k) = Cx(k), we obtain x(0) = = = x2 (−1) 10 x2 (0) 0 x (−1) and y(−1) = Cx(−1) = [1, 0] 1 = x1 (−1). Therefore, x1 (−1) x2 (−1) 0 x(0) = . y(−1) When A is nonsingular, the state x0 at k = 0 can be determined from past outputs and inputs in the following manner. We consider (5.84) and note that in this case y˜(k) = CAk x0 is valid for k ≤ 0 as well. This implies that Y(−1,−n

⎤ CA−n ⎥ ⎢ = OA−n x0 = ⎣ ... ⎦ x0 ⎡

(5.90)

−1

CA

with Y(−1,−n [˜ y T (−n), . . . , y˜T (−1)]T . Equation (5.90) must be solved for x0 . Clearly, in the case of constructibility (and under the assumption that A is nonsingular), the matrix OA−n is of interest instead of O [compare this with the dual results in (5.58)]. In particular, the system is constructible if and only if rank(OA−n ) = rank O = n. Example 5.53. Consider the system in Example 5.4, namely, x(k + 1) = Ax(k), y(k) = Cx(k), where A = [ 01 11 ] and C = [0, 1]. Since A is nonsingu −2 −2 CA lar, to check constructibility we consider OA = CA−1 = −11 10 , which has full rank. Therefore, the system is constructible (as expected), since it is y(−1) observable. To determine x(0), in view of (5.90), we note that = y(−2) −1 1 x1 (0) x1 (0) 01 y(−1) , from which = = OA−2 x(0) = 10 11 y(−2) x2 (0) x2 (0) y(−2) . y(−1) + y(−2)

230

5 Controllability and Observability: Fundamental Results

5.5 Summary and Highlights Reachability and Controllability •

•

In continuous-time systems, reachability always implies and is implied by controllability. In discrete-time systems, reachability always implies controllability, but controllability implies reachability only when A is nonsingular. See Deﬁnitions 5.8 and 5.18 and Theorems 5.20 and 5.31. When a discrete-time system x(k+1) = Ax(k)+Bu(k) [denoted by (A, B)] is completely reachable (controllable-from-the-origin), the input sequence {u(i)}, i = 0, . . . , K − 1 that transfers the state from any x0 (= x(0)) to any x1 in some ﬁnite time K (x1 = x(K), K > 0) is determined by solving x1 = AK x0 +

K−1

AK−(i+1) Bu(i) or

i=0

x1 − AK x0 = [B, AB, . . . , AK−1 ] [uT (K − 1), . . . , uT (0)]T . A solution for this always exists when K = n. See Theorem 5.27. •

•

C = [B, AB, . . . , An−1 B] (n × mn)

(5.25)

is the controllability matrix for both discrete- and continuous-time timeinvariant systems, and it has full (row) rank when the system, denoted by (A, B), is (completely) reachable (controllable-from-the-origin). When a continuous-time system x˙ = Ax + Bu [denoted by (A, B)] is controllable, an input that transfers any state x0 (= x(0)) to any other state x1 in some ﬁnite time T (x1 = x(T ) is u(t) = B T eA

T

(T −t)

Wr−1 (0, T )[x1 − eAT x0 ] t ∈ [0, T ],

where

Wr (0, T ) =

T

T

e(T −τ )A BB T e(T −τ )A dτ

(5.33)

(5.24)

0

•

is the reachability Gramian of the system. (A, B) is reachable if and only if rank[si I − A, B] = n

(5.42)

for si , i = 1, . . . , n, all the eigenvalues of A. Observability and Constructibility •

In continuous-time systems, observability always implies and is implied by constructibility. In discrete-time systems, observability always implies constructibility, but constructibility implies observability only when A is nonsingular. See Deﬁnitions 5.34 and 5.40 and Theorems 5.41 and 5.50.

5.5 Summary and Highlights

•

231

When a discrete-time system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k) [denoted by (A, C)] is completely observable, any initial state x(0) = x0 can be uniquely determined by observing the input and output over some ﬁnite period of time, and using the relation (5.84) y˜(k) = CAk x0 k = 0, 1, . . . , n − 1, k−1 k−(i+1) Bu(i) + D(k)u(k) . To determine where y˜(k) = y(k) − i=0 CA x0 , solve ⎤ ⎡ ⎤ ⎡ C y˜(0) ⎢ y˜(1) ⎥ ⎢ CA ⎥ ⎥ ⎢ ⎥ ⎢ ⎥ x0 . ⎢ ⎥=⎢ .. .. ⎦ ⎣ ⎦ ⎣ . . CAn−1 y˜(n − 1) See (5.88). ⎡ ⎢ ⎢ O=⎢ ⎣

•

⎤

C CA .. .

⎥ ⎥ ⎥ ⎦

(pn × n)

(5.64)

CAn−1

•

is the observability matrix for both discrete- and continuous-time, timeinvariant systems and it has full (column) rank when the system is completely observable. Consider the continuous-time system x˙ = Ax + Bu, y = Cx + Du. When this system [denoted by (A, C)] is completely observable, any initial state x0 = x(0) can be uniquely determined by observing the input and output over some ﬁnite period of time T and using the relation y˜(t) = CeAt x0 ,

t where y˜(t) = y(t) − 0 CeA(t−τ ) Bu(τ )dτ + Du(t) . The initial state x0 may be determined from

T T x0 = Wo−1 (0, T ) eA τ C T y˜(τ )dτ , (5.69) 0

where

T

eA

Wo (0, T ) =

T

τ

C T CeAτ dτ

(5.63)

0

•

is the observability Gramian of the system. (A, C) is observable if and only if si I − A rank =n C for si , i = 1, . . . , n, all the eigenvalues of A.

(5.79)

232

5 Controllability and Observability: Fundamental Results

Dual Systems •

(AD = AT , BD = C T , CD = B T , DD = DT ) is the dual of (A, B, C, D). Reachability is dual to observability. If a system is reachable (observable), its dual is observable (reachable).

5.6 Notes The concept of controllability was ﬁrst encountered as a technical condition in certain optimal control problems and also in the so-called ﬁnite-settling-time design problem for discrete-time systems (see Kalman [4]). In the latter, an input must be determined that returns the state x0 to the origin as quickly as possible. Manipulating the input to assign particular values to the initial state in (analog-computer) simulations was not an issue since the individual capacitors could initially be charged independently. Also, observability was not an issue in simulations due to the particular system structures that were used (corresponding, e.g., to observer forms). The current deﬁnitions for controllability and observability and the recognition of the duality between them were worked out by Kalman in 1959–1960 (see Kalman [7] for historical comments) and were presented by Kalman in [5]. The signiﬁcance of realizations that were both controllable and observable (see Chapter 5) was established later in Gilbert [2], Kalman [6], and Popov [8]. For further information regarding these historical issues, consult Kailath [3] and the original sources. Note that [3] has extensive references up to the late seventies with emphasis on the time-invariant case and a rather complete set of original references together with historical remarks for the period when the foundations of the state-space system theory were set, in the late ﬁfties and sixties.

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. E. Gilbert, “Controllability and observability in multivariable control systems,” SIAM J. Control, Vol. 1, pp. 128–151, 1963. 3. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 4. R.E. Kalman, “Optimal nonlinear control of saturating systems by intermittent control,” IRE WESCON Rec., Sec. IV, pp. 130–135, 1957. 5. R.E. Kalman, “On the general theory of control systems,” in Proc. of the First Intern. Congress on Automatic Control, pp. 481–493, Butterworth, London, 1960. 6. R.E. Kalman, “Mathematical descriptions of linear systems,” SIAM J. Control, Vol. 1, pp. 152–192, 1963. 7. R.E. Kalman, Lectures on Controllability and Observability, C.I.M.E., Bologna, 1968. 8. V.M. Popov, “On a new problem of stability for control systems,” Autom. Remote Control, Vol. 24, No. 1, pp. 1–23, 1963.

Exercises

233

Exercises 5.1. (a) Let Ck [B, AB, . . . , Ak−1 B], where A ∈ Rn×n , B ∈ Rn×m . Show that R (Ck ) = R (Cn ) for k ≥ n,

and R(Ck ) ⊂ R(Cn ) for k < n.

(b) Let Ok [C T , (CA)T , . . . , (CAk−1 )T ]T , where A ∈ Rn×n , C ∈ Rp×n . Show that N (Ok ) = N (On ) for k ≥ n, and N (Ok ) ⊃ N (On ) for k < n. 5.2. Consider the state equation x˙ = Ax + Bu, where ⎡ ⎤ ⎡ ⎤ 0 1 0 0 00 ⎢ 3w2 0 0 2w ⎥ ⎢ ⎥ ⎥, B = ⎢1 0⎥, A=⎢ ⎣ 0 ⎣0 0⎦ 0 0 1 ⎦ 0 −2w 0 0 01 which was obtained by linearizing the nonlinear equations of motion of an orbiting satellite about a steady-state solution. In the state x = [x1 , x2 , x3 , x4 ]T , x1 is the diﬀerential radius, whereas x3 is the diﬀerential angle. In the input vector u = [u1 , u2 ]T , u1 is the radial thrust and u2 is the tangential thrust. y1 x1 (a) Is this system controllable from u? If y = = , is the system y2 x3 observable from y? (b) Can the system be controlled if the radial thruster fails? What if the tangential thruster fails? (c) Is the system observable from y1 only? From y2 only? x˙ 1 −1/2 0 x1 1/2 5.3. Consider the state equation = + u. x˙ 2 x2 0 −1 1 a 0 (a) If x(0) = , derive an input that will drive the state to in T sec. b 0 5 (b) For x(0) = , plot u(t), x1 (t), x2 (t) for T = 1, 2, and 5 sec. Comment −5 on the magnitude of the input in your results. ⎡ ⎤ ⎡ ⎤ 110 0 5.4. Consider the state equation x(k + 1) = ⎣ 0 1 0 ⎦ x(k) + ⎣ 1 ⎦ u(k), y(k) = 001 1 110 x(k). 010

234

5 Controllability and Observability: Fundamental Results

⎡ ⎤ 3 (a) Is x1 = ⎣ 2 ⎦ reachable? If yes, what is the minimum number of steps 2 required to transfer the state from the zero state to x1 ? What inputs do you need? (b) Determine all states that are reachable. (c) Determine all states that are unobservable. (d) If x˙ = Ax + Bu is given with A, B as in (a), what is the minimum time required to transfer the state from the zero state to x1 ? What is an appropriate u(t)? 5.5. Output reachability (controllability) can be deﬁned in a manner analogous to state reachability (controllability). In particular, a system will be called output reachable if there exists an input that transfers the output from some y0 to any y1 in ﬁnite time. Consider now a discrete-time time-invariant system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k) with A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n and D ∈ Rp×m . Recall that y(k) = CAk x(0) +

k−1

CAk−(i+1) Bu(i) + Du(k).

i=0

(a) Show that the system {A, B, C, D} is output reachable if and only if rank[D, CB, CAB, . . . , CAn−1 B] = p. Note that this rank condition is also the condition for output reachability for continuous-time time-invariant systems x˙ = Ax + Bu, y = Cx + Du. It should be noted that, in general, state reachability is neither necessary nor suﬃcient for output reachability. Notice for example that if rank D = p, then the system is output reachable. (b) Let D = 0. Show that if (A, B) is (state) reachable, then {A, B, C, D} is output reachable if ⎤ and only ⎡ ⎡ if ⎤rank C = p. 1 0 0 1 (c) Let A = ⎣ 0 −2 0 ⎦, B = ⎣ 0 ⎦, C = [1, 1, 0], and D = 0. 0 0 −1 1 (i) Is the system output reachable? Is it state reachable? (ii) Let x(0) = 0. Determine an appropriate input sequence to transfer the output to y1 = 3 in minimum time. Repeat for x(0) = [1, −1, 2]T . 5.6. (a) Given x˙ = Ax + Bu, y = Cx + Du, show that this system is output reachable if and only if the rows of the p × m transfer matrix H(s) are linearly independent over the ﬁeld of complex numbers. In view of this result, is the system H(s) =

1 s+2 s s+1

output reachable?

Exercises

235

(b) Similarly, for discrete-time systems, the system is output reachable if and only if the rows of the transfer function matrix H(z) are linearly independent over the ﬁeld of complex numbers. Consider now the system of Exercise 5.5 and determine whether it is output reachable. 5.7. Show that the circuit depicted in Figure 5.4 with input u and output y is neither state reachable nor observable but is output reachable.

+

1

1

1 y

u –

1

1

Figure 5.4. Circuit for Exercise 5.7

5.8. A system x˙ = Ax+Bu, y = Cx+Du is called output function controllable if there exists an input u(t), t ∈ [0, ∞), that will cause the output y(t) to follow a prescribed trajectory for 0 ≤ t < ∞, assuming that the system is at rest at t = 0. It is easiest to derive a test for output function controllability in terms of the p × m transfer function matrix H(s), and this is the approach taken in the following. We say that the m × p rational matrix HR (s) is a right inverse of H(s) if H(s)HR (s) = Ip . (a) Show that the right inverse HR (s) exists if and only if rank H(s) = p. Hint: In the suﬃciency proof, select HR = H T (HH T )−1 , the (right) pseudoinverse of H. (b) Show that the system is output function controllable if and only if H(s) ˆ. In the necessity proof, has a right inverse HR (s). Hint: Consider yˆ = H u show that if rank H < p, then the system may not be output function controllable. Input function observability is the dual to output function controllablity. Here, the left inverse of H(s), HL (s), is of interest and is deﬁned by HL (s)H(s) = Im . (c) Show that the left inverse HL (s) of H(s) exists if and only if rank H(s) = m. Hint: This dual result to part (a). is the 1 , (d) Let H(s) = s+1 s s and characterize all inputs u(t) that will cause the system (at rest at t = 0) to exactly follow a step, yˆ(s) = 1/s. Part (d) points to a variety of questions that may arise when inverses are considered, including: Is HR (s) proper? Is it unique? Is it stable? What is the minimum degree possible?

236

5 Controllability and Observability: Fundamental Results

5.9. Consider the system x˙ = Ax + Bu, y = Cx. Show that output function controllability implies output controllability (-from-the-origin, or reachability). 11 1 10 5.10. Given x(k+1) = x(k)+ u(k), y(k) = x(k), and assume 01 1 11 zero initial conditions. (a) Is there a sequence {u(0), u(1), . . . } that transfers the output of inputs 0 0 from y(0) = to in ﬁnite time? If the answer is yes, determine 0 1 such a sequence. (b) Characterize all outputs that can be reached from the zero output (y(0) = 0 ), in one step. 0 ⎡ ⎤ 110 110 x(k), 5.11. Suppose that for system x(k + 1) = ⎣ 0 1 0 ⎦ x(k), y(k) = 010 0 0 1 1 it is known that y(0) = y(1) = y(2) = . Based on this information, what 0 can be said about the initial condition x(0)? 5.12. (a) Consider the system x˙ = Ax + Bu, y = Cx + Du, where (A, C) is assumed to be observable. Express x(t) as a function of y(t), u(t) and their derivatives. Hint: Write y(t), y (1) (t), . . . , y (n−1) (t) in terms of x(t) and u(t), u(1) (t), . . . , u(n−1) (t) ( x(t) ∈ Rn ). (b) Given the system x˙ = Ax + Bu, y = Cx + Du with (A, C) observable. Determine x(0) in terms of y(t), u(t) and their derivatives up to order n − 1. Note that in general this is not a practical way of determining x(0), since this method requires diﬀerentiation of signals, which is very susceptible to measurement noise. (c) Consider the system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k), where (A, C) is observable. Express x(k) as a function of y(k), y(k + 1), . . . , y(k + n − 1) and u(k), u(k + 1), . . . , y(k + n − 1). Hint: Express y(k), . . . , y(k + n − 1) in terms of x(k) and u(k), u(k + 1), . . . , u(k + n − 1) [ x(k) ∈ Rn ]. Note the relation to expression (5.88) in Section 5.4.

6 Controllability and Observability: Special Forms

6.1 Introduction In this chapter, important special forms for the state-space description of time-invariant systems are presented. These forms are obtained by means of similarity transformations and are designed to reveal those features of a system that are related to the properties of controllability and observability. In Section 6.2, special state-space forms that separate the controllable (observable) from the uncontrollable (unobservable) part of a system are presented. These forms, referred to as the standard forms for uncontrollable and unobservable systems, are very useful in establishing a number of results. In particular, these forms are used in Section 6.3 to derive alternative tests for controllability and observability and in Section 7.2 to relate state-space and input–output descriptions. In Section 6.4 the controller and observer state-space forms are introduced. These are useful in the study of state-space realizations in Chapter 8 and state feedback and state estimators in Chapter 9.

6.2 Standard Forms for Uncontrollable and Unobservable Systems We consider time-invariant systems described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(6.1)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . It was shown in the previous chapter that this system is state reachable if and only if the n × mn controllability matrix (6.2) C [B, AB, . . . , An−1 B] has full row rank n; i.e., rank C = n. If the system is reachable (or controllablefrom-the-origin), then it is also controllable (or controllable-to-the-origin), and vice versa (see Section 5.3.1).

238

6 Controllability and Observability: Special Forms

It was also shown earlier that system (6.1) is state observable if and only if the pn × n observability matrix ⎤ ⎡ C ⎢ CA ⎥ ⎥ ⎢ (6.3) O⎢ ⎥ .. ⎦ ⎣ . CAn−1 has full column rank; i.e., rank O = n. If the system is observable, then it is also constructible, and vice versa (see Section 5.4.1). Similar results were also derived for discrete-time time-invariant systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k).

(6.4)

Again, rank C = n and rank O = n are the necessary and suﬃcient conditions for state reachability and observability, respectively. Reachability always implies controllability and observability always implies constructibility, as in the continuous-time case. However, in the discrete-time case, controllability does not necessarily imply reachability and constructibility does not imply observability, unless A is nonsingular (see Sections 5.3.2 and 5.4.2). Next, we will introduce standard forms for unreachable and unobservable systems both for the continuous-time and the discrete-time time-invariant cases. These forms will be referred to as standard forms for uncontrollable systems, rather than unreachable systems, and standard forms for unobservable systems, respectively. 6.2.1 Standard Form for Uncontrollable Systems If the system (6.1) [or (6.4)] is not completely reachable or controllable-fromthe-origin, then it is possible to “separate” the controllable part of the system by means of an appropriate similarity transformation. This amounts to changing the basis of the state space so that all the vectors in the reachable subspace Rr have a certain structure. In particular, let rank C = nr < n; i.e., the pair (A, B) is not controllable. This implies that the subspace Rr = R(C) has dimension nr . Let {v1 , v2 , . . . , vnr } be a basis for Rr . These nr vectors can be, for example, any nr linearly independent columns of C. Deﬁne the n × n similarity transformation matrix Q [v1 , v2 , . . . , vnr , Qn−nr ],

(6.5)

where the n × (n − nr ) matrix Qn−nr contains n − nr linearly independent vectors chosen so that Q is nonsingular. There are many such choices. We are now in a position to prove the following result.

6.2 Standard Forms for Uncontrollable and Unobservable Systems

239

Lemma 6.1. For (A, B) uncontrollable, there exists a nonsingular matrix Q such that % = Q−1 AQ = A1 A12 % = Q−1 B = B1 , A (6.6) and B 0 A2 0 where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and the pair (A1 , B1 ) is controllable. The % B) % is in the standard form for uncontrollable systems. pair (A, Proof. We need to show that

A1 A12 AQ = A[v1 , . . . , vnr , Qn−nr ] = [v1 , . . . , vnr , Qn−nr ] 0 A2

% = QA.

Since the subspace Rr is A-invariant (see Lemma 5.19), Avi ∈ Rr , which can be written as a linear combination of only the nr vectors in a basis of Rr . % is an nr × nr matrix, and the (n − nr ) × nr matrix below it in Thus, A1 in A % A is a zero matrix. Similarly, we also need to show that B1 % B = [v1 , . . . , vnr , Qn−nr ] = QB. 0 But this is true for similar reasons: The columns of B are in the range of C or in Rr . % B) % is The n × nm controllability matrix C% of (A, n−1 % A %B, % ...,A %n−1 B] % = B1 A1 B1 · · · A1 B1 , C% = [B, 0 0 ··· 0

(6.7)

% = rank[B1 , A1 B1 , . . . , Anr −1 B1 , . . . , An−1 B1 ] = nr . which clearly has rank C 1 1 Note that C% = Q−1 C. (6.8) % B). % It contains vectors only The range of C% is the controllable subspace of (A, T T nr % = rank C% = nr , every of the form [α , 0] , where α ∈ R . Since dim R(C) vector of the form [αT , 0]T is a controllable (state) vector. In other words, the similarity transformation has changed the basis of Rn in such a manner so that all controllable vectors, expressed in terms of this new basis, have this very particular structure with zeros in the last n − nr entries. Given system (6.1) [or (6.4)], if a new state x ˆ(t) is taken to be x ˆ(t) = Q−1 x(t), then %x + Bu, % %xˆ + Du, % x ˆ˙ = Aˆ y=C (6.9) % = Q−1 B, C % = CQ, and D % = D constitutes an equiva% = Q−1 AQ, B where A lent representation (see Section 3.4.3). For Q as in Lemma 6.1, we obtain x ˆ x ˆ˙ 1 A1 A12 xˆ1 B1 u, y = [C1 , C2 ] 1 + Du, = + (6.10) ˙x 0 A x ˆ 0 x ˆ ˆ2 2 2 2

240

6 Controllability and Observability: Special Forms

where x ˆ = [ˆ xT1 , x ˆT2 ]T with x ˆ1 ∈ Rnr and where (A1 , B1 ) is controllable. The % = [C1 , C2 ] does not have any particular structure. This representamatrix C tion is called a standard form for the uncontrollable system. The state equation can now be written as xˆ˙ 1 = A1 x ˆ1 + B1 u + A12 x ˆ2 , x ˆ˙ 2 = A2 x ˆ2 ,

(6.11)

which shows that the input u does not aﬀect the trajectory component xˆ2 (t) at all, and therefore, x ˆ2 (t) is determined only by the value of its initial vector. The input u certainly aﬀects x ˆ1 (t). Note also that the trajectory component x ˆ1 (t) is also inﬂuenced by xˆ2 (t). In fact, t

t A1 t A1 (t−τ ) A1 (t−τ ) A2 τ xˆ1 (t) = e x ˆ1 (0) + e B1 u(τ )dτ + e A12 e dτ xˆ2 (0). 0

0

(6.12) The nr eigenvalues of A1 and the corresponding modes are the controllable eigenvalues and controllable modes of the pair (A, B) or of system (6.1) [or of (6.4)]. The n − nr eigenvalues of A2 and the corresponding modes are the uncontrollable eigenvalues and uncontrollable modes, respectively. It is interesting to observe that in the zero-state response of the system (zero initial conditions), the uncontrollable modes are completely absent. In t particular, in the solution x(t) = eAt x(0)+ 0 eA(t−τ ) Bu(τ )dτ of x˙ = Ax+Bu, given x(0), notice that A (t−τ ) 1 % B1 % =Q e eA(t−τ ) B = [QeA(t−τ ) Q−1 ][QB] , 0 where A1 [from (6.6)] contains only the controllable eigenvalues. Therefore, the input u(t) cannot directly inﬂuence the uncontrollable modes. Note, however, that the uncontrollable modes do appear in the zero-input response eAt x(0). The same observations can be made for discrete-time systems (6.4) where the quantity Ak B is of interest. ⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.2. Given A = ⎣ 1 −2 1 ⎦ and B = ⎣ 1 1 ⎦, we wish to reduce 0 1 −1 12 system (6.1) to the standard form (6.6). Here ⎤ ⎡ 1 0 0 1 0 −1 C = [B, AB, A2 B] = ⎣ 1 1 0 0 0 0 ⎦ 1 2 0 −1 0 1 and rank C = nr = 2 < 3 = n. Thus, the subspace Rr = R(C) has dimension nr = 2, and a basis {v1 , v2 } can be found by taking two linearly independent columns of C, say, the ﬁrst two, to obtain

6.2 Standard Forms for Uncontrollable and Unobservable Systems

⎡

241

⎤

100 Q = [v1 , v2 , Q1 ] = ⎣ 1 1 0 ⎦ . 121 The third column of Q was selected so that Q is nonsingular. Note that the ﬁrst two columns of Q could have been the ﬁrst and fourth columns of C instead, or any other two linearly independent vectors obtained as a linear combination of the columns in C. For the above choice for Q, we have ⎡ ⎤⎡ ⎤⎡ ⎤ 1 00 0 −1 1 100 % = Q−1 AQ = ⎣ −1 1 0 ⎦ ⎣ 1 −2 1 ⎦ ⎣ 1 1 0 ⎦ A 1 −2 1 0 1 −1 121 ⎡ ⎤⎡ ⎤ 0 −1 1 100 = ⎣ 1 −1 0 ⎦ ⎣ 1 1 0 ⎦ −2 4 −2 121 ⎤ ⎡ 0 1 1 A1 A12 , = ⎣ 0 −1 0 ⎦ = 0 A2 0 0 −2 ⎡ ⎤⎡ ⎤ ⎡ ⎤ 10 1 00 10 % = Q−1 B = ⎣ −1 1 0 ⎦ ⎣ 1 1 ⎦ = ⎣ 0 1 ⎦ = B1 , B 0 1 −2 1 12 00 where (A1 , B1 ) is controllable. The matrix A has three eigenvalues at 0, −1, % B) % that the eigenvalues 0, −1 are controllable (in and −2. It is clear from (A, A1 ), whereas −2 is an uncontrollable eigenvalue (in A2 ).

6.2.2 Standard Form for Unobservable Systems The standard form for an unobservable system can be derived in a similar way as the standard form of uncontrollable systems. If the system (6.1) [or (6.4)] is not completely state observable, then it is possible to “separate” the unobservable part of the system by means of a similarity transformation. This amounts to changing the basis of the state space so that all the vectors in the unobservable subspace Ro¯ have a certain structure. As in the preceding discussion concerning systems or pairs (A, B) that are not completely controllable, we shall select a similarity transformation Q to reduce a pair (A, C), which is not completely observable, to a particular form. This can be accomplished in two ways. The simplest way is to invoke duality and to work with the pair (AD = AT , BD = C T ), which is not controllable (refer to the discussion of dual systems in Section 5.2.3). If Lemma 6.1 is applied, then AD1 AD12 BD1 −1 −1 % % AD = QD AD QD = , , BD = QD BD = 0 AD2 0 where (AD1 , BD1 ) is controllable.

242

6 Controllability and Observability: Special Forms

% C), % which has the desired Taking the dual again, we obtain the pair (A, properties. In particular, T %=A %T = QT AT (QT )−1 = QT A(QT )−1 = ATD1 0T A , D D D D D D AD12 AD2 (6.13) T T T −1 T −1 T % % C = BD = BD (QD ) = C(QD ) = [BD1 , 0], T where (ATD1 , BD1 ) is completely observable by duality (see Lemma 5.7).

⎡

⎤ 0 1 0 111 Example 6.3. Given A = ⎣ −1 −2 1 ⎦ and C = , we wish to reduce 012 1 1 −1 system (6.1) to the standard form (6.13). To accomplish this, let AD = AT and BD = C T . Notice that the pair (AD , BD ) is precisely the pair (A, B) of Example 6.2. A pair (A, C) can of course also be reduced directly to the standard form for unobservable systems. This is accomplished in the following. Consider the system (6.1) [or (6.4)] and the observability matrix O in (6.3). Let rank O = no < n; i.e., the pair (A, C) is not completely observable. This implies that the unobservable subspace Ro¯ = N (O) has dimension n − no . Let {v1 , . . . , vn−no } be a basis for Ro¯, and deﬁne an n×n similarity transformation matrix Q as (6.14) Q [Qno , v1 , . . . , vn−no ], where the n × no matrix Qno contains no linearly independent vectors chosen so that Q is nonsingular. Clearly, there are many such choices. Lemma 6.4. For (A, C) unobservable, there is a nonsingular matrix Q such that A1 0 −1 % % = CQ = [C1 , 0], A = Q AQ = (6.15) and C A21 A2 where A1 ∈ Rno ×no , C1 ∈ Rp×no , and the pair (A1 , C1 ) is observable. The % C) % is in the standard form for unobservable systems. pair (A, Proof. We need to show that

A1 0 AQ = A[Qn0 , v1 , . . . , vn−no ] = [Qno , v1 , . . . , vn−no ] A21 A2

% = QA.

Since the unobservable subspace Ro¯ is A-invariant (see Lemma 5.49), Avi ∈ Ro¯, which can be written as a linear combination of only the n − no vectors % is an (n − no ) × (n − no ) matrix, and the in a basis of Ro¯. Thus, A2 in A % is a zero matrix. Similarly, we also need no × (n − no ) matrix above it in A to show that % CQ = C[Qno , v1 , . . . , vn−no ] = [C1 , 0] = C. This is true since Cvi = 0.

6.2 Standard Forms for Uncontrollable and Unobservable Systems

243

% of (A, % C) % is The pn × n observability matrix O % ⎤ ⎡ C1 C ⎢ C %A % ⎥ ⎢ C1 A1 ⎥ ⎢ %=⎢ O ⎥=⎢ ⎢ .. .. ⎦ ⎣ ⎣ . . n−1 % % C1 An−1 CA 1 ⎡

⎤ 0 0⎥ ⎥ .. ⎥ , .⎦

(6.16)

0

which clearly has ⎡

C1 C1 A1 .. .

⎤

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ % rank O = rank ⎢ no −1 ⎥ = no . ⎢ C1 A1 ⎥ ⎢ ⎥ .. ⎣ ⎦ . C1 An−1 1 Note that

% = OQ. O

(6.17)

% is the unobservable subspace of (A, % C). % It contains vectors The null space of O T T n−n0 % = n − rank O %= . Since dim N (O) only of the form [0, α ] , where α ∈ R T T n − n0 , every vector of the form [0, α ] is an unobservable (state) vector. In other words, the similarity transformation has changed the basis of Rn in such a manner so that all unobservable vectors expressed in terms of this new basis have this very particular structure—zeros in the ﬁrst no entries. For Q chosen as in Lemma 6.4, x ˆ A1 0 x ˆ1 B1 x ˆ˙ 1 = + u, y = [C1 , 0] 1 + Du, (6.18) x ˆ2 B2 x ˆ2 A21 A2 x ˆ˙ 2 where x ˆ = [ˆ xT1 , xˆT2 ]T with x ˆ1 ∈ Rno and (A1 , C1 ) is observable. The matrix T T T % = [B1 , B2 ] does not have any particular form. This representation is B called a standard form for the unobservable system. The no eigenvalues of A1 and the corresponding modes are called observable eigenvalues and observable modes of the pair (A, C) or of the system (6.1) [or of (6.4)]. The n − no eigenvalues of A2 and the corresponding modes are called unobservable eigenvalues and unobservable modes, respectively. Notice that the trajectory component xˆ(t), which is observed via the output y, is not inﬂuenced at all by x ˆ2 , the trajectory of which is determined primarily by the eigenvalues of A2 . The unobservable modes of the system are completely absent from the output. In particular, given x˙ = Ax + Bu, y = Cx with initial state x(0), we have

t CeA(t−τ ) Bu(τ )dτ y(t) = CeAt x(0) + 0

244

6 Controllability and Observability: Special Forms

% % −1 ][QeAt and CeAt = [CQ Q−1 ] = [C1 eA1 t , 0]Q−1 , where A1 [from (6.15)] contains only the observable eigenvalues. Therefore, the unobservable modes cannot be seen by observing the output. The same observations can be made for discrete-time systems where the quantity CAk is of interest.

0 1 and C = [1, 1], we wish to reduce −2 −3 system form (6.15). To accomplish this, we compute (6.1) to the standard C 1 1 O = = , which has rank O = no = 1 < 2 = n. Therefore, CA −2 −2 the unobservable subspace Ro¯ = N (O) has dimension n − no = 1. In view of (6.14), 0 1 Q = [Q1 , v1 ] = , 1 −1 Example 6.5. Given A =

where v1 = [1, −1]T is a basis for Ro¯, and Q1 was chosen so that Q is nonsingular. Then 11 0 1 0 1 −1 % A = Q AQ = 10 −2 −3 1 −1 −2 0 A1 0 = = , A21 A2 1 −1 % = CQ = [1, 1] 0 1 = [1, 0] = [C1 , 0], C 1 −1 where (A1 , C1 ) is observable. The matrix A has two eigenvalues at −1, −2. It % C) % that the eigenvalue −2 is observable (in A1 ), whereas −1 is clear from (A, is an unobservable eigenvalue (in A2 ).

6.2.3 Kalman’s Decomposition Theorem Lemmas 6.1 and 6.4 can be combined to obtain an equivalent representation of (6.1) where the reachable and observable parts of this system can readily be identiﬁed. We consider system (6.9) and proceed, in the following, to construct the n × n required similarity transformation matrix Q. As before, we let nr denote the dimension of the controllable subspace Rr ; i.e., nr = dim Rr = dim R(C) = rank C. The dimension of the unobservable subspace Ro¯ = N (O) is given by no¯ = n − rank O = n − no . Let nr¯o be the dimension of the subspace Rr¯o Rr ∩ Ro¯, which contains all the state vectors x ∈ Rn that are controllable but unobservable. We choose Q [v1 , . . . , vnr −nro¯+1 , . . . , vnr , QN , vˆ1 , . . . , vˆno¯−nro¯ ],

(6.19)

where the nr vectors in {v1 , . . . , vnr } form a basis for Rr . The last nr¯o vectors {vnr −nro¯+1 , . . . , vnr } in the basis for Rr are chosen so that they form a basis

6.2 Standard Forms for Uncontrollable and Unobservable Systems

245

for Rr¯o = Rr ∩ Ro¯. The no¯ − nr¯o = (n − no − nr¯o ) vectors {ˆ v1 , . . . , vˆno¯ −nro¯ } are selected so that when taken together with the nr¯o vectors {vnr −nro¯+1 , . . . , vnr } they form a basis for Ro¯, the unobservable subspace. The remaining N = n−(nr +no¯ −nr¯o ) columns in QN are simply selected so that Q is nonsingular. The following theorem is called the Canonical Structure Theorem or Kalman’s Decomposition Theorem. Theorem 6.6. For (A, B) uncontrollable and (A, C) unobservable, there is a nonsingular matrix Q such that ⎡ ⎡ ⎤ ⎤ A11 0 A13 0 B1 ⎢ ⎢ ⎥ ⎥ % = Q−1 AQ = ⎢ A21 A22 A23 A24 ⎥ , B % = Q−1 B = ⎢ B2 ⎥ , A ⎣ 0 0 A33 0 ⎦ ⎣ 0 ⎦ (6.20) 0 0 A43 A44 0 % = CQ = [C1 , 0, C3 , 0], C where (i) (Ac , Bc ) with Ac

A11 0 A21 A22

and

Bc

B1 B2

is controllable, where Ac ∈ Rnr ×nr , Bc ∈ Rnr ×m ; (ii) (Ao , Co ) with A11 A13 Ao and Co [C1 , C3 ] 0 A33 is observable, where Ao ∈ Rno ×no and Co ∈ Rp×no and where the dimensions of the matrices Aij , Bi , and Cj are as follows: A11 : (nr − nr¯o ) × (nr − nr¯o ), A33 : (n − (nr + no¯ − nro¯ )) ×

A22 : nr¯o × nro¯ , A44 : (no¯ − nr¯o ) × (no¯ − nr¯o ),

(n − (nr + no¯ − nro¯ )), B1 : (nr − nr¯o ) × m,

B2 : nr¯o × m,

C1 : p × (nr − nr¯o ),

C3 : p × (n − (nr + no¯ − nr¯o ));

(iii) the triple (A11 , B1 , C1 ) is such that (A11 , B1 ) is controllable and (A11 , C1 ) is observable. Proof. For details of the proof, refer to [6] and to [7], where further clariﬁcations to [6] and an updated method of selecting Q are given. The similarity transformation (6.19) has altered the basis of the state space in such a manner that the vectors in the controllable subspace Rr , the vectors

246

6 Controllability and Observability: Special Forms

in the unobservable subspace Ro¯, and the vectors in the subspace Rr¯o ∩ Ro¯ all have speciﬁc forms. To see this, we construct the controllability matrix % = [B, % ...,A %n−1 B] % whose range is the controllable subspace and the observC % = [C %T , . . . , (C %A %n−1 )T ]T , whose null space is the unobservable ability matrix O subspace. Then, all controllable states are of the form [xT1 , xT2 , 0, 0]T , all the unobservable ones have the structure [0, xT2 , 0, xT4 ]T , and states of the form [0, xT2 , 0, 0]T characterize Rr¯o ; i.e., they are controllable but unobservable. % or of A, are Similarly to the previous two lemmas, the eigenvalues of A, the eigenvalues of A11 , A22 , A33 , and A44 ; i.e., % = |λI − A11 ||λI − A22 ||λI − A33 ||λI − A44 |. |λI − A| = |λI − A|

(6.21)

% B, % C, % D} % given in (6.20), then If we consider the representation {A, ⎡˙ ⎤ ⎡ x ˆ1 A11 ˙ 2 ⎥ ⎢ A21 ⎢x ˆ ⎢ ⎥=⎢ ⎣x ˆ˙ 3 ⎦ ⎣ 0 0 x ˆ˙ 4

⎤ ⎤⎡ ⎤ ⎡ xˆ1 B1 0 ⎥ ⎢ ⎥ ⎢ A24 ⎥ ⎥ ⎢ xˆ2 ⎥ + ⎢ B2 ⎥ u, ⎦ ⎣ ⎦ ⎣ 0 xˆ3 0 ⎦ 0 A44 xˆ4 ⎡ ⎤ x ˆ1 ⎢x ˆ2 ⎥ ⎥ + Du. y = [C1 , 0, C3 , 0] ⎢ ⎣x ˆ3 ⎦ x ˆ4 0 A22 0 0

A13 A23 A33 A43

(6.22)

This shows that the trajectory components corresponding to x ˆ3 and x ˆ4 are not aﬀected by the input u. The modes associated with the eigenvalues of A33 and A44 determine the trajectory components for x ˆ3 and x ˆ4 (compare this with the results in Lemma 6.1). Similarly to Lemma 6.4, the trajectory ˆ4 are not inﬂuenced by xˆ1 and xˆ3 (observed via y), components for x ˆ2 and x and they are determined by the eigenvalues of A22 and A44 . The following is now apparent (see also Figure 6.1): The eigenvalues of A11 A22 A33 A44

are are are are

controllable and observable, controllable and unobservable, uncontrollable and observable, uncontrollable and unobservable. ⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.7. Given A = ⎣ 1 −2 1 ⎦, B = ⎣ 1 1 ⎦, and C = [0, 1, 0], we 0 1 −1 12 wish to reduce system (6.1) to the canonical structure (or Kalman decomposition) form (6.20). The appropriate transformation matrix Q is given by (6.19). The matrix C was found in Example 6.2 and

6.2 Standard Forms for Uncontrollable and Unobservable Systems

247

c – co o co

u

y

c– o

–c o– – c

Figure 6.1. Canonical decomposition (c and c¯ denote controllable and uncontrollable, respectively). The connections of the c/¯ c and o/¯ o parts of the system to the input and output are emphasized. Note that the impulse response (transfer function) of the system, which is an input–output description only, represents the part of the system that is both controllable and observable (see Chapter 7).

⎤ ⎡ ⎤ 0 1 0 C O = ⎣ CA ⎦ = ⎣ 1 −2 1 ⎦ . −2 4 −2 CA2 ⎡

A basis for Ro¯ = N (O) is {(1, 0, −1)T }. Note that nr = 2, no¯ = 1, and nr¯o = 1. Therefore, ⎤ ⎡ 1 10 Q = [v1 , v2 , QN ] = ⎣ 1 0 0 ⎦ 1 −1 1 is an appropriate similarity matrix (check that det Q = 0). We compute ⎡ ⎤⎡ ⎤⎡ ⎤ 0 10 0 −1 1 1 10 % = Q−1 AQ = ⎣ 1 −1 0 ⎦ ⎣ 1 −2 1 ⎦ ⎣ 1 0 0 ⎦ A 1 −2 1 0 1 −1 1 −1 1 ⎤ ⎡ ⎤ ⎡ 0 0 1 A11 0 A13 = ⎣ 0 −1 0 ⎦ = ⎣ A21 A22 A23 ⎦ , 0 0 A33 0 0 −2 ⎤ ⎤ ⎡ ⎡ ⎤⎡ ⎤ ⎡ 1 1 0 10 B1 10 % = Q−1 B = ⎣ 1 −1 0 ⎦ ⎣ 1 1 ⎦ = ⎣ 0 −1 ⎦ = ⎣ B2 ⎦ , B 0 1 −2 1 12 0 0

248

and

6 Controllability and Observability: Special Forms

⎡

⎤ 1 10 % = CQ = [0, 1, 0] ⎣ 1 0 0 ⎦ = [1, 0, 0] = [C1 , 0, C3 ]. C 1 −1 1

The eigenvalue 0 (in A11 ) is controllable and observable, the eigenvalue −1 (in A22 ) is controllable and unobservable and the eigenvalue −2 (in A33 ) is uncontrollable and observable. There are no eigenvalues that are both uncontrollable and unobservable.

6.3 Eigenvalue/Eigenvector Tests for Controllability and Observability There are tests for controllability and observability for both continuous- and discrete-time time-invariant systems that involve the eigenvalues and eigenvectors of A. Some of these criteria are called PBH tests, after the initials of the codiscoverers (Popov–Belevitch–Hautus) of these tests. These tests are useful in theoretical analysis, and in addition, they are also attractive as computational tools. Theorem 6.8. (i) The pair (A, B) is uncontrollable if and only if there exists a 1 × n (in general) complex vector vˆi = 0 such that vˆi [λi I − A, B] = 0,

(6.23)

where λi is some complex scalar. (ii) The pair (A, C) is unobservable if and only if there exists an n × 1 (in general) complex vector vi = 0 such that λi I − A (6.24) vi = 0, C where λi is some complex scalar. Proof. Only part (i) will be considered since (ii) can be proved using a similar argument or, directly, by duality arguments. (Suﬃciency) Assume that (6.23) is satisﬁed. In view of vˆi A = λi vˆi and vˆi B = 0, vˆi AB = λi vˆi B = 0 and vˆi Ak B = 0 k = 0, 1, 2, . . . . Therefore, vˆi C = vˆi [B, AB, . . . , An−1 B] = 0, which shows that (A, B) is not completely controllable. (Necessity) Let (A, B) be uncontrollable and assume without loss of generality the standard form for A and B given in Lemma 6.1. We will show that there exist λi and vˆi so that (6.23) holds. Let λi be an uncontrollable eigenvalue, and let vˆi = [0, α], αT ∈ C n−nr , where α(λi I − A2 ) = 0; i.e., α is a left eigenvector of A2 corresponding to λi . Then vˆi [λi I − A, B] = [0, α(λi I − A2 ), 0] = 0; i.e., (6.23) is satisﬁed.

6.3 Eigenvalue/Eigenvector Tests for Controllability and Observability

249

Corollary 6.9. (i) λi is an uncontrollable eigenvalue of (A, B) if and only if there exists a 1 × n (in general) complex vector vˆi = 0 that satisﬁes (6.23). (ii) λi is an unobservable eigenvalue of (A, C) if and only if there exists an n × 1 (in general) complex vector vi = 0 that satisﬁes (6.24). Proof. See [1, p. 273, Corollary 4.6].

⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.10. Given are A = ⎣ 1 −2 1 ⎦ , B = ⎣ 1 1 ⎦, and C = [0, 1, 0], 0 1 −1 12 as in Example 6.7. The matrix A has three eigenvalues, λ1 = 0, λ2 = −1, and λ3 = −2, with corresponding right eigenvectors v1 = [1, 1, 1]T , v2 = [1, 0, −1]T , v3 = [1, 1, −1]T and with left eigenvectors vˆ1 = [1/2, 0, 1/2], vˆ2 = [1, −1, 0], and vˆ3 = [−1/2, 1, −1/2], respectively. In view of Corollary 6.9, vˆ1 B = [1, 1] = 0 implies that λ1 = 0 is controllable. This is because vˆ1 is the only nonzero vector (within a multiplication by a nonzero scalar) that satisﬁes vˆ1 (λ1 I − A) = 0, and so vˆ1 B = 0 implies that the only 1 × 3 vector α that satisﬁes α[λ1 I − A, B] = 0 is the zero vector, which in turn implies that λ1 is controllable in view of (i) of Corollary 6.9. For similar reasons Cv1 = 1 = 0 implies that λ1 = 0 is observable; see (ii) of Corollary 6.9. Similarly, vˆ2 B = [0, −1] = 0 implies that λ2 = −1 is controllable, and Cv2 = 0 implies that λ2 = −1 is unobservable. Also, vˆ3 B = [0, 0] implies that λ3 = −2 is uncontrollable, and Cv3 = 1 = 0 implies that λ3 = −2 is observable. These results agree with the results derived in Example 6.7. Corollary 6.11. ( Rank Tests) (ia) The pair (A, B) is controllable if and only if rank[λI − A, B] = n

(6.25)

for all complex numbers λ, or for all n eigenvalues λi of A. (ib) λi is an uncontrollable eigenvalue of A if and only if rank[λi I − A, B] < n. (iia) The pair (A, C) is observable if and only if λI − A rank =n C for all complex numbers λ, or for all n eigenvalues λi . (iib) λi is an unobservable eigenvalue of A if and only if λi I − A rank < n. C

(6.26)

(6.27)

(6.28)

250

6 Controllability and Observability: Special Forms

Proof. The proofs follow in a straightforward manner from Theorem 6.8. Notice that the only values of λ that can possibly reduce the rank of [λI − A, B] are the eigenvalues of A.

Example 6.12. If in Example 6.10 the eigenvalues λ1 , λ2 , λ3 of A are known, but the corresponding eigenvectors are not, consider the system matrix ⎡ ⎤ s 1 −1 1 0 ⎢ −1 s + 2 −1 1 1 ⎥ sI − A B ⎥ P (s) = =⎢ ⎣ 0 −1 s + 1 1 2 ⎦ −C 0 0 −1 0 00 λ I −A and determine rank[λi I − A, B] and rank i . Notice that C ⎡ ⎤ −1 1 −1 ⎢ −1 1 −1 ⎥ sI − A ⎥ rank = rank ⎢ ⎣ 0 −1 0 ⎦ = 2 < 3 = n C s=λ2 0 1 0 ⎡

and rank[sI − A, B]s=λ3

⎤ −2 2 −1 1 0 = rank ⎣ −1 0 −1 1 1 ⎦ = 2 < 3 = n. 0 −1 −1 1 2

In view of Corollary 6.11, λ2 = −1 is unobservable and λ3 = −2 is uncontrollable.

6.4 Controller and Observer Forms It has been seen several times in this book that equivalent representations of systems x˙ = Ax + Bu, y = Cx + Du, (6.29) given by the equations %x + Bu, % x ˆ˙ = Aˆ

%xˆ + Du, % y=C

(6.30)

% = P B, C % = CP −1 , and D % = D may oﬀer % = P AP −1 , B where x ˆ = P x, A advantages over the original representation when P (or Q = P −1 ) is chosen in an appropriate manner. This is the case when P (or Q) is such that the new basis of the state space provides a natural setting for the properties of interest. This section shows how to select Q when (A, B) is controllable [or (A, C) is observable] to obtain the controller and observer forms. These special forms

6.4 Controller and Observer Forms

251

are very useful, in realizations discussed in Chapter 8 and especially when studying state-feedback control (and state observers) discussed in Chapter 9. They are also very useful in establishing a convenient way to transition between state-space representations and another very useful class of equivalent internal representations, the polynomial matrix representations. Controller forms are considered ﬁrst. Observer forms can of course be obtained directly in a similar manner to the controller forms, or they may be obtained by duality. This is addressed in the latter part of this section. 6.4.1 Controller Forms The controller form is a particular system representation where both matrices (A, B) have a certain special structure. Since in this case A is in the companion form, the controller form is sometimes also referred to as the controllable companion form. Consider the system x˙ = Ax + Bu,

y = Cx + Du,

(6.31)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m and let (A, B) be controllable. Then rank C = n, where C = [B, AB, . . . , An−1 B].

(6.32)

rank B = m ≤ n.

(6.33)

Assume that Under these assumptions, rank C = n and rank B = m. We will show how % B) % in controller form, ﬁrst for the singleto obtain an equivalent pair (A, input case (m = 1) and then for the multi-input case (m > 1). Before this is accomplished, we discuss how to deal with two special cases that do not satisfy the above assumptions that rank B = m and that (A, B) is controllable. 1. If the m columns of B are not linearly independent (rank B = r < m), then there exists an m × m nonsingular matrix K so that BK = [Br , 0], where the r columns of Br are linearly independent (rank Br = r). Note that ur x˙ = Ax + Bu = Ax + (BK)(K −1 u) = Ax + [Br , 0] = Ax + Br ur , um−r which shows that when rank B = r < m the same input action to the system can be accomplished by only r inputs, instead of m inputs. The pair (A, Br ), which is controllable when (A, B) is controllable, can now be reduced to controller form, using the method described below. 2. When (A, B) is not completely controllable, then a two-step approach can be taken. First, the controllable part is isolated (see Subsection 6.2.1) and then is reduced to the controller form, using the methods of this section. In particular, consider the system x˙ = Ax + Bu with A ∈ Rn×n , B ∈ Rn×m , and rank B = m. Let rank[B, AB, . . . , An−1 B] = nr < n. Then

252

6 Controllability and Observability: Special Forms

A1 A12 there exists a transformation P1 such that P1 AP1−1 = and 0 A2 B1 , where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and (A1 , B1 ) is conP1 B = 0 trollable (Subsection 6.2.1). Since (A1 , B1 ) is controllable, there exists a transformation P2 such that P2 A1 P2−1 = A1c , and P2 B1 = B1c , where A1c , B1c is in controller form, deﬁned below. Combining, we obtain A1c P2 A12 B1c −1 (6.34) P AP = , and P B = 0 A2 0 [where A1c ∈ Rnr ×nr , B1c ∈ Rnr ×m , and (A1c , B1c ) is controllable], which is in controller form. Note that P2 0 P = (6.35) P1 . 0 I Single-Input Case (m = 1) %= The representation {Ac , Bc , Cc , Dc } in controller form is given by Ac A −1 % P AP and Bc B = P B with ⎤ ⎡ ⎡ ⎤ 0 1 ··· 0 0 ⎥ ⎢ .. ⎢ .. ⎥ .. . . .. ⎥ ⎢ ⎢ ⎥ . . . Ac = ⎢ . (6.36) ⎥ , Bc = ⎢ . ⎥ , ⎦ ⎣ 0 ⎣0⎦ 0 ··· 1 −α0 −α1 · · · −αn−1 1 where the coeﬃcients αi are the coeﬃcients of the characteristic polynomial α(s) of A; that is, α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 .

(6.37)

% = CP −1 and Dc = D do not have any particular strucNote that Cc C ture. The structure of (Ac , Bc ) is very useful (in control problems), and the representation {Ac , Bc , Cc , Dc } shall be referred to as the controller form of the system. The similarity transformation matrix P is obtained as follows. n−1 B] is in this case an n × n The controllability matrix C = [B, AB, ...,A × nonsingular matrix. Let C −1 = , where q is the nth row of C −1 and × q indicates the remaining entries of C −1 . Then ⎡ ⎤ q ⎢ qA ⎥ ⎥ P ⎢ (6.38) ⎣ ··· ⎦. qAn−1

6.4 Controller and Observer Forms

253

To show that P AP −1 = Ac and P B = Bc given in (6.36), note ﬁrst that qAi−1 B = 0 i = 1, . . . , n − 1 and qAn−1 B = 1. This can be veriﬁed from the deﬁnition of q, which implies that q C = [0, 0, . . . , 1]. Now ⎡ ⎤ 0 0 ··· ··· 1 ⎢0 0 ··· 1 ×⎥ ⎢ ⎥ P C = P [B, AB, . . . , An−1 B] = ⎢ . (6.39) .. .. ⎥ = Cc , ⎣ .. 1 . .⎦ 1 × ··· × × which implies that |P C| = |P | |C| = 0 or that |P | = 0. Therefore, P qualiﬁes as a similarity transformation matrix. In view of (6.39), P B = [0, 0, . . . , 1]T = Bc . Furthermore, ⎤ ⎡ qA ⎢ .. ⎥ ⎥ ⎢ Ac P = ⎢ . ⎥ = P A, (6.40) n−1 ⎦ ⎣ qA qAn i n where in the last row of Ac P , the relation − n−1 i=0 αi A = A was used [which is the Cayley–Hamilton Theorem, namely, α(A) = 0]. ⎡

⎤ ⎡ ⎤ −1 0 0 1 Example 6.13. Let A = ⎣ 0 1 0 ⎦ and B = ⎣ −1 ⎦. Since n = 3 and 0 0 −2 1 |sI − A| = (s + 1)(s − 1)(s + 2) = s3 + 2s2 − s − 2, {Ac , Bc } in controller form is given by ⎡ ⎤ ⎡ ⎤ 01 0 0 Ac = ⎣ 0 0 1 ⎦ and Bc = ⎣ 0 ⎦ . 2 1 −2 1 The transformation matrix P that reduces (A, B) to (Ac = P AP −1 , Bc = P B) is now derived. We have ⎡ ⎤ ⎡ ⎤ 1 −1 1 1 −1/3 −1/3 C = [B, AB, A2 B] = ⎣ −1 −1 −1 ⎦ and C −1 = ⎣ −1/2 −1/2 0 ⎦ . 1 −2 4 −1/2 −1/6 1/3 The third (the nth) row of C −1 is q = [−1/2, −1/6, 1/3], and therefore, ⎡ ⎤ ⎡ ⎤ q −1/2 −1/6 1/3 P ⎣ qA ⎦ = ⎣ 1/2 −1/6 −2/3 ⎦ . qA2 −1/2 −1/6 4/3 It can now easily be veriﬁed that Ac = P AP −1 , or ⎡ ⎤ 1/2 −1/6 −2/3 Ac P = ⎣ −1/2 −1/6 −2/3 ⎦ = P A, 1/2 −1/6 −8/3 and that Bc = P B.

254

6 Controllability and Observability: Special Forms

An alternative form to (6.36) is ⎡ ⎤ −αn−1 · · · −α1 −α0 ⎢ 1 ··· 0 0 ⎥ ⎢ ⎥ Ac1 = ⎢ .. . .. ⎥ , .. ⎣ . .. . . ⎦ 0 ··· 1 0

Bc1

⎡ ⎤ 1 ⎢0⎥ ⎢ ⎥ = ⎢ . ⎥, ⎣ .. ⎦

(6.41)

0

which is obtained if the similarity transformation matrix is taken to be ⎡ n−1 ⎤ qA ⎢ .. ⎥ ⎢ ⎥ P1 ⎢ . ⎥ , (6.42) ⎣ qA ⎦ q i.e., by reversing the order of the rows of P in (6.38). (See Exercise 6.5 and Example 6.14.) 0 I ×× or . It In the above, Ac is a companion matrix of the form ×× I 0 0× ×0 could also be of the form or with coeﬃcients −[α0 , . . . , αn−1 ]T I× ×I in the last or the ﬁrst column. It is shown here, for completeness, how to determine controller forms where Ac are such companion matrices. In particular, if (6.43) Q2 = P2−1 = [B, AB, . . . , An−1 B] = C, then ⎡

Ac2

Also, if

⎤ ⎡ ⎤ 0 −α0 1 ⎢0⎥ 0 −α1 ⎥ ⎥ ⎢ ⎥ ⎥ , Bc2 = Q−1 .. .. 2 B = ⎢ .. ⎥ . ⎦ ⎣.⎦ . . 0 · · · 1 −αn−1 0

0 ··· ⎢1 ··· ⎢ = Q−1 2 AQ2 = ⎢ .. . . ⎣. .

Q3 = P3−1 = [An−1 B, . . . , B],

(6.44)

(6.45)

then ⎡

Ac3

−αn−1 ⎢ .. ⎢ . = Q−1 AQ = ⎢ 3 3 ⎣ −α1 −α0

⎡ ⎤ ⎤ 0 0 ⎢ .. ⎥ .. ⎥ ⎢.⎥ .⎥ ⎥ , Bc3 = Q−1 3 B = ⎢ ⎥. ⎣0⎦ 0 ··· 1⎦ 1 0 ··· 0 1 ··· .. . . . .

(6.46)

(Ac , Bc ) in (6.44) and (6.46) are also in controller canonical or controllable companion form. (See also Exercise 6.5 and Example 6.14.)

6.4 Controller and Observer Forms

255

⎡

⎤ ⎡ ⎤ −1 0 0 1 Example 6.14. Let A = ⎣ 0 1 0 ⎦ and B = ⎣ −1 ⎦, as in Example 6.13. 0 0 −2 1 Alternative controller forms can be derived for diﬀerent P . In particular, if ⎡ 2⎤ ⎡ ⎤ qA −1/2 −1/6 4/3 (i) P = P1 = ⎣ qA ⎦ = ⎣ 1/2 −1/6 −2/3 ⎦, as in (6.42) (C, C −1 , and q q −1/2 −1/6 1/3 were found in Example 6.13), then ⎡ ⎤ ⎡ ⎤ −2 1 2 1 Ac1 = ⎣ 1 0 0 ⎦ , Bc1 = ⎣ 0 ⎦ , 010 0 ⎡ ⎤ 1/2 −1/6 −8/3 as in (6.41). Note that in the present case Ac1 P1 = ⎣ −1/2 −1/6 4/3 ⎦ = 1/2 −1/6 −2/3 P1 A, Bc1⎡= P1 B. ⎤ 1 −1 1 (ii) Q2 = C = ⎣ −1 −1 −1 ⎦ , as in (6.43). Then 1 −2 4 ⎡

Ac2 as in (6.44).

⎤ 00 2 = ⎣1 0 1⎦, 0 1 −2

Bc2

⎡ ⎤ 1 ⎣ 0⎦, = Q−1 B = 2 0

⎡

⎤ 1 −1 1 (iii) Q3 = [A2 B, AB, B] = ⎣ −1 −1 −1 ⎦, as in (6.45). Then 4 −2 1 ⎡

Ac3

⎤ −2 1 0 = ⎣ 1 0 1⎦, 200

Bc3

⎡ ⎤ 0 = ⎣0⎦, 1

⎡

as in (6.46). Note that Q3 Ac3 ⎡

⎤ 1 ⎣ −1 ⎦ = B. 1

⎤ −1 1 −1 = ⎣ −1 −1 −1 ⎦ = AQ3 , −8 4 −2

Q3 Bc3 =

256

6 Controllability and Observability: Special Forms

Multi-Input Case (m > 1) In this case, the n × mn matrix C given in (6.32) is not square, and there are typically many sets of n columns of C that are linearly independent (rank C = n). Depending on which columns are chosen and in what order, diﬀerent controller forms (controllable companion forms) are derived. Note that in the case when m = 1, four diﬀerent controller forms were derived, even though there was only one set of n linearly independent columns. In the present case there are many more such choices. The form that will be used most often in the following is a generalization of (Ac , Bc ) given in (6.36). Further discussion including derivation and alternative forms may be found in [1, Subsection 3.4D]. % = P B, where P is constructed as follows. Consider % = P AP −1 and B Let A C = [B, AB, . . . , An−1 B] = [b1 , . . . , bm , Ab1 , . . . , Abm , . . . , An−1 b1 , . . . , An−1 bm ],

(6.47)

where the b1 , . . . , bm are the m columns of B. Select, starting from the left and moving to the right, the ﬁrst n independent columns (rank C = n). Reorder these columns by taking ﬁrst b1 , Ab1 , A2 b1 , etc., until all columns involving b1 have been taken; then take b2 , Ab2 , etc.; and lastly, take bm , Abm , etc., to obtain C¯ [b1 , Ab1 , . . . , Aμ1 −1 b1 , . . . , bm , . . . , Aμm −1 bm ], (6.48) an n × n matrix. The integer μi denotes the number of columns involving bi in the set of the ﬁrst n linearly independent columns found in C when moving from left to right. Deﬁnition 6.15. The m integers μi , i = 1, . . . , m, are the controllability indices of the system, and μ max μi is called the controllability index of the system. Note that m

μi = n

and

mμ ≥ n.

(6.49)

i=1

An alternative but equivalent deﬁnition for μ is that μ is the minimum integer k such that rank[B, AB, . . . , Ak−1 B] = n. (6.50) Notice that in (6.48) all columns of B are always present since rank B = m. This implies that μi ≥ 1 for all i. Notice further that if Ak bi is present, then Ak−1 bi must also be present. Now deﬁne k σk μi , k = 1, . . . , m; (6.51) i=1

6.4 Controller and Observer Forms

257

i.e., σ1 = μ1 , σ2 = μ1 + μ2 , . . . , σm = μ1 + · · · + μm = n. Also, consider C¯−1 and let qk , where qkT ∈ Rn , k = 1, . . . , m, denote its σk th row; i.e., . . T T C¯−1 = [×, . . . , ×, q1T .. · · · ..×, . . . , ×, qm ] . Next, deﬁne

⎡

(6.52)

⎤

q1 q1 A .. .

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ q1 Aμ1 −1 ⎥ ⎢ ⎥ ⎢ ⎥ ··· ⎢ ⎥ ⎢ ⎥ . .. P ⎢ ⎥. ⎢ ⎥ ⎢ ⎥ ··· ⎢ ⎥ ⎢ ⎥ q m ⎢ ⎥ ⎢ qm A ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ . μm −1 qm A

(6.53)

It can now be shown that P AP −1 = Ac and P B = Bc with Ac = [Aij ], i, j = 1, . . . , m, ⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Aii = ⎢ . Iμi −1 ⎥ ∈ Rμi ×μi , i = j, ⎣0 ⎦ × ×···×

⎡

0 ··· ⎢ .. .. ⎢ . Aij = ⎢ . ⎣ 0 ··· × ×···

⎤ 0 .. ⎥ . ⎥ ⎥ ∈ Rμi ×μj , i = j, 0⎦ ×

and ⎡

B1 ⎢ B2 ⎢ Bc = ⎢ . ⎣ .. Bm

⎤ ⎥ ⎥ ⎥, ⎦

⎡

0 ··· ⎢ Bi = ⎣ ...

0 .. .

0 ··· .. .

⎤ 0 .. ⎥ ∈ Rμi ×m , .⎦

(6.54)

0 ··· 0 1 ×··· ×

where the 1 in the last row of Bi occurs at the ith column location, i = 1, . . . , m, and × denotes nonﬁxed entries. Note that Cc = CP −1 does not have any particular structure. The expression (6.54) is a very useful form (in control problems) and shall be referred to as the controller form of the system. The derivation of this result is discussed in [1, Subsection 3.4D] . Example 6.16. Given are A ∈ Rn×n and B ∈ Rn×m with (A, B) controllable and with rank B = m. Let n = 4 and m = 2. Then there must be two 2 controllability indices μ1 and μ2 such that n = 4 = i=1 μi = μ1 + μ2 . Under these conditions, there are three possibilities:

258

6 Controllability and Observability: Special Forms

(i) μ1 = 2, μ2 = 2, Ac =

A11 A12 A21 A22

⎡

0 1 ⎢× × ⎢ =⎣ 0 0 ××

⎤ 0 0 × ×⎥ ⎥, 0 1⎦ ××

Bc =

B1 B2

⎡

⎤ 0 0 ⎢1 ×⎥ ⎥ =⎢ ⎣0 0 ⎦. 0 1

(ii) μ1 = 1, μ2 = 3, ⎡

⎤ ×× 1 0⎥ ⎥, 0 1⎦ ××

⎤ 1× ⎢0 0 ⎥ ⎥ Bc = ⎢ ⎣0 0 ⎦. 0 1

⎡

⎤ 0 0 1 0⎥ ⎥, × ×⎦ ××

⎡

×× ⎢0 0 Ac = ⎢ ⎣0 0 ××

⎡

(iii) μ1 = 3, μ2 = 1, 0 1 ⎢0 0 Ac = ⎢ ⎣× × ××

⎤ 0 0 ⎢0 0 ⎥ ⎥ Bc = ⎢ ⎣1 ×⎦. 0 1

It is possible to write Ac , Bc in a systematic and perhaps more transparent way. In particular, notice that Ac , Bc in (6.54) can be expressed as ¯c Am , Ac = A¯c + B

¯c Bm , Bc = B

where A¯c = block diag[A¯11 , A¯22 , . . . , A¯mm ] with ⎤ ⎡0 0 . .. μi ×1 ¯c = block diag A¯ii = ⎣ .. Iμi −1 ⎦ ∈ Rμi ×μi , B , . ∈R

(6.55)

i = 1, . . . , m ,

0 1

0 0 0···0

m×n and and Bm ∈ Rm×m are some appropriate matrices with m Am ∈ R ¯ ¯ i=1 μi = n. Note that the matrices Ac , Bc are completely determined by the m controllability indices μi , i = 1, . . . , m. The matrices Am and Bm consist of the σ1 th, σ2 th, . . . , σm th rows of Ac (entries denoted by ×) and the same rows of Bc , respectively [see (6.57) and (6.58) below].

⎡

⎤ ⎡ ⎤ 01 0 01 Example 6.17. Let A = ⎣ 0 0 1 ⎦ and B = ⎣ 1 1 ⎦. To determine the 0 2 −1 00 controller form (6.54), consider ⎡ ⎤ 0111 0 0 C = [B, AB, A2 B] = [b1 , b2 , Ab1 , Ab2 , A2 b1 , A2 b2 ] = ⎣ 1 1 0 0 2 2 ⎦ , 0 0 2 2 −2 −2

6.4 Controller and Observer Forms

259

where rank C = 3 = n; i.e., (A, B) is controllable. Searching from left to right, the ﬁrst three columns of C are selected since they are linearly independent. Then ⎡ ⎤ 011 C¯ = [b1 , Ab1 , b2 ] = ⎣ 1 0 1 ⎦ 020 and the controllability indices are μ1 = 2 and μ2 = 1. Also, σ1 = μ1 = 2 and σ2 = μ1 + μ2 = 3 = n, and ⎡ ⎤ −1 1 1/2 C¯−1 = ⎣ 0 0 1/2 ⎦ . 1 0 −1/2 the and third rows Notice that q1 = [0, 0, 1/2] and q2 = [1, 0, −1/2], ⎤ second ⎡ ⎤ ⎡ q1 0 0 1/2 of C¯−1 , respectively. In view of (6.53), P = ⎣ q1 A ⎦ = ⎣ 0 1 −1/2 ⎦, P −1 = 1 0 −1/2 q ⎡ ⎤ ⎤ ⎡ 2 0 10 101 ⎣ 1 1 0 ⎦, and Ac = P AP −1 = A11 A12 = ⎣ 2 −1 0 ⎦, Bc = P B = B1 = B2 A21 A22 200 1 00 ⎤ ⎡ 00 ⎣ 1 1 ⎦. 01 One can also verify (6.55) quite easily. We have ⎤ ⎤ ⎡ ⎡ ⎡ ⎤ 00 0 10 010 2 −1 0 ¯ ¯ ⎦ ⎦ ⎣ ⎣ ⎣ ⎦ Ac = 2 −1 0 = Ac + Bc Am = 0 0 0 + 1 0 1 00 1 00 000 01 and

⎡

0 Bc = ⎣ 1 0

⎤ ⎤ ⎡ 0 00 11 ¯ ⎦ ⎦ ⎣ 1 = Bc Bm = 1 0 . 01 1 01

It is interesting to note that in this example, the given pair (A, B) could have already been in controller form if B were diﬀerent but A were the same. For example, consider the following three cases: ⎡ ⎤ ⎡ ⎤ 01 0 1× 1. A = ⎣ 0 0 1 ⎦ , B = ⎣ 0 0 ⎦ , μ1 = 1, μ2 = 2, 0 2 −1 0 1 ⎤ ⎤ ⎡ ⎡ 01 0 0 0 2. A = ⎣ 0 0 1 ⎦ , B = ⎣ 1 × ⎦ , μ1 = 2, μ1 = 1, 0 2 −1 0 1

260

6 Controllability and Observability: Special Forms

⎡

⎤ 01 0 3. A = ⎣ 0 0 1 ⎦ , 0 2 −1

⎡ ⎤ 0 B = ⎣0⎦, 1

μ1 = 3 = n.

Note that case 3 is the single-input case (6.36).

Remarks (i) An important result involving the controllability indices of (A, B) is the following: Given (A, B) controllable, then (P (A + BGF )P −1 , P BG) will have the same controllability indices, within reordering, for any P, F , and G (|P | = 0, |G| = 0) of appropriate dimensions. In other words, the controllability indices are invariant under similarity and input transformations P and G, and state feedback F [or similarity transformation P and state feedback (F, G)]. (For further discussion, see [1, Subsection 3.4D].) (ii) It is not diﬃcult to derive explicit expressions for Am and Bm in (6.55). Using qi Ak−1 bj = 0 k = 1, . . . , μj , k−1

qi A

i = j,

bi = 0 k = 1, . . . , μi − 1, and qi Aμi −1 bi = 1,

i = j,

(6.56)

where i = 1, . . . , m, and j = 1, . . . , m, it can be shown that the m σ1 th, σ2 th, . . . , σm th rows of Ac that are denoted by Am in (6.55) are given by ⎤ ⎡ q1 Aμ1 ⎥ −1 ⎢ .. Am = ⎣ (6.57) ⎦P . . qm Aμm Similarly

⎤ q1 Aμ1 −1 ⎥ ⎢ .. =⎣ ⎦ B. . μm −1 qm A ⎡

Bm

(6.58)

The matrix Bm is an upper triangular matrix with ones on the diagonal. (For details, see [1, Subsection 3.4D].) ⎡

⎤ ⎡ ⎤ 01 0 11 Example 6.18. We wish to reduce A = ⎣ 0 0 1 ⎦ , B = ⎣ 0 1 ⎦ to controller 0 2 −1 00 form. Note that A and B are almost the same as in Example 6.17; how2 ever, here μ1 = 1 < 2 = ⎡ μ2 , as will⎤ be seen. We have C = [B, AB, A B] = 1101 [b1 , b2 , Ab1 , Ab2 , . . . ] = ⎣ 0 1 0 0 · · · ⎦. Searching from left to right, the ﬁrst 0002

6.4 Controller and Observer Forms

261

three linearly independent columns are b1 , b2 , Ab2 , and C¯ = [b1 , b2 , Ab2 ] = ⎡ ⎤ 111 ⎣ 0 1 0 ⎦, from which we conclude that μ1 = 1, μ2 = 2, σ1 = 1, and 002 ⎡ ⎤ 1 −1 −1/2 σ2 = 3. We compute C¯−1 = ⎣ 0 1 0 ⎦. Note that q1 = [1, −1, −1/2] 0 0 1/2 and q⎡2 = [0, rows of⎤C¯−1 , respectively. Then ⎤0, 1/2], ⎡ the ﬁrst ⎤and third ⎡ 1 −1 −1/2 121 q1 P = ⎣ q2 ⎦ = ⎣ 0 0 1/2 ⎦, P −1 = ⎣ 0 1 1 ⎦, and q2 A 0 1 −1/2 020 ⎤ ⎡ 0 −1 0 A11 A12 Ac = P AP −1 = = ⎣0 0 1⎦, A21 A22 0 2 −1 ⎤ ⎡ 10 B1 Bc = P B = = ⎣0 0⎦. B2 01 It is easy to verify relations (6.57) and (6.58).

Structure Theorem—Controllable Version The transfer function matrix H(s) of the system x˙ = Ax + Bu, y = Cx + Du is given by H(s) = C(sI − A)−1 B + D. If (A, B) is in controller form (6.54), then H(s) can alternatively be characterized by the Structure Theorem stated in Theorem 6.19 below. This result is very useful in the realization of systems, which is addressed in Chapter 8 and in the study of state feedback in Chapter 9. ¯ c Am and B = Bc = B ¯c Bm , as in (6.55), with Let A = Ac = A¯c + B |Bm | = 0, and let C = Cc and D = Dc . Deﬁne Λ(s) diag[sμ1 , sμ2 , . . . , sμm ],

(6.59)

μi −1 T

S(s) block diag([1, s, . . . , s

] ,

i = 1, . . . , m). (6.60) m Note that S(s) is an n × m polynomial matrix (n = i=1 μi ), i.e., a matrix with polynomials as entries. Now deﬁne the m × m polynomial matrix D(s) and the p × m polynomial matrix N (s) by −1 D(s) Bm [Λ(s) − Am S(s)], N (s) Cc S(s) + Dc D(s).

(6.61)

The following is the controllable version of the Structure Theorem. Theorem 6.19. H(s) = N (s)D−1 (s), where N (s) and D(s) are deﬁned in (6.61).

262

6 Controllability and Observability: Special Forms

Proof. First, note that (6.62) (sI − Ac )S(s) = Bc D(s). −1 ¯ ¯ To see this, we write Bc D(s) = Bc Bm Bm [Λ(s) − Am S(s)] = Bc Λ(s) − ¯c Am S(s) and (sI − Ac )S(s) = sS(s) − (A¯c + B ¯c Am )S(s) = (sI − A¯c )S(s) − B ¯ ¯ ¯ Bc Am S(s) = Bc Λ(s) − Bc Am S(s), which proves (6.62). Now H(s) = Cc (sI − Ac )−1 Bc + Dc = Cc S(s)D−1 (s) + Dc = [Cc S(s) + Dc D(s)]D−1 (s) = N D−1 . ⎡

⎤ ⎡ ⎤ 0 10 00 Example 6.20. Let Ac = ⎣ 2 −1 0 ⎦, Bc = ⎣ 1 1 ⎦, as in Example 6.17. Here 01 1 0 0 2 2 −1 0 11 s 0 , Bm = . Then Λ(s) = μ1 = 2, μ2 = 1 and Am = , 1 00 01 0 s ⎡ ⎤ 10 S(s) = ⎣ s 0 ⎦ and 01 2 1 −1 s 0 −s + 2 0 −1 − D(s) = Bm [Λ(s) − Am S(s)] = 0 1 0 s 1 0 2 2 1 −1 s +s−2 0 s + s − 1 −s = = . 0 1 −1 s −1 s Now Cc = [0, 1, 1], and Dc = [0, 0], N (s) = Cc S(s) + Dc D(s) = [s, 1], and

−1 1 s s s2 + s − 1 −s = [s, 1] 1 s2 + s − 1 s(s2 + s − 2) −1 s 1 = [s2 + 1, 2s2 + s − 1] s(s2 + s − 2)

H(s) = [s, 1]

= Cc (sI − Ac )−1 Bc + Dc . ⎡

⎤ ⎡ ⎤ 01 0 0 Example 6.21. Let Ac = ⎣ 0 0 1 ⎦, Bc = ⎣ 0 ⎦, Cc = [0, 1, 0], and Dc = 0 2 1 −2 1 (see Example 6.13). In the present case, we have Am = [2, 1, −2], Bm = 1, Λ(s) = s3 , S(s) = [1, s, s2 ]T , and D(s) = 1 · [s3 − [2, 1, −2][1, s, s2 ]T ] = s3 + 2s2 − s − 2,

N (s) = s.

Then H(s) = N (s)D−1 (s) = s/(s3 + 2s2 − s − 2) = Cc (sI − Ac )−1 Bc + Dc .

6.4 Controller and Observer Forms

263

6.4.2 Observer Forms Consider the system x˙ = Ax + Bu, y = Cx + Du given in (6.1) and assume that (A, C) is observable; i.e., rank O = n, where ⎤ ⎡ C ⎢ CA ⎥ ⎥ ⎢ (6.63) O=⎢ ⎥. .. ⎦ ⎣ . CAn−1 Also, assume that the p × n matrix C has a full row rank p; i.e., rank C = p ≤ n.

(6.64)

It is of interest to determine a transformation matrix P so that the equivalent system representation {Ao , Bo , Co , Do } with Ao = P AP −1 ,

Bo = P B,

Co = CP −1 ,

Do = D

(6.65)

will have (Ao , Co ) in an observer form (deﬁned below). As will become clear in the following discussion, these forms are dual to the controller forms previously discussed and can be derived by taking advantage of this fact. In particular, ( C T [(A, ( B) ( is controllable], and determine a nonsingular ( AT , B let A (c = P(A (P( −1 , B (c = P( B ( are in controller form given transformation P( so that A T (c and Co = B (cT is in observer form. in (6.54). Then Ao = A It will be demonstrated in the following discussion how to obtain observer forms directly, in a way that parallels the approach described for controller forms. This is done for the sake of completeness and to deﬁne the observability indices. The approach of using duality just given can be used in each case to verify the results. We ﬁrst note that if rank C = r < p, an approach analogous to the case when rank B < m can be followed, as in Subsection 6.4.1. The fact that the rows of C are not linearly independent means that the same information can be extracted from only r outputs, and therefore, the choice for the outputs should perhaps be reconsidered. Now if (A, C) is unobservable, one may use two steps to ﬁrst isolate the observable part and then reduce it to the observer form, in an analogous way to the uncontrollable case previously given. Single-Output Case (p = 1) Let

q , A˜ q , . . . , An−1 q˜], P −1 = Q [˜

where q˜ is the nth column in O

−1

. Then

(6.66)

264

6 Controllability and Observability: Special Forms

⎤ 0 · · · 0 −α0 ⎢ 1 · · · 0 −α1 ⎥ ⎥ ⎢ A0 = ⎢ . . . ⎥, .. ⎦ ⎣ .. . . .. . 0 · · · 1 −αn−1 ⎡

Co = [0, . . . , 0, 1],

(6.67)

where the αi denote the coeﬃcients of the characteristic polynomial α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 . Here Ao = P AP −1 = Q−1 AQ, Co = CP −1 = CQ, and the desired result can be established by using a proof that is completely analogous to the proof in determining the (dual) controller form presented in Subsection 6.4.1. Note that Bo = P B does not have any particular structure. The representation {Ao , Bo , Co , Do } will be referred to as the observer form of the system. Reversing the order of columns in P −1 given in (6.66) or selecting P to be exactly O, or to be equal to the matrix obtained after the order of the columns in O has been reversed, leads to alternative observer forms in a manner analogous to the controller form case. ⎡

⎤ −1 0 0 Example 6.22. Let A = ⎣ 0 1 0 ⎦ and C = [1, −1, 1]. To derive the ob0 0 −2 ( = C T , and ( = AT , B server form (6.67), we could use duality, by deﬁning A ( ( deriving the controller form of A, B, i.e., by following the procedure outlined ( B ( are exactly the matrices given in Examples 6.13 above. We note that the A, and 6.14. As an alternative approach, the observer form is now derived directly. In particular, we have ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ C 1 −1 1 1 −1/2 −1/2 O = ⎣ CA ⎦ = ⎣ −1 −1 −2 ⎦ , O−1 = ⎣ −1/3 −1/2 −1/6 ⎦ , CA2 1 −1 4 −1/3 0 1/3 and in view of (6.66), Q = P −1

⎡

⎤ −1/2 1/2 −1/2 = [˜ q , A˜ q , A2 q˜] = ⎣ −1/6 −1/6 −1/6 ⎦ . 1/3 −2/3 4/3

Note that q˜ = [−1/2, −1/6, 1/3]T , the last column of O−1 . Then ⎡ ⎤ 00 2 Ao = Q−1 AQ = ⎣ 1 0 1 ⎦ , and Co = CQ = [0, 0, 1], 0 1 −2 where |sI − A| = s⎤3 + 2s − s − 2 = s3 + α2 s2 + α1 s + α0 . Hence, QAo = ⎡ 1/2 −1/2 1/2 ⎣ −1/6 −1/6 −1/6 ⎦ = AQ. −2/3 4/3 −8/3

6.4 Controller and Observer Forms

265

Multi-Output Case (p > 1) Consider

⎡

c1 .. .

⎤

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ cp ⎥ ⎢ ⎤ ⎢ c A ⎥ ⎡ ⎥ C ⎢ 1 ⎥ ⎢ ⎥ . ⎢ CA ⎥ ⎢ .. ⎥ ⎥ ⎢ ⎢ ⎥, O=⎢ ⎥=⎢ .. ⎥ A c ⎦ ⎢ p ⎣ . ⎥ ⎢ ⎥ . n−1 .. CA ⎢ ⎥ ⎢ ⎥ ⎢ c1 An−1 ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ .

(6.68)

cp An−1 where c1 , . . . , cp denote the p rows of C, and select the ﬁrst n linearly independent rows in O, moving from the top to bottom (rank O = n). Next, reorder the selected rows by ﬁrst taking all rows involving c1 , then c2 , etc., to obtain ⎡ ⎤ c1 ⎢ c1 A ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎢ ⎥ . ⎢ ⎥ ⎢ c1 Aν1 −1 ⎥ ⎢ ⎥ ¯⎢ O (6.69) ⎥, .. ⎢ ⎥ . ⎢ ⎥ ⎢ cp ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ . νp −1 cp A an n × n matrix. The integer νi denotes the number of rows involving ci in the set of the ﬁrst n linearly independent rows found in O when moving from top to bottom. Deﬁnition 6.23. The p integers νi , i = 1, . . . , p, are the observability indices of the system, and ν max νi is called the observability index of the system. Note that p νi = n and pν ≥ n. (6.70) i=1

When rank C = p, then νi ≥ 1. Now deﬁne σ ˜k

k i=1

νi

k = 1, . . . , p;

(6.71)

266

6 Controllability and Observability: Special Forms

¯ −1 and let i.e., σ ˜1 = ν1 , σ ˜2 = ν1 + ν2 , . . . , σ ˜p = ν1 + · · · + νp = n. Consider O n q˜k ∈ R , k = 1, . . . , p, represent its σ ˜k th column; i.e.,

Deﬁne

¯ −1 = [× · · · × q˜1 | × · · · × q˜2 | · · · | × · · · × q˜p ]. O

(6.72)

P −1 = Q = [˜ q1 , . . . , Aν1 −1 q˜1 , . . . , q˜p , . . . , Aνp −1 q˜p ].

(6.73)

Then Ao = P AP ⎡

0···0 ⎢ Aii = ⎣ Iν −1 i

−1

⎤

=Q

−1

AQ and Co = CP

−1

= CQ are given by

Ao = [Aij ],

× .. ⎥ ∈ Rνi ×νi , . ⎦

i, j = 1, . . . , p, ⎡ ⎤ 0 ··· 0 × ⎢ .. .. ⎥ ∈ Rνi ×νj , i = j, Aij = ⎣ ... . .⎦

×

i = j,

0 ··· 0 × ⎡

and

0 ⎢ .. ⎢. ⎢ ⎢0 ⎢ Co = [C1 , C2 , . . . , Cp ], Ci = ⎢ ⎢0 ⎢0 ⎢ ⎢. ⎣ ..

··· 0 .. . ··· 0 ··· 0 ··· 0 .. .

0 ··· 0

⎤ 0 .. ⎥ . ⎥ ⎥ 0⎥ ⎥ p×νi 1⎥ , ⎥∈R ×⎥ ⎥ .. ⎥ . ⎦ ×

(6.74)

where the 1 in the last column of Ci occurs at the ith row location (i = 1, . . . , p) and × denotes nonﬁxed entries. Note that the matrix Bo = P B = Q−1 B does not have any particular structure. Equation (6.74) is a very useful form (in the observer problem) and shall be referred to as the observer form of the system. Analogous to (6.55), we express Ao and Co as Ao = A¯o + Ap C¯o ,

Co = Cp C¯o , ⎡ 0··· ⎢ ¯ where Ao = block diag[A1 , A2 , . . . , Ap ] with Ai = ⎣ Iν −1 i

(6.75) ⎤

0 .. ⎥ ∈ Rνi ×νi , C¯ = o .⎦

0 νi block diag([0, . . . , 0, 1]T ∈ R , i = 1, . . . , p), and Ap ∈ Rn×p , and Cp ∈ Rp×p p are appropriate matrices ( i=1 νi = n). Note that A¯o , C¯o are completely determined by the p observability indices νi , i = 1, . . . , p, and Ap and Cp contain this information in the σ ˜1 th, . . . , σ ˜p th columns of Ao and in the same columns of Co , respectively. ⎡

⎤ 00 0 010 Example 6.24. Given A = ⎣ 1 0 2 ⎦ and C = , we wish to reduce 110 0 1 −1 these to observer form. This can be accomplished using duality, i.e., by ﬁrst

6.4 Controller and Observer Forms

267

( AT , B ( C T to controller form. Note that A, ( B ( are the matrices reducing A used in Example 6.17, and therefore, the desired answer is easily obtained. Presently, we shall follow the direct algorithm described above. We have ⎡ ⎤ 01 0 ⎡ ⎤ ⎢1 1 0⎥ ⎢ ⎥ C ⎢1 0 2⎥ ⎢ ⎥. ⎣ ⎦ O = CA = ⎢ 1 0 2⎥ 2 ⎢ ⎥ CA ⎣ 0 2 −2 ⎦ 0 2 −2 Searching from top to bottom, the ﬁrst three c1 , c2 , c1 A, and ⎡ ⎤ ⎡ c1 01 ¯ = ⎣ c1 A ⎦ = ⎣ 1 0 O c2 11

linearly independent rows are ⎤ 0 2⎦. 0

Note that the observability indices are ν1 = 2, ν2 = 1 and σ ˜1 = 2, σ ˜2 = 3. We compute ⎡ ⎤ ⎡ ⎤ −1 0 1 × 0 1 ¯ −1 = ⎣ 1 0 0 ⎦ = ⎣× 0 0 ⎦. O 1/2 1/2 −1/2 × 1/2 −1/2 ⎡ ⎡ ⎤ ⎤ 0 0 1 112 1 0 ⎦ and Q−1 = ⎣ 0 1 0 ⎦. Therefore, q1 , q˜2 ] = ⎣ 0 Then, Q = [˜ q1 , A˜ 1/2 −1/2 −1/2 100 Ao = Q−1 AQ =

A11 A12 A21 A22

⎤ 0 21 . 010 = ⎣ 1 −1 0 ⎦ , Co = CQ = [C1 ..C2 ] = . 011 0 00 ⎡

We can also verify (6.47), namely ⎤ ⎤ ⎡ ⎡ ⎡ ⎤ 0 21 000 21 010 Ao = ⎣ 1 −1 0 ⎦ = A¯o + Ap C¯o = ⎣ 1 0 0 ⎦ + ⎣ −1 0 ⎦ 001 00 0 00 000

and Co =

010 10 010 . = Cp C¯o = 011 11 001

Structure Theorem—Observable Version The transfer function matrix H(s) of system x˙ = Ax + Bu, y = Cx + Du is given by H(s) = C(sI − A)−1 B + D. If (A, C) is in the observer form, given in (6.74), then H(s) can alternatively be characterized by the Structure

268

6 Controllability and Observability: Special Forms

Theorem stated in Theorem 6.25 below. This result will be very useful in the realization of systems, addressed in Chapter 8 and also in the study of observers in Chapter 9. Let A = Ao = A¯o + Ap C¯o and C = Co = Cp C¯o as in (6.75) with |Cp | = 0; let B = Bo and D = Do , and deﬁne ( diag[sν1 , sν2 , . . . , sνp ], S(s) ( Λ(s) block diag([1, s, . . . , sνi −1 ], i = 1, . . . , p). (6.76) p ( Note that S(s) is a p × n polynomial matrix, where n = i=1 νi . Now deﬁne ( ( (s) as the p × p polynomial matrix D(s) and the p × m polynomial matrix N −1 ( ( − S(s)A ( D(s) [Λ(s) p ]Cp ,

( (s) S(s)B ( ( N o + D(s)Do .

(6.77)

The following result is the observable version of the Structure Theorem. It is the dual of Theorem 6.19 and can therefore be proved using duality arguments. The proof given is direct. ( −1 (s)N ( (s), where N ( (s), D(s) ( Theorem 6.25. H(s) = D are deﬁned in (6.77). Proof. First we note that ( ( D(s)C o = S(s)(sI − Ao ).

(6.78)

−1 ¯ ¯ ( ( ( ¯ ( ( To see this, write D(s)C o = [Λ(s) − S(s)Ap ]Cp Cp Co = Λ(s)Co − S(s)Ap Co , ( ¯ ( ( ¯ ( ¯ and also, S(s)(sI − Ao ) = S(s)s − S(s)(Ao + Ap Co ) = S(s)(sI − Ao ) − ( ¯ ¯ ( ¯ ( S(s)A p Co = Λ(s)Co − S(s)Ap Co , which proves (6.78). We now obtain H(s) = −1 −1 ( ( ( −1 (s)[S(s)B ( ( Co (sI − Ao ) Bo + Do = D (s)S(s)B o + Do = D o + D(s)Do ] = −1 ( ( D (s)N (s).

⎡

⎤ 0 21 010 Example 6.26. Consider Ao = ⎣ 1 −1 0 ⎦ and Co = of Exam011 0 00 2 s 0 1s0 ( ( ple 6.24. Here ν1 = 2, ν2 = 1, Λ(s) = , and S(s) = . Then 0 s ⎡ ⎤⎤0 0 1 ⎡ −1 2 21 10 s 0 1s0 ⎣ −1 ( ( ( ⎦ ⎦ ⎣ −1 0 D(s) = [Λ(s) − S(s)Ap ]Cp = . = − 11 0 s 001 0 0 ⎡⎡ ⎤ ⎡ ⎤⎤ ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ s2 0 ⎦ ⎣ −s + 2 1 ⎦ ⎦ ⎣ 1 0 ⎦ ⎣ s2 + s − 2, −1 ⎦ ⎣ 1 0 ⎦ ⎣ s2 + s − 1 −1 ⎦ ⎣⎣ . − · = · = 0 s 0 0 −1 1 0 s −1 1 −s s T ( (s) = S(s)B ( ( Now if Bo = [0, 1, 1]T , Do = 0, and N o + D(s)Do = [s, 1] , then 1 −1 2 2 T −1 ( (s)N ( (s) = 2 H(s) = D [s +1, 2s +s−1] = Co (sI −Ao ) Bo +Do . s(s +s−2)

6.5 Summary and Highlights

269

6.5 Summary and Highlights •

The standard form for uncontrollable systems is A1 A12 B1 −1 −1 % % A = Q AQ = , , B=Q B= 0 A2 0

(6.6)

where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and (A1 , B1 ) is controllable. nr < n is the rank of the controllability matrix C = [B, AB, . . . , An−1 B]; i.e., rank C = nr . •

The standard form for unobservable systems is % = Q−1 AQ = A1 0 , C % = CQ = C1 , A A21 A2 0

(6.15)

where A1 ∈ Rno ×no , C1 ∈ Rp×no , and (A1 , C1 ) is observable. no < n is the rank of the observability matrix ⎡ % ⎤ C ⎢ C %A % ⎥ ⎢ ⎥ O=⎢ ⎥; .. ⎣ ⎦ . n−1 % % CA i.e., rank O = no . •

•

Kalman’s Decomposition Theorem. ⎤ ⎡ A11 0 A13 0 ⎥ ⎢ % = Q−1 AQ = ⎢ A21 A22 A23 A24 ⎥ , A ⎣ 0 0 A33 0 ⎦ 0 0 A43 A44 % = CQ = [C1 , 0, C3 , 0], C

⎤ B1 ⎢ ⎥ % = Q−1 B = ⎢ B2 ⎥ , B ⎣ 0 ⎦ 0

(6.20)

where (A11 , B1 , C1 ) is controllable and observable. λi is an uncontrollable eigenvalue if and only if vˆi [λi I − A, B] = 0,

•

⎡

where vˆi is the corresponding (left) eigenvector. λi is an unobservable eigenvalue if and only if λi I − A vi = 0, C where vi is the corresponding (right) eigenvector.

(6.23)

(6.24)

270

6 Controllability and Observability: Special Forms

Controller Forms (for Controllable Systems) •

m = 1 case. ⎡

0 1 ⎢ .. .. ⎢ . Ac = ⎢ . ⎣ 0 0 −α0 −α1

⎤ ··· 0 ⎥ .. .. ⎥ . . ⎥, ··· 1 ⎦ · · · −αn−1

⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Bc = ⎢ . ⎥ , ⎣0⎦ 1

(6.36)

where α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 . •

(6.37)

m > 1 case. Ac = [Aij ], i, j = 1, . . . , m, ⎡ ⎡ ⎤ 0 0 ··· ⎢ .. ⎢ .. ⎥ .. ⎢ ⎢ ⎥ . Aii = ⎢ . Iμi −1 ⎥ ∈ Rμi ×μi , i = j, Aij = ⎢ . ⎣0 ⎣ 0 ··· ⎦ × ×··· × ×···×

⎤ 0 .. ⎥ .⎥ ⎥ ∈ Rμi ×μj , i = j, 0⎦ ×

and ⎡

B1 ⎢ B2 ⎢ Bc = ⎢ . ⎣ .. Bm

⎤ ⎥ ⎥ ⎥, ⎦

⎡

0 ··· ⎢ .. Bi = ⎣ .

0 .. .

0 ··· .. .

⎤ 0 .. ⎥ ∈ Rμi ×m . .⎦

(6.54)

0 ··· 0 1 ×··· ×

An example for n = 4, m = 2 and μ1 = 2, μ2 = 2 is ⎤ ⎡ ⎡ ⎤ 0 1 0 0 0 0 ⎢× × × ×⎥ ⎢ ⎥ A11 A12 ⎥ , Bc = B1 = ⎢ 1 × ⎥ . Ac = =⎢ ⎦ ⎣ ⎣ A21 A22 B2 0 0 0 1 0 0⎦ ×××× 0 1 • •

¯c Am , Ac = A¯c + B

¯c Bm . Bc = B

(6.55)

Structure theorem—controllable version H(s) = N (s)D−1 (s), where −1 [Λ(s) − Am S(s)], N (s) = Cc S(s) + Dc D(s). D(s) = Bm

(6.61)

Note that (sI − Ac )S(s) = Bc D(s).

(6.62)

6.6 Notes

271

Observer Forms (for Observable Systems) •

p = 1 case. ⎤ 0 · · · 0 −α0 ⎢ 1 · · · 0 −α1 ⎥ ⎥ ⎢ A0 = ⎢ . . . ⎥, .. ⎦ ⎣ .. . . .. . 0 · · · 1 −αn−1 ⎡

•

Co = [0, . . . , 0, 1].

(6.67)

p > 1. i, j = 1, . . . , p, ⎡ ⎤ 0···0 × 0 ··· 0 × ⎥ ⎢ ⎢ .. .. ⎥ ∈ Rνi ×νj , i = j, Aii = ⎣ Iν −1 ... ⎦ ∈ Rνi ×νi , i = j, Aij = ⎣ ... . .⎦ i × 0 ··· 0 × and ⎡ ⎤ 0 ··· 0 0 ⎢ .. .. .. ⎥ ⎢. . .⎥ ⎢ ⎥ ⎢0 ··· 0 0 ⎥ ⎢ ⎥ p×νi ⎥ Co = [C1 , C2 , . . . , Cp ], Ci = ⎢ , (6.74) ⎢0 ··· 0 1 ⎥ ∈ R ⎢0 ··· 0 ×⎥ ⎢ ⎥ ⎢. .. .. ⎥ ⎣ .. . .⎦ ⎡

⎤

Ao = [Aij ],

0 ··· 0 × If (Ac , Bc ) is in controller form, (Ao = ATc , Co = BcT ) will be in observer form. • •

Ao = A¯o + Ap C¯o ,

Co = Cp C¯o .

(6.75)

Structure theorem—observable version ( (s), where ( −1 (s)N H(s) = D −1 ( ( − S(s)A ( D(s) = [Λ(s) p ]Cp ,

Note that

( (s) = S(s)B ( ( N o + D(s)Do .

( ( D(s)C o = S(s)(sI − Ao ).

(6.77)

(6.78)

6.6 Notes Special state-space forms for controllable and observable systems obtained by similarity transformations are discussed at length in Kailath [5]. Wolovich [13] discusses the algorithms for controller and observer forms and introduces the Structure Theorems. The controller form is based on results by Luenberger [9]

272

6 Controllability and Observability: Special Forms

(see also Popov [10]). A detailed derivation of the controller form can also be found in Rugh [12]. Original sources for the Canonical Structure Theorem include Kalman [6] and Gilbert [3]. The eigenvector and rank tests for controllability and observability are called PBH tests in Kailath [5]. Original sources for these include Popov [10], Belevich [2], and Hautus [4]. Consult also Rosenbrock [11], and for the case when A can be diagonalized via a similarity transformation, see Gilbert [3]. Note that in the eigenvalue/eigenvector tests presented herein the uncontrollable (unobservable) eigenvalues are also explicitly identiﬁed, which represents a modiﬁcation of the above original results. The fact that the controllability indices appear in the work of Kronecker was recognized by Rosenbrock [11] and Kalman [8]. For an extensive introductory discussion and a formal deﬁnition of canonical forms, see Kailath [5].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. V. Belevich, Classical Network Theory, Holden-Day, San Francisco, CA, 1968. 3. E. Gilbert, “Controllability and observability in multivariable control systems,” SIAM J. Control, Vol. 1, pp. 128–151, 1963. 4. M.L.J. Hautus, “Controllability and observability conditions of linear autonomous systems,” Proc. Koninklijke Akademie van Wetenschappen, Serie A, Vol. 72, pp. 443–448, 1969. 5. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 6. R.E. Kalman, “Mathematical descriptions of linear systems,” SIAM J. Control, Vol. 1, pp. 152–192, 1963. 7. R.E. Kalman, “On the computation of the reachable/observable canonical form,” SIAM J. Control Optimization, Vol. 20, no. 2, pp. 258–260, 1982. 8. R.E. Kalman, “Kronecker invariants and feedback,” in Ordinary Diﬀerential Equations, L. Weiss, ed., pp. 459–471, Academic Press, New York, NY, 1972. 9. D.G. Luenberger, “Canonical forms for linear multivariable systems,” IEEE Trans. Auto. Control, Vol. 12, pp. 290–293, 1967. 10. V.M. Popov, “Invariant description of linear, time-invariant controllable systems,” SIAM J. Control Optimization, Vol. 10, No. 2, pp. 252–264, 1972. 11. H.H. Rosenbrock, State-Space and Multivariable Theory, Wiley, New York, NY, 1970. 12. W.J. Rugh, Linear System Theory, Second Ed., Prentice-Hall, Englewood Cliﬀs, NJ, 1996. 13. W.A. Wolovich, Linear Multivariable Systems, Springer-Verlag, New York, NY, 1974.

Exercises 6.1. Write software programs to implement the algorithms of Section 6.2. In particular:

Exercises

273

(a) Given the pair (A, B), where A ∈ Rn×n , B ∈ Rn×m with rank[B, AB, . . . , An−1 B] = nr < n, reduce this pair to the standard uncontrollable form A1 A12 B1 −1 % % A = P AP = , ,B = PB = 0 A2 0 where (A1 , B1 ) is controllable and A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m . (b) Given the controllable pair (A, B), where A ∈ Rn×n , B ∈ Rn×m with rank B = m, reduce this pair to the controller form Ac = P AP −1 , Bc = P B. 6.2. Determine the uncontrollable modes of each pair (A, B) given below by (a) Reducing (A, B), using a similarity transformation. (b) Using eigenvalue/eigenvector criteria: ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ 001 0 1 00 10 ⎢0 0 1 0⎥ ⎥ A = ⎣ 0 −1 0 ⎦ , B = ⎣ 0 1 ⎦ and A = ⎢ ⎣0 0 0 0⎦, 0 02 00 0 0 0 −1

⎡

⎤ 01 ⎢0 0⎥ ⎥ B=⎢ ⎣1 0⎦. 00

6.3. Reduce the pair ⎡

⎤ 00 1 0 ⎢ 3 0 −3 1 ⎥ ⎥ A=⎢ ⎣ −1 1 4 −1 ⎦ , 1 0 −1 0

⎡

0 ⎢1 B=⎢ ⎣0 0

⎤ 0 0⎥ ⎥ 1⎦ 0

into controller form Ac = P AP −1 , Bc = P B. What is the similarity transformation matrix in this case? What are the controllability indices? 6.4. Consider

⎡

0 1 ⎢ .. .. ⎢ . Ac = ⎢ . ⎣ 0 0 −α0 −α1 Show that

⎤ ··· 0 ⎥ .. .. ⎥ . . ⎥, ··· 1 ⎦ · · · −αn−1 ⎡

0 ⎢0 ⎢ ⎢ .. ⎢ n−1 C = [Bc , Ac Bc , . . . , Ac Bc ] = ⎢ . ⎢0 ⎢ ⎣0 1

⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Bc = ⎢ . ⎥ . ⎣0⎦ 1

0 0 .. .

0 ··· 0 ··· .. .

1 c1 .. .

⎤

⎥ ⎥ ⎥ ⎥ ⎥, 0 1 · · · cn−3 ⎥ ⎥ 1 c1 · · · cn−2 ⎦ c1 c2 · · · cn−1

274

6 Controllability and Observability: Special Forms

where ck = − that

k−1 i=0

αn−i−1 ck−i−1 , k = 1, . . . , n − 1, with c0 = 1. Also, show ⎤ ⎡ α1 α2 · · · αn−1 1 ⎢ α2 α3 · · · 1 0 ⎥ ⎥ ⎢ ⎢ .. .. .. ⎥ . −1 C = ⎢ ... . . .⎥ ⎥ ⎢ ⎣ αn−1 1 · · · 0 0 ⎦ 1 0 ··· 0 0

6.5. Show that the matrices Ac = P AP −1 , Bc = P B are as follows: (a) Given by (6.41) if P is given by (6.42). (b) Given by (6.44) if Q(= P −1 ) is given by (6.43). (c) Given by (6.46) if Q(= P −1 ) is given by (6.45). 6.6. Consider the pair (A, b), where A ∈ Rn×n , b ∈ Rn . Show that if more than one linearly independent eigenvector can be associated with a single eigenvalue, then (A, b) is uncontrollable. Hint: Use the eigenvector test. Let vˆ1 , vˆ2 be linearly independent left eigenvectors associated with eigenvalue λ1 = λ2 = λ. Notice that if vˆ1 b = α1 and vˆ2 b = α2 , then (α1 vˆ1 − α1 vˆ2 )b = 0. 6.7. Show that if (A, B) is controllable, where A ∈ Rn×n , and B ∈ Rn×m , and rank B = m, then rank A ≥ n − m. 6.8. Given A ∈ Rn×n , and B ∈ Rn×m , let rank C = n, where C = % ∈ Rn×n , B % ∈ Rn×m with rank C% = n, where [B, AB, . . . , An−1 B]. Consider A n−1 % % % % % % C = [B, AB, . . . , A B], and assume that P ∈ Rn×n with det P = 0 exists such that % %A %n B]. P [C, An B] = [C, % = P B and A % = P AP −1 . Hint: Show that (P A − AP % )C = 0. Show that B ¯c Am and B = B ¯c Bm , where the A¯c , B ¯c are as in (6.55) 6.9. Let A = A¯c + B with Am ∈ Rm×n , Bm ∈ Rm×m , and |Bm | = 0. Show that (A, B) is controllable with controllability indices μi . Hint: Use the eigenvalue test to show that (A, B) is controllable. Use state feedback to simplify (A, B) (see Exercise 6.11), and show that the μi are the controllability indices. 6.10. Show that the controllability indices of the state equation x˙ = Ax + BGv, where |G| = 0 and (A, B) is controllable, with A ∈ Rn×n , B ∈ Rn×m , are the same as the controllability indices of x˙ = Ax + Bu, within reordering. Hint: Write C¯k = [BG, ABG, . . . , Ak−1 BG] = [B, AB, . . . , Ak−1 B] · [block diag G] = Ck · [block diag G] and show that the number of linearly dependent columns in Ak BG that occur while searching from left to right in C¯n is the same as the corresponding number in Cn . 6.11. Consider the state equation x˙ = Ax + Bu, where A ∈ Rn×n , B ∈ Rn×m with (A, B) controllable. Let the linear state-feedback control law be u = F x + Gv, F ∈ Rm×n , G ∈ Rm×m with |G| = 0. Show that

Exercises

275

(a) (A + BF, BG) is controllable. (b) The controllability indices of (A + BF, B) are identical to those of (A, B). (c) The controllability indices of (A+BF, BG) are equal to the controllability indices of (A, B) within reordering. Hint: Use the eigenvalue test to show (a). To show (b), use the controller forms in Section 6.4. 6.12. For the system x˙ = Ax + Bu, y = Cx, consider the corresponding ¯x(k) + B ¯u sampled-data system x ¯(k + 1) = A¯ ¯(k), y¯(k) = C¯ x ¯(k), where

AT ¯ ¯ A = e ,B = [

T

eAτ dτ ]B,

and C¯ = C.

0

(a) Let the continuous-time system {A, B, C} be controllable (observable), ¯ B, ¯ C} ¯ is controllable (oband assume it is a SISO system. Show that {A, servable) if and only if the sampling period T is such that Im (λi − λj ) =

2πk , where k = ±1, ±2, . . . whenever Re (λi − λj ) = 0, T

where {λi } are the eigenvalues of A. Hint: Use the PBH test. (b) Apply the results of (a) (Example 3.33 in Chap to the double integrator 01 0 ter 3), where A = , B = , and C = [1, 0], and also to 1 0 0 01 0 A = , B = , C = [1, 0]. Determine the values of T that −1 0 1 preserve controllability (observability). 6.13. (Spring mass system) Consider the spring mass given in Exercise 3.37. (a) Is the system controllable from [f1 , f2 ]T ? If yes, reduce (A, B) to controller form. (b) Is the system controllable from input f1 only? Is it controllable from f2 only? Discuss your answers. 1000 (c) Let y = Cx with C = . Is the system observable from y? If yes, 0100 reduce (A, C) to observer form.

6 Controllability and Observability: Special Forms

6.1 Introduction In this chapter, important special forms for the state-space description of time-invariant systems are presented. These forms are obtained by means of similarity transformations and are designed to reveal those features of a system that are related to the properties of controllability and observability. In Section 6.2, special state-space forms that separate the controllable (observable) from the uncontrollable (unobservable) part of a system are presented. These forms, referred to as the standard forms for uncontrollable and unobservable systems, are very useful in establishing a number of results. In particular, these forms are used in Section 6.3 to derive alternative tests for controllability and observability and in Section 7.2 to relate state-space and input–output descriptions. In Section 6.4 the controller and observer state-space forms are introduced. These are useful in the study of state-space realizations in Chapter 8 and state feedback and state estimators in Chapter 9.

6.2 Standard Forms for Uncontrollable and Unobservable Systems We consider time-invariant systems described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(6.1)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . It was shown in the previous chapter that this system is state reachable if and only if the n × mn controllability matrix (6.2) C [B, AB, . . . , An−1 B] has full row rank n; i.e., rank C = n. If the system is reachable (or controllablefrom-the-origin), then it is also controllable (or controllable-to-the-origin), and vice versa (see Section 5.3.1).

238

6 Controllability and Observability: Special Forms

It was also shown earlier that system (6.1) is state observable if and only if the pn × n observability matrix ⎤ ⎡ C ⎢ CA ⎥ ⎥ ⎢ (6.3) O⎢ ⎥ .. ⎦ ⎣ . CAn−1 has full column rank; i.e., rank O = n. If the system is observable, then it is also constructible, and vice versa (see Section 5.4.1). Similar results were also derived for discrete-time time-invariant systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k).

(6.4)

Again, rank C = n and rank O = n are the necessary and suﬃcient conditions for state reachability and observability, respectively. Reachability always implies controllability and observability always implies constructibility, as in the continuous-time case. However, in the discrete-time case, controllability does not necessarily imply reachability and constructibility does not imply observability, unless A is nonsingular (see Sections 5.3.2 and 5.4.2). Next, we will introduce standard forms for unreachable and unobservable systems both for the continuous-time and the discrete-time time-invariant cases. These forms will be referred to as standard forms for uncontrollable systems, rather than unreachable systems, and standard forms for unobservable systems, respectively. 6.2.1 Standard Form for Uncontrollable Systems If the system (6.1) [or (6.4)] is not completely reachable or controllable-fromthe-origin, then it is possible to “separate” the controllable part of the system by means of an appropriate similarity transformation. This amounts to changing the basis of the state space so that all the vectors in the reachable subspace Rr have a certain structure. In particular, let rank C = nr < n; i.e., the pair (A, B) is not controllable. This implies that the subspace Rr = R(C) has dimension nr . Let {v1 , v2 , . . . , vnr } be a basis for Rr . These nr vectors can be, for example, any nr linearly independent columns of C. Deﬁne the n × n similarity transformation matrix Q [v1 , v2 , . . . , vnr , Qn−nr ],

(6.5)

where the n × (n − nr ) matrix Qn−nr contains n − nr linearly independent vectors chosen so that Q is nonsingular. There are many such choices. We are now in a position to prove the following result.

6.2 Standard Forms for Uncontrollable and Unobservable Systems

239

Lemma 6.1. For (A, B) uncontrollable, there exists a nonsingular matrix Q such that % = Q−1 AQ = A1 A12 % = Q−1 B = B1 , A (6.6) and B 0 A2 0 where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and the pair (A1 , B1 ) is controllable. The % B) % is in the standard form for uncontrollable systems. pair (A, Proof. We need to show that

A1 A12 AQ = A[v1 , . . . , vnr , Qn−nr ] = [v1 , . . . , vnr , Qn−nr ] 0 A2

% = QA.

Since the subspace Rr is A-invariant (see Lemma 5.19), Avi ∈ Rr , which can be written as a linear combination of only the nr vectors in a basis of Rr . % is an nr × nr matrix, and the (n − nr ) × nr matrix below it in Thus, A1 in A % A is a zero matrix. Similarly, we also need to show that B1 % B = [v1 , . . . , vnr , Qn−nr ] = QB. 0 But this is true for similar reasons: The columns of B are in the range of C or in Rr . % B) % is The n × nm controllability matrix C% of (A, n−1 % A %B, % ...,A %n−1 B] % = B1 A1 B1 · · · A1 B1 , C% = [B, 0 0 ··· 0

(6.7)

% = rank[B1 , A1 B1 , . . . , Anr −1 B1 , . . . , An−1 B1 ] = nr . which clearly has rank C 1 1 Note that C% = Q−1 C. (6.8) % B). % It contains vectors only The range of C% is the controllable subspace of (A, T T nr % = rank C% = nr , every of the form [α , 0] , where α ∈ R . Since dim R(C) vector of the form [αT , 0]T is a controllable (state) vector. In other words, the similarity transformation has changed the basis of Rn in such a manner so that all controllable vectors, expressed in terms of this new basis, have this very particular structure with zeros in the last n − nr entries. Given system (6.1) [or (6.4)], if a new state x ˆ(t) is taken to be x ˆ(t) = Q−1 x(t), then %x + Bu, % %xˆ + Du, % x ˆ˙ = Aˆ y=C (6.9) % = Q−1 B, C % = CQ, and D % = D constitutes an equiva% = Q−1 AQ, B where A lent representation (see Section 3.4.3). For Q as in Lemma 6.1, we obtain x ˆ x ˆ˙ 1 A1 A12 xˆ1 B1 u, y = [C1 , C2 ] 1 + Du, = + (6.10) ˙x 0 A x ˆ 0 x ˆ ˆ2 2 2 2

240

6 Controllability and Observability: Special Forms

where x ˆ = [ˆ xT1 , x ˆT2 ]T with x ˆ1 ∈ Rnr and where (A1 , B1 ) is controllable. The % = [C1 , C2 ] does not have any particular structure. This representamatrix C tion is called a standard form for the uncontrollable system. The state equation can now be written as xˆ˙ 1 = A1 x ˆ1 + B1 u + A12 x ˆ2 , x ˆ˙ 2 = A2 x ˆ2 ,

(6.11)

which shows that the input u does not aﬀect the trajectory component xˆ2 (t) at all, and therefore, x ˆ2 (t) is determined only by the value of its initial vector. The input u certainly aﬀects x ˆ1 (t). Note also that the trajectory component x ˆ1 (t) is also inﬂuenced by xˆ2 (t). In fact, t

t A1 t A1 (t−τ ) A1 (t−τ ) A2 τ xˆ1 (t) = e x ˆ1 (0) + e B1 u(τ )dτ + e A12 e dτ xˆ2 (0). 0

0

(6.12) The nr eigenvalues of A1 and the corresponding modes are the controllable eigenvalues and controllable modes of the pair (A, B) or of system (6.1) [or of (6.4)]. The n − nr eigenvalues of A2 and the corresponding modes are the uncontrollable eigenvalues and uncontrollable modes, respectively. It is interesting to observe that in the zero-state response of the system (zero initial conditions), the uncontrollable modes are completely absent. In t particular, in the solution x(t) = eAt x(0)+ 0 eA(t−τ ) Bu(τ )dτ of x˙ = Ax+Bu, given x(0), notice that A (t−τ ) 1 % B1 % =Q e eA(t−τ ) B = [QeA(t−τ ) Q−1 ][QB] , 0 where A1 [from (6.6)] contains only the controllable eigenvalues. Therefore, the input u(t) cannot directly inﬂuence the uncontrollable modes. Note, however, that the uncontrollable modes do appear in the zero-input response eAt x(0). The same observations can be made for discrete-time systems (6.4) where the quantity Ak B is of interest. ⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.2. Given A = ⎣ 1 −2 1 ⎦ and B = ⎣ 1 1 ⎦, we wish to reduce 0 1 −1 12 system (6.1) to the standard form (6.6). Here ⎤ ⎡ 1 0 0 1 0 −1 C = [B, AB, A2 B] = ⎣ 1 1 0 0 0 0 ⎦ 1 2 0 −1 0 1 and rank C = nr = 2 < 3 = n. Thus, the subspace Rr = R(C) has dimension nr = 2, and a basis {v1 , v2 } can be found by taking two linearly independent columns of C, say, the ﬁrst two, to obtain

6.2 Standard Forms for Uncontrollable and Unobservable Systems

⎡

241

⎤

100 Q = [v1 , v2 , Q1 ] = ⎣ 1 1 0 ⎦ . 121 The third column of Q was selected so that Q is nonsingular. Note that the ﬁrst two columns of Q could have been the ﬁrst and fourth columns of C instead, or any other two linearly independent vectors obtained as a linear combination of the columns in C. For the above choice for Q, we have ⎡ ⎤⎡ ⎤⎡ ⎤ 1 00 0 −1 1 100 % = Q−1 AQ = ⎣ −1 1 0 ⎦ ⎣ 1 −2 1 ⎦ ⎣ 1 1 0 ⎦ A 1 −2 1 0 1 −1 121 ⎡ ⎤⎡ ⎤ 0 −1 1 100 = ⎣ 1 −1 0 ⎦ ⎣ 1 1 0 ⎦ −2 4 −2 121 ⎤ ⎡ 0 1 1 A1 A12 , = ⎣ 0 −1 0 ⎦ = 0 A2 0 0 −2 ⎡ ⎤⎡ ⎤ ⎡ ⎤ 10 1 00 10 % = Q−1 B = ⎣ −1 1 0 ⎦ ⎣ 1 1 ⎦ = ⎣ 0 1 ⎦ = B1 , B 0 1 −2 1 12 00 where (A1 , B1 ) is controllable. The matrix A has three eigenvalues at 0, −1, % B) % that the eigenvalues 0, −1 are controllable (in and −2. It is clear from (A, A1 ), whereas −2 is an uncontrollable eigenvalue (in A2 ).

6.2.2 Standard Form for Unobservable Systems The standard form for an unobservable system can be derived in a similar way as the standard form of uncontrollable systems. If the system (6.1) [or (6.4)] is not completely state observable, then it is possible to “separate” the unobservable part of the system by means of a similarity transformation. This amounts to changing the basis of the state space so that all the vectors in the unobservable subspace Ro¯ have a certain structure. As in the preceding discussion concerning systems or pairs (A, B) that are not completely controllable, we shall select a similarity transformation Q to reduce a pair (A, C), which is not completely observable, to a particular form. This can be accomplished in two ways. The simplest way is to invoke duality and to work with the pair (AD = AT , BD = C T ), which is not controllable (refer to the discussion of dual systems in Section 5.2.3). If Lemma 6.1 is applied, then AD1 AD12 BD1 −1 −1 % % AD = QD AD QD = , , BD = QD BD = 0 AD2 0 where (AD1 , BD1 ) is controllable.

242

6 Controllability and Observability: Special Forms

% C), % which has the desired Taking the dual again, we obtain the pair (A, properties. In particular, T %=A %T = QT AT (QT )−1 = QT A(QT )−1 = ATD1 0T A , D D D D D D AD12 AD2 (6.13) T T T −1 T −1 T % % C = BD = BD (QD ) = C(QD ) = [BD1 , 0], T where (ATD1 , BD1 ) is completely observable by duality (see Lemma 5.7).

⎡

⎤ 0 1 0 111 Example 6.3. Given A = ⎣ −1 −2 1 ⎦ and C = , we wish to reduce 012 1 1 −1 system (6.1) to the standard form (6.13). To accomplish this, let AD = AT and BD = C T . Notice that the pair (AD , BD ) is precisely the pair (A, B) of Example 6.2. A pair (A, C) can of course also be reduced directly to the standard form for unobservable systems. This is accomplished in the following. Consider the system (6.1) [or (6.4)] and the observability matrix O in (6.3). Let rank O = no < n; i.e., the pair (A, C) is not completely observable. This implies that the unobservable subspace Ro¯ = N (O) has dimension n − no . Let {v1 , . . . , vn−no } be a basis for Ro¯, and deﬁne an n×n similarity transformation matrix Q as (6.14) Q [Qno , v1 , . . . , vn−no ], where the n × no matrix Qno contains no linearly independent vectors chosen so that Q is nonsingular. Clearly, there are many such choices. Lemma 6.4. For (A, C) unobservable, there is a nonsingular matrix Q such that A1 0 −1 % % = CQ = [C1 , 0], A = Q AQ = (6.15) and C A21 A2 where A1 ∈ Rno ×no , C1 ∈ Rp×no , and the pair (A1 , C1 ) is observable. The % C) % is in the standard form for unobservable systems. pair (A, Proof. We need to show that

A1 0 AQ = A[Qn0 , v1 , . . . , vn−no ] = [Qno , v1 , . . . , vn−no ] A21 A2

% = QA.

Since the unobservable subspace Ro¯ is A-invariant (see Lemma 5.49), Avi ∈ Ro¯, which can be written as a linear combination of only the n − no vectors % is an (n − no ) × (n − no ) matrix, and the in a basis of Ro¯. Thus, A2 in A % is a zero matrix. Similarly, we also need no × (n − no ) matrix above it in A to show that % CQ = C[Qno , v1 , . . . , vn−no ] = [C1 , 0] = C. This is true since Cvi = 0.

6.2 Standard Forms for Uncontrollable and Unobservable Systems

243

% of (A, % C) % is The pn × n observability matrix O % ⎤ ⎡ C1 C ⎢ C %A % ⎥ ⎢ C1 A1 ⎥ ⎢ %=⎢ O ⎥=⎢ ⎢ .. .. ⎦ ⎣ ⎣ . . n−1 % % C1 An−1 CA 1 ⎡

⎤ 0 0⎥ ⎥ .. ⎥ , .⎦

(6.16)

0

which clearly has ⎡

C1 C1 A1 .. .

⎤

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ % rank O = rank ⎢ no −1 ⎥ = no . ⎢ C1 A1 ⎥ ⎢ ⎥ .. ⎣ ⎦ . C1 An−1 1 Note that

% = OQ. O

(6.17)

% is the unobservable subspace of (A, % C). % It contains vectors The null space of O T T n−n0 % = n − rank O %= . Since dim N (O) only of the form [0, α ] , where α ∈ R T T n − n0 , every vector of the form [0, α ] is an unobservable (state) vector. In other words, the similarity transformation has changed the basis of Rn in such a manner so that all unobservable vectors expressed in terms of this new basis have this very particular structure—zeros in the ﬁrst no entries. For Q chosen as in Lemma 6.4, x ˆ A1 0 x ˆ1 B1 x ˆ˙ 1 = + u, y = [C1 , 0] 1 + Du, (6.18) x ˆ2 B2 x ˆ2 A21 A2 x ˆ˙ 2 where x ˆ = [ˆ xT1 , xˆT2 ]T with x ˆ1 ∈ Rno and (A1 , C1 ) is observable. The matrix T T T % = [B1 , B2 ] does not have any particular form. This representation is B called a standard form for the unobservable system. The no eigenvalues of A1 and the corresponding modes are called observable eigenvalues and observable modes of the pair (A, C) or of the system (6.1) [or of (6.4)]. The n − no eigenvalues of A2 and the corresponding modes are called unobservable eigenvalues and unobservable modes, respectively. Notice that the trajectory component xˆ(t), which is observed via the output y, is not inﬂuenced at all by x ˆ2 , the trajectory of which is determined primarily by the eigenvalues of A2 . The unobservable modes of the system are completely absent from the output. In particular, given x˙ = Ax + Bu, y = Cx with initial state x(0), we have

t CeA(t−τ ) Bu(τ )dτ y(t) = CeAt x(0) + 0

244

6 Controllability and Observability: Special Forms

% % −1 ][QeAt and CeAt = [CQ Q−1 ] = [C1 eA1 t , 0]Q−1 , where A1 [from (6.15)] contains only the observable eigenvalues. Therefore, the unobservable modes cannot be seen by observing the output. The same observations can be made for discrete-time systems where the quantity CAk is of interest.

0 1 and C = [1, 1], we wish to reduce −2 −3 system form (6.15). To accomplish this, we compute (6.1) to the standard C 1 1 O = = , which has rank O = no = 1 < 2 = n. Therefore, CA −2 −2 the unobservable subspace Ro¯ = N (O) has dimension n − no = 1. In view of (6.14), 0 1 Q = [Q1 , v1 ] = , 1 −1 Example 6.5. Given A =

where v1 = [1, −1]T is a basis for Ro¯, and Q1 was chosen so that Q is nonsingular. Then 11 0 1 0 1 −1 % A = Q AQ = 10 −2 −3 1 −1 −2 0 A1 0 = = , A21 A2 1 −1 % = CQ = [1, 1] 0 1 = [1, 0] = [C1 , 0], C 1 −1 where (A1 , C1 ) is observable. The matrix A has two eigenvalues at −1, −2. It % C) % that the eigenvalue −2 is observable (in A1 ), whereas −1 is clear from (A, is an unobservable eigenvalue (in A2 ).

6.2.3 Kalman’s Decomposition Theorem Lemmas 6.1 and 6.4 can be combined to obtain an equivalent representation of (6.1) where the reachable and observable parts of this system can readily be identiﬁed. We consider system (6.9) and proceed, in the following, to construct the n × n required similarity transformation matrix Q. As before, we let nr denote the dimension of the controllable subspace Rr ; i.e., nr = dim Rr = dim R(C) = rank C. The dimension of the unobservable subspace Ro¯ = N (O) is given by no¯ = n − rank O = n − no . Let nr¯o be the dimension of the subspace Rr¯o Rr ∩ Ro¯, which contains all the state vectors x ∈ Rn that are controllable but unobservable. We choose Q [v1 , . . . , vnr −nro¯+1 , . . . , vnr , QN , vˆ1 , . . . , vˆno¯−nro¯ ],

(6.19)

where the nr vectors in {v1 , . . . , vnr } form a basis for Rr . The last nr¯o vectors {vnr −nro¯+1 , . . . , vnr } in the basis for Rr are chosen so that they form a basis

6.2 Standard Forms for Uncontrollable and Unobservable Systems

245

for Rr¯o = Rr ∩ Ro¯. The no¯ − nr¯o = (n − no − nr¯o ) vectors {ˆ v1 , . . . , vˆno¯ −nro¯ } are selected so that when taken together with the nr¯o vectors {vnr −nro¯+1 , . . . , vnr } they form a basis for Ro¯, the unobservable subspace. The remaining N = n−(nr +no¯ −nr¯o ) columns in QN are simply selected so that Q is nonsingular. The following theorem is called the Canonical Structure Theorem or Kalman’s Decomposition Theorem. Theorem 6.6. For (A, B) uncontrollable and (A, C) unobservable, there is a nonsingular matrix Q such that ⎡ ⎡ ⎤ ⎤ A11 0 A13 0 B1 ⎢ ⎢ ⎥ ⎥ % = Q−1 AQ = ⎢ A21 A22 A23 A24 ⎥ , B % = Q−1 B = ⎢ B2 ⎥ , A ⎣ 0 0 A33 0 ⎦ ⎣ 0 ⎦ (6.20) 0 0 A43 A44 0 % = CQ = [C1 , 0, C3 , 0], C where (i) (Ac , Bc ) with Ac

A11 0 A21 A22

and

Bc

B1 B2

is controllable, where Ac ∈ Rnr ×nr , Bc ∈ Rnr ×m ; (ii) (Ao , Co ) with A11 A13 Ao and Co [C1 , C3 ] 0 A33 is observable, where Ao ∈ Rno ×no and Co ∈ Rp×no and where the dimensions of the matrices Aij , Bi , and Cj are as follows: A11 : (nr − nr¯o ) × (nr − nr¯o ), A33 : (n − (nr + no¯ − nro¯ )) ×

A22 : nr¯o × nro¯ , A44 : (no¯ − nr¯o ) × (no¯ − nr¯o ),

(n − (nr + no¯ − nro¯ )), B1 : (nr − nr¯o ) × m,

B2 : nr¯o × m,

C1 : p × (nr − nr¯o ),

C3 : p × (n − (nr + no¯ − nr¯o ));

(iii) the triple (A11 , B1 , C1 ) is such that (A11 , B1 ) is controllable and (A11 , C1 ) is observable. Proof. For details of the proof, refer to [6] and to [7], where further clariﬁcations to [6] and an updated method of selecting Q are given. The similarity transformation (6.19) has altered the basis of the state space in such a manner that the vectors in the controllable subspace Rr , the vectors

246

6 Controllability and Observability: Special Forms

in the unobservable subspace Ro¯, and the vectors in the subspace Rr¯o ∩ Ro¯ all have speciﬁc forms. To see this, we construct the controllability matrix % = [B, % ...,A %n−1 B] % whose range is the controllable subspace and the observC % = [C %T , . . . , (C %A %n−1 )T ]T , whose null space is the unobservable ability matrix O subspace. Then, all controllable states are of the form [xT1 , xT2 , 0, 0]T , all the unobservable ones have the structure [0, xT2 , 0, xT4 ]T , and states of the form [0, xT2 , 0, 0]T characterize Rr¯o ; i.e., they are controllable but unobservable. % or of A, are Similarly to the previous two lemmas, the eigenvalues of A, the eigenvalues of A11 , A22 , A33 , and A44 ; i.e., % = |λI − A11 ||λI − A22 ||λI − A33 ||λI − A44 |. |λI − A| = |λI − A|

(6.21)

% B, % C, % D} % given in (6.20), then If we consider the representation {A, ⎡˙ ⎤ ⎡ x ˆ1 A11 ˙ 2 ⎥ ⎢ A21 ⎢x ˆ ⎢ ⎥=⎢ ⎣x ˆ˙ 3 ⎦ ⎣ 0 0 x ˆ˙ 4

⎤ ⎤⎡ ⎤ ⎡ xˆ1 B1 0 ⎥ ⎢ ⎥ ⎢ A24 ⎥ ⎥ ⎢ xˆ2 ⎥ + ⎢ B2 ⎥ u, ⎦ ⎣ ⎦ ⎣ 0 xˆ3 0 ⎦ 0 A44 xˆ4 ⎡ ⎤ x ˆ1 ⎢x ˆ2 ⎥ ⎥ + Du. y = [C1 , 0, C3 , 0] ⎢ ⎣x ˆ3 ⎦ x ˆ4 0 A22 0 0

A13 A23 A33 A43

(6.22)

This shows that the trajectory components corresponding to x ˆ3 and x ˆ4 are not aﬀected by the input u. The modes associated with the eigenvalues of A33 and A44 determine the trajectory components for x ˆ3 and x ˆ4 (compare this with the results in Lemma 6.1). Similarly to Lemma 6.4, the trajectory ˆ4 are not inﬂuenced by xˆ1 and xˆ3 (observed via y), components for x ˆ2 and x and they are determined by the eigenvalues of A22 and A44 . The following is now apparent (see also Figure 6.1): The eigenvalues of A11 A22 A33 A44

are are are are

controllable and observable, controllable and unobservable, uncontrollable and observable, uncontrollable and unobservable. ⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.7. Given A = ⎣ 1 −2 1 ⎦, B = ⎣ 1 1 ⎦, and C = [0, 1, 0], we 0 1 −1 12 wish to reduce system (6.1) to the canonical structure (or Kalman decomposition) form (6.20). The appropriate transformation matrix Q is given by (6.19). The matrix C was found in Example 6.2 and

6.2 Standard Forms for Uncontrollable and Unobservable Systems

247

c – co o co

u

y

c– o

–c o– – c

Figure 6.1. Canonical decomposition (c and c¯ denote controllable and uncontrollable, respectively). The connections of the c/¯ c and o/¯ o parts of the system to the input and output are emphasized. Note that the impulse response (transfer function) of the system, which is an input–output description only, represents the part of the system that is both controllable and observable (see Chapter 7).

⎤ ⎡ ⎤ 0 1 0 C O = ⎣ CA ⎦ = ⎣ 1 −2 1 ⎦ . −2 4 −2 CA2 ⎡

A basis for Ro¯ = N (O) is {(1, 0, −1)T }. Note that nr = 2, no¯ = 1, and nr¯o = 1. Therefore, ⎤ ⎡ 1 10 Q = [v1 , v2 , QN ] = ⎣ 1 0 0 ⎦ 1 −1 1 is an appropriate similarity matrix (check that det Q = 0). We compute ⎡ ⎤⎡ ⎤⎡ ⎤ 0 10 0 −1 1 1 10 % = Q−1 AQ = ⎣ 1 −1 0 ⎦ ⎣ 1 −2 1 ⎦ ⎣ 1 0 0 ⎦ A 1 −2 1 0 1 −1 1 −1 1 ⎤ ⎡ ⎤ ⎡ 0 0 1 A11 0 A13 = ⎣ 0 −1 0 ⎦ = ⎣ A21 A22 A23 ⎦ , 0 0 A33 0 0 −2 ⎤ ⎤ ⎡ ⎡ ⎤⎡ ⎤ ⎡ 1 1 0 10 B1 10 % = Q−1 B = ⎣ 1 −1 0 ⎦ ⎣ 1 1 ⎦ = ⎣ 0 −1 ⎦ = ⎣ B2 ⎦ , B 0 1 −2 1 12 0 0

248

and

6 Controllability and Observability: Special Forms

⎡

⎤ 1 10 % = CQ = [0, 1, 0] ⎣ 1 0 0 ⎦ = [1, 0, 0] = [C1 , 0, C3 ]. C 1 −1 1

The eigenvalue 0 (in A11 ) is controllable and observable, the eigenvalue −1 (in A22 ) is controllable and unobservable and the eigenvalue −2 (in A33 ) is uncontrollable and observable. There are no eigenvalues that are both uncontrollable and unobservable.

6.3 Eigenvalue/Eigenvector Tests for Controllability and Observability There are tests for controllability and observability for both continuous- and discrete-time time-invariant systems that involve the eigenvalues and eigenvectors of A. Some of these criteria are called PBH tests, after the initials of the codiscoverers (Popov–Belevitch–Hautus) of these tests. These tests are useful in theoretical analysis, and in addition, they are also attractive as computational tools. Theorem 6.8. (i) The pair (A, B) is uncontrollable if and only if there exists a 1 × n (in general) complex vector vˆi = 0 such that vˆi [λi I − A, B] = 0,

(6.23)

where λi is some complex scalar. (ii) The pair (A, C) is unobservable if and only if there exists an n × 1 (in general) complex vector vi = 0 such that λi I − A (6.24) vi = 0, C where λi is some complex scalar. Proof. Only part (i) will be considered since (ii) can be proved using a similar argument or, directly, by duality arguments. (Suﬃciency) Assume that (6.23) is satisﬁed. In view of vˆi A = λi vˆi and vˆi B = 0, vˆi AB = λi vˆi B = 0 and vˆi Ak B = 0 k = 0, 1, 2, . . . . Therefore, vˆi C = vˆi [B, AB, . . . , An−1 B] = 0, which shows that (A, B) is not completely controllable. (Necessity) Let (A, B) be uncontrollable and assume without loss of generality the standard form for A and B given in Lemma 6.1. We will show that there exist λi and vˆi so that (6.23) holds. Let λi be an uncontrollable eigenvalue, and let vˆi = [0, α], αT ∈ C n−nr , where α(λi I − A2 ) = 0; i.e., α is a left eigenvector of A2 corresponding to λi . Then vˆi [λi I − A, B] = [0, α(λi I − A2 ), 0] = 0; i.e., (6.23) is satisﬁed.

6.3 Eigenvalue/Eigenvector Tests for Controllability and Observability

249

Corollary 6.9. (i) λi is an uncontrollable eigenvalue of (A, B) if and only if there exists a 1 × n (in general) complex vector vˆi = 0 that satisﬁes (6.23). (ii) λi is an unobservable eigenvalue of (A, C) if and only if there exists an n × 1 (in general) complex vector vi = 0 that satisﬁes (6.24). Proof. See [1, p. 273, Corollary 4.6].

⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 6.10. Given are A = ⎣ 1 −2 1 ⎦ , B = ⎣ 1 1 ⎦, and C = [0, 1, 0], 0 1 −1 12 as in Example 6.7. The matrix A has three eigenvalues, λ1 = 0, λ2 = −1, and λ3 = −2, with corresponding right eigenvectors v1 = [1, 1, 1]T , v2 = [1, 0, −1]T , v3 = [1, 1, −1]T and with left eigenvectors vˆ1 = [1/2, 0, 1/2], vˆ2 = [1, −1, 0], and vˆ3 = [−1/2, 1, −1/2], respectively. In view of Corollary 6.9, vˆ1 B = [1, 1] = 0 implies that λ1 = 0 is controllable. This is because vˆ1 is the only nonzero vector (within a multiplication by a nonzero scalar) that satisﬁes vˆ1 (λ1 I − A) = 0, and so vˆ1 B = 0 implies that the only 1 × 3 vector α that satisﬁes α[λ1 I − A, B] = 0 is the zero vector, which in turn implies that λ1 is controllable in view of (i) of Corollary 6.9. For similar reasons Cv1 = 1 = 0 implies that λ1 = 0 is observable; see (ii) of Corollary 6.9. Similarly, vˆ2 B = [0, −1] = 0 implies that λ2 = −1 is controllable, and Cv2 = 0 implies that λ2 = −1 is unobservable. Also, vˆ3 B = [0, 0] implies that λ3 = −2 is uncontrollable, and Cv3 = 1 = 0 implies that λ3 = −2 is observable. These results agree with the results derived in Example 6.7. Corollary 6.11. ( Rank Tests) (ia) The pair (A, B) is controllable if and only if rank[λI − A, B] = n

(6.25)

for all complex numbers λ, or for all n eigenvalues λi of A. (ib) λi is an uncontrollable eigenvalue of A if and only if rank[λi I − A, B] < n. (iia) The pair (A, C) is observable if and only if λI − A rank =n C for all complex numbers λ, or for all n eigenvalues λi . (iib) λi is an unobservable eigenvalue of A if and only if λi I − A rank < n. C

(6.26)

(6.27)

(6.28)

250

6 Controllability and Observability: Special Forms

Proof. The proofs follow in a straightforward manner from Theorem 6.8. Notice that the only values of λ that can possibly reduce the rank of [λI − A, B] are the eigenvalues of A.

Example 6.12. If in Example 6.10 the eigenvalues λ1 , λ2 , λ3 of A are known, but the corresponding eigenvectors are not, consider the system matrix ⎡ ⎤ s 1 −1 1 0 ⎢ −1 s + 2 −1 1 1 ⎥ sI − A B ⎥ P (s) = =⎢ ⎣ 0 −1 s + 1 1 2 ⎦ −C 0 0 −1 0 00 λ I −A and determine rank[λi I − A, B] and rank i . Notice that C ⎡ ⎤ −1 1 −1 ⎢ −1 1 −1 ⎥ sI − A ⎥ rank = rank ⎢ ⎣ 0 −1 0 ⎦ = 2 < 3 = n C s=λ2 0 1 0 ⎡

and rank[sI − A, B]s=λ3

⎤ −2 2 −1 1 0 = rank ⎣ −1 0 −1 1 1 ⎦ = 2 < 3 = n. 0 −1 −1 1 2

In view of Corollary 6.11, λ2 = −1 is unobservable and λ3 = −2 is uncontrollable.

6.4 Controller and Observer Forms It has been seen several times in this book that equivalent representations of systems x˙ = Ax + Bu, y = Cx + Du, (6.29) given by the equations %x + Bu, % x ˆ˙ = Aˆ

%xˆ + Du, % y=C

(6.30)

% = P B, C % = CP −1 , and D % = D may oﬀer % = P AP −1 , B where x ˆ = P x, A advantages over the original representation when P (or Q = P −1 ) is chosen in an appropriate manner. This is the case when P (or Q) is such that the new basis of the state space provides a natural setting for the properties of interest. This section shows how to select Q when (A, B) is controllable [or (A, C) is observable] to obtain the controller and observer forms. These special forms

6.4 Controller and Observer Forms

251

are very useful, in realizations discussed in Chapter 8 and especially when studying state-feedback control (and state observers) discussed in Chapter 9. They are also very useful in establishing a convenient way to transition between state-space representations and another very useful class of equivalent internal representations, the polynomial matrix representations. Controller forms are considered ﬁrst. Observer forms can of course be obtained directly in a similar manner to the controller forms, or they may be obtained by duality. This is addressed in the latter part of this section. 6.4.1 Controller Forms The controller form is a particular system representation where both matrices (A, B) have a certain special structure. Since in this case A is in the companion form, the controller form is sometimes also referred to as the controllable companion form. Consider the system x˙ = Ax + Bu,

y = Cx + Du,

(6.31)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m and let (A, B) be controllable. Then rank C = n, where C = [B, AB, . . . , An−1 B].

(6.32)

rank B = m ≤ n.

(6.33)

Assume that Under these assumptions, rank C = n and rank B = m. We will show how % B) % in controller form, ﬁrst for the singleto obtain an equivalent pair (A, input case (m = 1) and then for the multi-input case (m > 1). Before this is accomplished, we discuss how to deal with two special cases that do not satisfy the above assumptions that rank B = m and that (A, B) is controllable. 1. If the m columns of B are not linearly independent (rank B = r < m), then there exists an m × m nonsingular matrix K so that BK = [Br , 0], where the r columns of Br are linearly independent (rank Br = r). Note that ur x˙ = Ax + Bu = Ax + (BK)(K −1 u) = Ax + [Br , 0] = Ax + Br ur , um−r which shows that when rank B = r < m the same input action to the system can be accomplished by only r inputs, instead of m inputs. The pair (A, Br ), which is controllable when (A, B) is controllable, can now be reduced to controller form, using the method described below. 2. When (A, B) is not completely controllable, then a two-step approach can be taken. First, the controllable part is isolated (see Subsection 6.2.1) and then is reduced to the controller form, using the methods of this section. In particular, consider the system x˙ = Ax + Bu with A ∈ Rn×n , B ∈ Rn×m , and rank B = m. Let rank[B, AB, . . . , An−1 B] = nr < n. Then

252

6 Controllability and Observability: Special Forms

A1 A12 there exists a transformation P1 such that P1 AP1−1 = and 0 A2 B1 , where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and (A1 , B1 ) is conP1 B = 0 trollable (Subsection 6.2.1). Since (A1 , B1 ) is controllable, there exists a transformation P2 such that P2 A1 P2−1 = A1c , and P2 B1 = B1c , where A1c , B1c is in controller form, deﬁned below. Combining, we obtain A1c P2 A12 B1c −1 (6.34) P AP = , and P B = 0 A2 0 [where A1c ∈ Rnr ×nr , B1c ∈ Rnr ×m , and (A1c , B1c ) is controllable], which is in controller form. Note that P2 0 P = (6.35) P1 . 0 I Single-Input Case (m = 1) %= The representation {Ac , Bc , Cc , Dc } in controller form is given by Ac A −1 % P AP and Bc B = P B with ⎤ ⎡ ⎡ ⎤ 0 1 ··· 0 0 ⎥ ⎢ .. ⎢ .. ⎥ .. . . .. ⎥ ⎢ ⎢ ⎥ . . . Ac = ⎢ . (6.36) ⎥ , Bc = ⎢ . ⎥ , ⎦ ⎣ 0 ⎣0⎦ 0 ··· 1 −α0 −α1 · · · −αn−1 1 where the coeﬃcients αi are the coeﬃcients of the characteristic polynomial α(s) of A; that is, α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 .

(6.37)

% = CP −1 and Dc = D do not have any particular strucNote that Cc C ture. The structure of (Ac , Bc ) is very useful (in control problems), and the representation {Ac , Bc , Cc , Dc } shall be referred to as the controller form of the system. The similarity transformation matrix P is obtained as follows. n−1 B] is in this case an n × n The controllability matrix C = [B, AB, ...,A × nonsingular matrix. Let C −1 = , where q is the nth row of C −1 and × q indicates the remaining entries of C −1 . Then ⎡ ⎤ q ⎢ qA ⎥ ⎥ P ⎢ (6.38) ⎣ ··· ⎦. qAn−1

6.4 Controller and Observer Forms

253

To show that P AP −1 = Ac and P B = Bc given in (6.36), note ﬁrst that qAi−1 B = 0 i = 1, . . . , n − 1 and qAn−1 B = 1. This can be veriﬁed from the deﬁnition of q, which implies that q C = [0, 0, . . . , 1]. Now ⎡ ⎤ 0 0 ··· ··· 1 ⎢0 0 ··· 1 ×⎥ ⎢ ⎥ P C = P [B, AB, . . . , An−1 B] = ⎢ . (6.39) .. .. ⎥ = Cc , ⎣ .. 1 . .⎦ 1 × ··· × × which implies that |P C| = |P | |C| = 0 or that |P | = 0. Therefore, P qualiﬁes as a similarity transformation matrix. In view of (6.39), P B = [0, 0, . . . , 1]T = Bc . Furthermore, ⎤ ⎡ qA ⎢ .. ⎥ ⎥ ⎢ Ac P = ⎢ . ⎥ = P A, (6.40) n−1 ⎦ ⎣ qA qAn i n where in the last row of Ac P , the relation − n−1 i=0 αi A = A was used [which is the Cayley–Hamilton Theorem, namely, α(A) = 0]. ⎡

⎤ ⎡ ⎤ −1 0 0 1 Example 6.13. Let A = ⎣ 0 1 0 ⎦ and B = ⎣ −1 ⎦. Since n = 3 and 0 0 −2 1 |sI − A| = (s + 1)(s − 1)(s + 2) = s3 + 2s2 − s − 2, {Ac , Bc } in controller form is given by ⎡ ⎤ ⎡ ⎤ 01 0 0 Ac = ⎣ 0 0 1 ⎦ and Bc = ⎣ 0 ⎦ . 2 1 −2 1 The transformation matrix P that reduces (A, B) to (Ac = P AP −1 , Bc = P B) is now derived. We have ⎡ ⎤ ⎡ ⎤ 1 −1 1 1 −1/3 −1/3 C = [B, AB, A2 B] = ⎣ −1 −1 −1 ⎦ and C −1 = ⎣ −1/2 −1/2 0 ⎦ . 1 −2 4 −1/2 −1/6 1/3 The third (the nth) row of C −1 is q = [−1/2, −1/6, 1/3], and therefore, ⎡ ⎤ ⎡ ⎤ q −1/2 −1/6 1/3 P ⎣ qA ⎦ = ⎣ 1/2 −1/6 −2/3 ⎦ . qA2 −1/2 −1/6 4/3 It can now easily be veriﬁed that Ac = P AP −1 , or ⎡ ⎤ 1/2 −1/6 −2/3 Ac P = ⎣ −1/2 −1/6 −2/3 ⎦ = P A, 1/2 −1/6 −8/3 and that Bc = P B.

254

6 Controllability and Observability: Special Forms

An alternative form to (6.36) is ⎡ ⎤ −αn−1 · · · −α1 −α0 ⎢ 1 ··· 0 0 ⎥ ⎢ ⎥ Ac1 = ⎢ .. . .. ⎥ , .. ⎣ . .. . . ⎦ 0 ··· 1 0

Bc1

⎡ ⎤ 1 ⎢0⎥ ⎢ ⎥ = ⎢ . ⎥, ⎣ .. ⎦

(6.41)

0

which is obtained if the similarity transformation matrix is taken to be ⎡ n−1 ⎤ qA ⎢ .. ⎥ ⎢ ⎥ P1 ⎢ . ⎥ , (6.42) ⎣ qA ⎦ q i.e., by reversing the order of the rows of P in (6.38). (See Exercise 6.5 and Example 6.14.) 0 I ×× or . It In the above, Ac is a companion matrix of the form ×× I 0 0× ×0 could also be of the form or with coeﬃcients −[α0 , . . . , αn−1 ]T I× ×I in the last or the ﬁrst column. It is shown here, for completeness, how to determine controller forms where Ac are such companion matrices. In particular, if (6.43) Q2 = P2−1 = [B, AB, . . . , An−1 B] = C, then ⎡

Ac2

Also, if

⎤ ⎡ ⎤ 0 −α0 1 ⎢0⎥ 0 −α1 ⎥ ⎥ ⎢ ⎥ ⎥ , Bc2 = Q−1 .. .. 2 B = ⎢ .. ⎥ . ⎦ ⎣.⎦ . . 0 · · · 1 −αn−1 0

0 ··· ⎢1 ··· ⎢ = Q−1 2 AQ2 = ⎢ .. . . ⎣. .

Q3 = P3−1 = [An−1 B, . . . , B],

(6.44)

(6.45)

then ⎡

Ac3

−αn−1 ⎢ .. ⎢ . = Q−1 AQ = ⎢ 3 3 ⎣ −α1 −α0

⎡ ⎤ ⎤ 0 0 ⎢ .. ⎥ .. ⎥ ⎢.⎥ .⎥ ⎥ , Bc3 = Q−1 3 B = ⎢ ⎥. ⎣0⎦ 0 ··· 1⎦ 1 0 ··· 0 1 ··· .. . . . .

(6.46)

(Ac , Bc ) in (6.44) and (6.46) are also in controller canonical or controllable companion form. (See also Exercise 6.5 and Example 6.14.)

6.4 Controller and Observer Forms

255

⎡

⎤ ⎡ ⎤ −1 0 0 1 Example 6.14. Let A = ⎣ 0 1 0 ⎦ and B = ⎣ −1 ⎦, as in Example 6.13. 0 0 −2 1 Alternative controller forms can be derived for diﬀerent P . In particular, if ⎡ 2⎤ ⎡ ⎤ qA −1/2 −1/6 4/3 (i) P = P1 = ⎣ qA ⎦ = ⎣ 1/2 −1/6 −2/3 ⎦, as in (6.42) (C, C −1 , and q q −1/2 −1/6 1/3 were found in Example 6.13), then ⎡ ⎤ ⎡ ⎤ −2 1 2 1 Ac1 = ⎣ 1 0 0 ⎦ , Bc1 = ⎣ 0 ⎦ , 010 0 ⎡ ⎤ 1/2 −1/6 −8/3 as in (6.41). Note that in the present case Ac1 P1 = ⎣ −1/2 −1/6 4/3 ⎦ = 1/2 −1/6 −2/3 P1 A, Bc1⎡= P1 B. ⎤ 1 −1 1 (ii) Q2 = C = ⎣ −1 −1 −1 ⎦ , as in (6.43). Then 1 −2 4 ⎡

Ac2 as in (6.44).

⎤ 00 2 = ⎣1 0 1⎦, 0 1 −2

Bc2

⎡ ⎤ 1 ⎣ 0⎦, = Q−1 B = 2 0

⎡

⎤ 1 −1 1 (iii) Q3 = [A2 B, AB, B] = ⎣ −1 −1 −1 ⎦, as in (6.45). Then 4 −2 1 ⎡

Ac3

⎤ −2 1 0 = ⎣ 1 0 1⎦, 200

Bc3

⎡ ⎤ 0 = ⎣0⎦, 1

⎡

as in (6.46). Note that Q3 Ac3 ⎡

⎤ 1 ⎣ −1 ⎦ = B. 1

⎤ −1 1 −1 = ⎣ −1 −1 −1 ⎦ = AQ3 , −8 4 −2

Q3 Bc3 =

256

6 Controllability and Observability: Special Forms

Multi-Input Case (m > 1) In this case, the n × mn matrix C given in (6.32) is not square, and there are typically many sets of n columns of C that are linearly independent (rank C = n). Depending on which columns are chosen and in what order, diﬀerent controller forms (controllable companion forms) are derived. Note that in the case when m = 1, four diﬀerent controller forms were derived, even though there was only one set of n linearly independent columns. In the present case there are many more such choices. The form that will be used most often in the following is a generalization of (Ac , Bc ) given in (6.36). Further discussion including derivation and alternative forms may be found in [1, Subsection 3.4D]. % = P B, where P is constructed as follows. Consider % = P AP −1 and B Let A C = [B, AB, . . . , An−1 B] = [b1 , . . . , bm , Ab1 , . . . , Abm , . . . , An−1 b1 , . . . , An−1 bm ],

(6.47)

where the b1 , . . . , bm are the m columns of B. Select, starting from the left and moving to the right, the ﬁrst n independent columns (rank C = n). Reorder these columns by taking ﬁrst b1 , Ab1 , A2 b1 , etc., until all columns involving b1 have been taken; then take b2 , Ab2 , etc.; and lastly, take bm , Abm , etc., to obtain C¯ [b1 , Ab1 , . . . , Aμ1 −1 b1 , . . . , bm , . . . , Aμm −1 bm ], (6.48) an n × n matrix. The integer μi denotes the number of columns involving bi in the set of the ﬁrst n linearly independent columns found in C when moving from left to right. Deﬁnition 6.15. The m integers μi , i = 1, . . . , m, are the controllability indices of the system, and μ max μi is called the controllability index of the system. Note that m

μi = n

and

mμ ≥ n.

(6.49)

i=1

An alternative but equivalent deﬁnition for μ is that μ is the minimum integer k such that rank[B, AB, . . . , Ak−1 B] = n. (6.50) Notice that in (6.48) all columns of B are always present since rank B = m. This implies that μi ≥ 1 for all i. Notice further that if Ak bi is present, then Ak−1 bi must also be present. Now deﬁne k σk μi , k = 1, . . . , m; (6.51) i=1

6.4 Controller and Observer Forms

257

i.e., σ1 = μ1 , σ2 = μ1 + μ2 , . . . , σm = μ1 + · · · + μm = n. Also, consider C¯−1 and let qk , where qkT ∈ Rn , k = 1, . . . , m, denote its σk th row; i.e., . . T T C¯−1 = [×, . . . , ×, q1T .. · · · ..×, . . . , ×, qm ] . Next, deﬁne

⎡

(6.52)

⎤

q1 q1 A .. .

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ q1 Aμ1 −1 ⎥ ⎢ ⎥ ⎢ ⎥ ··· ⎢ ⎥ ⎢ ⎥ . .. P ⎢ ⎥. ⎢ ⎥ ⎢ ⎥ ··· ⎢ ⎥ ⎢ ⎥ q m ⎢ ⎥ ⎢ qm A ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ . μm −1 qm A

(6.53)

It can now be shown that P AP −1 = Ac and P B = Bc with Ac = [Aij ], i, j = 1, . . . , m, ⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Aii = ⎢ . Iμi −1 ⎥ ∈ Rμi ×μi , i = j, ⎣0 ⎦ × ×···×

⎡

0 ··· ⎢ .. .. ⎢ . Aij = ⎢ . ⎣ 0 ··· × ×···

⎤ 0 .. ⎥ . ⎥ ⎥ ∈ Rμi ×μj , i = j, 0⎦ ×

and ⎡

B1 ⎢ B2 ⎢ Bc = ⎢ . ⎣ .. Bm

⎤ ⎥ ⎥ ⎥, ⎦

⎡

0 ··· ⎢ Bi = ⎣ ...

0 .. .

0 ··· .. .

⎤ 0 .. ⎥ ∈ Rμi ×m , .⎦

(6.54)

0 ··· 0 1 ×··· ×

where the 1 in the last row of Bi occurs at the ith column location, i = 1, . . . , m, and × denotes nonﬁxed entries. Note that Cc = CP −1 does not have any particular structure. The expression (6.54) is a very useful form (in control problems) and shall be referred to as the controller form of the system. The derivation of this result is discussed in [1, Subsection 3.4D] . Example 6.16. Given are A ∈ Rn×n and B ∈ Rn×m with (A, B) controllable and with rank B = m. Let n = 4 and m = 2. Then there must be two 2 controllability indices μ1 and μ2 such that n = 4 = i=1 μi = μ1 + μ2 . Under these conditions, there are three possibilities:

258

6 Controllability and Observability: Special Forms

(i) μ1 = 2, μ2 = 2, Ac =

A11 A12 A21 A22

⎡

0 1 ⎢× × ⎢ =⎣ 0 0 ××

⎤ 0 0 × ×⎥ ⎥, 0 1⎦ ××

Bc =

B1 B2

⎡

⎤ 0 0 ⎢1 ×⎥ ⎥ =⎢ ⎣0 0 ⎦. 0 1

(ii) μ1 = 1, μ2 = 3, ⎡

⎤ ×× 1 0⎥ ⎥, 0 1⎦ ××

⎤ 1× ⎢0 0 ⎥ ⎥ Bc = ⎢ ⎣0 0 ⎦. 0 1

⎡

⎤ 0 0 1 0⎥ ⎥, × ×⎦ ××

⎡

×× ⎢0 0 Ac = ⎢ ⎣0 0 ××

⎡

(iii) μ1 = 3, μ2 = 1, 0 1 ⎢0 0 Ac = ⎢ ⎣× × ××

⎤ 0 0 ⎢0 0 ⎥ ⎥ Bc = ⎢ ⎣1 ×⎦. 0 1

It is possible to write Ac , Bc in a systematic and perhaps more transparent way. In particular, notice that Ac , Bc in (6.54) can be expressed as ¯c Am , Ac = A¯c + B

¯c Bm , Bc = B

where A¯c = block diag[A¯11 , A¯22 , . . . , A¯mm ] with ⎤ ⎡0 0 . .. μi ×1 ¯c = block diag A¯ii = ⎣ .. Iμi −1 ⎦ ∈ Rμi ×μi , B , . ∈R

(6.55)

i = 1, . . . , m ,

0 1

0 0 0···0

m×n and and Bm ∈ Rm×m are some appropriate matrices with m Am ∈ R ¯ ¯ i=1 μi = n. Note that the matrices Ac , Bc are completely determined by the m controllability indices μi , i = 1, . . . , m. The matrices Am and Bm consist of the σ1 th, σ2 th, . . . , σm th rows of Ac (entries denoted by ×) and the same rows of Bc , respectively [see (6.57) and (6.58) below].

⎡

⎤ ⎡ ⎤ 01 0 01 Example 6.17. Let A = ⎣ 0 0 1 ⎦ and B = ⎣ 1 1 ⎦. To determine the 0 2 −1 00 controller form (6.54), consider ⎡ ⎤ 0111 0 0 C = [B, AB, A2 B] = [b1 , b2 , Ab1 , Ab2 , A2 b1 , A2 b2 ] = ⎣ 1 1 0 0 2 2 ⎦ , 0 0 2 2 −2 −2

6.4 Controller and Observer Forms

259

where rank C = 3 = n; i.e., (A, B) is controllable. Searching from left to right, the ﬁrst three columns of C are selected since they are linearly independent. Then ⎡ ⎤ 011 C¯ = [b1 , Ab1 , b2 ] = ⎣ 1 0 1 ⎦ 020 and the controllability indices are μ1 = 2 and μ2 = 1. Also, σ1 = μ1 = 2 and σ2 = μ1 + μ2 = 3 = n, and ⎡ ⎤ −1 1 1/2 C¯−1 = ⎣ 0 0 1/2 ⎦ . 1 0 −1/2 the and third rows Notice that q1 = [0, 0, 1/2] and q2 = [1, 0, −1/2], ⎤ second ⎡ ⎤ ⎡ q1 0 0 1/2 of C¯−1 , respectively. In view of (6.53), P = ⎣ q1 A ⎦ = ⎣ 0 1 −1/2 ⎦, P −1 = 1 0 −1/2 q ⎡ ⎤ ⎤ ⎡ 2 0 10 101 ⎣ 1 1 0 ⎦, and Ac = P AP −1 = A11 A12 = ⎣ 2 −1 0 ⎦, Bc = P B = B1 = B2 A21 A22 200 1 00 ⎤ ⎡ 00 ⎣ 1 1 ⎦. 01 One can also verify (6.55) quite easily. We have ⎤ ⎤ ⎡ ⎡ ⎡ ⎤ 00 0 10 010 2 −1 0 ¯ ¯ ⎦ ⎦ ⎣ ⎣ ⎣ ⎦ Ac = 2 −1 0 = Ac + Bc Am = 0 0 0 + 1 0 1 00 1 00 000 01 and

⎡

0 Bc = ⎣ 1 0

⎤ ⎤ ⎡ 0 00 11 ¯ ⎦ ⎦ ⎣ 1 = Bc Bm = 1 0 . 01 1 01

It is interesting to note that in this example, the given pair (A, B) could have already been in controller form if B were diﬀerent but A were the same. For example, consider the following three cases: ⎡ ⎤ ⎡ ⎤ 01 0 1× 1. A = ⎣ 0 0 1 ⎦ , B = ⎣ 0 0 ⎦ , μ1 = 1, μ2 = 2, 0 2 −1 0 1 ⎤ ⎤ ⎡ ⎡ 01 0 0 0 2. A = ⎣ 0 0 1 ⎦ , B = ⎣ 1 × ⎦ , μ1 = 2, μ1 = 1, 0 2 −1 0 1

260

6 Controllability and Observability: Special Forms

⎡

⎤ 01 0 3. A = ⎣ 0 0 1 ⎦ , 0 2 −1

⎡ ⎤ 0 B = ⎣0⎦, 1

μ1 = 3 = n.

Note that case 3 is the single-input case (6.36).

Remarks (i) An important result involving the controllability indices of (A, B) is the following: Given (A, B) controllable, then (P (A + BGF )P −1 , P BG) will have the same controllability indices, within reordering, for any P, F , and G (|P | = 0, |G| = 0) of appropriate dimensions. In other words, the controllability indices are invariant under similarity and input transformations P and G, and state feedback F [or similarity transformation P and state feedback (F, G)]. (For further discussion, see [1, Subsection 3.4D].) (ii) It is not diﬃcult to derive explicit expressions for Am and Bm in (6.55). Using qi Ak−1 bj = 0 k = 1, . . . , μj , k−1

qi A

i = j,

bi = 0 k = 1, . . . , μi − 1, and qi Aμi −1 bi = 1,

i = j,

(6.56)

where i = 1, . . . , m, and j = 1, . . . , m, it can be shown that the m σ1 th, σ2 th, . . . , σm th rows of Ac that are denoted by Am in (6.55) are given by ⎤ ⎡ q1 Aμ1 ⎥ −1 ⎢ .. Am = ⎣ (6.57) ⎦P . . qm Aμm Similarly

⎤ q1 Aμ1 −1 ⎥ ⎢ .. =⎣ ⎦ B. . μm −1 qm A ⎡

Bm

(6.58)

The matrix Bm is an upper triangular matrix with ones on the diagonal. (For details, see [1, Subsection 3.4D].) ⎡

⎤ ⎡ ⎤ 01 0 11 Example 6.18. We wish to reduce A = ⎣ 0 0 1 ⎦ , B = ⎣ 0 1 ⎦ to controller 0 2 −1 00 form. Note that A and B are almost the same as in Example 6.17; how2 ever, here μ1 = 1 < 2 = ⎡ μ2 , as will⎤ be seen. We have C = [B, AB, A B] = 1101 [b1 , b2 , Ab1 , Ab2 , . . . ] = ⎣ 0 1 0 0 · · · ⎦. Searching from left to right, the ﬁrst 0002

6.4 Controller and Observer Forms

261

three linearly independent columns are b1 , b2 , Ab2 , and C¯ = [b1 , b2 , Ab2 ] = ⎡ ⎤ 111 ⎣ 0 1 0 ⎦, from which we conclude that μ1 = 1, μ2 = 2, σ1 = 1, and 002 ⎡ ⎤ 1 −1 −1/2 σ2 = 3. We compute C¯−1 = ⎣ 0 1 0 ⎦. Note that q1 = [1, −1, −1/2] 0 0 1/2 and q⎡2 = [0, rows of⎤C¯−1 , respectively. Then ⎤0, 1/2], ⎡ the ﬁrst ⎤and third ⎡ 1 −1 −1/2 121 q1 P = ⎣ q2 ⎦ = ⎣ 0 0 1/2 ⎦, P −1 = ⎣ 0 1 1 ⎦, and q2 A 0 1 −1/2 020 ⎤ ⎡ 0 −1 0 A11 A12 Ac = P AP −1 = = ⎣0 0 1⎦, A21 A22 0 2 −1 ⎤ ⎡ 10 B1 Bc = P B = = ⎣0 0⎦. B2 01 It is easy to verify relations (6.57) and (6.58).

Structure Theorem—Controllable Version The transfer function matrix H(s) of the system x˙ = Ax + Bu, y = Cx + Du is given by H(s) = C(sI − A)−1 B + D. If (A, B) is in controller form (6.54), then H(s) can alternatively be characterized by the Structure Theorem stated in Theorem 6.19 below. This result is very useful in the realization of systems, which is addressed in Chapter 8 and in the study of state feedback in Chapter 9. ¯ c Am and B = Bc = B ¯c Bm , as in (6.55), with Let A = Ac = A¯c + B |Bm | = 0, and let C = Cc and D = Dc . Deﬁne Λ(s) diag[sμ1 , sμ2 , . . . , sμm ],

(6.59)

μi −1 T

S(s) block diag([1, s, . . . , s

] ,

i = 1, . . . , m). (6.60) m Note that S(s) is an n × m polynomial matrix (n = i=1 μi ), i.e., a matrix with polynomials as entries. Now deﬁne the m × m polynomial matrix D(s) and the p × m polynomial matrix N (s) by −1 D(s) Bm [Λ(s) − Am S(s)], N (s) Cc S(s) + Dc D(s).

(6.61)

The following is the controllable version of the Structure Theorem. Theorem 6.19. H(s) = N (s)D−1 (s), where N (s) and D(s) are deﬁned in (6.61).

262

6 Controllability and Observability: Special Forms

Proof. First, note that (6.62) (sI − Ac )S(s) = Bc D(s). −1 ¯ ¯ To see this, we write Bc D(s) = Bc Bm Bm [Λ(s) − Am S(s)] = Bc Λ(s) − ¯c Am S(s) and (sI − Ac )S(s) = sS(s) − (A¯c + B ¯c Am )S(s) = (sI − A¯c )S(s) − B ¯ ¯ ¯ Bc Am S(s) = Bc Λ(s) − Bc Am S(s), which proves (6.62). Now H(s) = Cc (sI − Ac )−1 Bc + Dc = Cc S(s)D−1 (s) + Dc = [Cc S(s) + Dc D(s)]D−1 (s) = N D−1 . ⎡

⎤ ⎡ ⎤ 0 10 00 Example 6.20. Let Ac = ⎣ 2 −1 0 ⎦, Bc = ⎣ 1 1 ⎦, as in Example 6.17. Here 01 1 0 0 2 2 −1 0 11 s 0 , Bm = . Then Λ(s) = μ1 = 2, μ2 = 1 and Am = , 1 00 01 0 s ⎡ ⎤ 10 S(s) = ⎣ s 0 ⎦ and 01 2 1 −1 s 0 −s + 2 0 −1 − D(s) = Bm [Λ(s) − Am S(s)] = 0 1 0 s 1 0 2 2 1 −1 s +s−2 0 s + s − 1 −s = = . 0 1 −1 s −1 s Now Cc = [0, 1, 1], and Dc = [0, 0], N (s) = Cc S(s) + Dc D(s) = [s, 1], and

−1 1 s s s2 + s − 1 −s = [s, 1] 1 s2 + s − 1 s(s2 + s − 2) −1 s 1 = [s2 + 1, 2s2 + s − 1] s(s2 + s − 2)

H(s) = [s, 1]

= Cc (sI − Ac )−1 Bc + Dc . ⎡

⎤ ⎡ ⎤ 01 0 0 Example 6.21. Let Ac = ⎣ 0 0 1 ⎦, Bc = ⎣ 0 ⎦, Cc = [0, 1, 0], and Dc = 0 2 1 −2 1 (see Example 6.13). In the present case, we have Am = [2, 1, −2], Bm = 1, Λ(s) = s3 , S(s) = [1, s, s2 ]T , and D(s) = 1 · [s3 − [2, 1, −2][1, s, s2 ]T ] = s3 + 2s2 − s − 2,

N (s) = s.

Then H(s) = N (s)D−1 (s) = s/(s3 + 2s2 − s − 2) = Cc (sI − Ac )−1 Bc + Dc .

6.4 Controller and Observer Forms

263

6.4.2 Observer Forms Consider the system x˙ = Ax + Bu, y = Cx + Du given in (6.1) and assume that (A, C) is observable; i.e., rank O = n, where ⎤ ⎡ C ⎢ CA ⎥ ⎥ ⎢ (6.63) O=⎢ ⎥. .. ⎦ ⎣ . CAn−1 Also, assume that the p × n matrix C has a full row rank p; i.e., rank C = p ≤ n.

(6.64)

It is of interest to determine a transformation matrix P so that the equivalent system representation {Ao , Bo , Co , Do } with Ao = P AP −1 ,

Bo = P B,

Co = CP −1 ,

Do = D

(6.65)

will have (Ao , Co ) in an observer form (deﬁned below). As will become clear in the following discussion, these forms are dual to the controller forms previously discussed and can be derived by taking advantage of this fact. In particular, ( C T [(A, ( B) ( is controllable], and determine a nonsingular ( AT , B let A (c = P(A (P( −1 , B (c = P( B ( are in controller form given transformation P( so that A T (c and Co = B (cT is in observer form. in (6.54). Then Ao = A It will be demonstrated in the following discussion how to obtain observer forms directly, in a way that parallels the approach described for controller forms. This is done for the sake of completeness and to deﬁne the observability indices. The approach of using duality just given can be used in each case to verify the results. We ﬁrst note that if rank C = r < p, an approach analogous to the case when rank B < m can be followed, as in Subsection 6.4.1. The fact that the rows of C are not linearly independent means that the same information can be extracted from only r outputs, and therefore, the choice for the outputs should perhaps be reconsidered. Now if (A, C) is unobservable, one may use two steps to ﬁrst isolate the observable part and then reduce it to the observer form, in an analogous way to the uncontrollable case previously given. Single-Output Case (p = 1) Let

q , A˜ q , . . . , An−1 q˜], P −1 = Q [˜

where q˜ is the nth column in O

−1

. Then

(6.66)

264

6 Controllability and Observability: Special Forms

⎤ 0 · · · 0 −α0 ⎢ 1 · · · 0 −α1 ⎥ ⎥ ⎢ A0 = ⎢ . . . ⎥, .. ⎦ ⎣ .. . . .. . 0 · · · 1 −αn−1 ⎡

Co = [0, . . . , 0, 1],

(6.67)

where the αi denote the coeﬃcients of the characteristic polynomial α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 . Here Ao = P AP −1 = Q−1 AQ, Co = CP −1 = CQ, and the desired result can be established by using a proof that is completely analogous to the proof in determining the (dual) controller form presented in Subsection 6.4.1. Note that Bo = P B does not have any particular structure. The representation {Ao , Bo , Co , Do } will be referred to as the observer form of the system. Reversing the order of columns in P −1 given in (6.66) or selecting P to be exactly O, or to be equal to the matrix obtained after the order of the columns in O has been reversed, leads to alternative observer forms in a manner analogous to the controller form case. ⎡

⎤ −1 0 0 Example 6.22. Let A = ⎣ 0 1 0 ⎦ and C = [1, −1, 1]. To derive the ob0 0 −2 ( = C T , and ( = AT , B server form (6.67), we could use duality, by deﬁning A ( ( deriving the controller form of A, B, i.e., by following the procedure outlined ( B ( are exactly the matrices given in Examples 6.13 above. We note that the A, and 6.14. As an alternative approach, the observer form is now derived directly. In particular, we have ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ C 1 −1 1 1 −1/2 −1/2 O = ⎣ CA ⎦ = ⎣ −1 −1 −2 ⎦ , O−1 = ⎣ −1/3 −1/2 −1/6 ⎦ , CA2 1 −1 4 −1/3 0 1/3 and in view of (6.66), Q = P −1

⎡

⎤ −1/2 1/2 −1/2 = [˜ q , A˜ q , A2 q˜] = ⎣ −1/6 −1/6 −1/6 ⎦ . 1/3 −2/3 4/3

Note that q˜ = [−1/2, −1/6, 1/3]T , the last column of O−1 . Then ⎡ ⎤ 00 2 Ao = Q−1 AQ = ⎣ 1 0 1 ⎦ , and Co = CQ = [0, 0, 1], 0 1 −2 where |sI − A| = s⎤3 + 2s − s − 2 = s3 + α2 s2 + α1 s + α0 . Hence, QAo = ⎡ 1/2 −1/2 1/2 ⎣ −1/6 −1/6 −1/6 ⎦ = AQ. −2/3 4/3 −8/3

6.4 Controller and Observer Forms

265

Multi-Output Case (p > 1) Consider

⎡

c1 .. .

⎤

⎢ ⎥ ⎢ ⎥ ⎢ ⎥ ⎢ cp ⎥ ⎢ ⎤ ⎢ c A ⎥ ⎡ ⎥ C ⎢ 1 ⎥ ⎢ ⎥ . ⎢ CA ⎥ ⎢ .. ⎥ ⎥ ⎢ ⎢ ⎥, O=⎢ ⎥=⎢ .. ⎥ A c ⎦ ⎢ p ⎣ . ⎥ ⎢ ⎥ . n−1 .. CA ⎢ ⎥ ⎢ ⎥ ⎢ c1 An−1 ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ .

(6.68)

cp An−1 where c1 , . . . , cp denote the p rows of C, and select the ﬁrst n linearly independent rows in O, moving from the top to bottom (rank O = n). Next, reorder the selected rows by ﬁrst taking all rows involving c1 , then c2 , etc., to obtain ⎡ ⎤ c1 ⎢ c1 A ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎢ ⎥ . ⎢ ⎥ ⎢ c1 Aν1 −1 ⎥ ⎢ ⎥ ¯⎢ O (6.69) ⎥, .. ⎢ ⎥ . ⎢ ⎥ ⎢ cp ⎥ ⎢ ⎥ ⎢ ⎥ .. ⎣ ⎦ . νp −1 cp A an n × n matrix. The integer νi denotes the number of rows involving ci in the set of the ﬁrst n linearly independent rows found in O when moving from top to bottom. Deﬁnition 6.23. The p integers νi , i = 1, . . . , p, are the observability indices of the system, and ν max νi is called the observability index of the system. Note that p νi = n and pν ≥ n. (6.70) i=1

When rank C = p, then νi ≥ 1. Now deﬁne σ ˜k

k i=1

νi

k = 1, . . . , p;

(6.71)

266

6 Controllability and Observability: Special Forms

¯ −1 and let i.e., σ ˜1 = ν1 , σ ˜2 = ν1 + ν2 , . . . , σ ˜p = ν1 + · · · + νp = n. Consider O n q˜k ∈ R , k = 1, . . . , p, represent its σ ˜k th column; i.e.,

Deﬁne

¯ −1 = [× · · · × q˜1 | × · · · × q˜2 | · · · | × · · · × q˜p ]. O

(6.72)

P −1 = Q = [˜ q1 , . . . , Aν1 −1 q˜1 , . . . , q˜p , . . . , Aνp −1 q˜p ].

(6.73)

Then Ao = P AP ⎡

0···0 ⎢ Aii = ⎣ Iν −1 i

−1

⎤

=Q

−1

AQ and Co = CP

−1

= CQ are given by

Ao = [Aij ],

× .. ⎥ ∈ Rνi ×νi , . ⎦

i, j = 1, . . . , p, ⎡ ⎤ 0 ··· 0 × ⎢ .. .. ⎥ ∈ Rνi ×νj , i = j, Aij = ⎣ ... . .⎦

×

i = j,

0 ··· 0 × ⎡

and

0 ⎢ .. ⎢. ⎢ ⎢0 ⎢ Co = [C1 , C2 , . . . , Cp ], Ci = ⎢ ⎢0 ⎢0 ⎢ ⎢. ⎣ ..

··· 0 .. . ··· 0 ··· 0 ··· 0 .. .

0 ··· 0

⎤ 0 .. ⎥ . ⎥ ⎥ 0⎥ ⎥ p×νi 1⎥ , ⎥∈R ×⎥ ⎥ .. ⎥ . ⎦ ×

(6.74)

where the 1 in the last column of Ci occurs at the ith row location (i = 1, . . . , p) and × denotes nonﬁxed entries. Note that the matrix Bo = P B = Q−1 B does not have any particular structure. Equation (6.74) is a very useful form (in the observer problem) and shall be referred to as the observer form of the system. Analogous to (6.55), we express Ao and Co as Ao = A¯o + Ap C¯o ,

Co = Cp C¯o , ⎡ 0··· ⎢ ¯ where Ao = block diag[A1 , A2 , . . . , Ap ] with Ai = ⎣ Iν −1 i

(6.75) ⎤

0 .. ⎥ ∈ Rνi ×νi , C¯ = o .⎦

0 νi block diag([0, . . . , 0, 1]T ∈ R , i = 1, . . . , p), and Ap ∈ Rn×p , and Cp ∈ Rp×p p are appropriate matrices ( i=1 νi = n). Note that A¯o , C¯o are completely determined by the p observability indices νi , i = 1, . . . , p, and Ap and Cp contain this information in the σ ˜1 th, . . . , σ ˜p th columns of Ao and in the same columns of Co , respectively. ⎡

⎤ 00 0 010 Example 6.24. Given A = ⎣ 1 0 2 ⎦ and C = , we wish to reduce 110 0 1 −1 these to observer form. This can be accomplished using duality, i.e., by ﬁrst

6.4 Controller and Observer Forms

267

( AT , B ( C T to controller form. Note that A, ( B ( are the matrices reducing A used in Example 6.17, and therefore, the desired answer is easily obtained. Presently, we shall follow the direct algorithm described above. We have ⎡ ⎤ 01 0 ⎡ ⎤ ⎢1 1 0⎥ ⎢ ⎥ C ⎢1 0 2⎥ ⎢ ⎥. ⎣ ⎦ O = CA = ⎢ 1 0 2⎥ 2 ⎢ ⎥ CA ⎣ 0 2 −2 ⎦ 0 2 −2 Searching from top to bottom, the ﬁrst three c1 , c2 , c1 A, and ⎡ ⎤ ⎡ c1 01 ¯ = ⎣ c1 A ⎦ = ⎣ 1 0 O c2 11

linearly independent rows are ⎤ 0 2⎦. 0

Note that the observability indices are ν1 = 2, ν2 = 1 and σ ˜1 = 2, σ ˜2 = 3. We compute ⎡ ⎤ ⎡ ⎤ −1 0 1 × 0 1 ¯ −1 = ⎣ 1 0 0 ⎦ = ⎣× 0 0 ⎦. O 1/2 1/2 −1/2 × 1/2 −1/2 ⎡ ⎡ ⎤ ⎤ 0 0 1 112 1 0 ⎦ and Q−1 = ⎣ 0 1 0 ⎦. Therefore, q1 , q˜2 ] = ⎣ 0 Then, Q = [˜ q1 , A˜ 1/2 −1/2 −1/2 100 Ao = Q−1 AQ =

A11 A12 A21 A22

⎤ 0 21 . 010 = ⎣ 1 −1 0 ⎦ , Co = CQ = [C1 ..C2 ] = . 011 0 00 ⎡

We can also verify (6.47), namely ⎤ ⎤ ⎡ ⎡ ⎡ ⎤ 0 21 000 21 010 Ao = ⎣ 1 −1 0 ⎦ = A¯o + Ap C¯o = ⎣ 1 0 0 ⎦ + ⎣ −1 0 ⎦ 001 00 0 00 000

and Co =

010 10 010 . = Cp C¯o = 011 11 001

Structure Theorem—Observable Version The transfer function matrix H(s) of system x˙ = Ax + Bu, y = Cx + Du is given by H(s) = C(sI − A)−1 B + D. If (A, C) is in the observer form, given in (6.74), then H(s) can alternatively be characterized by the Structure

268

6 Controllability and Observability: Special Forms

Theorem stated in Theorem 6.25 below. This result will be very useful in the realization of systems, addressed in Chapter 8 and also in the study of observers in Chapter 9. Let A = Ao = A¯o + Ap C¯o and C = Co = Cp C¯o as in (6.75) with |Cp | = 0; let B = Bo and D = Do , and deﬁne ( diag[sν1 , sν2 , . . . , sνp ], S(s) ( Λ(s) block diag([1, s, . . . , sνi −1 ], i = 1, . . . , p). (6.76) p ( Note that S(s) is a p × n polynomial matrix, where n = i=1 νi . Now deﬁne ( ( (s) as the p × p polynomial matrix D(s) and the p × m polynomial matrix N −1 ( ( − S(s)A ( D(s) [Λ(s) p ]Cp ,

( (s) S(s)B ( ( N o + D(s)Do .

(6.77)

The following result is the observable version of the Structure Theorem. It is the dual of Theorem 6.19 and can therefore be proved using duality arguments. The proof given is direct. ( −1 (s)N ( (s), where N ( (s), D(s) ( Theorem 6.25. H(s) = D are deﬁned in (6.77). Proof. First we note that ( ( D(s)C o = S(s)(sI − Ao ).

(6.78)

−1 ¯ ¯ ( ( ( ¯ ( ( To see this, write D(s)C o = [Λ(s) − S(s)Ap ]Cp Cp Co = Λ(s)Co − S(s)Ap Co , ( ¯ ( ( ¯ ( ¯ and also, S(s)(sI − Ao ) = S(s)s − S(s)(Ao + Ap Co ) = S(s)(sI − Ao ) − ( ¯ ¯ ( ¯ ( S(s)A p Co = Λ(s)Co − S(s)Ap Co , which proves (6.78). We now obtain H(s) = −1 −1 ( ( ( −1 (s)[S(s)B ( ( Co (sI − Ao ) Bo + Do = D (s)S(s)B o + Do = D o + D(s)Do ] = −1 ( ( D (s)N (s).

⎡

⎤ 0 21 010 Example 6.26. Consider Ao = ⎣ 1 −1 0 ⎦ and Co = of Exam011 0 00 2 s 0 1s0 ( ( ple 6.24. Here ν1 = 2, ν2 = 1, Λ(s) = , and S(s) = . Then 0 s ⎡ ⎤⎤0 0 1 ⎡ −1 2 21 10 s 0 1s0 ⎣ −1 ( ( ( ⎦ ⎦ ⎣ −1 0 D(s) = [Λ(s) − S(s)Ap ]Cp = . = − 11 0 s 001 0 0 ⎡⎡ ⎤ ⎡ ⎤⎤ ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ s2 0 ⎦ ⎣ −s + 2 1 ⎦ ⎦ ⎣ 1 0 ⎦ ⎣ s2 + s − 2, −1 ⎦ ⎣ 1 0 ⎦ ⎣ s2 + s − 1 −1 ⎦ ⎣⎣ . − · = · = 0 s 0 0 −1 1 0 s −1 1 −s s T ( (s) = S(s)B ( ( Now if Bo = [0, 1, 1]T , Do = 0, and N o + D(s)Do = [s, 1] , then 1 −1 2 2 T −1 ( (s)N ( (s) = 2 H(s) = D [s +1, 2s +s−1] = Co (sI −Ao ) Bo +Do . s(s +s−2)

6.5 Summary and Highlights

269

6.5 Summary and Highlights •

The standard form for uncontrollable systems is A1 A12 B1 −1 −1 % % A = Q AQ = , , B=Q B= 0 A2 0

(6.6)

where A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m , and (A1 , B1 ) is controllable. nr < n is the rank of the controllability matrix C = [B, AB, . . . , An−1 B]; i.e., rank C = nr . •

The standard form for unobservable systems is % = Q−1 AQ = A1 0 , C % = CQ = C1 , A A21 A2 0

(6.15)

where A1 ∈ Rno ×no , C1 ∈ Rp×no , and (A1 , C1 ) is observable. no < n is the rank of the observability matrix ⎡ % ⎤ C ⎢ C %A % ⎥ ⎢ ⎥ O=⎢ ⎥; .. ⎣ ⎦ . n−1 % % CA i.e., rank O = no . •

•

Kalman’s Decomposition Theorem. ⎤ ⎡ A11 0 A13 0 ⎥ ⎢ % = Q−1 AQ = ⎢ A21 A22 A23 A24 ⎥ , A ⎣ 0 0 A33 0 ⎦ 0 0 A43 A44 % = CQ = [C1 , 0, C3 , 0], C

⎤ B1 ⎢ ⎥ % = Q−1 B = ⎢ B2 ⎥ , B ⎣ 0 ⎦ 0

(6.20)

where (A11 , B1 , C1 ) is controllable and observable. λi is an uncontrollable eigenvalue if and only if vˆi [λi I − A, B] = 0,

•

⎡

where vˆi is the corresponding (left) eigenvector. λi is an unobservable eigenvalue if and only if λi I − A vi = 0, C where vi is the corresponding (right) eigenvector.

(6.23)

(6.24)

270

6 Controllability and Observability: Special Forms

Controller Forms (for Controllable Systems) •

m = 1 case. ⎡

0 1 ⎢ .. .. ⎢ . Ac = ⎢ . ⎣ 0 0 −α0 −α1

⎤ ··· 0 ⎥ .. .. ⎥ . . ⎥, ··· 1 ⎦ · · · −αn−1

⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Bc = ⎢ . ⎥ , ⎣0⎦ 1

(6.36)

where α(s) det(sI − A) = sn + αn−1 sn−1 + · · · + α1 s + α0 . •

(6.37)

m > 1 case. Ac = [Aij ], i, j = 1, . . . , m, ⎡ ⎡ ⎤ 0 0 ··· ⎢ .. ⎢ .. ⎥ .. ⎢ ⎢ ⎥ . Aii = ⎢ . Iμi −1 ⎥ ∈ Rμi ×μi , i = j, Aij = ⎢ . ⎣0 ⎣ 0 ··· ⎦ × ×··· × ×···×

⎤ 0 .. ⎥ .⎥ ⎥ ∈ Rμi ×μj , i = j, 0⎦ ×

and ⎡

B1 ⎢ B2 ⎢ Bc = ⎢ . ⎣ .. Bm

⎤ ⎥ ⎥ ⎥, ⎦

⎡

0 ··· ⎢ .. Bi = ⎣ .

0 .. .

0 ··· .. .

⎤ 0 .. ⎥ ∈ Rμi ×m . .⎦

(6.54)

0 ··· 0 1 ×··· ×

An example for n = 4, m = 2 and μ1 = 2, μ2 = 2 is ⎤ ⎡ ⎡ ⎤ 0 1 0 0 0 0 ⎢× × × ×⎥ ⎢ ⎥ A11 A12 ⎥ , Bc = B1 = ⎢ 1 × ⎥ . Ac = =⎢ ⎦ ⎣ ⎣ A21 A22 B2 0 0 0 1 0 0⎦ ×××× 0 1 • •

¯c Am , Ac = A¯c + B

¯c Bm . Bc = B

(6.55)

Structure theorem—controllable version H(s) = N (s)D−1 (s), where −1 [Λ(s) − Am S(s)], N (s) = Cc S(s) + Dc D(s). D(s) = Bm

(6.61)

Note that (sI − Ac )S(s) = Bc D(s).

(6.62)

6.6 Notes

271

Observer Forms (for Observable Systems) •

p = 1 case. ⎤ 0 · · · 0 −α0 ⎢ 1 · · · 0 −α1 ⎥ ⎥ ⎢ A0 = ⎢ . . . ⎥, .. ⎦ ⎣ .. . . .. . 0 · · · 1 −αn−1 ⎡

•

Co = [0, . . . , 0, 1].

(6.67)

p > 1. i, j = 1, . . . , p, ⎡ ⎤ 0···0 × 0 ··· 0 × ⎥ ⎢ ⎢ .. .. ⎥ ∈ Rνi ×νj , i = j, Aii = ⎣ Iν −1 ... ⎦ ∈ Rνi ×νi , i = j, Aij = ⎣ ... . .⎦ i × 0 ··· 0 × and ⎡ ⎤ 0 ··· 0 0 ⎢ .. .. .. ⎥ ⎢. . .⎥ ⎢ ⎥ ⎢0 ··· 0 0 ⎥ ⎢ ⎥ p×νi ⎥ Co = [C1 , C2 , . . . , Cp ], Ci = ⎢ , (6.74) ⎢0 ··· 0 1 ⎥ ∈ R ⎢0 ··· 0 ×⎥ ⎢ ⎥ ⎢. .. .. ⎥ ⎣ .. . .⎦ ⎡

⎤

Ao = [Aij ],

0 ··· 0 × If (Ac , Bc ) is in controller form, (Ao = ATc , Co = BcT ) will be in observer form. • •

Ao = A¯o + Ap C¯o ,

Co = Cp C¯o .

(6.75)

Structure theorem—observable version ( (s), where ( −1 (s)N H(s) = D −1 ( ( − S(s)A ( D(s) = [Λ(s) p ]Cp ,

Note that

( (s) = S(s)B ( ( N o + D(s)Do .

( ( D(s)C o = S(s)(sI − Ao ).

(6.77)

(6.78)

6.6 Notes Special state-space forms for controllable and observable systems obtained by similarity transformations are discussed at length in Kailath [5]. Wolovich [13] discusses the algorithms for controller and observer forms and introduces the Structure Theorems. The controller form is based on results by Luenberger [9]

272

6 Controllability and Observability: Special Forms

(see also Popov [10]). A detailed derivation of the controller form can also be found in Rugh [12]. Original sources for the Canonical Structure Theorem include Kalman [6] and Gilbert [3]. The eigenvector and rank tests for controllability and observability are called PBH tests in Kailath [5]. Original sources for these include Popov [10], Belevich [2], and Hautus [4]. Consult also Rosenbrock [11], and for the case when A can be diagonalized via a similarity transformation, see Gilbert [3]. Note that in the eigenvalue/eigenvector tests presented herein the uncontrollable (unobservable) eigenvalues are also explicitly identiﬁed, which represents a modiﬁcation of the above original results. The fact that the controllability indices appear in the work of Kronecker was recognized by Rosenbrock [11] and Kalman [8]. For an extensive introductory discussion and a formal deﬁnition of canonical forms, see Kailath [5].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. V. Belevich, Classical Network Theory, Holden-Day, San Francisco, CA, 1968. 3. E. Gilbert, “Controllability and observability in multivariable control systems,” SIAM J. Control, Vol. 1, pp. 128–151, 1963. 4. M.L.J. Hautus, “Controllability and observability conditions of linear autonomous systems,” Proc. Koninklijke Akademie van Wetenschappen, Serie A, Vol. 72, pp. 443–448, 1969. 5. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 6. R.E. Kalman, “Mathematical descriptions of linear systems,” SIAM J. Control, Vol. 1, pp. 152–192, 1963. 7. R.E. Kalman, “On the computation of the reachable/observable canonical form,” SIAM J. Control Optimization, Vol. 20, no. 2, pp. 258–260, 1982. 8. R.E. Kalman, “Kronecker invariants and feedback,” in Ordinary Diﬀerential Equations, L. Weiss, ed., pp. 459–471, Academic Press, New York, NY, 1972. 9. D.G. Luenberger, “Canonical forms for linear multivariable systems,” IEEE Trans. Auto. Control, Vol. 12, pp. 290–293, 1967. 10. V.M. Popov, “Invariant description of linear, time-invariant controllable systems,” SIAM J. Control Optimization, Vol. 10, No. 2, pp. 252–264, 1972. 11. H.H. Rosenbrock, State-Space and Multivariable Theory, Wiley, New York, NY, 1970. 12. W.J. Rugh, Linear System Theory, Second Ed., Prentice-Hall, Englewood Cliﬀs, NJ, 1996. 13. W.A. Wolovich, Linear Multivariable Systems, Springer-Verlag, New York, NY, 1974.

Exercises 6.1. Write software programs to implement the algorithms of Section 6.2. In particular:

Exercises

273

(a) Given the pair (A, B), where A ∈ Rn×n , B ∈ Rn×m with rank[B, AB, . . . , An−1 B] = nr < n, reduce this pair to the standard uncontrollable form A1 A12 B1 −1 % % A = P AP = , ,B = PB = 0 A2 0 where (A1 , B1 ) is controllable and A1 ∈ Rnr ×nr , B1 ∈ Rnr ×m . (b) Given the controllable pair (A, B), where A ∈ Rn×n , B ∈ Rn×m with rank B = m, reduce this pair to the controller form Ac = P AP −1 , Bc = P B. 6.2. Determine the uncontrollable modes of each pair (A, B) given below by (a) Reducing (A, B), using a similarity transformation. (b) Using eigenvalue/eigenvector criteria: ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ 001 0 1 00 10 ⎢0 0 1 0⎥ ⎥ A = ⎣ 0 −1 0 ⎦ , B = ⎣ 0 1 ⎦ and A = ⎢ ⎣0 0 0 0⎦, 0 02 00 0 0 0 −1

⎡

⎤ 01 ⎢0 0⎥ ⎥ B=⎢ ⎣1 0⎦. 00

6.3. Reduce the pair ⎡

⎤ 00 1 0 ⎢ 3 0 −3 1 ⎥ ⎥ A=⎢ ⎣ −1 1 4 −1 ⎦ , 1 0 −1 0

⎡

0 ⎢1 B=⎢ ⎣0 0

⎤ 0 0⎥ ⎥ 1⎦ 0

into controller form Ac = P AP −1 , Bc = P B. What is the similarity transformation matrix in this case? What are the controllability indices? 6.4. Consider

⎡

0 1 ⎢ .. .. ⎢ . Ac = ⎢ . ⎣ 0 0 −α0 −α1 Show that

⎤ ··· 0 ⎥ .. .. ⎥ . . ⎥, ··· 1 ⎦ · · · −αn−1 ⎡

0 ⎢0 ⎢ ⎢ .. ⎢ n−1 C = [Bc , Ac Bc , . . . , Ac Bc ] = ⎢ . ⎢0 ⎢ ⎣0 1

⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Bc = ⎢ . ⎥ . ⎣0⎦ 1

0 0 .. .

0 ··· 0 ··· .. .

1 c1 .. .

⎤

⎥ ⎥ ⎥ ⎥ ⎥, 0 1 · · · cn−3 ⎥ ⎥ 1 c1 · · · cn−2 ⎦ c1 c2 · · · cn−1

274

6 Controllability and Observability: Special Forms

where ck = − that

k−1 i=0

αn−i−1 ck−i−1 , k = 1, . . . , n − 1, with c0 = 1. Also, show ⎤ ⎡ α1 α2 · · · αn−1 1 ⎢ α2 α3 · · · 1 0 ⎥ ⎥ ⎢ ⎢ .. .. .. ⎥ . −1 C = ⎢ ... . . .⎥ ⎥ ⎢ ⎣ αn−1 1 · · · 0 0 ⎦ 1 0 ··· 0 0

6.5. Show that the matrices Ac = P AP −1 , Bc = P B are as follows: (a) Given by (6.41) if P is given by (6.42). (b) Given by (6.44) if Q(= P −1 ) is given by (6.43). (c) Given by (6.46) if Q(= P −1 ) is given by (6.45). 6.6. Consider the pair (A, b), where A ∈ Rn×n , b ∈ Rn . Show that if more than one linearly independent eigenvector can be associated with a single eigenvalue, then (A, b) is uncontrollable. Hint: Use the eigenvector test. Let vˆ1 , vˆ2 be linearly independent left eigenvectors associated with eigenvalue λ1 = λ2 = λ. Notice that if vˆ1 b = α1 and vˆ2 b = α2 , then (α1 vˆ1 − α1 vˆ2 )b = 0. 6.7. Show that if (A, B) is controllable, where A ∈ Rn×n , and B ∈ Rn×m , and rank B = m, then rank A ≥ n − m. 6.8. Given A ∈ Rn×n , and B ∈ Rn×m , let rank C = n, where C = % ∈ Rn×n , B % ∈ Rn×m with rank C% = n, where [B, AB, . . . , An−1 B]. Consider A n−1 % % % % % % C = [B, AB, . . . , A B], and assume that P ∈ Rn×n with det P = 0 exists such that % %A %n B]. P [C, An B] = [C, % = P B and A % = P AP −1 . Hint: Show that (P A − AP % )C = 0. Show that B ¯c Am and B = B ¯c Bm , where the A¯c , B ¯c are as in (6.55) 6.9. Let A = A¯c + B with Am ∈ Rm×n , Bm ∈ Rm×m , and |Bm | = 0. Show that (A, B) is controllable with controllability indices μi . Hint: Use the eigenvalue test to show that (A, B) is controllable. Use state feedback to simplify (A, B) (see Exercise 6.11), and show that the μi are the controllability indices. 6.10. Show that the controllability indices of the state equation x˙ = Ax + BGv, where |G| = 0 and (A, B) is controllable, with A ∈ Rn×n , B ∈ Rn×m , are the same as the controllability indices of x˙ = Ax + Bu, within reordering. Hint: Write C¯k = [BG, ABG, . . . , Ak−1 BG] = [B, AB, . . . , Ak−1 B] · [block diag G] = Ck · [block diag G] and show that the number of linearly dependent columns in Ak BG that occur while searching from left to right in C¯n is the same as the corresponding number in Cn . 6.11. Consider the state equation x˙ = Ax + Bu, where A ∈ Rn×n , B ∈ Rn×m with (A, B) controllable. Let the linear state-feedback control law be u = F x + Gv, F ∈ Rm×n , G ∈ Rm×m with |G| = 0. Show that

Exercises

275

(a) (A + BF, BG) is controllable. (b) The controllability indices of (A + BF, B) are identical to those of (A, B). (c) The controllability indices of (A+BF, BG) are equal to the controllability indices of (A, B) within reordering. Hint: Use the eigenvalue test to show (a). To show (b), use the controller forms in Section 6.4. 6.12. For the system x˙ = Ax + Bu, y = Cx, consider the corresponding ¯x(k) + B ¯u sampled-data system x ¯(k + 1) = A¯ ¯(k), y¯(k) = C¯ x ¯(k), where

AT ¯ ¯ A = e ,B = [

T

eAτ dτ ]B,

and C¯ = C.

0

(a) Let the continuous-time system {A, B, C} be controllable (observable), ¯ B, ¯ C} ¯ is controllable (oband assume it is a SISO system. Show that {A, servable) if and only if the sampling period T is such that Im (λi − λj ) =

2πk , where k = ±1, ±2, . . . whenever Re (λi − λj ) = 0, T

where {λi } are the eigenvalues of A. Hint: Use the PBH test. (b) Apply the results of (a) (Example 3.33 in Chap to the double integrator 01 0 ter 3), where A = , B = , and C = [1, 0], and also to 1 0 0 01 0 A = , B = , C = [1, 0]. Determine the values of T that −1 0 1 preserve controllability (observability). 6.13. (Spring mass system) Consider the spring mass given in Exercise 3.37. (a) Is the system controllable from [f1 , f2 ]T ? If yes, reduce (A, B) to controller form. (b) Is the system controllable from input f1 only? Is it controllable from f2 only? Discuss your answers. 1000 (c) Let y = Cx with C = . Is the system observable from y? If yes, 0100 reduce (A, C) to observer form.

7 Internal and External Descriptions: Relations and Properties

7.1 Introduction In this chapter it is shown how external descriptions of a system, such as the transfer function and the impulse response, depend only on the controllable and observable parts of internal state-space descriptions (Section 7.2). Based on these results, the exact relation between internal (Lyapunov) stability and input–output stability is established in Section 7.3. In Section 7.4 the poles of the transfer function matrix, the poles of the system (eigenvalues), the zeros of the transfer function, the invariant zeros, the decoupling zeros, and their relation to uncontrollable or unobservable eigenvalues are addressed. In the ﬁnal Section 7.5, polynomial matrix and matrix fractional descriptions are introduced. Polynomial matrix descriptions are generalizations of state-space internal descriptions. The matrix fractional descriptions of transfer function matrices oﬀer a convenient way to work with transfer functions in control design and to establish the relations between internal and external descriptions of systems.

7.2 Relations Between State-Space and Input–Output Descriptions In this section it is shown that the input–output description, namely the transfer function or the impulse response of a system, depends only on the part of the state-space representation that is both controllable and observable. The uncontrollable and/or unobservable parts of the system “cancel out” and play no role in the input–output system descriptions. Consider the system x˙ = Ax + Bu,

y = Cx + Du,

(7.1)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , D ∈ Rp×m has p × m. The transfer function matrix

278

7 Internal and External Descriptions: Relations and Properties

% + D, % % % −1 B H(s) = C(sI − A)−1 B + D = C(sI − A)

(7.2)

% B, % C, % D} % is an equivalent representation given in (6.9) with A %= where {A, −1 −1 % = Q B, C % = CQ, and D % = D. Consider now the Kalman DeQ AQ, B composition Theorem in Section 6.2.3 and the representation (6.22). We wish to investigate which of the submatrices Aij , Bi , Cj determine H(s) and which % can be determined by repeated application of do not. The inverse of sI − A the formulas −1 −1 −1 αβ α −α−1 βδ −1 α−1 0 α0 = = and , 0 δ −δ −1 γα−1 δ −1 0 δ −1 γδ (7.3) where α, β, γ, δ are matrices with α and δ square and nonsingular. It turns out that (7.4) H(s) = C1 (sI − A11 )−1 B1 + D, that is, the only part of the system that determines the external description is {A11 , B1 , C1 , D}, the subsystem that is both controllable and observable [see Theorem 6.6(iii)]. Analogous results exist in the time domain. Speciﬁcally, taking the inverse Laplace transform of both sides in (7.4), the impulse response of the system for t ≥ 0 is derived as H(t, 0) = C1 eA11 t B1 + Dδ(t),

(7.5)

which depends only on the controllable and observable parts of the system, as expected. Similar results exist for discrete-time systems described by (6.4). For such systems, the transfer function matrix H(z) and the pulse response H(k, 0) are given by (7.6) H(z) = C1 (zI − A11 )−1 B1 + D and

C1 Ak−1 11 B1 , H(k, 0) = D,

k > 0, k = 0.

(7.7)

Again, these depend only on the part of the system that is both controllable and observable, as in the continuous-time case. Example 7.1. For the system x˙ = Ax + Bu, y = Cx, where A, B, C are as in Examples 6.7 and 6.10, we have H(s) = C(sI −A)−1 B = C1 (sI −A11 )−1 B1 = (1)(1/s)[1, 1] = [1/s, 1/s]. Notice that only the controllable and observable eigenvalue of A, λ1 = 0 (in A11 ), appears in the transfer function as a pole. All other eigenvalues (λ2 = −1, λ3 = −2) cancel out.

7.2 Relations Between State-Space and Input–Output Descriptions +

x 2 (t)

i(t) +

x1(t)

–

C

v(t)

279

L R2

R1 –

Figure 7.1. An RL/RC circuit

Example 7.2. The circuit depicted in Figure 7.1 is described by the statespace equations 0 x˙ 1 (t) −1/(R1 C) x1 (t) 1/(R1 C) v(t) = + x˙ 2 (t) 0 −R2 /L x2 (t) 1/L x (t) i(t) = [−1/R1 , 1] 1 + (1/R1 )v(t), x2 (t) where the voltage v(t) and current i(t) are the input and output variables of the system, x1 (t) is the voltage across the capacitor, and x2 (t) is the current through the inductor. We have ˆi(s) = H(s)ˆ v (s) with the transfer function given by H(s) = C(sI − A)−1 B + D =

1 (R12 C − L)s + (R1 − R2 ) + . (Ls + R2 )(R12 Cs + R1 ) R1

The eigenvalues of A are λ1 = −1/(R1 C) and λ2 = −R2 /L. Note that in λ I −A general rank[λi I − A, B] = rank i = 2 = n; i.e., the system is conC trollable and observable, unless the relation R1 R2 C = L is satisﬁed. In this case, λ1 = λ2 = −R2 /L and the system matrix P (s) assumes the form ⎡ ⎤ 0 R2 /L s + R2 /L sI − A, B 0 s + R2 /L 1/L ⎦ . P (s) = =⎣ −C, D 1/R1 −1 1/R1 In the following discussion, assume that R1 R2 C = L is satisﬁed. (i) Let R1 = R2 and take R2 R1 , [v1 , v2 ] = 1 1

vˆ1 vˆ2

−1

= [v1 , v2 ]

1 = R2 − R1

1 −R1 −1 R2

to be the linearly independent right and left eigenvectors corresponding to the eigenvalues λ1 = λ2 = −R2 /L. The eigenvectors could have been any two linearly independent vectors since λi I − A = 0. They were chosen

280

7 Internal and External Descriptions: Relations and Properties

as above because they also have the property that vˆ2 B = 0 and Cv2 = 0, which in view of Corollary 6.9, implies that λ2 = −R2 /L is both uncontrollable and unobservable. The eigenvalue λ1 = −R both control 2 /L is R2 R1 to reduce the lable and observable, as it can be seen using Q = 1 1 representation to the canonical structure form (Kalman Decomposition Theorem). The transfer function is in this case given by H(s) =

(s + R1 /L)(s + R2 /L) s + R1 /L = ; R1 (s + R2 /L)(s + R2 /L) R1 (s + R2 /L)

that is, only the controllable and observable eigenvalue appears as a pole in H(s), as expected. (ii) Let R1 = R2 = R and take 1R vˆ1 1 −R −1 , . [v1 , v2 ] = = [v1 , v2 ] = 0 1 0 1 vˆ2 In this case vˆ1 B = 0 and Cv2 = 0. Thus, one of the eigenvalues, λ1 = −R/L, is uncontrollable (but can be shown to be observable) and the other eigenvalue, λ2 = −R/L, is unobservable (but can be shown to be controllable). In this case, none of the eigenvalues appear in the transfer function. In fact, H(s) = 1/R, as can readily be veriﬁed. Thus, in this case, the network behaves as a constant resistance network. At this point it should be made clear that the modes that are uncontrollable and/or unobservable from certain inputs and outputs do not actually disappear; they are simply invisible from certain vantage points under certain conditions. (The voltages and currents of this network in the case of constant resistance [H(s) = 1/R] are studied in Exercise 7.2.)

Example 7.3. Consider ⎡ ⎤ ⎡ ⎤ the system x˙ = Ax + Bu, y = Cx, where A = 1 0 0 1 ⎣ 0 −2 0 ⎦, B = ⎣ 0 ⎦, and C = [1, 1, 0]. Using the eigenvalue/eigenvector 0 0 −1 1 test, it can be shown that the three eigenvalues of A (resp., the three modes of A) are λ1 = 1 (resp., et ), which is controllable and observable; λ2 = −2 (resp., e−2t ), which is uncontrollable and observable; and λ3 = −1 (resp., e−t ), which is controllable and unobservable.

7.3 Relations Between Lyapunov and Input–Output Stability

281

The response due to the initial condition x(0) and the input u(t) is

t x(t) = eAt x(0) + eA(t−τ ) Bu(τ )dτ 0 ⎡ t ⎤ ⎡ ⎤

t e(t−τ ) e 0 0 ⎣ 0 ⎦ u(τ )dτ = ⎣ 0 e−2t 0 ⎦ x(0) + 0 0 0 e−t e−(t−τ ) and

t

y(t) = CeAt x(0) +

CeA(t−τ ) Bu(τ )dτ 0

t t −2t e(t−τ ) u(τ )dτ. = [e , e , 0]x(0) + 0

Notice that only controllable modes appear in eAt B [resp., only controllable eigenvalues appear in (sI − A)−1 B], only observable modes appear in CeAt [resp., only observable eigenvalues appear in C(sI − A)−1 ], and only modes that are both controllable and observable appear in CeAt B [resp., only eigenvalues that are both controllable and observable appear in C(sI − A)−1 B = H(s)]. For the discrete-time case, refer to Exercise 7.1d.

7.3 Relations Between Lyapunov and Input–Output Stability In view of the relation between eigenvalues of A and poles of H(s) developed above [see also (7.20) and (7.22)] we are now in a position to provide complete insight into the relation between exponential stability or Lyapunov stability and BIBO (Bounded Input Bounded Output) stability of a system. Consider the system x˙ = Ax + Bu, y = Cx + Du, and recall the following results: (i) The system is asymptotically stable (internally stable, stable in the sense of Lyapunov) if and only if the real parts of all the eigenvalues of A, Reλi (A) i = 1, . . . , n, are negative. Recall also that asymptotic stability is equivalent to exponential stability in the case of linear time-invariant systems. (ii) Let the transfer function be H(s) = C(sI − A)−1 B + D. The system is BIBO stable if and only if the real parts of all the poles of H(s), Repi (H(s)) i = 1, . . . , r, are negative [see Section 4.7]. The relation between the eigenvalues of A and the poles of H(s) is {eigenvalues of A} ⊃ {poles of H(s)}

(7.8)

282

7 Internal and External Descriptions: Relations and Properties

with equality holding when all eigenvalues are controllable and observable [see (7.20), (7.22) and Chapter 8, Theorems 8.9 and 8.12]. Speciﬁcally, the eigenvalues of A may be controllable and observable, uncontrollable and/or unobservable, and the poles of H(s) are exactly the eigenvalues of A that are both controllable and observable. The remaining eigenvalues of A, the uncontrollable and/or unobservable ones, cancel out when H(s) = C(sI − A)−1 B + D is determined. Note also that the uncontrollable/unobservable eigenvalues that cancel correspond to input and output decoupling zeros (see Section 7.4). So the cancellations that take place in forming H(s) are really pole/zero cancellations, i.e., cancellations between poles of the system (uncontrollable and unobservable eigenvalues of A) and zeros of the system (input and output decoupling zeros). It is now straightforward to see that ⇒

{Internal stability} {BIBO stability}; that is, internal stability implies, but is not necessarily implied by, BIBO stability. BIBO stability implies internal stability only when the system is completely controllable and observable ([1, p. 487, Theorem 9.4]).

01 Example 7.4. Consider the system x˙ = Ax + Bu, y = Cx, where A = , 21 0 B= , and C = [−2, 1]. The eigenvalues of A are the roots of |sI − A| = 1 s2 − s − 2 = (s + 1)(s − 2) at {−1, 2}, and so the system is not internally stable (it is not stable in the sense of Lyapunov). The transfer function is H(s) = C(sI − A)−1 B =

1 s−2 = . (s + 1)(s − 2) s+1

Since there is one pole of H(s) at {−1}, the system is BIBO stable, which veriﬁes that BIBO stability does not necessarily imply internal stability. As it can be easily veriﬁed, the −1 eigenvalue of A is controllable and observable and it is the eigenvalue that appears as a pole of H(s) at −1. The other eigenvalue at +2 that is unobservable, which is also the output decoupling zero of the system, cancels in a pole/zero cancellation in H(s) as expected.

7.4 Poles and Zeros In this section the poles and zeros of a time-invariant system are deﬁned and discussed. The poles and zeros are related to the (controllable and observable, resp., uncontrollable and unobservable) eigenvalues of A. These relationships shed light on the eigenvalue cancellation mechanisms encountered when input– output relations, such as transfer functions, are formed.

7.4 Poles and Zeros

283

In the following development, the ﬁnite poles of a transfer function matrix H(s) [or H(z)] are deﬁned ﬁrst (for the deﬁnition of poles at inﬁnity, refer to the Exercise 7.9). It should be noted here that the eigenvalues of A are sometimes called poles of the system {A, B, C, D}. To avoid confusion, we shall use the complete term poles of H(s), when necessary. The zeros of a system are deﬁned using internal descriptions (state-space representations). 7.4.1 Smith and Smith–McMillan Forms To deﬁne the poles of H(s), we shall ﬁrst introduce the Smith form of a polynomial matrix P (s) and the Smith–McMillan form of a rational matrix H(s). The Smith form SP (s) of a p × m polynomial matrix P (s) (in which the entries are polynomials in s) is deﬁned as Λ(s) 0 SP (s) = (7.9) 0 0 with Λ(s) diag[1 (s), . . . , r (s)], where r = rank P (s). The unique monic polynomials i (s) (polynomials with leading coeﬃcient equal to one) are the invariant factors of P (s). It can be shown that i (s) divides i+1 (s), i = 1, . . . , r − 1. Note that i (s) can be determined by i (s) = Di (s)/Di−1 (s),

i = 1, . . . , r,

where Di (s) is the monic greatest common divisor of all the nonzero ith-order minors of P (s) with D0 (s) = 1. The Di (s) are the determinantal divisors of P (s). A matrix P (s) can be reduced to Smith form by elementary row and column operations or by a pre- and post-multiplication by unimodular matrices, namely (7.10) UL (s)P (s)UR (s) = Sp (s). Unimodular Matrices. Let R[s]p×m denote the set of p × m matrices with entries that are polynomials in s with real coeﬃcients. A polynomial matrix U (s) ∈ R[s]p×p is called unimodular (or R[s]-unimodular) if there exists a ˆ (s) ∈ R[s]p×p such that U (s)U ˆ (s) = Ip . This is the same as saying that U −1 ˆ U (s) = U(s) exists and is a polynomial matrix. Equivalently, U (s) is unimodular if det U (s) = α ∈ R, α = 0. It can be shown that every unimodular matrix is a matrix representation of a ﬁnite number of successive elementary row and column operations. See [1, p. 526]. Consider now a p × m rational matrix H(s). Let d(s) be the monic least common denominator of all nonzero entries, and write H(s) =

1 N (s), d(s)

(7.11)

with N (s) a polynomial matrix. Let SN (s) = diag[n1 (s), . . . , nr (s), 0p−r,m−r ] be the Smith form of N (s), where r = rank N (s) = rank H(s). Divide each

284

7 Internal and External Descriptions: Relations and Properties

ni (s) of SN (s) by d(s), canceling all common factors to obtain the Smith– McMillan form of H(s), ˜ 0 Λ(s) SMH (s) = , (7.12) 0 0

r (s) ˜ with Λ(s) diag ψ 11(s) (s) , . . . , ψr (s) , where r = rank H(s). Note that i (s) divides i+1 (s), i = 1, 2, . . . , r −1, and ψi+1 (s) divides ψi (s), i = 1, 2, . . . , r −1. 7.4.2 Poles Pole Polynomial of H(s). Given a p × m rational matrix H(s), its characteristic polynomial or pole polynomial, pH (s), is deﬁned as pH (s) = ψ1 (s) · · · ψr (s),

(7.13)

where the ψi , i = 1, · · · , r, are the denominators of the Smith–McMillan form, SMH (s), of H(s). It can be shown that pH (s) is the monic least common denominator of all nonzero minors of H(s). Deﬁnition 7.5. The poles of H(s) are the roots of the pole polynomial pH (s). Note that the monic least common denominator of all nonzero ﬁrst-order minors (entries) of H(s) is called the minimal polynomial of H(s) and is denoted by mH (s). The mH (s) divides pH (s) and when the roots of pH (s) [poles of H(s)] are distinct, mH (s) = pH (s), since the additional roots in pH (s) are repeated roots of mH (s). It is important to note that when the minors of H(s) [of order 1, 2, . . . , min(p, m)] are formed by taking the determinants of all square submatrices of dimension 1 × 1, 2 × 2, etc., all cancellations of common factors between numerator and denominator polynomials should be carried out. In the scalar case, p = m = 1, Deﬁnition 7.5 reduces to the well-known deﬁnition of poles of a transfer function H(s), since in this case there is only one minor (of order 1), H(s), and the poles are the roots of the denominator polynomial of H(s). Notice that in this case, it is assumed that all the possible cancellations have taken place in the transfer function of a system. Here pH (s) = mH (s), that is, the pole or characteristic polynomial equals the minimal polynomial of H(s). Thus, pH (s) = mH (s) are equal to the (monic) denominator of H(s).

1/[s(s + 1)] 1/s 1 Example 7.6. Let H(s) = . The nonzero minors of 0 0 1/s2 order 1 are the nonzero entries. The least common denominator is s2 (s + 1) = mH (s), the minimal polynomial of H(s). The nonzero minors of order 2 are

7.4 Poles and Zeros

285

1/[s3 (s+1)] and 1/s3 (taking columns 1 and 3, and 2 and 3, respectively). The least common denominator of all minors (of order 1 and 2) is s3 (s+1) = pH (s), the characteristic polynomial of H(s). The poles are {0, 0, 0, −1}. Note that mH (s) is a factor of pH (s), and the additional root at s = 0 in pH (s) is a repeated the Smith–McMillan form of H(s), write H(s) = pole. To obtain 2 (s + 1) s s(s + 1) s 1 1 N (s), where d(s) = s2 (s + 1) = mH (s) = d(s) s2 (s+1) 0 0 (s + 1) [see (7.11)]. The Smith form of N (s) is 1 0 0 SN (s) = 0 s(s + 1) 0 since D0 = 1, D1 = 1, D2 = s(s + 1) [the determinantal divisors of N (s)], and n1 = D1 /D0 = 1, n2 = D2 /D1 = s(s + 1), the invariant factors of N (s). Dividing by d(s), we obtain the Smith–McMillan form of H(s), 1 /ψ1 0 0 1/[s2 (s + 1)] 0 0 SMH (s) = = . 0 2 /ψ2 0 0 1/s 0 Note that ψ2 divides ψ1 and 1 divides 2 . Now the characteristic or pole polynomial of H(s) is pH (s) = ψ1 ψ2 = s3 (s+1) and the poles are {0, 0, 0, −1}, as expected.

1α . If α = 1, then the second-order minor 11 1−α is |H(s)| = (s+2) 2 . The least common denominator of this nonzero secondorder minor |H(s)| and of all the entries of H(s) (the ﬁrst-order minors) is (s + 2)2 = pH (s); i.e., the poles are at {−2, −2}. Also, mH (s) = s + 2. Now if α = 1, then there are only ﬁrst-order nonzero minors (|H(s)| = 0). In this case pH (s) = mH (s) = s + 2, which is quite diﬀerent from the case when α = 1. Presently, there is only one pole at −2. Example 7.7. Let H(s) =

1 s+2

As will be shown in Chapter 8 via Theorems 8.9 and 8.12, the poles of H(s) are exactly the controllable and observable eigenvalues of the system (in A11 ) and no factors of |sI − A11 | in H(s) cancel [see (7.52)]. In general, for the set of poles of H(s) and the eigenvalues of A, we have {Poles of H(s)} ⊂ {eigenvalues of A},

(7.14)

with equality holding when all the eigenvalues of A are controllable and observable eigenvalues of the system. Similar results hold for discrete-time systems and H(z).

286

7 Internal and External Descriptions: Relations and Properties

⎡

⎤ ⎡ ⎤ 0 −1 1 10 Example 7.8. Consider A = ⎣ 1 −2 1 ⎦, B = ⎣ 1 1 ⎦, and C = [0, 1, 0]. 0 1 −1 12 Then the transfer function H(s) = [1/s, 1/s]. H(s) has only one pole, s1 = 0 (pH (s) = s), and λ1 = 0, is the only controllable and observable eigenvalue. The other two eigenvalues of A, λ2 = −1, λ3 = −2, which are not both controllable and observable, do not appear as poles of H(s). Example 7.9. Recall the circuit in Example 7.2 in Section 7.2. If R1 R2 C = L, then {poles of H(s)} = {eigenvalues of A at λ1 = −1/(R1 C) and λ2 = −R2 /L}. In this case, both eigenvalues are controllable and observable. Now if R1 R2 C = L with R1 = R2 , then H(s) has only one pole, s1 = −R2 /L, since in this case only one eigenvalue λ1 = −R2 /L is controllable and observable. The other eigenvalue λ2 at the same location −R2 /L is uncontrollable and unobservable. Now if R1 R2 C = L with R1 = R2 = R, then one of the eigenvalues becomes uncontrollable and the other (also at −R/L) becomes unobservable. In this case H(s) has no ﬁnite poles (H(s) = 1/R).

7.4.3 Zeros In a scalar transfer function H(s), the roots of the denominator polynomial are the poles, and the roots of its numerator polynomial are the zeros of H(s). As was discussed, the poles of H(s) are some or all of the eigenvalues of A (the eigenvalues of A are sometimes also called poles of the system {A, B, C, D}). In particular, the uncontrollable and/or unobservable eigenvalues of A can never be poles of H(s). In Chapter 8 (Theorems 8.9 and 8.12), it is shown that only those eigenvalues of A that are both controllable and observable appear as poles of the transfer function H(s). Along similar lines, the zeros of H(s) (to be deﬁned later) are some or all of the characteristic values of another matrix, the system matrix P (s). These characteristic values are called the zeros of the system {A, B, C, D}. The zeros of a system for both the continuous- and the discrete-time cases are deﬁned and discussed next. We consider now only ﬁnite zeros. For the case of zeros at inﬁnity, refer to the exercises. Let the system matrix (also called Rosenbrock’s system matrix ) of {A, B, C, D} be sI − A B P (s) . (7.15) −C D Note that in view of the system equations x˙ = Ax + Bu, y = Cx + Du, we have −ˆ x(s) 0 P (s) = , u ˆ(s) yˆ(s) where x ˆ(s) denotes the Laplace transform of x(t).

7.4 Poles and Zeros

287

Zero Polynomial of (A, B, C, D). Let r = rank P (s) [note that n ≤ r ≤ min(p + n, m + n)], and consider all those rth order nonzero minors of P (s) that are formed by taking the ﬁrst n rows and n columns of P (s), i.e., all rows and columns of sI − A, and then adding appropriate r − n rows (of [−C, D] ) and columns (of [B T , DT ]T ). The zero polynomial of the system {A, B, C, D}, zp (s), is deﬁned as the monic greatest common divisor of all these minors. Deﬁnition 7.10. The zeros of the system {A, B, C, D} or the system zeros are the roots of the zero polynomial of the system, zP (s). In addition, we deﬁne the invariant zeros of the system as the roots of the invariant polynomials of P (s). In particular, consider the (p + n) × (m + n) system matrix P (s) and let Λ(s) 0 , Λ(s) = diag[1 (s), . . . , r (s), 0] (7.16) SP (s) = 0 0 be its Smith form. The invariant zero polynomial of the system {A, B, C, D} is deﬁned as (7.17) zPI (s) = 1 (s)2 (s) · · · r (s), and its roots are the invariant zeros of the system. It can be shown that the monic greatest common divisor of all the highest order nonzero minors of P (s) equals zPI (s). In general, {zeros of the system} ⊃ {invariant zeros of the system}. When p = m with det P (s) = 0, then the zeros of the system coincide with the invariant zeros. Now consider the n × (m + n) matrix [sI − A, B] and determine its n invariant factors i (s) and its Smith form. The product of its invariant factors is a polynomial, the roots of which are the input-decoupling zeros of the system {A, B, C, D}. Note that this polynomial equals the monic greatest common divisor of all the highest order nonzero minors (of order n) of [sI − A, B]. sI − A Similarly, consider the (p + n) × n matrix and its invariant poly−C nomials, the roots of which deﬁne the output-decoupling zeros of the system {A, B, C, D}. Using the above deﬁnitions, it is not diﬃcult to show that the inputdecoupling zeros of the system are eigenvalues of A and also zeros of the system {A, B, C, D}. In addition note that if λi is such an input-decoupling zero, then rank[λi I − A, B] < n, and therefore, there exists a 1 × n vector vˆi = 0 such that vˆi [λi I − A, B] = 0. This, however, implies that λi is an uncontrollable eigenvalue of A (and vˆi is the corresponding left eigenvector), in view of Section 6.3. Conversely, it can be shown that an uncontrollable eigenvalue is an input-decoupling zero. Therefore, the input-decoupling zeros

288

7 Internal and External Descriptions: Relations and Properties

of the system {A, B, C, D} are the uncontrollable eigenvalues of A. Similarly, it can be shown that the output-decoupling zeros of the system {A, B, C, D} are the unobservable eigenvalues of A. They are also zeros of the system, as can easily be seen from the deﬁnitions. There are eigenvalues of A that are both uncontrollable and unobservable. These can be determined using the left and right corresponding eigenvector test or by the Canonical Structure Theorem (Kalman Decomposition Theorem) (see Sections 6.2 and 6.3). These uncontrollable and unobservable eigenvalues of A are zeros of the system that are both input- and output-decoupling zeros and are called input–output decoupling zeros. These input–output decoupling zeros can also be deﬁned directly from P (s) given in (7.15); however, care should be taken in the case of repeated zeros. If the zeros of a system are determined and the zeros that are input- and/or output-decoupling zeros are removed, then the zeros that remain are the zeros of H(s) and can be found directly from the transfer function H(s). Zero Polynomial of H(s). In particular, if the Smith–McMillan form of H(s) is given by (7.12), then zH (s) = 1 (s)2 (s) · · · r (s)

(7.18)

is the zero polynomial of H(s) and its roots are the zeros of H(s). These are also called the transmission zeros of the system. Deﬁnition 7.11. The zeros of H(s) or the transmission zeros of the system are the roots of the zero polynomial of H(s), zH (s). When P (s) is square and nonsingular, the relationship between the zeros of the system and the zeros of H(s) can easily be determined. Consider the identity sI − A B sI − A 0 I (sI − A)−1 B P (s) = = −C D −C I 0 H(s) and note that |P (s)| = |sI − A| |H(s)|. In this case, the invariant zeros of the system [the roots of |P (s)|], which are equal here to the zeros of the system, are the zeros of H(s) [the roots of |H(s)|] and those eigenvalues of A that are not both controllable and observable [the ones that do not cancel in |sI − A||H(s)|]. Note that the zero polynomial of H(s), zH (s), equals the monic greatest common divisor of the numerators of all the highest order nonzero minors in H(s) after all their denominators have been set equal to pH (s), the characteristic polynomial of H(s). In the scalar case (p = m = 1), our deﬁnition of the zeros of H(s) reduces to the well-known deﬁnition of zeros, namely, the roots of the numerator polynomial of H(s).

7.4 Poles and Zeros

289

Example 7.12. Consider H(s) of Example 7.6. From the Smith–McMillan form of H(s), we obtain the zero polynomial zH (s) = 1, and H(s) has no (ﬁnite) zeros. Alternatively, the highest order nonzero minors are 1/[s3 (s + 1)] and 1/s3 = (s + 1)/[s3 (s + 1)] and the greatest common divisor of the numerators is zH (s) = 1.

s 0 s+1 Example 7.13. We wish to determine the zeros of H(s) = 1 s+1 . The s+1 s2 s 1 , s+1 , s+1 ﬁrst-order minors are the entries of H(s), namely s+1 s2 , and there s s+1 1 is only one second-order minor s+1 · s2 = s . Then pH (s) = s2 (s + 1), the least common denominator, is the characteristic polynomial. Next, write the s(s+1) highest (second-) order minor as 1s = ss(s+1) 2 (s+1) = p (s) and note that s(s + 1) H is the zero polynomial of H(s), zH (s), and the zeros of H(s) are {0, −1}. It is worth noting that the poles and zeros of H(s) are at the same locations. This may happen only when H(s) is a matrix. 1 If the Smith–McMillan form of H(s) is to be used, write H(s) = s2 (s+1) 3 1 0 0 s 1 = d(s) N (s). The Smith form of N (s) is now 0 s3 (s + 1)2 s2 (s + 1)2 since D0 = 1, D1 = 1, D2 = s3 (s + 1)2 with invariant factors of N (s) given by n1 = D1 /D0 = 1 and n2 = D2 /D1 = s3 (s + 1)2 . Therefore, the Smith– McMillan form (7.12) of H(s) is 1 0 2 1 /ψ1 0 s (s+1) SMH (s) = = . s(s+1) 0 2 /ψ2 0 1

The zero polynomial is then zH (s) = 1 2 = s(s+1), and the zeros of H(s) are {0, −1}, as expected. Also, the pole polynomial is pH (s) = ψ1 ψ2 = s2 (s + 1), and the poles are {0, 0, −1}. ⎡ Example 7.14. We wish to determine the zeros of H(s) = ⎣

s s+1 0 1 s+1 s+1 s2 0 1s

⎤ ⎦.

1 1 The second-order minors are 1s , s+1 , s(s+1) , and the characteristic polyno2 mial is pH (s) = s (s + 1). Rewriting the highest (second-) order minors as s(s+1)/pH (s), s2 /pH (s), and s/pH (s), the greatest common divisor of the numerators is s; i.e., the zero polynomial of H(s) is zH (s) = s. Thus, there is only one zero of H(s) located at 0. Alternatively, note that the Smith–McMillan form is ⎤ ⎡ 1/[s2 (s + 1)] 0 0 s/1 ⎦ . SMH (s) = ⎣ 0 0

290

7 Internal and External Descriptions: Relations and Properties

7.4.4 Relations Between Poles, Zeros, and Eigenvalues of A Consider the system x˙ = Ax + Bu, y = Cx + Du and its transfer function matrix H(s) = C(sI − A)−1 B + D. Summarizing the above discussion, the following relations can be shown to be true. 1. We have the set relationship {zeros of the system} = {zeros of H(s)} ∪ {input-decoupling zeros} ∪ {output-decoupling zeros} − {input–output decoupling zeros}.

(7.19)

Note that the invariant zeros of the system contain all the zeros of H(s) (transmission zeros), but not all the decoupling zeros (see Example 7.15). When P (s) is square and nonsingular, the zeros of the system are exactly the invariant zeros of the system. Also, in the case when {A, B, C, D} is controllable and observable, the zeros of the system, the invariant zeros, and the transmission zeros [zeros of H(s)] all coincide. 2. We have the set relationship {eigenvalues of A (or poles of the system)} = {poles of H(s)} ∪ {uncontrollable eigenvalues of A} ∪ {unobservable eigenvalues of A} − {both uncontrollable and unobservable eigenvalues of A}.

(7.20)

3. We have the set relationships {input-decoupling zeros} = {uncontrollable eigenvalues of A }, {output-decoupling zeros} = {unobservable eigenvalue of A}, and {input–output decoupling zeros} = {eigenvalues of A that are both uncontrollable and unobservable}. (7.21) 4. When the system {A, B, C, D} is controllable and observable, then {zeros of the system} = {zeros ofH(s)} and {eigenvalues of A (or poles of the system)} = {poles of H(s)}. (7.22) Note that the eigenvalues of A (the poles of the system) can be deﬁned as the roots of the invariant factors of sI − A in P (s) given in (7.15).

7.4 Poles and Zeros

291

Example 7.15. Consider the system {A, B, C} of Example 7.8. Let ⎡ ⎤ s 1 −1 1 0 ⎢ −1 s + 2 −1 1 1 ⎥ sI − A B ⎥ P (s) = =⎢ ⎣ 0 −1 s + 1 1 2 ⎦ . −C D 0 −1 0 00 There are two fourth-order minors that include all columns of sI − A obtained by taking columns 1, 2, 3, 4 and columns 1, 2, 3, 5 of P (s); they are (s + 1)(s + 2) and (s + 1)(s + 2). The zero polynomial of the system is zP = (s+1)(s+2), and the zeros of the system are {−1, −2}. To determine the input-decoupling zeros, consider all the third-order minors of [sI − A, B]. The greatest common divisor is s + 2, which implies that the input-decoupling sI − A zeros are {−2}. Similarly, consider and show that s + 1 is the −C greatest common divisor of all the third-order minors and that the outputdecoupling zeros are {−1}. The transfer function for this example was found in Example 7.8 to be H(s) = [1/s, 1/s]. The zero polynomial of H(s) is zH (s) = 1, and there are no zeros of H(s). Notice that there are no input–output decoupling zeros. It is now clear that relation (7.19) holds. The controllable (resp., uncontrollable) and the observable (resp., unobservable) eigenvalues of A (poles of the system) have been found in Example 6.10. Compare these results to show that (7.21) holds. The poles of H(s) are {0}. Verify that (7.20) holds. One could work with the Smith form of the matrices of interest and the Smith–McMillan form ⎡ of H(s). In ⎤particular, it can be shown that the ⎡ ⎤ 100 0 0 10 0 00 ⎢0 1 0 ⎥ 0 0 ⎥ , of [sI − A, B] is ⎣ 0 1 0 0 0 ⎦ , Smith form of P (s) is ⎢ ⎣0 0 1 0 0⎦ 0 0 s+2 0 0 0 0 0 (s + 2) 0 ⎡ ⎤ ⎤ ⎡ 10 0 10 0 ⎢0 1 0 ⎥ sI − A ⎥ ⎦ . Also, ⎣ 0 of is ⎢ ⎣ 0 0 s + 1 ⎦ , and of [sI − A] is 0 1 −C 0 0 s(s + 1)(s + 2) 00 0 it can be shown that the Smith–McMillan form of H(s) is SMH (s) = [1/s, 0]. It is straightforward to verify the above results. Note that in the present case the invariant zero polynomial is zPI (s) = s + 2 and there is only one invariant zero at −2. Example 7.16. Consider the circuit of Example 7.9 and of Example 7.2 and the system matrix P (s) for the case when R1 R2 C = L given by

292

7 Internal and External Descriptions: Relations and Properties

⎤ ⎡ 0 R2 /L s + R2 /L sI − A B 0 s + R2 /L 1/L ⎦ . P (s) = =⎣ −C D 1/R1 −1 1/R1

(i) First, let R1 = R2 . To determine the zeros of the system, consider |P (s)| = (1/R1 )(s+R1 /L)(s+R2 /L), which implies that the zeros of the system are {−R1 /L, −R2 /L}. Consider now all second-order (nonzero) minors of [sI− A, B], namely, (s+R2 /L)2 , (1/L)(s+R2 /L) and −(R2 /L)(s+R2 /L), from which we see that {−R2 /L} is the input-decoupling zero. Similarly, we also see that {−R2 /L} is the output-decoupling zero. Therefore, {−R2 /L} is the input–output decoupling zero. Compare this with the results in Example 7.9 to verify (7.22). (ii) When R1 = R2 = R, then |P (s)| = (1/R)(s + R/L)2 , which implies that the zeros of the system are at {−R/L, −R/L}. Proceeding as in (i), it can readily be shown that {−R/L} is the input-decoupling zero and {−R/L} is the output-decoupling zero. To determine which are the input–output decoupling zeros, one needs additional information to the zero location. This information can be provided by the left and right eigenvectors of the two zeros at −R/L to determine that there is no input–output decoupling zero in this case (see Example 7.2). In both cases (i) and (ii), H(s) has been derived in Example 7.2. Verify relation (7.19). Finally, note that there are characteristic vectors or zero directions, associated with each invariant and decoupling zero of the system {A, B, C, D}, just as there are characteristic vectors or eigenvectors, associated with each eigenvalue of A (pole of the system) (see [1, p. 306, Section 3.5]). For pole-zero cancellations to take place in the case of multi-input or output systems when the transfer function matrix is formed, not only the pole, zero locations must be the same but also their characteristic directions must be aligned.

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems In this section, representations of linear time-invariant systems based on polynomial matrices, called Polynomial Matrix Description (PMD) [or Diﬀerential (Diﬀerence) Operator Representation (DOR)] are introduced. Such representations arise naturally when diﬀerential (or diﬀerence) equations are used to describe the behavior of systems, and the diﬀerential (or diﬀerence) operator is introduced to represent the operation of diﬀerentiation (or of time-shift). Polynomial matrices in place of polynomials are involved since this approach is typically used to describe multi-input, multi-output systems. Note that statespace system descriptions only involve ﬁrst-order diﬀerential (or diﬀerence)

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

293

equations, and as such, PMDs include the state-space descriptions as special cases. A rational function matrix can be written as a ratio or fraction of two polynomial matrices or of two rational matrices. If the transfer function matrix of a system is expressed as a fraction of two polynomial or rational matrices, this leads to a Matrix Fraction(al) Description (MFD) of the system. The MFDs that involve polynomial matrices, called polynomial MFDs, can be viewed as representations of internal realizations of the transfer function matrix; that is, they can be viewed as system PMDs of special form. These polynomial fractional descriptions (PMFDs) help establish the relationship between internal and external system representations in a clear and transparent manner. This can be used to advantage, for example, in the study of feedback control problems, leading to clearer understanding of the phenomena that occur when systems are interconnected in feedback conﬁgurations. The MFDs that involve ratios of rational matrices, in particular ratios of proper and stable rational matrices, oﬀer convenient characterizations of transfer functions in feedback control problems. MFDs that involve ratios of polynomial matrices and ratios of proper and stable rational matrices are essential in parameterizing all stabilizing feedback controllers. Appropriate selection of the parameters guarantees that a closedloop system is not only stable, but it will also satisfy additional control criteria. This is precisely the approach taken in optimal control methods, such as H ∞ optimal control. Parameterizations of all stabilizing feedback controllers are studied in Chapter 10. We note that extensions of MFDs are also useful in linear, time-varying systems and in nonlinear systems. These extensions are not addressed here. In addition to the importance of MFDs in characterizing all stabilizing controllers, and in H ∞ -optimal control, PMFDs and PMDs have been used in other control design methodologies as well (e.g., self-tuning control). The use of PMFDs in feedback control leads in a natural way to the polynomial Diophantine matrix equation, which is central in control design when PMDs are used and which directly leads to the characterization of all stabilizing controllers. Finally, PMDs are generalizations of state-space descriptions, and the use of PMDs to characterize the behavior of systems oﬀers additional insight and ﬂexibility. Detailed treatment of all these issues may be found in [1, Chapter 7]. The development of the material in this section is concerned only with continuous-time systems; however, completely analogous results are valid for discrete-time systems and can easily be obtained by obvious modiﬁcations. In this section we emphasize PMFD and discuss controllability, observability, and stability. An Important Comment on Notation. We will be dealing with matrices with entries polynomials in s or q, denoted by, e.g., D(s) or D(q), where s is the Laplace variable and q d/dt, the diﬀerential operator. For simplicity of notation we frequently omit the argument s or q and we write D to denote the polynomial matrix on hand. When ambiguity may arise, or when it is

294

7 Internal and External Descriptions: Relations and Properties

important to stress the fact that the matrix in question is a polynomial matrix, the argument will be included. 7.5.1 A Brief Introduction to Polynomial and Fractional Descriptions Below, the Polynomial Matrix Description (PMD) and the Matrix Fractional Description (MFD) of a linear, time-invariant system are introduced via a simple illustrating example. Example 7.17. In the ordinary diﬀerential equation representation of a system given by y¨1 (t) + y1 (t) + y2 (t) = u˙ 2 (t) + u1 (t), y˙ 1 (t) + y˙ 2 (t) + 2y2 (t) = u˙ 2 (t),

(7.23)

y1 (t), y2 (t) and u1 (t), u2 (t) denote, respectively, outputs and inputs of interest. We assume that appropriate initial conditions for the ui (t), yi (t) and their derivatives at t = 0 are given. By changing variables, one can express (7.23) by an equivalent set of ﬁrstorder ordinary diﬀerential equations, in the sense that this set of equations will generate all solutions of (7.23), using appropriate initial conditions and the same inputs. To this end, let x1 = y˙ 1 − u2 ,

x2 = y1 ,

x3 = y1 + y2 − u2 .

(7.24)

Then (7.23) can be written as x˙ = Ax + Bu, ⎡

y = Cx + Du,

(7.25)

⎤

x1 (t) u1 (t) y (t) where x(t) = ⎣ x2 (t) ⎦, u(t) = , y(t) = 1 , and u2 (t) y2 (t) x3 (t) ⎡ ⎤ ⎡ ⎤ 0 0 −1 1 −1 0 10 00 ⎣ ⎦ ⎣ ⎦ A= 10 0 , B= 0 1 , C= , D= 0 −1 1 01 0 2 −2 0 −2 with initial conditions x(0) calculated by using (7.24). More directly, however, system (7.23) can be represented by P (q)z(t) = Q(q)u(t), y(t) = R(q)z(t) + W (q)u(t), u1 (t) y1 (t) z1 (t) , u(t) = , y(t) = , and where z(t) = z2 (t) u2 (t) y2 (t)

(7.26)

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

P (q) =

q2 + 1 1 , q q+2

Q(q) =

1q , 0q

R(q) =

10 , 01

295

W (q) =

00 00

d , the diﬀerential operator. The variables z1 (t), z2 (t) are called with q dt partial state variables, z(t) denotes the partial state of the system description (7.26), and u(t) and y(t) denote the input and output vectors, respectively.

Polynomial Matrix Descriptions (PMDs) Representation (7.26), also denoted as {P (q), Q(q), R(q), W (q)}, is an example of a Polynomial Matrix Description (PMD) of a system. Note that the statespace description (7.25) is a special case of (7.26). To see this, write (7.25) as (qI − A)x(t) = Bu(t), y(t) = Cx(t) + Du(t). (7.27) Clearly, description {qI − A, B, C, D} is a special case of the general Polynomial Matrix Description {P (q), Q(q), R(q), W (q)} with P (q) = qI − A, Q(q) = B, R(q) = C, W (q) = D.

(7.28)

The above example points to the fact that a PMD of a system can be derived in a natural way from diﬀerential (or diﬀerence) equations that involve variables that are directly connected to physical quantities. By this approach, it is frequently possible to study the behavior of physical variables directly without having to transform the system to a state-space description. The latter may involve (state) variables that are quite removed from the physical phenomena they represent, thus losing physical insight when studying a given problem. The price to pay for this additional insight is that one has to deal with diﬀerential (or diﬀerence) equations of order greater than one. This typically adds computational burdens. We note that certain special forms of PMDs, namely the polynomial Matrix Fractional Descriptions, are easier to deal with than general forms. However, a change of variables may again be necessary to obtain such forms. Consider a general PMD of a system given by P (q)z(t) = Q(q)u(t),

y(t) = R(q)z(t) + W (q)u(t),

(7.29)

with P (q) ∈ R[q]l×l , Q(q) ∈ R[q]l×m , and R(q) ∈ R[q]p×l , W (q) ∈ R[q]p×m , where R[q]l×l denotes the set of l × l matrices with entries that are real polynomials in q. The transfer function matrix H(s) of (7.29) can be determined by taking the Laplace transform of both sides of the equation assuming zero initial conditions (z(0) = z(0) ˙ = · · · = 0, u(0) = u(0) ˙ = · · · = 0). Then H(s) = R(s)P −1 (s)Q(s) + W (s).

(7.30)

For the special case of state-space representations, H(s) in (7.30) assumes the well-known expression H(s) = C(sI − A)−1 B + D. For the study of the relationship between external and internal descriptions, (7.30) is not particularly

296

7 Internal and External Descriptions: Relations and Properties

convenient. There are, however, special cases of (7.30) that are very convenient to use in this regard. In particular, it can be shown [1, Section 7.3] that if the system is controllable, then there exists a representation equivalent to (7.29), which is of the form Dc (q)zc (t) = u(t),

y(t) = Nc (q)zc (t),

(7.31)

where Dc (q) ∈ R[q]m×m and Nc (q) ∈ R[q]p×m . Representation (7.31) is obtained by letting Q(q) = Im and W (q) = 0 in (7.29) and using D and N instead of P and R. Equation (7.30) now becomes H(s) = Nc (s)Dc (s)−1 ,

(7.32)

where Nc (s) and Dc (s) represent the matrix numerator and matrix demonimator of the transfer function, respectively. Similarly, if the system is observable, there exists a representation equivalent to (7.29), which is of the form Do (q)zo (t) = No (q)u(t),

y(t) = zo (t),

(7.33)

where Do (q) ∈ R[q]p×p and No (q) ∈ R[q]p×m . Representation (7.33) is obtained by letting in (7.29) R(q) = Ip and W (q) = 0 with P (q) = Do (q) and Q(q) = No (q). Here, (7.34) H(s) = Do−1 (s)No (s). Note that (7.32) and (7.34) are generalizations to the MIMO case of the SISO system expression H(s) = n(s)/d(s). As H(s) = n(s)/d(s) can be derived directly from the diﬀerential equation d(q)y(t) = n(q)u(t), by taking the Laplace transform and assuming that the initial conditions are zero, (7.34) can be derived directly from (7.33). Returning now to (7.25) in Example 7.17, notice that the system is observable (state observable from the output y). Therefore, the system in this case can be represented by a description of the form {Do , No , I2 , 0}. In fact, (7.26) is such a description, where Do and No are equal to P and Q, respectively, i.e., q2 + 1 1 1q Do (q) = . The transfer function matrix is , and No (q) = 0q q q+2 given by ⎡ ⎤−1 ⎡ ⎤ s 0 1 1 −1 0 1 0 00 −1 ⎣ ⎣ ⎦ ⎦ −1 s 0 0 1 + H(s) = C(sI − A) B + D = 0 −1 1 01 0 −2 s + 2 0 −2 2 −1 s + 1, 1 1s −1 = Do (s)No (s) = 0s s, s + 2 1s s + 2 −1 s + 2 s(s + 1) 1 1 = s3 +2s2 +2 = s3 +2s2 +2 . 0s −s s2 + 1 −s s(s2 − s + 1)

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

297

Matrix Fractional Descriptions (MFDs) of System Transfer Matrices A given p × m proper, rational transfer function matrix H(s) of a system can be represented as −1 −1 (s) = DL (s)NL (s), H(s) = NR (s)DR

(7.35)

where NR (s) ∈ R[s]p×m , DR (s) ∈ R[s]m×m and NL (s) ∈ R[s]p×m , DL (s) ∈ R[s]p×p . The pairs {NR (s), DR (s)} and {DL(s), NL (s)} are called Polynomial Matrix Fractional Descriptions (PMFDs) of the system transfer matrix with {NR (s), DR (s)} termed a right Fractional Description and {DL (s), NL (s)} a left Fractional Description. Notice that in view of (7.32), the right Polynomial Matrix Fractional Description (rPMFD) corresponds to the controllable Polynomial Matrix Description (PMD) given in (7.31). That is, {DR , Im , NR , 0}, or DR (q)zR (t) = u(t), y(t) = NR (q)zR (t), (7.36) is a controllable PMD of the system with transfer function H(s). The subscript c was used in (7.31) and (7.32) to emphasize the fact that Nc , Dc originated from an internal description that was controllable. In (7.35) and (7.36), the subscript R is used to emphasize that {NR , DR } is a right fraction representation of the external description H(s). Similarly, in view of (7.34), the left Polynomial Matrix Fractional Description (lPMFD) corresponds to the observable Polynomial Matrix Description (PMD) given in (7.33). That is, {DL , NL , Ip , 0}, or DL (q)zL (t) = NL (q)u(t),

y(t) = zL (t),

(7.37)

is an observable PMD of the system with transfer function H(s). Comments analogous to the ones made above concerning controllable and right fractional descriptions (subscripts c and R) can also be made here concerning the subscripts o and L. An MFD of a transfer function may not consist necessarily of ratios of polynomial matrices. In particular, given a p × m proper transfer function matrix H(s), one can write % −1 (s) = D % −1 (s)N %L (s), %R (s)D H(s) = N R L

(7.38)

% R, D % L, N %L are proper and stable rational matrices. To illustrate, %R , D where N in the example considered above, H(s) can be written as 1 s + 2 s(s + 1) H(s) = 3 s + 2s2 + 2 −s s(s2 − s + 1 −1 2 −1 −1 (s + 1)2 0 (s + 1)2 0 s +1 1 1s = 0s 0 s+2 s s+2 0 s+2 −1 2 1 s s +1 1 2 (s+1)2 (s+1)2 (s+1)2 (s+1) % −1 (s)N %L (s). =D = s L s 0 1 s+2 s+2 % L (s) and N %L (s) are proper and stable rational matrices. Note that D

298

7 Internal and External Descriptions: Relations and Properties

Such representations of proper transfer functions oﬀer certain advantages when designing feedback control systems. They are discussed further in [1, Section 7.4D]. 7.5.2 Coprimeness and Common Divisors Coprimeness of polynomial matrices is one of the most important concepts in the polynomial matrix representation of systems since it is directly related to controllability and observability. A polynomial g(s) is a common divisor (cd) of polynomials p1 (s), p2 (s) if and only if there exist polynomials p˜1 (s), p˜2 (s) such that p1 (s) = p˜1 (s)g(s),

p2 (s) = p˜2 (s)g(s).

(7.39)

The highest degree cd of p1 (s), p2 (s), g ∗ (s), is a greatest common divisor (gcd) of p1 (s), p2 (s). It is unique within multiplication by a nonzero real number. Alternatively, g ∗ (s) is a gcd of p1 (s), p2 (s) if and only if any cd g(s) of p1 (s), p2 (s) is a divisor of g ∗ (s) as well; that is, g ∗ (s) = m(s)g(s)

(7.40)

with m(s) a polynomial. The polynomials p1 (s), p2 (s) are coprime (cp) if and only if a gcd g ∗ (s) is a nonzero real. The above can be extended to matrices. In this case, both right divisors and left divisors must be deﬁned, since in general, two polynomial matrices do not commute. Note that one may talk about right or left divisors of polynomial matrices only when the matrices have the same number of columns or rows, respectively. An m × m matrix GR (s) is a common right divisor (crd) of the p1 × m polynomial matrix P1 (s) and the p2 ×m matrix P2 (s), if there exist polynomial matrices P1R (s), P2R (s) so that P1 (s) = P1R (s)GR (s),

P2 (s) = P2R (s)GR (s).

(7.41)

Similarly, a p × p polynomial matrix GL (s) is a common left divisor (cld) of the p × m1 polynomial matrix P%1 (s) and the p × m2 matrix P%2 (s), if there exist polynomial matrices P%1L (s), P%2L (s) so that P%1 (s) = GL (s)P%1L (s),

P%2 (s) = GL (s)P%2L (s).

(7.42)

Also G∗R (s) is a greatest common right divisor (gcrd) of P1 (s) and P2 (s) if and only if any crd GR (s) is an rd of G∗R (s). Similarly, G∗L (s) is a greatest common left divisor (gcld) of P%1 (s) and P%2 (s) if and only if any cld GL (s) is a ld of G∗L (s). That is, G∗R (s) = M (s)GR (s),

G∗L (s) = GL (s)N (s),

(7.43)

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

299

with M (s) and N (s) polynomial matrices and GR (s) and GL (s) any crd and cld of P1 (s), P2 (s), respectively. Alternatively, it can be shown that any crd G∗R (s) of P1 (s) and P2 (s) [or a cld G∗L (s) of P%1 (s) and P%2 (s)] with determinant of the highest degree possible is a gcrd (gcld) of the matrices. It is unique within a pre-multiplication (postmultiplication) by a unimodular Here it is assumed that GR (s) is matrix. P1 (s) nonsingular. Note that if rank = m (a (p1 +p2 )×m matrix), which is a P2 (s) typical case in polynomial matrix system descriptions, then rank GR (s) = m; that is, GR (s) is nonsingular. The polynomial matrices P1 (s) and P2 (s) are right coprime (rc) if and only if a gcrd G∗R (s) is a unimodular matrix. Similarly, P%1 (s) and P%2 (s) are left coprime (lc) if and only if a gcld G∗2 (s) is a unimodular matrix.

(s+1)(s+2) s+1 , P2 = 0 s(s+1) . Two dis 1 0 s+2 0 and GR2 = tinct common right divisors are GR1 = 0 s+1 0 1 ⎡ ⎡ ⎤ ⎤ s 0 s(s + 2) 0 ⎢ 0 (s + 1)2 ⎥ ⎢ 0 s + 1⎥ P1 ⎢ ⎢ ⎥ ⎥ G . A greatsince G = =⎣ P2 (s + 1)(s + 2) 1 ⎦ R1 ⎣ s + 2 s + 1 ⎦ R2 0 s 0 s(s + 1) s+2 0 s+2 0 ∗ est common right divisor (gcrd) is GR = = GR1 = 0 s+1 0 1 ⎡ ⎤ s 0 ∗ ⎢ 0 s + 1⎥ 1 0 P1 P ∗ 1R = ⎢ ⎥ GR2 . Now, = G∗−1 ∗ R ⎣ s + 1 1 ⎦ where P1R and 0 s+1 P2 P2R 0 s ∗ P2R are right coprime (rc). Note that a greatest common left divisor (gcld) of 1 0 P1 and P2 is G∗L = . Both G∗R and G∗L can be determined using an 0 s+1 P1 ; see [1, p. 532]. algorithm to derive the Hermite form of P2 Example 7.18. Let P1 =

s(s+2) 0 0 (s+1)2

Remarks It can be shown that two square p × p nonsingular polynomial matrices with determinants that are prime polynomials are both right and left coprime. The converse of this is not true; that is, two right coprime polynomial matrices do not necessarily have prime determinant polynomials. A case in point is ∗ ∗ ∗ and P2R are right coprime; however, det P1R = Example 7.18, where P1R ∗ det P2R = s(s + 1). Left and right coprimeness of two polynomial matrices (provided that the matrices are compatible) are quite distinct properties. For example, two ma-

300

7 Internal and External Descriptions: Relations and Properties

trices can be left coprime but not right coprime, and vice versa (refer to Example 7.19).

(s + 1)(s + 2) 1 and P2 = are left 0 s s+2 0 with det G∗R = coprime but not right coprime since a gcrd is G∗R = 0 1 (s + 2).

s(s + 2) 0 Example 7.19. P1 = 0 s+1

Finally, we note that all of the above deﬁnitions apply also to more than two polynomial matrices. To see this, replace in all deﬁnitions P1 , P2 by P1 , P2 , . . . , Pk . This is not surprising in view of the fact that the p1 ×m matrix P1 (s) and the p2 × m matrix P2 (s) consist of p1 and p2 rows, respectively, each of which can be viewed as a 1 × m polynomial matrix; that is, instead of, e.g., the coprimeness of P1 and P2 , one could speak of the coprimeness of the (p1 + p2 ) rows of P1 and P2 . How to Determine a Greatest Common Right Divisor Lemma 7.20. Let P1 (s) ∈ R[s]p1 ×m and P2 (s) ∈ R[s]p2 ×m with p1 + p2 ≥ m. Let the unimodular matrix U (s) be such that ∗ GR (s) P1 (s) = . (7.44) U (s) P2 (s) 0 Then G∗R (s) is a greatest common right divisor (gcrd) of P1 (s), P2 (s). Proof. Let U=

¯ ¯ X Y , −P(2 P(1

(7.45)

¯ ∈ R[s]m×p1 , Y¯ ∈ R[s]m×p2 , P(2 ∈ R[s]q×p1 , and P(1 ∈ R[s]q×p2 , where with X ¯ Y¯ and P(2 , P(1 are left coprime (lc) pairs. If q (p1 + p2 ) − m. Note that X, ¯ P(2 and they were not, then det U = α, a nonzero real number. Similarly, X, Y¯ , P(1 are right coprime (rc) pairs. Let ¯ ( P − Y (7.46) U −1 = ¯1 ( , P2 X ( ∈ R[s]p2 ×q , Y( ∈ R[s]p1 ×q where P¯1 ∈ R[s]p1 ×m , P¯2 ∈ R[s]p2 ×m are rc and X are rc. Equation (7.44) implies that ∗ P¯ GR P1 = ¯1 G∗R ; = U −1 (7.47) P2 P2 0 i.e., G∗R is a common right divisor of P1 , P2 . Equation (7.44) implies also that

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

¯ 1 + Y¯ P2 = G∗ . XP R

301

(7.48)

This relationship shows that any crd GR of P1 , P2 will also be a right divisor of G∗R . This can be seen directly by expressing (7.48) as M GR = G∗R , where M is a polynomial matrix. Thus, G∗R is a crd of P1 , P2 with the property that any crd GR of P1 , P2 is a rd of G∗R . This implies that G∗R is a gcrd of P1 , P2 .

s(s + 2) 0 (s + 1)(s + 2) s + 1 Example 7.21. Let P1 = . , P2 = 0 (s + 1)2 0 s(s + 1) Then ⎤ ⎡ −(s + 2) −1 s + 1 0 ¯ ¯ ⎢ s+1 X Y 1 −s 0⎥ P1 P1 ⎥ P1 ⎢ U = = 2 ⎣ −(s + 1) −s s(s + 1) 0 ⎦ P2 P2 P2 −P(2 P(1 −(s + 1) 0 s −1 ⎡ ⎤ s+2 0 ∗ ⎢ 0 s + 1⎥ GR ⎢ ⎥ =⎣ . = 0 0 ⎦ 0 0 0 s+2 0 In view of Lemma 7.20, GR ∗ = is a gcrd (see also Exam0 s+1 ple 7.18). Note that in order to derive (7.44) and thus determine a gcrd G∗R of P1 and P2 , one could use the algorithm to obtain the Hermite form [1, p. 532]. P1 P1 Finally, note also that if the Smith form of is known, i.e., UL UR = P2 P2 diag[i ] 0 , then ( diag[i ], 0)UR−1 is a gcrd of P1 and P2 in view of SP = 0 0 P Lemma 7.20. When rank 1 = m, which is the case of interest in systems, P2 then a gcrd of P1 and P2 is diag[i ]UR−1 . Criteria for Coprimeness There are several ways of testing the coprimeness of two polynomial matrices as shown in the following Theorem. Theorem 7.22. Let P1 ∈ R[s]p1 ×m and P2 ∈ R[s]p2 ×m with p1 + p2 ≥ m. The following statements are equivalent: (a) P1 and P2 are right coprime. (b) A gcrd of P1 and P2 is unimodular.

302

7 Internal and External Descriptions: Relations and Properties

(c) There exist polynomial matrices X ∈ R[s]m×p1 and Y ∈ R[s]m×p2 such that (7.49) XP1 + Y P2 = Im . P1 I (d) The Smith form of is . P2 0 P (s ) (e) rank 1 i = m for any complex number si . P2 (si ) P1 (f ) constitutes m columns of a unimodular matrix. P2

Proof. See [1, p. 538, Section 7.2D, Theorem 2.4].

s 0 s+1 1 Example 7.23. (a) The polynomial matrices P1 = , P2 = 0 s+1 0 s are right coprime in view of the following relations. To use condition (b) ⎤ ⎡ −(s + 2) −1 s + 1 0 ⎢ s+1 1 −s 0⎥ P1 P1 ⎥ ⎢ of the above theorem, let U = ⎣ = P2 −(s + 1)2 −s s(s + 1) 0 ⎦ P2 −(s + 1) 0 s −1 ⎡ ⎤ 10 ∗ ⎢0 1⎥ ⎢ ⎥ = GR . Then G∗ = I2 , which is unimodular. Applying condition (c) R ⎣0 0⎦ 0 00 −(s + 2) −1 s+1 0 XP1 + Y P2 = P1 + P = I2 . s+1 1 −s 0 2 P1 To use (d), note that the invariant polynomials of are 1 = 2 = 1; P2 I2 . To use condition (e), note that the only and the Smith form is then 0 P1 (si ) complex values si that may reduce the rank of are those for which P2 (si ) det P1 (si ) or det P2 (si )⎡= 0; ⎤ i.e., s1 = 0 and s2 = −1. For these⎡values we ⎤ have 0 0 −1 0 ⎢0 1⎥ ⎢ 0 0 ⎥ P1 (s1 ) P1 (s2 ) ⎢ ⎥ ⎥ rank = rank ⎣ = rank ⎢ = 2 and rank ⎣ 0 1 ⎦ = 2; P2 (s1 ) P2 (s2 ) 1 1⎦ 00 0 −1 i.e., both are of full rank. The following Theorem 7.24 is the corresponding to Theorem 7.22 result % proper and stable for (left coprime) proper and stable matrices. Note that U −1 % is a unimodular matrix if U is also a proper and stable matrix. Theorem 7.24. Let P%1 ∈ R[s]p×m1 and P%2 ∈ R[s]p×m2 with m1 + m2 ≥ p. The following statements are equivalent:

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

303

(a) P%1 and P%2 are left coprime. (b) A gcld of P%1 and P%2 is unimodular. % ∈ R[s]m1 ×p and Y% ∈ R[s]m2 ×p such (c) There exist polynomial matrices X that % + P%2 Y% = Ip . P%1 X (7.50) (d) The Smith form of [P%1 , P%2 ] is [I, 0]. (e) rank[P%1 (si ), P%2 (si )] = p for any complex number si . (f ) [P%1 , P%2 ] are p rows of a unimodular matrix. Proof. The proof is completely analogous to the proof of Theorem 7.22 and is omitted. 7.5.3 Controllability, Observability, and Stability Consider now the Polynomial Matrix Description P (q)z(t) = Q(q)u(t),

y(t) = R(q)z(t) + W (q)u(t),

(7.51)

where P (q) ∈ R[q]l×l , Q(q) ∈ R[q]l×m , R(q) ∈ R[q]p×l , and W (q) ∈ R[q]p×m . Assume that the PMD given in (7.51) is equivalent to some state-space representation x(t) ˙ = Ax(t) + Bu(t),

y(t) = Cx(t) + Du(t),

(7.52)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m [1, p. 553, Section 7.3A]. Controllability Deﬁnition 7.25. The representation {P, Q, R, W } given in (7.51) is said to be controllable if its equivalent state-space representation {A, B, C, D} given in (7.52) is state controllable. Theorem 7.26. The following statements are equivalent: (a) (b) (c) (d)

{P, Q, R, W } is controllable. The Smith form of [P, Q] is [I, 0]. rank[P (si ), Q(si )] = l for any complex number si . P, Q are left coprime.

Proof. See [1, p. 561, Theorem 3.4].

The right Polynomial Matrix Fractional Description, {DR , Im , NR }, is controllable since DR and I are left coprime.

304

7 Internal and External Descriptions: Relations and Properties

Observability Observability can be introduced in a completely analogous manner to controllability. This leads to the following concept and result. Deﬁnition 7.27. The representation {P, Q, R, W } given in (7.51) is said to be observable if its equivalent state-space representation {A, B, C, D} given in (7.52) is state observable. Theorem 7.28. The following statements are equivalent: (a) {P, Q, R, W } is observable. P I (b) The Smith form of is . R 0 P (si ) = l for any complex number si . (c) rank R(si ) (d) P, R are right coprime. Proof. It is analogous to the proof of Theorem 7.26.

The left Polynomial Matrix Fractional Description (PMFD), {DL , NL , Ip }, is observable since DL and Ip are right coprime. Stability Deﬁnition 7.29. The representation {P, Q, R, W } given in (7.51) is said to be asymptotically stable if for its equivalent state-space representation {A, B, C, D} given in (7.52) the equilibrium x = 0 of the free system x˙ = Ax is asymptotically stable. Theorem 7.30. The representation {P, Q, R, W } is asymptotically stable if and only if Reλi < 0, i = 1, . . . , n, where λi , i = 1, . . . , n are the roots of det P (s); the λi are the eigenvalues or poles of the system. Proof. See [1, p. 563, Theorem 3.6].

7.5.4 Poles and Zeros Poles and zeros can be deﬁned in a completely analogous way for system (7.51) as was done in Section 7.4 for state-space representations. It is straightforward to show that {poles of H(s) } ⊂ {roots of det P (s) }.

(7.53)

The roots of det P are the eigenvalues or the poles of the system {P, Q, R, W } and are equal to the eigenvalues of A in any equivalent state-space representation {A, B, C, D}. Relation (7.53) becomes an equality when the system is controllable and observable, since in this case the poles of the transfer function

7.5 Polynomial Matrix and Matrix Fractional Descriptions of Systems

305

matrix H are exactly those eigenvalues of the system that are both controllable and observable. Consider the system matrix or Rosenbrock Matrix of the representation {P, Q, R, W }, P (s) Q(s) S(s) = . (7.54) −R(s) W (s) The invariant zeros of the system are the roots of the invariant zero polynomial, which is the product of all the invariant factors of S(s). The input-decoupling, output-decoupling, and the input–output decoupling zeros of {P, Q, R, W } can be deﬁned in a manner completely analogous to the statespace case. For example, the roots of the product of all invariant factors of [P (s), Q(s)] are the input-decoupling zeros of the system; they are also the uncontrollable eigenvalues of the system. Note that the input-decoupling zeros are the roots of det GL (s), where GL (s) is a gcld of all the columns ¯ Similar results hold for the outputof [P (s), Q(s)] = GL (s)[P¯ (s), Q(s)]. decoupling zeros. The zeros of H(s), also called the transmission zeros of the system, are deﬁned as the roots of the zero polynomial of H(s), zH (s) = 1 (s) . . . r (s),

(7.55)

where the i are the numerator polynomials in the Smith–McMillan form of H(s). When {P, Q, R, W } is controllable and observable, the zeros of the system, the invariant zeros, and the transmission zeros coincide. Consider the representation DR zR = u, y = NR zR with DR ∈ R[s]m×m and NR ∈ R[s]p×m and notice that in this case the Rosenbrock matrix (7.54) can be reduced via elementary column operations to the form I 0 0I 0 I 0I I 0 DR I = = . −NR 0 −DR I I0 −NR 0 I0 0 −NR In view of the fact that the invariant factors of S do not change under elementary matrix operations, the nonunity invariant factors of S are the nonunity invariant factors of NR . Therefore, the invariant zero polynomial of the system equals the product of all invariant factors of NR and its roots are the invariant zeros of the system. Note that when rank NR = p ≤ m, the invariant zeros of the system are the roots of det GL , where GL is the gcld of all the columns ¯R . When NR , DR are right coprime, the system is of NR ; i.e., NR = GL N controllable and observable. In this case it can be shown that the zeros of −1 H (= NR DR ), also called the transmission zeros of the system, are equal to the invariant zeros (and to the system zeros of {DR , I, NR }) and can be determined from NR . In fact, the zero polynomial of the system, zs (s), equals zH (s), the zero polynomial of H, which equals 1 (s) . . . r (s), the product of the invariant factor of NR ; i.e., zs (s) = zH (s) = 1 (s) . . . r (s).

(7.56)

306

7 Internal and External Descriptions: Relations and Properties

The pole polynomial of H(s) is pH (s) = k

det DR (s),

(7.57)

where k ∈ R. −1 When H(s) is square and nonsingular and H(s) = NR (s)DR (s) = −1 DL (s)NL (s) rc and lc, respectively, the poles of H(s) are the roots of det DR (s) or of det DL (s) and the zeros of H(s) are the roots of NR (s) or of NL (s). An important well-known special case is the case of a scalar H(s) = n(s)/d(s), where the poles of H(s) are the roots of d(s) and the zeros of H(s) are the roots of n(s).

7.6 Summary and Highlights •

The transfer function H(s) = C1 (sI − A11 )−1 B1 + D

(7.4)

and the impulse response H(t, 0) = C1 eA11 t B1 + Dδ(t)

•

•

(7.5)

depend only on the controllable and observable parts of the system, (A11 , B1 , C1 ). Similar results hold for the discrete-time case in (7.6) and (7.7). Since {eigenvalues of A} ⊃ {poles of H(s)}, (7.9) internal stability always implies BIBO stability but not necessarily vice versa. Recall that the system is stable in the sense of Lyapunov (or internally stable) if and only if all eigenvalues of A have negative real parts; the system is BIBO stable if and only if all poles of H(s) have negative real parts. BIBO stability implies internal stability only when the eigenvalues of A are exactly the poles of H(s), which is the case when the system is both controllable and observable. When H(s) = C(sI − A)−1 B + D and (A, B) is controllable and (A, C) is observable, then {eigenvalues of A (poles of the system)} = {poles of H(s)}, {zeros of the system} = {zeros of H(s)}.

(7.58) (7.22)

When the system is not controllable and observable {eigenvalues of A (poles of the system)} = {poles of H(s)} ∪ {uncontrollable and/or unobservable eigenvalues}. (7.20) •

If the system {A, B, C, D} is not both controllable and observable, then the uncontrollable and/or unobservable eigenvalues cancel out when the transfer functions H(s) = C(sI − A)−1 B + D is determined.

7.6 Summary and Highlights

307

Poles and Zeros •

•

The Smith–McMillan form of a transfer function matrix H(s) is ˜ 0 Λ(s) SMH (s) = , (7.12) 0 0

r (s) ˜ with Λ(s) diag ψ 11(s) , . . . , are the invariant factors of N (s) in (s) ψr (s) 1 H(s) = d(s) N (s) and r = rank H(s). The characteristic or pole polynomial of H(s) is

pH (s) = ψ1 (s) · · · ψr (s).

•

(7.13)

pH is also the monic least common denominator of all nonzero minors of H(s). The roots of pH (s) are the poles of H(s). The zero polynomial of H(s) is zH (s) = 1 (s)2 (s) · · · r (s).

(7.18)

The roots of zH (s) are the zeros of H(s) (or the transmission zeros of the system). When H(s) = N (s)D(s)−1 a right coprime polynomial factorization, the zeros of H(s) are the invariant zeros of N (s). When N (s) is square, the zeros are the roots of |N (s)|. Polynomial Matrix Descriptions •

PMDs are given by P (q)z(t) = Q(q)u(t),

y(t) = R(q)z(t) + W (q)u(t),

(7.29)

where q d/dt the diﬀerential operator (qz = z). ˙ PMDs are, in general, equivalent to state-space representations of the form x˙ = Ax + Bu, •

y = Cx + D(q)u,

and so they are more general than the {A, B, C, D} descriptions. The transfer function matrix is H(s) = R(s)P −1 (s)Q(s) + W (s).

•

(7.30)

The system is controllable if and only if (P, Q) are left coprime (lc). It is observable if and only if (P, R) are right coprime (rc). (See Theorems 7.26 and 7.28.) The system is asymptotically stable if all the eigenvalues of the system, the roots of |P (q)|, have negative real parts. (See Theorem 7.30.)

308

•

7 Internal and External Descriptions: Relations and Properties

Polynomial Matrix Fractional Descriptions (PMFDs) are given by −1 −1 (s) = DL (s)NL (s), H(s) = NR (s)DR

(7.35)

where (NR , DR ) are rc and (DL , NL ) are lc. They correspond to the PMD DR (q)zR (t) = u(t),

y(t) = NR (q)zR (t)

(7.36)

and DL (q)zL (t) = NL (q)u(t), •

y(t) = zL (t),

(7.37)

which are both controllable and observable representations. Proper and stable Matrix Fractional Descriptions (MFDs) are given by %R (s)D % R (s)−1 = D % −1 (s)N %L (s), H(s) = N L

(7.38)

% R, D % L, N %L are proper and stable matrices with (N %R , D % R ) rc %R , D where N % % and (DL , NL ) lc.

7.7 Notes The role of controllability and observability in the relation between propertiers of internal and external descriptions are found in Gilbert [2], Kalman [4], and Popov [5]. For further information regarding these historical issues, consult Kailath [3] and the original sources. Multivariable zeros have an interesting history. For a review, see Schrader and Sain [7] and the references therein. Refer also to Vardulakis [8]. Polynomial matrix descriptions were used by Rosenbrock [6] and Wolovich [9]. See [1, Sections 7.6 and 7.7] for extensive notes and references.

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. E. Gilbert, “Controllability and observability in multivariable control systems,” SIAM J. Control, Vol. 1, pp. 128–151, 1963. 3. T. Kailath, Linear Systems, Prentice-Hall, Englewood, NJ, 1980. 4. R.E. Kalman, “Mathematical descriptions of linear systems,” SIAM J. Control, Vol. 1, pp. 152–192, 1963. 5. V.M. Popov, “On a new problem of stability for control systems,” Autom. Remote Control, pp. 1–23, Vol. 24, No. 1, 1963. 6. H.H. Rosenbrock, State-Space and Multivariable Theory, Wiley, New York, NY, 1970. 7. C.B. Schrader and M.K. Sain, “Research on system zeros: a survey,” Int. Journal of Control, Vol. 50, No. 4, pp. 1407–1433, 1989. 8. A.I.G. Vardulakis, Linear Multivariable Control. Algebraic Analysis and Synthesis Methods, Wiley, New York, NY, 1991. 9. W.A. Wolovich, Linear Multivariable Systems, Springer-Verlag, New York, NY, 1974.

Exercises

309

Exercises 7.1. Consider the system x˙ = Ax + Bu, y = Cx + Du. (a) Show that only controllable modes appear in eAt B and therefore in the zero-state response of the state. (b) Show that only observable modes appear in CeAt and therefore in the zero-input response of the system. (c) Show that only modes that are both controllable and observable appear in CeAt B and therefore in the impulse response and the transfer function matrix of the system. Consider next the system x(k +1) = Ax(k)+Bu(k), y(k) = Cx(k) + Du(k). (d) Show that only controllable modes appear in Ak B, only observable modes in CAk , and only modes that are both controllable and observable appear in CAk B ⎡ [that is, in⎤H(z)]. ⎡ ⎤ 1 0 0 1 (e) Let A = ⎣ 0 −2 0 ⎦, B = ⎣ 0 ⎦, C = [1, 1, 0], and D = 0. Verify the 0 0 −1 1 results obtained in (d). 7.2. In the circuit of Example 7.2, let R1 R2 C = L and R1 = R2 = R. Determine x(t) = [x1 (t), x2 (t)]T and i(t) for unit step input voltage, v(t), and initial conditions x(0) = [a, b]T . Comment on your results. 7.3.⎡(a) Consider x˙ = Ax + Bu, x(0) = x0 , where A = ⎤ the state⎡equation ⎤ 0 −1 1 10 ⎣ 1 −2 1 ⎦ and B = ⎣ 1 1 ⎦. Determine x(t) as a function of u(t) and 0 1 −1 12 x0 , and verify that the uncontrollable modes do not appear in the zerostate response but do appear in the zero-input response. (b) Consider the state equation x(k + 1) = Ax(k) + Bu(k) and x(0) = x0 , where A and B are as in (a). Demonstrate for this case results corresponding to (a). In (a) and (b), determine x(t) and x(k) for unit step inputs and x(0) = [1, 1, 1]T . 7.4. (a) Considerthe system x˙ = Ax + Bu, y = Cx with x(0) = x0 , where 0 1 0 A= ,B= , and C = [1, 1]. Determine y(t) as a function of −2 −3 1 u(t) and x0 , and verify that the unobservable modes do not appear in the output. (b) Consider the system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) with x(0) = x0 , where A, B, and C are as in (a). Demonstrate for this case results that correspond to (a). In (a) and (b), determine and plot y(t) and y(k) for unit step inputs and x(0) = 0.

310

7 Internal and External Descriptions: Relations and Properties

7.5. Consider the system x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k), where ⎡ ⎤ ⎡ ⎤ 1 0 0 1 A = ⎣ 0 −1/2 0 ⎦ , B = ⎣0⎦, C = [1, 1, 0]. 0 0 −1/2 1 Determine the eigenvalues that are uncontrollable and/or unobservable. Determine x(k), y(k) for k ≥ 0, given x(0) and u(k), k ≥ 0, and show that only controllable eigenvalues (resp., modes) appear in Ak B, only observable ones appear in CAk , and only eigenvalues (resp., modes) that are both controllable and observable appear in CAk B [in H(z) ]. ⎡ ⎤ ⎡ ⎤ −1 0 0 10 110 7.6. Given is the system x˙ = ⎣ 0 −1 0 ⎦ x + ⎣ 0 1 ⎦ u, y = x. 100 0 02 00 (a) Determine the uncontrollable and the unobservable eigenvalues (if any). (b) What is the impulse response of this system? What is its transfer function matrix? (c) Is the system asymptotically stable? s−1 0 s−2 s s+2 . 7.7. Given is the transfer function matrix H(s) = 0 s+1 0 s (a) Determine the Smith–McMillan form of H(s) and its characteristic (pole) polynomial and minimal polynomial. What are the poles of H(s)? (b) Determine the zero polynomial of H(s). What are the zeros of H(s)? s2 +1 s2 . 7.8. Let H(s) = s+1 s3

(a) Determine the Smith–McMillan form of H(s) and its characteristic (pole) polynomial and minimal polynomial. What are the poles of H(s)? (b) Determine the zero polynomial of H(s). What are the zeros of H(s)? 7.9. A rational function matrix R(s) may have, in addition to ﬁnite poles and zeros, poles and zeros at inﬁnity (s = ∞). To study the poles and zeros at inﬁnity, the bilinear transformation s=

b1 w + b0 a1 w + a0

with a1 = 0, b1 a0 − b0 a1 = 0 may be used, where b1 /a1 is not a ﬁnite pole or zero of R(s). This transformation maps the point s = b1 /a1 to w = ∞ and % is the point of interest, s = ∞, to w = −a0 /a1 . The rational matrix R(w) now obtained as b1 w + b0 % R(w) =R , a1 w + a0

Exercises

311

% and the ﬁnite poles and zeros of R(w) are determined. The poles and zeros at w = −a0 /a1 are the poles and zeros of R(s) at s = ∞. Note that frequently a good choice for the bilinear transformation is s = 1/w; that is, b1 = 0, b0 = 1 and a1 = 1, a0 = 0. (a) Determine the poles and zeros at inﬁnity of 1 R1 (s) = , s+1

R2 (s) = s,

1 0 R3 (s) = . s+1 1

Note that a rational matrix may have both poles and zeros at inﬁnity. (b) Show that if R(s) has a pole at s = ∞, then it is not a proper rational function ( lim R(s) → ∞). s→∞

7.10. Consider the polynomial matrices P (s) = s 0 . −s − 1 1

s2 + s −s , R(s) = −s2 − 1 s2

(a) Are they right coprime (rc)? If they are not, ﬁnd a greatest common right divisor (gcrd). (b) Are they left coprime (lc)? If they are not, ﬁnd a greatest common left divisor (gcld). 7.11. (a) Show that two square and nonsingular polynomial matrices, the determinants of which are coprime polynomials, are both right and left coprime. Hint: Assume they are not, say, right coprime and then use the determinants of their gcrd to arrive at a contradiction. (b) Show that the opposite is not true; i.e., two right (left) coprime polynomial matrices do not necessarily have determinants which are coprime polynomials. 7.12. Let P (s) be a polynomial matrix of full column rank, and let y(s) be a given polynomial vector. Show that the equation P (s)x(s) = y(s) will have a polynomial solution x(s) for any y(s) if and only if the columns of P (s) are lc, or equivalently, if and only if P (λ) has full column rank for any complex number λ. 7.13. Consider P (q)z(t) = Q(q)u(t) and y(t) = R(q)z(t) + W (q)u(t), where 3 q − q q2 − 1 q − 1 −2q + 2 P (q) = , Q(q) = , −q − 2 0 1 3q 2 −1 3q + 4 2q + q + 2 2q , W (q) = , R(q) = −q − 2 0 −1 −3q with q

d dt .

(a) Is this system representation controllable? Is it observable?

312

7 Internal and External Descriptions: Relations and Properties

(b) Find the transfer function matrix H(s)(ˆ y (s) = H(s)ˆ u(s)). (c) Determine an equivalent state-space representation x˙ = Ax + Bu, y = Cx + Du, and repeat (a) and (b) for this representation. 7.14. Use system theoretic arguments to show that two polynomials d(s) = sn +dn−1 sn−1 +· · ·+d1 s+d0 and n(s) = nn−1 sn−1 +nn−2 sn−2 +· · ·+n1 s+n0 are coprime if and only if ⎤ ⎡ Cc ⎢ Cc Ac ⎥ ⎥ ⎢ rank ⎢ ⎥ = n, .. ⎦ ⎣ . Cc An−1 c ⎡

0 0 .. .

1 0 .. .

0 ··· 1 ··· .. .

0 0 .. .

⎤

⎥ ⎢ ⎥ ⎢ ⎥ ⎢ where Ac = ⎢ ⎥ and Cc = [n0 , n1 , . . . , nn−1 ]. ⎥ ⎢ ⎣ 0 0 0 ··· 1 ⎦ −dn−1 −d0 −d1 −d2 2 s 0 7.15. Consider the system Dz = u, y = N z, where D = and N = 0 s3 2 [s − 1, s + 1]. (a) Is the system controllable? Is it observable? Determine all uncontrollable and/or unobservable eigenvalues, if any. (b) Determine the invariant and the transmission zeros of the system.

8 Realization Theory and Algorithms

8.1 Introduction In this chapter the following problem is being addressed: Given an external description of a linear system, speciﬁcally, its transfer function or its impulse response, determine an internal, state-space description for the system that generates the given transfer function. This is the problem of system realization. The name reﬂects the fact that if a (continuous-time) state-space description is known, an operational ampliﬁer circuit can be built in a straightforward manner to realize (actually simulate) the system response. There are many ways, an inﬁnite number in fact, of realizing a given transfer function. Presently, we are interested in realizations that contain the least possible number of energy or memory storage elements, i.e., in realizations of least order (in terms of diﬀerential or diﬀerence equations). To accomplish this, the concepts of controllability and observability play a central role. Indeed, it turns out that realizations of transfer functions of least order are both controllable and observable. In Section 8.2, the problem of state-space realizations of input–output descriptions is deﬁned and the existence of such realizations is addressed. The minimality of realizations of H(s) is studied in Section 8.3, culminating in two results, Theorem 8.9 and Theorem 8.10, where it is ﬁrst shown that a realization is minimal if and only if it is controllable and observable, and next, that if a realization is minimal, all other minimal realizations of a given H(s) can be found via similarity transformations. It is also shown how to determine the order of minimal realizations directly from H(s). Several realization algorithms are presented in Section 8.4, and the role of duality is emphasized in Subsection 8.4.1.

8.2 State-Space Realizations of External Descriptions In this section, state-space realizations of impulse responses and of transfer functions for time-invariant systems are introduced. Continuous-time systems

314

8 Realization Theory and Algorithms

are discussed ﬁrst in Subsection 8.2.1, followed by discrete-time systems in Subsection 8.2.2. 8.2.1 Continuous-Time Systems Before formally deﬁning the problem of system realization, we ﬁrst review some of the relations that were derived in Chapter 3. We consider a time-invariant system described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(8.1)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . The response of this system is given by

t H(t, τ )u(τ )dτ, (8.2) y(t) = CeAt x0 + 0

where, without loss of generality, the initial time t0 was taken to be zero. The impulse response is now given by the expression

CeA(t−τ ) B + Dδ(t − τ ), fort ≥ τ, (8.3) H(t, τ ) = 0, fort < τ. Recall that the time invariance of system (8.1) implies that H(t, τ ) = H(t − τ, 0), and therefore, τ , which is the time at which a unit impulse input is applied to the system, can be taken to equal zero (τ = 0), without loss of generality, to yield H(t, 0). The transfer function matrix of the system is the (one-sided) Laplace transform of H(t, 0), namely, H(s) = L[H(t, 0)] = C(sI − A)−1 B + D.

(8.4)

In the time-invariant case, a realization is commonly deﬁned in terms of the transfer function matrix. We let {A, B, C, D} denote the system description given in (8.1), and we let H(s) be a p×m matrix with entries that are functions of s. Deﬁnition 8.1. A realization of H(s) is any set {A, B, C, D}, the transfer function matrix of which is H(s); i.e., {A, B, C, D} is a realization of H(s) if (8.4) is satisﬁed. (See Figure 8.1.) As will be shown in the next section, given H(s), a condition for a realization {A, B, C, D} of H(s) to exist is that all entries in H(s) are proper, rational functions. Alternative conditions under which a given set {A, B, C, D} is a realization of some H(s) can easily be derived. To this end, we expand H(s) in a Laurent series to obtain H(s) = H0 + H1 s−1 + H2 s−2 + · · · .

(8.5)

8.2 State-Space Realizations of External Descriptions

315

D x( t 0 ) u(t)

B

+

Σ

x(t)

x(t)

∫

n

+ C

+

Σ

y(t)

+ A

Figure 8.1. Block diagram realization of {A, B, C, D}

Deﬁnition 8.2. The terms Hi , i = 0, 1, 2, . . . , in (8.5) are the Markov parameters of the system. The Markov parameters can be determined by the formulas H0 = lim H(s), H1 = lim s(H(s)−H0 ), H2 = lim s2 (H(s)−H0 −H1 s−1 ), s→∞

s→∞

s→∞

and so forth. Recall that relations involving the Markov parameters were used in Exercise 3.34 of Chapter 3. Theorem 8.3. The set {A, B, C, D} is a realization of H(s) if and only if H0 = D and Hi = CAi−1 B,

i = 1, 2, . . . .

(8.6)

Proof. H(s) = D + C(sI − A)−1 B = D + Cs−1 (I − s−1 A)−1 B = D + ∞ −1 −1 i i−1 B]s−i , from which (8.6) is derived Cs [ i=0 (s A) ]B = D + ∞ i=1 [CA in view of (8.5). 8.2.2 Discrete-Time Systems The realization theory in the discrete-time case essentially parallels the continuous-time case. There are of course certain notable diﬀerences because in the present case the realizations are diﬀerence equations instead of diﬀerential equations. We point to these diﬀerences in the subsequent sections. Some of the relations derived in Section 3.4 will be recalled next. We consider systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

y(k) = Cx(k) + Du(k),

(8.7)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . The response of this system is given by y(k) = CAk x0 +

k−1

H(k, i)u(i),

k > 0,

(8.8)

i=0

where, without loss of generality, k0 was taken to be zero. The unit pulse (discrete impulse) response is now given by

316

8 Realization Theory and Algorithms

⎧ k−(i+1) ⎪ B, k > i, ⎨CA H(k, i) = D, k = i, ⎪ ⎩ 0, k < i.

(8.9)

Recall that since the system (8.7) is time-invariant, H(k, i) = H(k − i, 0) and i, the time the pulse input is applied, can be taken to be zero, to yield H(k, 0) as the external system description. The transfer function matrix for (8.7) is now the (one-sided) z-transform of H(k, 0). We have H(z) = Z{H(k, 0)} = C(zI − A)−1 B + D.

(8.10)

Now let {A, B, C, D} denote the system description (8.7) and let H(z) be a p × m matrix with functions of z as entries. Deﬁnition 8.4. A realization of H(z) is any set {A, B, C, D}, the transfer function matrix of which is H(z); i.e., it satisﬁes (8.10). A result that is analogous to Theorem 8.3 is also valid in the discrete-time case [with H(s) replaced by H(z)].

8.3 Existence and Minimality of Realizations The existence of realizations is examined ﬁrst. Given a p × m matrix H(s), conditions for H(s) to be the transfer function matrix of a system described by equations of the form x˙ = Ax + Bu, y = Cx + Du are given in Theorem 8.5. It is shown that such realizations exist if and only if H(s) is a matrix of rational functions with the property that lims→∞ H(s) is ﬁnite. The corresponding results for discrete-time systems are also presented. Realizations of least order, also called minimal or irreducible realizations, are of interest to us since they realize a system, using the least number of dynamical elements (minimum number of elements with memory). The principal results are given in Theorems 8.9 and 8.10, where it is shown that minimal realizations are controllable (-from-the-origin) and observable and that all minimal realizations of H(s) are equivalent representations. The order of any minimal realization can be determined directly without ﬁrst determining a minimal realization, and this can be accomplished by using the characteristic polynomial and the degree of H(s) (Theorem 8.12) or from the rank of a Hankel matrix (Theorem 8.16). All the results on minimality of realizations apply to the discrete-time case as well with no substantial changes. This is discussed at the end of the section. 8.3.1 Existence of Realizations Continuous-Time Systems. Given a p×m matrix H(s), the following result establishes necessary and suﬃcient conditions for the existence of time-invariant realizations.

8.3 Existence and Minimality of Realizations

317

Theorem 8.5. H(s) is realizable as the transfer function matrix of a timeinvariant system described by (8.1) if and only if H(s) is a matrix of rational functions and satisﬁes (8.11) lim H(s) < ∞, s→∞

i.e., if and only if H(s) is a proper rational matrix. Proof. (Necessity) If the system x˙ = Ax + Bu, y = Cx + Du is a realization of H(s), then C(sI − A)−1 B + D = H(s), which shows that H(s) must be a rational matrix. Furthermore, lim H(s) = D,

s→∞

(8.12)

which is a real ﬁnite matrix. (Suﬃciency) If H(s) is a proper rational matrix, then any of the algorithms discussed in the next section can be applied to derive a realization. Discrete-Time Systems. Given a p × m matrix H(z), the next theorem establishes necessary and suﬃcient conditions for time-invariant realizations. This result corresponds to Theorem 8.5 for the continuous-time case. Notice that the conditions in these results are identical. Theorem 8.6. H(z) is realizable as the transfer function matrix of a timeinvariant system described by (8.7) if and only if H(z) is a matrix of rational functions and satisﬁes the condition that lim H(z) < ∞.

z→∞

Proof. Similar to the proof of Theorem 8.5.

(8.13)

8.3.2 Minimality of Realizations Realizations of a transfer function matrix H(s) can be expected to generate only the zero-state response of a system, since the external description H(s) has, by deﬁnition, no information about the initial conditions and the zeroinput response of the system. A second important point is the fact that if a realization of a given H(s) exists, then there exists an inﬁnite number of realizations. If (8.1) is a realization of the p × m matrix H(s), then realizations of the same order n, i.e., of the same dimension n of the state vector, can readily be generated by an equivalence transformation. There are, of course, other ways of generating alternative realizations. In particular, if (8.1) is a realization of H(s), then, for example, the system x˙ = Ax + Bu, z˙ = F z + Gu

y = Cx + Du,

(8.14)

318

8 Realization Theory and Algorithms

is also a realization. This was accomplished by adding to (8.1) a state equation z˙ = F z + Gu that does not aﬀect the system output. The dimension of F, dim F , and consequently the order of the realization, n + dim F , can be larger than any given ﬁnite number. In other words, there may be no upper bound to the order of the realizations of a given H(s). There exists, however, a lower bound, and a realization of such lowest order is called a least-order minimal or irreducible realization. Deﬁnition 8.7. A realization x˙ = Ax + Bu,

y = Cx + Du

(8.15)

of the transfer function matrix H(s) of least order n (A ∈ Rn×n ) is called a least-order, or a minimal, or an irreducible realization of H(s). Theorems 8.9 and 8.10 below completely solve the minimal realization problem. The ﬁrst of these results shows that a realization is minimal if and only if it is controllable (-from-the-origin or reachable) and observable, whereas the second result shows that if a minimal realization has been found, then all other minimal realizations can be obtained from the determined realization, using equivalence of representations. Controllability (-from-the-origin, or reachability) and observability play an important role in the minimality of realizations. Indeed, it was shown in Section 7.2 that only that part of a system that is both controllable and observable appears in H(s). In other words, H(s) contains no information about the uncontrollable and/or unobservable parts of the system. To illustrate this, consider the following speciﬁc case. Example 8.8. Let H(s) = 1/(s + 1). Four diﬀerent realizations of H(s) are given by 01 0 (i) {A = , B= , C = [−1, 1], D = 0}, 10 1 01 −1 (ii) {A = , B= , C = [0, 1], D = 0}, 1 0 1 1 0 0 (iii) {A = , B= , C = [0, 1], D = 0}, 0 −1 1 (iv) {A = −1, B = 1, C = 1, D = 0}. The eigenvalue +1 in (i) is unobservable, in (ii) is uncontrollable, and in (iii) is both uncontrollable and unobservable and does not appear in H(s) at all. Realization (iv), which is of order 1, is a minimal realization. It is controllable and observable. Theorem 8.9. An n-dimensional realization {A, B, C, D} of H(s) is minimal (irreducible, of least order) if and only if it is both controllable and observable.

8.3 Existence and Minimality of Realizations

319

Proof. (Necessity) Assume that {A, B, C, D} is a minimal realization but is not both controllable and observable. Using Kalman’s Canonical Decomposition (see Subsection 6.2.3), one may ﬁnd another realization of lower dimension that is both controllable and observable. This contradicts the assumption that {A, B, C, D} is a minimal realization. Therefore, it must be both controllable and observable. (Suﬃciency) Assume that the realization {A, B, C, D} is controllable and ¯ B, ¯ C, ¯ D} ¯ of order observable, but there exists another realization, say, {A, n ¯ < n. Since they are both realizations of H(s), or of the impulse response H(t, 0), then ¯ ¯ ¯ ¯ At B + Dδ(t) (8.16) CeAt B + Dδ(t) = Ce ¯ = lims→∞ H(s). Using the power series expansion for all t ≥ 0. Clearly, D = D of the exponential and equating coeﬃcients of the same power of t, we obtain ¯ CAk B = C¯ A¯k B,

k = 0, 1, 2, . . . ;

(8.17)

i.e., the Markov parameters of the two representations are the same (see Theorem 8.3). Let Cn [B, AB, . . . , An−1 B] ∈ Rn×mn ⎡

and

⎢ ⎢ On ⎢ ⎣

⎤

C CA .. .

⎥ ⎥ ⎥ ∈ Rpn×n . ⎦

(8.18)

CAn−1 Then the pn × mn matrix product On Cn assumes the form ⎤ ⎡ CB CAB · · · CAn−1 B ⎢ CAB CA2 B · · · CAn B ⎥ ⎥ ⎢ On Cn = ⎢ ⎥ .. .. .. ⎦ ⎣ . . . CAn−1 B ¯ C¯ B ¯ ⎢ C¯ A¯B ⎢ =⎢ .. ⎣ . ¯ C¯ A¯n−1 B ⎡

CAn B ¯ C¯ A¯B 2 ¯ ¯ ¯ CA B .. . ¯ C¯ A¯n B

· · · CA2n−2 B ⎤ ¯ · · · C¯ A¯n−1 B ¯ ⎥ · · · C¯ A¯n B ⎥ ¯n C¯n . ⎥=O .. ⎦ . ¯ · · · C¯ A¯2n−2 B

(8.19)

In view of Sylvester’s Rank Inequality, which relates the rank of the product of two matrices to the rank of its factors, we have ¯n C¯n ) ≤ min(rank On , rank Cn ) rank On + rank Cn − n ≤ rank(O

(8.20)

¯n C¯n ) = n. This and we obtain that rank On = rank Cn = n, rank(O ¯n C¯n ) ≤ result, however, contradicts our assumptions, since n = rank(O ¯n , rank C¯n ) ≤ n ¯ B, ¯ C, ¯ D}. ¯ Theremin(rank O ¯ because n ¯ is the order of {A, fore n ≤ n ¯ . Hence, n ¯ cannot be less than n and they can only be equal. Thus, n=n ¯ and {A, B, C, D} is indeed a minimal realization.

320

8 Realization Theory and Algorithms

Theorem 8.9 suggests the following procedure to realize H(s). First, we obtain a controllable (observable) realization of H(s). Next, using a similarity transformation, we obtain an observable standard form to separate the observable from the unobservable parts (controllable from the uncontrollable parts), using the approach of Subsection 6.2.1. Finally, we take the observable (controllable) part that will also be controllable (observable) as the minimal realization. We shall use this procedure in the next section. Is the minimal realization unique? The answer to this question is of course “no” since we know that equivalent representations, which are of the same order, give the same transfer function matrix. The following theorem shows how to obtain all minimal realizations of H(s). ¯ B, ¯ C, ¯ D} ¯ be realizations of H(s). Theorem 8.10. Let {A, B, C, D} and {A, ¯ B, ¯ C, ¯ D} ¯ is also a minimal If {A, B, C, D} is a minimal realization, then {A, realization if and only if the two realizations are equivalent, i.e., if and only ¯ = D and there exists a nonsingular matrix P such that if D A¯ = P AP −1 ,

¯ = P B, and C¯ = CP −1 . B

(8.21)

Furthermore, if P exists, it is given by ¯ −1 O ¯ T O. ¯ T O) P = C C¯T (C¯C¯T )−1 or P = (O

(8.22)

Proof. (Suﬃciency) Let the realizations be equivalent. Since {A, B, C, D} is minimal, it is controllable and observable and its equivalent representation ¯ B, ¯ C, ¯ D} ¯ is also controllable and observable and, therefore, minimal. Al{A, ternatively, since equivalence preserves the dimension of A, the equivalent ¯ B, ¯ C, ¯ D} ¯ is also minimal. realization {A, ¯ B, ¯ C, ¯ D} ¯ is also minimal. We shall show that it (Necessity) Suppose {A, is equivalent to {A, B, C, D}. Since they are both realizations of H(s), they ¯ and satisfy D = D ¯ k = 0, 1, 2 . . . , CAk B = C¯ A¯k B,

(8.23)

as was shown in the proof of Theorem 8.9. Here, both realizations are minimal, and therefore, they are both of the same order n and are both controllable and observable. ¯ C¯ Deﬁne C = Cn and O = On , as in (8.18). Then, in view of (8.19), OC = O ¯ C. ¯ Using Sylvester’s ¯ T , we obtain O ¯ T OC = O ¯T O and premultiplying by O ¯T O ¯ = n, and therefore, Inequality, we obtain rank O ¯ T O) ¯ −1 O ¯ T O]C = P C, C¯ = [(O

(8.24)

¯ −1 O ¯ T O ∈ Rn×n . Note that rank P = n since rank O ¯T O ¯ T O) where P (O T ¯ OC = n and from Sylvester’s is also equal to n as can be seen from rank O Inequality. Therefore, P qualiﬁes as a similarity transformation. Similarly, ¯ CC ¯ T , and ¯ C¯ implies that OCC T = O OC = O

8.3 Existence and Minimality of Realizations

¯ CC ¯ T (CC T )−1 ] = O ¯ P¯ , O = O[

321

(8.25)

¯ T (CC T )−1 ∈ Rn×n with rank P¯ = n. Note that P = where P¯ CC T ¯ −1 ¯ T ¯ ¯ ¯ (O O) O (OP ) = P¯ . To show that P is the equivalence transformation ¯ A¯C¯ from (8.19). Premultiplying by O ¯T given in (8.21), we note that OAC = O T ¯ and postmultiplying by C , we obtain P A = AP , in view of (8.24) and (8.25). ¯ and C = CP ¯ , we simply use the relations P C = C¯ and To show that P B = B ¯ O = OP , respectively. 8.3.3 The Order of Minimal Realizations One could ask the question whether the order of a minimal realization of H(s) can be determined directly, without having to actually derive a minimal realization. The answer to this question is yes, and in the following we will show how this can be accomplished. Determination via the Characteristic or Pole Polynomial of H(s). The characteristic polynomial (or pole polynomial), pH (s), of a transfer function matrix H(s) was deﬁned in Section 7.4 using the Smith–McMillan form of H(s). The polynomial pH (s) is equal to the monic least common denominator of all nonzero minors of H(s). The minimal polynomial of a transfer function matrix H(s), mH (s), was deﬁned as the monic least common denominator of all nonzero ﬁrst-order minors (entries) of H(s). Deﬁnition 8.11. The McMillan degree of H(s) is the degree of pH (s).

The number of poles in H(s), which are deﬁned as the zeros of pH (s), is equal to the McMillan degree of H(s). The degree of H(s) is in fact the order of any minimal realization of H(s), as the following result shows. Theorem 8.12. Let {A, B, C, D} be a minimal realization of H(s). Then the characteristic polynomial of H(s), pH (s), is equal to the characteristic polynomial of A, α(s) |sI − A|; i.e., pH (s) = α(s). Therefore, the McMillan degree of H(s) equals the order of any minimal realization. Proof. See [1, p. 397, Chapter 5, Theorem 3.11].

It can also be shown that the minimal polynomial of H(s), mH (s), is equal to the minimal polynomial of A, αm (s), where {A, B, C, D} is any controllable and observable realization of H(s). This is illustrated in the following example.

1/s 2/s Example 8.13. Let H(s) = . The ﬁrst-order minors, the entries 0 −1/s of H(s), have denominators s, s, and s, and therefore, mH (s) = s. The only second-order minor is −1/s2 and pH (s) = s2 with deg pH (s) = 2. Therefore,

322

8 Realization Theory and Algorithms

the order of a minimal realization by x˙ = Ax+ is 2. Such a realization is given 00 1 2 10 Bu and y = Cx with A = ,B = ,C = . We verify ﬁrst 00 0 −1 01 that this system is a realization of H(s) and then that it is controllable and observable and, therefore, minimal. Notice that the characteristic polynomial of A is α(s) = s2 = pH (s) and that its minimal polynomial is αm (s) = s = mH (s). In the case when H(s) is a scalar, the roots of mH = pH are the eigenvalues of any minimal realization of H(s). Corollary 8.14. Let H(s) = n(s)/d(s) be a scalar proper rational function. If {A, B, C, D} is a minimal realization of H(s), then kd(s) = α(s) = αm (s),

(8.26)

where α(s) = det(sI − A) and αm (s) are the characteristic and minimal polynomials of A, respectively, and k is a real scalar so that kd(s) is a monic polynomial. Proof. The characteristic and minimal polynomials of H(s), pH (s), and mH (s) are by deﬁnition equal to d(s) in the scalar case. Applying Theorem 8.12 proves the result. Determination via the Hankel Matrix There is an alternative way of determining the order of a minimal realization of H(s). This is accomplished via the Hankel matrix, associated with H(s). Given H(s), we express H(s) as a Laurent series expansion to obtain % = H0 + H1 s−1 + H2 s−2 + H3 s−3 + . . . , H(s) = H0 + H(s)

(8.27)

% where H(s) is strictly proper and the real p × m matrices H0 , H1 , . . . are the Markov parameters of the system. They can be determined by the formulas H0 = lim H(s), H1 = lim s(H(s)−H0 ), H2 = lim s2 (H(s)−H0 −H1 s−1 ), s→∞

s→∞

s→∞

and so forth. Deﬁnition 8.15. The Hankel matrix MH (i, j) of order (i, j) corresponding to the (Markov parameter) sequence H1 , H2 , . . . is deﬁned as the ip × jm matrix given by ⎤ ⎡ H 1 H2 · · · Hj ⎢ H2 H3 · · · Hj+1 ⎥ ⎥ ⎢ MH (i, j) ⎢ . (8.28) ⎥. .. .. ⎦ ⎣ .. . . Hi Hi+1 · · · Hi+j−1

8.3 Existence and Minimality of Realizations

323

Theorem 8.16. The order of a minimal realization of H(s) is the rank of MH (r, r) where r is the degree of the least common denominator of the entries of H(s); i.e., r = deg mH (s).

Proof. See [1, p. 399, Chapter 5, Theorem 3.13]. Example 8.17. Let H(s) =

1 2 s+1 s+1 −1 1 (s+1)(s+2) s+2

. Here the minimal polynomial

is mH (s) = (s + 1)(s + 2), and therefore, r = deg mH (s) = 2. The Hankel matrix MH (r, r) is then H1 H2 MH (r, r) = MH (2, 2) = , H2 H3 s 2s s+1 s+1 an rp × rm = 4 × 4 matrix, and H1 = lim sH(s) = lim = −s s s→∞ s→∞ (s+1)(s+2) s+2 s2 2s2 12 s+1 − s s+1 − 2s 2 −1 and H2 = lim s (H(s) − H1 s ) = lim = −s2 s2 01 s→∞ s→∞ (s+1)(s+2) s+2 − s −s −2s 12 −1 −2 s+1 s+1 2 = . Now = . Similarly, H lim 3 −s −2s 34 −1 −2 s→∞ (s+1)(s+2) s+2 ⎡

⎤ 1 2 −1 −2 ⎢ 0 1 −1 −2 ⎥ ⎥ rank MH (2, 2) = rank ⎢ ⎣ −1 −2 1 2 ⎦ = 3, −1 −2 3 4 which is the order of any minimal realization, in view of Theorem 8.16. The reader should verify this result, using Theorem 8.12.

1/s 2/s Example 8.18. Consider the transfer function matrix H(s) = , 0 −1/s as in Example 8.13. Here r = deg mH (s) = deg s = 1. Now, the Hankel matrix 1 2 . Its rank is 2, which MH (r, r) = MH (1, 1) = H1 = lims→∞ sH(s) = 0 −1 is the order of a minimal realization of H(s). This agrees with the results in Example 8.13.

8.3.4 Minimality of Realizations: Discrete-Time Systems The fact that the results on minimality of realizations in the discrete-time case are essentially identical to the corresponding results for the continuous-time

324

8 Realization Theory and Algorithms

case is not surprising since we are concentrating here on the time-invariant cases for which the transfer function matrices have the same forms: H(s) = C(sI −A)−1 B +D and H(z) = C(zI −A)−1 B +D. Accordingly, the results on how to generate 4-tuples {A, B, C, D} to satisfy these relations are, of course, also the same.

8.4 Realization Algorithms In this section, algorithms for generating time-invariant state-space realizations of external system descriptions are introduced. A brief outline of the contents of this section follows. Realizations of H(s) can often be derived in an easier manner if duality is used, and this is demonstrated ﬁrst in this section. Realizations of minimal order are both controllable and observable, as was shown in the previous section. To derive a minimal realization of H(s), one typically derives a realization that is controllable (observable) and then extracts the part that is also observable (controllable). This involves in general a two-step procedure. However, in certain cases, a minimal realization can be derived in one step, as for example, when H(s) is a scalar transfer function. Algorithms for realizations in a controller/observer form are discussed ﬁrst. In the interest of clarity, the SISO case is presented separately, thus providing an introduction to the general MIMO case. Realization algorithms, where A is diagonal, are introduced next. Finally, balanced realizations are addressed. It is not diﬃcult to see that the above algorithms can also be used to derive realizations described by equations of the form x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k) of transfer function matrices H(z) for discretetime time-invariant systems. Accordingly, the discrete-time case will not be treated separately in this section. Additional details, algorithms, and proofs may be found in [1, Section 5.4]. 8.4.1 Realizations Using Duality If the system described by the equations x˙ = Ax + Bu, y = Cx + Du is a realization of H(s), then H(s) = C(sI − A)−1 B + D.

(8.29)

( (x + B (u (x ( u, where A ( = AT , B (= If H(s) H T (s), then x˜˙ = A˜ ˜ and y˜ = C ˜ + D˜ T ( T T ( = D , is a realization of H(s) ( since in view of (8.29), C , C = B , and D ( H(s) = H T (s) = B T (sI − AT )−1 C T + DT ( + D. ( ( ( −1 B = C(sI − A)

(8.30)

8.4 Realization Algorithms

325

( B, ( C, ( D} ( is the dual representation to {A, B, C, D}, The representation {A, ( B, ( C, ( D} ( is observand if {A, B, C, D} is controllable (observable), then {A, able (controllable) (see Section 5.2.3). In other words, if a controllable (observable) realization {A, B, C, D} of the p × m transfer function matrix H(s) is known, then an observable (controllable) realization of the m × p transfer ( function matrix H(s) = H T (s) can be derived immediately: It is the dual ( B, ( C, ( D} ( = {AT , C T , B T , DT }. This fact is used representation, namely, {A, to advantage in deriving realizations in the MIMO case, since obtaining ﬁrst a realization of H T (s) instead of H(s) and then using duality leads sometimes to simpler, lower order, realizations. Duality is very useful in realizations of symmetric transfer functions, which have the property that H(s) = H T (s), as, e.g., in the case of SISO systems where H(s) is a scalar. Under these conditions, if {A, B, C, D} is a controllable (observable) realization of H(s), then {AT , C T , B T , DT } is an observable (controllable) realization of the same H(s). Note that in this case, H(s) = C(sI − A)−1 B + D = H T (s) = B T (sI − AT )−1 C T + DT . In realization algorithms of MIMO systems, a realization that is either controllable or observable is typically obtained ﬁrst. Next, this realization is reduced to a minimal one by extracting the part of the system that is both controllable and observable, using the methods of Subsection 6.2.1. Dual representations may simplify this process considerably. In the following discussion, we summarize the process of deriving minimal realizations for the reader’s convenience. Given a proper rational p × m transfer function matrix H(s), with % = H(s) − lims→∞ H(s) < ∞, we consider the strictly proper part H(s) % lims→∞ H(s) = H(s) − D [noting that working with H(s) instead of H(s) is optional]. 1. If a realization algorithm leading to a controllable realization is used, then the following steps are taken: ( B, ( C} ˜ → {A = A (T , B = C (T , C = B ( T }, % ( % T (s)) → {A, H(s) → (H(s) =H (8.31a) ( ( ( ( where {A, B, C} is a controllable realization of H(s) and {A, B, C} is an % observable realization of H(s). 2. To obtain a minimal realization, B1 A1 A12 (8.31b) , [C1 , C2 ] , , {A, B, C} → 0 A2 0 % where {A, B, C} is an observable realization of H(s) obtained from step (1), and (A1 , B1 ) is controllable (derived by using the method of Subsection 6.2.1), then {A1 , B1 , C1 } is a controllable and observable, and there% fore, a minimal realization of H(s), and furthermore, {A1 , B1 , C1 , D}, is a minimal realization of H(s).

326

8 Realization Theory and Algorithms

8.4.2 Realizations in Controller/Observer Form We shall ﬁrst consider realizations of scalar transfer functions H(s). Single-Input/Single-Output (SISO) Systems (p = m = 1) Let H(s) =

b n sn + · · · + b 1 s + b 0 n(s) = n , d(s) s + an−1 sn−1 + · · · + a1 s + a0

(8.32)

where n(s) and d(s) are prime polynomials. This is the general form of a proper transfer function of (McMillan) degree n. Note that if the leading coeﬃcient in the numerator n(s) is zero, i.e., bn = 0, then H(s) is strictly proper. Also, recall that y (n) + an−1 y (n−1) + · · · + a1 y (1) + a0 y = bn u(n) + · · · + b1 u(1) + b0 u (8.33a) or d(q)y(t) = (q n + an−1 q n−1 + · · · + a1 q + a0 )y(t) = (bn q n + . . . b1 q + b0 )u(t) = n(q)u(t),

(8.33b)

where q d/dt, the diﬀerential operator. This is the corresponding nth-order diﬀerential equation that directly gives rise to the map yˆ(s) = H(s)ˆ u(s) if the Laplace transform of both sides is taken, assuming that all variables and their derivatives are zero at t = 0. Controller Form Realizations Given n(s) and d(s), we proceed as follows to derive a realization in controller form. 1. Determine CcT ∈ Rn and Dc ∈ R so that n(s) = Cc S(s) + Dc d(s),

(8.34)

where S(s) [1, s, . . . , sn−1 ]T is an n × 1 vector of polynomials. Equation (8.34) implies that (8.35) Dc = lim H(s) = bn . s→∞

Then n(s) − bn d(s) is in general a polynomial of degree n − 1, which shows that a real vector Cc that satisﬁes (8.34) always exists. If bn = 0, i.e., if H(s) is strictly proper, then from (8.34) we obtain Cc = [b0 , . . . , bn−1 ]; i.e., Cc consists of the coeﬃcients of the n − 1 degree numerator. If bn = 0, then (8.34) implies that the entries of Cc are a combination of the coeﬃcients bi and ai . In particular, Cc = [b0 − bn a0 , b1 − bn a1 , . . . , bn−1 − bn an−1 ].

(8.36)

8.4 Realization Algorithms

327

2. A realization of H(s) in controller form is given by the equations ⎤ ⎡ ⎡ ⎤ 0 1 ··· 0 0 ⎢ .. ⎢0⎥ .. ⎥ .. . . ⎢ ⎢ ⎥ . . ⎥ . x˙ c = Ac xc + Bc u = ⎢ . ⎥ xc + ⎢ .. ⎥ u, ⎣ 0 ⎣.⎦ 0 ··· 1 ⎦ −a0 −a1 · · · −an−1 1 y = Cc xc + Dc u.

(8.37)

The n states of the realization in (8.37) are related by xi+1 = x˙ i , (i) i = 1, . . . , n − 1, or xi+1 = x1 , i = 1, . . . , n − 1, and x˙ n = −a0 x1 − n−1 n−1 (i) i=1 ai xi+1 + u = −a0 x1 − i=1 ai x1 + u. It can now be shown that x1 satisﬁes the relationship d(q)x1 (t) = u(t),

y(t) = n(q)x1 (t),

(8.38)

where q d/dt, the diﬀerential operator. Note that d(q)x1 (t) = u(t) n−1 (i) (n) (n) because x˙ n = − i=0 ai x1 + x1 + u = −d(q)x1 + u + x1 , which in (n) (n−1) view of x˙ n = x1 , derived from xn = x1 , implies that −d(q)xi +u = 0. The relation y(t) = n(q)x1 (t) can easily be veriﬁed by multiplying both sides of n(q) = Cc S(q) + Dc d(q) given in (8.34) by x1 . Lemma 8.19. The representation (8.37) is a minimal realization of H(s) given in (8.32). Proof. We must ﬁrst show that (8.37) is indeed a realization, i.e., that it satisﬁes (8.29). This is of course true in view of the Structure Theorem in Subsection 6.4.1. Presently, this will be shown directly, using (8.38). ˆ(s). This yields Relation d(q)x1 (t) = u(t) implies that xˆ1 (s) = (d(s))−1 u ˆn (s)]T = [1, s, . . . , sn−1 ]T x ˆ1 (s) = for the state that x ˆ(s) = [ˆ x1 (s), . . . , x S(s)(d(s))−1 u ˆ(s). However, we also have x ˆ(s) = (sI −Ac )−1 Bc u ˆ(s). Therefore, (sI − Ac )S(s) = Bc d(s).

(8.39)

Now Cc (sI−Ac )−1 Bc +Dc = Cc S(s)(d(s))−1 +Dc = (Cc S(s)+Dc d(s))(d(s))−1 = n(s) d(s) = H(s); i.e., (8.37) is indeed a realization. System (8.37) is of order n and is therefore, a minimal, controllable, and observable realization. This is because the degree of H(s) is n, which in view of Theorem 8.12, is the order of any minimal realization. Controllability and observability can also be established directly by forming the controllability and observability matrices. The reader is encouraged to pursue this approach. According to Deﬁnition 8.11, the McMillan degree of a rational scalar transfer function H(s) = n(s)/d(s) is the degree of d(s) only when n(s) and d(s) are prime polynomials; if they are not, all cancellations must ﬁrst take

328

8 Realization Theory and Algorithms

place before the degree can be determined. If n(s) and d(s) are not prime, then the above algorithm will yield a realization that is not observable. Notice that realization (8.37) is always controllable, since it is in controller form. This can also be seen directly from the expression ⎡ ⎤ 0 0 ··· 1 ⎢ .. .. .. ⎥ ⎢ .⎥ (8.40) [Bc , Ac Bc , . . . , An−1 Bc ] = ⎢ . . ⎥, c ⎣0 1 ··· ×⎦ 1 × ··· × which is of full rank. The realization (8.37) is observable if and only if the polynomials d(s) and n(s) are prime. In Figure 8.2 a block realization diagram of the form (8.37) for a secondorder transfer function is shown. Note that the states x1 (t) and x2 (t) are taken to be the voltages at the outputs of the integrators. b2 b1 – b2 a 1 u

∫

Σ

x2

∫

x1

b0 – b2 a 0

+ +

+ + y Σ +

– a1 – a0

Figure 8.2. Block realization of H(s) in controller form of the system xx˙˙ 12 = 0 1 x1 x1 b2 s2 +b1 s+b0 0 −a0 −a1 [ x2 ] + [ 1 ] u, y = [b0 − b2 a0 , b1 − b2 a1 ] [ x2 ] + b2 u; H(s) = s2 +a s+a 1

0

Observer Form Realizations Given the transfer function (8.32), the nth-order realization in observer form is given by x˙ o = Ao xo + Bo u ⎡ 0 · · · 0 −a0 ⎢1 0 −a1 ⎢ =⎢. . . .. ⎣ .. . . .. . 0 · · · 1 −an−1

⎤

⎡

⎥ ⎢ ⎥ ⎢ ⎥ xo + ⎢ ⎦ ⎣

b 0 − b n a0 b 1 − b n a1 .. .

⎤ ⎥ ⎥ ⎥ u, ⎦

bn−1 − bn an−1

y = Co xo + Do u = [0, 0, . . . , 0, 1]xo + bn u.

(8.41)

This realization was derived by taking the dual of realization (8.37). Notice that Ao = ATc , Bo = CcT , Co = BcT , and Do = DcT .

8.4 Realization Algorithms

329

Lemma 8.20. The representation (8.41) is a minimal realization of H(s) given in (8.32). Proof. Note that the observer form realization {Ao , Bo , Co , Do } described by (8.41) is the dual of the controller form realization {Ac , Bc , Cc , Dc } described by (8.37), used in Lemma 8.19. The realization (8.41) can also be derived directly from H(s), using deﬁning relations similar to (8.34). In particular, Bo and Do can be determined from the expression [see Subsection 6.4.2] ( n(s) = S(s)B o + d(s)Do ,

(8.42)

( = [1, s, . . . , sn−1 ]. where S(s) It can be shown (by taking transposes) that the corresponding relation to (8.39) is now given by ( S(s)(sI − Ao ) = d(s)Co

(8.43)

and that d(q)z(t) = n(q)u(t),

y(t) = z(t)

(8.44)

corresponds to (8.38). Figure 8.3 depicts a block realization diagram of the form (8.41) for a second-order transfer function. u

+ Σ + – a0

b2

b1 – b2 a 1

b0 – b2 a 0

∫

x1

+ +

Σ +

∫

x2

+ +

Σ

y

– a1

Figure 8.3. Block realization of H(s) in observer form of the system 0 −a0 x1 x1 b0 −b2 a0 b2 s2 +b1 s+b0 1 −a1 [ x2 ] + b1 −b2 a1 u, y = [0, 1] [ x2 ] + b2 u; H(s) = s2 +a1 s+a0

x˙ 1 x˙ 2

=

Example 8.21. We wish to derive a minimal realization for the transs3 +s−1 fer function H(s) = s3 +2s 2 −s−2 . Consider a realization {Ac , Bc , Cc , Dc }, where (Ac , Bc ) is in controller form. In view of (8.34) to (8.37), Dc = lims→∞ H(s) = 1 and n(s) = s3 +s−1 = Cc S(s)+Dc d(s), from which we have

330

8 Realization Theory and Algorithms

Cc S(s) = (s3 + s − 1) − (s3 + 2s2 − s − 2) = −2s2 + 2s + 1 = [1, 2, −2][1, s, s2]T . Therefore, a realization of H(s) is x˙ c = Ac xc + Bc u, y = Cc xc + Dc u, where ⎡ ⎡ ⎤ ⎤ 01 0 0 Ac = ⎣ 0 0 1 ⎦ , Bc = ⎣ 0 ⎦ , Cc = [1, 2, −2], Dc = 1. 2 1 −2 1 This is a minimal realization. Instead of solving n(s) = Cc S(s) + Dc d(s) for Cc as was done above, it is possible to derive Cc by inspection after H(s) is written as % % + Dc , (8.45) H(s) = H(s) + lim H(s) = H(s) s→∞

% where H(s) is now strictly proper. Notice that if H(s) is given by (8.32), then Dc = bn and cn−1 sn−1 + · · · + c1 s + c0 % , (8.46) H(s) = n s + an−1 sn−1 + · · · + a1 s + a0 where in fact, ci = bi − bn ai , i = 0, . . . , n − 1. The realization {Ac , Bc , Cc } % of H(s) has (Ac , Bc ) precisely the same as before; however, Cc can now be written directly as (8.47) Cc = [c0 , c1 , . . . , cn−1 ]; i.e., given H(s) there are three ways of determining Cc : (i) using formula (8.36), (ii) solving Cc S(s) = n(s) − Dc d(s) as in (8.34), and (iii) calculating % H(s) = H(s) − lims→∞ H(s). The reader should verify that for this example, (i) and (iii) yield the same Cc = [1, 2, −2] as in method (ii). Suppose now that it is of interest to determine a minimal realization {Ao , Bo , Co , Do }, where (Ao , Co ) is in observer form. This can be accomplished in ways completely analogous to the methods used to derive realizations in controller form. Alternatively, one could use duality directly and show that ⎡ ⎤ ⎡ ⎤ 00 2 1 T T Ao = Ac = ⎣ 1 0 1 ⎦ , Bo = Cc = ⎣ 2 ⎦ , Co = BcT = [0, 0, 1], Do = DcT = 1 0 1 −2 −2 is a minimal realization, where the pair (Ao , Co ) is in observer form. 3

s −1 Example 8.22. Consider now the transfer function H(s) = s3 +2s 2 −s−2 , 3 3 where the numerator is n(s) = s − 1 instead of s + s − 1, as in Example 8.21. We wish to derive a minimal realization of H(s). Using the same procedure as in the previous example, it is not diﬃcult to derive the realization ⎡ ⎡ ⎤ ⎤ 01 0 0 Ac = ⎣ 0 0 1 ⎦ , Bc = ⎣ 0 ⎦ , Cc = [1, 1, −2], Dc = 1. 2 1 −2 1

8.4 Realization Algorithms

331

This realization is controllable, since (Ac , Bc ) is in controller form (see Exercise 8.4); however, it is not observable, since rank O = 2 < 3 = n, where O denotes the observability matrix given by ⎡ ⎤ ⎡ ⎤ Cc 1 1 −2 5⎦. O = ⎣ Cc Ac ⎦ = ⎣ −4 −1 Cc A2c 10 1 −11 Therefore, the above matrix is not a minimal realization. This has occurred because the numerator and denominator of H(s) are not prime polynomials; i.e., s − 1 is a common factor. Thus, strictly speaking, the H(s) given above is not a transfer function, since it is assumed that in a transfer function all cancellations of common factors have taken place. (See also the discussion following Lemma 8.19.) Correspondingly, if the algorithm for deriving an observer form would be applied to the present case, the realization {Ao , Bo , Co , Do } would be an observable realization, but not a controllable one, and would therefore not be a minimal realization. To obtain a minimal realization of the above transfer function H(s), one could either extract the part of the controllable realization {Ac , Bc , Cc , Dc } that is also observable or simply cancel the factor s − 1 in H(s) and apply the algorithm again. The former approach of reducing a controllable realization will be illustrated when discussing the MIMO case. The latter approach is perhaps the easiest one to apply in this case. We have H(s) =

s2 + s + 1 −2s − 1 s3 − 1 = = 2 + 1, 3 2 2 s + 2s − s − 2 s + 3s + 2 s + 3s + 2

and a minimal realization of this is then determined as 0 1 0 Ac = , Bc = , Cc = [−1, −2], −2 −3 1

Dc = 1.

Multi-Input/Multi-Output (MIMO) Systems (pm > 1) Let a (p × m) proper rational matrix H(s) be given with lims→∞ H(s) < ∞. We now present alogrithms to obtain realizations {Ac , Bc , Cc , Dc } of H(s) in controller form and realizations {Ao , Bo , Co , Do } of H(s) in observer form. Minimal realizations can then be obtained by separating the observable (controllable) part of the controllable (observable) realization. Controller Form Realizations Consider a transfer function matrix H(s) = [nij (s)/dij (s)], i = 1, . . . , p, j = 1, . . . , m, and let j (s) denote the (monic) least common denominator of all entries in the jth column of H(s). The j (s) is the least degree polynomial divisible by all dij (s), i = 1, . . . , p. Then H(s) can be written as

332

8 Realization Theory and Algorithms

H(s) = N (s)D−1 (s),

(8.48)

a ratio of two polynomial matrices, where N (s) [¯ nij (s)] and D(s) diag[1 (s), . . . , m (s)]. Note that n ¯ ij (s)/j (s) = nij (s)/dij (s) for i = 1, . . . , p, and all j = 1, . . . , m. Let dj deg j (s), and assume that dj ≥ 1. Deﬁne Λ(s) diag(sd1 , . . . , sdm ) and ⎛⎡ ⎜⎢ ⎜⎢ S(s) block diag ⎜⎢ ⎝⎣

1 s .. .

⎤

⎞

⎥ ⎟ ⎥ ⎟ ⎥ j = 1, . . . , m⎟ , ⎦ ⎠

(8.49)

sdj −1 m and note that S(s) is an n j=1 dj × m polynomial matrix. Write D(s) = Dh Λ(s) + D S(s),

(8.50)

and note that Dh is the highest column degree coeﬃcient matrix of D(s). Here D(s) is diagonal with monic polynomial entries, and therefore, Dh = Im . If, 3s2 + 1 2s for example, D(s) = , then the highest column degree coeﬃcient 2s s 32 , and D S(s) given in (8.50) accounts for the remaining matrix Dh = 01 lower column degree terms in D(s), with D being a matrix of coeﬃcients. Observe that |Dh | = 0, and deﬁne the m × m and m × n matrices Bm = Dh−1 ,

Am = −Dh−1 D ,

(8.51)

respectively. Also, determine Cc and Dc such that N (s) = Cc S(s) + Dc D(s),

(8.52)

Dc = lim H(s).

(8.53)

and note that s→∞

We have H(s) = N (s)D−1 (s) = Cc S(s)D−1 (s)+Dc with Cc S(s)D−1 (s) being strictly proper (show this). Therefore, only Cc needs to be determined from (8.52). A controllable realization of H(s) in controller form is now given by the equations x˙ c = Ac xc + Bc u, y = Cc xc + Dc u. Here Cc and Dc were deﬁned in (8.52) and (8.53), respectively, ¯c Am , Ac = A¯c + B

¯c Bm , Bc = B

(8.54)

8.4 Realization Algorithms

333

where A¯c = block diag[A1 , A2 . . . , Am ] with ⎡ ⎤ 0 ⎢ .. ⎥ ⎢ ⎥ Aj = ⎢ . Idj−1 ⎥ ∈ Rdj ×dj , ⎣ ⎦ 0 0···0 ⎛⎡ ⎤ ⎞ 0 ⎜⎢ .. ⎥ ⎟ ⎢ ⎥ ⎟ ¯c = block diag ⎜ B ⎜⎢ . ⎥ ∈ Rdj , j = 1, . . . , m⎟ , ⎝⎣ 0 ⎦ ⎠ 1 and Am , Bm were deﬁned in (8.51). Note that if dj = μj , j = 1, . . . , m, the controllability indices, then (8.54) is precisely the relation (6.56) of Section 6.4. m Lemma 8.23. The system {Ac , Bc , Cc , Dc } is an n(= j=1 dj )-th-order controllable realization of H(s) with (Ac , Bc ) in controller form. Proof. First, to show that {Ac , Bc , Cc , Dc } is a realization of H(s), we note that in view of the Structure Theorem given in Subsection 6.4.1, we have ¯ (s)D(s) ¯ −1 , where Cc (sI − Ac )−1 Bc + Dc = N −1 ¯ D(s) Bm [Λ(s) − Am S(s)],

¯ (s) Cc S(s) + Dc D(s). N

¯ ¯ (s) = N (s), in view of (8.50) to (8.52). ThereHowever, D(s) = D(s) and N fore, Cc (sI − Ac )−1 Bc + Dc = N (s)D−1 (s) = H(s), in view of (8.48). It is now shown that (Ac , Bc ) is controllable. We write ¯c Am , B ¯ c Bm ] [sI − Ac , Bc ] = [sI − A¯c − B I 0 ¯c ] = [sI − A¯c , B −Am Bm

(8.55)

¯c ] = n for any complex sj . This is so because and notice that rank[sj I − A¯c , B ¯c . (This is, in fact, the Brunovski canonical form.) of the special form of A¯c , B Now since |Bm | = 0, Sylvester’s Rank Inequality implies that rank[sj I − Ac , Bc ] = n for any complex sj , which in view of Section 6.3 implies that (Ac , Bc ) is controllable. In addition, since Bm = Im , it follows that (Ac , Bc ) is of the form (6.55) of Section 6.4. With dj = μi , the pair (Ac , Bc ) is in controller form. An alternative way of determining Cc is to ﬁrst write H(s) in the form % % + Dc , H(s) = H(s) + lim H(s) = H(s) s→∞

(8.56)

% where H(s) H(s)− Dc is strictly proper. Now applying the above algorithm % % % (s)D−1 (s), where D(s) is precisely equal to to H(s), one obtains H(s) =N

334

8 Realization Theory and Algorithms

% (s) is diﬀerent. In the expression given in (8.50). We note, however, that N % (s) = N (s) − Dc D(s). In view of (8.52) the matrix Cc is now found to fact, N be of the form % (s) = Cc S(s). N (8.57) Note that this is a generalization of the scalar case discussed in Example 8.21 [see (8.45) to (8.47)]. In the above algorithm the assumption that dj ≥ 1 for all j = 1, . . . , m, was made. If for some j, dj = 0, this would mean that the jth column of H(s) will be a real m × 1 vector that will be equal to the jth column of Dc % [recall that Dc = lims→∞ H(s)]. The strictly proper H(s) in (8.56) will then have its jth column equal to zero, and this zero column can be generated by a realization where the jth column of Bc is set to zero. Therefore, the zero % column (the jth column) of H(s) is ignored in this case and the algorithm is applied to obtain a controllable realization. A zero column is then added to Bc . (See Example 8.26 below.) Observer Form Realizations These realizations are dual to the controller form realizations and can be obtained by duality arguments. In the following discussion, observer form realizations are obtained directly for completeness of exposition. We consider the transfer function matrix H(s) = [nij (s)/dij (s)], i = 1, . . . , p, j = 1, . . . , m, and let ˜i (s) be the (monic) least common denominator of all entries in the ith row of H(s). Then H(s) can be written as ( (s), ( −1 (s)N H(s) = D

(8.58)

( ( (s) [¯ diag[˜1 (s), . . . , ˜p (s)]. Note that where N nij (s)] and D(s) n ¯ ij (s)/˜i (s) = nij (s)/dij (s) for j = 1, . . . , m, and all i = 1, . . . , p. Let d˜i deg i (s), assume that d˜i ≥ 1, deﬁne ˜ ˜ diag(sd˜1 , . . . , sd˜p ), S(s) ( Λ(s) block diag([1, s, . . . , sdi −1 ], i = 1, . . . , p), (8.59) p ˜ ( and note that S(s) is a p × n( i=1 di ) polynomial matrix. Now, write

( ˜ D ( h + S(s) ( D ( D(s) = Λ(s)

(8.60)

( ( h is the highest row degree coeﬃcient matrix of D(s). Note and note that D ( ( that D(s) is diagonal, with entries monic polynomials, sothat Dh = Ip , the 2 + 1 2s 3s ( , then the highest p × p identity matrix. If for example, D(s) = 2s s ( h = 3 0 and S(s) ( D ( in (8.60) accounts for row degree coeﬃcient matrix is D 21 ( ( a matrix of coeﬃcients. the remaining lower row degree terms of D(s), with D

8.4 Realization Algorithms

335

( h | = 0, in fact D ( h = Ip . Deﬁne the p× p and n× p matrices Observe that |D ( −1 Cp = D h

( −1 , ( D and Ap = −D h

(8.61)

respectively. Also, determine Bo and Do such that ( (s) = S(s)B ( ( N o + D(s)Do .

(8.62)

Do = lim H(s),

(8.63)

Note that s→∞

and therefore, only Bo needs to be determined from (8.62). An observable realization of H(s) in observer form is now given by x˙ o = Ao xo + Bo u,

y = Co xo + Do u,

where Bo and Do were deﬁned in (8.62) and (8.63), respectively, and Ao = A¯o + Ap C¯o ,

Co = Cp C¯o ,

(8.64)

where A¯o = block diag[A1 , A2 , . . . , Ap ] with ⎡ ⎤ 0···0 0 ⎢ 0⎥ ⎢ ⎥ d˜ ×d˜ Ai = ⎢ .. ⎥ ∈ R i i , ⎣I .⎦ d˜i −1

0

˜ C¯o = block diag([0, . . . , 0, 1] ∈ R1×di i = 1, . . . , p), and Ap , Cp is deﬁned in (8.61). Note that (8.64) is exactly relation (6.76) of Section 6.4 if d˜i = νi , i = 1, . . . , p, the observability indices. p Lemma 8.24. The system {Ao , Bo , Co , Do } is an n( i=1 d˜i )-th-order observable realization of H(s) with (Ao , Co ) in observer form.

Proof. This is the dual result to Lemma 8.23. The proof is completely analogous and is omitted. We conclude by noting that results dual to the results discussed after Lemma 8.23 are also valid here, i.e., results involving (i) a strictly proper % ( −1 (s)N ( (s), H(s), (ii) an H(s) with d˜i = 0 for some row i, and (iii) H(s) = D ( ( where D(s), N (s) are not necessarily determined using (8.58) (refer to the following examples). 2 s+1 Example 8.25. Let H(s) = s s+1 . We wish to derive a minimal real2 , s3 ization for H(s). To this end we consider realizations {Ac , Bc , Cc , Dc }, where (Ac , Bc ) is in controller form. Here 1 (s) = s2 , 2 (s) = s3 and H(s) can therefore be written in the form (8.48) as

336

8 Realization Theory and Algorithms

H(s) = N (s)D

−1

s2 0 (s) = [s + 1, s + 1] 0 s3

−1

2

.

T s2 0 1s00 0 Here d1 = 2, d2 = 3 and Λ(s) = . Note that 4, S(s) = 0 s3 0 0 1 s s2 n = d1 +d2 = 5, and therefore, the realization will be 5. Write D(s) = of order 00000 Dh Λ(s) + D S(s), and note that Dh = I2 , D = . Therefore, in 00000 view of (8.51), 10 00000 Bm = and Am = −D = . 01 00000 Here Dc = lims→∞ H(s) = [1, 0] and (8.52) implies that Cc S(s) = N (s) − Dc D(s) = [s2 + 1, s + 1] − [s2 , 0] = [1, s + 1], from which we have Cc = [1, 0, 1, 1, 0]. A controllable realization in controller form is therefore given by x˙ = Ac xc + Bc u and y = Cc xc + Dc u, where ⎡ ⎡ ⎤ ⎤ 01000 00 ⎢0 0 0 0 0⎥ ⎢1 0⎥ ⎢ ⎢ ⎥ ⎥ ⎥ , Bc = ⎢ 0 0 ⎥ , Ac = ⎢ 0 0 0 1 0 ⎢ ⎢ ⎥ ⎥ ⎣0 0 0 0 1⎦ ⎣0 0⎦ 00000 01 Cc = [1, 0, 1, 1, 0],

and Dc = [1, 0].

Note that the characteristic (pole) polynomial of H(s) is s3 and that the McMillan degree of H(s) is 3. The order of any minimal realization of H(s) is therefore 3. This implies that the controllable ﬁfth-order realization derived above cannot be observable [verify that (Ac , Cc ) is not observable]. To derive a minimal realization, the observable part of the system {Ac , Bc , Cc , Dc } needs to be extracted, using the method described in Section 6.2. In particular, a transformation matrix P needs to be determined so that % = P Ac P −1 = A1 0 % = Cc P −1 = [C1 , 0], A and C A21 A2 % = P Bc = B1 , then {A1 , B1 , C1 , D1 } is where (A1 , C1 ) is observable. If B B2 a minimal realization of H(s). To reduce (Ac , Cc ) to such a standard form for unobservable systems, we let AD = AT , BD = CcT , and CD = BcT and we reduce (AD , BD ) to a standard form for uncontrollable systems. Here the controllability matrix is ⎡ ⎤ 10000 ⎢0 1 0 0 0⎥ ⎢ ⎥ ⎥ CD = ⎢ ⎢1 0 0 0 0⎥. ⎣1 1 0 0 0⎦ 01100

8.4 Realization Algorithms

337

−1 Note that rank CD = 3. Now if the ﬁrst three columns of QD = PD are taken to be the ﬁrst three linearly independent columns of CD , whereas the rest are chosen so that |QD | = 0, then ⎡ ⎡ ⎤ ⎤ 10001 0 −1 0 1 0 ⎢0 1 0 0 0⎥ ⎢0 1 0 0 0⎥ ⎢ ⎢ ⎥ ⎥ −1 ⎢ ⎥ ⎥ QD = ⎢ 1 0 0 1 0 ⎥ and QD = ⎢ ⎢ 0 −1 0 0 1 ⎥ . ⎣1 1 0 0 0⎦ ⎣ 0 1 1 −1 0 ⎦ 01100 1 1 0 −1 0

This implies that ⎡

0 ⎢1 ⎢ %D = Q−1 AD QD = AD1 AD12 = ⎢ 0 A D ⎢ 0 AD2 ⎣0 0 ⎡ ⎤ 1 ⎢0⎥ ⎢ ⎥ %D = Q−1 BD = BD1 = ⎢ 0 ⎥ , and B D ⎢ ⎥ BD2 ⎣0⎦ 0 Then

⎤ 0 0 1 −1 0 0 0 1⎥ ⎥ 1 0 0 −1 ⎥ ⎥, 0 0 −1 1 ⎦ 0 0 −1 1 %D = CD QD = 0 1 0 0 0 . C 01100

⎤ 01 0 0 0 ⎢ 0 0 1 0 0⎥ ⎥ ⎢ % = A1 0 = A %TD = ⎢ 0 0 0 0 0 ⎥ , A ⎥ ⎢ A21 A2 ⎣ 1 0 0 −1 −1 ⎦ −1 1 −1 1 1 ⎡ ⎤ 00 ⎢1 1⎥ ⎢ ⎥ .. T %=C %D ⎥ % %T B =⎢ ⎢ 0 1 ⎥ , and C = BD = [C1 , 0] = [1, 0, 0, . 0, 0]. ⎣0 0⎦ 00 ⎡

% = A %T , C % = B % T is in standard form. Therefore, a controllable Clearly, A D D and observable realization, which is a minimal realization, is given by x˙ co = Aco xco + Bco u and y = Cco xco + Dco u, where ⎡ ⎡ ⎤ ⎤ 010 00 Aco = ⎣ 0 0 1 ⎦ , Bco = ⎣ 1 1 ⎦ , Cco = [1, 0, 0], Dco = [1, 0]. 000 01 A minimal realization could also have been derived directly in the present case if a realization {Ao , Bo , Co , Do } of H(s), where (Ao , Bo ) is in observer

338

8 Realization Theory and Algorithms

form, had been considered ﬁrst, as is shown next. Notice that the McMillan degree of H(s) is 3, and therefore, any realization of order higher than 3 will not be minimal. Here, however, the degree of the least common denominator of the (only) row is 3, and therefore, it is known in advance that the realization in observer form, which is of order 3, will be minimal. A realization {Ao , Bo , Co , Do } of H(s) in observer form can also be derived by considering H T (s) and deriving a realization in controller form. Presently, {Ao , Bo , Co , Do } is derived directly. In particular, we write H(s) = ( −1 (s)N ( (s) = (s3 )−1 [s(s2 + 1), s + 1]. Then d˜1 = 3 [= deg ˜1 (s) = deg s3 ] and D ˜ = s3 , S(s) ( ( ˜ D ( h + S(s) ( D ( implies that Λ(s) = [1, s, s2 ]. Then D(s) = s3 = Λ(s) T ( ( Dh = 1 and D = [0, 0, 0] . In view of (8.61), we have Cp = 1,

Ap = [0, 0, 0]T ,

( ( ( Do = lims→∞ H(s) = [1, 0], and (8.62) implies that S(s)B o = N (s) − D(s)Do T 010 2 3 = [s(s + 1), s + 1] − [s , 0] = [s, s + 1], from which we have Bo = . An 110 observable realization of H(s) is the system x˙ = Ao xo + Bo u, y = Co xo + Do u, where ⎡ ⎡ ⎤ ⎤ 000 01 Ao = ⎣ 1 0 0 ⎦ , Bo = ⎣ 1 1 ⎦ , Co = [0, 0, 1], Do = [1, 0], 010 00 with (Ao , Co ) in observer form (see Lemma 8.24). This realization is minimal since it is of order 3, which is the McMillan degree of H(s). (The reader should verify this.) Note how much easier it was to derive a minimal realization, using the second approach.

1 Example . We wish to derive a minimal realiza0 = 2 and 2 (s) = 1 with d2 = 0. In view tion. Here of 01 the discussion following Lemma 8.23, we let Dc = lims→∞ H(s) = and 00 2 2 0 %% % H(s) = s+1 and . We now consider the transfer function H(s) = s+1 1 1 0 s s determine a minimal realization. %% Note that the McMillan degree of H(s) is 2, and therefore, any realization of order 2 will be minimal. Minimal realizations are now derived using two alternative approaches: 2 8.26. Let H(s) = s+1 1 s 1 (s) = s(s + 1) with d1

1. Via a controller form realization. Here 1 (s) = s(s + 1), d1 = 2, and 2s %% H(s) = [s(s + 1)]−1 = N (s)D−1 (s). Then Λ(s) = s2 and S(s) = s+1 [1, s]T , D(s) = s(s + 1) = 1s2 + [0, 1][1, s]T = Dh Λ(s) + D S(s).

8.4 Realization Algorithms

339

02 Therefore, Bm = 1 and Am = −[0, 1]. Also, Cc = , which follows 11 2s 02 1 from N (s) = = = Cc S(s). Then a minimal realization s+1 11 s 0 1 0 02 , Bc = , Cc = . Adding a zero column for H(s) is Ac = 0 −1 1 11 to Bc , a minimal realization of H(s) is now derived as 0 1 00 02 01 A= , B= , C= , D= . 0 −1 10 11 00 We ask the reader to verify that by adding a zero column to Bc , controllability is preserved. %% T 2. Via an observer form realization. We consider H (s) = [2/(s + 1), 1/s] and derive a realization in controller form. In particular, 1 = s + −1 s+1 0 s0 %% T (s) = [2, 1] , d1 = d2 = 1, Λ(s) = , and 1, 2 = s, H 0 s 0s 10 s+1 0 10 s0 10 10 S(s) = . Then D(s) = = + = 01 0 s 00 01 01 0s 10 −1 0 , Am = . Also, Cc = [2, 1], from Dh Λ(s)+D S(s) and Bm = 01 00 10 which we obtain N (s) = [2, 1] = [2, 1] = Cc S(s). Therefore, a min01 −1 0 10 %% T imal realization {A, B, C} of H (s) is , , [2, 1] . The dual 00 01 −1 0 2 %% , Bo = , of this is a minimal realization of H(s), namely, Ao = 0 0 1 10 and Co = . Therefore, a minimal realization of H(s) is 01

−1 0 A= , 00

20 B= , 10

10 C= , 01

01 D= . 00

8.4.3 Realizations with Matrix A Diagonal When the roots of the minimal polynomial mH (s) of H(s) are distinct, there is a realization algorithm that provides a minimal realization of H(s) with A diagonal. Let (8.65) mH (s) = sr + dr−1 sr−1 + · · · + d1 s + d0 be the (monic) least common denominator of all nonzero entries of the p × m matrix H(s), which in view of Section 7.4, is the minimal polynomial of H(s). We assume that its r roots λi are distinct, and we write

340

8 Realization Theory and Algorithms

mH (s) =

r

(s − λi ).

(8.66)

i=1

Note that the pole polynomial of H(s), pH (s), will have repeated roots (poles) % H(s) − if pH (s) = mH (s). We now consider the strictly proper matrix H(s) lims→∞ H(s) = H(s) − D, and we expand it into partial fractions to obtain % % (s)/mH (s) = H(s) =N

r i=1

1 Ri . s − λi

(8.67)

The p × m residue matrices Ri can be found from the relation % Ri = lim (s − λi )H(s).

(8.68)

s→λi

We write Ri = Ci Bi ,

i = 1, . . . , r,

(8.69)

where Ci is a p × ρi and Bi is a ρi × m matrix with ρi rank Ri ≤ min(p, m). Note that the above expression is always possible. Indeed, there is a systematic procedure of generating it, namely, by obtaining an LU decomposition of Ri . Then ⎤ ⎡ ⎤ ⎡ B1 λ1 Iρ1 ⎥ ⎢ B2 ⎥ ⎢ λ2 Iρ2 ⎥ ⎢ ⎥ ⎢ , B = (8.70) A=⎢ ⎥ ⎢ .. ⎥ , .. ⎦ ⎣ . ⎦ ⎣ . λr Iρr C = [C1 , C2 , . . . , Cr ], is a minimal realization of order n

Br

D = lim H(s) r i=1

s→∞

ρi .

Lemma 8.27. Representation (8.70) is a minimal realization of H(s). Proof. It can be veriﬁed directly that C(sI − A)−1 B + D = H(s), i.e., that (8.70) is a realization of H(s). To verify controllability, we write ⎤ ⎡ ⎤ ⎡ B1 n−1 ⎥ Im , λ1 Im , . . . , λ1 Im ⎢ B 2 ⎥ ⎥ ⎢ .. .. ⎢ .. C = [B, AB, . . . , An−1 B] = ⎢ ⎥⎣ . . ⎦. .. . ⎦ ⎣ . n−1 Im , λr Im , . . . , λr Im Br The second matrix in the product is a block Vandermonde matrix of dimensions mr × mn. It can be shown that this matrix has full rank mr since all = Σρi ) × mr matrix λi are assumed to be distinct. Also r note that the(n r block diag[Bi ] has rank equal to i=1 rank Bi = i=1 ρi = n ≤ mr. Now, in view of Sylvester’s Rank Inequality, as applied to the above matrix product, we have n + mr − mr ≤ rank C ≤ min(n, mr), from which rank C = n. Therefore, {A, B, C, D} is controllable. Observability is shown in a similar way. Therefore, representation (8.70) is minimal.

8.4 Realization Algorithms

Example 8.28. Let H(s) =

1 0 s 2 1 s+1 s(s+1)

341

. Here mH (s) = s(s + 1) with roots

1 R2 , where R1 = λ1 = 0, λ2 = −1 distinct. We write H(s) = 1s R1 + s+1 1 0 10 , R2 = lims→−1 (s + 1)H(s) = = lims→0 sH(s) = lims→0 2s 1 01 s+1 s+1 s+1 0 0 s 0 lims→−1 = , ρ1 = rank R1 = 2, and ρ2 = rank R2 = 1; i.e., 2 −1 2 1s the order of a minimal realization is n = ρ1 + ρ2 = 3. We now write 10 10 10 R1 = = = C1 B1 , 01 01 01 0 0 0 = [2 − 1] = C2 B2 . R2 = 2 −1 1

Then

⎡

⎤ 00 0 λ1 I2 0 A= = ⎣0 0 0 ⎦, 0 λ2 0 0 −1 100 C = [C1 , C2 ] = 011

B=

B1 B2

⎡

⎤ 1 0 = ⎣0 1⎦, 2 −1

is a minimal realization with A diagonal (show this). Note that the characteristic polynomial of H(s) is pH (s) = s2 (s + 1), and therefore, the McMillan degree, which is equal to the order of any minimal realization, is 3, as expected.

8.4.4 Realizations Using Singular-Value Decomposition Internally Balanced Realizations. Given a proper p × m matrix H(s), we let r denote the degree of its minimal polynomial mH (s), we write H(s) = H0 + H1 s−1 + H2 s−2 + . . . to obtain the Markov parameters Hi , ⎡ H1 · · · Hr ⎢ .. T MH (r, r) = ⎣ .

and we deﬁne ⎤ ⎤ ⎡ H2 · · · Hr+1 ⎥ % ⎢ .. ⎥ ⎦,T ⎣. ⎦, Hr · · · H2r−1 Hr+1 · · · H2r

(8.71)

where MH (r, r) is the Hankel matrix (see Deﬁnition 8.15) and T, T% are real matrices of dimension rp × rm. Using singular-value decomposition (see Section A.9), we write

342

8 Realization Theory and Algorithms

T =K

Σ0 L, 0 0

(8.72)

where = diag[λ1 , . . . , λn ] ∈ Rn×n with n = rank T = rank MH (r, r), which in view of Theorem 8.16 is the order of a minimal realization of H(s). The λi with λ1 ≥ λ2 ≥ · · · ≥ λn > 0 are the singular values of T , i.e., the nonzero eigenvalues of T T T . Furthermore, KK T = K T K = Ipr and LLT = LT L = Imr . We write T = K1 ΣL1 = (K1 Σ 1/2 )(Σ 1/2 L1 ) = V U,

(8.73)

where K1 denotes the ﬁrst n columns of K, L1 denotes the ﬁrst n rows of L, K1T K1 = In , and L1 LT1 = In . Also, V ∈ Rrp×n and U ∈ Rn×rm . We let V + and U + denote pseudoinverses of V and U , respectively (see the appendix); i.e., V + = Σ −1/2 K1T

and U + = LT1 Σ −1/2 ,

(8.74)

where V + V = In and U U + = In . Now deﬁne A = V + T%U + ,

T B = U Im,mr ,

C = Ip,pr V,

D = H0 ,

(8.75)

where Ik, [Ik , 0−k ], k > ; i.e., Ik, is a k × matrix with its ﬁrst k columns determining an identity matrix and the remaining − k columns being equal to zero. Thus, B is deﬁned as the ﬁrst m columns of U , and C is deﬁned as the ﬁrst p rows of V . Note that A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . Lemma 8.29. The representation (8.75) is a minimal realization of H(s). Proof. It can be shown that CAi−1 B = Hi , i = 1, 2, . . . . Thus, {A, B, C, D} is a realization. We note that V and U are the observability and controllability matrices, respectively, and that both are of full rank n. Therefore, the realization is minimal. Furthermore, we notice that V T V = U U T = Σ. Realizations of this type are called internally balanced realizations. The term internally balanced emphasizes the fact that realizations of this type are “as much controllable as they are observable,” since their controllability and observability Gramians are equal and diagonal. Using such representations, it is possible to construct reasonable reduced-order models of systems by deleting that part of the state space that is “least controllable” and therefore “least observable” in accordance with some criterion. In fact, the realization procedure described can be used to obtain a reduced-order model for a given system. Speciﬁcally, if the system is to be approximated by a qdimensional model with q < n, then the reduced-order model can be obtained from (8.76) T = Kq diag[λ1 , . . . , λq ]Lq , where Kq denotes the ﬁrst q columns of K in (8.72) and Lq denotes the ﬁrst q rows of L.

8.5 Polynomial Matrix Realizations

343

8.5 Polynomial Matrix Realizations It is rather straightforward to derive a realization of H in PMD form [see Section 7.5]. In fact, realizations in right (left) Polynomial Matrix Fractional Description (PMFD) form were derived as a step toward determining a statespace realization in controller (observer) form (see Subsection 8.4.2). However, these realizations, of the form {DR , Im , NR } and {DL , NL , Ip }, are typically not of minimal order; i.e., they are not controllable and observable. This implies that the controllable realization {DR , Im , NR }, for example, is not observable; i.e., DR , NR are not right coprime. Similarly, the observable realization {DL , NL , Ip } is not controllable; i.e., DL , NL are not left coprime. To obtain a minimal realization, a greatest common right divisor (gcrd) must be extracted from DR , NR , and similarly, a gcld must be extracted from DL , NL . This leads to the following realization algorithm, which results in a minimal realization {D, Im , N } of H. A minimal realization of the form {D, N, Ip } is obtained in an analogous (dual) manner. Consider H(s) = [nij (s)/dij (s)], i = 1, . . . , p, j = 1, . . . , m, and let lj (s) be the (monic) least common denominator of all entries in the jth column of H(s). Note that lj (s) is the (monic) least degree polynomial divisible by all dij (s), i = 1, . . . , p. Then H(s) can be written as −1 H(s) = NR (s)DR (s),

(8.77)

where NR (s) =[¯ nij (s)] and DR (s) = diag(l1 (s), . . . , lm (s)). Note that n ¯ ij /lj (s) = nij (s)/dij (s) for i = 1, . . . , p and all j = 1, . . . , m. Now DR (q)zR (t) = u(t),

y(t) = NR (q)zR (t)

(8.78)

is a controllable realization of H(s). If DR , NR are right coprime, it is observable as well and therefore minimal. If DR and NR are not right coprime, let GR be a greatest common right divisor (gcrd) and let D = DR G−1 R and . Then N = NR G−1 R D(q)z(t) = u(t),

y(t) = N (q)z(t)

(8.79)

is a controllable and observable, and therefore, minimal realization of H(s) since D, I and D, N are left and right coprime polynomial matrix pairs, re−1 −1 −1 spectively. Note that N D−1 = (NR G−1 = (NR G−1 R )(DR GR ) R )(GR DR ) = −1 NR DR = H. There is a dual algorithm that extracts a left PMFD resulting in −1 H(s) = DL (s)NL (s),

(8.80)

which corresponds to an observable realization of H(s), given by DL (q)zL (t) = NL (q)u(t), y(t) = zL (t).

(8.81)

344

8 Realization Theory and Algorithms

The details of this procedure are completely analogous to the above procedure that led to (8.77). If DL , NL are not left coprime, let GL be a greatest common ( = G−1 NL . Then a controllable and ( = G−1 DL and N left divisor and let D L L observable and, therefore, minimal realization of H(s) is given by ( z (t) = N ( (q)u(t), D(q)˜

y(t) = z˜(t).

(8.82)

The following example illustrates the above realization algorithms. Example 8.30. Let us derive a minimal realization for H(s) =

s2 +1 s+1 s2 , s3

.

Note that this is the same H(s) as in Example 8.25 of Section 8.4.2, where minimal state-space realizations were derived. The reader is encouraged to compare those results with the realizations derived below. We shall begin with a controllable realization. In view of (8.77) l1 = s2 , l2 = s3 , and H = 2 −1 s 0 −1 = [s2 + 1, s + 1] . Therefore, DR zR = u and y = NR zR NR DR 0 s3 constitute a controllable realization. This realization is not observable since ⎡ ⎤ 00 DR (s) = rank ⎣ 0 0 ⎦ = 1 < m = 2; i.e., DR and NR are not right rank NR (s) s=0 11 coprime. Another way of determining that DR and NR are not right coprime would have been to observe that deg det D(s) = 5 = order of the realization {DR , I, NR }. Now the McMillan degree of H, which is easily derived in the present case, is three. Therefore, the order of any minimal realization for this example is three. Since {DR , I, NR } is of order ﬁve and is controllable, it cannot be observable; i.e., DR and NR cannot be right coprime. We shall now extract a gcrd from DR and NR (using the procedure described in [1, Section 7.2D]). We have ⎤ ⎡ 2 ⎤ ⎡ ⎤ ⎡ 2 s 1 s+1 0 0 s DR s3 ⎦ −→ ⎣ 0 s3 ⎦ −→ ⎣ s2 0 ⎦ −→ =⎣ 0 NR 2 0 s3 s +1 s+1 1 s+1 ⎡ ⎤ ⎤ ⎤ ⎡ ⎡ 1 s+1 1 s+1 1 s+1 ⎣ 0 −s3 − s2 ⎦ −→ ⎣ 0 s2 ⎦ −→ ⎣ 0 s2 ⎦ . 0 s3 0 s3 0 0

1 s+1 is a gcrd. We now determine D = DR G−1 R and 0 s2 s2 0 s2 −(s + 1) 1 s+1 N = NR G−1 = DGR and 3 = R , using DR = 0 s 0 s 0 s2 1 s+1 = N GR , and we verify that NR = [s2 + 1, s + 1] = [s2 + 1, −(s + 1)] 0 s2 they are right coprime. Then

Therefore, GR =

8.6 Summary and Highlights

{DR , I, NR } =

345

q 2 −(q + 1) 10 , , [q 2 + 1, −(q + 1)] 0 q 01

is a minimal realization of H(s). Alternatively, given H, we shall ﬁrst derive an observable realization. In view of (8.80), −1 NL = (s3 )−1 [s(s2 + 1), s + 1]. H = DL ( z (t) = N ( (q)u(t) Here DL (q) and NL (q) are left coprime, and therefore, D(q)˜ ( (q) = NL (q) is controllable and ( and y(t) = z˜(t) with D(q) = DL (q) and N observable and is a minimal realization. Note that the order of this realization is deg det DL (s) = 3, which equals the McMillan degree of H(s).

8.6 Summary and Highlights Realizations • • •

x˙ = Ax + Bu, y = Cx + Du is a realization of H(s) (ˆ y = H(s)ˆ u) if yˆ = [C(sI − As−1 B + D]ˆ u. Realizations of H(s) exist if and only if H(s) is a proper rational matrix. lims→∞ H(s) = D < ∞. (See Theorem 8.5.) The Markov parameters Hi of the system in H(s) = H0 + H1 s−1 + H2 s−2 + . . . satisfy H0 = D and Hi = CAi−1 B,

• • •

• •

i = 1, 2, . . . .

(See Theorem 8.3.) A realization {A, B, C, D} of H(s) is minimal if and only if it is both controllable and observable. (See Theorem 8.9.) Two realizations of H(s) that are minimal must be equivalent representations. (See Theorem 8.10.) The order of a minimal realization of H(s) equals its McMillan degree, the order of its characteritic or pole polynomial pH (s). (See Theorem 8.12.) The order of a minimal realization of H(s) is also given by the rank of the Hankel matrix MH (r, r). (See Theorem 8.16.) Duality can be very useful in obtaining realizations. (See Subsection 8.4.1.) Realization algorithms are presented to obtain realizations in controller/ observer form [Subsection 8.4.2], realizations with A diagonal [Subsection 8.4.3], and balanced realizations via singular-value decomposition [Subsection 8.4.4].

346

8 Realization Theory and Algorithms

8.7 Notes A clear understanding of the relationship between external and internal descriptions of systems is one of the principal contributions of systems theory. This topic was developed in the early sixties with original contributions by Gilbert [3] and Kalman [5]. The role of controllability and observability in minimal realizations is due to Kalman [5]. See also Kalman, Falb, and Arbib [6]. The ﬁrst realization method for MIMO systems is attributed to Gilbert [3]. It was developed for systems where the matrix A can be taken to be diagonal. This method is presented in this chapter. For extensive historical comments concerning this topic, see Kailath [4]. Additional information concerning realizations for the time-varying case can be found, for example, in Brockett [2], Silverman [10], Kamen [7], Rugh [9], and the literature cited in these references. Balanced realizations were introduced in Moore [8].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. R.W. Brockett, Finite Dimensional Linear Systems, Wiley, New York, NY, 1970. 3. E. Gilbert, “Controllability and observability in multivariable control systems,” SIAM J. Control, Vol. 1, pp. 128–151, 1963. 4. T. Kailath, Linear Systems, Prentice Hall, Englewood Cliﬀs, NJ, 1980. 5. R.E. Kalman, “Mathematical description of linear systems,” SIAM J. Control, Vol. 1, pp. 152–192, 1963. 6. R.E. Kalman, P.L. Falb, and M.A. Arbib, Topics in Mathematical System Theory, McGraw-Hill, New York, NY, 1969. 7. E.W. Kamen, “New results in realization theory for linear time-varying analytic systems,” IEEE Trans. Auto. Control, Vol. AC-24, pp. 866–877, 1979. 8. B.C. Moore, “Principal component analysis in linear systems: controllability, observability and model reduction,” IEEE Trans. Auto. Control, Vol. AC-26, pp. 17–32, 1981. 9. W.J. Rugh, Linear System Theory, Second Edition, Prentice-Hall, Englewood Cliﬀs, NJ, 1996. 10. L.M. Silverman, “Realization of linear dynamical systems,” IEEE Trans. Auto. Control, Vol. AC-16, pp. 554–567, 1971.

Exercises 8.1. Consider a scalar proper rational transfer function H(s) = n(s)/d(s), and let x˙ = Ac xc + Bc u, y = Cc xc + Dc u be a realization of H(s) in controller form. (a) Show that the realization {Ac , Bc , Cc , Dc } is always controllable.

Exercises

347

(b) Show that {Ac , Bc , Cc , Dc } is observable if and only if n(s) and d(s) do not have any factors in common; i.e., they are prime polynomials. (c) State the dual results to (a) and (b) involving a realization in observer form. 2

s −s+1 8.2. Let H(s) = n(s) d(s) = s5 −s4 +s3 −s2 +s−1 . Determine a realization in controller form. Is your realization minimal? Explain your answer. Hint : Use the results of Exercise 8.1.

8.3. For the transfer function H(s) =

s+1 s2 +2 ,

ﬁnd

(a) an uncontrollable realization, (b) an unobservable realization, (c) an uncontrollable and unobservable realization, (d) a minimal realization. s−1 8.4. Consider the transfer function matrix H(s) =

1 s+1 s2 −1

1

0

.

(a) Determine the pole polynomial and the McMillan degree of H(s), using both the Smith–McMillan form and the Hankel matrix. (b) Determine an observable realization of H(s). (c) Determine a minimal realization of H(s). Hint : Obtain realizations for s−1 1 s+1 , s2 −1

.

T s 8.5. Consider the transfer function matrix H(s) = (s+1)(−s+5) , and (s−1)(s2 −9) , s−1 determine for H(s) a minimal realization in controller form. 1 s+3 s s+1 . 8.6. Consider the transfer function H(s) = 1 s s+3 s+1

(a) Determine the pole polynomial of H(s) and the McMillan degree of H(s). (b) Determine a minimal realization {A, B, C, D} of H(s), where A is a diagonal matrix. 8.7. Given is the system depicted in the block diagram of Figure 8.4, where s2 +1 . Determine a minimal state-space representation for H(s) = (s+1)(s+2)(s+3) the closed-loop system, using two approaches. In particular: (a) First, determine a state-space realization for H(s), and then, determine a minimal state-space representation for the closed-loop system; (b) ﬁrst, ﬁnd the closed-loop transfer function, and then, determine a minimal state-space representation for the closed-loop system. Compare the two approaches.

348

8 Realization Theory and Algorithms r

+

u

Σ

H(s)

y

–

Figure 8.4. Block diagram of the system in Exercise 8.7

8.8. Consider the system depicted in the block diagram of Figure 8.5, where s+1 k and G(s) = s+a with k, a ∈ R. Presently, H(s) could be viewed H(s) = s(s+3) as the system to be controlled and G(s) could be regarded as a feedback controller. (a) Obtain a state-space representation of the closed-loop system by (i) ﬁrst, determining realizations for H(s) and G(s) and then combining them; (ii) ﬁrst, determining Hc (s), the closed-loop transfer function. (b) Are there any choices for the parameters k and a for which your closedloop state-space representation is uncontrollable and unobservable? If your answer is aﬃrmative, state why.

r

+

u

H(s)

y

– G(s)

Figure 8.5. Block diagram of the system in Exercise 8.8

8.9. Consider the controllable and observable system given by x˙ = Ax + Bu, %x + Bu, % y=C %x % y = Cx + Du, and its equivalent representation x ˆ˙ = Aˆ ˆ + Du, −1 % −1 % % % where A = P AP , B = P B, C = CP , and D = D. Let Wr and Wo denote the reachability and observability Gramians, respectively. 2o = (P −1 )∗ Wo P −1 , where P ∗ denotes the 2r = P Wr P ∗ and W (a) Show that W complex conjugate transpose of P . Note that P ∗ = P T when only real coeﬃcients in the system equations are involved. Using singular-value decomposition (refer to Section A.9), write Wr = Ur Σr Vr∗

and Wo = Uo Σo Vo∗ ,

where U ∗ U = I, V V ∗ = I, and Σ = diag(σ1 , σ2 , . . . , σn ) with σi the singular values of W . Deﬁne H = (Σo1/2 )∗ Uo∗ Ur (Σr1/2 ), and using singular-value decomposition, write H = UH ΣH VH , ∗ UH = I, VH VH∗ = I. Prove the following: where UH

Exercises

349

−1 ∗ 2r = I, W 2o = Σ 2 . (b) If P = Pin VH ( 1/2 Vr , then W H r ) 1/2 ∗ 2r = Σ 2 , W 2o = I. ( o )∗ Vo∗ , then W (c) If P = Pout UH H 1/2 1/2 2r = W 2o = ΣH . Note that (d) If P = Pib = Pin H = H Pout , then W % % % % the equivalent representations {A, B, C, D} in (b), (c), and (d) are called, respectively, input-normal, output-normal, and internally balanced representations. 8.10. Consider a system described by 1 yˆ1 (s) 2 = (s+1) yˆ2 (s) 0

2 s2 s+1 s

u ˆ1 (s) . u ˆ2 (s)

(a) What is the order of a controllable and observable realization of this system? (b) If we consider such a realization, is the resulting system controllable from the input u2 ? Is it observable from the output y1 ? Explain your answers. 1 (ˆ y (s) = H(s)ˆ u(s)) 8.11. Consider the system described by H(s) = s−(1+ ) s−1 and C(s) = s+2 (ˆ u(s) = C(s)ˆ r (s)) connected in series ( ∈ R).

(a) Derive minimal state-space realizations for H(s) and C(s), and determine a (second order) state-space description for the system yˆ(s) = H(s)C(s)ˆ r (s). (b) Let = 0, and discuss the implications regarding the overall transfer function and your state-space representations in (a). Is the overall system now controllable, observable, asymptotically stable? Are the poles of the overall transfer function stable? [That is, is the overall system BIBO stable? (See Chapter 4.)] Plot the states and the output for some nonzero initial condition and a unit step input, and comment on your results. (c) In practice, if H(s) is a given system to be controlled and C(s) is a controller, it is unlikely that will be exactly equal to zero and therefore the situation in (a), rather than (b), will arise. In view of this, comment on whether open-loop stabilization can be used in practice. Carefully explain your reasoning. 1 1s s−1 s . Determine a min8.12. Consider the transfer function H(s) = 0 s+1 0 s2 imal realization in (a) Polynomial Matrix Fractional Description (PMFD) form, (b) State-Space Description (SSD) form.

9 State Feedback and State Observers

9.1 Introduction Feedback is a fundamental mechanism arising in nature and is present in many natural processes. Feedback is also common in manufactured systems and is essential in automatic control of dynamic processes with uncertainties in their model descriptions and their interactions with the environment. When feedback is used, the actual values of system variables are sensed, fed back, and used to control the system. Hence, a control law decision process is based not only on predictions about the system behavior derived from a process model, but also on information about the actual behavior. A common example of an automatic feedback control system is the cruise control system in an automobile, which maintains the speed of the automobile at a certain desired value within acceptable tolerances. In this chapter, feedback is introduced and the problem of pole or eigenvalue assignment by means of state feedback is discussed at length in Section 9.2. It is possible to arbitrarily assign all closedloop eigenvalues by linear static state feedback if and only if the system is completely controllable. In the study of state feedback, it is assumed that it is possible to measure the values of the states using appropriate sensors. Frequently, however, it may be either impossible or impractical to obtain measurements for all states. It is therefore desirable to be able to estimate the states from measurements of input and output variables that are typically available. In addition to feedback control problems, there are many other problems where knowledge of the state vector is desirable, since such knowledge contains useful information about the system. This is the case, for example, in navigation systems. State estimation is related to observability in an analogous way that state feedback control is related to controllability. The duality between controllability and observability makes it possible to easily solve the estimation problem once the control problem has been solved, and vice versa. In this chapter, asymptotic state estimators, also called state observers, are discussed at length in Section 9.3.

352

9 State Feedback and State Observers

Finally, state feedback static controllers and state dynamic observers are combined to form dynamic output feedback controllers. Such controllers are studied in Section 9.4, using both state-space and transfer function matrix descriptions. In the following discussion, state feedback and state estimation are introduced for continuous- and discrete-time time-invariant systems.

9.2 Linear State Feedback 9.2.1 Continuous-Time Systems We consider linear, time-invariant, continuous-time systems described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(9.1)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . Deﬁnition 9.1. The linear, time-invariant, state feedback control law is deﬁned by u = F x + r, (9.2) where F ∈ Rm×n is a gain matrix and r(t) ∈ Rm is an external input vector.

r

+ S +

u

System

y

x F

Figure 9.1. Linear state feedback conﬁguration

Note that r(t) is an external input , also called a command or reference input (see Figure 9.1). It is used to provide an input to the compensated closed-loop system and is omitted when such input is not necessary in a given discussion [r(t) = 0]. This is the case, e.g., when the Lyapunov stability of a system is studied. Note that the vector r(t) in (9.2) has the same dimension as u(t). If a diﬀerent number of inputs is desired, then an input transformation map may be used to accomplish this. The compensated closed-loop system of Figure 9.1 is described by the equations x˙ = (A + BF )x + Br, y = (C + DF )x + Dr,

(9.3)

9.2 Linear State Feedback

353

which were determined by substituting u = F x + r into the description of the uncompensated open-loop system (9.1). The state feedback gain matrix F aﬀects the closed-loop system behavior. This is accomplished by altering the matrices A and C of (9.1). In fact, the main inﬂuence of F is exercised through the matrix A, resulting in the matrix A + BF of the closed-loop system. The matrix F aﬀects the eigenvalues of A + BF and, therefore, the modes of the closed-loop system. The eﬀects of F can also be thought of as restricting the choices for u (= F x for r = 0) so that for apppropriate F , certain properties, such as asymptotic Lyapunov stability, of the equilibrium x = 0 are obtained. Open- Versus Closed-Loop Control The linear state feedback control law (9.2) can be expressed in terms of the initial state x(0) = x0 . In particular, working with Laplace transforms, we ˆ] + rˆ, in view of sˆ x − x0 = obtain u ˆ = Fx ˆ + rˆ = F [(sI − A)−1 x0 + (sI − A)−1 B u Aˆ x + Bu ˆ, derived from x˙ = Ax + Bu. Collecting terms, we have [I − F (sI − u = F (sI − A)−1 x0 + rˆ. This yields A)−1 B]ˆ u ˆ = F [sI − (A + BF )]−1 x0 + [I − F (sI − A)−1 B]−1 rˆ,

(9.4)

where the matrix identities [I − F (sI − A)−1 B]−1 F (sI − A)−1 ≡ F (sI − A)−1 [I − BF (sI − A)−1 ]−1 ≡ F [sI − (A + BF )]−1 have been used. Expression (9.4) is an open-loop (feedforward) control law, expressed in the Laplace transform domain. It is phrased in terms of the initial conditions x(0) = x0 , and if it is applied to the open-loop system (9.1), it generates exactly the same control action u(t) for t ≥ 0 as the state feedback u = F x+ r in (9.2). It can readily be veriﬁed that the descriptions of the compensated system are exactly the same when either control expressions, (9.2) or (9.4), are used. In practice, however, these two control laws hardly behave the same, as explained in the following. First, notice that in the open-loop scheme (9.4), the initial conditions x0 are assumed to be known exactly. It is also assumed that the plant parameters in A and B are known exactly. If there are uncertainties in the data, this control law may fail miserably, even when the diﬀerences are small, since it is based on incorrect information without any way of knowing that these data are not valid. In contrast to the above, the feedback law (9.2) does not require knowledge of x0 . Moreover, it receives feedback information from x(t) and adjusts u(t) to reﬂect the current system parameters, and consequently, it is more robust to parameter variations. Of course the feedback control law (9.2) will also fail when the parameter variations are too large. In fact, the area of robust control relates feedback control law designs to bounds on the uncertainties (due to possible changes) and aims to derive the best design possible under the circumstances. The point we wish to emphasize here is that although open- and closedloop control laws may appear to produce identical eﬀects, typically they do

354

9 State Feedback and State Observers

not, the reason being that the mathematical system models used are not suﬃciently accurate, by necessity or design. Feedback control and closed-loop control are preferred to accommodate ever-present modeling uncertainties in the plant and the environment. At this point, a few observations are in order. First, we note that feeding back the state in synthesizing a control law is a very powerful mechanism, since the state contains all the information about the history of a system that is needed to uniquely determine the future system behavior, given the input. We observe that the state feedback control law considered presently is linear, resulting in a closed-loop system that is also linear. Nonlinear state feedback control laws are of course also possible. Notice that when a time-invariant system is considered, the state feedback is typically static, unless there is no choice (as in certain optimal control problems), resulting in a closed-loop system that is also time-invariant. These comments justify to a certain extent the choice of linear, time-invariant, state feedback control to compensate linear time-invariant systems. The problem of stabilizing a system by using state feedback is considered next. Stabilization The problem we wish to consider now is to determine a state feedback control law (9.2) having the property that the resulting compensated closed-loop system has an equilibrium x = 0 that is asymptotically stable (in the sense of Lyapunov) when r = 0. (For a discussion of asymptotic stability, refer to Subsection 3.3.3 and to Chapter 4.) In particular, we wish to determine a matrix F ∈ Rm×n so that the system x˙ = (A + BF )x,

(9.5)

where A ∈ Rn×n and B ∈ Rn×m has equilibrium x = 0 that is asymptotically stable. Note that (9.5) was obtained from (9.3) by letting r = 0. One method of deriving such stabilizing F is by formulating the problem as an optimal control problem, e.g., as the Linear Quadratic Regulator (LQR) problem. This is discussed at the end of this section. Alternatively, in view of Subsection 3.3.3, the equilibrium x = 0 of (9.5) is asymptotically stable if and only if the eigenvalues λi of A + BF satisfy Reλi < 0, i = 1, · · · , n. Therefore, the stabilization problem for the timeinvariant case reduces to the problem of selecting F in such a manner that the eigenvalues of A + BF are shifted into desired locations. This will be studied in the following subsection. Note that stabilization is only one of the control objectives, although a most important one, that can be achieved by shifting eigenvalues. Control system design via eigenvalue (pole) assignment is a topic that is addressed in detail in a number of control books.

9.2 Linear State Feedback

355

9.2.2 Eigenvalue Assignment Consider again the closed-loop system x˙ = (A + BF )x given in (9.5). We shall show that if (A, B) is fully controllable (-from-the-origin, or reachable), all eigenvalues of A + BF can be arbitrarily assigned by appropriately selecting F . In other words, “the eigenvalues of the original system can arbitrarily be changed in this case.” This last statement, commonly used in the literature, is rather confusing: The eigenvalues of a given system x˙ = Ax + Bu are not physically changed by the use of feedback. They are the same as they used to be before the introduction of feedback. Instead, the feedback law u = F x + r, r = 0, generates an input u(t) that, when fed back to the system, makes it behave as if the eigenvalues of the system were at diﬀerent locations [i.e., the input u(t) makes it behave as a diﬀerent system, the behavior of which is, we hope, more desirable than the behavior of the original system]. Theorem 9.2. Given A ∈ Rn×n and B ∈ Rn×m , there exists F ∈ Rm×n such that the n eigenvalues of A+ BF can be assigned to arbitrary, real, or complex conjugate locations if and only if (A, B) is controllable (-from-the-origin, or reachable). Proof. (Necessity): Suppose that the eigenvalues of A+BF have been arbitrarily assigned, and assume that (A, B) in (9.1) is not fully controllable. We shall show that this leads to a contradiction. Since (A, B) is not fully controllable, in view of the results in Section 6.2, there exists a similarity transformation that will separate the controllable part from the uncontrollable part in (9.5). In particular, there exists a nonsingular matrix Q such that A1 A12 B1 [F1 , F2 ] + Q−1 (A + BF )Q = Q−1 AQ + (Q−1 B)(F Q) = 0 A2 0 A1 + B1 F1 A12 + B1 F2 = , (9.6) 0 A2 where [F1 , F2 ] F Q and (A1 , B1 ) is controllable. The eigenvalues of A + BF are the same as the eigenvalues of Q−1 (A+ BF )Q, which implies that A+ BF has certain ﬁxed eigenvalues, the eigenvalues of A2 , that cannot be shifted via F . These are the uncontrollable eigenvalues of the system. Therefore, the eigenvalues of A + BF have not been arbitrarily assigned, which is a contradiction. Thus, (A, B) is fully controllable. (Suﬃciency): Let (A, B) be fully controllable. Then by using any of the eigenvalue assignment algorithms presented later in this section, all the eigenvalues of A + BF can be arbitrarily assigned. Lemma 9.3. The uncontrollable eigenvalues of (A, B) cannot be shifted via state feedback. Proof. See the necessity part of the proof of Theorem 9.2. Note that the uncontrollable eigenvalues are the eigenvalues of A2 .

356

9 State Feedback and State Observers

0 −2 Example 9.4. Consider the uncontrollable pair (A, B), where A = , 1 −3 1 B= . This pair can be transformed to a standard form for uncontrollable 1 −2 1 ˆ = 1 , from which it can easily be systems, namely, Aˆ = , B 0 −1 0 seen that −1 is the uncontrollable eigenvalue, whereas −2 is the controllable eigenvalue. s − f1 , 2 − f2 Now if F = [f1 , f2 ], then det(sI −(A+BF )) = det = −1 − f1 s + 3 − f2 s2 + s(−f1 − f2 + 3) + (−f1 − f2 + 2) = (s + 1)(s + (−f1 − f2 + 2)). Clearly, the uncontrollable eigenvalue −1 cannot be shifted via state feedback. The controllable eigenvalue −2 can be shifted arbitrarily to (f1 + f2 − 2) by F = [f1 , f2 ]. It is now quite clear that a given system (9.1) can be made asymptotically stable via the state feedback control law (9.2) only when all the uncontrollable eigenvalues of (A, B) are already in the open left part of the s-plane. This is so because state feedback can alter only the controllable eigenvalues. Deﬁnition 9.5. The pair (A, B) is called stabilizable if all its uncontrollable eigenvalues are stable. Before presenting methods to select F for eigenvalue assignment, it is of interest to examine how the linear feedback control law u = F x + r given in (9.2) aﬀects controllability and observability. We write sI − (A + BF ) B sI − A B I0 = (9.7) −(C + DF ) D −C D −F I and note that rank[λI − (A + BF ), B] = rank[λI − A, B] for all complex λ. Thus, if (A, B) is controllable, then so is (A + BF, B) for any F . Furthermore, notice that in view of CF = [B, (A + BF )B, (A + BF )2 B, . . . , (A + BF )n−1 B] ⎡ ⎤ I F B F (A + BF )B · ⎢0 I FB ·⎥ ⎢ ⎥ ⎢ I ·⎥ = [B, AB, A2 B, . . . , An−1 B] ⎢ ⎥, ⎢ .. ⎥ ⎣ . ⎦ I

(9.8)

9.2 Linear State Feedback

357

R(CF ) = R([B, AB, . . . , An−1 B]) = R (C). This shows that F does not alter the controllability subspace of the system. This in turn proves the following lemma. Lemma 9.6. The controllability subspaces of x˙ = Ax + Bu and x˙ = (A + BF )x + Br are the same for any F . Although the controllabiliity of the system is not altered by linear state feedback u = F x + r, this is not true for the observability property. Note that the observability of the closed-loop system (9.3) depends on the matrices (A + BF ) and (C + DF ), and it is possible to select F to make certain eigenvalues unobservable from the output. In fact this mechanism is quite common and is used in several control design methods. It is also possible to make observable certain eigenvalues of the open-loop system that were unobservable. Several methods are now presented to select F to arbitrarily assign the closed-loop eigenvalues. Methods for Eigenvalue Assignment by State Feedback In view of Theorem 9.2, the eigenvalue assignment problem can now be stated as follows. Given a controllable pair (A, B), determine F to assign the n eigenvalues of A + BF to arbitrary real and/or complex conjugate locations. This problem is also known as the pole assignment problem, where by the term “pole” is meant a “pole of the system” (or an eigenvalue of the “A” matrix). This is to be distinguished from the “poles of the transfer function.” Note that all matrices A, B, and F are real, so the coeﬃcients of the polynomial det[sI − (A + BF )] are also real. This imposes the restriction that the complex roots of this polynomial must appear in conjugate pairs. Also, note that if (A, B) is not fully controllable, then (9.6) can be used together with the methods described a little later, to assign all the controllable eigenvalues; the uncontrollable ones will remain ﬁxed. It is assumed in the following discussion that B has full column rank; i.e., rank B = m.

(9.9)

This means that the system x˙ = Ax + Bu has m independent inputs. If rank B = r < m, this would imply that one could achieve the same result by manipulating only r inputs (instead of m > r). To assign eigenvalues in this case, one can proceed by writing F −1 (9.10) A + BF = A + (BM )(M F ) = A + [B1 , 0] 1 = A + B1 F1 , F2 where M is chosen so that BM = [B1 , 0] with B1 ∈ Rn×r and rank B1 = r. Then F1 ∈ Rr×n can be determined to assign the eigenvalues of A + B1 F1 ,

358

9 State Feedback and State Observers

using any one of the methods presented next. Note that (A, B) is controllable implies that (A, B1 ) is controllable. The state feedback matrix F is given in this case by F1 F =M , (9.11) F2 where F2 ∈ R(m−r)×n is arbitrary. 1. Direct Method Let F = [fij ], i = 1, . . . , m, j = 1, . . . , n, and express the coeﬃcients of the characteristic polynomial of A + BF in terms of fij ; i.e., det(sI − (A + BF )) = sn + gn−1 (fij )sn−1 + · · · + g0 (fij ). Now if the roots of the polynomial αd (s) = sn + dn−1 sn−1 + · · · + d1 s + d0 are the n desired eigenvalues, then the fij , i = 1, . . . , m, j = 1, . . . , n, must be determined so that gk (fij ) = dk ,

k = 0, 1, . . . , n − 1.

(9.12)

In general, (9.12) constitutes a nonlinear system of algebraic equations; however, it is linear in the single-input case, m = 1. The main diﬃculty in this method is not so much in deriving a numerical solution for the nonlinear system of equation, but in carrying out the symbolic manipulations needed to determine the coeﬃcients gk in terms of the fij in (9.12). This diﬃculty usually restricts this method to the simplest cases, with n = 2 or 3 and m = 1 or 2 being typical.

1/2 1 1 ,B = , we have det(sI −A) = s(s−5/2), 1 2 1 and therefore, the eigenvalues of A are 0 and 5/2. We wish to determine F so that the eigenvalues of A + BF are at −1 ± j. −1 − [ 11 ] [f1 , f2 ] = If F = [f1 , f2 ], then det(sI−(A+BF )) = det s−1/2 −1 s−2 s − 1/2 − f1 , −1 − f2 det = s2 + s(− 25 − f1 − f2 ) + f1 − 12 f2 . The desired −1 − f1 , s − 2 − f2 eigenvalues are the roots of the polynomial

Example 9.7. For A =

αd (s) = (s − (−1 + j))(s − (−1 − j)) = s2 + 2s + 2. Equating coeﬃcients, one obtains − 52 − f1 − f2 = 2, f1 − 12 f2 = 2, a linear system of equations. Note that it is linear because m = 1. In general one must solve a set of nonlinear algebraic equations. We have F = [f1 , f2 ] = [−1/6, −13/3] as the appropriate state feedback matrix.

9.2 Linear State Feedback

359

2. The Use of Controller Forms Given that the pair (A, B) is controllable, there exists an equivalence transformation matrix P so that the pair (Ac = P AP −1 , Bc = P B) is in controller form (see Section 6.4). The matrices A + BF and P (A + BF )P −1 = P AP −1 + P BF P −1 = Ac + Bc Fc have the same eigenvalues, and the problem is to determine Fc so that Ac + Bc Fc has desired eigenvalues. This problem is easier to solve than the original one because of the special structures of Ac and Bc . Once Fc has been determined, then the original feedback matrix F is given by (9.13) F = Fc P. We shall now assume that (A, B) has already been reduced to (Ac , Bc ) and describe methods of deriving Fc for eigenvalue assignment. Single-Input Case (m = 1). We let Fc = [f0 , . . . , fn−1 ].

(9.14)

In view of Section 6.4, since Ac , Bc are in controller form, we have AcF Ac + Bc Fc ⎤ ⎡ ⎤ ⎡ 0 0 1 ... 0 ⎥ ⎢ .. ⎥ ⎢ .. .. .. ⎥ ⎢.⎥ ⎢ . . =⎢ . ⎥ + ⎢ ⎥ [f0 , . . . , fn−1 ] ⎣ 0 0 ... 1 ⎦ ⎣0⎦ 1 −α0 −α1 · · · −αn−1 ⎡ ⎤ 0 1 ··· 0 ⎢ ⎥ .. .. .. .. ⎢ ⎥ . . . . =⎢ ⎥, ⎣ ⎦ 0 0 ··· 1 −(α0 − f0 ) −(α1 − f1 ) · · · −(αn−1 − fn−1 )

(9.15)

where αi , i = 0, . . . , n − 1, are the coeﬃcients of the characteristic polynomial of Ac ; i.e., det(sI − Ac ) = sn + αn−1 sn−1 + · · · + α1 s + α0 .

(9.16)

Notice that AcF is also in companion form, and its characteristic polynomial can be written directly as det(sI − AcF ) = sn + (αn−1 − fn−1 )sn−1 + · · · + (α0 − f0 ).

(9.17)

If the desired eigenvalues are the roots of the polynomial αd (s) = sn + dn−1 sn−1 + · · · + d0 ,

(9.18)

then by equating coeﬃcients, fi , i = 0, 1, . . . , n − 1, must satisfy the relations di = αi − fi , i = 0, 1, . . . , n − 1, from which we obtain

360

9 State Feedback and State Observers

fi = αi − di ,

i = 0, . . . , n − 1.

(9.19)

Alternatively, note that there exists a matrix Ad in companion form, the characteristic polynomial of which is (9.18). An alternative way of deriving (9.19) is then to set AcF = Ac + Bc Fc = Ad , from which we obtain −1 Fc = Bm [Adm − Am ],

(9.20)

where Bm = 1, Adm = [−d0 , . . . , −dn−1 ] and Am = [−α0 , . . . , −αn−1 ]. Therefore, Bm , Adm , and Am are the nth rows of Bc , Ad , and Ac , respectively (see Section 6.4). Relationship (9.20), which is an alternative formula to (9.19), has the advantage that it is in a form that can be generalized to the multi-input case studied below.

1/2 1 1 Example 9.8. Consider the matrices A = ,B = of Example 9.7. 1 2 1 Determine F so that the eigenvalues of A + BF are −1 ± j, i.e., so that they are the roots of the polynomial αd (s) = s2 + 2s + 2. To reduce (A, B) into the controller form, let 2 1 3/2 3 −3/2 C = [B, AB] = and C −1 = , 1 3 3 −1 1 q 1 −2 2 [see (6.38) in Section 6.4]. Then P −1 = from which P = = 3 1 2 qA −1 1 and 1/2 1 0 1 0 Ac = P AP −1 = , Bc = . 0 5/2 1 0 1 and Adm = [−2, −2] Thus, Am = [0, 5/2] and Bm = 1. Now Ad = −2 −2 since the characteristic polynomial of Ad is s2 + 2s + 2 = αd (s). Applying (9.20), we obtain that −1 Fc = Bm [Adm − Am ] = [−2, −9/2] −2/3 2/3 and F = Fc P = [−2, −9/2] = [−1/6, −13/3] assigns the eigen1/3 2/3 values of the closed-loop system at −1 ± j. This is the same result as the one obtained by the direct method given in Example 9.7. If αd (s) = s2 + d1 s + d0 , −1 then Adm = [−d0 , −d1 ], Fc = Bm [Adm − Am ] = [−d0 , −d1 − 5/2], and

1 5 [2d0 − d1 − , −2d0 − 2d1 − 5]. 3 2 In general the larger the diﬀerence between the coeﬃcients of αd (s) and α(s), (Adm −Am ), the larger the gains in F . This is as expected, since larger changes require in general larger control action. F = Fc P =

9.2 Linear State Feedback

361

Note that (9.20) can also be derived using (6.55) of Section 6.4. To see this, write ¯c Am ) + (B ¯c Bm )Fc = A¯c + B ¯c (Am + Bm Fc ). AcF = Ac + Bc Fc = (A¯c + B ¯c Adm and requiring AcF = Ad implies Selecting Ad = A¯c + B ¯c [Am + Bm Fc ] = B ¯c Adm , B from which Am + Bm Fc = Adm , which in turn implies (9.20). After Fc has been found, to determine F so that A + BF has desired eigenvalues, one should use F = Fc P given in (9.13). Note that P , which reduces (A, B) to the controller form, has a speciﬁc form in this (m = 1) case [see (6.38) of Section 6.4]. Combining these results, it is possible to derive a formula for the eigenvalue assigning F in terms of the original pair (A, B) and the coeﬃcients of the desired polynomial αd (s). In particular, the 1 × n matrix F that assigns the n eigenvalues of A + BF at the roots of αd (s) is unique and is given by (9.21) F = −eTn C −1 αd (A), where en = [0, . . . , 0, 1]T ∈ Rn and C = [B, AB, . . . , An−1 B] is the controllability matrix. Relation (9.21) is known as Ackermann’s formula; for details, see [1, p. 334]. Example 9.9. To the system of Example 9.8, we apply (9.21) and obtain F = −eT2 C −1 αd (A) 2 2 −1 1/2 1 1/2 1 10 = −[0, 1] +2 +2 −2/3 2/3 1 2 1 2 01 17/4 9/2 = −[−2/3, 2/3] = [−1/6, −13/3], 9/2 11 which is identical to the F found in Example 9.8. Multi-Input Case (m > 1). We proceed in a way completely analogous to the single-input case. Assume that Ac and Bc are in the controller form, (6.54). Notice that AcF Ac + Bc Fc is also in (controller) companion form with an identical block structure as Ac for any Fc . In fact, the pair (AcF , Bc ) has the same controllability indices μi , i = 1, . . . , m, as (Ac , Bc ). This can be seen directly, since ¯c Am ) + (B ¯c Bm )Fc = A¯c + B ¯c (Am + Bm Fc ), Ac + Bc Fc = (A¯c + B

(9.22)

¯c are deﬁned in (6.55). We can now select an n × n matrix Ad where A¯c and B with desired characteristic polynomial

362

9 State Feedback and State Observers

det(sI − Ad ) = αd (s) = sn + dn−1 sn−1 + · · · + d0 ,

(9.23)

and in companion form, having the same block structure as AcF or Ac ; that is, ¯ c Adm . Now if AcF = Ad , then in view of (9.22), B ¯c (Am +Bm Fc ) = Ad = A¯c + B ¯ Bc Adm . From this, it follows that −1 Fc = Bm [Adm − Am ],

(9.24)

where Bm , Adm , and Am are the m σj th rows of Bc , Ad , and Ac , respectively, j and σj = i=1 μi , j = 1, . . . , m. Note that this is a generalization of (9.20) of the single-input case. We shall now show how to select an n × n matrix Ad in multivariable companion form to have the desired characteristic polynomial. One choice is ⎤ ⎡ 0 1 ··· 0 ⎢ .. .. . . .. ⎥ ⎢ . . . ⎥ Ad = ⎢ . ⎥, ⎣ 0 0 ··· 1 ⎦ −d0 −d1 · · · −dn−1 the characteristic polynomial of which is αd (s). In this case the m × n matrix Adm is given by ⎤ ⎡ 0 ··· 0 1···0 ··· 0 ⎢ .. .. .. .. .. ⎥ ⎢ . . . . ⎥ Adm = ⎢ . ⎥, ⎣ 0 ··· 0 0···1 ··· 0 ⎦ ··· −dn−1 −d0 where the ith row, i = 1, . . . , m − 1, is zero everywhere except at the σi + 1 column location, where it is one. Another choice is to select Ad = [Aij ], i, j = 1, . . . , m, with Aij = 0 for i = j, i.e., ⎤ ⎡ A11 0 · · · 0 ⎢ 0 A22 · · · 0 ⎥ ⎥ ⎢ Ad = ⎢ . .. . . .. ⎥ , . ⎣ . . . ⎦ . 0

0 · · · Amm

noting that det(sI − Ad ) = det(sI − A11 ) . . . det(sI − Amm ). Then ⎡ ⎤ 0 1··· 0 ⎢ .. . . .. ⎥ ⎢ . .⎥ Aii = ⎢ . ⎥, ⎣0 1⎦ × ··· × where the last row is selected so that det(sI − Aii ) has desired roots. The disadvantage of this selection is that it may impose unnecessary restrictions

9.2 Linear State Feedback

363

on the number of real eigenvalues assigned. For example, if n = 4, m = 2 and the dimensions of A11 and A22 , which are equal to the controllability indices, are d1 = 3 and d2 = 1, then two eigenvalues must be real. There are of course other selections for Ad , and the reader is encouraged to come up with additional choices. A point that should be quite clear by now is that Fc (or F ) is not unique in the present case, since diﬀerent Fc can be derived for diﬀerent Adm , all assigning the eigenvalues at the same desired locations. In the single-input case, Fc is unique, as was shown. Therefore, the following result has been established. Lemma 9.10. Let (A, B) be controllable, and suppose that n desired real complex conjugate eigenvalues for A + BF have been selected. The state feedback matrix F that assigns all eigenvalues of A + BF to desired locations is not unique in the multi-input case (m > 1). It is unique in the single-input case m = 1. ⎡

⎤ 01 0 Example 9.11. Consider the controllable pair (A, B), where A = ⎣ 0 0 1 ⎦ 0 2 −1 ⎡ ⎤ 01 and B = ⎣ 1 1 ⎦. It was shown in Example 6.17, that this pair can be reduced 00 to its controller form ⎡ ⎤ ⎡ ⎤ 0 10 00 Ac = P AP −1 = ⎣ 2 −1 0 ⎦ , Bc = P B = ⎣ 1 1 ⎦ , 1 00 01 ⎡ ⎤ 0 0 1/2 where P = ⎣ 0 1 −1/2 ⎦. Suppose we desire to assign the eigenvalues of A+BF 1 0 −1/2 to the locations {−2, −1 ± j}, i.e., at the roots of the polynomial αd (s) = (s + 2)(s2 + 2s + 2) = s3 + 4s2 + 6s + 4. A choice for Ad is ⎡ ⎤ 0 1 0 0 0 1 , Ad1 = ⎣ 0 0 1 ⎦ , leading to Adm1 = −4 −6 −4 −4 −6 −4 and Fc1

−1 11 0 0 1 2 −1 0 = − Am ] = − 01 −4 −6 −4 1 00 1 −1 −2 1 1 3 7 5 = = . 0 1 −5 −6 −4 −5 −6 −4 −1 Bm [Adm1

Alternatively,

364

9 State Feedback and State Observers

⎡

Ad2

⎤ 0 1 0 −2 −2 0 ⎣ ⎦ = −2 −2 0 , from which Adm2 = 0 0 −2 0 0 −2

and

1 −1 −4 −1 0 Fc2 = − Am ] = 0 1 −1 0 −2 −3 −1 2 = . −1 0 −2 5 7 −9/2 2 −1 −2 Both F1 = Fc1 P = and F2 = Fc2 P = assign −4 −6 5/2 −2 0 1/2 the eigenvalues of A + BF to the locations {−2, −1 ± j}. The reader should plot the states of the equation x˙ = (A + BF )x for F = F1 and F = F2 when x(0) = [1, 1, 1]T and should comment on the diﬀerences between the trajectories. −1 Bm [Adm2

Relation (9.24) gives all feedback matrices, Fc (or F = Fc P ), that assign the n eigenvalues of Ac + Bc Fc (or A + BF ) to desired locations. The freedom in selecting such Fc is expressed in terms of the diﬀerent Ad , all in companion form, with Ad = [Aij ] and Aij of dimensions μi × μj , which have the same characteristic polynomial. Deciding which one of all the possible matrices Ad to select, so that in addition to eigenvalue assignment other objectives can be achieved, is not apparent. This ﬂexibility in selecting F can also be expressed in terms of other parameters, where both eigenvalue and eigenvector assignment are discussed, as will now be shown. 3. Assigning Eigenvalues and Eigenvectors Suppose now that F was selected so that A + BF has a desired eigenvalue sj with corresponding eigenvector vj . Then [sj I − (A + BF )]vj = 0, which can be written as vj [sj I − A, B] = 0. (9.25) −F vj To determine an F that assigns sj as a closed-loop eigenvalue, one could ﬁrst determine a basis for the right kernel (null space) of [sj I − A, B], i.e., one Mj could determine a basis such that −Dj Mj [sj I − A, B] = 0. (9.26) −Dj Note that the dimension of this basis is (n + m) − rank[sj I − A, B] = (n + m) − n = m, where rank[sj I − A, B] = n since the pair (A, B) is controllable. Since it is a basis, there exists a nonzero m × 1 vector aj so that

9.2 Linear State Feedback

365

vj Mj a = . −Dj j −F vj

(9.27)

Combining the relations −Dj aj = −F vj and Mj aj = vj , one obtains F M j aj = D j aj .

(9.28)

This is the relation that F must satisfy for sj to be a closed-loop eigenvalue. The nonzero m× 1 vector aj can be chosen arbitrarily. Note that Mj aj = vj is the eigenvector corresponding to sj . Note also that aj represents the ﬂexibility one has in selecting the corresponding eigenvector, in addition to assigning an eigenvalue. The n × 1 eigenvector vj cannot be arbitrarily assigned; rather, the m× 1 vector aj can be (almost) arbitrarily selected. These mild conditions on aj are discussed below. Theorem 9.12. The pair (sj , vj ) is an (eigenvalue, eigenvector)-pair of A + BF if and only if F satisﬁes (9.28) for some nonzero vector aj such that Mj vj = Mj aj with a basis of the null space of [sj I − A, B] as in (9.26). −Dj Proof. Necessity has been shown. To prove suﬃciency, postmultiply sj I −(A+ BF ) by Mj aj and use (9.28) to obtain (sj I − A)Mj aj − BDj aj = 0 in view of (9.26). Thus, [sj I − (A + BF )]Mj aj = 0, which implies that sj is an eigenvalue of A + BF and Mj aj = vj is the corresponding eigenvector. If relation (9.28) is written for n desired eigenvalues sj , where the aj are selected so that the corresponding eigenvectors vj = Mj aj are linearly independent, then F V = W, (9.29) where V [M1 a1 , . . . , Mn an ] and W [D1 a1 , . . . , Dn an ] uniquely specify F as the solution to these n linearly independent equations. When sj are distinct, the n vectors Mj aj , j = 1, . . . , n, are linearly independent for almost any nonzero aj , and so V has full rank. When sj have repeated values, it may still be possible under certain conditions to select aj so that Mj aj are linearly independent; however, in general, for multiple eigenvalues, (9.29) needs to be modiﬁed, and the details for this can be found in the literature. Also note that if sj+1 = s∗j , the complex conjugate of sj , then the corresponding eigenvector vi+1 = vj∗ = Mj∗ a∗j . Relation (9.29) clearly shows that the F that assigns all n closed-loop eigenvalues is not unique (see also Lemma 9.10). All such F are parameterized by the vectors aj that in turn characterize the corresponding eigenvectors. If the corresponding eigenvectors have been decided upon—of course within the set of possible eigenvectors vj = Mj aj —then F is uniquely speciﬁed. Note

366

9 State Feedback and State Observers

that in the single-input case, (9.28) becomes F Mj = Dj , where vj = Mj . In this case, F is unique. Example 9.13. Consider the controllable pair (A, B) of Example 9.11 given by ⎡ ⎤ ⎡ ⎤ 01 0 01 A = ⎣0 0 1⎦, B = ⎣1 1⎦. 0 2 −1 00 Again, it is desired to assign the eigenvalues of A + BF at −2, −1 ± j. Let s1 = −2, s2 = −1 + j, and s3 = −1 − j. Then, in view of (9.26), ⎤ ⎤ ⎡ ⎡ 1 1 1 1 ⎢ −1 0 ⎥ ⎢ j 0 ⎥ ⎥ ⎥ ⎢ ⎢ M1 M2 ⎥ ⎢ ⎢ 2 0 2 0 ⎥ =⎢ =⎢ , ⎥ ⎥, −D1 −D2 ⎣ −1 −2 ⎦ ⎣ 2 + j −1 + j ⎦ 1 2 1 1−j M2∗ M3 = , the complex conjugate, since s3 = s∗2 . and −D3 −D2∗ Each eigenvector vi = Mi ai , i = 1, 2, 3, is a linear combination of the columns of Mi . Note that v3 = v2∗ . If we select the eigenvectors to be ⎡ ⎤ 11 1 V = [v1 , v2 , v3 ] = ⎣ 0 j −j ⎦ , 02 2

0 1 1 i.e., a1 = , a2 = , and a3 = , then (9.29) implies that 1 0 0 ⎡ ⎤ 11 1 2 −2 − j −2 + j ⎣ ⎦ F 0 j −j = , −2 −1 −1 02 2 from which we have

⎡ ⎤ 4j 0 −2j 1 2 −2 − j −2 + j ⎣ 0 2 j ⎦ F = −1 4j −2 −1 0 −2 j 2 −1 −2 = . −2 0 1/2

As it can be veriﬁed, this matrix F is such that A + BF has the desired eigenvalues and eigenvectors.

9.2 Linear State Feedback

367

Remarks At this point, several comments are in order. 1. In Example 9.13, if the eigenvectors were chosen to be the eigenvectors of A + BF1 (instead of A + BF2 ) of Example 9.11, then from F V = W , it follows that F would have been F1 (instead of F2 ). 2. When si = s∗i+1 , then the corresponding eigenvectors are also complex ∗ . In this case we obtain from (9.29) that conjugates; i.e., vi = vi+1 F V = F [. . . , viR + jviI , viR − jviI , . . . ] = [. . . , wiR + jwiI , wiR − jwiI , . . . ] = W. Although these calculations could be performed over the complex numbers (as was done in the example), this is not necessary, since postmultiplication of F V = W by ⎡ ⎤ I ⎢ 1 −j 1 ⎥ 2 ⎢ 21 ⎥ 1 ⎣ ⎦ 2 +j 2 I shows that the above equation F V = W is equivalent to F [. . . , viR , viI , . . . ] = [. . . , wiR , wiI , . . . ], which involves only reals. Mj 3. The bases , j = 1, . . . , n, in (9.26) can be determined in an alterna−Dj tive way and the calculations can be simpliﬁed if the controller −1form of the P S(s) pair (A, B) is known. In particular, note that [sI − A, B] = 0, D(s) μi −1 ] where the n × m matrix S(s) is given by S(s) = block diag[1, s, . . . , s and the μi , i = 1, . . . , m, are the controllability indices of (A, B). Also, the −1 [diag[sμ1 , · · · sμm ] − Am S(s)]. m × m matrix D(s) is given by D(s) = Bm Note that S(s) and D(s) were deﬁned in the Structure Theorem (controllable version) in Section 6.4. It was shown there that (sI − Ac )S(s) = Bc D(s), from which it follows that (sI−A)P −1 S(s) = BD(s), where P is a similarity transformation matrix that reduces (A, B) to the controller form are right coprime (Ac = P AP −1 , Bc = P B). Since P −1 S(s) and D(s) −1 P S(sj ) = m for polynomial matrices (see Section 7.5), we have rank D(sj ) −1 P S(sj ) any sj , and therefore, qualiﬁes as a basis for the null space D(sj ) of the matrix [sj I − A, B] (P = I when A, B are in controller form; i.e., A = Ac and B = Bc .)

368

9 State Feedback and State Observers

Example 9.13 continued. Continuing the above example, the controller form of (A, B) was found in Example 9.11 using ⎡ ⎤ 101 P −1 = ⎣ 1 1 0 ⎦ . 200 ⎡

⎤ 0 0⎦, 1

s2 + s − 1 −s , D(s) = −1 s ⎡ ⎤ 1 1 −1 ⎢ s+1 0⎥ ⎢ ⎥ M (s) P S(s) ⎢ 2 0⎥ and = =⎢ ⎥. −D(s) −D(s) ⎣ −(s2 + s − 1) s ⎦ 1 −s Then ⎤ ⎡ 1 1 ⎢ −1 0 ⎥ ⎥ ⎢ M1 M (−2) ⎥ = =⎢ ⎢ 2 0⎥, −D1 −D(−2) ⎣ −1 −2 ⎦ 1 2 ⎡ ⎤ 1 1 ⎢ j 0 ⎥ ⎢ ⎥ M2 M (−1 + j) ⎢ 0 ⎥ = =⎢ 2 ⎥, −D(−1 + j) −D2 ⎣ 2 + j −1 + j ⎦ 1 1−j M3 M2∗ and = , which are precisely the bases used above. −D3 −D2∗ 1 Here S(s) = ⎣ s 0

Remarks (cont.) T 4. If in Example 9.13 the only requirement were that (s1 , v1 ) = (−2, (1, 0, 0) ), 2 f12 f13 then F (1, 0, 0)T = (2, −2)T ; i.e., any F = will assign the 2 f22 f23 desired values to an eigenvalue of A + BF and its corresponding eigenvector. 5. All possible eigenvectors v1 and v2 (v3 = v2∗ ) in Example 9.13 are given by ⎡ ⎤ ⎡ ⎤ 11 11 a a21 + ja31 11 ⎣ ⎦ ⎣ ⎦ v1 = M1 a1 = −1 0 and v2 = M2 a2 = j 0 , a12 a22 + ja32 20 20

9.2 Linear State Feedback

369

where the aij are such that the set {v1 , v2 , v3 } is linearly independent (i.e., V = [v1 , v2 , v3 ] is nonsingular) but otherwise arbitrary. Note that in this case (sj distinct), almost any arbitrary choice for aij will satisfy the above requirement; see [1, Appendix A.4]. 9.2.3 The Linear Quadratic Regulator (LQR): Continuous-Time Case A linear state feedback control law that is optimal in some appropriate sense can be determined as a solution to the so-called Linear Quadratic Regulator (LQR) problem (also called the H2 optimal control problem). The LQR problem has been studied extensively, and the interested reader should consult the extensive literature on optimal control for additional information on the subject. In the following discussion, we give a brief outline of certain central results of this topic to emphasize the fact that the state feedback gain F can be determined to satisfy, in an optimal fashion, requirements other than eigenvalue assignment, discussed above. The LQR problem has been studied for the time-varying and time-invariant cases. Presently, we will concentrate on the time-invariant optimal regulator problem. Consider the time-invariant linear system given by x˙ = Ax + Bu,

z = M x,

(9.30)

where the vector z(t) represents the variables to be regulated—to be driven to zero. We wish to determine u(t), t ≥ 0, which minimizes the quadratic cost

∞ [z T (t)Qz(t) + uT (t)Ru(t)]dt (9.31) J(u) = 0

for any initial state x(0). The weighting matrices Q, R are real, symmetric, and positive deﬁnite; i.e., Q = QT , R = RT , and Q > 0, R > 0. This is the most common version of the LQR problem. The term z T Qz = xT (M T QM )x is nonnegative, and it minimizes its integral forces z(t) to approach zero as t goes to inﬁnity. The matrix M T QM is in general positive semideﬁnite, which allows some states to be treated as “do not care” states. The term uT Ru with R > 0 is always positive for u = 0, and it minimizes its integral forces u(t) to remain small. The relative “size” of Q and R enforces tradeoﬀs between the size of the control action and the speed of response. Assume that (A, B, Q1/2 M ) is controllable (-from-the-origin) and observable. It turns out that the solution u∗ (t) to this optimal control problem can be expressed in state feedback form, which is independent of the initial condition x(0). In particular, the optimal control u∗ is given by u∗ (t) = F ∗ x(t) = −R−1 B T Pc∗ x(t),

(9.32)

370

9 State Feedback and State Observers

where Pc∗ denotes the symmetric positive deﬁnite solution of the algebraic Riccati equation AT Pc + Pc A − Pc BR−1 B T Pc + M T QM = 0.

(9.33)

This equation may have more than one solution but only one that is positive deﬁnite (see Example 9.14). It can be shown that u∗ (t) = F ∗ x(t) is a stabilizing feedback control law and that the minimum cost is given by Jmin = J(u∗ ) = xT (0)Pc∗ x(0). The assumptions that (A, B, Q1/2 M ) are controllable and observable may be relaxed somewhat. If (A, B, Q1/2 M ) is stabilizable and detectable, then the uncontrollable and unobservable eigenvalues, respectively, are stable, and Pc∗ is the unique, symmetric, but now positive-semideﬁnite solution of the algebraic Riccati equation. The matrix F ∗ is still a stabilizing gain, but it is understood that the uncontrollable and unobservable (but stable) eigenvalues will not be aﬀected by F ∗ . Note that if the time interval of interest in the evaluation of the cost goes from 0 to t1 < ∞, instead of 0 to ∞, that is, if

t1 J(u) = [z T (t)Qz(t) + uT (t)Ru(t)]dt, (9.34) 0

then the optimal control law is time-varying and is given by u∗ (t) = −R−1 B T P ∗ (t)x(t),

0 ≤ t ≤ t1 ,

(9.35)

where P ∗ (t) is the unique, symmetric, and positive-semideﬁnite solution of the Riccati equation, which is a matrix diﬀerential equation of the form −

d P (t) = AT P (t) + P (t)A − P (t)BR−1 B T P (t) + M T QM, dt

(9.36)

where P (t1 ) = 0. It is interesting to note that if (A, B, Q1/2 M ) is stabilizable and detectable (or controllable and observable), then the solution to this problem as t1 → ∞ approaches the steady-state value Pc∗ given by the algebraic Riccati equation; that is, when t1 → ∞ the optimal control policy is the time-invariant control law (9.32), which is much easier to implement than time-varying control policies. Example 9.14. Consider the described by the equations x˙ = Ax + system 01 0 Bu, y = Cx, where A = , B = , C = [1, 0]. Then (A, B, C) is 00 1 controllable and observable and C(sI − A)−1 B = 1/s2 . We wish to determine the optimal control u∗ (t), t ≥ 0, which minimizes the performance index

∞ J= (y 2 (t) + ρu2 (t))dt, 0

9.2 Linear State Feedback

371

where ρ is positive and real. Then R = ρ > 0, z(t) = y(t), M = C, and Q = 1 > 0. In the present case the algebraic Riccati equation (9.33) assumes the form AT Pc + Pc A−Pc BR−1 B T Pc + M T QM 1 00 1 01 0 = Pc + Pc [1 0] − Pc [0 1]Pc + 10 0 00 1 ρ 1 p1 p2 00 p1 p2 p p 01 00 p1 p2 = + 1 2 − 10 p2 p3 p2 p3 p2 p3 00 01 ρ p2 p3 10 00 + = , 00 00 p1 p2 where Pc = = PcT . This implies that p2 p3 1 − p22 + 1 = 0, ρ

1 p1 − p2 p3 = 0, ρ

1 2p2 − p33 = 0. ρ

Now Pc is positive deﬁnite if and only if p1 > 0 and p1 p3 − p22 > 0. The √ ﬁrst equation above implies that p2 = ± ρ. However, the third equation, √ √ which yields p23 = 2ρp2 , implies that p2 = + ρ. Then p23 = 2ρ ρ and p3 = √ ± 2ρ ρ. The second equation yields p1 = 1ρ p2 p3 and implies that only p3 = √ + 2ρ ρ is acceptable, since we must have p1 > 0 for Pc to be positive deﬁnite. Note that p1 > 0 and p3 − p22 = 2ρ − ρ = ρ > 0, which shows that √ √ 2 ρ ρ ∗ √ √ Pc = ρ 2ρ ρ is the positive deﬁnite solution of the algebraic Riccati equation. The optimal control law is now given by 1 u∗ (t) = F ∗ x(t) = −R−1 B T Pc∗ x(t) = − [0, 1]Pc∗ x(t). ρ The eigenvalues of the compensated system, i.e., the eigenvalues of A + BF ∗ , can now be determined for diﬀerent ρ. Also, the corresponding u∗ (t) and y(t) for given x(0) can be plotted. As ρ increases, the control energy expended to drive the output to zero is forced to decrease. The reader is asked to verify this by plotting u∗ (t) and y(t) for diﬀerent values of ρ when x(0) = [1, 1]T . Also, the reader is asked to plot the eigenvalues of A + BF ∗ as a function of ρ and to comment on the results. It should be pointed out that the locations of the closed-loop eigenvalues, as the weights Q and R vary, have been studied extensively. Brieﬂy, for the single-input case and for Q = qI and R = r in (9.31), it can be shown that the

372

9 State Feedback and State Observers

optimal closed-loop eigenvalues are the stable zeros of 1 + (q/r)H T (−s)H(s), where H(s) = M (sI − A)−1 B. As q/r varies from zero (no state weighting) to inﬁnity (no control weighting), the optimal closed-loop eigenvalues move from the stable poles of H T (−s)H(s) to the stable zeros of H T (−s)H(s). Note that the stable poles of H T (−s)H(s) are the stable poles of H(s) and the stable reﬂections of its unstable poles with respect to the imaginary axis in the complex plane, whereas its stable zeros are the stable zeros of H(s) and the stable reﬂections of its unstable zeros. The solution of the LQR problem relies on solving the Riccati equation. A number of numerically stable algorithms exist for solving the algebraic Riccati equation. The reader is encouraged to consult the literature for computer software packages that implement these methods. A rather straightforward method for determining Pc∗ is to use the Hamiltonian matrix given by A −BR−1 B T . (9.37) H −M T QM −AT Let [V1T , V2T ]T denote the n eigenvectors of H that correspond to the n stable [Re (λ) < 0] eigenvalues. Note that of the 2n eigenvalues of H, n are stable and are the mirror images reﬂected on the imaginary axis of its n unstable eigenvalues. When (A, B, Q1/2 M ) is controllable and observable, then H has no eigenvalues on the imaginary axis [Re(λ) = 0]. In this case the n stable eigenvalues of H are in fact the closed-loop eigenvalues of the optimally controlled system, and the solution to the algebraic Riccati equation is then given by (9.38) Pc∗ = V2 V1−1 . Note that in this case the matrix V1 consists of the n eigenvectors of A + BF ∗ , since for λ1 a stable eigenvalue of H, and v1 the corresponding (ﬁrst) column of V1 , we have [λ1 I − (A + BF ∗ )]v1 = [λ1 I − A + BR−1 B T V2 V1−1 ]v1 V1 V −1 T = [λ1 I, 0] − [A, −BR B ] 1 V1−1 v1 V2 V2 0 × ··· × 0 × ··· × 1 0 0 −1 . . . .. = . . .. = .. , V1 v1 = .. .. . . . . . . . . . 0 × ··· × 0 ×···× 0 0 V1 where the fact that are eigenvectors of H was used. It is worth reﬂecting V2 for a moment on the relationship between (9.38) and (9.29). The optimal control F derived by (9.38) is in the class of F derived by (9.29). 9.2.4 Input–Output Relations It is useful to derive the input–output relations for a closed-loop system that is compensated by linear state feedback. Given the uncompensated or

9.2 Linear State Feedback

373

open-loop system x˙ = Ax+Bu, y = Cx+Du, with initial conditions x(0) = x0 , we have u(s), (9.39) yˆ(s) = C(sI − A)−1 x0 + H(s)ˆ where the open-loop transfer function H(s) = C(sI − A)−1 B + D. Under the feedback control law u = F x + r, the compensated closed-loop system is described by the equations x˙ = (A + BF )x + Br, y = (C + DF )x + Dr, from which we obtain r (s), yˆ(s) = (C + DF )[sI − (A + BF )]−1 x0 + HF (s)ˆ

(9.40)

where the closed-loop transfer function HF (s) is given by HF (s) = (C + DF )[sI − (A + BF )]−1 B + D. Alternative expressions for HF (s) can be derived rather easily by substituting (9.4), namely, uˆ(s) = F [sI − (A + BF )]−1 x0 + [I − F (sI − A)−1 B]−1 rˆ(s), into (9.39). This corresponds to working with an open-loop control law that nominally produces the same results when applied to the system [see the discussion on open- and closed-loop control that follows (9.4)]. Substituting, we obtain yˆ(s) = [C(sI − A)−1 + H(s)F [sI − (A + BF )]−1 ]x0 + H(s)[I − F (sI − A)−1 B]−1 rˆ(s).

(9.41)

Comparing with (9.40), we see that (C + DF )[sI − (A + BF )]−1 = C(sI − A)−1 + H(s)F [sI − (A + BF )]−1 , and that HF (s) = (C + DF )[sI − (A + BF )]−1 B + D = [C(sI − A)−1 B + D][I − F (sI − A)−1 B]−1 = H(s)[I − F (sI − A)−1 B]−1 .

(9.42)

The last relation points out the fact that yˆ(s) = HF (s)ˆ r (s) can be obtained from yˆ(s) = H(s)ˆ u(s) using the open-loop control u ˆ(s) = [I − F (sI − A)−1 B]−1 rˆ(s). Using Matrix Fractional Descriptions Relation (9.42) can easily be derived in an alternative manner, using fractional matrix descriptions for the transfer function, introduced in Section 7.5. In particular, the transfer function H(s) of the open-loop system {A, B, C, D} is given by H(s) = N (s)D−1 (s),

374

9 State Feedback and State Observers

where N (s) = CS(s) + DD(s), with S(s) and D(s) satisfying (sI − A)S(s) = BD(s) (refer to the proof of the controllable version of the Structure Theorem given in Section 6.4). Notice that it has been assumed, without loss of generality, that the pair (A, B) is in controller form. Similarly, the transfer function HF (s) of the compensated system {A + BF, B, C + DF, D} is given by HF (s) = NF (s)DF−1 (s), where NF (s) = (C + DF )S(s) + DDF (s), with S(s) and DF (s) satisfying [sI − (A + BF )]S(s) = BDF (s). This relation implies that (sI − A)S(s) = B[DF (s) + F S(s)], from which we obtain DF (s) + F S(s) = D(s). Then NF (s) = CS(s) + D[F S(s) + DF (s)] = CS(s) + DD(s) = N (s); that is, HF (s) = N (s)DF−1 (s),

(9.43)

where DF (s) = D(s) − F S(s). Note that I − F (sI − A)−1 B in (9.42) is the transfer function of the system {A, B, −F, I} and can be expressed as DF (s)D−1 (s), where DF (s) = −F S(s) + ID(s). Let M (s) = (DF (s)D−1 (s))−1 . Then (9.43) assumes the form HF (s) = N (s)DF−1 (s) = (N (s)D−1 (s))(D(s)DF−1 (s)) = H(s)M (s).

(9.44)

Relation HF (s) = N (s)DF−1 (s) also shows that the zeros of H(s) [in N (s); see also Subsection 7.5.4] are invariant under linear state feedback; they can be changed only via cancellations with poles. Also observe that M (s) = D(s)DF−1 (s) is the transfer function of the system {A + BF, B, F, I}. This implies that HF (s) in (9.42) can also be written as HF (s) = H(s)[F (sI − (A + BF ))−1 B + I],

(9.45)

which is a result that could also be shown directly using matrix identities. Example 9.15. Consider the system x˙ = Ax + Bu, y = Cx, where ⎡ ⎡ ⎤ ⎤ 0 10 00 A = Ac = ⎣ 2 −1 0 ⎦ and B = Bc = ⎣ 1 1 ⎦ 1 00 01 as in Example 9.11, and let C = Cc = [1, 1, 0]. HF (s) will now be determined. In view of the Structure Theorem developed in Section 6.4, the transfer function is given by H(s) = N (s)D−1 (s), where ⎡ ⎤ 10 N (s) = Cc S(s) = [1, 1, 0] ⎣ s 0 ⎦ = [s + 1, 0] 01

9.2 Linear State Feedback

and

⎡ ⎡ −1 2 1 11 −1 ⎣ s 0 − 2 −1 0 ⎣ s D(s) = Bm [Λ(s) − Am S(s)] = 01 0 s 1 00 0 2 2 s + s − 1 −s 1 −1 s +s−2 0 = . = −1 s −1 s 0 1

375

⎤⎤ 0 0 ⎦⎦ 1

Then

2 −1 s + s − 1 −s H(s) = N (s)D−1 (s) = [s + 1, 0] −1 s 1 s s = [s + 1, 0] 1 s2 + s − 1 s3 + s2 − 2s 1 s+1 = [s(s + 1), s(s + 1)] = 2 [1, 1]. 2 s(s + s − 2) s +s−2 3 7 5 If Fc = (which is Fc1 of Example 9.11), then −5 −6 −4 ⎡ ⎤ 2 10 s + s − 1 −s 3 7 5 ⎣ s 0⎦ − DF (s) = D(s) − Fc S(s) = −1 s −5 −6 −4 01 2 s − 6s − 4 −s − 5 = . 6s + 4 s+4 Note that det DF (s) = s3 + 4s2 + 6s + 4 = (s + 2)(s2 + 2s + 2) with roots −2, −1 ± j, as expected. Now 1 s+4 s+5 −1 HF (s) = N (s)DF (s) = [s + 1, 0] −6s − 4 s2 − 6s − 4 (s + 2)(s2 + 2s + 2) s+1 [s + 4, s + 5]. = (s + 2)(s2 + 2s + 2) Note that the zeros of H(s) and HF (s) are identical, located at −1. Then HF (s) = H(s)M (s), where 2 s + s − 1 −s s+4 s+5 −1 1 M (s) = D(s)DF (s) = −1 s −6s − 4 s2 − 6s − 4 s3 +4s2 +6s+4 3 s + 11s2 + 7s − 4 12s2 + 8s − 5 1 = −6s2 − 5s − 4 s3 − 6s2 − 5s − 5 s3 +4s2 +6s+4 = [I − Fc (sI − Ac )−1 Bc ]−1 . Note that the open-loop uncompensated system is unobservable, with 0 being the unobservable eigenvalue, whereas the closed-loop system is observable; i.e., the control law changed the observability of the system.

376

9 State Feedback and State Observers

9.2.5 Discrete-Time Systems Linear state feedback control for discrete-time systems is deﬁned in a way that is analogous to the continuous-time case. The deﬁnitions are included here for purposes of completeness. We consider a linear, time-invariant, discrete-time system described by equations of the form x(k + 1) = Ax(k) + Bu(k), y(k) = Cx(k) + Du(k),

(9.46)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , D ∈ Rp×m , and k ≥ k0 , with k ≥ k0 = 0 being typical. Deﬁnition 9.16. The linear (discrete-time, time-invariant) state feedback control law is deﬁned by u(k) = F x(k) + r(k),

(9.47)

where F ∈ Rm×n is a gain matrix and r(k) ∈ Rm is the external input vector. The compensated closed-loop system is now given by x(k + 1) = (A + BF )x(k) + Br(k), y(k) = (C + DF )x(k) + Dr(k).

(9.48)

In view of Section 3.5, the system x(k + 1) = (A + BF )x(k) is asymptotically stable if and only if the eigenvalues of A + BF satisfy |λi | < 1, i.e., if they lie strictly within the unit disk of the complex plane. The stabilization problem for the time-invariant case therefore becomes a problem of shifting the eigenvalues of A + BF , which is precisely the problem studied before for the continuous-time case. Theorem 9.2 and Lemmas 9.3 and 9.6 apply without change, and the methods developed before for eigenvalue assignment can be used here as well. The only diﬀerence in this case is the location of the desired eigenvalues: They are assigned to be within the unit circle to achieve stability. We will not repeat here the details for these results. Input–output relations for discrete-time systems, which are in the spirit of the results developed in the preceding subsection for continuous-time systems, can be derived in a similar fashion, this time making use of the z-transform of x(k + 1) = Ax(k) + Bu(k), x(0) = x0 to obtain x ˆ(z) = z(zI − A)−1 x0 + (zI − A)−1 B u ˆ(z).

(9.49)

[Compare expression (9.49) with x ˆ(s) = (sI − A)−1 x0 + (sI − A)−1 B u ˆ(s).]

9.2 Linear State Feedback

377

9.2.6 The Linear Quadratic Regulator (LQR): Discrete-Time Case The formulation of the LQR problem in the discrete-time case is analogous to the continuous-time LQR problem. Consider the time-invariant linear system x(k + 1) = Ax(k) + Bu(k), z(k) = M x(k),

(9.50)

where the vector z(t) represents the variables to be regulated. The LQR problem is to determine a control sequence {u∗ (k)}, k ≥ 0, which minimizes the cost function ∞ J(u) = [z T (k)Qz(k) + uT (k)Ru(k)] (9.51) k=0

for any initial state x(0), where the weighting matrices Q and R are real symmetric and positive deﬁnite. Assume that (A, B, Q1/2 M ) is reachable and observable. Then the solution to the LQR problem is given by the linear state feedback control law u∗ (k) = F ∗ x(k) = −[R + B T Pc∗ B]−1 B T Pc∗ Ax(k),

(9.52)

where Pc∗ is the unique, symmetric, and positive deﬁnite solution of the (discrete-time) algebraic Riccati equation, given by Pc = AT [Pc − Pc B[R + B T Pc B]−1 B T Pc ]A + M T QM.

(9.53)

The minimum value of J is J(u∗ ) = Jmin = xT (0)Pc∗ x(0). As in the continuous-time case, it can be shown that the solution Pc∗ can be determined from the eigenvectors of the Hamiltonian matrix , which in this case is A + BR−1 B T A−T M T QM −BR−1 B T A−T H= , (9.54) −A−T M T QM A−T where it is assumed that A−1 exists. Variations of the above method that relax this assumption exist and can be found in the literature. Let [V1T , V2T ]T be n eigenvectors corresponding to the n stable (|λ| < 1) eigenvalues of H. Note that out of the 2n eigenvalues of H, n of them are stable (i.e., within the unit circle) and are the reciprocals of the remaining n unstable eigenvalues (located outside the unit circle). When (A, B, Q1/2 M ) is controllable (-from-the-origin) and observable, then H has no eigenvalues on the unit circle (|λ| = 1). In fact the n stable eigenvalues of H are in this case the closed-loop eigenvalues of the optimally controlled system. The solution to the algebraic Riccati equation is given by Pc∗ = V2 V1−1 .

(9.55)

As in the continuous-time case, we note that V1 consists of the n eigenvectors of A + BF ∗ .

378

9 State Feedback and State Observers

Example 9.17. Weconsider thesystem x(k + 1) = Ax(k) + Bu(k), y(k) = 01 0 Cx(k), where A = , B = , C = [1, 0] and we wish to determine 00 1 ∗ the optimal control sequence {u (k)}, k ≥ 0, that minimizes the performance index ∞ (y 2 (k) + ρu2 (k)), J(u) = k=0

where ρ > 0. In (9.51), z(k) = y(k), M = C, Q = 1, and R = ρ. The reader is asked to determine u∗ (k) given in (9.52) by solving the discrete-time algebraic Riccati equation (9.53) in a manner analogous to the solution in Example 9.14 (for the continuous-time algebraic Riccati equation).

9.3 Linear State Observers Since the states of a system contain a great deal of useful information, there are many applications where knowledge of the state vector over some time interval is desirable. It may be possible to measure states of a system by appropriately positioned sensors. This was in fact assumed in the previous section, where the state values were multiplied by appropriate gains and then fed back to the system in the state feedback control law. Frequently, however, it may be either impossible or simply impractical to obtain measurements for all states. In particular, some states may not be available for measurement at all (as in the case, for example, with temperatures and pressures in inaccessible parts of a jet engine). There are also cases where it may be impractical to obtain state measurements from otherwise available states because of economic reasons (e.g., some sensors may be too expensive) or because of technical reasons (e.g., the environment may be too noisy for any useful measurements). Thus, there is a need to be able to estimate the values of the state of a system from available measurements, typically outputs and inputs (see Figure 9.2). Given the system parameters A, B, C, D and the values of the inputs and outputs over a time interval, it is possible to estimate the state when the system is observable. This problem, a problem in state estimation, is discussed in this section. In particular, we will address the so-called full-order and reducedorder asymptotic estimators, which are also called full-order and reduced-order observers. 9.3.1 Full-Order Observers: Continuous-Time Systems We consider systems described by equations of the form x˙ = Ax + Bu, where A ∈ R

n×n

,B∈R

n×m

,C ∈R

y = Cx + Du,

p×n

, and D ∈ R

p×m

(9.56) .

9.3 Linear State Observers u

{ A, B, C, D}

379

y

State Observer ^ x

Figure 9.2. Linear state observer conﬁguration

Full-State Observers: The Identity Observer An estimator of the full state x(t) can be constructed in the following manner. We consider the system x ˆ˙ = Aˆ x + Bu + K(y − yˆ), where yˆ C x ˆ + Du. Note that (9.57) can be written as u x ˆ˙ = (A − KC)ˆ x + [B − KD, K] , y

(9.57)

(9.58)

which clearly reveals the role of u and y (see Figure 9.3). The error between the actual state x(t) and the estimated state x ˆ(t), e(t) = x(t) − x ˆ(t), is governed by the diﬀerential equation e(t) ˙ = x(t) ˙ − xˆ˙ (t) = [Ax + Bu] − [Aˆ x + Bu + KC(x − x ˆ)] or e(t) ˙ = [A − KC]e(t).

(9.59)

e(t) = exp[(A − KC)t]e(0).

(9.60)

Solving (9.59), we obtain

Now if the eigenvalues of A − KC are in the left half-plane, then e(t) → 0 as t → ∞, independently of the initial condition e(0) = x(0) − x ˆ(0). This asymptotic state estimator is known as the Luenberger observer . Lemma 9.18. There exists K ∈ Rn×p so that the eigenvalues of A − KC are assigned to arbitrary real or complex conjugate locations if and only if (A, C) is observable. Proof. The eigenvalues of (A − KC)T = AT − C T K T are arbitarily assigned via K T if and only if the pair (AT , C T ) is controllable (see Theorem 9.2 of the previous section) or, equivalently, if and only if the pair (A, C) is observable.

380

9 State Feedback and State Observers u

y

B – KD

K +

+ Σ +

^ x(t)

Σ

+

∫

n

^ x

A – KC

Figure 9.3. Full-state identity observer conﬁguration

Discussion If (A, C) is not observable, but the unobservable eigenvalues are stable, i.e., (A, C) is detectable, then the error e(t) will still tend to zero asymptotically. However, the unobservable eigenvalues will appear in this case as eigenvalues of A − KC, and they may aﬀect the speed of the response of the estimator in an undesirable way. For example, if the unobservable eigenvalues are stable but are located close to the imaginary axis, then their corresponding modes will tend to dominate the response, most likely resulting in a state estimator that converges too slowly to the actual value of the state. Where should the eigenvalues of A − KC be located? This problem is dual to the problem of closed-loop eigenvalue placement via state feedback and is equally diﬃcult to resolve. On the one hand, the observer must estimate the state suﬃciently fast, which implies that the eigenvalues should be placed suﬃciently far from the imaginary axis so that the error e(t) will tend to zero suﬃciently fast. On the other hand, this requirement may result in a high gain K, which tends to amplify existing noise, thus reducing the accuracy of the estimate. Note that in this case, noise is the only limiting factor of how fast an estimator may be, since the gain K is realized by an algorithm and is typically implemented by means of a digital computer. Therefore, gains of any size can easily be introduced. Compare this situation with the limiting factors in the control case, which is imposed by the magnitude of the required control action (and the limits of the corresponding actuator). Typically, the faster the compensated system, the larger the required control magnitude. One may of course balance the tradeoﬀs between speed of response of the estimator and eﬀects of noise by formulating an optimal estimation problem to derive the best K. To this end, one commonly assumes certain probabilistic properties for the process. Typically, the measurement noise and the initial condition of the plant are assumed to be Gaussian random variables, and one tries to minimize a quadratic performance index. This problem is typically referred to as the Linear Quadratic Gaussian (LQG) estimation problem. This optimal estimation or ﬁltering problem can be seen to be the dual of the quadratic optimal control problem of the previous section, a fact that will

9.3 Linear State Observers

381

be exploited in deriving its solution. Note that the well-known Kalman ﬁlter is such an estimator. In the following discussion, we shall brieﬂy discuss the optimal estimation problem. First, however, we shall address the following related issues. 1. Is it possible to take K = 0 in the estimator (9.57)? Such a choice would eliminate the information contained in the term y − yˆ from the estimator, which would now be of the form x ˆ˙ = Aˆ x + Bu. (9.61) In this case, the estimator would operate without receiving any information on how accurate the estimate x ˆ actually is. The error e(t) = x(t)−xˆ(t) would go to zero only when A is stable. There is no mechanism to affect the speed by which x ˆ(t) would approach x(t) in this case, and this is undesirable. One could perhaps determine x(0), using the methods in Section 5.4, assuming that the system is observable. Then, by setting xˆ(0) = x(0), presumably x ˆ(t) = x(t) for all t ≥ 0, in view of (9.61). This of course is not practical for several reasons. First, the calculated xˆ(0) is never exactly equal to the actual x(0), which implies that e(0) would be nonzero. Therefore, the method would rely again on A being stable, as before, with the advantage here that e(0) would be small in some sense and so e(t) → 0 faster. Second, this scheme assumes that suﬃcient data have been collected in advance to determine (an approximation to) x(0) and to initialize the estimator, which may not be possible. Third, it is assumed that this initialization process is repeated whenever the estimator is restarted, which may be impractical. 2. If derivatives of the inputs and outputs are available, then the state x(t) may be determined directly (see Exercise 5.12 in Chapter 5). The estimate x ˆ(t) is in this case produced instantaneously from the values of the inputs and outputs and their derivatives. Under these circumstances, x ˆ(t) is the output of a static state estimator, as opposed to the above dynamic state estimator, which leads to a state estimate x ˆ(t) that only approaches the actual state x(t) asymptotically as t → ∞ [e(t) = x(t) − xˆ(t) → 0 as t → ∞]. Unfortunately, this approach is in general not viable since noise present in the measurements of u(t) and y(t) makes accurate calculations of the derivatives problematic, and since errors in u(t), y(t) and their derivatives are not smoothed by the algebraic equations of the static estimator (as opposed to the smoothing eﬀects introduced by integration in dynamic systems). It follows that in this case the state estimates may be erroneous. Example 9.19. Consider the observable pair ⎡ ⎤ 01 0 A = ⎣ 0 0 1 ⎦ , C = [1, 0, 0]. 0 2 −1

382

9 State Feedback and State Observers

We wish to assign the eigenvalues of A−KC in a manner that enables us to design a full-order/full-state asymptotic observer. Let the desired characteristic polynomial be αd (s) = s3 + d2 s2 + d1 s + d0 , and consider ⎡ ⎡ ⎤ ⎤ 00 0 1 AD = AT = ⎣ 1 0 2 ⎦ and BD = C T = ⎣ 0 ⎦ . 0 1 −1 0 To reduce (AD , BD ) to controller form, we consider ⎡ ⎤ 100 C = [BD , AD BD , A2D BD ] = ⎣ 0 1 0 ⎦ = C −1 . 001 ⎡

⎡ ⎤ ⎡ ⎤ ⎤ q −2 1 1 0 0 1 Then P = ⎣ qAD ⎦ = ⎣ 0 1 −1 ⎦ and P −1 = ⎣ 1 1 0 ⎦, qA2D 100 1 −1 3 from which we obtain ⎡ ⎡ ⎤ ⎤ 01 0 0 ADc = P AD P −1 = ⎣ 0 0 1 ⎦ and BDc = P BD = ⎣ 0 ⎦ . 0 2 −1 1 −1 [Adm − Am ] = [−do , −d1 − The state feedback is then given by FDc = Bm 2, −d2 + 1] and FD = FDc P = [−d2 + 1, d2 − d1 − 3, d1 − d0 − 3d2 + 5]. Then T = [d2 − 1, d1 − d2 + 3, d0 − d1 + 3d2 − 5]T K = −FD

assigns the eigenvalues of A − KC at the roots of αd (s) = s3 + d2 s2 + d1 s + d0 . Note that the same result could also have been derived using the direct method for eigenvalue assignment, using |sI − (A − (k0 , k1 , k2 )T C)| = αd (s). Also, the result could have been derived using the observable version of Ackermann’s formula, namely, T = αd (A)O−1 en , K = −FD −1 αd (AD ) from (9.21). Note that the given system has where FD = −eTn CD eigenvalues at 0, 1, −2 and is therefore unstable. The observer derived in this case will be used in the next section (Example 9.25) in combination with state feedback to stabilize the system x˙ = Ax + Bu, y = Cx, where ⎡ ⎤ ⎡ ⎤ 01 0 01 A = ⎣ 0 0 1 ⎦ , B = ⎣ 1 1 ⎦ , and C = [1, 0, 0] 0 2 −1 00

(see Example 9.11), using only output measurements.

9.3 Linear State Observers

383

0 −2 1 −2 and C = [0, 1], and where (A, C) is in observer form. It is easy to show that K = [d0 − 2, d1 − 2]T assigns the eigenvalues of A − KC at the roots of s2 + d1 s + d0 . To verify this, note that s0 0 −d0 det(sI − (A − KC)) = det − = s2 + d1 + d0 . 0s 1 −d1 Example 9.20. Consider the system x˙ = Ax, y = Cx, where A =

The error e(t) = x(t) − x ˆ(t) is governed by the equation e(t) ˙ = (A − KC)e(t) given in (9.59). Noting that the eigenvalues of A are −1 ± j, select diﬀerent sets of eigenvalues for the observer and plot the states x(t), xˆ(t) and the error e(t) for x(0) = [2, 2]T and x ˆ(0) = [0, 0]T . The further away the eigenvalues of the observer are selected from the imaginary axis (with negative real parts), the larger the gains in K will become and the faster x ˆ(t) → x(t).

Partial or Linear Functional State Observers The state estimator studied above is a full-state estimator or observer; i.e., x ˆ(t) is an estimate of the full-state vector x(t). There are cases where only part of the state vector, or a linear combination of the states, is of interest. In control problems, for example, F xˆ(t) is used and fed back, instead of F x(t), where F is an m × n state feedback gain matrix. An interesting question that arises at this point is as follows: Is it possible to estimate directly a linear ˜ ≤ n? For details of this combination of the state, say, T x, where T ∈ Rn˜ ×n , n problem see materials starting with [1, p. 354]. 9.3.2 Reduced-Order Observers: Continuous-Time Systems Suppose that p states, out of the n state, can be measured directly. This information can then be used to reduce the order of the full-state estimator from n to n − p. Similar results are true for the estimator of a linear function of the state, but this problem will not be addressed here. To determine a full-state estimator of order n − p, ﬁrst consider the case when C = [Ip , 0]. In particular, let A11 A12 x1 B1 x˙ 1 = + u x˙ 2 A21 A22 x2 B2 x (9.62) z = [Ip , 0] 1 , x2 where z = x1 represents the p measured states. Therefore, only x2 (t) ∈ R(n−p)×1 is to be estimated. The system whose state is to be estimated is now given by

384

9 State Feedback and State Observers

x˙ 2 = A22 x2 + [A21 , B2 ]

x1 u

(u = A22 x2 + B ˜, x1 z ( [A21 , B2 ] and u where B ˜ = is a known signal. Also, u u y˜ x˙ 1 − A11 x1 − B1 u = A12 x2 ,

(9.63)

(9.64)

where y˜ is known. An estimator for x2 can now be constructed. In particular, in view of (9.57), we have that the system (u ( y − A12 xˆ2 ) ˆ2 + B ˜ + K(˜ x ˆ˙ 2 = A22 x ( 12 )ˆ ( z˙ − A11 z − B1 u) x2 + (A21 z + B2 u) + K( = (A22 − KA

(9.65)

is an asymptotic state estimator for x2 . Note that the error e satisﬁes the equation ( 12 )e, (9.66) e˙ = x˙ 2 − xˆ˙ 2 = (A22 − KA ( 12 can be and if (A22 , A12 ) is observable, then the eigenvalues of A22 − KA ( arbitrarily assigned making use of K. It can be shown that if the pair (A = [Aij ], C = [Ip , 0]) is observable, then (A22 , A12 ) is also observable (prove this using the eigenvalue observability test of Section 6.3). System (9.65) is an estimator of order n − p, and therefore, the estimate of the entire state x is z ( ˆ2 = w + Kz . To avoid using z˙ = x˙ 1 in y˜ given by (9.64), one could use x xˆ2 and obtain from (9.65) an estimator in terms of w, z, and u. In particular, ( 12 )w +[(A22 − KA ( 12 )K ( +A21 − KA ( 11 ]z +[B2 − KB ( 1 ]u. (9.67) w˙ = (A22 − KA ( and of course w + Kz ( is an estimate for x Then w is an estimate of x ˆ2 − Kz ˆ2 . In the above derivation, it was assumed for simplicity that a part of the state x1 , is measured directly; i.e., C = [Ip , 0]. One could also derive a reducedorder estimator for the system x˙ = Ax + Bu,

y = Cx.

To see let rank C = p and deﬁne a similarity transformation matrix this, C % is such that P is nonsingular. Then P = % , where C C ¯x + Bu, ¯ x ¯˙ = A¯

y = C¯ x ¯ = [Ip , 0]¯ x,

(9.68)

¯ = P B, and C¯ = CP −1 = [Ip , 0]. The transwhere x¯ = P x, A¯ = P AP −1 , B formed system is now in an appropriate form for an estimator of order n − p to be derived, using the procedure discussed above. The estimate of x ¯ is

9.3 Linear State Observers

385

y y −1 , and the estimate of the original state x is P ˆ¯2 . In particular, xˆ¯2 x ( where w satisﬁes (9.67) with z = y, [Aij ] = A¯ = P AP −1 , and x ¯2 =w + Ky, B1 ¯ = P B. The interested reader should verify this result. =B B2

Example the system x˙ = Ax + Bu, y = Cx, where A = 9.21. Consider 0 −2 0 , B = , and C = [0, 1]. We wish to design a reduced n − p = 1 −2 1 n − 1 = 2 − 1 = 1, a ﬁrst-order asymptotic state estimator. C 01 leads to (9.68), The similarity transformation matrix P = % = 10 C 01 0 −2 01 −2 1 ¯ = where x ¯ = P x and A¯ = P AP −1 = = , B 10 1 −2 10 −2 0 1 ¯ B, ¯ C} ¯ is now in an PB = , and C¯ = CP −1 = [1, 0]. The system {A, 0 A11 A12 −2 1 ¯ = , appropriate form for use of (9.67). We have A = A21 A22 −2 0 ¯ = B1 = 1 , and (9.67) assumes the form B B2 0 ( ( ( + [−K ( 2 + (−2) − K(−2)]y + (−K)u, w˙ = (−K)w which is a system observer of order 1. ( = −10 we have w˙ = 10w − 122y + 10u, and w + Ky ( = w − 10y is For K y ˆ2 . Therefore, is an estimate of x ¯, and an estimate for x ¯ w − 10y y 01 y w − 10y P −1 = = w − 10y 10 w − 10y y is an estimate of x(t) for the original system.

9.3.3 Optimal State Estimation: Continuous-Time Systems The gain K in the estimator (9.57) above can be determined so that it is optimal in an appropriate sense. This is discussed brieﬂy below. The interested reader should consult the extensive literature on ﬁltering theory for additional information, in particular, the literature on the Kalman–Bucy ﬁlter. In addressing optimal state estimation, noise with certain statistical properties is introduced in the model and an appropriate cost functional is set up that is then minimized. In the following discussion, we shall introduce some of the key equations of the Kalman–Bucy ﬁlter and we will point out the duality between the optimal control and estimation problems. We concentrate on

386

9 State Feedback and State Observers

the time-invariant case, although, as in the LQR control problem discussed earlier, more general results for the time-varying case do exist. We consider the linear time-invariant system x˙ = Ax + Bu + Γ w, y = Cx + v,

(9.69)

where w and v represent process and measurement noise terms. Both w and v are assumed to be white, zero-mean Gaussian stochastic processes; i.e., they are uncorrelated in time and have expected values E[w] = 0 and E[v] = 0. Let (9.70) E[wwT ] = W, E[vv T ] = V denote their covariances, where W and V are real, symmetric, and positive deﬁnite matrices, i.e., W = W T , W > 0, and V = V T , V > 0. Assume that the noise processes w and v are independent; i.e., E[wv T ] = 0. Also assume that the initial state x(0) of the plant is a Gaussian random variable of known mean, E[x(0)] = x0 , and known covariance, E[(x(0) − x0 )(x(0) − x0 )T ] = Pe0 . Assume also that x(0) is independent of w and v. Note that all these are typical assumptions made in practice. Consider now the estimator (9.57), namely, x ˆ˙ = Aˆ x + Bu + K(y − C x ˆ) = (A − KC)ˆ x + Bu + Ky,

(9.71)

and let (A, Γ W 1/2 , C) be controllable (-from-the-origin) and observable. It turns out that the error covariance E[(x − xˆ)(x − x ˆ)T ] is minimized when the ﬁlter gain is given by (9.72) K ∗ = Pe∗ C T V −1 , where Pe∗ denotes the symmetric, positive deﬁnite solution of the quadratic (dual) algebraic Riccati equation Pe AT + APe − Pe C T V −1 CPe + Γ W Γ T = 0.

(9.73)

Note that Pe∗ , which is in fact the minimum error covariance, is the positive semideﬁnite solution of the above Riccati equation if (A, Γ W 1/2 , C) is stabilizable and detectable. The optimal estimator is asymptotically stable. The above algebraic Riccati equation is the dual to the Riccati equation given in (9.33) for optimal control and can be obtained from (9.33) making use of the substitutions A → AT , B → C T , M → Γ T

and R → V, Q → W.

(9.74)

Clearly, methods that are analogous to the ones developed by solving the control Riccati equation (9.33) may be applied to solve the Riccati equation (9.71) in ﬁltering. These methods are not discussed here.

9.3 Linear State Observers

387

00 ,C = Example 9.22. Consider the system x˙ = Ax, y = Cx, where A = 10 1 [0, 1], and let Γ = , V = ρ > 0, W = 1. We wish to derive the optimal 0 ﬁlter gain K ∗ = Pe∗ C T V −1 given in (9.72). In this case, the Riccati equation (9.73) is precisely the Riccati equation of the control problem given in Example 9.14. The solution of this equation was determined to be √ √ 2 ρ ρ Pe∗ = √ √ . ρ 2ρ ρ

We note that this was expected, since our example was chosen to satisfy (9.74). Therefore, √ 1 ρ 0 1 = √ . K ∗ = Pe∗ 1 ρ 2ρ ρ ρ

9.3.4 Full-Order Observers: Discrete-Time Systems We consider systems described by equations of the form x(k + 1) = Ax(k) + Bu(k),

y = Cx(k) + Du(k),

(9.75)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×m , and D ∈ Rp×m . The construction of state estimators for discrete-time systems is mostly analogous to the continuous-time case, and the results that we established above for such systems are valid here as well, subject to obvious adjustments and modiﬁcations. There are, however, some notable diﬀerences. For example, in discrete-time systems, it is possible to construct a state estimator that converges to the true value of the state in ﬁnite time, instead of inﬁnite time as in the case of asymptotic state estimators. This is the estimator known as the deadbeat observer. Furthermore, in discrete-time systems it is possible to talk about current state estimators, in addition to prediction state estimators. In what follows, a brief description of the results that are analogous to the continuous-time case is given. Current estimators and deadbeat observers that are unique to the discrete-time case are discussed at greater length. Full-State Observers: The Identity Observer As in the continuous-time case, following (9.57) we consider systems described by equations of the form xˆ(k + 1) = Aˆ x(k) + Bu(k) + K[y(k) − yˆ(k)], where yˆ(k) C x ˆ(k) + Dx(k). This can also be written as

(9.76)

388

9 State Feedback and State Observers

x ˆ(k + 1) = (A − KC)ˆ x(k) + [B − KD, K]

u(k) . y(k)

(9.77)

It can be shown that the error e(k) x(k)− x ˆ(k) obeys the equation e(k+1) = (A − KC)e(k). Therefore, if the eigenvalues of A − KC are inside the open unit disk of the complex plane, then e(k) → 0 as k → ∞. There exists K so that the eigenvalues of A − KC can be arbitrarily assigned if and only if the pair (A, C) is observable (see Lemma 9.18). The discussion following Lemma 9.18 for the case when (A, C) is not completely observable, although detectable, is still valid. Also, the remarks on appropriate locations for the eigenvalues of A − KC and noise being the limiting factor in state estimators are also valid in the present case. Note that the latter point should seriously be considered when deciding whether to use the deadbeat observer described next. To balance the tradeoﬀs between speed of the estimator response and noise ampliﬁcation, one may formulate an optimal estimation problem as was done in the continuous-time case, the Linear Quadratic Gaussian (LQG) design being a common formulation. The Kalman ﬁlter (discrete-time case) that is based on the “current estimator” described below is such a quadratic estimator. The LQG optimal estimation problem can be seen to be the dual of the quadratic optimal control problem discussed in the previous section. As in the continuous-time case, optimal estimation in the discrete-time case will be discussed only brieﬂy as follows. First, however, several other related issues are addressed. Deadbeat Observer If the pair (A, C) is observable, it is possible to select K so that all the eigenvalues of A − KC are at the origin. In this case e(k) = x(k) − x ˆ(k) = (A − KC)k e(0) = 0, for some k ≤ n; i.e., the error will be identically zero within at most n steps. The minimum value of k for which (A − KC)k = 0 depends on the size of the largest block on the diagonal of the Jordan canonical form of A−KC. (Refer to the discussion on the modes of discrete-time systems in Subsection 3.5.5.) Example 9.23. Consider the system x(k + 1) = Ax(k), y(k) = Cx(k), where ⎤ ⎡ 0 21 010 ⎦ ⎣ A = 1 −1 0 , C = 011 0 00 is in observer form. We wish to design a deadbeat observer. It is rather easy to show (compare with Example 9.11) that ⎡ ⎡ ⎤⎤ 21 −1 0 T ⎣ ⎣ ⎦ ⎦ K = Adm − −1 0 , 1 −1 00

9.3 Linear State Observers

389

which was determined by taking the dual AD = AT , BD = C T in controller −1 T form, using FD = Bm [Adm − Am ] and K = −FD . T The matrix Adm consists of the second and third columns of a matrix ⎤ ⎡ 0×× Ad = ⎣ 1 × × ⎦ in observer (companion) form with all its eigenvalues at 0. 0×× ⎡ ⎤ 000 For Ad1 = ⎣ 1 0 0 ⎦, we have 010 ⎡⎡ ⎤ ⎡ ⎤⎤ ⎡ ⎤ 00 21 11 −1 0 K1 = ⎣⎣ 0 0 ⎦ − ⎣ −1 0 ⎦⎦ = ⎣ −1 0 ⎦ , 1 −1 10 00 −1 0 ⎡ ⎤ 000 and for Ad2 = ⎣ 1 0 0 ⎦, we obtain 000 ⎡⎡ ⎤ ⎡ ⎤⎤ ⎡ ⎤ 00 21 11 −1 0 K2 = ⎣⎣ 0 0 ⎦ − ⎣ −1 0 ⎦⎦ = ⎣ −1 0 ⎦ . 1 −1 00 00 00 ⎡ ⎤ 000 Note that A − K1 C = Ad1 , A2d1 = ⎣ 0 0 0 ⎦, and A3d1 = 0, and that A − 100 K2 C = Ad2 and A2d2 = 0. Therefore, for the observer gain K1 , the error e(k) in the deadbeat observer will become zero in n = 3 steps, since e(3) = (A − K1 C)3 e(0) = 0. For the observer gain K2 , the error e(k) in the deadbeat observer will become zero in 2 < n steps, since e(2) = (A − K2 C)2 e(0) = 0. The reader should determine the Jordan canonical forms of Ad1 and Ad2 and verify that the dimension of the largest block on the diagonal is 3 and 2, respectively. The comments in the discussion following Lemma 9.18 on taking K = 0 are valid in the discrete-time case as well. Also, the approach of determining the state instantaneously in the continuous-time case, using the derivatives of the input and output, corresponds in the discrete-time case to determining the state from current and future input and output values (see Exercise 5.12 in Chapter 5). This approach was in fact used to determine x(0) when studying observability in Section 5.4. The disadvantage of this method is that it requires future measurements to calculate the current state. This issue of using future or past measurements to determine the current state is elaborated upon next. Current Estimator The estimator (9.76) is called a prediction estimator . The state estimate x ˆ(k) is based on measurements up to and including y(k − 1). It is often of interest

390

9 State Feedback and State Observers

in applications to determine the state estimate x ˆ(k) based on measurements up to and including y(k). This may seem rather odd at ﬁrst; however, if the computation time required to calculate x ˆ(k) is short compared with the sample period in a sampled-data system, then it is certainly possible practically to determine the estimate x ˆ(k) before x(k + 1) and y(k + 1) are generated by the system. If this state estimate, which is based on current measurements of y(k), is to be used to control the system, then the unavoidable computational delays should be taken into consideration. Now let x ¯(k) denote the current state estimate based on measurements up through y(k). Consider the current estimator ˆ(k)), x ¯(k) = x ˆ(k) + Kc (y(k) − C x

(9.78)

x ˆ(k) = A¯ x(k − 1) + Bu(k − 1);

(9.79)

where i.e., x ˆ(k) denotes the estimate based on model prediction from the previous time estimate, x ¯(k − 1). Note that in (9.78), the error is y(k) − yˆ(k), where yˆ(k) = C x ˆ(k) (D = 0), for simplicity. Combining the above, we obtain u(k − 1) x ˆ(k) = (I − Kc C)A¯ x(k − 1) + [(I − Kc C)B, −Kc ] . (9.80) y(k) The relation to the prediction estimator (9.76) can be seen by substituting (9.78) into (9.79) to obtain x ˆ(k + 1) = Aˆ x(k) + Bu(k) + AKc [y(k) − C x ˆ(k)].

(9.81)

Comparison with the prediction estimator (9.76) (with D = 0) shows that it is clear that if (9.82) K = AKc , then (9.81) is indeed the prediction estimator, and the estimate x ˆ(k) used in the current estimator (9.78) is indeed the prediction state estimate. In view of this, we expect to obtain for the error eˆ(k) = x(k) − x ˆ(k) the diﬀerence equation e(k). (9.83) eˆ(k + 1) = (A − AKc C)ˆ To determine the error e¯(k) = x(k) − x ¯(k) we note that e¯(k) = eˆ(k) − (¯ x(k) − x ˆ(k)). Equation (9.78) now implies that x ¯(k) − xˆ(k) = Kc Ce(k). Therefore, e(k). e¯(k) = (I − Kc C)ˆ

(9.84)

This establishes the relationship between errors in current and prediction estimators. Premultiplying (9.81) by I − Kc C (assuming |I − Kc C| = 0), we obtain e(k), e¯(k + 1) = (A − Kc CA)¯

(9.85)

9.3 Linear State Observers

391

which is the current estimator error equation. The gain Kc is chosen so that the eigenvalues of A − Kc CA are within the open unit disk of the complex plane. The pair (A, CA) must be observable for arbitrary eigenvalue assignment. Note that the two error equations (9.83) and (9.85) have identical eigenvalues. Example 9.24. Consider the system x(k + 1) = Ax(k), y(k) = Cx(k), where 0 −2 A= , C = [0, 1], which is in observer form (see also Example 9.20). 1 −2 We wish to design a current estimator. In view of the error equation (9.85), we consider s0 0 −2 k0 − − det(sI − (A − Kc CA)) = det [1 − 2] 0s 1 −2 k1 s + k0 2 − 2k0 = det k1 − 1 s + 2 − 2k1 = s2 + s(2 − 2k1 + k0 ) + (2 − 2k1 ) = s2 + d1 s + d0 = αd (s), a desired polynomial, from which Kc = [k0 , k1 ]T = [d1 − d0 , 12 (2 − d0 )]T . Note that AKc = [d0 − 2, d1 − 2]T = K, found in Example 9.20, as noted in (9.82). The current estimator (9.80) is now given by x ¯(k) = (A − Kc CA)¯ x(k − 1) − Kc CBu(k − 1) + Kc y(k), or −k0 −2 + 2k0 k x¯(k) = x ¯(k − 1) + 0 y(k). 1 − k1 −2 + 2k1 k1

Partial or Linear Functional State Observers The problem of estimating a linear function of the state, T x(k), T ∈ Rn˜ ×n , where n ˜ ≤ n, using a prediction estimator, is completely analogous to the continuous-time case. 9.3.5 Reduced-Order Observers: Discrete-Time Systems It is possible to estimate the full state x(k) using an estimator of order n − p, where p = rank C. If a prediction estimator is used for that part of the state that needs to be estimated, then the problem in the discrete-time case is completely analogous to the continuous-time case, discussed before. 9.3.6 Optimal State Estimation: Discrete-Time Systems The formulation of the Kalman ﬁltering problem in discrete-time is analogous to the continuous-time case.

392

9 State Feedback and State Observers

Consider the linear time-invariant system given by x(k + 1) = Ax(k) + Bu(k) + Γ w(k),

y(k) = Cx(k) + v,

(9.86)

where the process and measurement noises w, v are white, zero-mean Gaussian stochastic processes; i.e., they are uncorrelated in time with E[w] = 0 and E[v] = 0. Let the covariances be given by E[wwT ] = W,

E[vv T ] = V,

(9.87)

where W = W T , W > 0 and V = V T , V > 0. Assume that w, v are independent, that the initial state x(0) is Gaussian of known mean (E[x(0)] = x0 ), that E[(x(0) − x0 )(x(0) − x0 )T ] = Pe0 , and that x(0) is independent of w and v. Consider now the current estimator (9.76), namely, ˆ(k)], x ¯(k) = xˆ(k) + Kc [y(k) − C x where x ˆ(k) = A¯ x(k − 1) + Bu(k − 1) and x ˆ(k) denotes the prior estimate of the state at the time of a measurement. It turns out that the state error covariance is minimized when the ﬁlter gain is (9.88) Kc∗ = Pe∗ C T (CPe∗ C T + V )−1 , where Pe∗ is the unique, symmetric, positive deﬁnite solution of the Riccati equation Pe = A[Pe − Pe C T [CPe C T + V ]−1 CPe ]AT + Γ W Γ T .

(9.89)

It is assumed here that (A, Γ W 1/2 , C) is reachable and observable. This algebraic Riccati equation is the dual to the Riccati equation (9.53) that arose in the discrete-time LQR problem and can be obtained by substituting A → AT , B → C T , M → Γ T

and R → V, Q → W.

(9.90)

It is clear that, as in the case of the LQR problem, the solution of the algebraic Riccati equation can be determined using the eigenvectors of the (dual) Hamiltonian. The ﬁlter derived above is called the discrete-time Kalman ﬁlter. It is based on the current estimator (9.78). Note that AKc yields the gain K of the prediction estimator [see (9.82)].

9.4 Observer-Based Dynamic Controllers State estimates, derived by the methods described in the previous section, may be used in state feedback control laws to compensate given systems. This section addresses this topic.

9.4 Observer-Based Dynamic Controllers

393

In Section 9.2, the linear state feedback control law was introduced. There it was implicitly assumed that the state vector x(t) is available for measurement. The values of the states x(t) for t ≥ t0 were fed back and used to generate a control input in accordance with the relation u(t) = F x(t) + r(t). There are cases, however, when it may be either impossible or impractical to measure the states directly. This has provided the motivation to develop methods for estimating the states. Some of these methods were considered in Section 9.3. A natural question that arises at this time is the following: What would happen to system performance if, in the control law u = F x + r, the state estimate x ˆ were used in place of x as in Figure 9.4? How much, if any, would the compensated system response deteriorate? What are the diﬃculties in designing such estimator-(observer-)based linear state feedback controllers? These questions are addressed in this section. Note that observer-based controllers of the type described in the following are widely used. r

u

+

System

y

+

F

State Observer ^ x

Figure 9.4. Observer-based controller

In the remainder of this section we will concentrate primarily on fullstate/full-order observers and (static) linear state feedback, as applied to linear time-invariant systems. The analysis of partial-state and/or reduced-order observers with static or dynamic state feedback is analogous; however, it is more complex. In this section, continuous-time systems are addressed. The discrete-time case is completely analogous and will be omitted. 9.4.1 State-Space Analysis We consider systems described by equations of the form x˙ = Ax + Bu,

y = Cx + Du,

(9.91)

where A ∈ Rn×n , B ∈ Rn×m , C ∈ Rp×n , and D ∈ Rp×m . For such systems, we determine an estimate x ˆ(t) ∈ Rn of the state x(t) via the (full-state/fullorder) state observer (9.57) given by x ˆ˙ = Aˆ x + Bu + K(y − yˆ)

u = (A − KC)ˆ x + [B − KD, K] , y

z = xˆ,

(9.92)

394

9 State Feedback and State Observers

where yˆ = C x ˆ + Du. We now compensate the system by state feedback using the control law u = Fx ˆ + r, (9.93) where x ˆ is the output of the state estimator and we wish to analyze the behavior of the compensated system. To this end we ﬁrst eliminate y in (9.92) to obtain x ˆ˙ = (A − KC)ˆ x + KCx + Bu. (9.94) The state equations of the compensated system are then given by x˙ = Ax + BF x ˆ + Br, ˙x ˆ = KCx + (A − KC + BF )ˆ x + Br,

(9.95)

and the output equation assumes the form y = Cx + DF x ˆ + Dr,

(9.96)

where u was eliminated from (9.91) and (9.94), using (9.93). Rewriting in matrix form, we have x˙ A BF x B = + r, KC A − KC + BF ˆ x B x ˆ˙ x y = [C, DF ] + Dr, (9.97) xˆ which is a representation of the compensated closed-loop system. Note that (9.97) constitutes a 2nth-order system. Its properties are more easily studied if an appropriate similarity transformation is used to simplify the representation. Such a transformation is given by x I 0 x x P = = , (9.98) xˆ I −I x ˆ e where the error e(t) = x(t) − x ˆ(t). Then the equivalent representation is x˙ A + BF −BF x B = + r, e˙ 0 A − KC e 0 x + Dr. (9.99) y = [C + DF, −DF ] e It is now quite clear that the closed-loop system is not fully controllable with respect to r (this can be explained in view of Subsection 6.2.1). In fact, e(t) does not depend on r at all. This is of course as it should be, since the error e(t) = x(t) − x ˆ(t) should converge to zero independently of the externally applied input r.

9.4 Observer-Based Dynamic Controllers

395

The closed-loop eigenvalues are the roots of the polynomial |sIn − (A + BF )||sIn − (A − KC)|.

(9.100)

Recall that the roots of |sIn − (A + BF )| are the eigenvalues of A + BF that can arbitrarily be assigned via F provided that the pair (A, B) is controllable. These are in fact the closed-loop eigenvalues of the system when the state x is available and the linear state feedback control law u = F x + r is used (see Section 9.2). The roots of |sIn −(A−KC)| are the eigenvalues of (A−KC) that can arbitrarily be assigned via K provided that the pair (A, C) is observable. These are the eigenvalues of the estimator (9.92). The above discussion points out that the design of the control law (9.93) can be carried out independently of the design of the estimator (9.92). This is referred to as the Separation Property and is generally not true for more complex systems. The separation property indicates that the linear state feedback control law may be designed as if the state x were available and the eigenvalues of A + BF are assigned at appropriate locations. The feedback matrix F can also be determined by solving an optimal control problem (LQR). If state measurements are not available for feedback, a state estimator is employed. The eigenvalues of a full-state/full-order estimator are given by the eigenvalues of A−KC. These are typically assigned so that the error e(t) = x(t)− x ˆ(t) becomes adequately small in a short period of time. For this reason, the eigenvalues of A − KC are (empirically) taken to be about 6 to 10 times further away from the imaginary axis (in the complex plane, for continuous-time systems) than the eigenvalues of A + BF . The estimator gain K may also be determined by solving an optimal estimation problem (the Kalman ﬁlter). In fact, under the assumption of Gaussian noise and initial conditions given earlier (see Section 9.3), F and K can be found by solving, respectively, optimal control and estimation problems with quadratic performance criteria. In particular, the deterministic LQR problem is ﬁrst solved to determine the optimal control gain F ∗ , and then the stochastic Kalman ﬁltering problem is solved to determine the optimal ﬁlter gain K ∗ . The separation property (i.e., Separation Theorem—see any optimal control textbook) guarantees that the overall (state estimate feedback) Linear Quadratic Gaussian (LQG) control ˆ(t) minimizes design is optimal in the sense that the control law u∗ (t) = F ∗ x ∞ the quadratic performance index E[ 0 (z T Qz +uT Ru)dt]. As was discussed in previous sections, the gain matrices F ∗ and K ∗ are evaluated in the following manner. Consider x˙ = Ax + Bu + Γ w, y = Cx + v, z = M x (9.101) with E{wwT } = W > 0 and E[vv T ] = V > 0 and ∞with Q > 0, R > 0 denoting the matrix weights in the performance index E[ 0 (z T Qx+uT Ru)dt]. Assume that both (A, B, Q1/2 M ) and (A, Γ W 1/2 , C) are controllable and observable. Then the optimal control law is given by u∗ (t) = F ∗ x ˆ(t) = −R−1 B T Pc∗ x ˆ(t),

(9.102)

396

9 State Feedback and State Observers

where Pc∗ > 0 is the solution of the algebraic Riccati equation (9.33) given by AT Pc + Pc A − Pc BR−1 B T Pc + M T QM = 0.

(9.103)

The estimate x ˆ is generated by the optimal estimator

where

x ˆ˙ = Aˆ x + Bu + K ∗ (y − C x ˆ),

(9.104)

K ∗ = Pc∗ C T V −1 ,

(9.105)

in which Pe∗ > 0 is the solution to the dual algebraic Riccati equation (9.71) given by (9.106) Pe AT + APe − Pe C T V −1 CPe + Γ W Γ T = 0. Designing observer-based dynamic controllers by the LQG control design method has been quite successful, especially when the plant model is accurately known. In this approach the weight matrices Q, R and the covariance matrices W , V are used as design parameters. Unfortunately, this method does not necessarily lead to robust designs when uncertainties are present. This limitation has led to an enhancement of this method, called the LQR/LTR (Loop Transfer Recovery) method, where the design parameters W and V are selected (iteratively) so that the robustness properties of the LQR design are recovered. Finally, as mentioned earlier, the discrete-time case is analogous to the continuous-time case and its discussion will be omitted. Example 9.25. Consider the system x˙ = Ax + Bu, y = Cx, where ⎡ ⎤ ⎡ ⎤ 01 0 01 A = ⎣ 0 0 1 ⎦ , B = ⎣ 1 1 ⎦ , C = [1, 0, 0]. 0 2 −1 00 This is a controllable and observable but unstable system with eigenvalues of A equal to 0, −2, 1. A linear state feedback control u = F x + r was derived in Example 9.11 to assign the eigenvalues of A+BF at −2, −1±j. An appropriate F to accomplish this was shown to be 2 −1 −2 F = . −2 0 1/2 If the state x(t) is not available for measurement, then an estimate xˆ(t) is used instead; i.e., the control law u = F x ˆ + r is employed. In Example 9.19, a full-order/full-state observer, given by u ˙x ˆ = (A − KC)ˆ x + [B, K] , y

9.4 Observer-Based Dynamic Controllers

397

was derived [see (9.58)] with the eigenvalues of A − KC determined as the roots of the polynomial αd (s) = s3 + d2 s2 + d1 s + d0 . It was shown that the (unique) K is in this case K = [d2 − 1, d1 − d2 + 3, d0 − d1 + 3d2 − 5]T , and the observer is given by ⎤ ⎤ ⎡ ⎡ 1 0 1 − d2 01 d2 − 1 u ˙x ⎦ ⎦ ⎣ ⎣ 0 1 x −d1 + d2 − 3 d1 − d2 + 3 ˆ= ˆ+ 1 1 . y −d0 + d1 − 3d2 + 5 2 −1 0 0 d0 − d1 + 3d2 − 5 Using the estimate x ˆ in place of the control state x in the feedback control law causes some deterioration in the behavior of the system. This deterioration can be studied experimentally. (See the next subsection for analytical results.) To this end, let the eigenvalues of the observer be at, say, −10, −10, −10; let ˆ(0) = [0, 0, 0]T ; plot x(t), x ˆ(t), and e(t) = x(t) − xˆ(t); x(0) = [1, 1, 1]T and x and compare these with the corresponding plots of Example 9.11, where no observer was used. Repeat the above with observer eigenvalues closer to the eigenvalues of A + BF (say, at −2, −1 ± j) and also further away. In general the faster the observer, the faster e(t) → 0, and the smaller the deterioration of response; however, in this case, care should be taken if noise is present in the system.

9.4.2 Transfer Function Analysis For the compensated system (9.99) [or (9.97)], the closed-loop transfer function T (s) between y and r is given by y˜(s) = T (s)˜ r(s) = [(C + DF )[sI − (A + BF )]−1 B + D]˜ r (s),

(9.107)

where y˜(s) and r˜(s) denote the Laplace transforms of y(t) and r(t), respectively. The function T (s) was found from (9.99), using the fact that the uncontrollable part of the system does not appear in the transfer function (see Section 7.2). Note that T (s) is the transfer function of {A+BF, B, C+DF, D}; i.e., T (s) is precisely the transfer function of the closed-loop system HF (s) when no state estimation is present (see Section 9.2). Therefore, the compensated system behaves to the outside world as if there were no estimator present. Note that this statement is true only after suﬃcient time has elapsed from the initial time, allowing the transients to become negligible. (Recall what the transfer function represents in a system.) Speciﬁcally, taking Laplace transforms in (9.99) and solving, we obtain x ˜(s) [sI−(A+BF )]−1 −[sI−(A+BF )]−1 BF [sI−(A−KC)]−1 x(0) −1 e˜(s) = e(0) 0 [sI−(A+BF )] −1 [sI−(A+BF )] B r˜(s), + 0 (s) + D˜ r(s). (9.108) y˜(s) = [C + DF, −DF ] xe˜˜(s)

398

9 State Feedback and State Observers

Therefore, y˜(s) = (C + DF )[sI − (A + BF )]−1 x(0) − [(C + DF )[sI − (A + BF )]−1 BF [sI − (A − KC)]−1 + DF [sI − (A + BF )]−1 ]e(0) + T (s)˜ r(s),

(9.109)

which indicates the eﬀects of the estimator on the input–output behavior of the closed-loop system. Notice how the initial conditions for the error e(0) = x(0) − xˆ(0) inﬂuence the response. Speciﬁcally, when e(0) = 0, its eﬀect can be viewed as a disturbance that will become negligible at steady state. The speed by which the eﬀect of e(0) on y will diminish depends on the location of the eigenvalues of A + BF and A − KC, as can be easily seen from relation (9.109). Two-Input Controller In the following discussion, we will ﬁnd it of interest to view the observer-based controller discussed previously as a one-vector output (u) and a two-vector input (y and r) controller. In particular, from x ˆ˙ = (A − KC)ˆ x + (B − KD)u + Ky given in (9.92) and u = F x ˆ + r given in (9.93), we obtain the equations y ˙x , ˆ = (A − KC + BF − KDF )ˆ x + [K, B − KD] r u = Fx ˆ + r.

(9.110)

This is the description of the (nth order) controller shown in Figure 9.4. The state x ˆ is of course the state of the estimator, and the transfer function between u and y, r is given by u ˜(s) = F [sI − (A − KC + BF − KDF )]−1 K y˜(s) r (s). (9.111) + [F [sI − (A − KC + BF − KDF )]−1 (B − KD) + I]˜ If we are interested only in “loop properties,” then r can be taken to be zero; in which case, (9.111) (for r = 0) yields the output feedback compensator, which accomplishes the same control objectives (that are typically only “loop properties”) as the original observer-based controller. This fact is used in the LQG/LTR design approach. When r = 0, (9.111) is not appropriate for the realization of the controller since the transfer function from r, which must be outside the loop, may be unstable. Note that an expression for this controller that leads to a realization of a stable closed-loop system is given by y˜(s) −1 (9.112) u ˜(s) = [F [sI −(A−KC +BF −KDF )] [K, B−KD]+[0, I]] r˜(s) (see Figure 9.5). This was also derived from (9.110). The stability of general two-input controllers (with two degrees of freedom) is discussed at length in Chapter 10.

9.4 Observer-Based Dynamic Controllers

399

r System

Controller

Figure 9.5. Two-input controller

At this point, we ﬁnd it of interest to determine the relationship of the observer-based controller and the conventional block controller conﬁguration of Figure 9.6. Here, the requirement is to maintain the same transfer functions between inputs y and r and output u. (For further discussion of stability and attainable response maps in system controlled by output feedback controllers, refer to Chapter 10.) We proceed by considering once more (9.92) and (9.93) and by writing u(s) u ˜(s) = F [sI − (A − KC)]−1 (B − KD)˜ ˜(s) + Gy y˜(s) + r˜(s). + F [sI − (A − KC)]−1 K y˜(s) + r˜(s) = Gu u

r

+

Σ

( I – Gu ) –1

u

y System

+

Gy

Figure 9.6. Conventional block controller conﬁguration

This yields

u ˜(s) = (I − Gu )−1 [Gy y˜(s) + r˜(s)]

(9.113)

(see Figure 9.6). Notice that Gy = F [sI − (A − KC)]−1 K;

(9.114)

i.e., the controller in the feedback path is stable. The matrix (I − Gu )−1 is not necessarily stable; however, it is inside the loop and therefore the internal stability of the compensated system is preserved. Comparing with (9.111), we obtain (I − Gu )−1 = F [sI − (A − KC + BF − KDF )]−1 (B − KD) + I.

(9.115)

Also, as expected, we have (I − Gu )−1 Gy = F [sI − (A − KC + BF − KDF )]−1 K.

(9.116)

These relations could have been derived directly as well by the use of matrix identities; however, such derivation is quite involved.

400

9 State Feedback and State Observers

0 −2 , 1 −2

Example 9.26. For the system x˙ = Ax + Bu, y = Cx with A = 0 s B = , and C = [0, 1], we have H(s) = C(sI − A)−1 B = s2 +2s+2 . In 1 Example 9.20, it was shown that the gain matrix K = [d0 − 2, d1 − 2]T assigns 2 the eigenvalues of the asymptotic observer(of A−KC) at the roots of s +d1 s+ s d0 . It is straightforward to show that d0 . In fact sI − (A − KC) = −1 s + d1 system (of F = [ 12 a0 − 1, 2 − a1 ] will assign the eigenvalues of the closed-loop s 2 2 A+BF ) at the roots of s +a1 s+a0 . Indeed, sI −(A+BF ) = . − 12 a0 s + a1 Now in (9.113) we have Gy (s) = F (sI − (A − KC))−1 K =

s((d0 −2)( 12 a0 −1)+(d1 −2)(2−a1 ))+((d0 −d1 )(a0 −2)+(d0 −2)(2−a1 )) , s2 +d1 s+d0

Gu (s) = F (sI − (A − KC))−1 B = (1 − Gu )−1 =

s(2−a1 )−d0 ( 12 a0 −1) , s2 +d1 s+d0

s2 +d1 s+d0 . s2 +s(d1 +a1 −2)+ 12 a0 d0

9.5 Summary and Highlights Linear State Feedback •

Given x˙ = Ax + Bu, y = Cx + Du and the linear state feedback control law u = F x + r, the closed-loop system is x˙ = (A + BF )x + Br,

•

y = (C + DF )x + Dr.

If u were implemented via open-loop control, it would be given by uˆ = F [sI − (A + BF )]−1 x(0) + [I − F (sI − A)−1 B]−1 rˆ.

•

•

(9.3)

(9.4)

The eigenvalues of A+BF can be assigned to arbitrary real and/or complex conjugate locations by selecting F if and only if the system [or (A, B)] is controllable. The uncontrollable eigenvalues of (A, B) cannot be shifted (see Theorem 9.2 and Lemma 9.3). Methods to select F to assign the closed-loop eigenvalues in A+BF include 1. the direct method (see (9.12)), and

9.5 Summary and Highlights

401

2. using controller forms (see (9.20 and (9.24)). Controller forms are used to derive Ackermann’s formula (m = 1) F = −eTn C −1 αd (A),

(9.21)

where en = [0, . . . , 0, 1]T , C = [B, . . . , An−1 B] is the controllability matrix and αd (s) is the desired closed-loop characteristic polynomial (its roots are the desired eigenvalues). 3. Assigning eigenvalues and eigenvectors (see Theorem 9.12). The ﬂexibility in choosing F that assigns the n closed-loop eignvalues (when m > 1) is expressed in terms of desired closed-loop eigenvectors that can be partially assigned, F V = W,

•

(9.29)

where V [M1 a1 , . . . , Mn an ] and W [D1 a1 , . . . , Dn an ] uniquely specify F as the solution to these n linearly independent equations. When sj are distinct, the n vectors Mj aj , j = 1, . . . , n, are linearly independent for almost any nonzero aj , and V has full rank. Optimal Control Linear Quadratic Regulator. Given x˙ = Ax + Bu, z = M x, ﬁnd u(t) that minimizes the quadratic cost

∞ J(u) = [z T (t)Qz(t) + uT (t)Ru(t)]dt. (9.31) 0

Under controllability and observability conditions, the solution is unique and it is given as a linear state feedback control law u∗ (t) = F ∗ x(t) = −R−1 B T Pc∗ x(t),

(9.32)

where Pc∗ is the symmetric, positive deﬁnite solution of the algebraic Riccati equation AT Pc + Pc A − Pc BR−1 B T Pc + M T QM = 0.

•

(9.33)

The corresponding discrete-time case optimal control is described in (9.51), (9.52), and (9.53). The closed-loop transfer function Hf (s) is given by HF (s) = (C + DF )[sI − (A + BF )]−1 B + D = [C(sI − A)−1 B + D][I − F (sI − A)−1 B]−1 = H(s)[I − F (sI − A)−1 B]−1 = H(s)[F (sI − (A + BF ))−1 B + I]. See also (9.42) and (9.45). Also HF (s) = N (s)DF−1 (s) = [N (s)D−1 (s)][D(s)DF−1 (s)] = H(s)[D(s)DF−1 (s)].

(9.44)

402

9 State Feedback and State Observers

Linear State Observers •

Given x˙ = Ax + Bu, y = Cx + Du, the Luenberger observer is x ˆ˙ = Aˆ x + Bu + K(y − yˆ),

(9.57)

where yˆ = C yˆ + D or

u xˆ˙ = (A − KC)ˆ x + [B − KD, K] , y

•

•

(9.58)

where K is chosen so that all the eigenvalues of A − KC have negative real parts. Then the error e(t) = x(t) − xˆ(t) will go to zero asymptotically. The eigenvalues of A − KC can be assigned to arbitrary real and/or complex conjugate locations by selecting K if and only if the system [or (A, C)] is observable. The unobservable eigenvalues of (A, C) cannot be shifted. This is the dual problem to the control problem of assigning eigenvalues in A + BF , and the same methods can be used (see Lemma 9.18). Optimal State Estimation. Consider x˙ = Ax + Bu + Γ w, y = Cx + v, where w, v are process and measurement noise. Let the state estimator be x ˆ˙ = Aˆ x + Bu + K(y − C x ˆ) = (A − KC)ˆ x + Bu + Ky,

(9.117) (9.71)

and consider minimizing the error covariance E[(x − x ˆ)(x − x ˆ)T ]. Under certain controllability and observability conditions, the solution is unique and it is given by (9.72) K ∗ = Pe∗ C T V −1 , where Pe∗ is the symmetric, positive deﬁnite solution of the quadratic (dual) algebraic Riccati equation Pe AT + APe − Pe C T V −1 CPe + Γ W Γ T = 0. •

(9.73)

This problem is the dual to the Linear Quadratic Regulator problem. The discrete-time case is analogous to the continuous-time case [see (9.76)]. The current estimator is given in (9.78)–(9.80). The optimal current estimator is given by (9.88) and (9.89).

Observer-Based Dynamic Controllers •

Given x˙ = Ax + Bu, y = Cx + Du with the state feedback u = F x + r, if the state is estimated via a Luenberger observer, then the closed-loop system is x˙ A + BF −BF x B = + r, (9.118) e˙ 0 A − KC e 0 x y = [C + DF, −DF ] + Dr. (9.99) e The error e = x − x ˆ.

9.6 Notes

• • •

403

The design of the control law (F ) can be carried out independently of the design of the estimator (K) [see (9.101)–(9.106]. (Separation property) The compensated system behaves to the outside world as if there were no estimator present—after suﬃcient time so the transients have become negligible [see (9.109)]. The observer based dynamic controller is a special case of a two degrees of freedom controller [see (9.113)–(9.115)].

9.6 Notes The fact that if a system is (state) controllable, then all its eigenvalues can arbitrarily be assigned by means of linear state feedback has been known since the 1960s. Original sources include Rissanen [20], Popov [18], and Wonham [24]. (See also remarks in Kailath [11, pp. 187, 195].) The present approach for eigenvalue assignment via linear state feedback, using the controller form, follows the development in Wolovich [23]. Ackermann’s formula ﬁrst appeared in Ackermann [2]. The development of the eigenvector formulas for the feedback matrix that assign all the closed-loop eigenvalues and (in part) the corresponding eigenvectors follows Moore [17]. The corresponding development that uses (A, B) in controller (companion) form and polynomial matrix descriptions follows Antsaklis [4]. Related results on static output feedback and on polynomial and rational matrix interpolation can be found in Antsaklis and Wolovich [5] and Antsaklis and Gao [6]. Note that the ﬂexibility in assigning the eigenvalues via state feedback in the multi-input case can be used to assign the invariant polynomials of sI −(A+BF ); conditions for this are given by Rosenbrock [21]. The Linear Quadratic Regulator (LQR) problem and the Linear Quadratic Gaussian (LQG) problem have been studied extensively, particularly in the 1960s and early 1970s. Sources for these topics include the books by Anderson and Moore [3], Kwakernaak and Sivan [12], Lewis [13], and Dorato et al. [10]. Early optimal control sources include Athans and Falb [7] and Bryson and Ho [9]. A very powerful idea in optimal control is the Principle of Optimality, Bellman [8], which can be stated as follows: “An optimal trajectory has the property that at any intermediate point, no matter how it was reached, the remaining part of a trajectory must coincide with an optimal trajectory, computed from the intermediate point as the initial point.” For historical remarks on this topic, refer, e.g., to Kailath [11, pp. 240–241]. The most inﬂuential work on state observers is the work of Luenberger. Although the asymptotic observer presented here is generally attributed to him, Luenberger’s Ph.D. thesis work in 1963 was closer to the reduced-order observer presented above. Original sources on state observers include Luenberger [14], [15], and [16]. For an extensive overview of observers, refer to the book by O’Reilly [19].

404

9 State Feedback and State Observers

When linear quadratic optimal controllers and observers are combined in control design, a procedure called LQG/LTR (Loop Transfer Recovery) is used to enhance the robustness properties of the closed-loop system. For a treatment of this procedure, see Stein and Athans [22] and contemporary textbooks on multivariable control.

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. J. Ackermann, “Der Entwurf linearer Regelungssysteme im Zustandsraum,” Regelungstechnik und Prozessdatenverarbeitung, Vol. 7, pp. 297–300, 1972. 3. B.D.O. Anderson and J.B. Moore, Optimal Control. Linear Quadratic Methods, Prentice-Hall, Englewood, Cliﬀs, NJ, 1990. 4. P.J. Antsaklis, “Some new matrix methods applied to multivariable system analysis and design,” Ph.D. Dissertation, Brown University, Providence, RI, May 1976. 5. P.J. Antsaklis and W.A. Wolovich, “Arbitrary pole placement using linear output feedback compensation,” Int. J. Control, Vol. 25, No. 6, pp. 915–925, 1977. 6. P.J. Antsaklis and Z. Gao, “Polynomial and rational matrix interpolation: theory and control applications,” Int. J. Control, Vol. 58, No. 2, pp. 349–404, August 1993. 7. M. Athans and P.L. Falb, Optimal Control, McGraw-Hill, New York, NY, 1966. 8. R. Bellman, Dynamic Programming, Princeton University Press, Princeton, NJ, 1957. 9. A.E. Bryson and Y.C. Ho, Applied Optimal Control, Holsted Press, New York, NY, 1968. 10. P. Dorato, C. Abdallah, and V. Cerone, Linear-Quadratic Control: An Introduction, Prentice-Hall, Englewood Cliﬀs, NJ, 1995. 11. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 12. H. Kwakernaak and R. Sivan, Linear Optimal Control Systems, Wiley, New York, NY, 1972. 13. F.L. Lewis, Optimal Control, Wiley, New York, NY, 1986. 14. D.G. Luenberger, “Observing the state of a linear system,” IEEE Trans. Mil. Electron, Vol. MIL-8, pp. 74–80, 1964. 15. D.G. Luenberger, “Observers for multivariable systems,” IEEE Trans. Auto. Control, Vol. AC-11, pp. 190–199, 1966. 16. D.G. Luenberger, “An introduction to observers,” IEEE Trans. Auto. Control, Vol. AC-16, pp. 596–603, Dec. 1971. 17. B.C. Moore, “On the ﬂexibility oﬀered by state feedback in multivariable systems beyond closed loop eigenvalue assignment,” IEEE Trans. Auto. Control, Vol. AC-21, pp. 689–692, 1976; see also Vol. AC-22, pp. 140–141, 1977 for the repeated eigenvalue case. 18. V.M. Popov, “Hyperstability and optimality of automatic systems with several control functions,” Rev. Roum. Sci. Tech. Ser. Electrotech Energ., Vol. 9, pp. 629–690, 1964. See also V.M. Popov, Hyperstability of Control Systems, Springer-Verlag, New York, NY, 1973. 19. J. O’Reilly, Observers for Linear Systems, Academic Press, New York, NY, 1983.

Exercises

405

20. J. Rissanen, “Control system synthesis by analogue computer based on the generalized linear feedback concept,” in Proc. Symp. Analog Comp. Applied to the Study of Chem. Processes, pp. 1–13, Intern. Seminar, Brussels, 1960. Presses Acad´emiques Europ´eennes, Bruxelles, 1961. 21. H.H. Rosenbrock, State-Space and Multivariable Theory, Wiley, New York, NY, 1970. 22. G. Stein and M. Athans, “The LQG/LTR procedure for multivariable feedback control design,” IEEE Trans. Auto. Control, Vol. AC-32, pp. 105–114, February, 1987. 23. W.A. Wolovich, Linear Multivariable Systems, Springer-Verlag, New York, NY, 1974. 24. W.M. Wonham, “On pole assigment in multi-input controllable linear systems,” IEEE Trans. Auto. Control, Vol. AC-12, pp. 660–665, 1967.

Exercises 9.1. Consider the system x˙ = Ax + Bu, where A = 1 1 B= with u = F x. −0.25 0.75

−0.01 0 0 −0.02

and

(a) Verify that the three diﬀerent state feedback matrices given by −1.1 −3.7 0 0 −0.1 0 F1 = , F2 = , F3 = 0 0 −1.1 1.2333 0 −0.1 all assign the closed-loop eigenvalues at the same locations, namely, at −0.1025 ± j0.04944. Note that in the ﬁrst control law (F1 ) only the ﬁrst input is used, whereas in the second law (F2 ), only the second input is used. For all three cases, plot x(t) = [x1 (t), x2 (t)]T when x(0) = [0, 1]T and comment on your results. This example demonstrates how diﬀerent the responses can be for diﬀerent designs even though the eigenvalues of the compensated system are at the same locations. (b) Use the eigenvalue/eigenvector assignment method to characterize all F that assign the closed-loop eigenvalues at −0.1025 ± j0.04944. Show how to select the free parameters to obtain F1 , F2 , and F3 above. What are the closed-loop eigenvectors in these cases? 9.2. For the system x˙ = Ax + Bu with A ∈ Rn×n and B ∈ Rn×m , where (A, B) is controllable and m > 1, choose u = F x as the feedback control law. It is possible to assign all eigenvalues of A + BF by ﬁrst reducing this problem to the case of eigenvalue assignment for single-input systems (m = 1). This is accomplished by ﬁrst reducing the system to a single-input controllable system. We proceed as follows. Let F = g · f , where g ∈ Rm and f T ∈ Rn are vectors to be selected. Let g be chosen such that (A, Bg) is controllable. Then f in

406

9 State Feedback and State Observers

A + BF = A + (Bg)f can be viewed as the state feedback gain vector for a single-input controllable system (A, Bg), and any of the single-input eigenvalue assignment methods can be used to select f so that the closed-loop eigenvalues are at desired locations. The only question that remains to be addressed is whether there exists g such that (A, Bg) is controllable. It can be shown that if (A, B) is controllable and A is cyclic, then almost any g ∈ Rm will make (A, Bg) controllable. (A matrix A is cyclic if and only if its characteristic and minimal polynomials are equal.) In the case when A is not cyclic, it can be shown that if (A, B, C) is controllable and observable, then for almost any real output feedback gain matrix H, A + BHC is cyclic. So initially, by an almost arbitrary choice of H or F = HC, the matrix A is made cyclic, and then by employing a g, (A, Bg) is made controllable. The state feedback vector gain f is then selected so that the eigenvalues are at desired locations. Note that F = gf is always a rank one matrix, and this restriction on F reduces the applicability of the method when requirements in addition to eigenvalue assignment are to be met. (a) For A, B as in Exercise 9.4, use the method described above to determine F so that the closed-loop eigenvalues are at −1 ± j and −2 ± j. Comment on your choice for g. 01 10 (b) For A = and B = , characterize all g such that the closed11 01 loop eigenvalues are at −1. 9.3. Consider the system x(k + 1) = Ax(k) + Bu(k), where ⎤ ⎡ ⎤ ⎡ 00 1 40 A = ⎣ 2 −1 0 ⎦ , B = ⎣ 1 0 ⎦ . 0 01 −1 1 Determine a linear state feedback control law u(k) = F x(k) such that all the eigenvalues of A + BF are located at the origin. To accomplish this, use (a) reduction to a single-input controllable system, (b) the controller form of (A, B), (c) det(zI − (A + BF )) and the resulting nonlinear system of equations. In each case, plot x(k) with x(0) = [1, 1, 1]T and comment on your results. In how many steps does your compensated system go to the zero state? 9.4. For the system x˙ = Ax + Bu, where ⎡ ⎤ ⎡ ⎤ 01 00 10 ⎢0 0 1 0⎥ ⎢0 0⎥ ⎥ ⎢ ⎥ A=⎢ ⎣0 0 0 1⎦, B = ⎣0 0⎦, 1 1 −3 4 01

Exercises

407

determine F so that the eigenvalues of A + BF are at −1 ± j and −2 ± j. Use as many diﬀerent methods to choose F as you can. 9.5. Consider the SISO system x˙ c = Ac xc + Bc u, y = Cc xc + Dc u, where (Ac , Bc ) is in controller form with ⎡ ⎡ ⎤ ⎤ 0 1 ··· 0 0 ⎢ .. ⎢ .. ⎥ ⎥ .. . . .. ⎢ ⎢ ⎥ ⎥ . . . Ac = ⎢ . ⎥ , Bc = ⎢ . ⎥ , Cc = [c0 , c1 , . . . , cn−1 ], ⎣ 0 ⎣0⎦ 0 ··· 1 ⎦ −α0 −α1 · · · −αn−1 1 and let u = Fc x + r = [f0 , f1 , . . . , fn−1 ]x + r be the linear state feedback control law. Use the Structure Theorem of Section 6.4 to show that the openloop transfer function is H(s) = Cc (sI − Ac )−1 Bc + Dc = =

cn−1 sn−1 + · · · + c1 s + c0 + Dc sn + αn−1 sn−1 + · · · + α1 s + α0

n(s) d(s)

and that the closed-loop transfer function is HF (s) = (Cc + Dc Fc )[sI − (Ac + Bc Fc )]−1 Bc + Dc (cn−1 + Dc fn−1 )sn−1 + · · · + (c1 s + Dc f1 )s + (c0 + Dc f0 ) + Dc sn + (αn−1 − fn−1 )sn−1 + · · · + (α1 − f1 )s + (α0 − f0 ) n(s) . = dF (s) =

Observe that state feedback does not change the numerator n(s) of the transfer function, but it can arbitrarily assign any desired (monic) denominator polynomial dF (s) = d(s) − Fc [1, s, . . . , sn−1 ]T . Thus, state feedback does not (directly) alter the zeros of H(s), but it can arbitrarily assign the poles of H(s). Note that these results generalize to the MIMO case [see (9.43)]. 9.6. Consider the system x˙ = Ax + Bu, y = Cx, where ⎡ ⎤ ⎡ ⎤ 01 0 0 A = ⎣ 0 0 1 ⎦ , B = ⎣ 0 ⎦ , C = [1, 2, 0]. 1 0 −1 1 (a) Determine an appropriate linear state feedback control law u = F x + Gr (G ∈ R) so that the closed-loop transfer function is equal to a given desired transfer function Hm (s) =

1 . s2 + 3s + 2

408

9 State Feedback and State Observers

We note that this is an example of model matching, i.e., compensating a given system so that it matches the input–output behavior of a desired model. In the present case, state feedback is used; however, output feedback is more common in model matching. (b) Is the compensated system in (a) controllable? Is it observable? Explain your answers. (c) Repeat (a) and (b) by assuming that the state is not available for measurement. Design an appropriate state observer, if possible. 9.7. Design an observer for the oscillatory system x(t) ˙ = v(t), v(t) ˙ = −ω02 x(t), using measurements of the velocity v. Place both observer poles at s = −ω0 . 9.8. Consider the undamped harmonic oscillator x˙ 1 (t) = x2 (t), x˙ 2 (t) = −ω02 x1 (t) + u(t). Using an observation of velocity y = x2 , design an observer/state feedback compensator to control the position x1 . Place the state feedback controller poles at s = −ω0 ±jω0 and both observer poles at s = −ω0 . Plot x(t) for x(0) = [1, 1]T and ω0 = 2. 2

9.9. A servomotor that drives a load is described by the equation ddt2θ + dθ dt = u, where θ is the shaft position (output) and u is the applied voltage. Choose u so that θ and dθ dt will go to zero exponentially (when their initial values are not zero). To accomplish this, proceed as follows. (a) Derive a state-space representation of the servomotor. (b) Determine linear state feedback, u = F x + r, so that both closed-loop eigenvalues are at −1. Such F is actually optimal since it minimizes J = ∞ 2 & dθ '2 [θ + dt + u2 ]dt. 0 (c) Since only θ and u are available for measurement, design an asymptotic state estimator (with eigenvalues at, say, −3) and use the state estimate xˆ in the linear state feedback control law. Write the transfer function and the state-space description of the overall system and comment on stability, controllability, and observability. (d) Plot θ and dθ/dt in (b) and (c) for r = 0 and initial conditions equal to [1, 1]T . (e) Repeat (c) and (d), using a reduced-order observer of order 1. 9.10. Consider the LQR problem for the system x˙ = Ax + Bu, where (A, B) is controllable and the performance index is given by

∞ ˜ J(u) = e2αt [xT (t)Qx(t) + uT (t)Ru(t)]dt, 0

where α ∈ R, α > 0 and Q ≥ 0, R > 0. ˜ (a) Show that u∗ that minimizes J(u) is a ﬁxed control law with constant ˜ = e2αt Q, R ˜= gains on the states, even though the weighting matrices Q 2αt e R are time varying. Derive the algebraic Riccati matrix equation that characterizes this control law.

Exercises

409

(b) The performance index given above has been used to solve the question of relative stability. In light of your solution, how do you explain this? Hint : Reformulate the problem in terms of the transformed variables x ˜ = eαt x, u˜ = eαt u. 01 1 9.11. Consider the system x˙ = x+ u and the performance indices 11 0 J1 , J2 given by

∞

∞ (x21 + x22 + u2 )dt and J2 = (900(x21 + x22 ) + u2 )dt. J1 = 0

0

Determine the optimal control laws that minimize J1 and J2 . In each case, plot u(t), x1 (t), x2 (t) for x(0) = [1, 1]T and comment on your results. 01 0 9.12. Consider the system x˙ = x+ u, y = [1, 0]x. 10 −1 (a) Use state feedback u = F x to assign the eigenvalues of A + BF at −0.5 ± j0.5. Plot x(t) = [x1 (t), x2 (t)]T for the open- and closed-loop system with x(0) = [−0.6, 0.4]T . (b) Design an identity observer with eigenvalues at −α ± j, where α > 0. What is the observer gain K in this case? (c) Use the state estimate x ˆ from (b) in the linear feedback control law u = Fx ˆ, where F was found in (a). Derive the state-space description of the closed-loop system. If u = F x ˆ + r, what is the transfer function between y and r? ˆ(0) = [0, 0]T , plot x(t), xˆ(t), y(t), and u(t) of (d) For x(0) = [−0.6, 0.4]T and x the closed-loop system obtained in (c) and comment on your results. Use α = 1, 2, 5, and 10, and comment on the eﬀects on the system response. Remark: This exercise illustrates the deterioration of system response when state observers are used to generate the state estimate that is used in the feedback control law. 9.13. Consider the system x(k + 1) = Ax(k) + Bu(k) + Eq(k),

y(k) = Cx(k),

where q(k) ∈ Rr is some disturbance vector. It is desirable to completely eliminate the eﬀects of q(k) on the output y(k). This can happen only when E satisﬁes certain conditions. Presently, it is assumed that q(k) is an arbitrary r × 1 vector. (a) Express the required conditions on E in terms of the observability matrix of the system. 11 (b) If A = , C = [1, 1], characterize all E that satisfy these conditions. 11

410

9 State Feedback and State Observers

(c) Suppose E ∈ Rn×1 , C ∈ Rp×1 , and q(k) is a step, and let the objective be to asymptotically reduce the eﬀects of q on the output. Note that this speciﬁcation is not as strict as in (a), and in general it is more easily satisﬁed. Use z-transforms to derive conditions for this to happen. Hint : Express the conditions in terms of poles and zeros of {A, E, C}. 9.14. Consider the system x˙ = Ax + Bu, y = Cx + Du, where 00 10 10 10 A= , B= , C= , D= . 00 01 12 01 Let u = F x + r be a linear state feedback control law. Determine F so that the eigenvalues of A + BF are −1, −2 and are unobservable from y. What is y = HF rˆ) in this case? the closed-loop transfer function HF (s) (ˆ Hint: Select the eigenvalues and eigenvectors of A + BF . 9.15. Consider the controllable and observable SISO system x˙ = Ax + Bu, y = Cx with H(s) = C(sI − A)−1 B. (a) If λ is not an eigenvalue of A, show that there exists an initial state x0 such that the response to u(t) = eλt , t ≥ 0, is y(t) = H(λ)eλt , t ≥ 0. What happens if λ is a zero of H(s)? (b) Assume that A has distinct eigenvalues. Let λ be an eigenvalue of A and show that there exists an initial state x0 such that with “no input” ( u(t) ≡ 0 ), y(t) = keλt , t ≥ 0, for some k ∈ R.

10 Feedback Control Systems

10.1 Introduction This chapter focuses on one and two degrees of freedom feedback control systems that have been studied, using Polynomial Matrix (PMD) and Matrix Fractional (MFD) Descriptions. The chapter starts by considering in Section 10.2 interconnected systems and their properties, with emphasis on systems connected via feedback interconnections. Internal stability is central in the development, and all stabilizing feedback controllers are parameterized in Section 10.3. The role of the Diophantine equation is also explained. In Section 10.4 two degrees of freedom controllers are studied at length.

10.2 Interconnected Systems Interconnected systems, connected in parallel, series, and feedback conﬁgurations are studied in the present section. It is shown that particular interconnections may introduce uncontrollable, unobservable, or unstable modes into a system; for a more detailed development, see [1, p. 568, Subsection 7.3C]. Feedback conﬁgurations, as well as series interconnections, are of particular importance in the control of systems. 10.2.1 Systems Connected in Parallel and in Series In Parallel Consider ﬁrst systems S1 and S2 connected in parallel as shown in Figure 10.1, and let (10.1) P1 (q)z1 (t) = Q1 (q)u1 (t), y1 (t) = R1 (q)z1 (t) and P2 (q)z2 (t) = Q2 (q)u2 (t),

y2 (t) = R2 (q)z2 (t)

(10.2)

412

10 Feedback Control Systems u1

y1

S1

+

u

y

+ S2

u2

y2 S

Figure 10.1. Systems connected in parallel

be representations (PMDs) for S1 and S2 , respectively; see Section 7.5. Since u(t) = u1 (t) = u2 (t) and y(t) = y1 (t) + y2 (t), the overall system description is given by z1 (t) z1 (q) Q1 (q) P1 (q) 0 = u(t), y(t) = [R1 (q), R2 (q)] . 0 P2 (q) z2 (q) Q2 (q) z2 (t) (10.3) If the systems S1 and S2 are described by the state-space representations x˙ i = Ai xi + Bi ui , yi = Ci xi + Di ui , i = 1, 2, then the overall system statespace description is given by A1 0 x1 B1 x˙ 1 = + u, x˙ 2 x2 B2 0 A2 x (10.4) y = [C1 , C2 ] 1 + [D1 + D2 ]u. x2 If H1 (s), H2 (s) are the transfer function matrices of S1 and S2 , respectively, then the overall transfer function can be found from yˆ(s) = yˆ1 (s) + yˆ2 (s) = H1 (s)ˆ u1 (s) + H2 (s)ˆ u2 (s) = [H1 (s) + H2 (s)]ˆ u(s) to be H(s) = H1 (s) + H2 (s).

(10.5)

Note that if both H1 (s) and H2 (s) are proper, then H(s) is also proper. In Series Consider now systems S1 and S2 connected in series, as shown in Figure 10.2, and let (10.1) and (10.2) describe the systems. Here u2 (t) = y1 (t). To derive

u1

S1

y1

u2

y2

S2 S

Figure 10.2. Systems connected in series

10.2 Interconnected Systems

413

the overall system description, consider P2 z2 = Q2 u2 = Q2 y1 = Q2 R1 z1 . Then P1 0 z1 Q1 u1 , = −Q2 R1 P2 z2 0 (10.6) z y2 = [0, R2 ] 1 . z2 If the systems S1 , S2 are described by the state-space representations x˙ i = Ai xi + Ci ui , yi = Ci xi + Di ui , i = 1, 2, then it can be shown that the overall system state-space description is given by A1 0 x1 B1 0 u1 x˙ 1 = + , B2 C1 A2 B2 D1 B2 x˙ 2 x2 r2 (10.7) C1 0 x1 D1 0 u1 y1 = + . y2 x2 r2 D2 C1 C2 D2 D1 D2 If H1 (s), H2 (s) are the transfer function matrices of S1 and S2 , then the overall transfer function yˆ2 (s) = H(s)ˆ u1 (s) is H(s) = H2 (s)H1 (s).

(10.8)

It can be shown that if both H1 and H2 are proper, then H is also proper. Note that poles of H1 and H2 may cancel in the product H2 H1 and any cancellation implies that there are uncontrollable/unobservable eigenvalues in the overall system internal description. 10.2.2 Systems Connected in Feedback Conﬁguration Consider systems S1 and S2 connected in a feedback conﬁguration as shown in Figure 10.3a, or equivalently as in Figure 10.3b. Let P1 (q)z1 (t) = Q1 (q)u1 (t),

y1 (t) = R1 (q)z1 (t)

(10.9)

P2 (q)z2 (t) = Q2 (q)u2 (t),

y2 (t) = R2 (q)z2 (t)

(10.10)

and be polynomial matrix representations of S1 and S2 , respectively. Since u1 (t) = y2 (t) + r1 (t), u2 (t) = y1 (t) + r2 (t),

(10.11) (10.12)

where r1 and r2 are external inputs, the dimensions of the vector inputs and outputs, u1 and y2 and also u2 and y1 must be the same. To derive the overall system description we consider P1 z1 = Q1 u1 = Q1 (y2 + r1 ) and P2 z2 = Q2 u2 = Q2 (y1 +r2 ) where y1 and y2 are as above. Then the closed-loop is described by

414

10 Feedback Control Systems r1

u1

+

y1

S1

+

y2

+

u2

S2

r2

+

(a)

r1 r2

u2

+

S2

+

y2 +

+

u1

S1

y1

(b)

Figure 10.3. Feedback conﬁguration

z1 Q1 0 r1 y R1 0 z1 = , 1 = . z2 r2 y2 z2 0 Q2 0 R2 (10.13) Note that the condition for the closed-loop system to be well deﬁned is that P1 −Q1 R2 = 0. (10.14) det −Q2 R1 P2 P1 −Q1 R2 −Q2 R1 P2

If this condition is not satisﬁed, then the closed-loop system cannot be described by the polynomial matrix representations discussed here. If the systems S1 and S2 are described by the state-space representations x˙ i = Ai xi + Bi ui , yi = Ci xi + Di ui , i = 1, 2, then it can be shown that the closed-loop system state-space description is x1 x˙ 1 A1 +B1 M2 D2 C1 B1 M2 B1 M2 D2 r1 B1 M2 C2 [ r2 ] , x˙ 2 = B2 M1 C1 A2 +B2 M1 D1 C2 [ x2 ] + B2 M1 D1 B2 M1 M1 C1 M1 D1 C2 x1 M1 D1 M1 D1 D2 r1 y1 (10.15) [ y2 ] = M2 D2 C1 M2 C2 [ x2 ] + M2 D2 D1 M2 D2 [ r2 ] , where M1 = (I − D1 D2 )−1 and M2 = (I − D2 D1 )−1 . It is assumed that det(I − D1 D2 ) = det(I − D2 D1 ) = 0. It is not diﬃcult to see that in the case of state-space representations the conditions for the closed-loop system state-space representation to be well deﬁned is det(I − D1 D2 ) = 0. When D1 = 0 and D2 = 0, then (10.15) simpliﬁes to

10.2 Interconnected Systems

x˙ 1 x˙ 2

A1 B1 C2 x1 B1 0 + B2 C1 A2 x2 0 B2 y1 C1 0 x1 = . 0 C2 y2 x2

=

415

r1 , r2 (10.16)

Example 10.1. Consider systems S1 and S2 in a feedback conﬁguration with s H1 (s) = s+1 and H2 (s) = 1 and consider the realizations {P1 , Q1 , R1 , W1 } = {q + 1, q, 1, 0} and {P2 , Q2 , R2 , W2 } = {1, 1, 1, 0}. Then (10.13) becomes q0 r1 q + 1 −q z1 = , z2 r2 01 −1 1 10 z1 y1 = . y2 z2 01 q + 1 −q Since det = 1 = 0, this is a well-deﬁned polynomial matrix −1 1 description for the closed-loop system. Note that the transfer function matrix −1 10 s + 1 −s s0 s s of the closed-loop system is H(s) = = , 01 −1 1 01 s s+1 which is not proper, whereas H1 and H2 were both proper. −1 Now if state-space realizations of H1 (s) = s+1 + 1 and H2 (s) = 1 are considered, namely {A1 , B1 , C1 , D1 } = {−1, 1, −1, 1} and {A2 , B2 , C2 , D2 } = {0, 0, 0, 1}, then 1 − D1 D2 = 1 − 1 · 1 = 0; i.e., a state-space description of the closed-loop does not exist. This is to be expected since the closed-loop transfer function is nonproper and as such cannot be represented by a statespace realization {A, B, C, D}. Next, let H1 (s) and H2 (s) be the transfer function matrices of S1 and S2 ; i.e., yˆ1 (s) = H1 (s)ˆ u1 (s) and yˆ2 (s) = H2 (s)ˆ u2 (s). In view of u ˆ1 = yˆ2 + rˆ1 and u ˆ2 = yˆ1 + rˆ2 , we have yˆ1 = H1 uˆ1 = H1 (ˆ y2 + rˆ1 ) = H1 H2 u ˆ2 + H1 rˆ1 = H1 H2 yˆ1 + H1 H2 rˆ2 + H1 rˆ1 or y1 = H1 H2 rˆ2 + H1 rˆ1 . (I − H1 H2 )ˆ

(10.17)

Also, yˆ2 = H2 u ˆ2 = H2 (ˆ y1 + rˆ2 ) = H2 H1 u ˆ1 +H2 rˆ2 = H2 H1 yˆ2 +H2 H1 rˆ1 +H2 rˆ2 or y2 = H2 H1 rˆ1 + H2 rˆ2 . (10.18) (I − H2 H1 )ˆ Note that det(I − H1 H2 ) = det(I − H2 H1 ), and assume that the determinant is nonzero. Then (I − H1 H2 )−1 H1 (I − H1 H2 )−1 H1 H2 rˆ1 yˆ1 = yˆ2 (I − H2 H1 )−1 H2 H1 (I − H2 H1 )−1 H2 rˆ2 (10.19) H11 H12 rˆ1 = . H21 H22 rˆ2

416

10 Feedback Control Systems

The signiﬁcance of the assumption det(I − H1 H2 ) = 0 can be seen as fol(1 u1 , y1 = z˜1 and D2 z2 = u2 , y2 = N2 z2 be representations ( 1 z˜1 = N lows. Let D of the systems S1 and S2 . As will be shown below, the closed-loop system (1 N2 )z2 = N (1 r1 + D ( 1 r2 and ( 1 D2 − N description in this case is given by (D −1 ( ( y1 = D2 z2 −r2 and y2 = N2 z2 . Now note that I −H1 H2 = I −D1 N1 N2 D2−1 = ( −1 (D ( 1 D2 − N (1 N2 )D−1 , which implies that det(I − H1 H2 ) = 0 if and only if D 1 2 ( 1 D2 − N (1 N2 ) = 0; i.e., if det(I − H1 H2 ) = 0, then the closed-loop sysdet(D tem cannot be described by the polynomial matrix representations discussed in this chapter. Thus, the assumption that det(I − H1 H2 ) = 0 is essential for the closed-loop system to be well deﬁned. s Example 10.2. Consider H1 (s) = s+1 and H2 (s) = 1 as in Example 10.1. 1 Here 1 − H1 H2 = s+1 = 0, and therefore, the closed-loop system is well deﬁned. Relation (10.19) assumes in this case the form s s rˆ1 yˆ1 = , yˆ2 rˆ2 s s+1

a nonproper transfer function that is the transfer function matrix H(s) derived in Example 10.1. For simplicity, assume that both S1 and S2 in Figure 10.3 are controllable and observable and consider the following representations. For system S1 : (1a) D1 (q)z1 (t) = u1 (t), or

y1 (t) = N1 (q)z1 (t)

( 1 (q)˜ (1 (q)u1 (t), y1 (t) = z˜1 (t), (1b) D z1 (t) = N

(10.20) (10.21)

( 1 (q), N (1 (q)) are lc. where (D1 (q), N1 (q)) are rc and (D For system S2 : (2a) D2 (q)z2 (t) = u2 (t), or

y2 (t) = N2 (q)z2 (t)

( 2 (q)˜ (2 (q)u2 (t), (2b) D z2 (t) = N

y2 (t) = z˜2 (t),

(10.22) (10.23)

( 2 (q), N (2 (q)) are lc. where (D2 (q), N2 (q)) are rc and (D In view of the connections u1 (t) = y2 (t) + r1 (t), u2 (t) = y1 (t) + r2 (t),

(10.24)

the closed-loop feedback system of Figure 10.3 can now be characterized as follows [see also (10.13)]:

10.2 Interconnected Systems

(i)

417

Using descriptions (1a) and (2a), and Eqs. 10.20 and 10.21, we have D1 −N2 z1 I0 r1 y N1 0 z1 = , 1 = . (10.25) 0 N2 −N1 D2 z2 r2 y2 z2 0I

(ii) Using descriptions (1b) and (2b), we have ( 1 −N (1 0 (1 D z˜1 r1 N y1 I0 z˜1 = , = . ( ( ( z ˜ r y z ˜2 0 I − N2 D2 2 0 N2 2 2 (iii) Using descriptions (1b) and (2a), we have ( 1 −N (1 0 (1 N2 z˜1 y1 I 0 z˜1 r1 D N = , = . z2 r2 y2 z2 0 N2 −I D2 0 I

(10.26)

(10.27)

(1 u1 + r2 = D (1 (y2 + r1 ) + r2 = ( −1 N ( −1 N Also, D2 z2 = u2 = y1 + r2 = D 1 1 −1 ( ( D1 N1 (N2 z2 + r1 ) + r2 and y1 = u2 − r2 = D2 z2 − r2 , from which we obtain r1 ( 1 D2 − N (1 N2 )z2 = [N (1 , D ( 1 ] r1 , y1 = D2 z2 + 0 −I (D . 0 0 r2 y2 N2 r2 (10.28) (iv) Using descriptions (1a) and (2b), we have I 0 D1 −I z1 r1 y1 N1 0 z1 = , = . (10.29) (2 (2 N1 D2 z˜2 r2 y2 z˜2 0 I 0N −N (2 u2 + r1 = D (2 (y1 + r2 ) + r1 = ( −1 N ( −1 N Also, D1 z1 = u1 = y2 + r1 = D 2 2 −1 ( ( D2 N2 (N1 z1 + r2 ) + r1 and y2 = u1 − r1 = D1 z1 − r1 , from which we obtain 00 r1 ( 2 D1 − N (2 N1 )z1 = [D ( 2, N (2 ] r1 , y1 = N1 z1 + (D . −I 0 r2 y2 D1 r2 (10.30) Controllability and Observability The preceding descriptions of the closed-loop system given in (i), (ii), (iii), and (iv) are equivalent and have the same uncontrollable and unobservable modes. The systems S1 and S2 were taken to be controllable and observable, and so the uncontrollability and unobservability discussed below is due to the feedback interconnection only.

418

10 Feedback Control Systems

Controllability. To study controllability, consider the (10.25). representation D1 −N2 I0 It can be seen from the matrices and that the eigenvalues −N1 D2 0I that are uncontrollable from r1 will be the roots of the determinant of a gcld of [−N1 , D2 ] and the eigenvalues that are uncontrollable from r2 will be the roots of a gcld of [D1 , −N2 ]. The closed-loop system is controllable r1 from . Clearly, all possible eigenvalues that are uncontrollable from r1 r2 are eigenvalues of S2 . These are the poles of H2 = N2 D2−1 that cancel in the product H2 N1 . Similarly, all possible eigenvalues that are uncontrollable from r2 are eigenvalues of S1 . These are the poles of H1 = N1 D1−1 that cancel in the product H1 N2 . Observability. To study observability, consider the representation (10.26). (1 ( 1 −N I0 D From the matrices ( 2 and 0 I , it can be seen that the eigen(2 D −N values that from y1 will be the roots of the determinant of are unobservable (1 −N a gcrd of ( 2 and the eigenvalues that are unobservable from y2 will be D (1 D the roots of the determinant of a gcrd of (2 . The closed-loop system is −N y observable from 1 . Clearly, all possible eigenvalues that are unobservable y2 (2 that cancel ( −1 N from y1 are eigenvalues of S2 . These are the poles of H2 = D 2 ( in the product N1 H2 . Similarly, all possible eigenvalues that are unobservable (1 that cancel ( −1 N from y2 are eigenvalues of S1 . These are the poles of H1 = D 1 (2 H1 , H2 [H1 , I]. in the product N Example 10.3. Consider systems S1 and S2 connected in the feedback conﬁguration of Figure 10.3, and let S1 and S2 be described by the transfer funcs+a0 s+1 , and H2 (s) = a1s+b . For the closed-loop to be well deﬁned, tions H1 (s) = s−1 2

(1−a1 )s +(b−a1 −a0 −1)s−(b+a0 ) s+1 a1 s+a0 we must have 1 − H1 H2 = 1 − s−1 = 0. s+b = (s−1)(s+b) s−1 Note that for a1 = 1, a0 = −1, and b = 1, H2 = s+1 and 1−H1 H2 = 1−1 = 0. Therefore, these values are not allowed for the parameters if the closed-loop system is to be represented by a PMD. If state-space descriptions are to be used, let D1 = lims→∞ H1 (s) = 1 and D2 = lims→∞ H2 (s) = a1 , from which we have 1 − D1D2 = 1 − a1 = 0 for the closed-loop system to be characterized by a state-space description. Let us assume that a1 = 1. The uncontrollable and unobservable eigenvalues can be determined from a PMD such as (10.28). Alternatively, in view of the discussion just preceding this example, we conclude the following. (i) The eigenvalues that are uncons+a0 (s + 1); i.e., trollable from r1 are the poles of H2 that cancel in H2 N1 = a1s+b

10.2 Interconnected Systems

419

there is an eigenvalue that is uncontrollable from r1 (at −1) only when b = 1. If this is the case, −1 is also an eigenvalue that is unobservable from y1 . (ii) The poles of H1 that cancel in H1 N2 = s+1 s−1 (a1 s + a0 ) are the eigenvalues that are uncontrollable from r2 ; i.e., there is an eigenvalue that is uncontrollable from r2 (at +1) only when a0 /a1 = −1. If this is the case, +1 is also an eigenvalue that is unobservable from y2 .

Stability The closed-loop feedback system is internally stable if and only if all of its eigenvalues have negative real parts. The closed-loop eigenvalues can be determined from the closed-loop descriptions derived above. First recall the identities AD det = det(A) det(B − CA−1 D) = det(B) det(A − DB −1 C), (10.31) CB where in the ﬁrst expression it was assumed that det(A) = 0 and in the second expression it was assumed that det(B) = 0. The proof ofthis result is im I 0 AD A D mediate from the matrix identities = −CA−1 I C B 0 B − CA−1 D −1 −1 I −DB AD A − DB C 0 and . = C B 0 I CB ( 1 −N (1 D1 −N2 D We now consider the polynomial matrices , (2 , (2 D −N1 D2 −N

(1 N2 ), and (D ( 2 D1 − N (2 N1 ) from the closed-loop descriptions in ( 1 D2 − N (D (i), (ii), (iii), and (iv). Then D1 −N2 = det(D1 ) det(D2 − N1 D1−1 N2 ) det −N1 D2 (1 N2 ) ( −1 N = det(D1 ) det(D2 − D 1

( −1 ) det(D ( 1 D2 − N (1 N2 ) = det(D1 ) det(D 1 ( 1 D2 − N (1 N2 ), (10.32) = α1 det(D where α1 is a nonzero real number. Also D1 −N2 det = det(D2 ) det(D1 − N2 D2−1 N1 ) −N1 D2 (2 N1 ) ( −1 N = det(D2 ) det(D1 − D 2

( −1 ) det(D ( 2 D1 − N (2 N1 ) = det(D2 ) det(D 2 ( 2 D1 − N (2 N1 ), (10.33) = α2 det(D

420

10 Feedback Control Systems

where α2 is a nonzero real number. Similarly, ( 1 −N (1 D ( 2 D1 − N (2 N1 ), det =α ˆ 1 det(D (2 (2 D −N ( 1 ) det(D−1 ) is a nonzero real number, and where α ˆ 1 = det(D 1 ( 1 −N (1 D ( 1 D2 − N (1 N2 ), det =α ˆ 2 det(D (2 (2 D −N

(10.34)

(10.35)

( 2 ) det(D−1 ) is a nonzero real number. These computations where α ˆ2 = det(D 2 verify that the equivalent representations given by (i), (ii), (iii), and (iv) have identical eigenvalues. The following theorem presents conditions for the internal stability of the feedback system of Figure 10.3. These conditions are useful in a variety of circumstances. Assume that the systems S1 and S2 are controllable and observable and that they are described by (10.20)–(10.23) with transfer function matrices given by (1 ( −1 N (10.36) H1 = N1 D1−1 = D 1 and

(2 , ( −1 N H2 = N2 D2−1 = D 2

(10.37)

(i , D ( i ) are lc for i = 1, 2. Let α1 (s) and where the (Ni , Di ) are rc and the (N α2 (s) be the pole (characteristic) polynomials of H1 (s) and H2 (s), respec( i (s)), i = 1, 2, for some tively. Note that αi (s) = ki det(Di (s)) = k˜i det(D ˜ nonzero real numbers ki , ki . Consider the feedback system in Figure 10.3. Theorem 10.4. The following statements are equivalent: (a) The closed-loop feedback system in Figure 10.3 is internally stable. (b) The polynomial D1 −N2 (i) det , or −N1 D2 (1 ( 1 −N D , or (ii) det ( ( − N2 D2 (1 N2 ), or ( 1 D2 − N (iii) det(D ( 2 D1 − N (2 N1 ) (iv) det(D is Hurwitz; that is, its roots have negative real parts. (c) The polynomial α1 (s)α2 (s) det(I − H1 (s)H2 (s)) = α1 (s)α2 (s) det(I − H2 (s)H1 (s)) (10.38) is a Hurwitz polynomial.

10.2 Interconnected Systems

421

(d) The poles of

−1 u ˆ1 I −H2 rˆ1 = u ˆ2 −H1 I rˆ2 −1 (I − H2 H1 ) H2 (I − H1 H2 )−1 rˆ1 = H1 (I − H2 H1 )−1 (I − H1 H2 )−1 rˆ2

(10.39)

are stable; i.e., they have negative real parts. (e) The poles of

−1 rˆ1 −H2 I 0 H2 yˆ1 = I −H1 yˆ2 H1 0 rˆ2 (I − H1 H2 )−1 H1 (I − H1 H2 )−1 H1 H2 rˆ1 = (I − H2 H1 )−1 H2 H1 (I − H2 H1 )−1 H2 rˆ2

(10.40)

are stable. Proof. See [1, p. 583, Theorem 3.15].

Remarks It is important all four entries in the (10.40) to consider transfer function y1 r1 u1 r1 between and [or in (10.39) between and ] when cony2 r2 u2 r2 sidering internal stability. Note that the eigenvalues that are uncontrollable from r1 or r2 will not appear in the ﬁrst or the second column of the transfer matrix, respectively. Similarly, the eigenvalues that are unobservable from y1 or y2 will not appear in the ﬁrst or the second row of the transfer matrix, respectively. Therefore, consideration of the poles of some of the entries only may lead to erroneous results, since possible uncontrollable or unobservable modes may be omitted from consideration, and these may lead to instabilities. Closed-Loop Characteristic Polynomial. The open-loop characteristic polynomial of the feedback system is α1 (s)α2 (s). The closed-loop characteristic polynomial is a monic polynomial, αcl (s), with roots equal to the closed-loop eigenvalues; i.e., it is equal to any of the polynomials in (b) within a multiplication by a nonzero real number. Then, relation (10.38) implies, in view of (iv), that the determinant of the return diﬀerence matrix (I − H1 (s)H2 (s)) is the ratio of the closed-loop characteristic polynomial over the open-loop characteristic polynomial within a multiplication by a nonzero real number. Example 10.5. Consider the feedback conﬁguration of Figure 10.3 with a1 s+a0 H1 = s+1 the transfer functions of systems S1 and S2 , s−1 and H2 = s+b respectively. Let a1 = 1 so that the loop is well deﬁned in terms of state-space representations (and all transfer functions are proper). (See Example 10.3.)

422

10 Feedback Control Systems

All polynomials in (b) of Theorem 10.4 are equal within a multiplication by a nonzero real number, to the closed-loop characteristic polynomial given b+a0 1 −a0 −1 s − 1−a . This polynomial must be a Hurwitz by αcl (s) = s2 + b−a1−a 1 1 polynomial for internal stability. If α1 (s) = s − 1 and α2 (s) = s + b are the pole polynomials of H1 and H2 , then the polynomial in (c) is given by α1 (s)α2 (s)(1 − H1 (s)H2 (s)) = (1 − a1 )s2 + (b − a1 − a0 − 1)s − (b + a0 ) = (1 − a1 )αcl (s), which implies that the return diﬀerence 1 − H1 (s)H2 (s) = cl (s) . Note that (1 − H1 H2 )−1 = (1 − H2 H1 )−1 = (s−1)(s+b) with (1 − a1 ) α1α(s)α α(s) 2 (a) α(s) = (1 − α1 )αcl (s) and the transfer function matrix in (d) of Theorem 10.4 is given by (s−1)(s+b) (s−1)(a1 s+a0 ) rˆ1 uˆ1 α(s) α(s) = (s+1)(s+b) . (s−1)(s+b) uˆ2 rˆ2 α(s)

α(s)

The polynomial α(s) has a factor s + 1 when b = 1. Notice that α(−1) = 2 − 2b = 0 when b = 1. If this is the case (b = 1), then s−1 (s−1)(a1 s+a0 ) rˆ1 u ˆ1 ¯ α(s) = α(s) , s+1 s−1 u ˆ2 r ˆ2 α(s) ¯ α(s) ¯ where α(s) = (s + 1)¯ α(s). Notice that three out of four transfer functions do not contain the pole at −1 in α ¯ (s). Recall that when b = 1, −1 is an eigenvalue that is uncontrollable from the r1 eigenvalue and it cancels in certain transfer functions as expected (see Example 10.3). Similar results can be derived when a0 /a1 = −1. This illustrates the necessity for considering all the transfer functions between u1 , u2 and r1 , r2 when studying the internal stability of the feedback system. Similar results can be derived when considering the transfer functions between y1 , y2 and r1 , r2 in (e).

10.3 Parameterization of All Stabilizing Feedback Controllers In this section, it is shown that all stabilizing feedback controllers can be conveniently parameterized. These parameterizations are very important in control since they are fundamental in methodologies such as the optimal H ∞ approach to control design. Our development builds on the controllability, observability, and particularly the internal stability results introduced in Section 10.2, as well as on Diophantine Equation results [1, Subsection 7.2E]. First, in Subsection 10.3.1, all stabilizing feedback controllers are parameterized, using PMDs. Parameterizations are introduced, using ﬁrst the polyno(k, N (k and then the stable rational mial matrix parameters (i) Dk , Nk and D −1 −1 (k . These parameters are very convenient ( N parameter (ii) K = Nk Dk = D k in characterizing stability, but cumbersome when properness of the controller

10.3 Parameterization of All Stabilizing Feedback Controllers

423

transfer function is to be guaranteed. A parameterization that uses proper and stable MFDs and involves a proper and stable parameter K is then introduced in Subsection 10.3.2. This is very convenient when properness of H2 is to be guaranteed. The parameter K is closely related to the parameter K used in the second approach enumerated above. This type of parameterization is useful in certain control design methods such as optimal H ∞ control design. Two degrees of freedom feedback controllers oﬀer additional capabilities in control design and are discussed in Subsection 10.3.2. Control problems are also described in this subsection. In the following discussion, the term “stable system S” is taken to mean that the eigenvalues of the internal description of system S have negative real parts (in the continuous-time case); i.e., the system S is internally stable. Note that when the transfer functions in (10.39) and (10.40) of the feedback system S are proper, internal stability of S implies bounded-input, boundedoutput stability of the feedback system, since the poles of the various transfer functions are a subset of the closed-loop eigenvalues. 10.3.1 Stabilizing Feedback Controllers Using Polynomial MFDs Now consider systems S1 and S2 connected in the feedback conﬁguration shown in Figure 10.3. Given S1 , it is shown how to parameterize all systems S2 so that the closed-loop feedback system is internally stable. Thus, if S1 = S, called the plant, is a given system to be controlled, then S2 = Sc is viewed as the feedback controller that is to be designed. Presently we provide the parameterizations of all stabilizing feedback controllers. Theorem 10.6. Assume that the system S1 is controllable and observable and is described by the PMD (or PMFD) as (a) D1 z1 = u1 , y1 = N1 z1 ( 1 z˜1 = N (1 u1 , y1 = z˜1 given in (10.21). Let the given in (10.20), or by (b) D ( 1, N (1 ) be doubly coprime factorizations of the pair (D1 , N1 ) and the pair (D (1 . That is, ( −1 N transfer function matrix H1 (s) = N1 D−1 = D 1

U U −1 =

X1 Y1 (1 (1 D −N

1

D1 −Y˜1 (1 N1 X

=

I0 , 0I

(10.41)

where U is a unimodular matrix (i.e., det U is a nonzero real number) and (1 , Y˜1 are appropriate matrices. Then all the controllable and observX1 , Y1 , X able systems S2 with the property that the closed-loop feedback system eigenvalues are stable (i.e., they have negative real parts) are described by (a)

(2 u2 , ( 2 z˜2 = N D

y2 = z˜2 ,

(10.42)

(1 and N ( 1 ) with X1 , Y1 , N ( k X1 − N (k N (2 = −(D ( k Y1 + N (k D (1 , D (1 (2 = D where D ( k and N (k are selected arbitrarily under given in (10.41) and the parameters D

424

10 Feedback Control Systems

( −1 exists and is stable, and the pair (D (k, N (k ) is lc and the conditions that D k ( ( ( is such that det(Dk X1 − Nk N1 ) = 0. Equivalently, all stabilizing S2 can be described by (b)

D2 z 2 = u 2 ,

y2 = N2 z 2 ,

(10.43)

(1 Dk − N1 Nk and N2 = −(Y˜1 Dk + D1 Nk ) with X (1 , Y˜1 , N (1 , D (1 where D2 = X given in (10.41) and the parameters Dk and Nk are selected arbitrarily under the conditions that Dk−1 exists and is stable, and the pair (Dk , Nk ) is rc and (1 Dk − N1 Nk ) = 0. is such that det(X (k Furthermore, the closed-loop eigenvalues are precisely the roots of det D or of det Dk . In addition, the transfer function matrix of S2 is given by (1 )−1 (D ( 1) ( k X1 − N (k N ( k Y1 + N (k D H2 = −(D (1 Dk − N1 Nk )−1 . = −(Y˜1 Dk + D1 Nk )(X

(10.44)

Proof. The closed-loop description in case (a) is given by (10.30) and in case (b) it is given by (10.28). It can be shown [1, Subsection 7.2E] that the expression in (a) and (b) above can also be written as

and that

( 2 , −N (2 ] = [D (k, N (k ]U [D

(10.45)

−Nk N2 = U −1 D2 Dk

(10.46)

are parameterizations of all solutions of the Diophantine equation

and

( 2 D1 − N (2 N1 = D (k D

(10.47)

( 1 D2 − N (1 N2 = Dk , D

(10.48)

( k and Dk be desired closed-loop matrices. The respectively, where we let D ( −1 (or D−1 ) exists and is stable guarantees that all the closedfact that D k k ( −1 (or of D−1 ), will be stable. The loop eigenvalues, which are the poles of D k k ( ( (1 Dk −N1 Nk ) = 0) guarantees that ( condition det(Dk X1 − Nk N1 ) = 0 (or det(X ( 2 = 0 (or det D2 = 0) and therefore the polynomial matrix description det D (k, N (k ) is lc if for S2 in (10.28) is well deﬁned. Finally, note that the pair (D ( ( ( ( (k, N (k ]U and only if the pair (D2 , N2 ) is lc as can be seen from [D2 , −N2 ] = [D given in (10.45) where U unimodular. This then implies that the description (2 , I} for S2 is both controllable and observable. Similarly, the pair ( 2, N {D (Dk , Nk ) is rc, which guarantees that {D2 , I, N2 } with D2 and N2 given in (10.46) is also a controllable and observable description for S2 . (k, N (k or Dk , Nk , it is posIn place of the polynomial matrix parameters D sible to use a single parameter, a stable rational matrix K. This is shown next.

10.3 Parameterization of All Stabilizing Feedback Controllers

425

Theorem 10.7. Assume that the system S1 is controllable and observable and is described by its transfer function matrix (1 , ( −1 N H1 = N1 D−1 = D (10.49) 1

1

(1, N (1 ) are doubly coprime factorizations satisfying where the pairs (N1 , D1 ), (D (10.41). Then all the controllable and observable systems S2 with the property that the closed-loop feedback system eigenvalues are stable (i.e., they have strictly negative real parts) are described by the transfer function matrix (1 )−1 (Y1 + K D ( 1) H2 = −(X1 − K N (1 − N1 K)−1 , = −(Y˜1 + D1 K)(X

(10.50)

where the parameter K is an arbitrary rational matrix that is stable and is (1 ) = 0 or det(X (1 − N1 K) = 0. Furthermore, the poles such that det(X1 − K N of K are precisely the closed-loop eigenvalues. Proof. This is in fact a corollary to Theorem 10.6. It is called a theorem here since it was historically one of the ﬁrst results established in this area. The parameter K is called the Youla parameter . In Theorem 10.6, descriptions for H2 were given in (10.44) in terms of the (k and Dk , Nk . Now in view of −D ( k Nk + N (k Dk = 0, we have (k, N parameters D (k = Nk D−1 = K, ( −1 N D (10.51) k

k

(k, N (k ) is lc and the pair which is a stable rational matrix. Since the pair (D (Nk , Dk ) is rc, they are coprime factorizations for K. Therefore, H2 in (10.50) can be written as the H2 of (10.44) given in the previous theorem, from which the controllable and observable internal descriptions for S2 in (10.42) and (10.43) can immediately be derived. Conversely, (10.50) can immediately be derived from (10.44), using (10.51). Note that the poles of K are the roots of ( k or det Dk , which are the closed-loop eigenvalues. det D s+1 (1 = s + 1 and D1 = D (1 = Example 10.8. Consider H1 = s−1 . Here N1 = N s − 1. These are doubly coprime factorizations (a trivial case) since (10.41) is satisﬁed. We have X1 Y1 D1 −Y˜1 U U −1 = (1 (1 D (1 −N N1 X s − 1, −(−s + 32 ) s + 12 −s + 32 10 = = . −(s + 1) s − 1 01 s + 1, s + 12

In view of (10.44) and (10.50), all stabilizing controllers H2 are then given by H2 = −

(−s + 32 )dk + (s − 1)nk (−s + 32 ) + (s − 1)K = − , (s + 12 )dk − (s + 1)nk (s + 12 ) − (s + 1)K

where K = nk /dk is any stable rational function.

426

10 Feedback Control Systems

−1 s2 −(s + 1) = 0 1 (1 , which are coprime polynomial MFDs. Rela( −1 N N1 D1−1 = s12 [1, s + 1] = D 1 tion (10.41) is given by X1 Y1 D1 −Y˜1 −1 UU = (1 (1 D (1 −N N1 X ⎡ ⎤⎡ 2 ⎤ 1 s + 1 −s2 + 1 s −(s + 1) −(s + 1) ⎦ 1 s = ⎣ s s2 + s + 1 −s3 ⎦ ⎣ 0 −1 −(s + 1) s2 1 0 1 ⎤ ⎡ 100 = ⎣0 1 0⎦. 001

Example 10.9. Consider H1 (s) = [ s12 , s+1 s2 ] = [1, 0]

All stabilizing controllers may then be determined by applying (10.44) or (10.50). Remark In [1, pp. 592–605] a complete treatment of several diﬀerent parameterizations of all stabilizing controllers is given. The ﬁrst two parameterizations involving Dk and K were presented here. Another interesting parameterization involves Q1 and Q2 [1, p. 597], which in the case when the plant is stable, it becomes particularly attractive [1, p. 597, Corollary 4.4]. 10.3.2 Stabilizing Feedback Controllers Using Proper and Stable MFDs In the above development all systems S2 that internally stabilize the closedloop feedback system were parametrically characterized. In that development H1 , the transfer function of S1 was not necessarily proper and the stabilizing H2 as well as the closed-loop system transfer function were not necessarily proper either. Recall that a system is said to be internally stable when all of its eigenvalues, which are the roots of its characteristic polynomial, have strictly negative real parts. Polynomial matrix descriptions that can easily handle the case of nonproper transfer functions were used to derive the above results and the case of proper H1 and H2 was handled by restricting the parameters used to characterize all stabilizing controllers. Here we concentrate exclusively on the case of proper transfer functions H1 of S1 and parametrically characterize all proper H2 , which internally stabilize the closed-loop system. For this purpose, proper and stable matrix fractional

10.3 Parameterization of All Stabilizing Feedback Controllers

427

descriptions (MFDs) of H1 and H2 are used. Such MFDs are now described [1, Subsection 7.4C]. Consider H(s) ∈ R(s)p×m to be proper, i.e., lims→∞ H(s) < ∞, and write the MFD as H(s) = N (s)D (s)−1 , (10.52) where the N (s) and D (s) are proper and stable rational matrices that p×m m×m we denote here as N (s) ∈ RH∞ and D (s) ∈ RH∞ ; that is, they are matrices with elements in RH∞ , the set of all proper and stable ras−1 , tional functions with real coeﬃcients. For instance, if H(s) = (s−2)(s+1) −1 −1 (s−2)(s+1) s−1 s−1 s−2 = (s+1) are examples then H(s) = (s+2)(s+3) 2 (s+2)(s+3) s+1 of proper and stable MFDs. A pair (N , D ) ∈ RH∞ is called right coprime (rc) in RH∞ if there exists a pair (X , Y ) ∈ RH∞ such that X D + Y N = I.

(10.53)

This is a Diophantine Equation over the ring of proper and stable rational functions. It is also called a Bezout Identity. Let H = N D−1 , and write (10.53) as X + Y H = D−1 . Since the lefthand side is proper, D−1 is also proper; i.e., in the MFD given by H = N D−1 , where the pair (N , D ) is rc, D is biproper (D and D−1 are both proper). Note that X −1 , where X satisﬁes (10.53), does not necessarily exist. If, however, H is strictly proper (lims→∞ H(s) = 0), then lims→∞ X (s) = lims→∞ D (s)−1 is a nonzero real matrix, and in this case X −1 exists and is proper; i.e., in this case X is biproper. When the Diophantine Equation (10.53) is used to characterize all stabilizing controllers, it is often desirable to have solutions (X , Y ) where X is biproper. This is always possible. Clearly, when H is strictly proper, this is automatically true, as was shown. When H is not strictly proper, however, care should be exercised in the selection of the solutions of (10.53). As in the polynomial case, doubly coprime factorizations in RH∞ of a −1 −1 3 N˜ 1 , where D , N ∈ RH∞ transfer function matrix H1 = N 1 D 1 = D 1 1 1 3 1 , N˜ 1 ∈ RH∞ are important in obtaining parametric characterizations and D of all stabilizing controllers. Assume therefore that X1 Y1 D1 −Y˜1 I0 −1 UU = (10.54) 3 1 3 1 D 3 1 = 0 I , −N N1 X where U is unimodular in RH∞ , i.e., U and U −1 ∈ RH∞ . Also, assume that 3 1 have been selected so that det X1 = 0 and det X 3 1 = 0. X1 and X Internal Stability Consider now the feedback system in Figure 10.3, and let H1 and H2 be the transfer function matrices of S1 and S2 , respectively, which are assumed

428

10 Feedback Control Systems

to be controllable and observable. Internal stability of a system can be deﬁned in a variety of equivalent ways in terms of the internal description of the system. For example, in this chapter, polynomial matrix internal descriptions were used and the system was considered as being internally stable when its eigenvalues were stable; i.e., they have negative real parts. In Theorem 10.4, it was shown that the closed-loop feedback is internally system r1 y1 u1 and or stable if and only if the transfer function between u2 r2 y2 −1 r I −H2 and 1 have stable poles, i.e., if and only if the poles of or r2 −H1 I −1 −H2 I 0 H1 , respectively, are stable. I −H1 H1 0 In this section we shall regard the feedback system to be internally stable when −1 I −H2 ∈ RH∞ , (10.55) −H1 I i.e., when all the transfer function matrices in (10.55) are proper and stable. In this way, internal stability can be checked without necessarily involving internal descriptions of S1 and S2 . This approach to stability has advantages since it can be extended to systems other than linear, time-invariant systems. −1

−1 3 1 be doubly coprime MFDs in 3 1 N Theorem 10.10. Let H1 = N1 D 1 = D RH∞ . Then the closed-loop feedback system is internally stable if and only if −1 3 2 , such that 3 2 N H2 has an lc MFD in RH∞ , H2 = D

3 2 D1 − N 3 2 N1 = I, D

(10.56) −1

or if and only if H2 has an rc MFD in RH∞ , H2 = N2 D 2 , such that 3 1 D2 − N 3 1 N2 = I. D Proof. See [1, p. 615, Corollary 4.12].

(10.57)

In the following discussion, all proper stabilizing controllers are now parameterized. −1 3 1 be doubly coprime MFDs in 3 −1 N Theorem 10.11. Let H1 = N1 D 1 = D 1 RH∞ that satisfy (10.54). Then all H2 that internally stabilize the closed-loop feedback system are given by

3 1 )−1 (Y + K D 3 1 ) = −(Y˜ + D K )(X 3 1 − N K )−1 , H2 = −(X1 − K N 1 1 1 1 (10.58) 3 −1 −1 ( where K ∈ RH∞ is such that (X1 − K N 1 ) (or (X1 − N1 K ) ) exists and is proper.

10.3 Parameterization of All Stabilizing Feedback Controllers

429

( 2 D − N (2 N = I are given by Proof. It can be shown that all solutions of D 1 1 X1 Y1 3 2 , −N 3 2 ] = [I, K ] [D (10.59) 3 1 , 3 1 D −N where K ∈ RH∞ . The proof of this result is similar to the proof of the corresponding result for the polynomial matrix Diophantine Equation. Similarly, 3 1 D2 − N 3 1 N2 = I are given by all solutions of D 3 1 −K D1 − Y N2 , (10.60) = 3 1 D2 I N1 X where K ∈ RH∞ . The result follows then directly from Theorem 10.10.

The above theorem is a generalization of the Youla parameterization of Theorem 10.7 over the ring of proper and stable rational functions. It is interesting to note that in view of (10.54), H2 in (10.58) can be written ( −1 exist. Then as follows. Assume that X1−1 and X 1 −1 3 1 + X −1 ( H2 = −(Y 1 (I − Y1 N1 )K )(X1 − N1 K ) −1

−1

3 (X 3 1 X 3 1 − N K ) + X K ](X (1 − N K )−1 = −[Y 1 1 1 1 −1

−1

3 − X K (X 3 1 X (1 − N K )−1 = H20 + H2a ; = −Y 1 1 1

(10.61)

i.e., any stabilizing controller H2 can be viewed as the sum of an initial sta−1 3 1 and an additional controller H2a , which 3 1 X bilizing controller H20 = −Y depends on K . When K = 0, then H2a , is zero. 1 1 1 −1 −1 Example 10.12. Let H1 = s−1 = ( s+1 )( s−1 = N1 D−1 = ( s−1 ( s+a )= 1 s+1 ) s+a ) −1 3 3 D 1 N 1 with a > 0, which are doubly coprime factorizations. Note that s+3 s+5 s−1 − (s+5)(s+a) 3 1 X1 Y1 10 D1 − Y s+1 (s+1)(s+2) s+2 s+2 = . 1 s−1 (s+3)(s+a) 1 3 1 3 1 D 3 1 = − s+a 01 −N N1 X s+a s+1

(s+1)(s+2)

All stabilizing H2 are parametrically characterized by (10.58). Example 10.13. In the above example H2 = −(b + 1), b > 0 characterizes all static stabilizing H2 . Then for a = 1, we have −1 s−1 b+1 s+5 s+3 K =− − (b + 1) + s+2 s+2 s+1 s+1 −1 −bs − 3b + 2 (s + 1)(bs + 3b − 2) s+b , =− = s+2 s+1 (s + 2)(s + b) which will yield the desired H2 = −(b + 1). The closed-loop eigenvalue is in this case at −b as can easily be veriﬁed.

430

10 Feedback Control Systems

Parameterizations Using State-Space Descriptions −1

−1 3 , a doubly coprime factorization in RH∞ ; 3 N Consider H = N D = D i.e., (10.54) is satisﬁed. It is possible to express all proper and stable matrices in (10.54) in terms of the matrices of a state-space realization of the transfer function matrix H(s). In particular, we have the following result.

Lemma 10.14. Let {A, B, C, D} be a stabilizable and detectable realization s −1 of H(s), i.e., H(s) = C(sI − A) B + D, which is also denoted by H(s) = AB , and with (A, B) stabilizable and (A, C) detectable. Let F be a state CD feedback gain matrix such that all the eigenvalues of A + BF have negative real parts, and let K be an observer gain matrix such that all the eigenvalues of A − KC have negative real parts. Deﬁne ⎤ ⎡ A − KC B − KD K X Y s ⎣ −F U = (10.62) I 0⎦ 3 = 3 D −N −C −D I and

% = U

3 D −Y 3 N X

⎤ A + BF B −K s =⎣ F I 0 ⎦. C + DF D I

Then (10.54) holds and H = N D of H.

⎡

−1

3 =D

−1

(10.63)

3 are coprime factorizations N

Proof. Relation (10.54) can be shown to be true by direct computation, which % ∈ RH∞ . That N , D and D 3 , N 3 it is left to the reader to verify. Clearly, U , U −1 −1 3 = H 3 N are coprime is a direct consequence of (10.54). That N D = D can be shown by direct computation and is left to the reader. In view of Lemma 10.14, U and U

−1

∈ RH∞ in (10.54) can be expressed

as U =

X Y 3 3 D −N

and U

−1

=

I0 −F (10.64) [sI −(A−KC)]−1 [B −KD, K]+ −D I −C

I 0 F −1 . = [sI − (A + BF )] [B, −K] + DI C + DF

=

3 D −Y 3 N X

(10.65) These formulas can be used as follows. A stabilizable and detectable realization {A, B, C, D} of H(s) is ﬁrst determined, and appropriate F and K are found so that A + BF and A − KC have eigenvalues with negative real −1 parts. Then U and U are calculated from (10.64) and (10.65). Note that

10.4 Two Degrees of Freedom Controllers

431

appropriate state feedback gain matrices F and observer gain matrices K can be determined, using the methods discussed in Chapter 9. The matrices F and K may be determined, for example, by solving appropriate optimal linear quadratic control and ﬁltering problems. All proper stabilizing controllers −1 −1 3 2 of the plant H1 are then characterized as in Theo3 2 N H2 = N2 D 2 = D rem 10.11. It can now be shown, in view of Lemma 10.14, that all stabilizing controllers are described by x ˆ˙ = (A + BF − K(C + DF ))ˆ x + Ky + (B − KD)r1 , u = Fx ˆ + r1 , r2 = y − (C + DF )ˆ x − Dr1 , r1 = K (q)r2 ,

(10.66)

which can be rewritten as x ˆ˙ = Aˆ x + Bu + K(y − (C x ˆ + Du)), u = Fx ˆ + K (q)(y − (C x ˆ + Du)).

(10.67)

Thus, every stabilizing controller is a combination of an asymptotic (full-state, full-order) estimator or observer and a stabilizing state feedback, plus K (q)r2 with r2 = y − (C x ˆ + Du), the output “error” (see Figure 10.4). –D B +

+

y +

K +

+

^ x

∫

^ x

F

+

+

u +

A

–C r2

r1 K (q)

Figure 10.4. A state-space representation of all stabilizing controllers

10.4 Two Degrees of Freedom Controllers Consider the two degrees of freedom controller SC in the feedback conﬁguration of Figure 10.5. Here SH represents the system to be controlled and is described by its transfer function matrix H(s) so that yˆ(s) = H(s)ˆ u(s).

(10.68)

432

10 Feedback Control Systems

The two degrees of freedom controller SC is described by its transfer function matrix C(s) in yˆ(s) yˆ(s) u ˆ(s) = C(s) = [Cy (s), Cr (s)] . (10.69) rˆ(s) rˆ(s) Since the controller SC generates the input u to SH by processing independently y, the output of SH , and r, it is called a two degrees of freedom controller. r

SC

u

SH

y

Figure 10.5. Two degrees of freedom controller SC

In the following discussion, we shall assume that H is a proper transfer function and we shall determine proper controller transfer functions C, which internally stabilize the feedback system in Figure 10.5. The restriction that H and C are proper may easily be removed, if so desired. 10.4.1 Internal Stability Theorem 10.15. Given is the proper transfer function H of SH , and the proper transfer function C of SC in (10.69) where det(I − Cy H) = 0. The closed-loop system in Figure 10.5 is internally stable if and only if (i) u ˆ = Cy yˆ internally stabilizes the system yˆ = H u ˆ, and (ii) Cr is such that the rational matrix M (I − Cy H)−1 Cr

(10.70)

(u = M r) satisﬁes D−1 M = X, a stable rational matrix, where Cy satisﬁes (i) and H = N D−1 is a right coprime polynomial matrix factorization. Proof. Consider controllable and observable polynomial matrix descriptions (PMDs) for SH , given by Dz = u, and for SC , given by

y = Nz

( c z˜c = [N (y , N (r ] y , u = z˜c , D r

(10.71)

(10.72)

(y , N (r ] are lc polynomial matrices. The ( c , [N where the N, D are rc and the D closed-loop system is then described by

10.4 Two Degrees of Freedom Controllers

(cD − N (c N )z = N (r r, y = N z (D

433

(10.73)

( o , where D (o D ( cD − N (c N , have and is internally stable if the roots of det D negative real parts. (Necessity) Assume that the closed-loop system is internally stable, i.e., ( o−1 is stable. Since Cy = D (y is not necessarily a left coprime poly( c−1 N D ( ( Cy , N (Cy ], where GL is a gcld ( nomial factorization, write [Dc , Ny ] = GL [D ( ( ( ( ( ( ( of the pair (Dc , Ny ). Then DCy D − NCy N = G−1 L Do = Dk , where Dk ( −1 stable; note also that G−1 is stable. is a polynomial matrix, with D L k −1 ( ( Hence, u = Cy y = DCy NCy y internally stabilizes y = Hu = N D−1 u; i.e., part (i) of the theorem is true. To show that (ii) is true, we write ( Cy (D (r ) = DD (r = DX, where ( −1 D ( c−1 N ( −1 G−1 N M = (I − Cy H)−1 Cr = DD L k k −1 (r is a stable rational matrix. This shows that (ii) is also necessary. (o N XD ( c−1 [N (y , N (r ] (Suﬃciency) Let C satisfy (i) and (ii) of the theorem. If C = D ( ( ( ( is an lc polynomial MFD and GL is a gcld of the pair (Dc , Ny ), then [Dc , Ny ] = ( ( Cy , N (Cy ] is true for some lc matrices D ( Cy and N (Cy (Cy = D ( −1 N GL [D Cy Cy ). Be−1 ( Cy D − N (Cy N = D ( k , where D ( is stable. Premultiplycause (i) is satisﬁed, D k ( ( ( ( −1 ing by GL we obtain Dc D − Ny N = GL Dk . Now if G−1 L is stable, then Do , −1 ( k , will be stable since D ( cD − N (y N = GL D ( is stable. To show (o D where D k −1 ( −1 −1 −1 (r ) = D (r ( ( ( −1 G−1 N this, write D M = D (I − Cy H) Cr = Dk DCy (Dc−1 N L k (r are and note that this is stable, in view of (ii). Observe now that the GL , N ( c−1 [N (y , N (r ] would not be a coprime factorizalc; if they were not, then C = D (r (D ( −1 is ( −1 G−1 N tion. In this case no unstable cancellations take place in D L k k −1 −1 −1 (k) = D ( stable) and therefore, if D M is stable, then (GL D is stable or o the closed-loop system is internally stable. Remarks (i) It is straightforward to show the same results, using proper and stable factorizations of H given by H = N D−1 ,

(10.74)

where the pair (N , D ) ∈ RH∞ and (N , D ) is rc, and of −1

3 c [N 3 y , N 3 r ], C=D

(10.75)

3 y , N 3 r ]) ∈ RH∞ and (D 3 c , [N 3 y , N 3 r ]) is lc. The 3 c , [N where the pair (D proof is completely analogous and is left to the reader. The only change in the theorem will be in its part (ii), which will now read as follows: Cr is such that the rational matrix M (I − Cy H)−1 Cr satisﬁes D−1 M = X ∈ RH∞ , where Cy satisﬁes (a) and H = N D−1 is an rc MFD in RH∞ .

434

10 Feedback Control Systems

(ii) Theorem 10.15 separates the role of Cy , the feedback part of the two degrees of freedom controller C, from the role of Cr , in achieving internal stability. Clearly, if only feedback action is considered, then only part (i) of the theorem is of interest; and if open-loop control is desired, then Cy = 0 and (i) implies that for internal stability H must be stable and Cr = M must satisfy part (ii). In (ii) the parameter M = DX appears naturally and in (i) the way is open to use any desired feedback parameterizations. In view of Theorem 10.15 it is straightforward to parametrically characterize all internally stabilizing controllers C. In the theorem it is clearly stated [Part (i)] that Cy must be a stabilizing controller. Therefore, any parametric characterization of the ones developed in the previous subsections, as in [1, Subsection 7.4], can be used for Cy . Also, Cr is expressed in terms of D−1 M = X (or D −1 M = X ). ( ( −1 N Theorem 10.16. Given that yˆ = H u ˆ is proper with H = N D−1 = D doubly coprime polynomial MFDs, all internally stabilizing proper controllers yˆ C in u ˆ=C are given by rˆ (a)

C = (I+QH)−1 [Q, M ] = [(I+LN )D−1 ]−1 [L, X],

(10.76)

−1

where Q = DL and M = DX are proper with L, X and D (I + QH) = (I + LN )D−1 stable, so that (I + QH)−1 exists and is proper; or ( −1 [−(X2 +K D), ( X], C = (X1 −K N)

(b)

(10.77)

(1)−1 exists and C is proper. Also, where K and X are stable so that (X1 − K N (2 X1 X2 I0 D −X −1 X1 and X2 are determined from U U = = with ( D ( (1 0I −N N X U unimodular. 3 are doubly coprime MFDs in RH∞ , then all 3 −1 N If H = N D−1 = D stabilizing proper C are given by 3 )−1 [−(X +K D 3 ), X ], C = (X1 −K N 2

(c) where K , X ∈ X1 U U −1 = 3 −N (d)

3 −1 RH∞ so that (X ) exists and is proper. Also, 1 − K N 3 X2 I0 D −X 2 = with U , U −1 ∈ RH∞ . 3 3 1 0I D N X

C = (I +QH)−1 [Q, M ] = [(I +L N )D

(10.78)

−1 −1

]

[L , X ],

−1

(10.79)

where Q = D L , M = D X ∈ RH∞ with L , X and D (I + QH) = (I + L N )D−1 ∈ RH∞ so that (I + QH)−1 or (I + L N )−1 exists and is proper. Proof. The proof is based on the parameterizations of Section 10.3. For details, and for additional discussion of the parameters L and L , see [1, p. 624, Theorem 4.2.2].

10.4 Two Degrees of Freedom Controllers

435

Remarks (a) In [1, pp. 592–605] a complete treatment of diﬀerent parameterizations of all stabilizing controllers is given. Parameter K in the theorem above was discussed earlier and parameters Q, X and L are discussed in [1, pp. 597–605]. (b) Notice that in the above theorem Cy is parameterized by K or Q or L, whereas Cr is parameterized by M or X. 10.4.2 Response Maps It is straightforward to express the maps between signals of interest of Figure 10.6 in terms of the parameters in Theorem 10.16. For instance, y y u = C = [Cy , Cr ] = Cy Hu + Cr r, from which we have u = r r (I − Cy H)−1 Cr r = M r. (In the following discussion, we will use the symbols u, y, r, etc. instead of u ˆ, yˆ, rˆ, etc. for convenience.) If expressions in (d) of Theorem 10.16 are used, then u = D X r,

and y = Hu = N D−1 D X r = N X r

(10.80)

in view of (I − Cy H)−1 = D (I + L N )D−1 . Similar results can be derived using the other parameterizations in Theorem 10.16. To determine expressions for other maps of interest in control systems, consider Figure 10.6, where du and dy are assumed to be disturbances at the input and output of the plant H, respectively, and η denotes measurement noise. Then, y + dy + η u = [Cy , Cr ] + du , from which we have u = (I − Cy H)−1 [Cr r + r Cy dy + Cy η + du ] and y = Hu = H(I − Cy H)−1 [Cr r + Cy dy + Cy η + du ]. dy

du r C

+

+

u

H

y +

+

yo

η Figure 10.6. Two degrees of freedom control conﬁguration

Then, in view of (10.79) in Theorem 10.16, we obtain u = D X r + D L dy + D L η + D (I + L N )D−1 du = M r + Qdy + Qη + Si du and

(10.81)

436

10 Feedback Control Systems

y = N X r + N L dy + N L η + N (I + L N )D−1 du = T r + (So − I)dy + HQη + HSi du .

(10.82)

Notice that Q = (I − Cy H)−1 Cy = D L is the transfer function between u and dy or η. Also, Si (I − Cy H)−1 = D (I + L N )D−1 = I + QH

(10.83)

is the transfer function between u and du . The matrix Si is called the input comparison sensitivity matrix . Notice also that yo = y + dy = T r + So dy + HQη + HSi du ; i.e., So = (I − HCy )−1 = I + HQ

(10.84)

is the transfer function between yo and dy . The matrix So is called the output comparison sensitivity matrix . The sensitivity matrices Si and So are important quantities in control design. Now So − HQ = So − N L = I

(10.85)

since HQ = H(I − Cy H)−1 Cy = HCy (I − HCy )−1 = −I + (I − HCy )−1 = −I + So , where So and HQ are the transfer functions from yo to dy and η, respectively. Equation (10.85) states that disturbance attenuation (or sensitivity reduction) and noise attenuation cannot occur over the same frequency range. This is a fundamental limitation of the feedback loop and occurs also in two degrees of freedom control systems. Similarly we note that Si − QH = I.

(10.86)

We now summarize some of the relations discussed above: T = H(I − Cy H)−1 Cr = HM = N X −1

M = (I − Cy H)

−1

Q = (I − Cy H)

−1

So = (I − HCy )

−1

Si = (I − Cy H)

(y = T r),

Cr = DX

(u = M r),

Cy = DL

(u = Qdy ),

= I + HQ

(yo = So dy ),

= I + QH

(u = Si du ),

where y = T r denotes the relation between y and r from (10.82) when all the other signals are zero. Similar expressions hold for the rest of the relations. Realizing Desired Responses The input–output maps attainable from r, using an internally stable two degrees of freedom conﬁguration, can be characterized directly. In particular, consider the two maps described by

10.4 Two Degrees of Freedom Controllers

y T = r, u M

437

(10.87)

i.e., the command/output map T and the command/input map M . Let H = N D−1 be an rc polynomial MFD. Theorem 10.17. The stable rational function matrices T and M are realizable with internal stability by means of a two degrees of freedom control conﬁguration [which satisﬁes (10.87)] if and only if there exists a stable X so that T N = X. (10.88) M D Proof. (Necessity) Assume that T and M in (4.169) are realizable with internal stability. Then in view of Theorem 10.15, X D−1 M is stable. Also, y = Hu = (N D−1 )(M r) = N Xr. (Suﬃciency) Let (10.88) be satisﬁed. If X is stable, then T and M are stable. Also, note that T = HM . We now show that in this case a controller conﬁguration exists to implement these maps (see Figure 10.7). Note that y 2r + Cy (T%r + y) = [Cy , M 2 + Cy T%] , from which we obtain u=M r 2 + Cy T%)r. u = (I + Cy H)−1 (M

(10.89)

2 = M and T% = T , then in view of T = HM , this relation implies Now if M that u = (I + Cy H)−1 (I + Cy H)M r = M r and y = Hu = HM r = T r. Furthermore, Cy is a stabilizing feedback controller, and the system is internally 2 are stable. stable since T% and M

^ M r

+ ^ T

Cy

+

u

H

y

Figure 10.7. Feedback realization of (T, M )

Note that other (than Figure 10.7), internally stable controller conﬁgurations to attain these maps are possible. (The realization of both response maps T and M , instead of only T as in the case of the Model Matching Problem, makes the convenient formulation in Theorem 10.17 possible. The realization of both T and M is sometimes referred to as the Total Synthesis Problem; see [6], [7] and the references therein.) The results of Theorem 10.17 can be expressed in terms of H = N D−1 , rc MFDs in RH∞ . In particular, we have the following result.

438

10 Feedback Control Systems

Theorem 10.18. T, M ∈ RH∞ are realizable with internal stability by means of a two degrees of freedom control conﬁguration [which satisﬁes (10.87)] if and only if there exists X ∈ RH∞ so that T N (10.90) = X . D M Proof. The proof is completely analogous to the proof of Theorem 10.17, and it is omitted. Remarks

y T (i) It is now clear that given any desirable response maps = r u M T N such that = X , where X ∈ RH∞ , the pair (T, M ) can be M D realized with internal stability by using for instance a controller (10.79), C = [(I + L N )D−1 ]−1 [L , X ], where [(I + L N )D −1 , L ] ∈ RH∞ and X is given above, as can easily be veriﬁed. It is clear that there are many C, which realize such T and M , and they are all parameterized via the parameter L ∈ RH∞ , which for internal stability must satisfy the condition (I + L N )D−1 ∈ RH∞ . Other parameterizations such as K can also be used. In other words, the maps T, M can be realized by a variety of conﬁgurations, each with diﬀerent feedback properties. (ii) In a two degrees of freedom feedback control conﬁguration, all admissible responses from r under condition of internal stability are characterized in terms of the parameters X (or M ), whereas all response maps from disturbance and noise inputs that describe feedback properties of the system can be characterized in terms of parameters such as K or Q or L. This is the fundamental property of two degrees of freedom control systems: It is possible to attain the response maps from r independently from feedback properties such as response to disturances and sensitivity to plant parameter variations.

Example 10.19. We consider H(s) = (s−1)(s+2) and wish to character(s−2)2 ize all proper and stable transfer functions T (s) that can be realized by means of some control conﬁguration with internal stability. Let H(s) = −1 (s−2)2 s−1 = N D −1 be an rc M F D in RH∞ . Then in view of Theo2 (s+2) (s+2) −1

s+2 T = X ∈ RH∞ . Therefore, rem 10.18, all such T must satisfy N T = s−1 any proper T with a zero at +1 can be realized via a two degrees of freedom feedback controller with internal stability. In general, all unstable zeros of H must appear in T for internal stability to be possible. This shows a fundamental limitation of feedback control.

10.4 Two Degrees of Freedom Controllers

439

Now if a single degree of freedom controller must be used, the class of realizable T (s) under internal stability is restricted. In particular, if the unity feedback conﬁguration {I, Gf f , I} in Figure 10.10 below is used, then all proper and stable T that are realizable under internal stability are again given by T = N X = s−1 s+2 X where X = L ∈ RH∞ [see 10.100] and in addition −1

2

(s+2) (I + X N )D = (1 + X s−1 s+2 ) (s−2)2 ∈ RH∞ ; i.e., X = nx /dx is proper and stable and should also satisfy (s + 2)dx + (s − 1)nx = (s − 2)2 p(s) for some polynomial p(s). This illustrates the restrictions imposed by the unity feedback controller, as opposed to a two degrees of freedom controller.

It is not diﬃcult to prove the following result. Theorem 10.20. T, M, S ∈ RH∞ are realizable with internal stability by a two degrees of freedom control conﬁguration that satisfy (10.87) and (10.85) [S = So , see Figure 10.6 and (10.81), (10.82)] if and only if there exist X , L ∈ RH∞ so that ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ T 0 N 0 X ⎣ M ⎦ = ⎣ D 0 ⎦ ⎣ 0⎦, + (10.91) L 0 N S I where (I + L N )D−1 ∈ RH∞ . Similarly, T, M, Q ∈ RH∞ are realizable if and only if there exist X , L ∈ RH∞ so that ⎡ ⎤ ⎡ ⎤ T N 0 ⎣ M ⎦ = ⎣ D 0 ⎦ X , (10.92) L 0 D Q where (I + L N )D−1 ∈ RH∞ . Proof. The proof is straightfoward in view of Theorem 10.18. Note that S or Q are selected in such a manner that the feedback loop has desirable feedback characteristics that are expressed in terms of these maps. 10.4.3 Controller Implementations The controller C = [Cy , Cr ] may be implemented, for example, as a system Sc as shown in Figure 10.5 and described by (10.72); or as shown in Figure 10.7 with C = [Cy , M + Cy T ], where Cy stabilizes H and T, M are desired stable maps that relate r to y and r to u; i.e., y = T r and u = M r. There are also alternative ways of implementing a stabilizing controller C. In the following discussion, the common control conﬁguration of Figure 10.8, denoted by {R; Gf f , Gf b }, is brieﬂy discussed together with several special cases.

440

10 Feedback Control Systems r

+

R

u

Gff

y

H

+ Gfb

Figure 10.8. Two degrees of freedom controller {R; Gf f , Gf b }

{R; Gf f , Gf b } Conﬁguration Consider the system in Figure 10.8. Note that since y y u = [Cy , Cr ] = [Gf f Gf b , Gf f R] , r r

(10.93)

{R; Gf f , Gf b } is a two degrees of freedom control conﬁguration that is as general as the ones discussed before. To see this, let C = [Cy , Cr ] = −1 3 c [N 3 y , N 3 r ] be an lc MFD in RH∞ and let D −1

3 r , Gf f = D 3 , Gf b = N 3 y . R=N c

(10.94)

Note that R and Gf b are always stable; also, G−1 f f exists and is stable. Assume now that C was chosen so that 3 c D − N 3 y N = U 3 , D

(10.95)

−1

3 , U 3 ∈ RH∞ . Then the system in Figure 10.8 with R, Gf f and Gf b where U given in (10.94) is internally stable. See [1, p. 630] for the proof of this claim. We shall now discuss brieﬂy some special cases of the {R; Gf f , Gf b } control conﬁguration, which are quite common in practice. Note that the conﬁgurations below are simpler; however, they restrict the choices of attainable response maps and so the ﬂexibility oﬀered to the control designer is reduced. (i) {I; Gf f , Gf b } Controller

r

+

Gff

u

H

y

+ Gfb

Figure 10.9. The {I; Gf f , Gf b } controller

In this case u = [Cy , Cr ]

y y = [Gf f Gf b , Gf f ] ; that is, r r

10.4 Two Degrees of Freedom Controllers

Cy = Cr Gf b .

441

(10.96)

See Figure 10.9. In view of (10.79) given in Theorem 10.16, this implies that L = X Gf b

(10.97)

or that the choice for the parameters L and X is not completely independent as in the {R; Gf f , Gf b } case. The L and X must of course satisfy L , X and (I + L N )D−1 ∈ RH∞ . In addition, in this case L and X must be so that a proper solution Gf b of (10.97) exists and no unstable poles cancel in X Gf b . Note that these poles will cancel in the product Gf f Gf b and will lead to an unstable system. Since L and X are both stable, we will require that (10.97) has a solution Gf b ∈ RH∞ . This implies that if, for example, X −1 exists, then X and L must be such that X −1 L ∈ RH∞ ; i.e., the X and L have the same unstable zeros and L is “more proper” than X . This provides some guidelines about the conditions X and L must satisfy. Also, Gf f = [(I + L N )D−1 ]−1 X .

(10.98)

It should be noted that the state feedback law implemented by a dynamic observer can be represented as a {I; Gf f , Gf b } controller. See [1, Section 7.4B, Figure 7.8]. (ii) {I; Gf f , I} Controller

r

+

Gff

u

H

y

+

Figure 10.10. The {I; Gf f , I} controller

A special case of (i) is the common conﬁguration; unity feedback control y y see Figure 10.10. Here u = [Cy , Cr ] = [Gf f , Gf f ] ; that is, r r Cr = Cy ,

(10.99)

which in view of (10.79) implies that X = L .

(10.100)

In this case the responses between y or u and r (characterized by X ) cannot be designed independently of feedback properties such as sensitivity (characterized by L ). This is a single degree of freedom controller and is used primarily to attain feedback control speciﬁcations. This case is discussed further below.

442

10 Feedback Control Systems r

R

+

Gff

u

H

y

+

Figure 10.11. The {R; Gf f , I} controller

(iii) {R; Gf f , I} Controller y y = [Gf f , Gf f R] ; that is, Here u = [Cy , Cr ] r r Cr = Cy R.

(10.101)

See Figure 10.11. In view of (10.79) given in Theorem 10.16, this implies that X = L R.

(10.102)

The L and X must satisfy L , X , (I + L N )D−1 ∈ RH∞ . In addition, they must be such that (10.102) has a solution R ∈ RH∞ . Note that R stable is necessary for internal stability. The reader should refer to the discussion in (i) above for the implications of such assumptions on X and L . Also, Gf f = [(I + L N )D−1 ]−1 L .

(10.103)

(iv) {R; I, Gf b } Controller

r

R

+

u

H

y

+ Gfb

Figure 10.12. The {R; I, Gf b } controller

In this case u = [Cy , Cr ]

y y = [Gf b , R] . r r

(10.104)

See Figure 10.12. For internal stability, R must be stable. In view of (10.79) given in Theorem 10.16, this implies the requirement [(I + L N )D−1 ]−1 X ∈ RH∞ , in addition to L , X , (I +L N )D−1 ∈ RH∞ , which imposes signiﬁcant additional restrictions on L . Here [Gf b , R] = [(I + L N )D−1 ]−1 [L , X ].

(10.105)

10.4 Two Degrees of Freedom Controllers +

r

u

443

y

H

+ Gfb

Figure 10.13. The {I; I, Gf b } controller

(v) {I; I, Gf b } Controller This is a special case of (iv), a single degree of freedom case where R = I; see Figure 10.13. Here, R = I implies that X = (I + L N )D−1 ,

(10.106)

or that, X and L must satisfy additionally the relation D X − L N = I,

(10.107)

a (skew) Diophantine Equation. This is in addition to the condition that L , X , (I + L N )D−1 ∈ RH∞ . Unity (Error) Feedback Conﬁguration Consider the unity feedback (error feedback) control system depicted in Figure 10.14, where H and C are the transfer function matrices of the plant and controller, respectively [see also Figure 10.10 and (10.99), (10.100)]. This conﬁguration is studied further below. d r

+ _

e C

u

y H

Figure 10.14. Unity feedback control system

Assume that (I + HC)−1 exists. It is not diﬃcult to verify the relations y = (I + HC)−1 HCr + (I + HC)−1 d T r + Sd, u = (I + CH)−1 Cr − (I + CH)−1 Cd M r − M d.

(10.108)

If they are compared with relations (10.81)–(10.86) for the two degrees of freedom controller, then u = Cy y + Cr r, Cy = −C and Cr = C, since u = −Cy + Cr. Hence, for the error feedback system of Figure 10.14, the relations following (10.86) assume the forms

444

10 Feedback Control Systems

M = (I + CH)−1 C = DX = −Q = −DL, T = H(I + CH)−1 C = (I + HC)−1 HC = HM = N X, So = (I + HC)−1 = I + HQ = I − HM = I − T, Si = (I + CH)−1 = I + QH = I − M H.

(10.109)

If now Theorem 10.16 is applied to the present error feedback case, then it can be seen that all stabilizing controllers are given by C = [(I − XN )D−1 ]−1 X,

(10.110)

where [(I − XN )D−1 , X] is stable and (I − XN )−1 exists. H = N D−1 is a right coprime (rc) polynomial matrix factorization. Similarly, it can be shown by applying Theorem 10.16 that if H is proper −1 and H = N D is an rc MFD in RH∞ , then all proper stabilizing controllers are given by −1 (10.111) C = [(I − X N )D ]−1 X , where [(I − X N )D

−1

, X ] ∈ RH∞ and (I − X N )−1 exists and is proper.

H Square and Nonsingular Assume now that H is proper and H −1 exists; i.e., H is square and nonsingular. Let H = N D−1 be an rc polynomial MFD. If T is the closed-loop transfer function between y and r, it can be shown that the system will be internally stable if and only if (10.112) [N −1 (I − T )H, N −1 T ] is stable. Assume that T = I in order for the loop to be well deﬁned. Note that if T is proper, then C = H −1 T (I − T )−1

(10.113)

is proper if and only if H −1 T is proper and I − T is biproper. SISO Case If, in addition, it is assumed that H and T are single-input, single-output transfer functions with H = n/d, the closed-loop system will be stable if and only if (10.114) (1 − T )d−1 = Sd−1 and T n−1 are stable, i.e., if and only if the sensitivity matrix has as zeros all the unstable poles of the plant and the closed-loop transfer function has as zeros all the unstable zeros of the plant. This is a result that is well known in the classical control literature (refer to the book by J. R. Ragazzini and G. F. Franklin, Sampled Data Control Systems, McGraw-Hill, New York, 1958). It is derived here by specializing the more general multi-input, multi-output case results to the single-input, single-output case.

10.4 Two Degrees of Freedom Controllers

445

s−1 Example 10.21. Given H(s) = (s−2)(s+1) , all scalar proper transfer functions T that can be realized via the error feedback conﬁguration, shown in Figure 10.14, under internal stability, are to be characterized. When an error feedback conﬁguration is used, T must satisfy the following conditions: dT −nT nT −1 −1 [(1 − T )d , T n ] = (s−2)(s+1) , dT (s−1) stable; that is, T must be stable and dT − nT = (s − 2)dˆT , nT = (s − 1)ˆ nT (T must have as zero the un-

stable zero of H). The controller C =

nT (s−2)(s+1) (dT −nT )(s−1)

=

n ˆ T (s+1) . For dˆT T T = dTd−n T

C to be

proper H −1 T = must be proper and 1 − must be biproper; these are satisﬁed when deg dT ≥ deg nT + 1. The closed-loop eigenvalues are the zeros of dc d + nc n = dˆT (s − 2)(s + 1) + n ˆ T (s + 1)(s − 1) = (s + 1)[(dT − nT ) + nT ] = (s + 1)dT . If T is to be realized via a two degrees of freedom controller instead, in view of Theorem 10.17, the stability requirement is that T = N X = (s − 1)X with X stable. It may be of interest to use Theorem 10.18 and proper and stable factoriza −1 s−1 s−1 s−2 = (s+1) . Then T is realiztions. In this case, let H = (s−2)(s+1) 2 s+1 able with internal stability using a two degrees of freedom conﬁguration if and 2 nT only if N −1 T = (s+1) nT (s−1)dT = X is proper and stable. That is nT = (s − 1)ˆ −1 −1 and deg dT ≥ deg nT + 1. In the error feedback case, [(1 − T )d , T n ] = (dT −nT )(s+1) nt (s+1)2 , dT (s−1) must be proper and stable, which imply, for stabildT (s−2) ity, that T should be stable, dT − nT = (s − 2)dˆT , nT = (s − 1)ˆ nT ; and for properness, deg dT ≥ deg nT + 1 as before. (s−2)(s+1)nT (s−1)dT

10.4.4 Some Control Problems In control problems, design speciﬁcations typically include requirements for internal stability or pole placement, low sensitivity to parameter variations, disturbance attenuation, and noise reduction. Also, requirements such as model matching, diagonal decoupling, static decoupling, regulation, and tracking are included in the speciﬁcations. Internal stability has, of course, been a central theme throughout this book, and in this section, all stabilizing controllers were parameterized. Pole placement was also studied in Chapter 9, using state feedback. Sensitivity and disturbance noise reduction are treated by appropriately selecting the feedback controller Cy . Methodologies to accomplish these control goals, frequently in an optimal way, are developed in many control books. It should be noted that many important design approaches such as the H∞ optimal control design method are based on the parameterizations of all feedback stabilizing controllers discussed above. In particular, an appropriate or optimal controller

446

10 Feedback Control Systems

is selected by restricting the parameters used, so that additional control goals are accomplished optimally, while guaranteeing internal stability in the loop. Our development of the theory of two degrees of freedom controllers can be used directly to study model matching and decoupling, and a brief outline of this approach is given in the following. Note that this does not, by far, constitute a complete treatment of these important control problems, but rather, an illustration of the methodologies introduced in this section. Model Matching Problem In the model matching problem, the transfer function of the plant H(s) (y = Hu) and a desired transfer function T (s) (y = T r) are given and a transfer function M (s) (u = M r) is sought so that T (s) = H(s)M (s).

(10.115)

Typically, H(s) is proper, and the proper and stable T (s) is to be obtained from H(s) using a controller under the condition of internal stability. Therefore, M (s) can in general not be implemented as an open-loop controller, but rather, as a two degrees of freedom controller. In view of Theorem 10.18, −1 is an rc MFD in RH∞ , then the pair (T, M ) can be realif H = N D ized with internal stability if and only if there exists X ∈ RH∞ so that T N X . Note that an M that satisﬁes (10.115) must ﬁrst be se= D M lected (there may be an inﬁnite number of solutions M ). In the case when det H(s) = 0, T can be realized with internal stability by means of a two −1 degrees of freedom control conﬁguration if and only if N T = X ∈ RH∞ (see Example 10.19). In this case M = D X . Now if the model matching is to be achieved by a more restricted control conﬁguration, then additional conditions are imposed on T for this to happen, which are expressed in terms of X (see, for instance, Example 10.19 for the case of the unity feedback conﬁguration). Decoupling Problem In the problem of diagonal decoupling, T (s) in (10.115) is not completely speciﬁed but is required to be diagonal, proper, and stable. In this problem the ﬁrst input aﬀects only the ﬁrst output, the second input aﬀects only the second output, and so forth. If H(s)−1 exists, then diagonal decoupling under internal stability via a two degrees of freedom control conﬁguration is possible if and only if ⎡ n1 ⎤ N

−1

T =N

−1

⎢ ⎣

d1

..

⎥ ⎦ = X ∈ RH∞ ,

. nm dm

(10.116)

10.5 Summary and Highlights

447

−1

where H = N D is an rc MFD in RH∞ and T (s) = diag[ni (s)/di (s)], i = 1, . . . , m. It is clear that if H(s) has only stable zeros, then no additional restrictions are imposed on T (s). Relation (10.116) implies restrictions on the zeros of ni (s) when H(s) has unstable zeros. It is straightforward to show that if diagonal decoupling is to be accomplished by means of more restricted control conﬁgurations, then additional restrictions will be imposed on T (s) via X . (See Exercise 10.5 below for the case of diagonal decoupling via linear state feedback.) A problem closely related to the diagonal decoupling problem is the problem of the inverse of H(s). In this case, T (s) = I. In the problem of static decoupling, T (s) ∈ RH∞ m is square and also satisﬁes T (0) = Λ, a real nonsingular diagonal matrix. An example of such 2 2 s + 1 s(s + 2) 1 T (s) is T (s) = d(s) , where d(s) is a Hurwitz polynos(s + 2) s2 + 3s + 1 mial. Note that if T (0) = Λ, then a step change in the ﬁrst input r will aﬀect only the ﬁrst output in y at steady-state and so forth. Here y = T r = T 1s and lims→0 sT 1s = T (0) = Λ, which is diagonal and nonsingular. For this to happen, with internal stability when H(s) is nonsingular (see Theorem 10.18), −1 we must have N T = X ∈ RH∞ , from which can be seen that static decoupling is possible if and only if H(s) does not have zeros at s = 0. If this is the case and if in addition H(s) is stable, static decoupling can be achieved with just a precompensation by a real gain matrix G where G = H −1 (0)Λ. In this case T (s) = H(s)G = H(s)H −1 (0)Λ from which T (0) = Λ.

10.5 Summary and Highlights Interconnected Systems—Feedback •

•

Let y = H1 u and u = H2 y + r, where the plant H1 = N1 D1−1 , and the (2 are both coprime MFD. Then the closed-loop ( −1 N controller H2 = D 2 ( 2 D1 − N (2 N1 ) is a Hurwitz polynomial system is stable if and only if det(D −1 I −H2 are stable (see Theorem 10.4). or the poles of −H1 I The Diophantine Equation ( 2 D1 − N (2 N1 = D (k D

•

( k are the closed-loop is important for feedback systems. The roots of det D eigenvalues. See (10.30). For interconnected systems in parallel and series, see (10.3)–(10.5) and (10.6)–(10.8).

448

10 Feedback Control Systems

Parameterization of All Stabilizing Feedback Controllers •

(1 , a doubly coprime factorization, all feed( −1 N Given H1 = N1 D1−1 = D 1 back stabilizing controllers H2 are given by (1 )−1 (D ( 1) ( k X1 − N (k N ( k Y1 + N (k D H2 = −(D (1 Dk − N1 Nk )−1 , = −(Y(1 Dk + D1 Nk )(X where U U −1 =

X1 Y1 (1 (1 D −N

D1 −Y˜1 I0 = (1 0I N1 X

(10.44)

(10.41)

(k and Nk in with U a unimodular matrix. The polynomial matrices N ( −1 N (k = Nk D−1 = K D k k

•

(10.51)

( −1 , D−1 stable; the closed-loop eigenvalues are the are arbitrary and D k k ( k or of det Dk (see Theorem 10.6). roots of det D Equivalently, all stabilizing controllers are given by (1 )−1 (Y1 + K D ( 1) H2 = −(X1 − K N (1 − N1 K)−1 , = −(Y(1 + D1 K)(X

•

•

(10.50)

where the poles of K are the closed-loop eigenvalues (see Theorem 10.7). −1 −1 3 1 , a doubly coprime MFDs in RH∞ , then 3 1 N Given H1 = N1 D 1 = D all proper stabilizing controllers H2 are given by 3 1 )−1 (Y + K D 3 1 ) = −(Y 3 1 + D K )(X 3 1 − N K )−1 , H2 = −(X1 − K N 1 1 1 (10.58) where K ∈ RH∞ , any rational proper and stable matrix (see Theorem 10.11). See (10.67) for all stabilizing controllers in terms of state-space descriptions.

Two Degrees of Freedom Controllers •

Given H = N D−1 right coprime, u ˆ(s) = [Cy (s), Cr (s)]

yˆ(s) rˆ(s)

stabilizes H if and only if ˆ, and (i) u ˆ = Cy yˆ stabilizes yˆ = H u (ii) Cr is such that M (I − Cy H)−1 Cr (u = M r) satisﬁes D rem 10.15).

−1

(10.69)

(10.70)

M = X, a stable rational matrix (see Theo-

10.6 Notes

• • •

• •

449

See Theorem 10.16 for parameterizations of all stabilizing two degrees of freedom controllers. See (10.81) and (10.82) for relations between u, y and external inputs and disturbances. Given y = N D−1 u, y = T r and u = M r are realizable via any control conﬁguration with internal stability if and only if T N = X, M D where X is stable. See Theorems 10.17 and 10.18. The cases when a more restricted controller is used are addressed. See (10.96)–(10.107). The error or unity feedback controller is further discussed in (10.108)–(10.114). The model matching problem, the diagonal decoupling problem, and the static decoupling problem are discussed. See Subsection 10.4.4.

10.6 Notes Two books that are original sources on the use of polynomial matrix descriptions in Systems and Control are Rosenbrock [18] and Wolovich [22]. In the former, what is now called Rosenbrock’s matrix is employed and relations to state-space descriptions are emphasized. In the latter, what are now called Polynomial Matrix Fractional Descriptions are emphasized and the relation to state space is accomplished primarily by using controller forms and the Structure Theorem, which was presented in Chap 6. Good general sources for the polynomial matrix description approach include also the books by Vardulakis [19], Kailath [16], and Chen [9]. A good source for the study of feedback systems using PMDs and MFDs is the book by Callier and Desoer [8]. The development of the properties of interconnected systems, addressed in Section 10.2, which include controllability, observability, and stability of systems in parallel, in series, and in feedback conﬁgurations is primarily based on the approach taken in Antsaklis and Sain [7], Antsaklis [3] and [4], and Gonzalez and Antsaklis [14]. Parameterizations of all stabilizing controllers are of course very important in control theory today. Historically, their development appears to have evolved in the following manner (see also the historical remarks on the Diophantine Equation in [1, Subsection 7.2E]): Youla et al. [23] introduced the K parameterization (as in Theorem 10.7 above) in 1976 and used it in the Wiener–Hopf design of optimal controllers. This work is considered to be the seminal contribution in this area. The proofs of the results on the parameterizations in Youla et al. [23] involve transfer functions and their characteristic polynomials. Neither the Diophantine Equation nor PMDs of the system are used (explicitly). It should be recalled that in the middle 1970s most of the

450

10 Feedback Control Systems

control results in the literature concerning MIMO systems involved statespace descriptions and a few employed transfer function matrices. The PMD descriptions of systems were only beginning to make some impact. A version of the linear Diophantine Equation, namely, AX + Y B = C polynomial in z −1 was used in control design by Kucera in work reported in 1974 and 1975. In that work, parameterizations of all stabilizing controllers were implicit, not explicit, in the sense that the stabilizing controllers were expressed in terms of the general solution of the Diophantine Equation, which in turn can be described parametrically. Explicit parameterizations were reported later in Kucera [17] in 1979. Antsaklis [2] in 1979 introduced the doubly coprime MFDs (used in this book and in the literature) for the ﬁrst time with the polynomial Diophantine Equation, working over the ring of polynomials, to derive parameterizations of all stabilizing controllers and to prove the results by Youla et al. in an alternative way. In this work, internal system descriptions were connected directly to stabilizing controller parameterizations via the polynomial Diophantine Equation. In Desoer et al. [10] in 1980 parameterizations K of all stabilizing controllers using coprime MFDs in rings other than polynomial rings (including the ring of proper and stable rational functions) were derived. It should also be noted that proper and stable MFDs had apparently been used earlier by Vidyasagar. In Zames [24] in 1981, a parameterization Q of all stabilizing controllers, but only for stable plants was introduced and used in H∞ optimal control design. (Similar parameterizations were also used elsewhere, but apparently not to characterize all stabilizing controllers; for example, they were used in the design of the closed-loop transfer function in control systems and in sensitivity studies in the 1950s and 1960s, and also in the “internal model control” studies in chemical process control in the 1980s.) A parameterization X of all stabilizing controllers (where X is closely related to the attainable response in an error feedback control system), valid for unstable plants as well, was introduced in Antsakis and Sain [6]. Parameterizations involving proper and stable MFDs were further developed in the 1980s in connection with optimal control design methodologies, such as H∞ optimal control, and connections to state-space approaches were derived. Two degrees of freedom controllers were also studied, and the limitations of the diﬀerent control conﬁgurations became better understood. By now, MDFs and PMDs have become important system representations and their study is essential, if optimal control design methodologies are to be well understood. See [1, Subsections 7.2E and Section 7.6] for further discussion of controller parameterizations. The material on two degrees of freedom controllers in Section 10.4 is based on Antsaklis [4] and Gonzalez and Antsaklis [12], [13], [14], [15]; a good source for this topic is also Vidyasagar [20]. Note that the main stability theorem (Theorem 10.15) ﬁrst appeared in Antsaklis [4] and Antsaklis and Gonzalez [5]. For additional material on model matching and decoupling, consult Chen [9], Kailath [16], Falb and Wolovich [11], Williams and Antsaklis [21], and the extensive list of references therein.

References

451

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. P.J. Antsaklis, “Some relations satisﬁed by prime polynomial matrices and their role in linear multivariable system theory,” IEEE Trans. Auto. Control, Vol. AC-24, No. 4, pp. 611–616, August 1979. 3. P.J. Antsaklis, Notes on: Polynomial Matrix Representation of Linear Control Systems, Pub. No. 80/17, Dept. of Elec. Engr., Imperial College, 1980. 4. P.J. Antsaklis, Lecture Notes of the graduate course, Feedback Systems, University of Notre Dame, Spring 1985. 5. P.J. Antsaklis and O.R. Gonzalez, “Stability parameterizations and stable hidden modes in two degrees of freedom control design,” Proc. of the 25th Annual Allerton Conference on Communication, Control and Computing, pp. 546–555, Monticelo, IL, Sept. 30–Oct. 2, 1987. 6. P.J. Antsaklis and M.K. Sain, “Unity feedback compensation of unstable plants,” Proc. of the 20th IEEE Conf. on Decision and Control, pp. 305–308, Dec. 1981. 7. P.J. Antsaklis and M.K. Sain, “Feedback controller parameterizations: ﬁnite hidden modes and causality,” in Multivariable Control: New Concepts and Tools, S. G. Tzafestas, Ed., D. Reidel Pub., Dordrecht, Holland, 1984. 8. F.M. Callier and C.A. Desoer, Multivariable Feedback Systems, Springer-Verlag, New York, NY, 1982. 9. C.T. Chen, Linear System Theory and Design, Holt, Reinehart and Winston, New York, NY, 1984. 10. C.A. Desoer, R.W. Liu, J. Murray, and R. Saeks, “Feedback system design: the fractional approach to analysis and synthesis,” IEEE Trans. Auto. Control, Vol. AC-25, pp. 399–412, June 1980. 11. P.L. Falb and W.A. Wolovich, “Decoupling in the design of multivariable control systems,” IEEE Trans. Auto. Control, Vol. AC-12, pp. 651–659, 1967. 12. O.R. Gonzalez and P.J. Antsaklis, “Implementations of two degrees of freedom controllers,” Proc. of the 1989 American Control Conference, pp. 269–273, Pittsburgh, PA, June 21–23, 1989. 13. O.R. Gonzalez and P.J. Antsaklis, “Sensitivity considerations in the control of generalized plants,” IEEE Trans. Auto. Control, Vol. 34, No. 8, pp. 885–888, August 1989. 14. O.R. Gonzalez and P.J. Antsaklis, “Hidden modes of two degrees of freedom systems in control design,” IEEE Trans. Auto. Control, Vol. 35, No. 4, pp. 502– 506, April 1990. 15. O.R. Gonzalez and P.J. Antsaklis, “Internal models in regulation, stabilization and tracking,” Int. J. Control, Vol. 53, No. 2, pp. 411–430, 1991. 16. T. Kailath, Linear Systems, Prentice-Hall, Englewood Cliﬀs, NJ, 1980. 17. V. Kucera, Discrete Linear Control, Wiley, New York, NY, 1979. 18. H. H. Rosenbrock, State-Space and Multivariable Theory, Wiley, New York, NY, 1970. 19. A.I.G. Vardulakis, Linear Multivariable Control. Algebraic Analysis and Synthesis Methods, Wiley, New York, NY, 1991. 20. M. Vidyasagar, Control System Synthesis. A Factorization Approach, MIT Press, Cambridge, MA, 1985. 21. T. Williams and P.J. Antsaklis, “Decoupling,” The Control Handbook, Chapter 50, pp. 745–804, CRC Press and IEEE Press, New York, NY, 1996.

452

10 Feedback Control Systems

22. W.A. Wolovich, Linear Multivariable Systems, Springer-Verlag, New York, NY, 1974. 23. D.C. Youla, H.A. Jabr, and J.J. Bongiorno, Jr., “Modern Wiener–Hopf design of optimal controllers – Part II: The multivariable case,” IEEE Trans. Auto. Control, Vol. AC-21, pp. 319–338, June 1976. 24. G. Zames, “Feedback and optimal sensitivity: model reference transformations, multiplicative seminorms, and approximate inverses,” IEEE Trans. Auto. Control, Vol. 26, pp. 301–320, 1981.

Exercises 10.1. Consider the double integrator H1 =

1 s2 .

(a) Characterize all stabilizing controllers H2 for H1 . (b) Characterize all proper stabilizing controllers H2 for H1 of order 1. 10.2. Consider the double integrator H1 =

1 s2 .

(a) Derive a minimal state-space realization for H1 , and use Lemma 10.14 to derive doubly coprime factorizations in RH∞ . (b) Use the polynomial Diophantine Equations to derive factorizations in RH∞ . 2

s+1 10.3. Consider H1 = [ s s+1 2 , s3 ].

(a) Derive a minimal state-space realization {A, B, C, D}, and use Lemma 10.14 and Theorem 10.11 to parameterize all stabilizing controllers H2 . (b) Derive a stabilizing controller H2 of order three by appropriately selecting K . What are the closed-loop eigenvalues in this case? Comment on your results. 1 2 s+1 s+3 10.4. Consider H = . 1 1 s+1 s+1 −1

(a) Derive anrc MFD in RH∞ , H = N D . n1 0 (b) Let T = d1 n2 , and characterize all diagonal T that can be realized 0 d2 under internal stability via a two degrees of freedom control conﬁguration.

10.5. In the model matching problem, the transfer function matrices H ∈ Rp×m (s) of the plant and T ∈ Rp×m (s) of the model must be found so that T = HM . M is to be realized via a feedback control conﬁguration under internal stability. Here we are interested in the model matching problem via linear state feedback . For this purpose, let H = N D−1 an rc polynomial factorization with D column reduced. Then Dz = u, y = N z is a minimal realization of H. Let the state feedback control law be deﬁned by u = F z +Gr, where F ∈ R[s]m×m , G ∈ Rm×m with det G = 0 and degcj F < degcj D. To

Exercises

453

allow additional ﬂexibility, let r = Kv and K ∈ Rm×q . Note that HF,GK = N DF−1 GK = (N D−1 )(DDF−1 GK) = (N D−1 )[D(G−1 DF )−1 K] = HM where DF = D − F . In view of the above, solve the model matching problem via linear state feedback, determine F, G, and K, and comment your results when (a) H = (b) H =

(s+1)(s+2) 2 −3s+2 , 2ss+1 0 s 1

s+2 s s+3 s+1 s+2 1 s+1 0

s s+2

(c) H =

T = ,

,

s+1 s+2 ,

T = I2 , T =

s+1 s+4 −2 (s+2)(s+4)

.

Hint: The model matching problem via linear state feedback is quite easy to solve when p = m and rank H = m in view of (G−1 DF )−1 K = D−1 M = D−1 H −1 T = N −1 T .

A Appendix

This appendix consists of nine parts. In the ﬁrst eight, Sections A.1–A.8, we present results from linear algebra used throughout this book. In the last part, Section A.9, we address some numerical considerations. In all cases, our aim is to present a concise summary of pertinent results and not a full development of the subject on hand. For a more extensive exposition of the materials presented herein, refer to Antsaklis and Michel [1, Section 2.2] and to the other sources cited at the end of this appendix.

A.1 Vector Spaces In deﬁning vector space, we require the notion of a ﬁeld. A.1.1 Fields Deﬁnition A.1. Let F be a set containing more than one element, and let there be two operations “+” and “·” deﬁned on F (i.e., “+” and “·” are mappings of F × F into F ), called addition and multiplication, respectively. Then for each α, β ∈ F there is a unique element α + β ∈ F , called the sum of α and β, and a unique element αβ α · β ∈ F , called the product of α and β. We say that {F ; +, ·} is a ﬁeld provided that the following axioms are satisﬁed: α + (β + γ) = (α + β) + γ and α · (β · γ) = (α · β) · γ for all α, β, γ ∈ F (i.e., “+” and “·” are associative operations); (ii) α + β = β + α and α · β = β · α for all α, β ∈ F (i.e., “+” and “·” are commutative operations); (iii) α · (β + γ) = α · β + α · γ for all all α, β, γ ∈ F (i.e., “·” is distributive over “+”); (iv) There exists an element 0F ∈ F such that 0F + α = α for all α ∈ F (i.e., 0F is the identity element of F with respect to “+”); (i)

456

A Appendix

(v) There exists an element 1F ∈ F, 1F = 0F , such that 1F · α = α for all α ∈ F (i.e., 1F is the identity element of F with respect to “·”); (vi) For every α ∈ F , there exists an element −α ∈ F such that α+(−α) = 0F (i.e., −α is the additive inverse of F ); (vii) For any α = 0F , there exists an α−1 ∈ F such that α · (α−1 ) = 1F (i.e., α−1 is the multiplicative inverse of F ). In the sequel, we will usually speak of a ﬁeld F rather than of “a ﬁeld {F ; +, ·}.” Perhaps the most widely known ﬁelds are the ﬁeld of real numbers R and the ﬁeld of complex numbers C. Another ﬁeld that we will encounter (see Example A.11) is the ﬁeld of rational functions (i.e., rational fractions over polynomials). As a third example, we let F = {0, 1} and we deﬁne on F (binary) addition as 0 + 0 = 0 = 1 + 1, 1 + 0 = 1 = 0 + 1 and (binary) multiplication as 1 · 0 = 0 · 1 = 0 · 0 = 0, 1 · 1 = 1. It is easily veriﬁed that {F ; +, ·} is a ﬁeld. As a fourth example, let P denote the set of polynomials with real coeﬃcients and deﬁne addition “+” and multiplication “·” on P in the usual manner. Then {F ; +, ·} is not a ﬁeld since, e.g., axiom (vii) in Deﬁnition A.1 is violated (i.e., the multiplicative inverse of a polynomial p ∈ P is not necessarily a polynomial). A.1.2 Vector Spaces Deﬁnition A.2. Let V be a nonempty set, F a ﬁeld, “+” a mapping of V ×V into V , and “·” a mapping of F × V into V . Let the members x ∈ V be called vectors, let the elements α ∈ F be called scalars, let the operation “+” deﬁned on V be called vector addition, and let the mapping “·” be called scalar multiplication or multiplication of vectors by scalars. Then for each x, y ∈ V , there is a unique element, x + y ∈ V , called the sum of x and y, and for each x ∈ V and α ∈ F , there is a unique element, αx α · x ∈ V , called the multiple of x by α. We say that the nonempty set V and the ﬁeld F , along with the two mappings of vector addition and scalar multiplication, constitute a vector space or a linear space if the following axioms are satisﬁed: (i) x + y = y + x for every x, y ∈ V ; (ii) x + (y + z) = (x + y) + z for every x, y, z ∈ V ; (iii) There is a unique vector in V , called the zero vector or the null vector or the origin, that is denoted by 0V and has the property that 0V + x = x for all x ∈ V ; (iv) α(x + y) = αx + αy for all α ∈ F and for all x, y ∈ V ; (v) (α + β)x = αx + βx for all α, β ∈ F and for all x ∈ V ; (vi) (αβ)x = α(βx) for all α, β ∈ F and for all x ∈ V ; (vii) 0F x = 0V for all x ∈ V ; (viii) 1F x = x for all x ∈ V .

A.1 Vector Spaces

457

When the meaning is clear from context, we will write 0 in place of 0F , 1 in place of 1F , and 0 in place of 0V . To indicate the relationship between the set of vectors V and the underlying ﬁeld F , we sometimes refer to a vector space V over the ﬁeld F , and we signify this by writing (V, F ). However, usually, when the ﬁeld in question is clear from context, we simply speak of a vector space V . If F is the ﬁeld of real numbers R, we call the space a real vector space. Similarly, if F is the ﬁeld of complex numbers C, we speak of a complex vector space. Examples of Vector Spaces Example A.3. Let V = F n denote the set of all ordered n-tuples of elements from a ﬁeld F . Thus, if x ∈ F n , then x = (x1 , . . . , xn )T , where xi ∈ F , i = 1, . . . , n. With x, y ∈ F n and α ∈ F , let vector addition and scalar multiplication be deﬁned as x + y = (x1 , . . . , xn )T + (y1 , . . . , yn )T (x1 + y1 , . . . , xn + yn )T

(A.1)

and αx = α(x1 , . . . , xn )T (αx1 , . . . , αxn )T .

(A.2)

In this case the null vector is deﬁned as 0 = (0, . . . , 0) and the vector −x is deﬁned as −x = −(x1 , . . . , xn )T = (−x1 , . . . , −xn )T . Utilizing the properties of the ﬁeld F , all axioms of Deﬁnition A.2 are readily veriﬁed, and therefore, F n is a vector space. We call this space the space F n of n-tuples of elements of F . If in particular we let F = R, we have Rn , the n-dimensional real coordinate space. Similarly, if we let F = C, we have C n , the n-dimensional complex coordinate space. T

We note that the set of points in R2 , (x1 , x2 ), that satisfy the linear equation x1 + x2 + c = 0, c = 0, with addition and multiplication deﬁned as in (A.1) and (A.2), is not a vector space. Example A.4. Let V = R∞ denote the set of all inﬁnite sequences of real numbers, x = {x1 , x2 , . . . , xk , . . . } {xi }, let vector addition be deﬁned similarly as in (A.1), and let scalar multiplication be deﬁned similarly as in (A.2). It is again an easy matter to show that this space is a vector space. On some occasions we will ﬁnd it convenient to modify V = R∞ to consist of the set of all real inﬁnite sequences {xi }, i ∈ Z.

458

A Appendix

Example A.5. Let 1 ≤ p ≤ ∞, and deﬁne V = lp by lp = {x ∈ R∞ :

∞

|xi |p < ∞},

1 ≤ p < ∞,

i=1

l∞ = {x ∈ R∞ : sup{|xi |} < ∞}.

(A.3)

i

Deﬁne vector addition and scalar multiplication on lp as in (A.1) and (A.2), respectively. It can be veriﬁed that this space, called the lp -space, is a vector space. In proving that lp , 1 ≤ p ≤ ∞, is indeed a vector space, in establishing some properties of norms deﬁned on the lp -spaces, in deﬁning linear transformations on lp -spaces, and in many other applications, we make use of the H¨ older and Minkowski Inequalities for inﬁnite sums, given below. (These inequalities are of course also valid for ﬁnite sums.) For proofs of these results, refer, e.g., to Michel and Herget [9, pp. 268–270]. H¨ older’s Inequality states that if p, q ∈ R are such that 1 < p < ∞ and 1/p + 1/q = 1, if i } and {yi } are sequences in either R or C, and if {x ∞ ∞ p q |x | < ∞ and i i=1 i=1 |yi | < ∞, then ∞ i=1

∞ ∞ |xi yi | ≤ ( |xi |p )1/p ( |yi |q )1/q . i=1

(A.4)

i=1

Minkowski’s Inequality states that if p ∈ R, where 1 ≤ p < ∞,if {xi } and ∞ ∞ {yi } are sequences in either R or C, and if i=1 |xi |p < ∞ and i=1 |yi |p < ∞, then ∞ ∞ ∞ ( |xi ± yi |p )1/p ≤ ( |xi |p )1/p + ( |yi |p )1/p . (A.5) i=1

i=1

i=1

If in particular p = q = 2, then (A.4) reduces to the Schwarz Inequality for sums. Example A.6. Let V = C([a, b], R). We note that x = y if and only if x(t) = y(t) for all t ∈ [a, b], and that the null vector is the function that is zero for all t ∈ [a, b]. Let F denote the ﬁeld of real numbers, let α ∈ F , and let vector addition and scalar multiplication be deﬁned pointwise by (x + y)(t) = x(t) + y(t) for all t ∈ [a, b]

(A.6)

and (αx)(t) = αx(t)

for all t ∈ [a, b].

(A.7)

A.1 Vector Spaces

459

Then clearly x + y ∈ V whenever x, y ∈ V, αx ∈ V , whenever α ∈ F and x ∈ V , and all the axioms of a vector space are satisﬁed. We call this space the space of real-valued continuous functions on [a, b], and we frequently denote it simply by C[a, b]. Example A.7. Let 1 ≤ p < ∞, and let V denote the set of all real-valued functions x on the interval [a, b] such that

b |x(t)|p dt < ∞. (A.8) a

Let F = R, and let vector addition and scalar multiplication be deﬁned as in (A.6) and (A.7), respectively. It can be veriﬁed that this space is a vector space. In this book we will usually assume that in (A.8), integration is in the Riemann sense. When integration in (A.8) is in the Lebesgue sense, then the vector space under discussion is called an Lp -space (or the space Lp [a, b]). In proving that the Lp -spaces are indeed vector spaces, in establishing properties of norms deﬁned on Lp -spaces, in deﬁning linear transformations older and on Lp -spaces, and in many other applications, we make use of the H¨ Minkowski Inequalities for integrals, given below. (These inequalities are valid when integration is in the Riemann and the Lebesgue senses.) For proofs of these results, refer, e.g., to Michel and Herget [9, pp. 268–270]. H¨older’s Inequality states that if p, q ∈ R are such that 1 < p < ∞ and 1/p + 1/q = 1, if [a, b] is an interval on the real line, if f, g : [a, b] → R, and if b b |f (t)|p dt < ∞ and a |g(t)|q dt < ∞, then a

b

|f (t)g(t)|dt ≤ (

a

b

|f (t)| dt) p

1/p

a

(

b

|g(t)|q dt)1/q .

(A.9)

a

Minkowski’s Inequality states that if p ∈ R, where 1 ≤ p < ∞, if f, g : b b [a, b] → R, and if a |f (t)|p dt < ∞ and a |g(t)|p dt < ∞, then

( a

b

|f (t) ± g(t)|p dt)1/p ≤ (

b

|f (t)|p dt)1/p + (

a

b

|g(t)|p dt)1/p .

(A.10)

a

If in particular p = q = 2, then (A.9) reduces to the Schwarz Inequality for integrals. Example A.8. Let V denote the set of all continuous real-valued functions on the interval [a, b] such that max |x(t)| < ∞.

a≤t≤b

(A.11)

460

A Appendix

Let F = R, and let vector addition and scalar multiplication be deﬁned as in (A.6) and (A.7), respectively. It can readily be veriﬁed that this space is a vector space. In some applications it is necessary to expand the above space to the set of measurable real-valued functions on [a, b] and to replace (A.11) by ess sup |x(t)| < ∞,

(A.12)

a≤t≤b

where ess sup denotes the essential supremum; i.e., ess sup |x(t)| = inf{M : μ{t : |x(t)| > M } = 0, }, a≤t≤b

where μ denotes the Lebesgue measure. In this case, the vector space under discussion is called the L∞ -space.

A.2 Linear Independence and Bases We now address the important concepts of linear independence of a set of vectors in general and bases in particular. We ﬁrst require the notion of linear subspace. A.2.1 Linear Subspaces A nonempty subset W of a vector space V is called a linear subspace (or a linear manifold ) in V if (i) w1 + w2 is in W whenever w1 and w2 are in W , and (ii) αw is in W whenever α ∈ F and w ∈ W . It is an easy matter to verify that a linear subspace W satisﬁes all the axioms of a vector space and may as such be regarded as a linear space itself. Two trivial examples of linear subspaces include the null vector (i.e., the set W = {0} is a linear subspace of V ) and the vector space V itself. Another example of a linear subspace is the set of all real-valued polynomials deﬁned on the interval [a, b] that is a linear subspace of the vector space consisting of all real-valued continuous functions deﬁned on the interval [a, b] (refer to Example A.6). As another example of a linear subspace (of R2 ), we cite the set of all points on a straight line passing through the origin. On the other hand, a straight line that does not pass through the origin is not a linear subspace of R2 . It is an easy matter to show that if W1 and W2 are linear subspaces of a vector space V , then W1 ∩ W2 , the intersection of W1 and W2 , is also a linear subspace of V . A similar statement cannot be made, however, for the union of W1 and W2 (prove this). Note that to show that a set V is a vector space, it suﬃces to show that it is a linear subspace of some vector space.

A.2 Linear Independence and Bases

461

A.2.2 Linear Independence Throughout this section, we let {α1 , . . . , αn }, αi ∈ F , denote an indexed set of scalars and we let {v 1 , . . . , v n }, v i ∈ V , denote an indexed set of vectors. Now let W be a set in a linear space V (W may be a ﬁnite set or an inﬁnite set). We say that a vector v ∈ V is a ﬁnite linear combination of vectors in W if there is a ﬁnite set of elements {w1 , . . . , wn } in W and a ﬁnite set of scalars {α1 , . . . , αn } in F such that v = α1 w1 + · · · + αn wn . Now let W be a nonempty subset of a linear space V and let S(W ) be the set of all ﬁnite linear combinations of the vectors from W ; i.e., w ∈ S(W ) if and only if there is some set of scalars {α1 , . . . , αm } and some ﬁnite subset {w1 , . . . , wm } of W such that w = α1 w1 + · · · + αm wm , where m may be any positive integer. Then it is easily shown that S(W ) is a linear subspace of V , called the linear subspace generated by the set W . Now if U is a linear subspace of a vector space V and if there exists a set of vectors W ⊂ V such that the linear space S(W ) generated by W is U , then we say that W spans U . It is easily shown that S(W ) is the smallest linear subspace of a vector space V containing the subset W of V . Speciﬁcally, if U is a linear subspace of V and if U contains W , then U also contains S(W ). As an example, in the space (R2 , R), the set S1 = {e1 } = {(1, 0)T } spans the set consisting of all vectors of the form (a, 0)T , a ∈ R, whereas the set S2 = {e1 , e2 }, e2 = (0, 1)T spans all of R2 . We are now in a position to introduce the notion of linear dependence. Deﬁnition A.9. Let S = {v 1 , . . . , v m } be a ﬁnite nonempty set in a linear space V . If there exist scalars α1 , . . . , αm , not all zero, such that α1 v 1 + · · · + αm v m = 0,

(A.13)

then the set S is said to be linearly dependent (over F ). If a set is not linearly dependent, then it is said to be linearly independent. In this case relation (A.13) implies that α1 = · · · = αm = 0. An inﬁnite set of vectors W in V is said to be linearly independent if every ﬁnite subset of W is linearly independent.

Example A.10. Consider the linear space (Rn , R) (see Example A.3), and let e1 = (1, 0, . . . , 0)T , e2 = (0, 1, 0, . . . , 0)T , . . . , en = (0, . . . , 0, 1)T . Clearly, n i i=1 αi e = 0 implies that αi = 0, i = 1, . . . , n. Therefore, the set S = {e1 , . . . , en } is a linearly independent set of vectors in Rn over the ﬁeld of real numbers R.

462

A Appendix

Example A.11. Let V be the set of 2-tuples whose entries are complexvalued rational functions over the ﬁeld of complex-valued rational functions. Let 1/(s + 1) (s + 2)/[(s + 1)(s + 3)] , v2 = , v1 = 1/(s + 2) 1/(s + 3) and let α1 = −1, α2 = (s + 3)/(s + 2). Then α1 v 1 + α2 v 2 = 0, and therefore, the set S = {v 1 , v 2 } is linearly dependent over the ﬁeld of rational functions. On the other hand, since α1 v 1 + α2 v 2 = 0 when α1 , α2 ∈ R is true if and only if α1 = α2 = 0, it follows that S is linearly independent over the ﬁeld of real numbers (which is a subset of the ﬁeld of rational functions). This shows that linear dependence of a set of vectors in V depends on the ﬁeld F .

A.2.3 Linear Independence of Functions of Time Example A.12. Let V = C((a, b), Rn ), let F = R, and for x, y ∈ V and α ∈ F , deﬁne addition of elements in V and multiplication of elements in V by elements in F by (x+y)(t) = x(t)+y(t) for all t ∈ (a, b) and (αx)(t) = αx(t) for all t ∈ (a, b). Then, as in Example A.6, we can easily show that (V, F ) is a vector space. An interesting question that arises is whether for this space, linear dependence (and linear independence) of a set of vectors can be phrased in some testable form. The answer is aﬃrmative. Indeed, it can readily be veriﬁed that for the present vector space (V, F ), linear dependence of a set of vectors S = {φ1 , . . . , φk } in V = C((a, b), Rn ) over F = R is equivalent to the requirement that there exist scalars αi ∈ F , i = 1, . . . , k, not all zero, such that α1 φ1 (t) + · · · + αk φk (t) = 0 for all t ∈ (a, b). Otherwise, S is linearly independent. To see how the above example applies to speciﬁc cases, let V = C((−∞, ∞), R2 ), and consider the vectors φ1 (t) = [1, t]T , φ2 (t) = [1, t2 ]T . To show that the set S = {φ1 , φ2 } is linearly independent (over F = R), assume for purposes of contradiction that S is linearly dependent. Then there must exist scalars α1 and α2 , not both zero, such that α1 [1, t]T + α2 [1, t2 ]T = [0, 0]T for all t ∈ (−∞, ∞). But in particular, for t = 2, the above equation is satisﬁed if and only if α1 = α2 = 0, which contradicts the assumption. Therefore, S = {φ1 , φ2 } is linearly independent. As another speciﬁc case of the above example, let V = C((−∞, ∞), R2 ) and consider the set S = {φ1 , φ2 , φ3 , φ4 }, where φ1 (t) = [1, t]T , φ2 (t) = [1, t2 ], φ3 (t) = [0, 1]T , and φ4 (t) = [e−t , 0]. The set S is clearly independent over R since α1 φ1 (t) + α2 φ2 (t) + α3 φ3 (t) + α4 φ4 (t) = 0 for all t ∈ (−∞, ∞) if and only if α1 = α2 = α3 = α4 = 0.

A.2 Linear Independence and Bases

463

A.2.4 Bases We are now in a position to introduce another important concept. Deﬁnition A.13. A set W in a linear space V is called a basis for V if (i) W is linearly independent, and (ii) the span of W is the linear space V itself; i.e., S(W ) = V .

An immediate consequence of the above deﬁnition is that if W is a linearly independent set in a vector space V , then W is a basis for S(W ). To introduce the notion of dimension of a vector space, it is shown that if a linear space V is generated by a ﬁnite number of linearly independent elements, then this number of elements must be unique. The following results lead up to this. Let {v 1 , . . . , v n } be a basis for a linear space V . Then it is easily shown that for each vector v ∈ V , there exist unique scalars α1 , . . . , αn such that v = α1 v 1 + · · · + αn v n . Furthermore, if u1 , . . . , um is any linearly independent set of vectors in V , then m ≤ n. Moreover, any other basis of V consists of exactly n elements. These facts allow the following deﬁnitions. If a linear space V has a basis consisting of a ﬁnite number of vectors, say, {v 1 , . . . , v n }, then V is said to be a ﬁnite-dimensional vector space and the dimension of V is n, abbreviated dim V = n. In this case we speak of an n-dimensional vector space. If V is not a ﬁnite-dimensional vector space, it is said to be an inﬁnite-dimensional vector space. By convention, the linear space consisting of the null vector is ﬁnitedimensional with dimension equal to zero. An alternative to the above deﬁnition of dimension of a (ﬁnite-dimensional) vector space is given by the following result, which is easily veriﬁed: Let V be a vector space that contains n linearly independent vectors. If every set of n + 1 vectors in V is linearly dependent, then V is ﬁnite-dimensional and dim V = n. The preceding results enable us now to introduce the concept of coordinates of a vector. We let {v 1 , . . . , v n } be a basis of a vector space V , and we let v ∈ V be represented by v = ξ1 v 1 + · · · + ξn v n . The unique scalars ξ1 , . . . , ξn are called the coordinates of v with respect to the basis {v 1 , . . . , v n }. Example A.14. For the linear space (Rn , R), let S = {e1 , . . . , en }, where the ei ∈ Rn , i = 1, . . . , n, were deﬁned earlier (in Example A.10). Then

464

A Appendix

S is clearly a basis for (Rn , R) since it is linearly independent and since givenany v ∈ Rn , there exist unique real scalars αi , i = 1, . . . , n, such that v = ni=1 αi ei = (α1 , . . . , αn )T ; i.e., S spans Rn . It follows that with every vector v ∈ Rn , we can associate a unique n-tuple of scalars ⎡ ⎤ α1 ⎢ .. ⎥ ⎣ . ⎦ or (α1 , . . . , αn ) αn relative to the basis {e1 , . . . , en }, the coordinate representation of the vector v ∈ Rn with respect to the basis S = {e1 , . . . , en }. Henceforth, we will refer to the basis S of this example as the natural basis for Rn . Example A.15. We note that the vector space of all (complex-valued) polynomials with real coeﬃcients of degree less than n is an n-dimensional vector space over the ﬁeld of real numbers. A basis for this space is given by S = {1, s, . . . , sn−1 } where s is a complex variable. Associated with a given element of this vector space, say p(s) = α0 +α1 s+· · ·+αn−1 sn−1 , we have the unique n-tuple given by (α0 , α1 , . . . , αn−1 )T , which constitutes the coordinate representation of p(s) with respect to the basis S given above. Example A.16. We note that the space (V, R), where V = C([a, b], R), given in Example A.6 is an inﬁnite-dimensional vector space.

A.3 Linear Transformations Deﬁnition A.17. A mapping T of a linear space V into a linear space W , where V and W are vector spaces over the same ﬁeld F , is called a linear transformation or a linear operator provided that (L-i) (L-ii)

T (x + y) = T (x) + T (y) T (αx) = αT (x)

for all x, y ∈ V , and for all x ∈ V and α ∈ F .

In the following discussion, we consider three speciﬁc examples of linear transformations. Example A.18. Let (V, R) = (Rn , R) and (W, R) = (Rm , R) be vector spaces deﬁned as in Example A.3, let A = [aij ] ∈ Rm×n , and let T : V → W be deﬁned by the equation y = Ax,

y ∈ Rm ,

x ∈ Rn ,

where Ax denotes multiplication of the matrix A and the vector y. It is easily veriﬁed using the properties of matrices that T is a linear transformation.

A.3 Linear Transformations

465

Example A.19. Let (V, R) = (lp , R) be the vector space deﬁned in Example A.5 (modiﬁed to consist of sequences {xi }, i ∈ Z, in place of {xi }, i = 1, 2, . . . ). Let h : Z × Z → R be a function having the property that for each x ∈ V , the inﬁnite sum ∞

h(n, k)x(k)

k=−∞

exists and deﬁnes a function of n on Z. Let T : V → V be deﬁned by y(n) =

∞

h(n, k)x(k).

k=−∞

It is easily veriﬁed that T is a linear transformation. The existence of the above sum is ensured under appropriate assumptions. For example, by using the H¨ older Inequality, it is readily shown that if, e.g., for ﬁxed n, {h(n, k)} ∈ l2 and {x(k)} ∈ l2 , then the above sum is well deﬁned. The above sum exists also if, e.g., {x(k)} ∈ l∞ and {h(n, k)} ∈ l1 for ﬁxed n.

Example A.20. Let (V, R) denote the vector space given in Example A.7, and let k ∈ C([a, b] × [a, b], R) have the property that for each x ∈ V , the Riemann integral

b k(s, t)x(t)dt a

exists and deﬁnes a continuous function of s on [a, b]. Let T : V → V be deﬁned by

b k(s, t)x(t)dt. (T x)(s) = y(s) = a

It is readily veriﬁed that T is a linear transformation of V into V . Henceforth, if T is a linear transformation from a vector space V (over a ﬁeld F ) into a vector space W (over the same ﬁeld F ) we will write T ∈ L(V, W ) to express this. In the following discussion, we will identify some of the important properties of linear transformations. A.3.1 Linear Equations With T ∈ L(V, W ) we deﬁne the null space of T as the set N (T ) = {v ∈ V : T v = w = 0}

466

A Appendix

and the range space of T as the set R(T ) = {w ∈ W : w = T v, v ∈ V }. Note that since T 0 = 0, N (T ) and R(T ) are never empty. It is easily veriﬁed that N (T ) is a linear subspace of V and that R(T ) is a linear subspace of W . If V is ﬁnite-dimensional (of dimension n), then it is easily shown that dim R(T ) ≤ n. Also, if V is ﬁnite-dimensional and if {w1 , . . . , wn } is a basis for R(T ) and v i is deﬁned by T v i = wi , i = 1, . . . , n, then it is readily proved that the vectors v 1 , . . . , v n are linearly independent. One of the important results of linear algebra, called the fundamental theorem of linear equations, states that for T ∈ L(V, W ) with V ﬁnite-dimensional, we have dim N (T ) + dim R(T ) = dim V. For the proof of this result, refer to any of the references on linear algebra cited at the end of Chapters 4, 6, 8, and 9. The above result gives rise to the notions of the rank, ρ(T ), of a linear transformation T of a ﬁnite-dimensional vector space V into a vector space W , which we deﬁne as the dimension of the range space R(T ), and the nullity, ν(T ), of T , which we deﬁne as the dimension of the null space N (T ). With the above machinery in place, it is now easy to establish the following important results concerning linear equations. Let T ∈ L(V, W ), where V is ﬁnite-dimensional, let s = dim N (T ), and let {v 1 , . . . , v s } be a basis for N (T ). Then it is easily veriﬁed that s (i) a vector v ∈ V satisﬁes the equation T v = 0 if and only if v = i=1 αi v i for some set of scalars {α1 , . . . , αs }, and furthermore, for each v ∈ V such that T v = 0 is true, the set of scalars {α1 , . . . , αs } is unique; (ii) if w0 ∈ W is a ﬁxed vector, then T v = w0 holds for at least one vector v ∈ V (called the solution of the equation T v = w0 ) if and only if w0 ∈ R(T ); and (iii) if w0 is any ﬁxed vector in W and if v 0 is some vector in V such that T v 0 = w0 (i.e., v 0 is a solution of the equation T v 0 = w0 ), then a vector s 0 0 v ∈ V satisﬁes T v = w if and only if v = v + i=1 βi v i for some set of scalars {β1 , . . . , βs }, and furthermore, for each v ∈ V such that T v = w0 , the set of scalars {β1 , . . . , βs } is unique. A.3.2 Representation of Linear Transformations by Matrices In the following discussion, we let (V, F ) and (W, F ) be vector spaces over the same ﬁeld and we let A : V → W denote a linear mapping. We let {v 1 , . . . , v n } be a basis for V , and we set v¯1 = Av 1 , . . . , v¯n = Av n . Then it is an easy matter to show that if v is any vector in V and if (α1 , . . . , αn ) are the coordinates of v with respect to {v 1 , . . . , v n }, then Av = α1 v¯1 + · · · + αn v¯n . Indeed, we have Av = A(α1 v 1 + · · · + αn v n ) = α1 Av 1 + · · · + αn Av n = α1 v¯1 + · · · + αn v¯n .

A.3 Linear Transformations

467

Next, we let {¯ v 1 , . . . , v¯n } be any set of vectors in W . Then it can be shown that there exists a unique linear transformation A from V into W such that Av 1 = v¯1 , . . . , Av n = v¯n . To show this, we ﬁrst observe that for each v ∈ V we have unique scalars α1 , . . . , αn such that v = α1 v 1 + · · · + αn v n . Now deﬁne a mapping A : V → W as A(v) = α1 v¯1 + · · · + αn v¯n . Clearly, A(v i ) = v¯i , i = 1, . . . , n. We ﬁrst must show that A is linear and, then, that A is unique. Given v = α1 v 1 + · · · + αn v n and w = β1 v 1 + · · · + βn v n , we have A(v + w) = A[(α1 + β1 )v 1 + · · ·+ (αn + βn )v n ] = (α1 + β1 )¯ v 1 + · · ·+ (αn + n 1 n βn )¯ v . On the other hand, A(v) = α1 v¯ +· · ·+αn v¯ , A(w) = β1 v¯1 +· · ·+βn v¯n . v1 + Thus, A(v)+A(w) = (α1 v¯1 +· · ·+αn v¯n )+(β1 v¯1 +· · ·+βn v¯n ) = (α1 +β1 )¯ n · · · + (αn + βn )¯ v = A(v + w). In a similar manner, it is easily established that αA(v) = A(αv) for all α ∈ F and v ∈ V . Therefore, A is linear. Finally, to show that A is unique, suppose there exists a linear transformation B : V → W such that Bv i = v¯i , i = 1, . . . , n. It follows that (A − B)v i = 0, i = 1, . . . , n, and, therefore, that A = B. These results show that a linear transformation is completely determined by knowing how it transforms the basis vectors in its domain, and that this linear transformation is uniquely determined in this way. These results enable us to represent linear transformations deﬁned on ﬁnite-dimensional spaces in an unambiguous way by means of matrices. We will use this fact in the following development. Let (V, F ) and (W, F ) denote n-dimensional and m-dimensional vector spaces, respectively, and let {v 1 , . . . , v n } and {w1 , . . . , wm } be bases for V and W , respectively. Let A : V → W be a linear transformation, and let v¯i = Av i , i = 1, . . . , n. Since {w1 , . . . , wm } is a basis for W , there are unique scalars {aij }, i = 1, . . . , m, j = 1, . . . , n, such that Av 1 = v¯1 = a11 w1 + a21 w2 + · · · + am1 wm , Av 2 = v¯2 = a12 w1 + a22 w2 + · · · + am2 wm , ····································

(A.14)

Av n = v¯n = a1n w1 + a2n w2 + · · · + amn wm . Next, let v ∈ V . Then v has the unique representation v = α1 v 1 + α2 v 2 + · · · + αn v n with respect to the basis {v 1 , . . . , v n }. In view of the result given at the beginning of this subsection, we now have Av = α1 v¯1 + · · · + αn v¯n .

(A.15)

Since Av ∈ W, Av has a unique representation with respect to the basis {w1 , . . . , wm }, say,

468

A Appendix

Av = γ1 w1 + γ2 w2 + · · · + γm wm .

(A.16)

Combining (A.14) and (A.16), and rearranging, in view of the uniqueness of the representation in (A.16), we have γ1 = a11 α1 + a12 α2 + · · · + a1n αn , γ2 = a21 α1 + a22 α2 + · · · + a2n αn , ······························ γm = am1 α1 + am2 α2 + · · · + amn αn ,

(A.17)

where (α1 , . . . , αn )T and (γ1 , . . . , γm )T are coordinate representations of v ∈ V and Av ∈ W with respect to the bases {v 1 , . . . , v n } of V and {w1 , . . . , wm } of W , respectively. This set of equations enables us to represent the linear transformation A from the linear space V into the linear space W by the unique scalars {aij }, i = 1, . . . , m, j = 1, . . . , n. For convenience we let ⎡ ⎤ a11 a12 · · · a1n ⎢ a21 a22 · · · a2n ⎥ ⎥ (A.18) A = [aij ] = ⎢ ⎣ ··· ··· ··· ··· ⎦. am1 am2 · · · amn We see that once the bases {v 1 , . . . , v n }, {w1 , . . . , wm } are ﬁxed, we can represent the linear transformation A by the array of scalars in (A.18) that are uniquely determined by (A.14). Note that the jth column of A is the coordinate representation of the vector Av j ∈ W with respect to the basis {w1 , . . . , wm }. The converse to the preceding statement also holds. Speciﬁcally, with the bases for V and W still ﬁxed, the array given in (A.18) is uniquely associated with the linear transformation A of V into W . The above discussion gives rise to the following important deﬁnition. Deﬁnition A.21. The array given in (A.18) is called the matrix A of the linear transformation A from a linear space V into a linear space W (over F ) with respect to the basis {v 1 , . . . , v n } of V and the basis {w1 , . . . , wm } of W . If in Deﬁnition A.21, V = W , and if for both V and W the same basis {v 1 , . . . , v n } is used, then we simply speak of the matrix A of the linear transformation A with respect to the basis {v 1 , . . . , v n }. In (A.18) the scalars (ai1 , ai2 , . . . , ain ) form the ith row of A and the scalars (a1j , a2j , . . . , amj )T form the jth column of A. The scalar aij refers to that element of matrix A that can be found in the ith row and jth column of A. The array in (A.18) is said to be an m × n matrix. If m = n, we speak of a square matrix. Consistent with the above discussion, an n × 1 matrix is called a column vector, column matrix, or n-vector, and a 1 × n matrix is called a row vector. Finally, if A = [aij ] and B = [bij ] are two m × n matrices, then

A.3 Linear Transformations

469

A = B; i.e., A and B are equal if and only if aij = bij for all i = 1, . . . , m, and for all j = 1, . . . , n. Furthermore, we call AT = [aij ]T = [aji ] the transpose of A. The preceding discussion shows in particular that if A is a linear transformation of an n-dimensional vector space V into an m-dimensional vector space W , w = Av, (A.19) if γ = (γ1 , . . . , γm )T denotes the coordinate representation of w with respect to the basis {w1 , . . . , wm }, if α = (α1 , . . . , αn )T denotes the coordinate representation of v with respect to the basis {v 1 , . . . , v n }, and if A denotes the matrix of A with respect to the bases {v 1 , . . . , v n }, {w1 , . . . , wm }, then γ = Aα, or equivalently, γi =

n

aij αj ,

i = 1, . . . , m

(A.20)

(A.21)

j=1

which are alternative ways to write (A.17). The Rank of a Matrix Let A denote the matrix representation of a linear transformation A. The rank of A, ρ(A), is deﬁned as the rank of A, ρ(A). It can be shown that the rank ρ(A) of an m × n matrix A is the largest number of linearly independent columns of A. The rank is also equal to the largest numbers of linearly independent rows of A. It also equals the dimension of the largest nonzero minor of A. A.3.3 Solving Linear Algebraic Equations Now consider the linear system of equations given by Aα = γ,

(A.22)

where A ∈ Rm×n and γ ∈ Rm are given and α ∈ Rn is to be determined. 1. For a given γ, a solution α of (A.22) exists (not necessarily unique) if and only if γ ∈ R(A), or equivalently, if and only if ρ([A, γ]) = ρ(A).

(A.23)

2. Every solution α of (A.22) can be expressed as a sum α = αp + αh ,

(A.24)

470

A Appendix

where αp is a speciﬁc solution of (A.22) and αh satisﬁes Aαh = 0. This result allows us to span the space of all solutions of (A.22). Note that there are dim N (A) = n − ρ(A) (A.25) linearly independent solutions of the system of equations Aβ = 0. 3. Aα = γ has a unique solution if and only if (A.23) is satisﬁed and ρ(A) = n ≤ m.

(A.26)

4. A solution α of (A.22) exists for any γ if and only if ρ(A) = m.

(A.27)

If (A.27) is satisﬁed, a solution of (A.22) can be found by using the relation α = AT (AAT )−1 γ.

(A.28)

When in (A.22), ρ(A) = m = n, then A ∈ Rn×n and is nonsingular and the unique solution of (A.28) is given by α = A−1 γ.

Example A.22. Consider

(A.29)

⎡

⎤ 000 Aα = ⎣ 0 0 1 ⎦ α = γ. 000

(A.30)

It is easily veriﬁed that {(0, 1, 0)T } is a basis for R(A). Since a solution of (A.30) exists if and only if γ ∈ R(A), γ must be of the form γ = (0, k, 0)T , k ∈ R. Note that ⎤ ⎡ 0000 ρ(A) = 1 = ρ([A, γ]) = rank ⎣ 0 0 1 k ⎦ , 0000 as expected. To determine all solutions of (A.30), we need to determine an αp and an αh [see (A.24)]. In particular, αp = (0 0 k)T will do. To determine αh , we consider Aβ = 0. There are dim N (A) = 2 linearly independent solutions of Aβ = 0. In particular, {(1, 0, 0)T , (0, 1, 0)T } is a basis for N (A). Therefore, any solution of (A.30) can be expressed as ⎡ ⎤ ⎡ ⎤ 0 10 c α = αp + αh = ⎣ 0 ⎦ + ⎣ 0 1 ⎦ 1 , c2 k 00 where c1 , c2 are appropriately chosen real numbers.

A.4 Equivalence and Similarity

471

A.4 Equivalence and Similarity From our previous discussion it is clear that a linear transformation A of a ﬁnite-dimensional vector space V into a ﬁnite-dimensional vector space W can be represented by means of diﬀerent matrices, depending on the particular choice of bases in V and W . The choice of bases may in diﬀerent cases result in matrices that are easy or hard to utilize. Many of the resulting “standard” forms of matrices, called canonical forms, arise because of practical considerations. Such canonical forms often exhibit inherent characteristics of the underlying transformation A. Throughout this section, V and W are ﬁnite-dimensional vector spaces over the same ﬁeld F, dim V = n, and dim W = m. A.4.1 Change of Bases: Vector Case Our ﬁrst aim will be to consider the change of bases in the coordinate reprev 1 , . . . , v¯n } be sentation of vectors. Let {v 1 , . . . , v n } be a basis for V , and let {¯ a set of vectors in V given by v¯i =

n

pji v j ,

i = 1, . . . , n,

(A.31)

j=1

where pij ∈ F for all i, j = 1, . . . , n. It is easily veriﬁed that the set {¯ v 1 , . . . , v¯n } forms a basis for V if and only if the n × n matrix P = [pij ] is nonsingular (i.e., det P = 0). We call P the matrix of the basis {¯ v 1 , . . . , v¯n } 1 n with respect to the basis {v , . . . , v }. Note that the ith column of P is the coordinate representation of v¯i with respect to the basis {v 1 , . . . , v n }. Continuing the above discussion, let {v 1 , . . . , v n } and {¯ v 1 , . . . , v¯n } be two 1 bases for V and let P be the matrix of the basis {¯ v , . . . , v¯n } with respect to 1 n the basis {v , . . . , v }. Then it is easily shown that P −1 is the matrix of the basis {v 1 , . . . , v n } with respect to the basis {¯ v 1 , . . . , v¯n }. 1 n v 1 , . . . , v¯n }, and {˜ v 1 , . . . , v˜n } be Next, let the sets of vectors {v , . . . , v }, {¯ 1 n bases for V . If P is the matrix of the basis {¯ v , . . . , v¯ } with respect to the basis {v 1 , . . . , v n } and if Q is the matrix of the basis {˜ v 1 , . . . , v˜n } with respect 1 n to the basis {¯ v , . . . , v¯ }, then it is easily veriﬁed that P Q is the matrix of the basis {˜ v 1 , . . . , v˜n } with respect to the basis {v 1 , . . . , v n }. Continuing further, let {v 1 , . . . , v n } and {¯ v 1 , . . . , v¯n } be two bases for V 1 and let P be the matrix of the basis {¯ v , . . . , v¯n } with respect to the basis 1 n T {v , . . . , v }. Let a ∈ V , and let α = (α1 , . . . , αn ) denote the coordinate representation of a with respect to the basis {v 1 , . . . , v n } (i.e., a = ni=1 αi v i ). Let α ¯ T = (¯ α1 , . . . , α ¯ n ) denote the coordinate representation of a with respect to the basis {¯ v 1 , . . . , v¯n }. Then it is readily veriﬁed that Pα ¯ = α.

472

A Appendix

Example A.23. Let V = R3 , F = R, and let a = (1, 2, 3)T ∈ R3 be given. Let {v 1 , v 2 , v 3 } = {e1 , e2 , e3 } denote the natural basis for R3 ; i.e., e1 = (1, 0, 0)T , e2 = (0, 1, 0)T , e3 = (0, 0, 1)T . Clearly, the coordinate representation α of a with respect to the natural basis is (1, 2, 3)T . Now let {¯ v 1 , v¯2 , v¯3 } be another basis for R3 , given by v¯1 = (1, 0, 1)T , v¯2 = T 3 (0, 1, 0) , v¯ = (0, 1, 1)T . From the relation ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ 1 0 0 (1, 0, 1)T = v¯1 = p11 v 1 + p21 v 2 + p31 v 3 = p11 ⎣ 0 ⎦ + p21 ⎣ 1 ⎦ + p31 ⎣ 0 ⎦ , 0 0 1 we conclude that p11 = 1, p21 = 0, and p31 = 1. Similarly, from ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ 1 0 0 (0, 1, 0)T = v¯2 = p12 v 1 + p22 v 2 + p32 v 3 = p12 ⎣ 0 ⎦ + p22 ⎣ 1 ⎦ + p32 ⎣ 0 ⎦ , 0 0 1 we conclude that p12 = 0, p22 = 1, and p32 = 0. Finally, from the relation ⎡ ⎤ ⎡ ⎤ ⎡ ⎤ 1 0 0 (0, 1, 1)T = v¯3 = p13 ⎣ 0 ⎦ + p23 ⎣ 1 ⎦ + p33 ⎣ 0 ⎦ , 0 0 1 we obtain that p13 = 0, p23 = 1, and p33 = 1. The matrix P = [pij ] of the basis {¯ v 1 , v¯2 , v¯3 } with respect to the basis 1 2 3 {v , v , v } is therefore determined to be ⎤ ⎡ 100 P = ⎣0 1 1⎦, 101 and the coordinate representation of a with respect to the basis {¯ v 1 , v¯2 , v¯3 } is −1 given by α ¯ = P α, or ⎡

⎤−1 ⎡ ⎤ ⎡ ⎤⎡ ⎤ ⎡ ⎤ 100 1 10 0 1 1 α ¯ = ⎣ 0 1 1 ⎦ ⎣ 2 ⎦ = ⎣ 1 1 −1 ⎦ ⎣ 2 ⎦ = ⎣ 0 ⎦ . 101 3 −1 0 0 3 2

A.4.2 Change of Bases: Matrix Case Having addressed the relationship between the coordinate representations of a given vector with respect to diﬀerent bases, we next consider the relationship between the matrix representations of a given linear transformation relative to diﬀerent bases. To this end, let A ∈ L(V, W ) and let {v 1 , . . . , v n } and

A.4 Equivalence and Similarity

473

{w1 , . . . , wm } be bases for V and W , respectively. Let A be the matrix of A with respect to the bases {v 1 , . . . , v n } and {w1 , . . . , wm }. Let {¯ v 1 , . . . , v¯n } 1 n be another basis for V , and let the matrix of {¯ v , . . . , v¯ } with respect to {v 1 , . . . , v n } be P . Let {w ¯1, . . . , w ¯ m } be another basis for W , and let Q be the matrix of {w1 , . . . , wm } with respect to {w ¯1 , . . . , w ¯m }. Let A¯ be the matrix of 1 n 1 ¯ ,...,w ¯m }. Then it is readily A with respect to the bases {¯ v , . . . , v¯ } and {w veriﬁed that A¯ = QAP. (A.32) This result is depicted schematically in Figure A.1. A V −→W {v 1 , . . . , v n } ν = P ν¯

A −→

P ↑ {¯ v 1 , . . . , v¯n } ν¯

{w1 , · · · , wm } ω = Aν ↓Q

¯ A −→

{w ¯1 , . . . , w ¯m } ω ¯ = Qω

Figure A.1. Schematic diagram of the equivalence of two matrices

A.4.3 Equivalence and Similarity of Matrices The preceding discussion motivates the following deﬁnition. Deﬁnition A.24. An m × n matrix A¯ is said to be equivalent to an m × n matrix A if there exists an m × m nonsingular matrix Q and an n × n nonsingular matrix P such that (A.32) is true. If A¯ is equivalent to A, we write A¯ ∼ A. Next, let V = W , let A ∈ L(V, V ), let {v 1 , . . . , v n } be a basis for V , and let A be the matrix of A with respect to {v 1 , . . . , v n }. Let {¯ v 1 , . . . , v¯n } be 1 n another basis for V whose matrix with respect to {v , . . . , v } is P . Let A¯ be the matrix of A with respect to {¯ v 1 , . . . , v¯n }. Then it follows immediately from (A.32) that A¯ = P −1 AP. (A.33) The meaning of this result is depicted schematically in Figure A.2. The above discussion motivates the following deﬁnition. Deﬁnition A.25. An n × n matrix A¯ is said to be similar to an n × n matrix A if there exists an (n × n) nonsingular matrix P such that

474

A Appendix A −→ V A 1 n 1 {v , . . . , v } −→ {v , . . . , v n } ↑P ↓ P −1 ¯ A {¯ v 1 , . . . , v¯n } −→ {¯ v 1 , . . . , v¯n } V

Figure A.2. Schematic diagram of the similarity of two matrices

A¯ = P −1 AP. If A¯ is similar to A, we write A¯ ∼ A. We call P a similarity transformation. It is easily veriﬁed that if A¯ is similar to A [i.e., (A.33) is true], then A is ¯ i.e., similar to A; ¯ −1 . A = P AP (A.34) In view of this, there is no ambiguity in saying “two matrices are similar,” and we could just as well have used (A.34) [in place of (A.33)] to deﬁne similarity of matrices. To sum up, if two matrices A and A¯ represent the same linear transformation A ∈ L(V, V ), possibly with respect to two diﬀerent bases for V , then A and A¯ are similar matrices.

A.5 Eigenvalues and Eigenvectors Deﬁnition A.26. Let A be an n× n matrix whose elements belong to the ﬁeld F . If there exist λ ∈ F and a nonzero vector α ∈ F n such that Aα = λα,

(A.35)

then λ is called an eigenvalue of A and α is called an eigenvector of A corresponding to the eigenvalue λ. We note that if α is an eigenvector of A, then any nonzero multiple of α is also an eigenvector of A. A.5.1 Characteristic Polynomial Let A ∈ C n×n . Then det(A − λI) = α0 + α1 λ + α2 λ2 + · · · + αn λn

(A.36)

n

[note that α0 = det(A) and αn = (−1) ]. The eigenvalues of A are precisely the roots of the equation det(A − λI) = α0 + α1 λ + α2 λ2 + · · · + αn λn = 0

(A.37)

and A has at most n distinct eigenvalues. We call (A.36) the characteristic polynomial of A, and we call (A.37) the characteristic equation of A.

A.5 Eigenvalues and Eigenvectors

475

Remarks The above deﬁnition of characteristic polynomial is the one usually used in texts on linear algebra and matrix theory (refer, e.g., to some of the books on this subject cited at the end of this chapter). An alternative to the above deﬁnition is given by the expression α(λ) det(λI − A) = (−1)n det(A − λI). Now consider det(A − λI) = (λ1 − λ)m1 (λ2 − λ)m2 · · · (λp − λ)mp ,

(A.38)

where λi , i = 1, . . . , p, are the distinct roots of (A.37) (i.e., λi = λj , if i = j). In (A.38), mi is calledthe algebraic multiplicity of the root λi . The mi are p positive integers, and i=1 mi = n. The reader should make note of the distinction between the concept of algebraic multiplicity mi of λi , given above, and the (geometric) multiplicity li of an eigenvalue λi , given by li = n − ρ(λi I − A). In general these need not be the same. A.5.2 The Cayley–Hamilton Theorem and Applications We now state and prove a result that is very important in linear systems theory. Theorem A.27. (Cayley–Hamilton Theorem) Every square matrix satisﬁes its characteristic equation. More speciﬁcally, if A is an n × n matrix and p(λ) = det(A − λI) is the characteristic polynomial of A, then p(A) = O. Proof. Let the characteristic polynomial for A be p(λ) = α0 +α1 λ+· · ·+αn λn , and let B(λ) = [bij (λ)] be the classical adjoint of (A − λI). (For a nonsin1 adj(C), adj(C) is called the classigular matrix C with inverse C −1 = det(C) cal adjoint of C.) Since the bij (λ) are cofactors of the matrix A − λI, they are polynomials in λ of degree not more than n − 1. Thus, bij (λ) = βij0 + βij1 λ + · · · + βij(n−1) λn−1 . Letting Bk = [βijk ] for k = 0, 1, . . . , n − 1, we have B(λ) = B0 + λB1 + · · · + λn−1 Bn−1 and (A − λI)B(λ) = [det(A − λI)]I. Thus, (A−λI)[B0 +λB1 +· · ·+λn−1 Bn−1 ] = (α0 +α1 λ+· · ·+αn λn )I. Expanding the left-hand side of this equation and equating like powers of λ, we have −Bn−1 = αn I, ABn−1 − Bn−2 = αn−1 I, . . . , AB1 − B0 = α1 I, AB0 = α0 I. Premultiplying the above matrix equations by An , An−1 , . . . , A, I, respectively, we have −An Bn−1 = αn An , An Bn−1 − An−1 Bn−2 = αn−1 An−1 , . . . , A2 B1 − AB0 = α1 A, AB0 = α0 I. Adding these matrix equations, we obtain O = α0 I + α1 A + · · · + αn An = p(A), which was to be shown.

476

A Appendix

As an immediate consequence of the Cayley–Hamilton Theorem, we have the following results: Let A be an n × n matrix with characteristic polynomial given by (A.37). Then (i) An = (−1)n+1 [α0 I + α1 A + · · · + αn−1 An−1 ]; and (ii) if f (λ) is any polynomial in λ, then there exist β0 , β1 , . . . , βn−1 ∈ F such that (A.39) f (A) = β0 I + β1 A + · · · + βn−1 An−1 . Part (i) follows from the Cayley–Hamilton Theorem and from the fact that αn = (−1)n . To prove part (ii), let f (λ) be any polynomial in λ and let p(λ) denote the characteristic polynomial of A. From a result for polynomials (called the division algorithm), we know that there exist two unique polynomials g(λ) and r(λ) such that f (λ) = p(λ)g(λ) + r(λ),

(A.40)

where the degree of r(λ) ≤ n − 1. Now since p(A) = 0, we have that f (A) = r(A) and the result follows. The Cayley–Hamilton Theorem can also be used to express n × n matrixvalued power series (as well as other kinds of functions) as matrix polynomials of degree n − 1. Consider in particular the matrix exponential eAt deﬁned by eAt =

∞

(tk /k!)Ak , t ∈ (−a, a).

(A.41)

k=0

In view of the Cayley–Hamilton Theorem, we can write f (A) = eAt =

n−1

αi (t)Ai .

(A.42)

i=0

In the following discussion, we present a method to determine the coeﬃcients αi (t) in (A.42) [or βi in (A.39)]. p In accordance with (A.38), let p(λ) = det(A − λI) = i=1 (λi − λ)mi be the characteristic polynomial of A. Also, let f (λ) and g(λ) be two analytic functions. Now if f (l) (λi ) = g (l) (λi ),

l = 0, . . . , mi − 1,

i = 1, . . . , p,

(A.43)

p l where f (l) (λi ) = ddλfl (λ)|λ=λi , i=1 mi = n, then f (A) = g(A). To see this, we note that condition (A.43) written as (f − g)l (λi ) = 0 implies that f (λ) − g(λ) has p(λ) as a factor; i.e., f (λ) − g(λ) = w(λ)p(λ) for some analytic function w(λ). From the Cayley–Hamilton Theorem we have that p(A) = O and therefore f (A) − g(A) = O. Example A.28. As a speciﬁc application of the Cayley–Hamilton Theorem, 10 37 we evaluate the matrix A , where A = . Since n = 2, we assume, in 12

A.5 Eigenvalues and Eigenvectors

477

view of (A.39), that A37 is of the form A37 = β0 I + β1 A. The characteristic polynomial of A is p(λ) = (1 − λ)(2 − λ), and the eigenvalues of A are λ1 = 1 and λ2 = 2. In this case, f (λ) = λ37 and r(λ) in (A.40) is r(λ) = β0 + β1 λ. To determine β0 and β1 we use the fact that p(λ1 ) = p(λ2 ) = 0 to conclude that f (λ1 ) = r(λ1 ) and f (λ2 ) = r(λ2 ). Therefore, we have that β0 + β1 = 137 = 1 and β0 + 2β1 = 237 . Hence, β1 = 237− 1 and β0 = 2 − 237 . Therefore, 1 0 A37 = (2 − 237 )I + (237 − 1)A or A37 = 37 . 2 − 1 237

−1 1 Example A.29. Let A = , and let f (A) = eAt , f (λ) = eλt , and −1 1 g(λ) = α1 λ + α0 . The matrix A has an eigenvalue λ = λ1 = λ2 = 0 with multiplicity m1 = 2. Conditions (A.43) are given by f (λ1 ) = g(λ1 ) = 1 and f (1) (λ1 ) = g (1) (λ1 ), which imply that α0 = 1 and α1 = t. Therefore, −α1 + α0 α1 1−t t eAt = f (A) = g(A) = α1 A + α0 I = = . −α1 α1 + α0 −t 1 + t

A.5.3 Minimal Polynomials For purposes of motivation, consider the matrix ⎡ ⎤ 1 3 −2 A = ⎣ 0 4 −2 ⎦ . 0 3 −1 The characteristic polynomial of A is p(λ) = (1 − λ)2 (2 − λ), and we know from the Cayley–Hamilton Theorem that p(A) = O.

(A.44)

Now let us consider the polynomial m(λ) = (1 − λ)(2 − λ) = 2 − 3λ + λ2. Then m(A) = 2I − 3A + A2 = O.

(A.45)

Thus, matrix A satisﬁes (A.45), which is of lower degree than (A.44), the characteristic equation of A. More generally, it can be shown that for an n × n matrix A, there exists a unique polynomial m(λ) such that (i) m(A) = O, (ii) m(λ) is monic (i.e., if m is an nth-order polynomial in λ, then the coeﬃcient of λn is unity), and (iii) if m (λ) is any other polynomial such that m (A) = O, then the degree of m(λ) is less or equal to the degree of m (λ) [i.e., m(λ) is of the lowest degree such that m(A) = O]. The polynomial m(λ) is called the minimal polynomial of A.

478

A Appendix

Let f (λ) be any polynomial such that f (A) = O (e.g., the characteristic polynomial). Then it is easily shown that m(λ) divides f (λ) [i.e., there is a polynomial q(λ) such that f (λ) = q(λ)m(λ)]. In particular, the minimal polynomial of A, m(λ), divides the characteristic polynomial of A, p(λ). Also, it can be shown that p(λ) divides [m(λ)]n . Next, let p(λ) be given by p(λ) = (λ1 − λ)m1 (λ2 − λ)m2 · · · (λp − λ)mp ,

(A.46)

where m1 , . . . , mp are the algebraic multiplicities of the distinct eigenvalues λ1 , . . . , λp of A, respectively. It can be shown that m(λ) = (λ − λ1 )μ1 (λ − λ2 )μ2 · · · (λ − λp )μp ,

(A.47)

where 1 ≤ μi ≤ mi , i = 1, . . . , p. It can also be shown that (λ − λi )μi is the minimal polynomial of the Ai diagonal block in the Jordan canonical form of A, which we discuss in the next section. When A has all n distinct eigenvalues, the Jordan canonical form has n diagonal blocks and, therefore, μi = 1 and p(λ) = m(λ). The Jordan canonical form is described in Section A.6 and in [1, Section 2.2].

A.6 Diagonal and Jordan Canonical Form of Matrices Let A be an n × n matrix A ∈ C n×n . The following developement follows [10]. To begin with, let us assume that A has distinct eigenvalues λ1 , . . . , λn . Let vi be an eigenvector of A corresponding to λi , i = 1, . . . , n. Then it can be easily shown that the set of vectors {v1 , . . . , vn } is linearly independent over C, and ( be the representation as such, it can be used as a basis for C n . Now let A ( is the of A with respect to the basis {v1 , . . . , vn }. Since the ith column of A representation of Avi = λi vi with respect to the basis {v1 , . . . , vn }, it follows that ⎡ ⎤ λ1 0 ⎢ λ2 ⎥ ⎥ (=⎢ A (A.48) ⎢ ⎥ diag(λ1 , . . . , λn ). .. ⎣ ⎦ . 0

λn

( are matrix representations of the same linear transformation, Since A and A ( are similar matrices. Indeed, this can be checked by it follows that A and A computing ( = P −1 AP, A (A.49) where P = [v1 , . . . , vn ] and where the vi are eigenvectors corresponding to λi , ( is true because the ith column of AP is i = 1, . . . , n. Note that AP = AP ( . Avi , which equals λi vi , the ith column of AP

A.6 Diagonal and Jordan Canonical Form of Matrices

479

( is obtained from a matrix A via a similarity transforWhen a matrix A mation P , we say that matrix A has been diagonalized. Now if the matrix A has repeated eigenvalues, then it is not always possible to diagonalize it. In generating a “convenient” basis for C n in this case, we introduce the concept of generalized eigenvector. Speciﬁcally, a vector v is called a generalized eigenvector of rank k of A, associated with an eigenvalue λ if and only if (A − λIn )k v = 0

and (A − λIn )k−1 v = 0,

(A.50)

where In denotes the n × n identity matrix. Note that when k = 1, this deﬁnition reduces to the preceding deﬁntion of eigenvector. Now let v be a generalized eigenvector of rank k associated with the eigenvalue λ. Deﬁne vk = v, vk−1 = (A − λIn )v = (A − λIn )vk , vk−2 = (A − λIn )2 v = (A − λIn )vk−1 , .. .

(A.51)

v1 = (A − λIn )k−1 v = (A − λIn )v2 . Then for each i, 1 ≤ i ≤ k, vi is a generalized eigenvector of rank i. We call the set of vectors {v1 , . . . , vk } a chain of generalized eigenvectors. For generalized eigenvectors, we have the following results: The generalized eigenvectors {v1 , . . . , vk } deﬁned in (A.51) are linearly independent. (ii) The generalized eigenvectors of A associated with diﬀerent eigenvalues are linearly independent. (iii) If u and v are generalized eigenvectors of rank k and l, respectively, associated with the same eigenvalue λ, and if ui and vj are deﬁned by

(i)

ui = (A − λIn )k−i u,

i = 1, . . . , k,

vj = (A − λIn )

j = 1, . . . , l,

l−j

v,

and if u1 and v1 are linearly independent, then the generalized eigenvectors u1 , . . . , uk , v1 , . . . , vl are linearly independent. These results can be used to construct a new basis for C n such that the matrix representation of A with respect to this new basis is in the Jordan canonical form J. We characterize J in the following result: For every complex n × n matrix A, there exists a nonsingular matrix P such that the matrix J = P −1 AP is in the canonical form

480

A Appendix

⎡ ⎢ ⎢ J =⎢ ⎣

J0

0 J1 ..

0

.

⎤ ⎥ ⎥ ⎥, ⎦

(A.52)

Js

where J0 is a diagonal matrix with diagonal elements λ1 , . . . , λk (not necessarily distinct), i.e., J0 = diag(λ1 , . . . , λk ), and each Jp is an np × np matrix of the form ⎡ ⎤ 0 ··· 0 λk+p 1 ⎢ .⎥ ⎢ 0 λk+p 1 . . . .. ⎥ ⎢ ⎥, Jp = ⎢ . ⎥ .. . . . ⎣ . ⎦ . 1 . 0 0 · · · λk+p

p = 1, . . . , s,

where λk+p need not be diﬀerent from λk+q if p = q and k + n1 + · · · + ns = n. The numbers λi , i = 1, . . . , k + s, are the eigenvalues of A. If λi is a simple eigenvalue of A, it appears in the block J0 . The blocks J0 , J1 , . . . , Js are called Jordan blocks, and J is called the Jordan canonical form. Note that a matrix may be similar to a diagonal matrix without having distinct eigenvalues. The identity matrix I is such an example. Also, it can be shown that any real symmetric matrix A has only real eigenvalues (which may be repeated) and is similar to a diagonal matrix. We now give a procedure for computing a set of basis vectors that yield the Jordan canonical form J of an n × n matrix A and the required nonsingular transformation P that relates A to J: 1. Compute the eigenvalues of A. Let λ1 , . . . , λm be the distinct eigenvalues of A with multiplicities n1 , . . . , nm , respectively. 2. Compute n1 linearly independent generalized eigenvectors of A associated with λ1 as follows: Compute (A − λ1 In )i for i = 1, 2, . . . until the rank of (A − λ1 In )k is equal to the rank of (A − λ1 In )k+1 . Find a generalized eigenvector of rank k, say u. Deﬁne ui = (A − λ1 In )k−i u, i = 1, . . . , k. If k = n1 , proceed to step 3. If k < n1 , ﬁnd another linearly independent generalized eigenvector with the largest possible rank; i.e., try to ﬁnd another generalized eigenvector with rank k. If this is not possible, try k − 1, and so forth, until n1 linearly independent generalized eigenvectors are determined. Note that if ρ(A−λ1 In ) = r, then there are totally (n−r) chains of generalized eigenvectors associated with λ1 . 3. Repeat step 2 for λ2 , . . . , λm . 4. Let u1 , . . . , uk , . . . be the new basis. Observe, from (A.51), that

A.6 Diagonal and Jordan Canonical Form of Matrices

481

Au1 = λ1 u1 = [u1 u2 · · · uk · · · ][λ1 , 0, . . . , 0]T , Au2 = u1 + λ1 u2 = [u1 u2 · · · uk · · · ][1, λ1 , 0, . . . , 0]T , .. . Auk = uk−1 + λ1 uk = [u1 u2 · · · uk · · · ][0, . . . , 0, 1, λ1 , 0, . . . , 0]T , with λ1 in the kth position, which yields the representation J in (A.52) of A with respect to the new basis, where the k × k matrix J1 is given by ⎡ ⎤ λ1 1 · · · 0 ⎢ .. ⎥ ⎢ 0 λ1 . ⎥ ⎢ ⎥. J1 = ⎢ ⎥ . .. 1 ⎦ ⎣ 0 · · · λ1 Note that each chain of generalized eigenvectors generates a Jordan block whose order equals the length of the chain. 5. The similarity transformation that yields J = Q−1 AQ is given by Q = [u1 , . . . , uk , . . . ]. 6. Rearrange the Jordan blocks in the desired order to yield (A.52) and the corresponding similarity transformation P .

Example A.30. The characteristic equation of the matrix ⎡ ⎤ 3 −1 1 1 0 0 ⎢ 1 1 −1 −1 0 0 ⎥ ⎢ ⎥ ⎢0 0 2 0 1 1⎥ ⎢ ⎥ A=⎢ ⎥ ⎢ 0 0 0 2 −1 −1 ⎥ ⎣0 0 0 0 1 1⎦ 0 0 0 0 1 1 is given by det(A − λI) = (λ − 2)5 λ = 0. Thus, A has eigenvalue λ2 = 2 with multiplicity 5 and eigenvalue λ1 = 0 with multiplicity 1. Now compute (A − λ2 I)i , i = 1, 2, . . . , as follows: ⎡ ⎤ 1 −1 1 1 0 0 ⎢ 1 −1 −1 −1 0 0 ⎥ ⎢ ⎥ ⎢0 0 0 0 1 1⎥ ⎥ (A − 2I) = ⎢ ⎢ 0 0 0 0 −1 −1 ⎥ and ρ(A − 2I) = 4, ⎢ ⎥ ⎣ 0 0 0 0 −1 1 ⎦ 0 0 0 0 1 −1

482

A Appendix

⎡

00 ⎢0 0 ⎢ ⎢0 0 (A − 2I)2 = ⎢ ⎢0 0 ⎢ ⎣0 0 00 ⎡ 00 ⎢0 0 ⎢ ⎢0 0 (A − 2I)3 = ⎢ ⎢0 0 ⎢ ⎣0 0 00 ⎡ 00 ⎢0 0 ⎢ ⎢0 0 (A − 2I)4 = ⎢ ⎢0 0 ⎢ ⎣0 0 00

⎤ 22 0 0 2 2 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 2 −2 ⎦ 0 0 −2 2 ⎤ 00 0 0 0 0 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 −4 4 ⎦ 0 0 4 −4 ⎤ 00 0 0 0 0 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 0 0⎥ ⎥ 0 0 8 −8 ⎦ 0 0 −8 8

and ρ(A − 2I)2 = 2,

and ρ(A − 2I)3 = 1,

and ρ(A − 2I)4 = 1.

Since ρ(A − 2I)3 = ρ(A − 2I)4 , we stop at (A − 2I)3 . It can be easily veriﬁed that if u = [0 0 1 0 0 0]T , then (A−2I)3 u = 0 and (A−2I)2 u = [2 2 0 0 0 0]T = 0. Therefore, u is a generalized eigenvector of rank 3. So we deﬁne T u1 (A − 2I)2 u = 2 2 0 0 0 0 , T u2 (A − 2I)u = 1 −1 0 0 0 0 , T u3 u = 0 0 1 0 0 0 . Since we have only three generalized eigenvectors for λ2 = 2 and since the multiplicity of λ2 = 2 is ﬁve, we have to ﬁnd two more linearly independent eigenvectors for λ2 = 2. So let us try to ﬁnd a generalized eigenvector of rank 2. Let v = [0 0 1 − 1 1 1]T . Then (A − 2I)v = [0 0 2 − 2 0 0]T = 0 and (A − 2I)2 v = 0. Moreover, (A − 2I)v is linearly independent of u1 , and hence, we have another linearly independent generalized eigenvector of rank 2. Deﬁne T v2 v = 0 0 1 −1 1 1 and T v1 = (A − 2I)v = 0 0 2 −2 0 0 . Next, we compute an eigenvector associated with λ1 = 0. Since w = [0 0 0 0 1 − 1]T is a solution of (A − λ1 I)w = 0, the vector w will do. Finally, with respect to the basis w1 , u1 , u2 , u3 , v1 , v2 , the Jordan canonical form of A is given by

A.7 Normed Linear Spaces

⎡

00 ⎢0 2 ⎢ ⎢0 0 J =⎢ ⎢0 0 ⎢ ⎣0 0 00 and

00 10 21 02 00 00

⎤

⎡

λ1 00 ⎢ 0 0 0⎥ ⎥ ⎢ ⎢ 0 0⎥ ⎥=⎢ 0 ⎥ 0 0⎥ ⎢ ⎢ 0 2 1⎦ ⎣ 0 02 0

0 λ2 0 0 0 0

0 1 λ2 0 0 0

0 0 1 λ2 0 0

0 0 0 0 λ2 0

483

⎤

0 0 ⎥ ⎥ 0 ⎥ ⎥ 0 ⎥ ⎥ 1 ⎦ λ2

(A.53)

⎡

⎤ 02 10 0 0 ⎢ 0 2 −1 0 0 0 ⎥ ⎢ ⎥ ⎢ 0 0 0 1 2 1⎥ ⎥ P = w1 u1 u2 u3 v1 v2 = ⎢ ⎢ 0 0 0 0 −2 −1 ⎥ . ⎢ ⎥ ⎣ 1 0 0 0 0 1⎦ −1 0 0 0 0 1

(A.54)

The correctness of P is easily checked by computing P J = AP .

A.7 Normed Linear Spaces In the following discussion, we require for (V, F ) that F be either the ﬁeld of real numbers R or the ﬁeld of complex numbers C. For such linear spaces we say that a function · : V → R+ is a norm if x ≥ 0 for every vector x ∈ V and x = 0 if and only if x is the null vector (i.e., x = 0); (N-ii) for every scalar α ∈ F and for every vector x ∈ V , αx = |α| x , where |α| denotes the absolute value of α when F = R and the modulus when F = C; and (N-iii) for every x and y in V , x + y ≤ x + y . (This inequality is called the triangle inequality.)

(N-i)

We call a vector space on which a norm has been deﬁned a normed vector space or a normed linear space.

Example A.31. On the linear space (Rn , R), we deﬁne for every x = (x1 , . . . , xn )T , n |xi |p )1/p , 1 ≤ p < ∞ (A.55) x p = ( i=1

and x ∞ = max{|xi | : 1 ≤ i ≤ n}.

(A.56)

Using Minkowski’s Inequality for ﬁnite sums, see (A.5), it is an easy matter to show that for every p, 1 ≤ p ≤ ∞, · p is a norm on Rn . In addition to · ∞ , of particular interest to us will be the cases p = 1 and p = 2; i.e.,

484

A Appendix

x 1 =

n

|xi |

(A.57)

i=1

and

x 2 =

n

1/2 |xi |2

.

(A.58)

i=1

The norm · 1 is sometimes referred to as the taxicab norm or Manhattan norm, whereas, · 2 is called the Euclidean norm. The linear space (Rn , R) with norm · 2 is called a Euclidean vector space. The foregoing norms are related by the inequalities x ∞ ≤ x 1 ≤ n x ∞ , √ x ∞ ≤ x 2 ≤ n x ∞ , √ x 2 ≤ x 1 ≤ n x 2 .

(A.59) (A.60) (A.61)

Also, for p = 2, we obtain from the H¨ older Inequality for ﬁnite sums, (A.4), the Schwarz Inequality |x y| = | T

n

xi yi | ≤

i=1

n

1/2 |xi |

2

i=1

n

1/2 |yi |

2

(A.62)

i=1

for all x, y ∈ Rn . The assertions made in the above example turn out to be also true for the space (C n , C). We ask the reader to verify these relations. Example A.32. On the space lp given in Example A.5, let x p =

∞

1/p |xi |

p

1 ≤ p < ∞,

,

i=1

and x ∞ = sup |xi |. i

Using Minkowski’s Inequality for inﬁnite sums, (A.5), it is an easy matter to show that · p is a norm for every p, 1 ≤ p ≤ ∞.

Example A.33. On the space given in Example A.7, let

1/p

b

|x(t)| dt

x p =

p

a

,

1 ≤ p < ∞.

A.7 Normed Linear Spaces

485

Using Minkowski’s Inequality for integrals, (A.10), see Example A.7, it can readily be veriﬁed that · p is a norm for every p, 1 ≤ p < ∞. Also, on the space of continuous functions given in Example A.8, assume that (A.11) holds. Then x ∞ = max |x(t)| a≤t≤b

is easily shown to determine a norm. Furthermore, expression (A.12) can also be used to determine a norm.

Example A.34. We can also deﬁne the norm of a matrix. To this end, consider the set of real m × n matrices, Rm×n = V and F = R. It is easily veriﬁed that (V, F ) = (Rm×n , R) is a vector space, where vector addition is deﬁned as matrix addition and multiplication of vectors by scalars is deﬁned as multiplication of matrices by scalars. For a given norm · u on Rn and a given norm · v on Rm , we deﬁne · vu : Rm×n → R+ by A vu = sup{ Ax v : x ∈ Rn with x u = 1}.

(A.63)

It is easily veriﬁed that (M-i) Ax v ≤ A vu x u for any x ∈ Rn , (M-ii) A + B vu ≤ A vu + B vu , (M-iii) αA vu = |α| A vu for all α ∈ R, (M-iv) A vu ≥ 0 and A vu = 0 if and only if A is the zero matrix (i.e., A = 0), m n (M-v) A vu ≤ i=1 j=1 |aij | for any p-vector norms deﬁned on Rn and Rm . Properties (M-ii) to (M-iv) clearly show that · vu deﬁnes a norm on Rm×n and justiﬁes the use of the term matrix norm. Since the matrix norm · vu depends on the choice of the vector norms, · u , and · v , deﬁned on U Rn and V Rm , respectively, we say that the matrix norm · uv is induced by the vector norms · u and · v . In particular, if · u = · p and · v = · p , then the notation A p is frequently used to denote the norm of A. As a speciﬁc case, let A = [aij ] ∈ Rm×n . Then it is easily veriﬁed that m A 1 = max |aij | , j

i=1

A 2 = [max λ(AT A)]1/2 , where max λ(AT A) denotes the largest eigenvalue of AT A and

486

A Appendix

⎛ ⎞ n A ∞ = max ⎝ |aij |⎠ . i

j=1

When it is clear from context which vector spaces and vector norms are being used, the indicated subscripts on the matrix norms are usually not used. For example, if A ∈ Rm×n and B ∈ Rn×k , it can be shown that (M-vi) AB ≤ A B . In (M-vi) we have omitted subscripts on the matrix norms to indicate inducing vector norms. We conclude by noting that it is possible to deﬁne norms on (Rm×n , R) that need not be induced by vector norms. Furthermore, the entire discussion given in Example A.34 holds also for norms deﬁned on complex spaces, e.g., (C m×n , C).

A.8 Some Facts from Matrix Algebra Determinants We recall that the determinant of a matrix A = [aij ] ∈ Rn×n , det A, can be evaluated by the relation aij dij for any i = 1, 2, . . . , n, det A = j

where dij = (−1) det Aij and Aij is the (n − 1) × (n − 1) matrix obtained by deleting the ith row and jth column of A. The term dij is the cofactor of A corresponding to aij and det Aij is the ijth minor of the matrix . The principal minors of A are obtained by letting i = j, i, j = 1, . . . n. If any column (or row) of A is multiplied by a scalar k, then the determinant of the new matrix is k det A. If every entry is multiplied by k, then the determinant of the new matrix is k n det A. Also, i+j

det AT = det A

where AT is the transpose of A.

Determinants of Products det AB = det A det B when A and B are square matrices, and det[Im − AB] = det[In − BA] where A ∈ Rm×n and B ∈ Rn×m . Determinants of Block Matrices m×m m×n A B det = det A det[D − CA−1 B], C D

det A = 0

n×m n×n

= det D det[A − BD−1 C],

det D = 0.

A.9 Numerical Considerations

487

Inverse A−1 of A If A ∈ Rn×n and if A is nonsingular (i.e., det A = 0), then AA−1 = A−1 A = I. A−1 =

1 adj(A), det A

where adj(A) = [dij ]T is the adjoint of A, where dij is the cofactor of A corresponding to aij . When ab A= cd is a 2 × 2 matrix, then −1

A

1 d −b = . ad − cb −c a

If A ∈ Rm×m and C ∈ Rn×n , if A and C are nonsingular, and if B ∈ Rm×n and D ∈ Rn×m , then (A + BCD)−1 = A−1 − A−1 B(DA−1 B + C −1 )−1 DA−1 . For example −1 = I − C(sI − A + BC)−1 B. I + C(sI − A)−1 B When A ∈ Rm×n and B ∈ Rn×m , then (Im + AB)−1 = Im − A(In + BA)−1 B. Sylvester Rank Inequality If X ∈ Rp×n and Y ∈ Rn×m , then rank X + rank Y − n ≤ rank(xy) ≤ min{rank X, rank Y }.

A.9 Numerical Considerations Computing the rank of the controllability matrix [B, AB, . . . , An−1 B], the eigenvalues of A, or the zeros of the system {A, B, C, D} typically requires the use of a digital computer. When this is the case, one must deal with the selection of an algorithm and interpret numerical results. In doing so, two issues arise that play important roles in numerical computations using a computer, namely, the numerical stability or instability of the computational method used, and how well or ill conditioned the problem is numerically. An example of a problem that can be ill conditioned is the problem of calculating the roots of a polynomial, given its coeﬃcients. This is so because

488

A Appendix

for certain polynomials, small variations in the values of the coeﬃcients, introduced say via round-oﬀ errors, can lead to great changes in the roots of the polynomial. That is to say, the roots of a polynomial can be very sensitive to changes in its coeﬃcients. Note that ill conditioning is a property of the problem to be solved and does not depend on the ﬂoating-point system used in the computer, nor on the particular algorithm being implemented. A computational method is numerically stable if it yields a solution that is near the true solution of a problem with slightly changed data. An example 2 of a numerically unstable method to compute the roots of ax + 2bx + c = 0 2 is the formula (−b ± (b − ac))/a, which for certain parameters a, b, c may give erroneous results in ﬁnite arithmetic. This instability is caused by the subtraction of two approximately equal large numbers in the numerator when b2 >> ac. Note that the roots may be calculated in a numerically stable way, using the mathematically equivalent, but numerically very diﬀerent, expres sion c/(−b ∓ (b2 − ac)). We would like of course, to always use numerically stable methods, and we would prefer to have well-conditioned problems. In what follows, we discuss brieﬂy the problem of solving a set of algebraic equations given by Ax = b. We will show that a measure of how ill conditioned a given problem is, is the size of the condition number (to be deﬁned) of the matrix A. There are many algorithms to numerically solve Ax = b, and we will brieﬂy discuss numerically stable ones. Singular values, singular value decomposition, and the least-squares problem are also discussed. A.9.1 Solving Linear Algebraic Equations Consider the set of linear algebraic equations given by Ax = b,

(A.64)

where A ∈ Rm×n , b ∈ Rm and x ∈ Rn is to be determined. Existence and Uniqueness of Solutions See also Sec. A.3, (A.22)–(A.29). Given (A.64), for a given b, a solution x exists if and only if b ∈ R(A), or equivalently, if and only if ρ ([A, b]) = ρ(A).

(A.65)

Every solution of (A.64) can be expressed as a sum x = xp + xh ,

(A.66)

where xp is a speciﬁc solution and xh satisﬁes Axh = 0. There are dim N (A) = n − ρ(A)

(A.67)

A.9 Numerical Considerations

489

linearly independent solutions of the systems of equations Ax = 0. Ax = b has a unique solution if and only if (A.65) is satisﬁed and ρ(A) = n ≤ m.

(A.68)

A solution exists for any b if and only if ρ(A) = m. In this case, a solution may be found using x = AT (AAT )−1 b. When ρ(A) = m = n, then A is nonsingular and the unique solution is x = A−1 b.

(A.69)

It is of interest to know the eﬀects of small variations of A and b to the solution x of this system of equations. Note that such variations may be introduced, for example, by rounding errors when calculating a solution or by noisy data. Condition Number Let A ∈ Rn×n be nonsingular. If A is known exactly and b has some uncertainty Δb associated with it, then A(x + Δx) = b + Δb. It can then be shown that the variation in the solution x is bounded by Δb Δx ≤ cond(A) , x b

(A.70)

where · denotes any vector norm (and consistent matrix norm) and cond(A) denotes the condition number of A, where cond(A) A A−1 . Note that (A.71) cond(A) = σmax (A)/σmin (A), where σmax (A) and σmin (A) are the maximum and minimum singular values of A, respectively (see the next section). From the property of matrix norms, AA−1 ≤ A A−1 , it follows that cond(A) ≥ 1. This also follows from the expression involving singular values. If cond(A) is small, then A is said to be well conditioned with respect to the problem of solving linear equations. If cond(A) is large, then A is ill conditioned with respect to the problem of solving linear equations. In this case the relative uncertainty in the solution ( Δx / x ) can be many times the relative uncertainty in b ( Δb / b ). This is of course undesirable. Similar results can be derived when variations in both b and A are considered, i.e., when b and A become b+Δb and A+ΔA. Note that the conditioning of A, and of the given problem, is independent of the algorithm used to determine a solution. The condition number of A provides a measure of the distance of A to the set of singular (reduced rank) matrices. In particular, if ΔA is the norm of the smallest perturbation ΔA such that A + ΔA is singular, and is denoted by

490

A Appendix

d(A), then dA/ A = 1/ cond(A). Thus, a large condition number indicates a short distance to a singularity and it is not surprising that this implies great sensitivity of the numerical solution x of Ax = b to variations in the problem data. The condition number of A plays a similar role in the case when A is not square. It can be determined in terms of the singular values of A deﬁned in the next subsection. Computational Methods The system of equations Ax = b is easily solved if A has some special form (e.g., if it is diagonal or triangular). Using the method of Gaussian elimination, any nonsingular matrix A can be reduced to an upper triangular matrix U . These operations can be represented by premultiplication of A by a sequence of lower triangular matrices. It can then be shown that A can be represented as A = LU, (A.72) where L is a lower triangular matrix with all diagonal elements equal to 1 and U is an upper triangular matrix. The solution of Ax = b is then reduced to the solution of two systems of equations with triangular matrices, Ly = b and U x = y. This method of solving Ax = b is based on the decomposition (A.72) of A, which is called the LU decomposition of A. If A is a symmetric positive deﬁnite matrix, then it may be represented as A = U T U,

(A.73)

where U is an upper triangular matrix. This is known as the Cholesky decomposition of a positive deﬁnite matrix. It can be obtained using a variant of Gaussian elimination. Note that this method requires half of the operations necessary for Gaussian elimination on an arbitrary nonsingular matrix A, since A is symmetric. Now consider the system of equations Ax = b, where A ∈ Rm×n , and let rank A = n(≤ m). Then R R = Q1 R, (A.74) A=Q = [Q1 , Q2 ] O O where Q is an orthogonal matrix (QT = Q−1 ) and R ∈ Rn×n is an upper triangular matrix of full rank n. Expression (A.74) is called the QR decomposition of A. When rank A = r, the QR decomposition of A is expressed as R1 R2 , (A.75) AP = Q 0 0 where Q is orthogonal, R1 ∈ Rr×r is nonsingular and upper triangular, and P is a permutation matrix that represents the moving of the columns during the reduction (in QT AP ).

A.9 Numerical Considerations

491

The QR decomposition can be used to determine solutions of Ax = b. In particular, consider A ∈ Rm×n with rank A = n(≤ m) and assume that a solution exists. First, determine the QR decomposition of A given in (A.74). R x = QT b (since QT = Q−1 ) or Rx = c. Solve this Then QT Ax = QT b or 0 system of equations, where R is triangular and c = [In , 0]QT b. In the general case when rank(A) = r ≤ min(n, m), determine the QR decomposition of A (2.7) and assume that a solution exists. The solutions are given by x = R1−1 (c − R2 y) , c = [Ir , 0]QT b, where y ∈ Rm−r is arbitrary. P y A related problem is the linear least-squares problem where a solution x of the system of equations Ax = b is to be found that minimizes b − Ax 2 . This is a more general problem than simply solving Ax = b, since solving it provides the “best” solution in the above sense, even when an exact solution does not exist. The least-squares problem is discussed further in a subsequent subsection. A.9.2 Singular Values and Singular Value Decomposition The singular values of a matrix and the Singular Value Decomposition Theorem play a signiﬁcant role in a number of problems of interest in the area of systems and control, from the computation of solutions of linear systems of equations, to computations of the norm of transfer matrices at speciﬁed frequencies, to model reduction, and so forth. In what follows, we provide a brief description of some basic results and we introduce some terminology. Consider A ∈ C n×n , and let A∗ = A¯T ; i.e., the complex conjugate transpose of A. A ∈ C n×n is said to be Hermitian if A∗ = A. If A ∈ Rn×n , then A∗ = AT and if A = AT , then A is symmetric. A ∈ C n×n is unitary if A∗ = A−1 . In this case A∗ A = AA∗ = In . If A ∈ Rn×n , then A∗ = AT and if AT = A−1 , i.e., if AT A = AAT = In , then A is orthogonal . Singular Values Let A ∈ C m×n , and consider AA∗ ∈ C m×m . Let λi , i = 1, . . . , m denote the eigenvalues of AA∗ , and note that these are all real and nonnegative numbers. Assume that λ1 ≥ λ2 ≥ · · · λr ≥ · · · ≥ λm . Note that if r = rank A = rank(AA∗ ), then λ1 ≥ λ2 ≥ · · · ≥ λr > 0 and λr+1 = · · · = λm = 0. The singular values σi of A are the positive square roots of λi , i = 1, . . . , min(m, n). In fact, the nonzero singular values of A are σi = (λi )1/2 ,

i = 1, . . . , r,

(A.76)

where r = rank A, whereas the remaining (min(m, n) − r) of the singular values are zero. Note that σ1 ≥ σ2 ≥ · · · ≥ σr > 0, and σr+1 = σr+2 = · · · = σmin(m,n) = 0. The singular values could also have been found as the square

492

A Appendix

roots of the eigenvalues of A∗ A ∈ C n×n (instead of AA∗ ∈ C m×m ). To see this, consider the following result. Lemma A.35. Let m ≥ n. Then |λIm − AA∗ | = λm−n |λIn − A∗ A|;

(A.77)

i.e., all eigenvalues of A∗ A are eigenvalues of AA∗ that also has m − n additional eigenvalues at zero. Thus AA∗ ∈ C m×m and A∗ A ∈ C n×n have precisely the same r nonzero eigenvalues (r = rank A); their remaining eigenvalues, (m − r) for AA∗ and (n − r) for A∗ A, are all at zero. Therefore, either AA∗ or A∗ A can be used to determine the r nonzero singular values of A. All remaining singular values are zero. Proof. The proof is based on Schur’s formula for determinants. In particular, we have 1/2 λ Im A = |λ1/2 Im | |λ1/2 In − A∗ λ−1/2 Im A| D(λ) = A∗ λ1/2 In (A.78) = |λ1/2 Im | |λ−1/2 In | |λIn − A∗ A| =λ

m−n 2

· |λIn − A∗ A|,

where Schur’s formula was applied to the (1, 1) block of the matrix. If it is applied to the (2, 2) block, then D(λ) = λ

n−m 2

· |λIm − AA∗ |.

(A.79)

Equating (A.78) and (A.79) we obtain |λIm −AA∗ | = λm−n |λIn −A∗ A|, which is (A.78). 210 Example A.36. A = ∈ R2×3 . Here rank A = r = 1, λi (AA∗ ) = 0 0 0 ⎛ ⎡ ⎤⎞ 20 2 1 0 50 ⎝ ⎣ ⎦ ⎠ 10 = λi λi = {5, 0} and λ1 = 5, λ2 = 0. Also, 000 00 0 0 ⎛⎡ ⎛⎡ ⎤ ⎞ ⎤⎞ 20 420 210 ⎠ λi (A∗ A) = λi ⎝⎣ 1 0 ⎦ = λi ⎝⎣ 2 1 0 ⎦⎠, and λ1 = 5, λ2 = 0, and 000 00 000 √ √ λ3 = 0. The only nonzero singular value is σ1 = λ1 = + 5. The remaining singular values are zero. There is an important relation between the singular values of A and its induced Hilbert or 2-norm, also called the spectral norm A 2 = A s . In particular,

A.9 Numerical Considerations

A 2 (= A s ) = sup Ax 2 = max{(λi (A∗ A))1/2 } = σ ¯ (A), x2 =1

i

493

(A.80)

where σ ¯ (A) denotes the largest singular value of A. Using the inequalities that are axiomatically true for induced norms, it is possible to establish relations between singular values of various matrices that are useful in MIMO control design. The signiﬁcance of the singular values of a gain matrix A(jw) is discussed later in this section. There is an interesting relation between the eigenvalues and the singular values of a (square) matrix. Let λi , i = 1, . . . , n denote the eigenvalues of A ∈ Rn×n , let λ(A) = mini |λi |, and let λ(A) = maxi |λi |. Then σ(A) ≤ λ(A) ≤ λ(A) ≤ σ(A).

(A.81)

Note that the ratio σ ¯ (A)/σ(A), i.e., the ratio of the largest and smallest singular values of A, is called the condition number of A, and is denoted by cond(A). This is a very useful measure of how well conditioned a system of linear algebraic equations Ax = b is (refer to the discussion of the previous section). The singular values provide a reliable way of determining how far a square matrix is from being singular, or a nonsquare matrix is from losing rank. This is accomplished by examining how close to zero σ(A) is. In contrast, the eigenvalues of a square matrix are not a good indicator of how far the matrix is from being singular, and a typical example in the literature to illustrate this point is an n × n lower triangular matrix A with −1’s on the diagonal and +1’s everywhere else. In this case, σ(A) behaves as 1/2n and the matrix is nearly singular for large n, whereas all of its eigenvalues are at −1. In fact, it can be shown that by adding 1/2n−1 to every element in the ﬁrst column of A results in an exactly singular matrix (try it for n = 2). Singular Value Decomposition Let A ∈ C m×n with rank A = r ≤ min(m, n). Let A∗ = A¯T , the complex conjugate transpose of A. Theorem A.37. There exist unitary matrices U ∈ C m×n and V ∈ C n×n such that A = U ΣV ∗ , (A.82) Σr 0r×(n−r) where Σ = with Σr = diag(σ1 , σ2 , . . . , σr ) ∈ Rr×r 0(m−r)×r 0(m−r)×(n−r) selected so that σ1 ≥ σ2 ≥ · · · ≥ σr > 0. Proof. For the proof, see for example, Golub and Van Loan [7], and Patel et al. [11]. Let U = [U1 , U2 ] with U1 ∈ C m×r , U2 ∈ C m×(m−r) and V = [V1 , V2 ] with V1 ∈ C n×r , V2 ∈ C n×(n−r) . Then

494

A Appendix

A = U ΣV ∗ = U1 Σr V1∗ . Since U and V are unitary, we have ∗ U1 [U1 , U2 ] = Im , U1∗ U1 = Ir U ∗U = U2∗

(A.83)

(A.84)

and

V1∗ V V = [V1 , V2 ] = In , V1∗ V1 = Ir . V2∗ ∗

(A.85)

Note that the columns of U1 and V1 determine orthonormal bases for R(A) and R(A∗ ), respectively. Now AA∗ = (U1 Σr V1∗ )(V1 Σr U1∗ ) = U1 Σr2 U1∗ ,

(A.86)

from which we have AA∗ U1 = U1 Σr2 U1∗ U1 = U1 Σr2 .

(A.87)

If ui , i = 1, . . . , r, is the ith column of U1 , i.e., U1 = [u1 , u2 , . . . , ur ], then AA∗ ui = σi2 ui ,

i = 1, . . . , r.

(A.88)

This shows that the σi2 are the r nonzero eigenvalues of AA∗ ; i.e., σi , i = 1, . . . , r, are the nonzero singular values of A. Furthermore, ui , i = 1, . . . , r, are the eigenvectors of AA∗ corresponding to σi2 . They are the left singular vectors of A. Note that the ui are orthonormal vectors (in view of U1∗ U1 = Ir ). Similarly, A∗ A = (V1 Σr U1∗ )(U1 Σr V1∗ ) = V1 Σr2 V1∗ , (A.89) from which we obtain A∗ AV1 = V1 Σr2 V1∗ V1 = V1 Σr2 .

(A.90)

If vi , i = 1, . . . , r, is the ith column of V1 , i.e., V1 = [v1 , v2 , . . . , vr ], then A∗ Avi = σi2 vi ,

i = 1, 2, . . . , r.

(A.91)

The vectors vi are the eigenvectors of A∗ A corresponding to the eigenvalues σi2 . They are the right singular vectors of A. Note that the vi are orthonormal vectors (in view of V1∗ V1 = Ir ). The singular values are unique, whereas the singular vectors are not. To see this, consider %1 = U1 diag(e−jθi ). V%1 = V1 diag(ejθi ) and U Their columns are also singular vectors of A.

A.9 Numerical Considerations

495

Note also that A = U1 Σr V1∗ implies that A=

r

σi ui vi∗ .

(A.92)

i=1

The signiﬁcance of the singular values of a gain matrix A(jw) is now brieﬂy discussed. This is useful in the control theory of MIMO systems. Consider the relation between signals y and v, given by y = Av. Then y 2 Av 2 = max =σ ¯ (A) v 2 v2 =0 v 2

max

v2 =0

or max y 2 = max Av 2 = σ ¯ (A).

v2 =1

v2 =1

(A.93)

Thus, σ ¯ (A) yields the maximum ampliﬁcation, in energy terms (2-norm), when the transformation A operates on a signal v. Similarly, min y 2 = min Av 2 = σ(A).

v2 =1

v2 =1

Therefore, σ(A) ≤

Av 2 ≤σ ¯ (A), v 2

(A.94)

(A.95)

where v 2 = 0. Thus the gain (energy ampliﬁcation) is bounded from above and below by σ ¯ (A) and σ(A), respectively. The exact value depends on the direction of v. To determine the particular directions of vectors v for which these (max and min) gains are achieved, consider (A.92) and write y = Av =

r

σi ui vi∗ v.

(A.96)

i=1

Notice that |vi∗ v| ≤ ||vi ||||v|| = ||v||, since ||vi || = 1, with equality holding only when v = αvi , α ∈ C. Therefore, to maximize, consider v along the singular value directions vi and let v = αvi with |α| = 1 so that ||v|| = 1. Then in view of vi∗ vj = 0, i = j and vi∗ vj = 1, i = j, we have that y = Av = αAvi = ασi ui and ||y||2 = ||Av||2 = σi , since ||ui ||2 = 1. Thus, the maximum possible gain is σ1 ; i.e., max ||y||2 = max ||Av||2 = σ1 (= σ ¯ (A)), as was shown above. v2 =1

v2 =1

This maximum gain occurs when v is along the right singular vector v1 . Then Av = Av1 = σ1 u1 = y in view of (A.92); i.e., the projection is along the left singular vector u1 , also of the same singular value σ1 . Similarly, for the minimum gain, we have σr = σ(A) = min ||y||2 = min ||Av||2 ; in which v2 =1

case, Av = Avr = σr ur = y.

v2 =1

496

A Appendix

Additional interesting properties include R(A) = R(U1 ) = span{u1 , . . . , ur },

(A.97)

N (A) = R(V2 ) = span{vr+1 , . . . , vn },

(A.98)

where U = [u1 , . . . , ur , ur+1 , . . . , um ] = [U1 , U2 ], V = [v1 , . . . , vr , vr+1 , . . . , vn ] = [V1 , V2 ]. A.9.3 Least-Squares Problem Consider now the least-squares problem where a solution x to the system of linear equations Ax = b is to be determined that minimizes b − Ax 2 . Write min b − Ax 22 = min(b − Ax)T (b − Ax) = min(xT AT Ax − 2bT Ax + bT b). x

x

x

Then ∇x (xT AT Ax − 2bT Ax + bT b) = 2AT Ax − 2AT b = 0 implies that the x, which minimizes b − Ax 2 , is a solution of AT Ax = AT b.

(A.99)

Rewrite this as V1 Σr2 V1T x = (U1 Σr V1T )T b = V1 Σr U1T b in view of (A.89) and (A.83). Now x = V1 Σr−1 U1T b is a solution. To see this, substitute and note that V1T V1 = Ir . In view of the fact that N (AT A) = N (A) = R(V2 ) = span{vr+1 , . . . , vn }, the complete solution is given by xw = V1 Σr−1 U1T b + V2 w

(A.100)

for some w ∈ Rm−r . Since V1 Σr−1 U1T b is orthogonal to V2 w for all w, x0 = V1 Σr−1 U1T b

(A.101)

is the optimal solution that minimizes b − Ax 2 . The Moore–Penrose pseudo-inverse of A ∈ Rm×n can be shown to be A+ = V1 Σr−1 U1T .

(A.102)

We have seen that x = A+ b is the solution to the least-squares problem. It can be shown that this pseudo-inverse minimizes AA+ − Im F , where A, which is equal to the square root A F denotes the mFrobenius normof m of trace[AAT ] = i=1 λi (AAT ) = i=1 σi2 (A). It is of interest to note that the Moore–Penrose pseudo-inverse of A is deﬁned as the unique matrix that satisﬁes the conditions (i) AA+ A = A, (ii) A+ AA+ = A+ , (iii) (AA+ )T = AA+ , and (iv) (A+ A)T = A+ A. Note that if rank A = m ≤ n then it can be shown that A+ = AT (AAT )−1 ; this is, in fact, the right inverse of A, since A(AT (AAT )−1 ) = Im . Similarly, if rank A = n ≤ m, then A+ = (AT A)−1 AT , the left inverse of A, since ((AT A)−1 AT )A = In . Singular values and singular value decomposition are discussed in a number of references. See for example, Golub and Van Loan [7], Patel et al. [11], Petkov et al. [12], and DeCarlo [5].

References

497

A.10 Notes Standard references on linear algebra and matrix theory include Birkhoﬀ and MacLane [4], Halmos [8], and Gantmacher [6]. Our presentation in this appendix follows Michel and Herget [9]. Conditioning and numerical stability of a problem are key issues in the area of numerical analysis. Our aim in Section A.9 was to make the reader aware that depending on the problem, the numerical considerations in the calculation of a solution may be nontrivial. These issues are discussed at length in many textbooks on numerical analysis. Examples of good books in this area include Golub and Van Loan [7] and Stewart [13] where matrix computations are emphasized. Also, see Petkov et al. [12] and Patel et al. [11] for computational methods with emphasis on system and control problems. For background on the theory of algorithms, optimization algorithms, and their numerical properties, see Bazaraa et al. [2] and Bertsekas and Tsitsiklis [3].

References 1. P.J. Antsaklis and A.N. Michel, Linear Systems, Birkh¨ auser, Boston, MA, 2006. 2. M.S. Bazaraa, H.D. Sherali, and C.M. Shetty, Nonlinear Programming Theory and Algorithms, 2nd edition, Wiley, New York, NY, 1993. 3. D.P. Bertsekas and J.N. Tsitsiklis, Parallel and Distributed Computation– Numerical Methods, Prentice Hall, Englewood Cliﬀs, NJ, 1989. 4. G. Birkhoﬀ and S. MacLane, A Survey of Modern Algebra, Macmillan, New York, NY, 1965. 5. R.A. DeCarlo, Linear Systems, Prentice Hall, Englewood Cliﬀs, NJ, 1989. 6. F.R. Gantmacher, Theory of Matrices, Vols. I and II, Chelsea Publications, New York, NY, 1959. 7. G.H. Golub and C.F. Van Loan, Matrix Computations, The Johns Hopkins University Press, Baltimore, MD, 1983. 8. P.R. Halmos, Finite Dimensional Vector Spaces, D. Van Nostrand, Princeton, NJ, 1958. 9. A.N. Michel and C.J. Herget, Applied Algebra and Functional Analysis, Dover, New York, NY, 1993. 10. R.K. Miller and A.N. Michel, Ordinary Diﬀerential Equations, Academic Press, New York, NY, 1982. 11. R.V. Patel, A.J. Laub, and P.M. VanDooren, Eds., Numerical Linear Algebra Techniques for Systems and Control, IEEE Press, Piscataway, NJ, 1993. 12. P.Hr. Petkov, N.D. Christov, and M.M. Konstantinov, Computational Methods for Linear Control Systems, Prentice Hall-International Series, Englewood Cliﬀs, NJ, 1991. 13. G.W. Stewart, Introduction to Matrix Computations, Academic Press, New York, NY, 1973.

Solutions to Selected Exercises

Exercises of Chapter 1 √ 1.10 Δx˙ = (k1 k2 /L) Δx + k2 Δu, Δy = (k1 /L) Δx where L = 2 k − k1 k2 t. Δx˙ 1 01 Δx1 1.12 (a) = . Δx˙ 2 Δx2 11 (b) x1 = x,x2 = x ˙ Δx˙ 1 0 1 Δx1 0 = + Δu. Δx˙ 2 Δx2 0 −3 −1 ˙ x3 = s, x4 = s˙ 1.13 x⎤1 =⎡φ, x2 = φ, ⎤⎡ ⎤ ⎡ ⎡ 0 10 0 0 Δx1 Δx˙ 1 ⎢ Δx˙ 2 ⎥ ⎢ g 0 0 F ⎥ ⎢ Δx2 ⎥ ⎢ − 1 L M ⎥⎢ ⎥ ⎢L ⎥ ⎢ LM ⎢ ⎣ Δx˙ 3 ⎦ = ⎣ 0 0 0 1 ⎦ ⎣ Δx3 ⎦ + ⎣ 0 1 F Δx˙ 4 Δx4 0 0 0 −M M

⎤ ⎥ ⎥ Δμ. ⎦

Exercises of Chapter 2 2.4 (b) Not linear; time-invariant; causal. 2.5 Causal; linear; not time-invariant. 2.6 Noncausal; linear; time-invariant. 2.7 Not linear. 2.8 Noncausal; time-invariant. 2.9 Noncausal; nonlinear (aﬃne). ∞ ∞ 2.10 y(n) = k=−∞ u(l)[s(n, l) − s(n, l − 1)], where s(n, l) = l=−∞ h(n, k) p(k − l) is the unit step response of the system.

500

Solutions to Selected Exercises

Exercises of Chapter 3 3.1 (a) (α1 , α2 , α3 ) = (1, 0, 5). (b) (¯ α1 , α ¯2, α ¯ 3 ) = (s, 2, s + 1/s). ¯ = [0, 1/2, 1/2]. 3.2 a = [1, 0, −2]T , a 3.3 A basis is {(1, α)T }, α ∈ R. 3.4 It is a vector space of dimension n2 . The set of nonsingular matrices is not a vector space since closure of matrix addition is violated. 3.5 Dependent over the ﬁeld of rational functions; independent over the ﬁeld of reals. 3.6 (a) Rank is 1 over complex numbers. (b) 2 over reals. (c) 2 over rational functions. (d) 1 over rational functions. 3.8 Directly, from the series deﬁnition of eAt or using system concepts. 3.9 See also Subsection 6.4.1. 3.11 (λki , v i ) is an (eigenvalue, eigenvector) pair of Ak . Then f (A)v i = f (λi )v i . 3.13 Substitute x(t) = Φ(t, t0 )z(t) into x˙ = A(t)x + B(t)u. 3.14 Take derivatives of both sides of Φ(t, τ )Φ(τ, t) = I with respect to τ . 3.19 Verify that Φ(t, 0) = eAt is the solution of Φ(t, 0) = AΦ(t, 0), Φ(0, 0) = I. √ 3.21 Use Exercise 3.19. x21 + x22 = 2 = ( 2)2 , so trajectory is a circle. 3.22 x(0) = [1, 1]T is colinear to the eigenvector of eigenvalue 1, and so et is the only mode that appears in the solution. 3.23 (a) Take t = 0 in the expression for eAt . 3.25 (a) x(0) = [−1, 1, 0]T . 3.30 (I − A)x(0) = Bu(0); u(0) = 2.

Exercises of Chapter 4 4.1 Set of equilibria is {(−4v, v, 5v)T : v ∈ R}. 1 4.2 Set of equilibria is {( kπ , 0)T : k ∈ N \{0}} ∪ {(0, 0)T }.

4.3 x = 0 is uniformly asymptotically stable; x = 1 is unstable. 4.5 A > 0. 4.7 x = 0 is exponentially stable; x = 1 is unstable. 4.9 Uniformly BIBO stable.

Solutions to Selected Exercises

501

4.10 (a) Set of equilibria {(α, −α)T ∈ R2 : α ≥ 0}. (b) No equilibrium. 4.12 x = 0 is stable. 4.13 x = 0 is stable. 4.14 x = 0 is not stable. 4.15 x = 0 is not stable. 4.18 (a) x = 0 is stable. (b) x = 0 is stable. 4.21 x = 0 is unstable. 4.22 Not BIBO stable. Theorem cannot be applied.

Exercises of Chapter 5 5.2 (a) Controllable from u, observable from y. (b) when u1 = 0, controllable from u2 ; when u2 = 0, not controllable from u1 . (c) not observable from y1 ; observable from y2 . 5.3 (a) Use u(t) = B T eA

T

(T −t)

Wr−1 (0, T )(x1 − eAT x0 ).

5.4 (a) It can be reached in two steps, with u(0) = 3, u(1) = −1. (b) Any x = (b, a, a)T will be reachable. a, b ∈ R. (c) x = (0, 0, a)T unobservable. a ∈ R. 5.10 (a) u(0) = −1, u(1) = 2; (b) y(1) = (1, 2)T u(0). 5.11 x0 = [1 0 α]T , α ∈ R.

Exercises of Chapter 6 6.2 (b) λ = 3 uncontrollable (ﬁrst pair); λ = −1 uncontrollable (second pair). 6.3 Controllability indices are 1, 3. 6.7 Use controller form or Sylvester’s Rank Inequality. 6.13 (a) It is controllable. (b) It is controllable from f1 only. (c) It is observable.

Exercises of Chapter 7 7.1 Use the standard form for uncontrollable systems. 7.5 λ1 = 1 is both controllable and observable, λ2 = − 21 is uncontrollable but observable, and λ3 = − 12 is controllable but unobservable.

502

Solutions to Selected Exercises

7.6 (a) λ = 2 is uncontrollable and unobservable. (b) H(s) =

1 s+1

11 . 10

(c) It is not asymptotically stable, but it is BIBO stable. 7.7 (a) pH (s) = s2 (s + 2), mH (s) = s(s + 2). (b) zH (s) = 1. 7.8 (a) pH (s) = s3 = mH (s). (b) zH (s) = 1. 7.10 (a) They are rc. (b) They are not lc; a glcd is

s0 . 01

7.13 (a) It is uncontrollable and unobservable. −1 2 2 . (b) H(s) = s+1 00

Exercises of Chapter 8 8.4 pH = s2 − 1; McMillan degree is 2. 8.6 (a) p ⎡H (s) = s(s ⎤ + 1)(s⎡+ 3);⎤McMillan degree is 3. 0 0 0 10 1 20 01 (b) A = ⎣ 0 −1 0 ⎦, B = ⎣ 0 1 ⎦, C = ,D= . 0 −1 1 01 0 0 −3 10 8.10 (a) pH (s) = s2 (s + 1)2 so the order of any minimal realization is 4. (b) Take u1 = 0, and ﬁnd the McMillan degree, which is 2. So in a fourth order realization, system will not be controllable from u2 only. System will be observable from y1 . 8.12 pH (s) = s3 , and 3 is the ⎡ order of⎤any minimal realization. A minimal ⎡ so ⎤ 010 000 0 1 −1 101 realization is A = ⎣ 0 0 0 ⎦, B = ⎣ 0 1 0 ⎦, C = ,D= . 11 0 000 000 001

Exercises of Chapter 9 9.4 F = gf , g = (0, 1)T , f = (−11 − 19 − 12; −10) (after reducing the system to single-input controllable). 9.6 (a) G = 12 , F = [−2, − 27 , − 52 ]. (b) controllable but unobservable. ˙ Then A = 0 1 , B = 0 , C = 1 0 . 9.9 (a) Let x1 = θ, x2 = θ. 0 −1 1 (b) F = [−1, −1]. 9.11 F = [−3.7321, −6, 4641] minimizes J1 . 9.12 (a) F = 32 , 1 . (b) K = [2α, α2 + 2]T .

Solutions to Selected Exercises

503

9.13 (a) OE = 0. (b) E = α(1, −1)T . 10 9.14 F = − . 12 9.15 (a) x0 = −(λI − A)−1 B; If λ is a zero of H(s), a pole-zero cancellation will occur. (b) x0 = αv, where v is the eigenvector corresponding to λ.

Exercises of Chapter 10 (1 = 0, Y1 = Y(1 = 1, H2 = (1 + s2 K)/K, where K is any 10.1 (a) For X1 = X ( = (s2 + 8s + 24)/(s + 2)2 , stable rational function. Alternatively, for X1 = X 1 ( = 1/(s + 2)2 , D = D ( = s2 /(s + 2)2 , Y1 = Y(1 = (32s + 16)/(s + 2)2 , N1 = N 1 1 1 2 2 and H2 = (32s + 16 − s K )/(s + 8s + 24 − K ), where K is any proper and stable rational function. (b) In general, it is not easy (or may be impossible) to restrict appropriately K or K , so H2 is of speciﬁc order. Here let H2 = (b1 s + b0 )/(s + a0 ) and establish conditions on the parameters so that the closed-loop system is stable. 10.4 (b) N −1 T = X , a proper and stable function, implies conditions on ni , di of T . 10.5 (a) In view of the hint, N −1 T = 1/(s + 2)2 = 1/G−1 DF , from which G = 2, F (s) = F S(s) = [−6, −11][1, s]T .

Index

A/D, analog-to-digital converter, 117 Abel’s formula, 80 Ackermann’s formula, 361, 382, 401 Adjoint equation, 132, 133 Adjoint of a matrix, 487 Algebraic multiplicity, 475, see also Eigenvalue Asymptotic behavior, 94, 121, see also Mode of system Asymptotic state estimator, see State observer Automobile suspension system, 140 Autonomous, 10, see also Linear ordinary diﬀerential equation; System Axioms of a ﬁeld, 455 of a norm, 483 of a vector space, 456 Basis, see Vector space BIBO stable, 170, 174, 187, 189, see also Stability Biproper, 427, see also Rational function Canonical form, 471 Jordan, 88, 478–481 Canonical Structure Theorem, 245, 269, see also Kalman’s Decomposition Theorem Cauchy–Peano existence theorem, 18 Cayley–Hamilton Theorem, 91, 127, 475 Characteristic

equation, 474 polynomial, 474, see also Matrix; Transfer function value, see Eigenvalue vector, see Eigenvector Cholesky decomposition, 490 Circuit, 14, 279, 286, 291 Closed-loop control, 353, 400 Cofactor, 486, see also Matrix Command input, see Reference input Companion form matrix, 137 Condition number, 489, see also Matrix Constructibility, 222, 230, see also Observability continuous-time system, 222–224 discrete-time system, 202, 228 Gramian, 223 Continuous function at a point, 7 over an interval, 7 uniformly, 7 Control problems, 445 Controllability (-to-the-origin), 209, 210, 230, 303, 307 continuous-time system, 209, 230 discrete-time system, 216 eigenvalue/eigenvector (PBH) test, 248 from the origin, see Reachability Gramian, 210 indices, 256

506

Index

Controllability (Cont’d ) matrix, 197, 206, 230 output, 234 Controllable (-to-the-origin), 199, 209, 230 companion form, see Controller form eigenvalues, 240 mode, 240 single-input, 405 subspace, 209 Controller digital, 116 feedback, 352, 411 implementations, 439 with two degrees of freedom, 431, 448 Controller form, 251, 270 multi-input, 256, 270 single-input, 252, 270 Converter(A/D, D/A), 117 Convolution integral, 69 sum, 62 Coprime, 299, 301, 307, 423, 448, see also Polynomial matrices D/A, digital-to-analog converter, 117 Deadbeat control, 136 observer, 388 Decoupling diagonal, 446, 449 static, 447, 449 Degree, McMillan, 321, 345 Detectable, 380 Determinant, 486, see also Matrix Determinantal divisor, 283 Diagonal decoupling, 446, 449 Diﬀerence equations, 51, see also Solutions of diﬀerence equations Diﬀerential equations, ordinary, see also Solutions of diﬀerential equations classiﬁcation, 10 ﬁrst-order, 9 linear, 20, 21 linear homogeneous, 11, 12, 28 linear homogeneous with constant coeﬃcients, 11, 12, 78

linear nonhomogeneous, 11, 12, 30, 78 nth-order, 11 systems of ﬁrst-order, 10 Digital signal, 117 Diophantine equation, 424, 427, 447 all solutions, 424, 429 Bezout identity, 427 Dirac delta distribution, 65, 66, 73, 92 Direct link matrix, 105 Discrete-time impulse, 60 Discrete-time Kalman ﬁlter, 391, see also Kalman ﬁlter Divisor, common, 298 Domain of attraction, 166, see also Equilibrium Double integrator, 120, 139 Doubly coprime, 423, 448, 450, see also Coprime Dual system, 203, 232

Eigenvalue, 474 algebraic multiplicity, 475 controllable, 240 critical, 152 geometric multiplicity, 475 multiple, 475 observable, 243 Eigenvalue or pole assignment, 357, 401 direct method, 358, 400 eigenvector assignment, 364, 401 using controller form, 359, 401 Eigenvector, 474 generalized, 479 Equilibrium, 124, 129, 142, 174, 188, see also Stability attractive, 145 domain of attraction, 145 qualitative characterization, 144 trivial solution, 143 Equivalence of internal representations, 105, 115, 303 of matrices, 473 zero-input, 107 zero-state, 107 Estimator, see State observer Euclidean norm, 484

Index Euler method, 38 External input, 352 Feedback conﬁguration, 413 control, 411 gain matrix, 352 output, 351, 392, 411 state, 351, 400 Feedback stabilizing controller, 422, 448 parameterizations, polynomial MFD, 423, 448 parameterizations, proper and stable MFD, 426, 448 two degrees of freedom, 434, 449 Field, 455 Frequency response, 138 Function, 7 continuous, 7 Hamiltonian, 34 indeﬁnite, 155 piecewise continuous, 8, 31 positive deﬁnite, semideﬁnite, 155 Fundamental matrix, 78–81, 127 Fundamental theorem of linear equations, 466 Gaussian elimination, 490 Generalized distance function, 154, see also Lyapunov function Generalized eigenvector, 479 Generalized energy function, 154, see also Lyapunov function Generalized function, 66, see also Dirac delta distribution Geometric multiplicity, 475, see also Eigenvalue Gram matrix, 211 Gramian constructibility, 223 controllability, 210 observability, 220, 231 reachability, 206, 230 Hamiltonian dynamical systems, 34 function, 34 matrix, 372

507

Hamiltonian matrix, 377 Hankel matrix, 322, 345 Harmonic oscillator, 134 Hermite form, 299, 301 H¨ older’s Inequality, 458 Hurwitz matrix, 165 Hybrid system, 118 Ill conditioned, 489 Impulse response continuous-time, 70, 71, 73 discrete-time, 64, 72 Impulse response matrix, 64, 68, 70, 71 Indices controllability, 256 observability, 265 Inﬁnite series method, 87, 127, see also Matrix, exponential Initial conditions, 5, 6 Initial time, 5, 6 Initial-value problem, 8, 11, 32, 51 examples, 13 solutions, 17 Input command or reference, 352 comparison sensitivity matrix, 436 decoupling zeros, 287, 305 external, 352 function observability, 235 output decoupling zeros, 288, 305 vector, 5 Input-output description, see System representations, descriptions Instability, 160 Integral equation, 10 Integral representation, 65 Integration, forward rectangular rule, 38 Internal description, see System representations, descriptions Internal stability, 144–169, 173–186, 188 Invariant factors, polynomials, 283 Invariant property of (A, B), 260 Invariant subspace, 209, 227 Inverted pendulum, 43, see also Pendulum Jacobian matrix, 21, 32 Jordan canonical form, 88, 478–481

508

Index

Kalman ﬁlter continuous-time, 385 discrete-time, 391 Kalman–Bucy ﬁlter, 385 Kalman’s Decomposition Theorem, 245, 269 Lagrange’s equation, 35 Lagrangian, 36 Laplace transform, 92, 127 Least-order realization, 318 Least-squares, 491 Leonhard–Mikhailov stability criterion, 190 Level curve, 157, see also Lyapunov function Lienard equation, 15, 167 Limit cycle, 42 Linear algebraic equation fundamental theorem, 466 solutions, 469, 488 Linear operator, see Linear transformation Linear ordinary diﬀerence equations, 52, 53 Linear ordinary diﬀerential equation, see also Solutions of diﬀerential equations autonomous, 10 homogeneous, 11, 12, 28 matrix, 80 nonhomogeneous, 11, 12, 30 periodic, 10, 12 Linear space, see Vector space Linear system, 57 Linear transformation, 464 fundamental theorem, 466 null space, 465 nullity, 466 orthogonal, 491 principle of superposition, 50 range space, 466 representation by a matrix, 466 Linearization, 6, 21, 32, 164, 185, 189 examples, 24 Linearized equation, 22, 23, 32 Linearly dependent, 461, 462, see also Vector Linearly independent, 210, 461, 462,

see also Vector Lipschitz condition, 18, 20 LQG (linear quadratic Gaussian) problem, 385, 402, 403 LQR (linear quadratic regulator) problem continuous-time, 369 discrete-time, 377, 401 LU decomposition, 490 Luenberger observer, 379, 402 Lyapunov function, 154, 183 construction of, 160 level curve, 157 Lyapunov matrix equation, 153, 179, 189 Lyapunov stability, 144, 148, 188, 189, see also Stability Lyapunov’s Direct or Second Method, 153 Markov parameter, 137, 315, 322, 345 Matrix characteristic polynomial, 474 Cholesky decomposition, 490 cofactor, 486 companion form, 137 condition number, 489 controllability, 197, 230 determinant, 486 diagonal, 478 equivalent, 473 exponential, 85, 127 fundamental, 80 Gram, 211 Hamiltonian, 372, 377 Hankel, 322, 345 Hermite form, 299, 301 Hermitian, 491 Hurwitz, 165 ill conditioned, 489 impulse response, 64, 68, 70, 71 indeﬁnite, 154 inverse, 487 Jacobian, 21, 32 Jordan, 478–481 LU decomposition, 490 minimal polynomial, 477 minor, 155, 284, 307, 486 Moore–Penrose inverse, 496

Index Matrix (Cont’d ) negative deﬁnite, semideﬁnite, 154 nonsingular, 487 norm, 485 observability, 220, 231 orthogonal, 491 positive deﬁnite, semideﬁnite, 154 proper rational, 105 QR decomposition, 490 rank, 469 Rosenbrock system, 286, 305 Schur stable, 178 similar, 473 Smith form, 283 Smith–McMillan form, 284, 307 state transition, 82, 109, 127 symmetric, 154, 491 system, 286, 305 Toeplitz, 227 unimodular, 283 unitary, 491 well conditioned, 489 Matrix fractional description, 293, 297, 308, see also System representations, descriptions McMillan degree, 321, 345 MIMO system multi-input/multioutput, 56 Minimal polynomial, 284, 477 Minkowski’s Inequality, 458 Mode of system, 95, 122, 127, see also System Model matching problem, 446, 449, 452 Modeling, 2 Moore–Penrose pseudo-inverse, 496 Natural basis, 464, see also Basis; Vector space Negative, see also Function; Matrix deﬁnite, semideﬁnite, 154 Nonlinear systems, 4, 147, 164, 185, 189 Norm Euclidean, 484 induced, 485 Manhattan, 484 matrix, 485 taxicab, 484

509

Observability, 219, 223, 230, 304, 307 continuous-time system, 219, 221, 230 discrete-time system, 226 eigenvalue/eigenvector (PBH) test, 248 Gramian, 220, 231 indices, 265 matrix, 220, 231 subspace, see Unobservable Observable eigenvalue mode, 243 Observer, Luenberger, 379, 402, see also State observer Observer form, 263, 271 multi-output, 265, 271 single-input, 263, 271 Open-loop control, 353, 400 Operator, linear, see Linear transformation Optimal control problem, LQR, 369, 377, 401 estimation problem, LQG, 385, 391, 402, 404 Optimality principle, 403 Orthogonal, 491 matrix, 491 Output comparison sensitivity matrix, 436 decoupling zeros, 287, 305 equation, 5 function controllability, 235 reachability, controllability, 234 vector, 5 Peano–Baker series, 29, 33, 82 Pendulum inverted, 43 simple, 17, 24, 45 Phase plane, 134 portrait, 42 variable, 134 Picard iterations, 20 with successive approximations, 28 Pole assignment problem, 357, see also Eigenvalue or pole assignment Pole polynomial, 284, 307 Pole, zero relations, 290, 306

510

Index

Poles at inﬁnity, 283 Poles of a transfer function, 284 Poles of the system, 283, 306, see also Eigenvalue Polynomial monic, 477 Polynomial matrices coprime, left, right, 299, 301, 307 division algorithm, 476 doubly coprime, 423, 448, 450 greatest common divisors, 298, 300 Hermite form, 299, 301 Smith form, 283 unimodular, 283 Polynomial matrix description, 292, see also System representations, descriptions Positive, see also Function; Matrix deﬁnite, indeﬁnite, semideﬁnite, 155 Prediction estimator, 389 Predictor–corrector method, 40 Proper transfer function, 105

controller/observer form, 326, 345 matrix A diagonal, 339, 345 singular-value decomposition, 341, 345 using duality, 324, 345 Realization of systems, 314, 343, 345 existence and minimality, 316, 345 least order, irreducible, minimal order, 318, 321, 345 Reconstructible, see Constructibility Reference input, 352 Response, 49, 55, 71 maps, 435 total, 100, 111, 128 zero-input, 100, 111 zero-state, 100, 111 Return diﬀerence matrix, 421, 422 Riccati equation continuous-time case, 370, 401 discrete-time case, 386, 402 Rosenbrock system matrix, 286, 305 Routh–Hurwitz stability criterion, 190 Runge–Kutta method, 39

QR decomposition, 490 Quadratic form, 154 Quantization, 117

Sampled data system, 116, 129 Sampling period, rate, 119, 129 Scalar, 456 Schur–Cohn stability criterion, 190 Schwarz Inequality, 458 Semigroup property, 109 Sensitivity matrix, 436 Separation principle, property, 395, 403 Shift operator, 75 Signal, digital, 117 Similarity transformation, 105, 474 Singular value, 491 value decomposition, 493 vector, left, right, 494 SISO system single-input/single-output, 56 Smith form, 283 Smith–McMillan form, 284, 307 Solutions of algebraic equations, 469, 488 Solutions of diﬀerence equations particular, 55 total, 55 Solutions of diﬀerential equations, 9,

Rank, 469 test, 249 Rational function biproper, 427 proper and stable, 308 Rayleigh’s dissipation function, 36 Reachability, 205, 214, 216, see also Controllability, from the origin continuous-time system, 205, 230 discrete-time system, 198, 214, 230 Gramian, 206, 230 matrix, see Controllability output, 234 subspace, 206 Reachable, 198, 205, 214, 230, see also Controllable; Controllability, from the origin state, 205 subspace, 206 Realization algorithms, 324, 345

Index see also Variation of constants formula bounded, 148 continuable, 19 continuation, 18 continuous dependence on initial conditions, 20 continuous dependence on parameters, 19, 20 existence, 18, 27, 33 homogeneous, 28–30, 53 noncontinuable, 18, 19 particular, 31 Peano–Baker series, 29 predictor–corrector method, 40 Runge–Kutta, 39 successive approximations, Picard iterations, 20, 28 total, 31 Space of n-tuples, 457 of real-valued continuous functions, 459 span, 461 Spring, 16 Spring mass system, 139 Stability, 124, 129, 141, 148, 304, 307, 419, 427 asymptotic, 124, 145, 149, 150, 177, 178, 185 asymptotic in the large, 146, 149, 152, 177, 180 attractive equilibrium, 145, 175 bounded-input/bounded-output (BIBO), 170, 174, 187, 189 causal, 58, 61, 62, 64, 70, 72, 73 domain of attraction, 145, 175 exponential, 145, 150, 177 exponential in the large, 150, 152 external, 170 global asymptotic, 150 input–output, 170, 186, 189, 281, 306 linear systems, continuous, 148 linear systems, discrete, 173 Lyapunov, 144, 148, 188, 189, 281, 306 Routh–Hurwitz criterion, 190 Schur–Cohn, 190 Stabilizable, 356

Stable, see Stability Standard form Kalman’s canonical, 244, 269 uncontrollable system, 238, 269 unobservable system, 241 State partial, 295 phase variable, 134 variables, 5 vector, 5 State equation, 5 State estimator, see State observer State feedback, 352, 400, see also Feedback eigenvalue assignment, 355, 400 input–output relations, 372 optimal, 369, 377, 401 State observer, 378, 402 current, 389, 402 deadbeat, 388 full-order, 378, 387 identity, 379, 387 optimal, 385, 391, 402 partial state, 383, 391 prediction, 389 reduced-order, 383, 391 State transition matrix, 82, 109 State unconstructible, 222, 223 State unobservable, 220, 223 Structure theorem controllable version, 261, 270 observable version, 267, 271 Successive approximations, Picard iterations, 20, 28, 32, see also Solutions of diﬀerential equations Superposition principle, 50, 57 Sylvester Rank Inequality, 319, 487 System at rest, 63, 69 autonomous, 10 causal, 58, 72, 73 conservative, 34 continuous-time, 5 discrete-time, 4, 6, 50, 60, 72 distributed parameter, 4 dual, 203, 232 ﬁnite-dimensional, 4, 6 Hamiltonian, 35

511

512

Index

System (Cont’d ) hybrid, 118 inﬁnite-dimensional, 4 linear, 57 lumped parameter, 4 matrix, 286, 305 memoryless, 57 mode, 95, 122, 127 nonanticipative, 58 nonlinear, 4 realization, 314, 343, 345 sampled data, 116, 129 single input/single output, 56 time-invariant, 59, 72 time-varying, 59 with memory, 57, 72 System interconnections feedback, 413, 447 parallel, 411, 447 series, or tandem, 412, 447 System representations, descriptions balanced, 342, 345 continuous-time, 48 controller form, 251, 257, 270 diﬀerential/diﬀerence operator, 292, 307 discrete-time, 50 equivalence, of, 105, 115, 128 external, 6, 56, 72, 293 input–output, 56, 72, 73 internal, 6, 293 matrix fractional, 293, 297, 308 observer form, 263, 266, 271 polynomial matrix, 292, 295, 307, 308, 416 standard form, uncontrollable, unobservable, 238, 239, 241, 242, 269 state-space, 5 Time reversibility, 109 Toeplitz matrix, 227 Trajectory, 42, 134 Transfer function McMillan degree, 321, 345 minimal polynomial, 284 pole polynomial, 284 strictly proper, 105 Triangle inequality, 483

Truncation operator, 74 Two degrees of freedom controller, 431, 448 Unconstructible, 227, see also Constructibility subspace, 227 Uncontrollable, see also Controllability eigenvalues, modes, 240, 269 Unimodular matrix, 283 Unit pulse, or unit impulse, response, 61 pulse, or unit sample, 60 step function, 92 step sequence, 60 Unit impulse, 66, 73 Unity feedback, 441, 443, 449 Unobservable, 219, see also Observability eigenvalues, modes, 243 subspace, 219 van der Pol equation, 15, 42 Variation of constants formula, 31, 33, 132 Vector, 456 coordinate representation, 464 linearly dependent, 461, 462 linearly independent, 461, 462 Vector space, 456 basis, 463, 472 dimension, 463 examples, 457 ﬁnite-dimensional, 463 normed, 483 null, 465 Youla parameter, 425, 429, 449 z-Transform, 112 Zero, 286, 287, 304, 307 at inﬁnity, 310 decoupling input/output, 288, 305 direction, 292 invariant, 287, 305, 307 of transfer functions, 288, 305, 306 polynomial, 287, 305, 307 system, 287 transmission, 288, 305

Index Zero-input response, 100, 111, see also Response Zero-order hold, 117

Zero-state response, 100, 111, see also Response

513

About the Authors

Panos J. Antsaklis is the H. Cliﬀord and Evelyn A. Brosey Professor of Electrical Engineering and Concurrent Professor of Computer Science and Engineering at the University of Notre Dame. He served as the Director of the Center for Applied Mathematics of the University of Notre Dame from 1999 to 2005. He is a graduate of the National Technical University of Athens (NTUA), Greece and holds MS and Ph.D. degrees from Brown University. His research addresses problems of control and automation and examines ways to design engineering systems that will exhibit a high degree of autonomy in performing useful tasks. His recent research focuses on networked embedded systems and addresses problems in the interdisciplinary research area of control, computing and communication networks, and on hybrid and discrete-event dynamical systems. Dr. Antsaklis has authored a number of publications in journals, conference proceedings, and books, and he has edited six books on intelligent autonomous control, hybrid systems, and networked embedded control systems. In addition, he has co-authored the research monographs Supervisory Control of Discrete-Event Systems Using Petri Nets (Kluwer Academic Publishers, 1998, with J. Moody) and Supervisory Control of Concurrent Systems: A Petri Net Structural Approach (Birkh¨ auser, 2006, with M.V. Iordache) as well as the graduate textbook Linear Systems (McGraw-Hill, 1997, ﬁrst printing and Birkh¨ auser, 2005, second printing, with A.N. Michel). Dr. Antsaklis has been guest editor of special issues of the IEEE Transactions of Automatic Control and the Proceedings of the IEEE on Hybrid and on Networked Control Systems. He serves on the editorial boards of several journals, and he currently serves as Associate-Editor-at-Large of the IEEE Transactions of Automatic Control. Dr. Antsaklis has served as program chair and general chair of major systems and control conferences including the Conference on Decision and Control, and he was the 1997 President of the IEEE Control Systems Society (CSS). He has been a plenary and keynote speaker at a number of confer-

516

About the Authors

ences and research workshops and currently serves as the president of the Mediterranean Control Association. Dr. Antsaklis serves on the Scientiﬁc Advisory Board for the Max-PlanckInstitut f¨ ur Dynamik komplexer technischer Systeme, Magdeburg, Germany. He is currently a member of the subcommittee on Networking and Information Technology of the President’s Council of Advisors for Science and Technology (PCAST), which advises the President of the United States on science and technology federal policy issues regarding technology, scientiﬁc research priorities, and math and science education. Dr. Antsaklis is an IEEE Fellow for his contributions to the theory of feedback stabilization and control of linear multivariable systems, a Distinguished Lecturer of the IEEE Control Systems Society, a recipient of the IEEE Distinguished Member Award of the Control Systems Society, and an IEEE Third Millennium Medal recipient. He is the 2006 recipient of the Brown Engineering Alumni Medal from Brown University, Providence, Rhode Island. Anthony N. Michel received the Ph.D. degree in electrical engineering from Marquette University and the D.Sc. in applied mathematics from the Technical University of Graz, Austria. He has extensive industrial and academic experience with interests in control systems, circuit theory, neural networks, and applied mathematics. His most recent work is concerned with stability analysis of ﬁnite- and inﬁnite-dimensional discontinuous dynamical systems. He has held faculty positions at Iowa State University and the University of Notre Dame and visiting faculty positions at the Technical University in Vienna, Austria, the Johannes Kepler University in Linz, Austria, and the Ruhr University in Bochum, Germany. He is currently the Frank M. Freimann Professor of Engineering Emeritus and the Matthew H. McCloskey Dean of Engineering Emeritus at the University of Notre Dame. Dr. Michel has co-authored ten books and a number of publications in journals, conference proceedings, and books. He is a past Editor-in-Chief of the IEEE Transactions on Circuits and Systems and has held a variety of positions on the editorial boards of the IEEE Transactions on Automatic Control ; IEEE Transactions on Neural Networks; Circuits, Systems and Signal Processing; International Journal of Hybrid Systems; Nonlinear Analysis; and other journals. He is a past president of the IEEE Circuits and Systems Society and has been a member of the executive committees of several professional organizations. Dr. Michel is a Life Fellow of the IEEE. He received three prize paper awards from the IEEE Control Systems Society and the IEEE Circuits and Systems Society. He was awarded the IEEE Centennial Medal (1984), the Golden Jubilee Medal of the IEEE Circuits and Systems Society (1999), and the IEEE Third Millennium Medal (2000). He was a Fulbright Scholar at the Technical University of Vienna (1992), and he received the 1995 Technical Achievement Award of the IEEE Circuits and Systems Society, the Alexander von Humboldt Research Award for Senior U.S. Scientists (1997), the Distin-

About the Authors

517

guished Member Award of the IEEE Control Systems Society (1998), and the 2005 Distinguished Alumnus Award of the College of Engineering, Marquette University.