NNBook
September 1, 2009
Nonnegative and Compartmental Dynamical Systems
NNBook
September 1, 2009
NNBook
Septem...
43 downloads
1411 Views
3MB Size
Report
This content was uploaded by our users and we assume good faith they have the permission to share this book. If you own the copyright to this book and it is wrongfully on our website, we offer a simple DMCA procedure to remove your content from our site. Start by pressing the button below!
Report copyright / DMCA form
NNBook
September 1, 2009
Nonnegative and Compartmental Dynamical Systems
NNBook
September 1, 2009
NNBook
September 1, 2009
Nonnegative and Compartmental Dynamical Systems
Wassim M. Haddad VijaySekhar Chellaboina Qing Hui
PRINCETON UNIVERSITY PRESS PRINCETON AND OXFORD
NNBook
September 1, 2009
c 2010 by Princeton University Press Copyright Published by Princeton University Press 41 William Street, Princeton, New Jersey 08540 In the United Kingdom: Princeton University Press 6 Oxford St, Woodstock, Oxfordshire OX20 1TW All Rights Reserved Library of Congress Cataloging-in-Publication Data Haddad, Wassim M., 1961– Nonnegative and compartmental dynamical systems / Wassim M. Haddad, VijaySekhar Chellaboina, Qing Hui. p. cm. Includes bibliographical references and index. ISBN 978-0-691-14411-5 (hardcover : alk. paper) 1. Differential dynamical systems. I. Chellaboina, VijaySekhar, 1970- II. Hui, Qing, 1976- III. Title. QA614.8.H33 2010 515′ .39—dc22 2009022506
British Library Cataloging-in-Publication Data is available This book has been composed in LATEX The publisher would like to acknowledge the authors of this volume for providing the camera-ready copy from which this book was printed. Printed on acid-free paper. ∞ press.princeton.edu Printed in the United States of America 10
9
8
7
6
5
4
3
2
1
NNBook
September 1, 2009
To my father Mikhael Haddad, father-in-law Paul Katinas, and mentor and friend Dennis Bernstein, with gratitude and appreciation for instilling in me the fervor to always strive to reach ret W. M. H. To my father Nageswara Rao and the memory of my mother Andhra Jayashree for inspiring my passion for science and mathematics V. C. To my mother Guihua Li and my father Shifu Hui, with everlasting love Q. H.
NNBook
September 1, 2009
NNBook
September 1, 2009
FÔsi krÔptesjai file.
Nature loves to hide. Purì te ntamoib t pnta kaÈ pÜr pntwn.
All matter is exchanged for energy, and energy for all matter. EÚnai gr ãn tä sofìn, âprtasjai gn¸mhn, åtèh âkubèrnhse pnta di pntwn.
Ultimate wisdom is reached when one achieves a fundamental understanding of the universal laws that govern all things and all forces in the universe. —Herakleitos of Ephesus, Ionia, Greece FÔsi oudenì estn eìntwn all mìnon mxi te, dillax te migèntwn est, fÔsi d ep toi onomzetai anjr¸poisin.
There is no genesis with regards to any of the things in nature but rather a blending and alteration of the mixed elements; man, however, uses the word ‘nature’ to name these events. —Empedocles of Acragas, Sicily, Greater Greece H enìthta enai o nìmo tou Jèou, h exèlixh enai o nìmo th zw , o arijmì enai o nìmo tou kìsmou.
Unity is the law of God, evolution is the law of life, and mathematics is the law of the universe. — Pythagoras of Samos, Samos, Greece
NNBook
September 1, 2009
NNBook
September 1, 2009
Contents
Preface
xv
Chapter 1. Introduction
1
Chapter 2. Stability Theory for Nonnegative Dynamical Systems 2.1 Introduction 2.2 Lyapunov Stability Theory for Nonnegative Dynamical Systems 2.3 Invariant Set Stability Theorems 2.4 Semistability of Nonnegative Dynamical Systems 2.5 Stability Theory for Linear Nonnegative Dynamical Systems 2.6 Nonlinear Compartmental Dynamical Systems 2.7 Compartmental Systems in Biology, Ecology, Epidemiology, and Pharmacology 2.8 Discrete-Time Lyapunov Stability Theory for Nonnegative Dynamical Systems 2.9 Discrete-Time Invariant Set Theorems and Semistability Theorems 2.10 Stability Theory for Discrete-Time Linear Nonnegative Dynamical Systems 2.11 Discrete-Time Nonlinear Compartmental Dynamical Systems
7
Chapter 3. Stability Theory for Nonnegative and Compartmental Dynamical Systems with Time Delay 3.1 Introduction 3.2 Lyapunov Stability Theory for Time-Delay Nonnegative Dynamical Systems 3.3 Invariant Set Stability Theorems 3.4 Stability Theory for Continuous-Time Nonnegative Dynamical Systems with Time Delay 3.5 Discrete-Time Lyapunov Stability Theory for Time-Delay Nonnegative Dynamical Systems
7 7 16 21 30 43 49 61 64 69 83
89 89 90 93 97 103
NNBook
x
September 1, 2009
CONTENTS
3.6
Stability Theory for Discrete-Time Nonnegative Dynamical Systems with Time Delay
Chapter 4. Nonoscillation and Monotonicity of Solutions of Nonnegative Dynamical Systems 4.1 Introduction 4.2 Nonoscillation and Monotonicity of Linear Nonnegative Dynamical Systems 4.3 Mammillary Systems 4.4 Monotonicity of Nonlinear Nonnegative Dynamical Systems 4.5 Monotonicity of Discrete-Time Linear Nonnegative Dynamical Systems 4.6 Monotonicity of Discrete-Time Nonlinear Nonnegative Dynamical Systems 4.7 Monotonicity of Nonnegative Dynamical Systems with Time Delay Chapter 5. Dissipativity Theory for Nonnegative Dynamical Systems 5.1 Introduction 5.2 Dissipativity Theory for Nonnegative Dynamical Systems 5.3 Feedback Interconnections of Nonnegative Dynamical Systems 5.4 Dissipativity Theory for Nonlinear Nonnegative Dynamical Systems 5.5 Feedback Interconnections of Nonnegative Nonlinear Dynamical Systems 5.6 Dissipativity Theory for Discrete-Time Nonnegative Dynamical Systems 5.7 Specialization to Discrete-Time Linear Nonnegative Dynamical Systems 5.8 Feedback Interconnections of Discrete-Time Nonnegative Dynamical Systems 5.9 Dissipativity Theory for Nonnegative Dynamical Systems with Time Delay 5.10 Feedback Interconnections of Nonnegative Dynamical Systems with Time Delay 5.11 Dissipativity Theory for Discrete-Time Nonnegative Dynamical Systems with Time Delay 5.12 Feedback Interconnections of Discrete-Time Nonnegative Dynamical Systems with Time Delay Chapter 6. Hybrid Nonnegative and Compartmental Dynamical Systems
106
111 111 112 119 123 127 132 135
143 143 145 153 158 164 166 173 177 183 188 191 194
197
NNBook
September 1, 2009
xi
CONTENTS
6.1 6.2 6.3 6.4 6.5 6.6
Introduction Stability Theory for Nonlinear Hybrid Nonnegative Dynamical Systems Hybrid Compartmental Dynamical Systems Dissipativity Theory for Hybrid Nonnegative Dynamical Systems Specialization to Linear Impulsive Dynamical Systems Feedback Interconnections of Nonlinear Hybrid Nonnegative Dynamical Systems
Chapter 7. System Thermodynamics, Irreversibility, and Time Asymmetry 7.1 Introduction 7.2 Dynamical System Model 7.3 Reversibility, Irreversibility, Recoverability, and Irrecoverability 7.4 Reversible Dynamical Systems, Volume-Preserving Flows, and Poincar´e Recurrence 7.5 System Thermodynamics 7.6 Entropy and Irreversibility 7.7 Semistability and the Entropic Arrow of Time 7.8 Monotonicity of System Energies in Thermodynamic Processes
197 199 203 207 215 217
223 223 226 228 233 243 247 254 259
Chapter 8. Finite-Time Thermodynamics 8.1 Introduction 8.2 Finite-Time Semistability of Nonlinear Nonnegative Dynamical Systems 8.3 Homogeneity and Finite-Time Semistability 8.4 Finite-Time Energy Equipartition in Thermodynamic Systems
263
Chapter 9.1 9.2 9.3 9.4 9.5 9.6 9.7 9.8
281
9. Modeling and Analysis of Mass-Action Kinetics Introduction Reaction Networks The Law of Mass Action and the Kinetic Equations Nonnegativity of Solutions Realization of Mass-Action Kinetics Reducibility of the Kinetic Equations Stability Analysis of Linear and Nonlinear Kinetics The Zero-Deficiency Theorem
Chapter 10. Semistability and State Equipartition of Nonnegative Dynamical Systems 10.1 Introduction 10.2 Semistability and State Equipartitioning
263 264 268 275
281 282 284 288 290 293 297 301
315 315 315
NNBook
September 1, 2009
xii
CONTENTS
10.3 10.4 Chapter 11.1 11.2 11.3 11.4
Semistability and Equipartition of Linear Compartmental Systems with Time Delay Semistability and Equipartition of Nonlinear Compartmental Systems with Time Delay 11. Robustness of Nonnegative Dynamical Systems Introduction Nominal System Model Semistability and Homogeneous Dynamical Systems Uncertain System Model
Chapter 12. Modeling and Control for Clinical Pharmacology 12.1 Introduction 12.2 Pharmacokinetic Models 12.3 State Space Models 12.4 Drug Action, Effect, and Interaction 12.5 Pharmacokinetic Parameter Estimation 12.6 Pharmacodynamic Models 12.7 Open-Loop Drug Dosing 12.8 Closed-Loop Drug Dosing 12.9 Closed-Loop Control of Cardiovascular Function 12.10 Closed-Loop Control of Anesthesia 12.11 Electroencephalograph-Based Control 12.12 Bispectral Index-Based Control 12.13 Pharmacokinetic and Pharmacodynamic Models for Drug Distribution 12.14 Challenges and Opportunities in Pharmacological Control Chapter 13. Optimal Fixed-Structure Control for Nonnegative Systems 13.1 Introduction 13.2 Optimal Zero Set-Point Regulation for Nonnegative Dynamical Systems 13.3 Optimal Nonzero Set-Point Regulation for Nonnegative Dynamical Systems 13.4 Suboptimal Control for Nonnegative Dynamical Systems 13.5 Optimal Fixed-Structure Control for Nonnegative Dynamical Systems 13.6 Nonnegative Control for Nonnegative Dynamical Systems 13.7 Optimal Fixed-Structure Control for General Anesthesia Chapter 14. H2 Suboptimal Control for Nonnegative Dynamical Systems Using Linear Matrix Inequalities 14.1 Introduction
324 328 343 343 343 347 348 359 359 360 361 362 363 365 366 368 369 371 372 373 374 377
379 379 379 383 390 392 394 396
405 405
NNBook
September 1, 2009
xiii
CONTENTS
14.2 14.3 14.4
H2 Suboptimal Control for Nonnegative Dynamical Systems Suboptimal Estimation for Nonnegative Dynamical Systems H2 Suboptimal Dynamic Controller Design for Nonnegative Dynamical Systems
Chapter 15. Adaptive Control for Nonnegative Systems 15.1 Introduction 15.2 Adaptive Control for Linear Nonnegative Uncertain Dynamical Systems 15.3 Adaptive Control for Linear Nonnegative Dynamical Systems with Nonnegative Control 15.4 Adaptive Control for General Anesthesia: Linear Model 15.5 Adaptive Control for Nonlinear Nonnegative Uncertain Dynamical Systems 15.6 Adaptive Control for General Anesthesia: Nonlinear Model 15.7 Adaptive Control for Nonlinear Nonnegative Uncertain Dynamical Systems 15.8 Adaptive Control for Linear Nonnegative Uncertain Dynamical Systems with Time Delay 15.9 Adaptive Control for Linear Nonnegative Dynamical Systems with Nonnegative Control and Time Delay 15.10 Adaptive Control for Nonnegative Systems with Time Delay and Actuator Amplitude Constraints 15.11 Adaptive Control for General Anesthesia: Linear Model with Time Delay and Actuator Constraints Chapter 16. Adaptive Disturbance Rejection Control for Compartmental Systems 16.1 Introduction 16.2 Compartmental Systems with Exogenous Disturbances 16.3 Adaptive Control for Linear Compartmental Uncertain Systems with Exogenous Disturbances 16.4 Adaptive Control for Linear Compartmental Dynamical Systems with L2 Disturbances 16.5 Adaptive Control for Automated Anesthesia with Hemorrhage and Hemodilution Effects Chapter 17. Limit Cycle Stability Analysis and Control for Respiratory Compartmental Models 17.1 Introduction 17.2 Ultrametric Matrices, Periodic Orbits, and Poincar´e Maps 17.3 Compartmental Modeling of Lung Dynamics: Dichotomy Architecture 17.4 State Space Multicompartment Lung Model
405 413 418 425 425 427 435 438 444 451 454 463 476 480 484
491 491 492 493 502 512
523 523 524 528 531
NNBook
xiv
September 1, 2009
CONTENTS
17.5 17.6 17.7 17.8 17.9
Limit Cycle Analysis of the Multicompartment Lung Model A Regular Dichotomy Model A General Tree Structure Model Direct Adaptive Control for Switched Linear Time-Varying Systems Adaptive Control for a Multicompartment Lung Model
Chapter 18. Identification of Stable Nonnegative and Compartmental Systems 18.1 Introduction 18.2 State Reconstruction 18.3 Constrained Optimization for Subspace Identification of Stable Nonnegative Systems 18.4 Constrained Optimization for Subspace Identification of Compartmental Systems 18.5 Illustrative Numerical Examples
534 538 541 545 548
553 553 554 557 566 567
Chapter 19. Conclusion
571
Bibliography
573
Index
599
NNBook
September 1, 2009
Preface
Nonnegative and compartmental dynamical system models are derived from mass and energy balance considerations that involve dynamic states whose values are nonnegative. These models are widespread in biology, chemistry, ecology, economics, genetics, medicine, sociology, and engineering, and play a key role in the understanding of these disciplines. Specifically, since such disciplines give rise to systems that have numerous input, state, and output properties related to conservation, dissipation, and transport of mass and energy, nonnegative and compartmental models are conceptually simple yet remarkably effective in describing the essential phenomenological features of these dynamical systems. Furthermore, since such systems are governed by conservation laws (e.g., mass, energy, fluid, etc.) and are comprised of homogeneous compartments which exchange variable nonnegative quantities of material via intercompartmental flow laws, these systems are completely analogous to network thermodynamic (advection-diffusion) systems with compartmental masses or energies playing the role of heat and temperatures. Compartmental models have been widely used in biology, pharmacology, and physiology to describe the distribution of a substance (e.g., biomass, drug, radioactive tracer, etc.) among different tissues of an organism. In this case, a compartment represents the amount of the substance inside a particular tissue and the intercompartmental flows are due to diffusion processes. In engineering and the physical sciences, compartments typically represent the energy, mass, or information content of the different parts of the system, and different compartments interact by exchanging heat, work energy, and matter. In ecology and economics, compartments can represent soil and debris, or finished goods and raw materials in different regions, and the flows are due to energy and nutrient exchange (e.g., nitrates, phosphates, carbon, etc.), or money and securities. Compartmental systems can also be used to model chemical reaction systems. In this case, the compartments would represent quantities of different chemical substances contained within the compartment, and the compartmental flows would characterize transformation rates of reactants to products. In this monograph, we develop a unified stability and dissipativity
NNBook
xvi
September 1, 2009
PREFACE
(i.e., conservation, dissipation, and transport) analysis and control design framework for nonnegative and compartmental dynamical systems in order to foster the understanding of these systems as well as advancing the state of the art in active control of nonnegative and compartmental systems. This general framework is then applied to the fields of thermal sciences, biology, chemistry, and medicine to provide a dynamical systems perspective of these diverse disciplines. The monograph is written from a system-theoretic point of view and can be viewed as a contribution to dynamical system and control system theory. After a brief introduction to nonnegative and compartmental dynamical systems in Chapter 1, fundamental stability theory for linear and nonlinear nonnegative and compartmental dynamical systems is developed in Chapter 2. In Chapter 3, we extend the results of Chapter 2 to address nonnegative and compartmental systems with time delay. Chapter 4 provides necessary and sufficient conditions for identifying nonnegative and compartmental systems that admit nonoscillatory and monotonic solutions. A detailed treatment of dissipativity theory and stability of feedback interconnections of nonnegative dynamical systems is given in Chapter 5, whereas extensions of these results to impulsive nonnegative systems are given in Chapter 6. In Chapters 7 and 8 we use compartmental dynamical system theory to provide a system-theoretic foundation for thermodynamics. A detailed treatment of mass-action kinetics is given in Chapter 9, while Chapters 10 and 11 provide extensions to general compartmental models with directed and undirected intercompartmental flows, time delays, and model uncertainty. Next, in Chapters 12–16 we develop a control design framework for nonnegative and compartmental dynamical systems with application to drug dosing control for clinical pharmacology. In Chapter 17, we use compartmental dynamical system theory and Poincar´e maps to model, analyze, and control the dynamics of a pressure-limited respirator and lung mechanics system. Chapter 18 develops a constrained optimization framework for nonnegative and compartmental system identification. Finally, in Chapter 19 we present conclusions. The first author would like to thank James M. Bailey for his valuable discussions on pharmacokinetic and pharmacodynamic modeling in clinical pharmacology over the recent years. In addition, the authors thank Paul Katinas for several insightful and enlightening discussions on the statements quoted in ancient Greek on page vii. In some parts of the monograph we have relied on work we have done jointly with Elias August, James M. Bailey, Dennis S. Bernstein, Sanjay P. Bhat, Behnood Gholami, Tomohisa Hayakawa, Hancao Li, Sergey G. Nersesov, Tanmay Rajpurohit, Jayanthy Ramakrishnan, and Kostyantyn Y. Volyanskyy; it is a pleasure to acknowledge their contributions. The aphorisms by Herakleitos, Empedocles, and Pythagoras quoted in
NNBook
PREFACE
September 1, 2009
xvii
the epigraph of the book give the earliest perception of the complexity of nature and universe. For example, biology has shown that many species of animals such as insect swarms, ungulate flocks, fish schools, ant colonies, and bacterial colonies self-organize in nature. These biological aggregations give rise to remarkably complex global behaviors from simple local interactions between a large number of relatively unintelligent agents without the need for a centralized architecture. The spontaneous development (i.e., selforganization) of these autonomous biological systems and their spatiotemporal evolution to more complex states often appears without any external system interaction. In other words, structural morphing into coherent groups is internal to the system and results from local interactions among subsystem components that are independent of the physical nature of the individual components. These local interactions often comprise a simple set of rules that lead to remarkably complex and robust behaviors. Complexity here refers to the quality of a system wherein interacting subsystems self-organize to form hierarchical evolving structures exhibiting emergent system properties, whereas robustness refers to insensitivity of individual subsystem failures and unplanned behavior at the individual subsystem level. The connection between the local subsystem interactions and the globally complex system behavior is often elusive. This is true for nature in general and was most eloquently stated first by the ancient Greek philosopher Herakleitos in his 123rd fragment—Nature loves to hide (FÔsi krÔptesjai file). Herakleitos’ profound second statement—All matter is exchanged for energy, and energy for all matter (Purì te ntamoib t pnta kaÈ pÜr pntwn)—is a statement of the law of conservation of mass-energy and is a precursor to the principle of relativity. In describing the nature of the universe Herakleitos postulates that nothing can be created out of nothing, and nothing that disappears ceases to exist. This totality of forms, or massenergy equivalence, is eternal and unchangeable in a constantly changing universe (ta puta re). Herakleitos’ last statement defines ultimate wisdom as knowledge and understanding of the intelligence which steers all things through all things. In the language of modern science, this statement defines ultimate wisdom as a fundamental understanding of the universal laws that govern all things and all forces in the universe. Like Herakleitos’ second statement, Empedocles’ statement is one of totality of forms in nature. He postulates that there is no genesis with regard to any of the things in nature but rather a blending and alteration of elements (stoiqea) through attractive and repulsive forces. He further postulates that the organic universe originated from spontaneous aggregations involving pattern interactions by which life emerged through autopoiesis (self-creation). Pythagoras’ statement attempting to explain our incomprehensible universe is as trenchant today as it was two and a half
NNBook
September 1, 2009
xviii
PREFACE
millennia ago, with parts of his statement resonating with creationists, evolution theorists, and intelligent designers. However, Pythagoras spoke of one god, and of God in many forms, and he did so without contradiction. And with God elicited as the universal forces (strong nuclear, electromagnetic, weak nuclear, and gravitational), his statement belongs to the scientist. The results reported in this monograph were obtained at the School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, and the Department of Mechanical, Aerospace, and Biomedical Engineering of the University of Tennessee, Knoxville, between June 2000 and May 2008. The research support provided by the Air Force Office of Scientific Research and the National Science Foundation over the years has been instrumental in allowing us to explore basic research topics that have led to some of the material in this monograph. We are indebted to them for their support.
Atlanta, Georgia, USA, July 2009, Wassim M. Haddad
NNBook
September 1, 2009
Chapter One
Introduction
With the ever-increasing influence of mathematical modeling and engineering on biological, social, and medical sciences, it is not surprising that dynamical system theory has played a central role in the understanding of many biological, ecological, and physiological processes [155, 171, 172, 235]. With this confluence it has rapidly become apparent that mathematical modeling and dynamical system theory are the key threads that tie together these diverse disciplines. The dynamical models of many biological, pharmacological, and physiological processes such as pharmacokinetics [19, 287], metabolic systems [50], epidemic dynamics [155, 157], biochemical reactions [57, 171], endocrine systems [50], and lipoprotein kinetics [171] are derived from mass and energy balance considerations that involve dynamic states whose values are nonnegative. Hence, it follows from physical considerations that the state trajectory of such systems remains in the nonnegative orthant of the state space for nonnegative initial conditions. Such systems are commonly referred to as nonnegative dynamical systems 1 in the literature [79, 164, 166, 233]. A subclass of nonnegative dynamical systems are compartmental systems [4, 5, 29, 43, 88, 100, 134, 152, 155–158, 162, 165, 188, 198, 208, 209, 211, 219, 220, 232, 252, 258, 259, 300]. Compartmental systems involve dynamical models that are characterized by conservation laws (e.g., mass, energy, fluid, etc.) capturing the exchange of material between coupled macroscopic subsystems known as compartments. Each compartment is assumed to be kinetically homogeneous, that is, any material entering the compartment is instantaneously mixed with the material of the compartment. The range of applications of nonnegative systems and compartmental systems is not limited to biological, social, and medical systems. Their usage includes chemical reaction systems [25, 60, 82, 187, 298], queuing systems [301], large-scale systems [274,275], stochastic systems (whose state variables 1 Some authors erroneously refer to nonnegative dynamical systems as positive systems. However, since the state of a nonnegative system can evolve in the nonnegative (closed) orthant of the state space, which is a proper cone (i.e., a closed, convex, solid, and pointed cone), and is not necessarily constrained to the positive (open) orthant of the state space, nonnegative dynamical systems is the appropriate expression for the description of such systems.
NNBook
2
September 1, 2009
CHAPTER 1
represent probabilities) [301], ecological systems [38, 141, 181, 211, 231], economic systems [21], demographic systems [155], telecommunications systems [90], transportation systems, power systems, heat transfer systems, thermodynamic systems [116], and structural vibration systems [175–177], to cite but a few examples. In economic systems the interaction of raw materials, finished goods, and financial resources can be modeled by compartments representing various interacting sectors in a dynamic economy. Similarly, network systems, computer networks, and telecommunications systems are all amenable to compartmental modeling with intercompartmental flow laws governed by nodal dynamics and rerouting strategies that can be controlled to minimize waiting times and optimize system throughput. Compartmental models can also be used to model the interconnecting components of power grid systems with energy flow between regional distribution points subject to control and possible failure. Road, rail, air, and space transport systems also give rise to compartmental systems with interconnections subject to failure and real-time modification. Since the aforementioned dynamical systems have numerous input, state, and output properties related to conservation, dissipation, and transport of mass, energy, or information, nonnegative and compartmental models are conceptually simple yet remarkably effective in describing the essential phenomenological features of these dynamical systems. Furthermore, since such systems are governed by conservation laws and are comprised of homogeneous compartments which exchange variable nonnegative quantities of material via intercompartmental flow laws, these systems are completely analogous to network thermodynamic (advection-diffusion) systems with compartmental masses, energies, or information playing the role of heat and temperatures. The goal of the present monograph is directed toward developing a general stability2 analysis and control design framework for nonlinear nonnegative and compartmental dynamical systems. However, as in general nonlinear systems, nonlinear nonnegative dynamical systems can exhibit a very rich dynamical behavior, such as multiple equilibria, limit cycles, bifurcations, jump resonance phenomena, and chaos, which can make general nonlinear nonnegative system analysis and control notoriously difficult. In addition, since nonnegative and compartmental dynamical systems have specialized structures, nonlinear nonnegative system stabilization has received very little attention in the literature and remains 2 Unlike standard stability theory, stability notions for nonnegative dynamical systems need to be defined with respect to relatively open subsets of the nonnegative orthant of the state space containing the system equilibrium point. See Definition 2.3.
NNBook
INTRODUCTION
September 1, 2009
3
relatively undeveloped. For example, biological and physiological systems typically possess a multiechelon hierarchical hybrid structure characterized by continuous-time dynamics at the lower levels of the hierarchy and discrete-time dynamics (logical decision-making units) at the higher levels of the hierarchy. This is evident in all living systems wherein control structures and hierarchies are present at the intracellular level, the intercellular level, the organs, and the organ system and organism level. Furthermore, biological and physiological systems are self-regulating systems, and hence, they additionally involve feedback (nested or interconnected) subsystems within their hierarchical structures. Finally, the complexity of biological and physiological system modeling and control is further exacerbated when addressing system modeling uncertainty inherent to system biology and physiology. Another complicating factor in the stability analysis of many nonnegative and compartmental dynamical systems is that these systems possess a continuum of equilibria. Since every neighborhood of a nonisolated equilibrium contains another equilibrium, a nonisolated equilibrium cannot be asymptotically stable. Hence, asymptotic stability is not the appropriate notion of stability for systems having a continuum of equilibria. Two notions that are of particular relevance to such systems are convergence and semistability. Convergence is the property whereby every system solution converges to a limit point that may depend on the system initial condition. Semistability is the additional requirement that all solutions converge to limit points that are Lyapunov stable. Semistability for an equilibrium thus implies Lyapunov stability, and is implied by asymptotic stability.3 The dependence of the limiting state on the initial state is seen in numerous stable nonnegative systems and compartmental systems. For these systems, every trajectory that starts in a neighborhood of a Lyapunov stable equilibrium converges to a (possibly different) Lyapunov stable equilibrium, and hence, these systems are semistable. The main objective of this monograph is to develop a general analysis and control design framework for nonnegative and compartmental dynamical systems. The main contents of the monograph are as follows. In Chapter 2, we establish notation and definitions, and develop stability theory for nonnegative and compartmental dynamical systems. Specifically, Lyapunov stability theorems as well as invariant set stability theorems are developed for linear and nonlinear, continuous-time and discrete-time nonnegative and compartmental dynamical systems. Chapter 3 provides an extension of the results of Chapter 2 to nonnegative and compartmental dynamical systems 3 It is important to note that semistability is not merely equivalent to asymptotic stability of the set of equilibria. Indeed, it is possible for a trajectory to converge to the set of equilibria without converging to any one equilibrium point as examples in [34] show.
NNBook
4
September 1, 2009
CHAPTER 1
with time delay. Specifically, stability theorems for linear and nonlinear nonnegative and compartmental dynamical systems with time delay are established using Lyapunov-Krasovskii functionals. Since nonlinear nonnegative and compartmental dynamical systems can exhibit a full range of nonlinear behavior, including bifurcations, limit cycles, and even chaos, in Chapter 4 we present necessary and sufficient conditions for identifying nonnegative and compartmental systems that admit only nonoscillatory and monotonic solutions. As a result, we provide sufficient conditions for the absence of limit cycles in nonlinear compartmental systems. In Chapter 5, using generalized notions of system mass and energy storage, and external flux and energy supply, we present a systematic treatment of dissipativity theory for nonnegative and compartmental dynamical systems. Specifically, using linear and nonlinear storage functions with linear supply rates, we develop new notions of dissipativity theory for nonnegative dynamical systems. In addition, we develop new Kalman-Yakubovich-Popov equations for nonnegative systems for characterizing dissipativeness with linear and nonlinear storage functions and linear supply rates. Finally, these results are used to develop general stability criteria for feedback interconnections of nonnegative dynamical systems. In Chapter 6, we extend the results of Chapters 2 and 5 to develop stability and dissipativity results for impulsive nonnegative and compartmental dynamical systems. Using the concepts developed in Chapters 2, 4, and 5, in Chapter 7 we use compartmental dynamical system theory to provide a systemtheoretic foundation for thermodynamics. Specifically, using a state space formulation, we develop a nonlinear compartmental dynamical system model characterized by energy conservation laws that are consistent with basic thermodynamic principles. In addition, we establish the existence of a unique, continuously differentiable global entropy function for our compartmental thermodynamic model, and using Lyapunov stability theory we show that the proposed thermodynamic model has convergent trajectories to Lyapunov stable equilibria with a uniform energy distribution determined by the system initial energies. Finally, using the system entropy, we establish the absence of Poincar´e recurrence for our thermodynamic model and develop a clear connection between irreversibility, the second law of thermodynamics, and the entropic arrow of time. In Chapter 8, we merge the theories of semistability and finitetime stability [32, 35] to develop a rigorous framework for finite-time thermodynamics. Specifically, using a geometric description of homogeneity theory, we develop intercompartmental flow laws that guarantee finite-time
NNBook
INTRODUCTION
September 1, 2009
5
semistability and energy equipartition for the thermodynamically consistent model developed in Chapter 7. Next, in Chapter 9, we address the problem of nonnegativity, realizability, reducibility, and semistability of chemical reaction networks. Specifically, we show that mass-action kinetics have nonnegative solutions for initially nonnegative concentrations, we provide a general procedure for reducing the dimensionality of the kinetic equations, and we present stability results based upon Lyapunov methods. In Chapter 10, we generalize the results of Chapter 7 to general compartmental systems that account for directional material flow between compartments as well as material in transit between compartments. Specifically, we develop compartmental models that guarantee semistability and state equipartitioning with directed and undirected thermal flow as well as flow delays between compartments. In Chapter 11, we consider robustness extensions of nonnegative dynamical systems; that is, sensitivity of system stability and state equipartitioning in the face of model uncertainty. In Chapters 12–16, we develop a general control design framework for nonnegative and compartmental dynamical systems with application to clinical pharmacology. Specifically, pharmacokinetic and pharmacodynamic models for drug distribution are formulated, and suboptimal, optimal, and adaptive control strategies are developed to address the challenging problem of active control for intraoperative anesthesia. In particular, using a constrained fixed-structure control framework we develop optimal output feedback control laws for nonnegative and compartmental dynamical systems that guarantee that the trajectories of the closed-loop system remain in the nonnegative orthant of the state space for nonnegative initial conditions. Output feedback controllers for compartmental systems with nonnegative inputs are also given. In addition, we develop H2 (sub)optimal controllers for nonnegative dynamical systems using linear matrix inequalities. Finally, a Lyapunov-based direct adaptive control framework is developed for nonnegative systems that guarantees partial asymptotic stability of the closed-loop system, that is, asymptotic stability with respect to part of the closed-loop system states associated with the physiological state variables. The adaptive controllers are constructed without requiring knowledge of the system dynamics or the system disturbances while providing a nonnegative control (source) input for system stabilization. In Chapter 17, we use compartmental dynamical system theory and Poincar´e maps to model, analyze, and control the dynamics of a pressurelimited respirator and lung mechanics system. Chapter 18 develops a constrained optimization framework for nonnegative and compartmental system identification that guarantees asymptotic stability of the plant system dynamics as well as the nonnegativity of the system matrices.
NNBook
6
September 1, 2009
CHAPTER 1
The approach is based on a subspace identification method wherein the resulting constrained optimization problem is cast as a convex linear programming problem with mixed equality, inequality, quadratic, nonnegative, and nonnegative-definite constraints. Finally, we draw conclusions in Chapter 19.
NNBook
September 1, 2009
Chapter Two
Stability Theory for Nonnegative Dynamical Systems
2.1 Introduction Even though numerous results focusing on compartmental systems have been developed in the literature (see [4, 29, 88, 100, 155, 158, 209, 211, 220, 259] and the numerous references therein), the development of nonnegative dynamical systems theory has received far less attention. In this chapter, we develop several basic mathematical results on stability of linear and nonlinear nonnegative dynamical systems. In addition, using linear Lyapunov functions, we develop necessary and sufficient conditions for Lyapunov stability, semistability, that is, system trajectory convergence to Lyapunov stable equilibrium points [31, 47], and asymptotic stability for linear nonnegative dynamical systems. The consideration of a linear Lyapunov function leads to a new Lyapunov-like equation for examining the stability of linear nonnegative systems. This Lyapunov-like equation is analyzed using nonnegative matrix theory [21,145]. The motivation for using a linear Lyapunov function follows from the fact that the state of a nonnegative dynamical system is nonnegative, and hence, a linear Lyapunov function is a valid Lyapunov function candidate. This considerably simplifies the stability analysis of nonnegative dynamical systems. Linear Lyapunov functions were first considered in [158] for compartmental systems and further explored in [25] to study the stability of mass action kinetics which exhibit nonnegative dynamics. For compartmental systems, a linear Lyapunov function corresponds to the total mass of the system.
2.2 Lyapunov Stability Theory for Nonnegative Dynamical Systems In this chapter, we introduce notation, several definitions, and some key results on stability of linear and nonlinear nonnegative dynamical systems needed for developing the main results of this monograph. In a definition or
NNBook
September 1, 2009
8
CHAPTER 2
when a word is defined in the text, the concept defined is italicized. Italics in the running text are also used for emphasis. The definition of a word, phrase, or symbol is to be understood as an “if and only if” statement. Lowercase letters such as x denote vectors, upper-case letters such as A denote matrices, upper-case script letters such as S denote sets, and lower-case Greek letters such as α denote scalars; however, there are a few exceptions to this convention. The notation S1 ⊂ S2 means that S1 is a proper subset of S2 , whereas S1 ⊆ S2 means that either S1 is a proper subset of S2 or S1 is equal to S2 . Throughout the monograph we use two basic types of mathematical statements, namely, existential and universal statements. An existential statement has the form: there exists x ∈ X such that a certain condition C is satisfied; whereas a universal statement has the form: condition C holds for all x ∈ X . For universal statements we often omit the words “for all” and write: condition C holds, x ∈ X . The notation used in this monograph is fairly standard. Specifically, R (respectively, C) denotes the set of real (respectively, complex) numbers, Z+ denotes the set of nonnegative integers, Z+ denotes the set of positive integers, Rn (respectively, Cn ) denotes the set of n × 1 real (respectively, complex) column vectors, Rn×m (respectively, Cn×m ) denotes the set of real (respectively, complex) n × m matrices, (·)T denotes transpose, (·)+ denotes the Moore-Penrose generalized inverse, (·)# denotes the group generalized inverse, (·)D denotes the Drazin inverse, ⊗ denotes Kronecker product, ⊕ denotes Kronecker sum, In or I denotes the n × n identity matrix, and e denotes the ones vector of order n, that is, e = [1, . . . , 1]T . For x ∈ Rq we write x ≥≥ 0 (respectively, x >> 0) to indicate that every component of x is nonnegative (respectively, positive). In this case we say that x is nonnegative or positive, respectively. Likewise, A ∈ Rp×q is nonnegative or positive if every entry of A is nonnegative or positive, respectively, which q is written as A ≥≥ 0 or A >> 0, respectively. Let R+ and Rq+ denote the q nonnegative and positive orthants of Rq , that is, if x ∈ Rq , then x ∈ R+ and x ∈ Rq+ are equivalent, respectively, to x ≥≥ 0 and x >> 0. Furthermore, L2 denotes the space of square-integrable Lebesgue measurable functions on [0, ∞) and L∞ denotes the space of bounded Lebesgue measurable functions on [0, ∞). In addition, we denote the boundary, the interior, and the closure ◦
of the set S by ∂S, S , and S, respectively.
We write k · k for the Euclidean vector norm, k · kF for the Frobenius matrix norm, ||| · ||| for the operator norm of an element in a Banach space B, R(A) and N (A) for the range space and the null space of a matrix A, respectively, spec(A) for the spectrum of the square matrix A including multiplicity, α(A) for the spectral abscissa of A (that is, α(A) = max{Re λ : λ ∈ spec(A)}), and ρ(A) for the spectral radius of A (that is, ρ(A) = max{|λ| : λ ∈ spec(A)}). For vectors x, y ∈ Rp and matrices A, B ∈ Rp×q
NNBook
September 1, 2009
9
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
we use x◦y and A◦B to denote component-by-component and entry-by-entry multiplication, respectively. For a matrix A ∈ Rp×q , rowi (A) and colj (A) denote the ith row and jth column of A, respectively, and rank A denotes the rank of A. Furthermore, we write V ′ (x) for the Fr´echet derivative of V at x, Bε (x), x ∈ Rn , ε > 0, for the open ball centered at x with radius ε, M ≥ 0 (respectively, M > 0) to denote the fact that the Hermitian matrix M is nonnegative (respectively, positive) definite, inf to denote infimum (that is, the greatest lower bound), sup to denote supremum (that is, the least upper bound), and x(t) → M as t → ∞ to denote that x(t) approaches the set M (that is, for each ε > 0 there exists T > 0 such that dist(x(t), M) < ε for all t > T , where dist(p, M) , inf x∈M kp − xk). Finally, the notions of openness, convergence, continuity, and compactness that we use throughout q the monograph refer to the topology generated on R+ (respectively, B) by the norm k · k (respectively, ||| · |||). In this section, we develop the fundamental results of Lyapunov stability theory for nonnegative dynamical systems. We begin by considering the general nonlinear autonomous dynamical system x(t) ˙ = f (x(t)),
x(0) = x0 ,
t ∈ I x0 ,
(2.1)
where x(t) ∈ D ⊆ Rn , t ∈ Ix0 , is the system state vector, D is a relatively open set (see Definition 2.2), f : D → Rn is continuous on D, and Ix0 = [0, τx0 ), 0 ≤ τx0 ≤ ∞, is the maximal interval of existence for the solution x(·) of (2.1). A continuously differentiable function x : Ix0 → D is said to be a solution to (2.1) on the interval Ix0 ⊆ R with initial condition x(0) = x0 if and only if x(t) satisfies (2.1) for all t ∈ Ix0 . We assume that for every initial condition x(0) ∈ D and every τx0 > 0, the dynamical system (2.1) possesses a unique solution x : [0, τx0 ) → D on the interval [0, τx0 ). We denote the solution to (2.1) with initial condition x(0) = x0 by s(·, x0 ), so that the flow of the dynamical system (2.1) given by the map s : [0, τx0 ) × D → D is continuous in x and continuously differentiable in t and satisfies the consistency property s(0, x0 ) = x0 and the semigroup property s(τ, s(t, x0 )) = s(t + τ, x0 ), for all x0 ∈ D and t, τ ∈ [0, τx0 ) such that t + τ ∈ [0, τx0 ). Unless otherwise stated, we assume f (·) is Lipschitz continuous on D. Furthermore, xe ∈ D is an equilibrium point of (2.1) if and only if f (xe ) = 0. In addition, a subset Dc ⊆ D is an invariant set relative to (2.1) if Dc contains the orbits of all its points. Finally, recall that if all solutions to (2.1) are bounded, then it follows from the Peano-Cauchy theorem [112, p. 76] that Ix0 = R. The following definition introduces the notion of essentially nonnegative functions and vector fields. n
Definition 2.1. Let f = [f1 , . . . , fn ]T : D ⊆ R+ → Rn . Then f is
NNBook
September 1, 2009
10
CHAPTER 2 n
essentially nonnegative if fi (x) ≥ 0, for all i = 1, . . . , n, and x ∈ R+ such that xi = 0, where xi denotes the ith component of x. The following definition and technical lemma are needed. n
n
Definition 2.2. A set Q ⊆ R+ is open relative to R+ if there exists an n open set R ⊆ Rn such that Q = R ∩ Rn+ . A set Q ⊆ R+ is closed relative n to R+ if there exists an closed set R ⊆ Rn such that Q = R ∩ Rn+ . A set n n Q ⊆ R+ is compact relative to R+ if there exists an compact set R ⊆ Rn such that Q = R ∩ Rn+ . Lemma 2.1. Consider the nonlinear dynamical system (2.1), and let Dc ⊂ D be closed relative to D. Then the following statements are equivalent: i) For all x ∈ Dc , limh→0+ inf y∈Dc kx + hf (x) − yk/h = 0. ii) Dc is an invariant set with respect to (2.1). Proof. Assume that i) holds. To show ii), let x0 ∈ Dc . Since f (·) is Lipschitz continuous it follows that there exist ε > 0 and L > 0 such that kf (x) − f (y)k ≤ Lkx − yk,
x, y ∈ B2ε (x0 ).
(2.2)
Let T ∈ [0, τx0 ) be such that s(t, x) ∈ B2ε (x0 ) and s(t, y) ∈ B2ε (x0 ) for all t ∈ [0, T ) and x, y ∈ Bε (x0 ). Now, it follows from Gronwall’s lemma [112, p. 81] that, ks(t, x) − s(t, y)k ≤ eLt kx − yk,
x, y ∈ Bε (x0 ),
(2.3)
for all t ∈ [0, T ). Next, let t1 ∈ [0, T ) be such that ks(t, x0 )−x0 k < ε/3 for all t ∈ (0, t1 ), and define ϕ(t) , dist(s(t, x0 ), Dc ) = inf y∈Dc ks(t, x0 ) − yk. Note that since x0 ∈ Dc , it follows that ϕ(0) = 0 and ϕ(t) ≤ ks(t, x0 ) − x0 k < ε/3 for all t ∈ (0, t1 ). Now, let t ∈ (0, t1 ) and let yt ∈ Dc be such that ks(t, x0 ) − yt k − ϕ(t) ≤ ε/3. Hence, kyt − x0 k = ≤ ≤ <
kyt − s(t, x0 ) + s(t, x0 ) − x0 k ks(t, x0 ) − x0 k + ks(t, x0 ) − yt k ks(t, x0 ) − x0 k + ϕ(t) + ε/3 ε.
Now, for all h > 0 such that t + h ≤ t1 , since ks(t, yt ) − x0 k < ε/3 < ε and ks(h, yt ) − x0 k < ε, it follows from (2.3) that ϕ(t + h) = inf ks(t + h, x0 ), zk z∈Dc
NNBook
September 1, 2009
11
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
≤ inf
n
ks(t + h, x0 ) − s(h, yt )k + ks(h, yt ) − yt − hf (yt )k o +kyt + hf (yt ) − zk z∈Dc
= ks(t + h, x0 ) − s(h, yt )k + ks(h, yt ) − yt − hf (yt )k +dist(yt + hf (yt ), Dc ) ≤ eLh kyt − s(t, x0 )k + ks(h, yt ) − yt − hf (yt )k +dist(yt + hf (yt ), Dc ),
(2.4)
which implies that ϕ(t + h) − ϕ(t) ≤ h
s(h, yt ) − yt eLh − 1 − f (yt ) ϕ(t) +
h h dist(yt + hf (yt ), Dc ) + . h
Now, letting h → 0+ yields lim sup h→0+
ϕ(t + h) − ϕ(t) ≤ Lϕ(t). h
(2.5)
Next, by Gronwall’s lemma [112, p. 81], it follows from (2.5) that 0 ≤ ϕ(t) ≤ eLt ϕ(0), t ∈ (0, t1 ), and hence, since ϕ(0) = 0, it follows that ϕ(t) = 0 for all t ∈ (0, t1 ). Now, since x0 ∈ Dc is arbitrary, it follows that, for every τ1 > 0 such that ϕ(τ1 ) = 0, there exists h > 0 such that ϕ(t) = 0, t ∈ [τ1 , τ1 + h). Next, let τ = inf{t > 0 : ϕ(t) > 0} and suppose, ad absurdum, that τ < τx0 . Since ϕ(t) = 0 for all t ∈ [0, t1 ), it follows that τ ≥ t1 > 0 and, by the definition of τ , ϕ(t) = 0 for all t ∈ [0, τ ) or, equivalently, s(t, x0 ) ∈ Dc for all t ∈ [0, τ ). Hence, since s(τ, x0 ) = limt→τ − s(t, x) and Dc is relatively closed with respect to D, it follows that s(τ, x0 ) ∈ Dc . Therefore, ϕ(τ ) = 0, which implies that there exists h > 0 such that ϕ(t) = 0 for all t ∈ [τ, τ + h), contradicting the definition of τ . Thus, ϕ(t) = 0, t ∈ [0, τx0 ), establishing the result. Conversely, assume Dc is an invariant set with respect to (2.1) so that, for all x0 ∈ Dc and h 6= 0, dist(x0 + hf (x0 ), Dc ) ≤ ks(h, x0 ) − x0 − hf (x0 )k
s(h, x0 ) − x0
= |h| − f (x0 )
. h
Now, the result follows by letting h → 0+ .
The flow-invariant set result given by Lemma 2.1 was first proved by Brezis [40] and uses the fact that the vector field f in (2.1) is Lipschitz continuous on D. This result was generalized independently by Crandall [61]
NNBook
September 1, 2009
12
CHAPTER 2
and Hartman [131] to the case where f is continuous on D and (2.1) has a unique right maximally defined solution. The case where f = f (t, x) is a time-varying vector field is subsumed under the case f = f (x) by representing the time-varying dynamical system as an autonomous system, where an additional state is appended to represent time. Flow-invariant sets and differential inequalities in normed spaces with Lebesgue measurable and locally essentially bounded vector fields, that is, vector fields that are bounded on a bounded neighborhood of every point excluding sets of measure zero, are discussed in [250]. Specifically, extensions to Lemma 2.1 are addressed for unique absolutely continuous solutions to (2.1) with an essentially one-sided Lipschitz condition on f of the Osgood type [249]. n
Our next result shows that the nonnegative orthant R+ is an invariant set with respect to (2.1) if and only if f is essentially nonnegative. In light of the above discussion, this result holds for the case where f is continuous on D and, more generally, f is measurable and locally essentially bounded on D. n
n
Proposition 2.1. Suppose R+ ⊂ D. Then R+ is an invariant set with respect to (2.1) if and only if f : D → Rn is essentially nonnegative. n
Proof. Define dist(x, R+ ) = inf y∈Rn kx−yk, x ∈ Rn . Now, suppose f : △
+
n
D → Rn is essentially nonnegative and let x ∈ R+ . For every i ∈ {1, . . . , q}, if xi = 0, then xi + hfi (x) = hfi (x) ≥ 0 for all h ≥ 0, whereas, if xi > 0, n then xi + hfi (x) > 0 for all |h| sufficiently small. Thus, x + hf (x) ∈ R+ for n all sufficiently small h > 0, and hence, limh→0+ dist(x + hf (x), R+ )/h = 0. n It now follows from Lemma 2.1, with x(0) = x0 , that x(t) ∈ R+ for all t ∈ [0, τx0 ). n
Conversely, suppose that R+ is invariant with respect to (2.1), let n x(0) ∈ R+ , and suppose, ad absurdum, x is such that there exists i ∈ {1, . . . , q} such that xi (0) = 0 and fi (x(0)) < 0. Then, since f is continuous, there exists sufficiently small h > 0 such that fi (x(t)) < 0 for all t ∈ [0, h), where x(t) is the solution to (2.1). Hence, xi (t) is strictly decreasing on [0, h), n and thus, x(t) 6∈ R+ for all t ∈ (0, h), which leads to a contradiction. It follows from Proposition 2.1 that if x0 ≥≥ 0, then x(t) ≥≥ 0, t ≥ 0, if and only if f is essentially nonnegative. In this case, we say that (2.1) is a nonnegative dynamical system. Henceforth, in this monograph, we assume that f is essentially nonnegative so that the nonlinear dynamical system (2.1) is a nonnegative dynamical system. As we see in Chapters 13, 15, and 16, in order to guarantee the nonnegativity of a controlled closed-loop system state associated with the
NNBook
September 1, 2009
13
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
physical system dynamics it may be necessary to use discontinuous feedback. In this case, the closed-loop system dynamics give rise to a discontinuous vector field. To address the nonnegativity of such systems we present a partial extension to Proposition 2.1 involving nonlinear time-varying dynamical systems of the form x(t) ˙ = f (t, x(t)),
x(t0 ) = x0 ,
t ≥ t0 ,
(2.6)
where x ∈ Rn and f : R × Rn → Rn is such that for every t ∈ R, f (t, ·) is essentially nonnegative. Proposition 2.2. Consider the nonlinear time-varying dynamical system (2.6) where f : R × Rn → Rn is such that for every t ∈ R, f (t, ·) is essentially nonnegative and for every (t0 , x0 ) ∈ R × Rn , (2.6) has a unique solution forward in time. Furthermore, for every (t0 , x0 ) ∈ R × Rn , assume that there exist δ > 0 and an increasing sequence {ti }∞ i=0 such that ti+1 − ti > δ for all i = 0, 1, . . ., and f (·, ·) is continuous at (t, x(t)) for all n t ∈ [ti , ti+1 ), i = 0, 1, . . .. Then R+ is an invariant set with respect to (2.6). Proof. The result is a direct consequence of Proposition 2.1 by equivalently representing the time-varying system (2.6) as an autonomous system by appending another state to represent time. Specifically, let n n x0 ∈ R+ and note that it follows from Proposition 2.1 that x(t) ∈ R+ , n t ∈ [t0 , t1 ). Hence, since x(t) is continuous for all t ≥ t0 , x(t1 ) ∈ R+ . n Now, applying Proposition 2.1 on the interval [t1 , t2 ) we obtain x(t) ∈ R+ , t ∈ [t1 , t2 ). The result now follows by repeating this procedure on every interval [ti , ti+1 ), i = 2, 3, . . .. Note that, if f (t, x) is piecewise continuous in t and essentially nonnegative in x, and (2.6) has a unique solution forward in time, then all the conditions of Proposition 2.2 are trivially satisfied. The following definition introduces several types of stability for the n equilibrium solution x(t) ≡ xe ∈ R+ of the nonlinear nonnegative dynamical system (2.1) for Ix0 = [0, ∞). n
Definition 2.3. i) The equilibrium solution x(t) ≡ xe ∈ R+ to (2.1) is n Lyapunov stable with respect to R+ if, for all ε > 0, there exists δ = δ(ε) > 0 n n such that if x0 ∈ Bδ (xe ) ∩ R+ , then x(t) ∈ Bε (xe ) ∩ R+ , t ≥ 0. n
ii) The equilibrium solution x(t) ≡ xe ∈ R+ to (2.1) is (locally) n asymptotically stable with respect to R+ if it is Lyapunov stable with respect n n to R+ and there exists δ > 0 such that if x0 ∈ Bδ (xe ) ∩ R+ , then limt→∞ x(t) = xe .
NNBook
September 1, 2009
14
CHAPTER 2 n
iii) The equilibrium solution x(t) ≡ xe ∈ R+ to (2.1) is globally n asymptotically stable with respect to R+ if it is Lyapunov stable with respect n n to R+ and, for all x0 ∈ R+ , limt→∞ x(t) = xe . The following result, known as Lyapunov’s direct method, gives sufficient conditions for Lyapunov and asymptotic stability of a nonlinear nonnegative dynamical system. For this result, let V : D → R be a continuously differentiable function with derivative along the trajectories of △ (2.1) given by V˙ (x) = V ′ (x)f (x). Note that V˙ (x) is dependent on the system d V (s(t, x)) t=0 = dynamics (2.1). Since, using the chain rule, V˙ (x) = dt V ′ (x)f (x) it follows that if V˙ (x) is negative, then V (x) decreases along the solution s(t, x0 ) of (2.1) through x0 ∈ D at t = 0. Theorem 2.1 (Lyapunov’s Theorem). Let D be an open subset n relative to R+ that contains xe . Consider the nonlinear dynamical system (2.1) where f is essentially nonnegative and f (xe ) = 0, and assume that there exists a continuously differentiable function V : D → R such that V (xe ) = 0, V (x) > 0, ′ V (x)f (x) ≤ 0,
x ∈ D, x ∈ D.
x 6= xe ,
(2.7) (2.8) (2.9)
Then the equilibrium solution x(t) ≡ xe to (2.1) is Lyapunov stable with n respect to R+ . If, in addition, V ′ (x)f (x) < 0,
x ∈ D,
x 6= xe ,
(2.10)
then the equilibrium solution x(t) ≡ xe to (2.1) is asymptotically stable with n respect to R+ . Finally, if V (·) is such that V (x) → ∞ as kxk → ∞,
(2.11)
then (2.10) implies that the equilibrium solution x(t) ≡ xe to (2.1) is globally n asymptotically stable with respect to R+ . n
n
Proof. Let ε > 0 be such that Bε (xe ) ∩ R+ ⊆ D. Since R+ ∩ ∂Bε (xe ) is compact and V (x), x ∈ D, is continuous, it follows that n △ α = minx∈Rn ∩∂Bε (xe ) V (x) exists. Note α > 0 since xe 6∈ R+ ∩ ∂Bε (xe ) + and V (x) > 0, x ∈ D, x 6= xe . Next, let β ∈ (0, α) and define Dβ to be the arcwise connected component of {x ∈ D : V (x) ≤ β} containing xe ; that is, Dβ is the set of all x ∈ D such that there exists a continuous function ψ : [0, 1] → D such that ψ(0) = x, ψ(1) = xe , and V (ψ(µ)) ≤ β for all n µ ∈ [0, 1].1 Note that Dβ ⊂ R+ ∩ Bε (xe ). To see this, suppose, ad absurdum, 1 Unless otherwise stated, in the remainder of the monograph we assume that sets of the form Dβ = {x ∈ D : V (x) ≤ β} correspond to the arcwise connected component of {x ∈ D : V (x) ≤ β} containing xe . This minor abuse of notation considerably simplifies the presentation.
NNBook
September 1, 2009
15
STABILITY THEORY FOR NONNEGATIVE SYSTEMS n
that Dβ 6⊂ R+ ∩ Bε (xe ). In this case, there exists a point p ∈ Dβ such n that p ∈ R+ ∩ ∂Bε (xe ), and hence, V (p) ≥ α > β, which is a contradiction. △ Now, since V˙ (x) = V ′ (x)f (x) ≤ 0, x ∈ Dβ , it follows that V (x(t)) is a nonincreasing function of time, and hence, V (x(t)) ≤ V (x(0)) ≤ β, t ≥ 0. Hence, Dβ is a positively invariant set (see Definition 2.6) with respect to (2.1). Next, since V (·) is continuous and V (xe ) = 0, there exists δ = δ(ε) ∈ n (0, ε) such that V (x) < β, x ∈ R+ ∩ Bδ (xe ). Now, let x(t), t ≥ 0, satisfy n n n (2.1) with x(0) ∈ R+ ∩ Bδ (xe ). Since, R+ ∩ Bδ (xe ) ⊂ Dβ ⊂ R+ ∩ Bε (xe ) ⊆ D and V ′ (x)f (x) ≤ 0, x ∈ D, it follows that Z t V (x(t)) − V (x(0)) = V ′ (x(s))f (x(s))ds ≤ 0, t ≥ 0, (2.12) and hence, for all x(0) ∈
0 n R+ ∩
Bδ (xe ),
V (x(t)) ≤ V (x(0)) < β, n
t ≥ 0.
Now, since V (x) ≥ α, x ∈ R+ ∩ ∂Bε (xe ), and β ∈ (0, α), it follows that n x(t) 6∈ R+ ∩ ∂Bε (xe ), t ≥ 0. Hence, since f is essentially nonnegative, for n all ε > 0 there exists δ = δ(ε) > 0 such that if x(0) ∈ Bδ (xe ) ∩ R+ , then n x(t) ∈ Bε (xe ) ∩ R+ , t ≥ 0, which proves Lyapunov stability with respect to n R+ of the equilibrium solution x(t) ≡ xe to (2.1). n
To prove asymptotic stability with respect to R+ of the equilibrium solution x(t) ≡ xe to (2.1), suppose that V ′ (x)f (x) < 0, x ∈ D, x 6= xe , n n and x(0) ∈ R+ ∩ Bδ (xe ). Then it follows that x(t) ∈ R+ ∩ Bε (xe ), t ≥ 0. However, V (x(t)), t ≥ 0, is decreasing and bounded from below by zero. Now, ad absurdum, suppose x(t), t ≥ 0, does not converge to xe . This implies that V (x(t)), t ≥ 0, is lower bounded, that is, there exists L > 0 such that V (x(t)) ≥ L > 0, t ≥ 0. Hence, by continuity of V (·) there exists n δ′ > 0 such that V (x) < L for x ∈ R+ ∩ Bδ′ (xe ), which further implies that n △ x(t) 6∈ R+ ∩ Bδ′ (xe ) for all t ≥ 0. Next, define L1 = min{−V ′ (x)f (x) : n δ′ ≤ kx − xe k ≤ ε, x ∈ R+ }. Now, (2.10) implies −V ′ (x)f (x) ≥ L1 , δ′ ≤ n kx − xe k ≤ ε, x ∈ R+ , or, equivalently, Z t V (x(t)) − V (x(0)) = V ′ (x(s))f (x(s))ds ≤ −L1 t, 0
and hence, for all x(0) ∈
n R+
∩ Bδ (xe ),
V (x(t)) ≤ V (x(0)) − L1 t. Letting t > V (x(0))−L , it follows that V (x(t)) < L, which is a contradiction. L1 Hence, x(t) → xe as t → ∞, establishing asymptotic stability with respect
NNBook
September 1, 2009
16
CHAPTER 2 n
to R+ . n
Finally, to prove global asymptotic stability with respect to R+ , let n △ x(0) ∈ R+ , and let β = V (x0 ). Now, the radial unboundedness condition n (2.11) implies that there exists ε > 0 such that V (x) > β for all x ∈ R+ such that kx − xe k ≥ ε. Hence, it follows from (2.12) that V (x(t)) ≤ V (x0 ) = β, n t ≥ 0, which implies that x(t) ∈ R+ ∩ Bε (xe ), t ≥ 0. Now, the proof follows as in the proof of the local asymptotic stability result. A continuously differentiable function V (·) satisfying (2.7) and (2.8) is called a Lyapunov function candidate for the nonnegative dynamical system (2.1). If, additionally, V (·) satisfies (2.9), V (·) is called a Lyapunov function for the nonnegative dynamical system (2.1). Finally, we note that as in standard nonlinear dynamical system theory [112], converse Lyapunov theorems for asymptotically stable nonlinear, nonnegative dynamical systems can also be established. Since the statement and proofs of these results are virtually identical to the standard converse Lyapunov stability proofs for nonlinear dynamical systems, they are not presented here.
2.3 Invariant Set Stability Theorems In this section, we introduce the Krasovskii-LaSalle invariance principle to relax one of the conditions on the Lyapunov function V (·) in the theorems given in Section 2.2. In particular, the strict negative-definiteness condition on the Lyapunov derivative can be relaxed while ensuring system asymptotic stability. Specifically, if a continuously differentiable function defined on a compact invariant set with respect to the nonlinear dynamical system (2.1) can be constructed whose derivative along the system’s trajectories is negative semidefinite and no system trajectories can stay indefinitely at points where the function’s derivative vanishes, then the system’s equilibrium point is asymptotically stable. To state and prove the main results of this section, several definitions and a key theorem are needed. First, we introduce the notion of invariance with respect to the flow of the nonlinear dynamical system (2.1). Given t ∈ R we denote the map s(t, ·) : D → D by st (x0 ). Hence, for a fixed t ∈ R the set of mappings defined by st (x0 ) = s(t, x0 ) for every x0 ∈ D gives the flow of (2.1). In particular, if D0 is a collection of initial conditions such that D0 ⊂ D, then the flow st : D → D is the motion of all points x0 ∈ D0 or, equivalently, the image of D0 ⊂ D under the flow st , that is, st (D0 ) ⊂ D, where st (D0 ) , {y : y = st (x0 ) for some x0 ∈ D0 }. Alternatively, if the initial condition x0 ∈ D is fixed and we let [t0 , t1 ] ⊂ R, then the mapping s(·, x0 ) : [t0 , t1 ] → D defines
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
17
the solution curve or trajectory of the dynamical system (2.1). Hence, the mapping s(·, x0 ) generates a graph in [t0 , t1 ] × D identifying the trajectory corresponding to the motion along a curve through the point x0 in a subset D of the state space. Given x ∈ D, we denote the map s(·, x) : R → D by sx (t). Identifying s(·, x) with its graph, the trajectory or orbit of a point x0 ∈ D is defined as the motion along the curve △
Ox0 = {x ∈ D : x = s(t, x0 ), t ∈ R}.
(2.13)
For t ≥ 0, we define the positive orbit through the point x0 ∈ D as the motion along the curve Ox+0 = {x ∈ D : x = s(t, x0 ), t ≥ 0}. △
(2.14)
Definition 2.4. The trajectory x(t), t ≥ 0, of (2.1) is bounded if there exists γ > 0 such that kx(t)k < γ, t ≥ 0. Definition 2.5. A point p ∈ D is a positive limit point of the trajectory s(·, x) of (2.1) if there exists a monotonic sequence {tn }∞ n=0 of positive numbers, with tn → ∞ as n → ∞, such that s(tn , x) → p as n → ∞. The set of all positive limit points of s(t, x), t ≥ 0, is the positive limit set ω(x) of s(·, x) of (2.1). Definition 2.6. A set M ⊂ D ⊆ Rn is a positively invariant set with respect to the nonlinear dynamical system (2.1) if st (M) ⊆ M for all t ≥ 0, △ where st (M) = {st (x) : x ∈ M}. A set M ⊆ D is an invariant set with respect to the dynamical system (2.1) if st (M) = M for all t ∈ R. Next, we state and prove a key theorem involving positive limit sets. For this result, we use the notation x(t) → M ⊆ D as t → ∞ to denote that x(t) approaches M, that is, for each ε > 0 there exists T > 0 such that △ dist(x(t), M) < ε for all t > T , where dist(p, M) = inf x∈M kp − xk. Theorem 2.2. Consider the nonlinear dynamical system (2.1) where f is essentially nonnegative. Suppose the solution x(t) to (2.1) corresponding n to an initial condition x(0) = x0 ∈ R+ is bounded for all t ≥ 0. Then the positive limit set ω(x0 ) of x(t), t ≥ 0, is a nonempty, compact, invariant, n and connected subset of R+ . Furthermore, x(t) → ω(x0 ) as t → ∞. Proof. Let x(t), t ≥ 0, or, equivalently, s(t, x0 ), t ≥ 0, denote the solution to (2.1) corresponding to the initial condition x(0) = x0 . Next, since x(t) is bounded for all t ≥ 0, it follows from the Bolzano-Weierstrass △ theorem [112, p. 27] that every sequence in the positive orbit Ox+0 = {s(t, x) : t ∈ [0, ∞)} has at least one accumulation point p ∈ D as t → ∞, and hence, ω(x0 ) is nonempty. Next, let p ∈ ω(x0 ) so that there exists an increasing unbounded sequence {tn }∞ n=0 , with t0 = 0, such that limn→∞ x(tn ) = p.
NNBook
18
September 1, 2009
CHAPTER 2
Now, since x(tn ) is uniformly bounded in n it follows that the limit point p is bounded, which implies that ω(x0 ) is bounded. To show that ω(x0 ) is closed let {pi }∞ i=0 be a sequence contained in ω(x0 ) such that limi→∞ pi = p. Now, since pi → p as i → ∞ for every ε > 0, there exists an i such that kp − pi k < ε/2. Next, since pi ∈ ω(x0 ), there exists t ≥ T , where T is arbitrary and finite, such that kpi − x(t)k < ε/2. Now, since kp − pi k < ε/2 and kpi − x(t)k < ε/2 it follows that kp − x(t)k ≤ kpi − x(t)k + kp − pi k < ε, and hence, p ∈ ω(x0 ). Thus, every accumulation point of ω(x0 ) is an element of ω(x0 ) so that ω(x0 ) is closed. Hence, since ω(x0 ) is closed and bounded, ω(x0 ) is compact. To show positive invariance of ω(x0 ) let p ∈ ω(x0 ) so that there exists an increasing unbounded sequence {tn }∞ n=0 such that x(tn ) → p as n → ∞. Now, let s(tn , x0 ) denote the solution x(tn ) of (2.1) with initial condition x(0) = x0 and note that, since f : D → Rn in (2.1) is Lipschitz continuous on D, x(t), t ≥ 0, is the unique solution to (2.1) so that by the semigroup property s(t + tn , x0 ) = s(t, s(tn , x0 )) = s(t, x(tn )). Now, since x(t), t ≥ 0, is continuous it follows that, for t + tn ≥ 0, limn→∞ s(t + tn , x0 ) = limn→∞ s(t, x(tn )) = s(t, p), and hence, s(t, p) ∈ ω(x0 ). Hence, st (ω(x0 )) ⊆ ω(x0 ), t ≥ 0, establishing positive invariance of ω(x0 ). To show invariance of ω(x0 ) let y ∈ ω(x0 ) so that there exists an increasing unbounded sequence {tn }∞ n=0 such that s(tn , x0 ) → y as n → ∞. Next, let t ∈ [0, ∞) and note that there exists N such that tn > t, n ≥ N . Hence, it follows from the semigroup property that s(t, s(tn − t, x0 )) = s(tn , x0 ) → y as n → ∞. Now, it follows from the Bolzano-Lebesgue theorem [112, p. 28] that there exists a subsequence {znk }∞ k=1 of the sequence zn = s(tn − t, x0 ), n = N, N + 1, . . ., such that znk → z ∈ D as k → ∞ and, by definition, z ∈ ω(x0 ). Next, it follows from the continuous dependence property that limk→∞ s(t, znk ) = s(t, limk→∞ znk ), and hence, y = s(t, z), which implies that ω(x0 ) ⊆ st (ω(x0 )), t ∈ [0, ∞). Now, using positive invariance of ω(x0 ) it follows that st (ω(x0 )) = ω(x0 ), t ≥ 0, establishing invariance of the positive limit set ω(x0 ). To show connectedness of ω(x0 ), suppose, ad absurdum, that ω(x0 ) is not connected. In this case, there exist two nonempty closed sets P1+ and P2+ such that P1+ ∩ P2+ = Ø and ω(x0 ) = P1+ ∪ P2+ . Since P1+ and P2+ are closed and disjoint there exist two open sets S1 and S2 such that S1 ∩S2 = Ø, P1+ ⊂ S1 , and P2+ ⊂ S2 . Next, since f : D → R is Lipschitz continuous on D it follows that the solution x(t), t ≥ 0, to (2.1) is a continuous function of ∞ t. Hence, there exist sequences {tn }∞ n=0 and {τn }n=0 such that x(tn ) ∈ S1 , x(τn ) ∈ S2 , and tn < τn < tn+1 , which implies that there exists a sequence {τn }∞ n=0 , with tn < τn < τn+1 , such that x(τn ) 6∈ S1 ∪ S2 . Next, since x(t) is
NNBook
September 1, 2009
19
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
bounded for all t ≥ 0, it follows that x(τn ) → pˆ 6∈ ω(x0 ) as n → ∞, leading to a contradiction. Hence, ω(x0 ) is connected. Finally, to show x(t) → ω(x0 ) as t → ∞, suppose, ad absurdum, x(t) 6→ ω(x0 ) as t → ∞. In this case, there exists a sequence {tn }∞ n=0 , with tn → ∞ as n → ∞, such that inf
p∈ω(x0 )
kx(tn ) − pk > ε,
n ∈ Z+ .
(2.15)
However, since x(t), t ≥ 0, is bounded, the bounded sequence {x(tn )}∞ n=0 ∗ ∗ contains a convergent subsequence {x(t∗n )}∞ n=0 such that x(tn ) → p ∈ ω(x0 ) as n → ∞, which contradicts (2.15). Hence, x(t) → ω(x0 ) as t → ∞ and, n since f is essentially nonnegative, ω(x0 ) ⊆ R+ . Note that Theorem 2.2 implies that if p ∈ D is an ω-limit point of a trajectory s(·, x) of (2.1), then all other points of the trajectory s(·, p) of (2.1) through the point p are also ω-limit points of s(·, x), that is, if p ∈ ω(x) then Op+ ⊂ ω(x). Furthermore, since every equilibrium point xe ∈ D of (2.1) satisfies s(t, xe ) = xe for all t ∈ R, all equilibrium points xe ∈ D of (2.1) are their own ω-limit sets. If a trajectory of (2.1) possesses a unique ω-limit point xe , then it follows from Theorem 2.2 that since ω(xe ) is invariant with respect to the flow st of (2.1), xe is an equilibrium point of (2.1). Next, we present the Krasovskii-LaSalle invariance principle for nonnegative dynamical systems. Theorem 2.3 (Krasovskii-LaSalle Theorem). Consider the nonlinear dynamical system (2.1) where f is essentially nonnegative, assume that Dc ⊂ n D ⊆ R+ is a compact positively invariant set with respect to (2.1), and assume there exists a continuously differentiable function V : Dc → R such △ that V ′ (x)f (x) ≤ 0, x ∈ Dc . Let R = {x ∈ Dc : V ′ (x)f (x) = 0} and let M be the largest invariant set contained in R. If x(0) ∈ Dc , then x(t) → M as t → ∞. Proof. Let x(t), t ≥ 0, be a solution to (2.1) with x(0) ∈ Dc . Since V ′ (x)f (x) ≤ 0, x ∈ Dc , it follows that Z t V (x(t)) − V (x(τ )) = V ′ (x(s))f (x(s))ds ≤ 0, t ≥ τ, τ
and hence V (x(t)) ≤ V (x(τ )), t ≥ τ , which implies that V (x(t)) is a nonincreasing function of t. Next, since V (·) is continuous on the compact set Dc , there exists β ∈ R such that V (x) ≥ β, x ∈ Dc . Hence, △ γx0 = limt→∞ V (x(t)) exists. Now, for all p ∈ ω(x0 ) there exists an increasing unbounded sequence {tn }∞ n=0 , with t0 = 0, such that x(tn ) → p as n → ∞. Since V (x), x ∈ Dc , is continuous, V (p) = V (limn→∞ x(tn )) =
NNBook
September 1, 2009
20
CHAPTER 2
limn→∞ V (x(tn )) = γx0 , and hence, V (x) = γx0 on ω(x0 ). Now, since Dc is compact and positively invariant it follows that x(t), t ≥ 0, is bounded, and hence, it follows from Theorem 2.2 that ω(x0 ) is a nonempty, compact invariant set. Hence, it follows that V ′ (x)f (x) = 0 on ω(x0 ) and thus ω(x0 ) ⊂ M ⊂ R ⊂ Dc . Finally, since x(t) → ω(x0 ) as t → ∞, it follows that x(t) → M as t → ∞. Next, using Theorem 2.3 we provide a generalization of Theorem 2.1 for local asymptotic stability of a nonlinear dynamical system. Corollary 2.1. Consider the nonlinear dynamical system (2.1) where f n is essentially nonnegative, assume that Dc ⊂ D ⊆ R+ is a compact positively invariant set with respect to (2.1) such that xe ∈ Dc , and assume that there exists a continuously differentiable function V : Dc → R such that V (xe ) = 0, V (x) > 0, x 6= xe , and V ′ (x)f (x) ≤ 0, x ∈ Dc . Furthermore, assume that the △ set R = {x ∈ Dc : V ′ (x)f (x) = 0} contains no invariant set other than the set {xe }. Then the equilibrium solution x(t) ≡ xe to (2.1) is asymptotically n stable with respect to R+ . n
Proof. Lyapunov stability with respect to R+ of the equilibrium solution x(t) ≡ xe to (2.1) follows from Theorem 2.1 since V ′ (x)f (x) ≤ 0, x ∈ Dc . Now, it follows from Theorem 2.3 that if x0 ∈ Dc , then ω(x0 ) ⊆ M, where M denotes the largest invariant set contained in R, which implies that M = {xe }. Hence, x(t) → M = {xe } as t → ∞, establishing asymptotic stability of the equilibrium solution x(t) ≡ xe to (2.1) with n respect to R+ . In Theorem 2.3 and Corollary 2.1, we explicitly assumed that there n exists a compact invariant set Dc ⊂ D ⊆ R+ of (2.1). Next, we provide a result that does not require the explicit assumption of the existence of a compact invariant Dc . Theorem 2.4. Consider the nonlinear dynamical system (2.1) where f is essentially nonnegative and assume that there exists a continuously n differentiable function V : R+ → R such that V (xe ) = 0, V (x) > 0, ′
n
V (x)f (x) ≤ 0,
x∈
x∈
n R+ , n R+ .
x 6= xe ,
(2.16) (2.17) (2.18)
Let R = {x ∈ R+ : V ′ (x)f (x) = 0} and let M be the largest invariant set contained in R. Then all solutions x(t), t ≥ 0, of (2.1) that are bounded approach M as t → ∞. △
n
Proof. Let x ∈ R+ be such that trajectory s(t, x), t ≥ 0, of (2.1)
NNBook
September 1, 2009
21
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
n
is bounded. Since f is essentially nonnegative it follows that s(t, x) ∈ R+ , t ≥ 0. Now, with Dc = Ox+ , it follows from Theorem 2.3 that s(t, x) → M as t → ∞. Next, we present the global invariant set theorem for guaranteeing global asymptotic stability of a nonlinear dynamical system. Theorem 2.5. Consider the nonlinear dynamical system (2.1) where f is essentially nonnegative and assume there exists a continuously differenn tiable function V : R+ → R such that V (xe ) = 0, V (x) > 0, ′
x∈
n R+ , n R+ ,
x 6= xe ,
V (x)f (x) ≤ 0, x ∈ V (x) → ∞ as kxk → ∞.
(2.19) (2.20) (2.21) (2.22)
n
Furthermore, assume that the set R = {x ∈ R+ : V ′ (x)f (x) = 0} contains no invariant set other than the set {xe }. Then the equilibrium solution n x(t) ≡ xe to (2.1) is globally asymptotically stable with respect to R+ . △
Proof. Since (2.19)–(2.21) hold, it follows from Theorem 2.1 that the equilibrium solution x(t) ≡ xe to (2.1) is Lyapunov stable with respect n to R+ , while the radial unboundedness condition (2.22) implies that all solutions to (2.1) are bounded. Now, Theorem 2.4 implies that x(t) → M as t → ∞. However, since R contains no invariant set other than the set {xe }, the set M is {xe }, and hence, global asymptotic stability with respect n to R+ is immediate.
2.4 Semistability of Nonnegative Dynamical Systems As discussed in Chapter 1, numerous nonnegative and compartmental systems give rise to systems that posses a continuum of equilibria. In this section, we develop a stability analysis framework for systems having a continuum of equilibria. Since every neighborhood of a nonisolated equilibrium contains another equilibrium, a nonisolated equilibrium cannot be asymptotically stable. Hence, asymptotic stability is not the appropriate notion of stability for systems having a continuum of equilibria. Two notions that are of particular relevance to such systems are convergence and semistability. Convergence is the property whereby every system solution converges to a limit point that may depend on the system initial condition. Semistability is the additional requirement that all solutions converge to limit points that are Lyapunov stable. Semistability for an equilibrium thus implies Lyapunov stability, and is implied by asymptotic stability.
NNBook
22
September 1, 2009
CHAPTER 2
It is important to note that semistability is not merely equivalent to asymptotic stability of the set of equilibria. Indeed, it is possible for a trajectory to converge to the set of equilibria without converging to any one equilibrium point [34]. Conversely, semistability does not imply that the equilibrium set is asymptotically stable in any accepted sense. This is because stability of sets (see [112]) is defined in terms of distance (especially in case of noncompact sets), and it is possible to construct examples in which the dynamical system is semistable, but the domain of semistability (see Definition 2.8) contains no ε-neighborhood (defined in terms of the distance) of the (noncompact) equilibrium set, thus ruling out asymptotic stability of the equilibrium set. Hence, semistability and set stability of the equilibrium set are independent notions. The dependence of the limiting state on the initial state is seen in numerous dynamical systems including compartmental systems [158] which arise in chemical kinetics [25], biomedical [155], environmental [231], economic [21], power [274], and thermodynamic systems [116]. For these systems, every trajectory that starts in a neighborhood of a Lyapunov stable equilibrium converges to a (possibly different) Lyapunov stable equilibrium, and hence these systems are semistable. Semistability is especially pertinent to networks of dynamic agents which exhibit convergence to a state of consensus in which the agents agree on certain quantities of interest [150]. Semistability was first introduced in [47] for linear systems, and applied to matrix second-order systems in [24]. References [34] and [33] consider semistability of nonlinear systems, and give several stability results for systems having a continuum of equilibria based on nontangency and arc length of trajectories, respectively. In this section, we develop necessary and sufficient conditions for semistability. We say that the dynamical system (2.1) is convergent with n n respect to R+ if limt→∞ s(t, x) exists for every x ∈ R+ . The following proposition gives a sufficient condition for a trajectory of (2.1) to converge to a limit. Proposition 2.3. Consider the nonlinear dynamical system (2.1) where n f is essentially nonnegative and let x ∈ R+ . If the positive limit set ω(x) of n (2.1) contains a Lyapunov stable (with respect to R+ ) equilibrium point y, then y = limt→∞ s(t, x), that is, ω(x) = {y}. n
Proof. Suppose y ∈ ω(x) is Lyapunov stable with respect to R+ and let n Nε ⊆ R+ be a relatively open neighborhood of y. Since y is Lyapunov stable n n with respect to R+ , there exists a relatively open neighborhood Nδ ⊂ R+ of y such that st (Nδ ) ⊆ Nε for every t ≥ 0. Now, since y ∈ ω(x), it follows that there exists τ ≥ 0 such that s(τ, x) ∈ Nδ . Hence, s(t + τ, x) = st (s(τ, x)) ∈
NNBook
September 1, 2009
23
STABILITY THEORY FOR NONNEGATIVE SYSTEMS n
st (Nδ ) ⊆ Nε for every t > 0. Since Nε ⊆ R+ is arbitrary, it follows that y = limt→∞ s(t, x). Thus, limn→∞ s(tn , x) = y for every sequence {tn }∞ n=1 , and hence, ω(x) = {y}. The following definitions and key proposition are necessary for the main results of this section. n
Definition 2.7. An equilibrium solution x(t) ≡ xe ∈ R+ to (2.1) is n n semistable with respect to R+ if it is Lyapunov stable with respect to R+ + and there exists δ > 0 such that if x0 ∈ Bδ (xe ) ∩ Rn , then limt→∞ x(t) exists n and corresponds to a Lyapunov stable equilibrium point with respect to R+ . n An equilibrium point xe ∈ R is a globally semistable equilibrium with respect n n + to R+ if it is Lyapunov stable with respect to R+ and, for every x0 ∈ Rn , limt→∞ x(t) exists and corresponds to a Lyapunov stable equilibrium point n with respect to R+ . The system (2.1) is said to be Lyapunov stable with n respect to R+ if every equilibrium point of (2.1) is Lyapunov stable with n n respect to R+ . The system (2.1) is said to be semistable with respect to R+ n if every equilibrium point of (2.1) is semistable with respect to R+ . Finally, n (2.1) is said to be globally semistable with respect to R+ if every equilibrium n point of (2.1) is globally semistable with respect to R+ . n
Definition 2.8. The domain of semistability with respect to R+ is the n set of points x0 ∈ R+ such that if x(t) is a solution to (2.1) with x(0) = n x0 , t ≥ 0, then x(t) converges to a Lyapunov stable (with respect to R+ ) n equilibrium point in R+ . Next, we present alternative equivalent characterizations of semistability of (2.1). For this result recall the definitions of class K and class L functions [112, p. 162]. Proposition 2.4. Consider the nonlinear dynamical system G given by (2.1) where f is essentially nonnegative. Then the following statements are equivalent: n
i) G is semistable with respect to R+ .
ii) For each xe ∈ f −1 (0), there exist class K and L functions α(·) and β(·), respectively, and δ = δ(xe ) > 0, such that if kx0 − xe k < δ, then kx(t) − xe k ≤ α(kx0 − xe k), t ≥ 0, and dist(x(t), f −1 (0)) ≤ β(t), t ≥ 0.
iii) For each xe ∈ f −1 (0), there exist class K functions α1 (·) and α2 (·), a class L function β(·), and δ = δ(xe ) > 0, such that if kx0 − xe k < δ, then dist(x(t), f −1 (0)) ≤ α1 (kx(t) − xe k)β(t) ≤ α2 (kx0 − xe k)β(t), t ≥ 0.
NNBook
24
September 1, 2009
CHAPTER 2
Proof. To show that i) implies ii), suppose (2.1) is semistable and let xe ∈ f −1 (0). It follows from Lemma 4.5 of [174] that there exist δ = δ(xe ) > 0 and a class K function α(·) such that if kx0 − xe k ≤ δ, then kx(t)−xe k ≤ α(kx0 −xe k), t ≥ 0. Without loss of generality, we may assume that δ is such that Bδ (xe ) is contained in the domain of semistability of (2.1). Hence, for every x0 ∈ Bδ (xe ), limt→∞ x(t) = x∗ ∈ f −1 (0) and, consequently, limt→∞ dist(x(t), f −1 (0)) = 0. For each ε > 0 and x0 ∈ Bδ (xe ), define Tx0 (ε) to be the infimum of T with the property that dist(x(t), f −1 (0)) < ε for all t ≥ T , that is, Tx0 (ε) , inf{T : dist(x(t), f −1 (0)) < ε, t ≥ T }. For each x0 ∈ Bδ (xe ), the function Tx0 (ε) is nonnegative and nonincreasing in ε, and Tx0 (ε) = 0 for sufficiently large ε. Next, let T (ε) , sup{Tx0 (ε) : x0 ∈ Bδ (xe )}. We claim that T is well defined. To show this, consider ε > 0 and x0 ∈ Bδ (xe ). Since dist(s(t, x0 ), f −1 (0)) < ε for every t > Tx0 (ε), it follows from the continuity of s that, for every η > 0, there exists an open neighborhood U of x0 such that dist(s(t, z), f −1 (0)) < ε for every z ∈ U . Hence, lim supz→x0 Tz (ε) ≤ Tx0 (ε), implying that the function x0 7→ Tx0 (ε) is upper semicontinuous at the arbitrarily chosen point x0 , and hence on Bδ (xe ). Since an upper semicontinuous function defined on a compact set achieves its supremum, it follows that T (ε) is well defined. The function T (·) is the pointwise supremum of a collection of nonnegative and nonincreasing functions, and is hence nonnegative and nonincreasing. Moreover, T (ε) = 0 for every ε > max{α(kx0 − xe k) : x0 ∈ Bδ (xe )}. Rε Let ψ(ε) , 2ε ε/2 T (σ)dσ + 1ε ≥ T (ε) + 1ε . The function ψ(ε) is positive, continuous, strictly decreasing, and ψ(ε) → 0 as ε → ∞. Choose β(·) = ψ −1 (·). Then β(·) is positive, continuous, strictly decreasing, and β(σ) → 0 as σ → ∞. Furthermore, T (β(σ)) < ψ(β(σ)) = σ. Hence, dist(x(t), f −1 (0)) ≤ β(t), t ≥ 0. Next, to show that ii) implies iii), suppose ii) holds and let xe ∈ f −1 (0). Then it follows from Lemma 4.5 of [174] that xe is Lyapunov stable. Choosing x0 sufficiently close to xe , it follows from the inequality kx(t) − xe k ≤ α(kx0 − xe k), t ≥ 0, that trajectories of (2.1) starting sufficiently close to xe are bounded, and hence, the positive limit set of (2.1) is nonempty. Since limt→∞ dist(x(t), f −1 (0)) = 0, it follows that the positive limit set is contained in f −1 (0). Now, since every point in f −1 (0) is Lyapunov stable, it follows from Proposition 2.3 that limt→∞ x(t) = x∗ , where x∗ ∈ f −1 (0) is Lyapunov stable. If x∗ = xe , then it follows using similar arguments as ˆ such that dist(x(t), f −1 (0)) ≤ above that there exists a class L function β(·)
NNBook
September 1, 2009
25
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
ˆ for every x0 satisfying kx0 − xe k < δ and t ≥ 0. Hence, kx(t) − xe k ≤ β(t) q p ˆ t ≥ 0. Next, consider the case dist(x(t), f −1 (0)) ≤ kx(t) − xe k β(t), ∗ where x 6= xe and let α1 (·) be a class K function. In this case, note that limt→∞ dist(x(t), f −1 (0))/α1 (kx(t) − xe k) = 0, and hence, it follows using similar arguments as above that there exists a class L function β(·) such that dist(x(t), f −1 (0)) ≤ α1 (kx(t) − xe k)β(t), t ≥ 0. Finally, note that α1 ◦ α is of class K (by Lemma 4.5 of [174]), and hence, iii) follows immediately. Finally, to show that iii) implies i), suppose iii) holds and let xe ∈ f −1 (0). Then it follows that α1 (kx(t) − xe k) ≤ α2 (kx(0) − xe k), t ≥ 0, that is, kx(t) − xe k ≤ α(kx(0) − xe k), where t ≥ 0 and α = α−1 1 ◦ α2 is of class K (by Lemma 4.2 of [174]). It now follows from Lemma 4.5 of [174] that xe is Lyapunov stable. Since xe was chosen arbitrarily, it follows that every equilibrium point is Lyapunov stable. Furthermore, limt→∞ dist(x(t), f −1 (0)) = 0. Choosing x0 sufficiently close to xe , it follows from the inequality kx(t) − xe k ≤ α(kx0 − xe k), t ≥ 0, that trajectories of (2.1) starting sufficiently close to xe are bounded, and hence, the positive limit set of (2.1) is nonempty. Since every point in f −1 (0) is Lyapunov stable, it follows from Proposition 2.3 that limt→∞ x(t) = x∗ , where x∗ ∈ f −1 (0) is Lyapunov stable. Hence, by definition, (2.1) is semistable. Next, we present a sufficient condition for semistability with respect n to R+ . Theorem 2.6. Consider the nonlinear dynamical system (2.1) where n f is essentially nonnegative. Let Q ⊆ R+ be a relatively open neighborhood n of f −1 (0) ∩ R+ and assume that there exists a continuously differentiable function V : Q → R such that V ′ (x)f (x) < 0,
x ∈ Q\f −1 (0).
(2.23)
n
If (2.1) is Lyapunov stable with respect to R+ , then (2.1) is semistable with n respect to R+ . Proof. Since (2.1) is Lyapunov stable by assumption, for every z ∈ f −1 (0), there exists a relatively open neighborhood Vz S of z such that s([0, ∞) × Vz ) is bounded and contained in Q. The set V , z∈f −1 (0) Vz is a relatively open neighborhood of f −1 (0) contained in Q. Consider x ∈ V so that there exists z ∈ f −1 (0) such that x ∈ Vz and s(t, x) ∈ Vz , t ≥ 0. Since Vz is bounded it follows that the positive limit set of x is nonempty and invariant. Furthermore, it follows from (2.23) that V˙ (s(t, x)) ≤ 0, t ≥ 0, and hence, it follows from Theorem 2.3 that s(t, x) → M as t → ∞, where M is the largest invariant set contained in the set R = {y ∈ Vz : V ′ (y)f (y) = 0}. Note that R = f −1 (0) is invariant, and hence, M = R, which implies
NNBook
September 1, 2009
26
CHAPTER 2
that limt→∞ dist(s(t, x), f −1 (0)) = 0. Finally, since every point in f −1 (0) is Lyapunov stable, it follows from Proposition 2.3 that limt→∞ s(t, x) = x∗ , where x∗ ∈ f −1 (0) is Lyapunov stable. Hence, by definition, (2.1) is semistable. Next, we present a slightly more general theorem for semistability wherein we do not assume that all points in the zero-level set of the derivative of V , that is, V˙ −1 (0), are Lyapunov stable but rather we assume that all points in the largest invariant subset of V˙ −1 (0) are Lyapunov stable. Theorem 2.7. Consider the nonlinear dynamical system (2.1) where f n is essentially nonnegative, and let Q ⊆ R+ be a relatively open neighborhood n of f −1 (0) ∩ R+ . Suppose the orbit Ox of (2.1) is bounded for all x ∈ Q and assume that there exists a continuously differentiable function V : Q → R such that V ′ (x)f (x) ≤ 0,
x ∈ Q.
(2.24)
If every point in the largest invariant subset M of {x ∈ Q : V ′ (x)f (x) = 0} n is Lyapunov stable with respect to R+ , then (2.1) is semistable with respect n to R+ . Proof. Since every solution of (2.1) is bounded, it follows from the hypotheses on V (·) that, for every x ∈ Q, the positive limit set ω(x) of (2.1) is nonempty and contained in the largest invariant subset M of {x ∈ Q : V ′ (x)f (x) = 0}. Since every point in M is a Lyapunov stable equilibrium, it follows from Proposition 2.3 that ω(x) contains a single point for every x ∈ Q and limt→∞ s(t, x) exists for every x ∈ Q. Now, since limt→∞ s(t, x) ∈ M is Lyapunov stable for every x ∈ Q, semistability is immediate. Example 2.1. Consider the nonlinear dynamical system given by x˙ 1 (t) = σ12 (x2 (t)) − σ21 (x1 (t)), x˙ 2 (t) = σ21 (x1 (t)) − σ12 (x2 (t)),
x1 (0) = x10 , x2 (0) = x20 ,
t ≥ 0,
(2.25) (2.26)
where x1 , x2 ∈ R+ , σij (·), i, j = 1, 2, i 6= j, are Lipschitz continuous, σ12 (x2 ) − σ21 (x1 ) = 0 if and only if x1 = x2 , and (x1 − x2 )(σ12 (x2 ) − 2 σ21 (x1 )) ≤ 0, x1 , x2 ∈ R+ . Note that f −1 (0) = {(x1 , x2 ) ∈ R+ : x1 = x2 = α, α ∈ R+ }. To show that (2.25) and (2.26) is a semistable system, consider the Lyapunov function candidate V (x1 , x2 ) = 21 (x1 − α)2 + 12 (x2 − α)2 , where α ∈ R+ . Now, it follows that V˙ (x1 , x2 ) = (x1 − α)[σ12 (x2 ) − σ21 (x1 )] + (x2 − α)[σ21 (x1 ) − σ12 (x2 )] = x1 [σ12 (x2 ) − σ21 (x1 )] + x2 [σ21 (x1 ) − σ12 (x2 )]
NNBook
September 1, 2009
27
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
= (x1 − x2 )[σ12 (x2 ) − σ21 (x1 )] ≤ 0, (x1 , x2 ) ∈ R+ × R+ ,
(2.27)
which implies that x1 = x2 = α is Lyapunov stable. 2
2
Finally, let R , {(x1 , x2 ) ∈ R+ : V˙ (x1 , x2 ) = 0} = {(x1 , x2 ) ∈ R+ : x1 = x2 = α, α ∈ R+ }. Since R consists of equilibrium points, it follows that M = R. Hence, for every x1 (0), x2 (0) ∈ R+ , (x1 (t), x2 (t)) → M as t → ∞. Hence, it follows from Theorem 2.7 that x1 = x2 = α is semistable for all α ∈ R+ . △ Next, we provide a converse Lyapunov theorem for semistability, which holds with a smooth (i.e., infinitely differentiable) Lyapunov function. Theorem 2.8. Consider the system (2.1). Suppose (2.1) is semistable with the domain of semistability D0 . Then there exist a smooth nonnegative function V : D0 → R+ and a class K∞ function α(·) such that i) V (x) = 0, x ∈ f −1 (0), ii) V (x) ≥ α(dist(x, f −1 (0))), x ∈ D0 , and iii) V ′ (x)f (x) < 0, x ∈ D0 \f −1 (0). Proof. For R t any given solution x(t) of (2.1), the change of time variable from t to τ = 0 (1 + kf (x(s))k)ds results in the dynamical system d¯ x f (¯ x(τ )) = , dτ 1 + kf (¯ x(τ ))k
x ¯(0) = x0 ,
τ ≥ 0,
(2.28)
where x ¯(τ ) = x(t). With a slight abuse of notation, let s¯(t, x), t ≥ 0, denote the solution of (2.28) starting from x ∈ D0 . Note that (2.28) implies that k¯ s(t, x) − s¯(τ, x)k ≤ |t − τ |, x ∈ D0 , t, τ ≥ 0. Next, define the function U : D0 → R+ by 1 + 2t −1 U (x) , sup dist(¯ s(t, x), f (0)) , 1+t t≥0
x ∈ D0 .
(2.29)
Note that U (·) is well defined since (2.28) is semistable. Clearly, i) holds with V (·) replaced by U (·). Furthermore, since U (x) ≥ dist(x, f −1 (0)), x ∈ D0 , it follows that ii) holds with V (·) replaced by U (·). To show that U (·) is continuous on D0 \f −1 (0), define T : D0 \f −1 (0) → [0, ∞) by T (z) , inf{h : dist(¯ s(t, z), f −1 (0)) < dist(z, f −1 (0))/2 for all t ≥ h > 0}, and denote Wε , {x ∈ D0 : dist(x, f −1 (0)) < ε}. Note that Wε ⊃ f −1 (0) is open. Consider z ∈ D0 \f −1 (0) and define λ , dist(z, f −1 (0)) > 0 and let xe , limt→∞ s¯(t, z). Since xe is Lyapunov stable, it follows that there exists a relatively open neighborhood V of xe such that all solutions of (2.28) in V remain in Wλ/2 . Since xe is semistable, it follows that there
NNBook
September 1, 2009
28
CHAPTER 2
exists h > 0 such that s¯(h, z) ∈ V. Consequently, s¯(h + t, z) ∈ Wλ/2 for all t ≥ 0, and hence, it follows that T (z) is well defined. Next, by continuity of solutions of (2.28) on compact time intervals, it follows that there exists a neighborhood U of z such that U ∩ f −1 (0) = Ø and s¯(T (z), y) ∈ V for all y ∈ U . Now, it follows from the choice of V that s¯(T (z) + t, y) ∈ Wλ/2 for all t ≥ 0 and y ∈ U . Then, for every t > T (z) and y ∈ U , [(1 + 2t)/(1 + t)]dist(¯ s(t, y), f −1 (0)) ≤ 2dist(¯ s(t, y), f −1 (0)) ≤ λ. Therefore, for each y ∈ U , 1 + 2t −1 U (z) − U (y) = sup dist(¯ s(t, z), f (0)) 1+t t≥0 1 + 2t −1 − sup dist(¯ s(t, y), f (0)) 1+t t≥0 1 + 2t −1 = sup dist(¯ s(t, z), f (0)) 1+t 0≤t≤T (z) 1 + 2t −1 − sup dist(¯ s(t, y), f (0)) . (2.30) 1+t 0≤t≤T (z) Hence, 1 + 2t |U (z) − U (y)| ≤ sup dist(¯ s(t, z), f −1 (0)) 0≤t≤T (z) 1 + t s(t, y), f −1 (0)) −dist(¯ ≤ 2 sup dist(¯ s(t, z), f −1 (0)) 0≤t≤T (z)
−dist(¯ s(t, y), f −1 (0)) s(t, z), s¯(t, y)), ≤ 2 sup dist(¯ 0≤t≤T (z)
z ∈ D0 \f −1 (0),
y ∈ U.
(2.31)
Now, it follows from the continuous dependence of solutions s¯(·, ·) on system initial conditions (Theorem 3.4 of Chapter I of [127]) and (2.31) that U (·) is continuous at z. Furthermore, it follows from (2.31) that, for every sufficiently small h > 0, |U (¯ s(h, z)) − U (z)| ≤ 2
sup 0≤t≤T (z)
= 2
sup 0≤t≤T (z)
≤ 2h,
k¯ s(t, s¯(h, z)) − s¯(t, z)k k¯ s(t + h, z) − s¯(t, z)k
which implies that |U˙ (z)| ≤ 2. Since z ∈ D0 \f −1 (0) was chosen arbitrarily, it follows that U (·) is continuous, |U˙ (·)| ≤ 2, and T (·) is well defined on D0 \f −1 (0).
NNBook
September 1, 2009
29
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
To show that U (·) is continuous on f −1 (0), consider xe ∈ f −1 (0). −1 (0) that converges to x . Since x Let {xn }∞ e e n=1 be a sequence in D0 \f is Lyapunov stable, it follows from Lemma 4.5 of [174] that x(t) ≡ xe is the unique solution to (2.28) with x0 = xe . By the continuous dependence of solutions s¯(·, ·) on system initial conditions (Theorem 3.4 of Chapter I of [127]), s¯(t, xn ) → s¯(t, xe ) = xe as n → ∞, t ≥ 0. Let ε > 0 and note that it follows from ii) of Proposition 3.1 that there exists δ = δ(xe ) > 0 such that, for every solution of (2.28) in Bδ (xe ), there exists Tˆ = Tˆ(xe , ε) > 0 such that s¯t (Bδ (xe )) ⊂ Wε for all t ≥ Tˆ. Next, note that there exists a positive integer N1 such that xn ∈ Bδ (xe ) for all n ≥ N1 . Now, it follows from (2.29) that for n ≥ N1 , U (xn ) ≤ 2 sup dist(¯ s(t, xn ), f −1 (0)) + 2ε.
(2.32)
0≤t≤Tˆ
Next, it follows from Lemma 3.1 of Chapter I of [127] that s¯(·, xn ) converges to s¯(·, xe ) uniformly on [0, Tˆ]. Hence, s(t, xn ), f −1 (0)) = sup dist( lim s¯(t, xn ), f −1 (0)) lim sup dist(¯
n→∞
0≤t≤Tˆ
0≤t≤Tˆ
n→∞
= sup dist(xe , f −1 (0)) 0≤t≤Tˆ
= 0, which implies that there exists a positive integer N2 = N2 (xe , ε) ≥ N1 such that sup0≤t≤Tˆ dist(¯ s(t, xn ), f −1 (0)) < ε for all n ≥ N2 . Combining (2.32) with the above result yields U (xn ) < 4ε for all n ≥ N2 , which implies that limn→∞ U (xn ) = 0 = U (xe ). Next, we show that U (¯ x(τ )) is strictly decreasing along the solution of (2.28) on D\f −1 (0). Note that for every x ∈ D0 \f −1 (0) and 0 < h ≤ 1/2 such that s¯(h, x) ∈ D0 \f −1 (0), it follows from the arguments preceding (2.30) that, for sufficiently small h, the supremum in the definition of U (¯ s(h, x)) is reached at some time tˆ such that 0 ≤ tˆ ≤ T (x). Hence, 1 + 2tˆ U (¯ s(h, x)) = dist(¯ s(tˆ + h, x), f −1 (0)) 1 + tˆ 1 + 2tˆ + 2h = dist(¯ s(tˆ + h, x), f −1 (0)) 1 + tˆ + h h · 1− (1 + 2tˆ + 2h)(1 + tˆ) h ≤ U (x) 1 − , 2(1 + T (x))2
(2.33)
which implies that U˙ (x) ≤ − 21 U (x)(1 + T (x))−2 < 0, x ∈ D0 \f −1 (0), and
NNBook
30
September 1, 2009
CHAPTER 2
hence, iii) holds with V (·) replaced by U (·). The function U (·) now satisfies all of the conditions of the theorem except for smoothness. To obtain smoothness, note that since |U˙ (x)| ≤ 2 for every x ∈ D0 , it follows that U˙ (x) satisfies a boundedness condition in the sense of Wilson [310]. By Theorem 2.5 of [310], there exists a smooth function W : D0 \f −1 (0) → R satisfying |W (x)−U (x)| < 14 U (x)(1+T (x))−2 < 12 U (x) ˙ (x) ≤ − 1 U (x)(1 + T (x))−2 < 0 for x ∈ D0 \f −1 (0). Next, we extend and W 4 W (·) to all of D0 by taking W (z) = 0 for z ∈ f −1 (0). Now, W (·) is a continuous Lyapunov function which is smooth on D0 \f −1 (0). Taking −2 V (x) = W (x)e−(W (x)) , and noting that W (x) > 12 U (x) > 12 dist(x, f −1 (0)), 2 x ∈ D0 \f −1 (0), so that V (·) satisfies ii) with α(r) , (r/2)e−4/r , we obtain the desired smooth Lyapunov function.
2.5 Stability Theory for Linear Nonnegative Dynamical Systems Linear nonnegative dynamical systems are of major importance in biological and physiological systems. For example, almost the entire field of distribution of tracer-labeled materials in steady-state systems can be captured by linear nonnegative dynamical systems. In this section, we develop necessary and sufficient conditions for stability of linear nonnegative dynamical systems. First, however, we introduce several definitions and some key results concerning nonnegative matrices [21, 22, 145, 218] that are necessary for developing the main results of this section. Definition 2.9. Let T > 0. A real function u : [0, T ] → Rm is a nonnegative (respectively, positive) function if u(t) ≥≥ 0 (respectively, u(t) >> 0) on the interval [0, T ]. Definition 2.10. Let A ∈ Rn×n . A is a Z-matrix if A(i,j) ≤ 0, i, j = 1, . . . , n, i 6= j. A is an M-matrix (respectively, a nonsingular M-matrix) if A is a Z-matrix and Re λ ≥ 0 (respectively, Re λ > 0) for all λ ∈ spec(A). A is essentially nonnegative if −A is a Z-matrix, that is, A(i,j) ≥ 0, i, j = 1, . . . , n, i 6= j. A is compartmental if A is essentially nonnegative and P n T i=1 A(i,j) ≤ 0, j = 1, . . . , n, or, equivalently, A e ≤≤ 0. Finally, A is 2 nonnegative (respectively, positive) if A(i,j) ≥ 0 (respectively, A(i,j) > 0), i, j = 1, 2, . . . , n. The following results are needed for developing several stability results for linear nonnegative dynamical systems. Theorem 2.9. Let A ∈ Rn×n be such that A ≥≥ 0. Then ρ(A) ∈ 2 In this monograph it is important to distinguish between a nonnegative (respectively, positive) matrix and a nonnegative-definite (respectively, positive-definite) matrix.
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
31
spec(A) and there exists x ≥≥ 0, x 6= 0, such that Ax = ρ(A)x. Proof. See [144, p. 503]. Lemma 2.2. Assume A ∈ Rn×n is a Z-matrix. Then the following statements are equivalent: i ) A is an M-matrix. ii ) Re λ ≥ 0, λ ∈ spec(A). iii ) There exist a scalar α > 0 and an n × n nonnegative matrix B ≥≥ 0 such that α ≥ ρ(B) and A = αI − B. iv ) If λ ∈ spec(A), then either λ = 0 or Re λ > 0. Furthermore, the following statements are equivalent: v ) A is a nonsingular M-matrix. vi ) det A 6= 0 and A−1 ≥≥ 0.
vii ) For every y ∈ Rn , y ≥≥ 0, there exists a unique x ∈ Rn , x ≥≥ 0, such that Ax = y. viii ) There exists x ∈ Rn , x ≥≥ 0, such that Ax >> 0. ix ) There exists x ∈ Rn , x >> 0, such that Ax >> 0. Proof. The equivalence of i) and ii) is by definition. To show that ii) implies iii), note that since A is a Z-matrix there exist α > 0 and B ≥≥ 0 such that A = αI − B. Next, it follows from Theorem 2.9 that ρ(B) ∈ spec(B) so that α − ρ(B) ∈ spec(A). Now, it follows from ii) that α ≥ ρ(B). Next, to show that iii) implies ii), let λ ∈ spec(A) and since A = αI − B there exists β ∈ spec(B) such that λ = α − β. Now, since α ≥ ρ(B) it follows that Re λ = α − Re β ≥ α − ρ(B) ≥ 0. To show that ii) implies iv), note that if λ ∈ spec(A), then Re λ ≥ 0. Suppose, there exists λ ∈ spec(A) such that Re λ = 0, that is, λ = ω for some ω ∈ R. Since ii) implies iii) it follows that there exist a scalar α > 0 and an n × n nonnegative matrix B ≥≥ 0 such that α ≥ ρ(B) and A = αI − B. Hence, there exists β ∈ spec(B) such that λ = α − β, which implies that 0 = Re λ = α − Re β ≥ α − ρ(B) ≥ 0, which further implies that α = β or, equivalently, λ = 0. Hence, either Re λ > 0 or λ = 0. Statement ii) follows trivially from iv), establishing the equivalence of ii) and iv).
NNBook
September 1, 2009
32
CHAPTER 2
To show that v) implies vi), note that since A is an M-matrix it follows from iii) that there exist α > 0 and B ≥≥ 0 such that A = αI − B and α ≥ ρ(B). Next, since A is nonsingular and α − ρ(B) ∈ spec(A) it follows that α > ρ(B) or, equivalently, ρ(B/α) < 1. Hence, I − α1 B is invertible P 1 k and (I − α1 B)−1 = ∞ k=0 ( α B) ≥≥ 0. The result now follows by noting that 1 1 −1 −1 A = α (I − α B) . To show that vi) implies vii), let y ≥≥ 0 and note that since A is nonsingular there exists a unique x such that Ax = y. Now, since A−1 ≥≥ 0 it follows that x = A−1 y ≥≥ 0. To show that vii) implies viii), let y = e and note that it follows from vii) that there exists x ≥≥ 0 such that Ax = y = e >> 0. To show that viii) implies ix), let α > 0 and B ≥≥ 0 be such that A = αI − B. Now, letting x ≥≥ 0 be such that 0 << Ax = αx − Bx, it follows that αx >> Bx ≥≥ 0, establishing the result. To show that ix) implies v), let x >> 0 be such that Ax >> 0 and consider the linear dynamical system y(t) ˙ = −AT y(t),
y(0) = y0 ≥≥ 0,
t ≥ 0.
(2.34)
Note that since A is a Z-matrix it follows that f (y) = −AT y is essentially nonnegative. Hence, with V (y) = xT y it follows from Theorem 2.1 that T y(t) = e−A t y0 → 0 as t → ∞ for every y0 ≥≥ 0, which implies that −AT is Hurwitz. Now, the result is immediate by noting that −AT is Hurwitz if and only if Re λ > 0 for all λ ∈ spec(A) (see Definition 2.11). Note that if f (x) = Ax, where A ∈ Rn×n , then f is essentially nonnegative if and only if A is essentially nonnegative. To address linear nonnegative dynamical systems consider (2.1) with f (x) = Ax so that x(t) ˙ = Ax(t),
x(0) = x0 ,
t ≥ 0,
(2.35)
where x(t) ∈ Rn , t ≥ 0, and A ∈ Rn×n . The solution to (2.35) is standard and is given by x(t) = eAt x(0), t ≥ 0. The following proposition shows that A is essentially nonnegative if and only if the state transition matrix eAt is nonnegative on [0, ∞). Proposition 2.5. Let A ∈ Rn×n . Then A is essentially nonnegative if and only if eAt is nonnegative for all t ≥ 0. Furthermore, if A is essentially nonnegative and x0 ≥≥ 0, then x(t) ≥≥ 0, t ≥ 0, where x(t), t ≥ 0, denotes the solution to (2.35). Proof. The proof is a direct consequence of Proposition 2.1 with
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
33
f (x) = Ax. The proof can also be shown using matrix mathematics [29]. To prove necessity, note that, since A is essentially nonnegative it follows that △ Aα = A + αI is nonnegative, where α , − min{A(1,1) , . . . , A(n,n) }. Hence, eAα t = e(A+αI)t ≥≥ 0, t ≥ 0, and thus eAt = e−αt eAα t ≥≥ 0, t ≥ 0. Conversely, suppose eAt ≥≥ 0, t ≥ 0, and assume, adP absurdum, there −1 k k exist i, j such that i 6= j and A(i,j) < 0. Now, since eAt = ∞ i=1 (k!) A t , it follows that [eAt ](i,j) = I(i,j) + tA(i,j) + O(t2 ), where O(t)/t → 0 as t → 0. Thus, as t → 0 and i 6= j, it follows that [eAt ](i,j) < 0 for some t sufficiently small, which leads to a contradiction. Hence, A is essentially nonnegative. Finally, if A is essentially nonnegative and x0 ≥≥ 0, then x(t) = eAt x0 ≥≥ 0, t ≥ 0, is immediate. Since it follows from Proposition 2.5 that the linear dynamical system given by (2.35) is nonnegative if and only if A is essentially nonnegative, henceforth we assume that A is essentially nonnegative. Definition 2.11. Let A ∈ Rn×n . Then: i ) A is Lyapunov stable if spec(A) ⊂ {s ∈ C : Re s ≤ 0} and, if λ ∈ spec(A) and Re λ = 0, then λ is semisimple. ii ) A is semistable if spec(A) ⊂ {s ∈ C : Re s < 0} ∪ {0} and, if 0 ∈ spec(A), then 0 is semisimple. iii ) A is asymptotically stable or Hurwitz if spec(A) ⊂ {s ∈ C : Re s < 0}. The following proposition concerning Lyapunov stability, semistability, and asymptotic stability of (2.35) is immediate. This result holds whether or not A is an essentially nonnegative matrix. Proposition 2.6 ([23]). Let A ∈ Rn×n and consider the linear dynamical system (2.35). Then the following statements are equivalent: i ) xe = 0 is a Lyapunov-stable equilibrium of (2.35). ii ) At least one equilibrium of (2.35) is Lyapunov stable. iii ) Every equilibrium of (2.35) is Lyapunov stable. iv ) A is Lyapunov stable. v ) For every initial condition x(0) ∈ Rn , x(t) is bounded for all t ≥ 0.
vi ) keAt k is bounded for all t ≥ 0, where k · k is a matrix norm on Rn×n .
NNBook
September 1, 2009
34
CHAPTER 2
vii ) For every initial condition x(0) ∈ Rn , eAt x(0) is bounded for all t ≥ 0. The following statements are equivalent: viii ) A is semistable. ix ) limt→∞ eAt exists. In fact, limt→∞ eAt = I − AA# . x ) For every initial condition x(0) ∈ Rn , limt→∞ x(t) exists. The following statements are equivalent: xi ) xe = 0 is an asymptotically stable equilibrium of (2.35). xii) A is asymptotically stable. xiii ) α(A) < 0. xiv ) For every initial condition x(0) ∈ Rn , limt→∞ x(t) = 0. xv ) For every initial condition x(0) ∈ Rn , limt→∞ eAt x(0) = 0. xvi ) limt→∞ eAt = 0. The following theorem gives several properties of a nonnegative dynamical system when a Lyapunov-like equation is satisfied for (2.35). Note that it follows from Proposition 2.6 that if A is asymptotically stable, then N (A) = {0}. Theorem 2.10. Let A ∈ Rn×n be essentially nonnegative. If there exist vectors p, r ∈ Rn such that p >> 0 and r ≥≥ 0 satisfy 0 = AT p + r,
then the following statements hold: i ) −A is an M-matrix. ii ) If λ ∈ spec(A), then either Re λ < 0 or λ = 0. iii ) A is semistable and limt→∞ eAt = I − AA# ≥≥ 0. iv ) R(A) = N (I − AA# ) and N (A) = R(I − AA# ). Rt v ) 0 eAσ ds = A# (eAt − I) + (I − AA# )t, t ≥ 0.
vi ) A is nonsingular if and only if −A is a nonsingular M-matrix.
(2.36)
NNBook
September 1, 2009
35
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
vii ) If A is nonsingular, then A is asymptotically stable and A−1 ≤≤ 0. Proof. i) Consider the linear dynamical system x(t) ˙ = Ax(t),
x(0) = x0 ≥≥ 0,
t ≥ 0.
(2.37)
Note that since A is an essentially nonnegative matrix it follows that f (x) = Ax is essentially nonnegative. Hence, with V (x) = pT x it follows from Theorem 2.1 that the zero solution to (2.37) is Lyapunov stable, and hence, Re λ ≤ 0 for all λ ∈ spec(A). Now, i) follows by noting A is essentillay nonnegative if and only if −A is a Z-matrix. ii) The proof is a consequence of i)–iv) of Lemma 2.2. iii) It follows from i) and ii) that A is Lyapunov stable and Re λ < 0 or λ = 0 for all λ ∈ spec(A). Hence, the eigenvalue λ = 0 (if it exists) is semisimple and it follows from the Jordan decomposition that there exist invertable matrices J ∈ Rr×r , where r = rank A, and S ∈ Rn×n such that J 0 A=S S −1 , 0 0 and J is Hurwitz. Hence, it follows that Jt e 0 At lim e = lim S S −1 0 In−r t→∞ t→∞ 0 0 = S S −1 0 In−r −1 J 0 J 0 −1 = In − S S S S −1 0 0 0 0 = In − AA# .
Next, since A is essentially nonnegative, it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0, which implies that I − AA# ≥≥ 0. iv) Let x ∈ R(A), that is, there exists y ∈ Rn such that x = Ay. Now, (I − AA# )x = x − AA# Ay = x − Ay = 0, which implies that R(A) ⊆ N (I − AA# ). Conversely, let x ∈ N (I − AA# ). Hence, (I − AA# )x = 0, or, equivalently, x = AA# x, which implies that x ∈ R(A), and hence, proves R(A) = N (I − AA# ). The equality N (A) = R(I − AA# ) can be proved in an analogous manner. J 0 v) Note that A = S S −1 , and hence, 0 0 Z t Z t Jσ e 0 Aσ e dσ = S S −1 dσ 0 In−r 0 0
NNBook
September 1, 2009
36
CHAPTER 2
= S
Rt 0
eJσ dσ 0 Rt 0 I 0 n−r dσ
S −1
J −1 (eJt − I) 0 = S S −1 0 In−r t −1 Jt J 0 (e − Ir ) 0 −1 S −1 = S S S 0 0 0 0 0 0 +S S −1 0 In−r t
= A# (eAt − In ) + (In − AA# )t,
t ≥ 0.
vi) The result follows from i). vii) Asymptotic stability of A is a direct consequence of ii). A−1 ≤≤ 0 follows from vi) of Lemma 2.2. It follows from Proposition 2.5 and iii) of Theorem 2.10 that lim x(t) = (I − AA# )x0 ≥≥ 0.
t→∞
Hence, the set of all equilibria of a semistable linear nonnegative dynamical system lies in N (A) = R(I − AA# ). Next, we show that linear compartmental dynamical systems [4,29,88, 100, 155, 158, 209, 211, 220, 259] are a special case of nonnegative dynamical systems. To see this, let xi (t), i = 1, . . . , n, denote the mass (and hence a nonnegative quantity) of the ith subsystem of the compartmental system shown in Figure 2.1, let aii ≥ 0 denote the loss coefficient of the ith subsystem, let wi (t) ≥ 0, i = 1, . . . , n, denote the flux (mass inflow) supplied to the ith subsystem, and let φij (t), i 6= j, i, j = 1, . . . , n, denote the net mass flow (or flux) from the jth subsystem to the ith subsystem given by φij (t) = aij xj (t) − aji xi (t), t ≥ 0, where the transfer coefficient aij ≥ 0, i 6= j, i, j = 1, . . . , n. A mass balance for the whole compartmental system yields x˙ i (t) = −aii xi (t) +
n X
φij (t) + wi (t),
j=1,i6=j
t ≥ 0,
i = 1, . . . , n,
(2.38)
or, equivalently, x(t) ˙ = Ax(t) + w(t),
x(0) = x0 ,
t ≥ 0,
(2.39)
where x(t) = [x1 (t), . . . , xn (t)]T , w(t) = [w1 (t), . . . , wn (t)]T , and for i, j =
NNBook
September 1, 2009
37
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
wi (t)
wj (t)
' ?
ith Subsystem xi (t) &
$ ) %
aij xj (t)
aji xi (t)
'
$
?
jth Subsystem xj (t) 1&
aii xi (t) ?
%
ajj xj (t) ?
Figure 2.1 Linear compartmental interconnected subsystem model.
1, . . . , n, A(i,j) =
−
Pn
k=1 aki , aij ,
i = j, i 6= j.
(2.40)
Thus, a compartmental system (with w(t) ≡ 0) satisfies x˙ i (t) ≤ 0 for all t ≥ 0 whenever xj (t) = 0 for all j 6= i and t ≥ 0, while a nonnegative system (with w(t) ≡ 0) satisfies x˙ i (t) ≥ 0 for all t ≥ 0 whenever xi (t) = 0 and xj (t) ≥ 0 for all j 6= i and t ≥ 0. Note that A is an essentially nonnegative matrix and hence the compartmental model given by (2.38) is a nonnegative dynamical system. Furthermore, note that AT e = [−a11 , −a22 , . . . , −ann ]T , and hence, with p = e and r = −AT e ≥≥ 0, it follows that (2.36) is satisfied, which implies that the compartmental model given by (2.38) (with w(t) ≡ 0) is semistable if A is singular and P asymptotically stable if A is nonsingular. In both cases, V (x) = eT x = ni=1 xi denoting the total mass of the system serves as a Lyapunov function for the undisturbed (w(t) ≡ 0) system (2.38) P n with V˙ (x) = eT Ax = − ni=1 aii xi ≤ 0, x ∈ R+ .
The compartmental system (2.38) with no inflows, that is, wi (t) ≡ 0, i = 1, . . . , n, is said to be inflow-closed [155]. Alternatively, if (2.38) possesses no losses (outflows) it is said to be outflow-closed [155]. A compartmental system is said to be closed if it is inflow-closed and outflown closed. Note that for a closed system V˙ (x) = 0, x ∈ R+ , which shows that the total mass inside a closed system is conserved. Alternatively, in the case where aii 6= 0 and wi (t) 6= 0, i = 1, . . . , n, it follows that (2.38) can be equivalently written as ∂V T x(t) ˙ = [Jn (x) − D(x)] + w(t), x(0) = x0 , t ≥ 0, (2.41) ∂x where Jn (x) is a skew-symmetric matrix function with Jn(i,i) (x) = 0 and Jn(i,j) (x) = aij xj − aji xi , i 6= j, and D(x) = diag[a11 x1 , a22 x2 , . . . , ann xn ] n ≥≥ 0, x ∈ R+ . Hence, a linear compartmental system is a port-controlled
NNBook
September 1, 2009
38
CHAPTER 2 n
Hamiltonian system [203] with a Hamiltonian H(x) = V (x) = eT x, x ∈ R+ , n representing the total mass in the system, Jn (x), x ∈ R+ , representing the n internal system interconnection structure, D(x), x ∈ R+ , representing the outflow dissipation, and w(t) representing the supplied flux to the system. This observation shows that closed compartmental systems are conservative systems. This will be further elaborated in Chapter 5. Finally, we note that semistability of an inflow-closed compartmental system is equivalent to the existence of a trap in the system. A trap [158] is a compartment or a set of compartments which is outflow-closed and from which there are no transfers to any compartments outside the trap. A simple trap is a trap that has no traps inside it. Reference [83] shows that the compartmental matrix given by (2.40) has a zero eigenvalue if and only if the compartmental system has a trap. Furthermore, [84] shows that the algebraic multiplicity of λ = 0, where λ ∈ spec(A), corresponds to the number of simple traps in the system. Now, using the construction developed in the proof of iii) of Theorem 2.10, it can be shown that the algebraic and geometric multiplicity of λ = 0 ∈ spec(A) are equal. Hence, all solutions of inflow-closed linear compartmental systems are bounded and convergent. Next, motivated by the fact that for a compartmental system the total mass in the system can serve as a Lyapunov function, we give necessary and sufficient conditions for Lyapunov stability, semistability, and asymptotic stability for linear nonnegative dynamical systems using linear Lyapunov functions. Theorem 2.11. Consider the linear dynamical system given by (2.35) where A ∈ Rn×n is essentially nonnegative. Then the following statements hold: i ) A is Lyapunov stable if and only if A is semistable. ii ) If there exist vectors p, r ∈ Rn such that p >> 0 and r ≥≥ 0 satisfy 0 = AT p + r,
(2.42)
then A is semistable (and hence Lyapunov stable). iii ) If A is semistable, then there exist vectors p, r ∈ Rn such that p ≥≥ 0 and r ≥≥ 0 satisfy (2.42). iv ) If there exist vectors p, r ∈ Rn such that p ≥≥ 0 and r ≥≥ 0 satisfy (2.42) and (A, r T ) is observable, then p >> 0 and (2.35) is asymptotically stable.
Furthermore, the following statements are equivalent:
NNBook
September 1, 2009
39
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
v ) A is asymptotically stable. vi ) There exist vectors p, r ∈ Rn such that p >> 0 and r >> 0 satisfy (2.42). vii ) There exist vectors p, r ∈ Rn such that p ≥≥ 0 and r >> 0 satisfy (2.42). viii ) For every r ∈ Rn such that r >> 0, there exists p ∈ Rn such that p >> 0 satisfies (2.42). Proof. i) If A is semistable, then A is Lyapunov stable by definition. Conversely, suppose A is Lyapunov stable and essentially nonnegative. Then, it follows from ii) of Lemma 2.2 that −A is an M-matrix. Now, it follows from iv) of Lemma 2.2 that the real part of each nonzero λ ∈ spec(A) is negative, and hence, Re λ < 0 or λ = 0. This proves the equivalence between Lyapunov stability and semistability. ii) The proof is a direct consequence of iv) of Theorem 2.10. Alternatively, consider the linear Lyapunov function candidate V (x) = pT x. n Note that V (0) = 0 and V (x) > 0, x ∈ R+ , x 6= 0. Now, computing the Lyapunov derivative yields △ V˙ (x) = V ′ (x)Ax = pT Ax = −r T x ≤ 0,
n
x ∈ R+ ,
establishing Lyapunov stability. Semistability now follows from i). iii) If A is semistable, it follows as in the proof of i) that −AT is an M-matrix. Hence, it follows from ii) of Lemma 2.2 that there exist a scalar α > 0 and a nonnegative matrix B ≥≥ 0 such that α ≥ ρ(B) and AT = B − αI. Now, since B ≥≥ 0, it follows from Theorem 2.9 that ρ(B) ∈ spec(B), and hence, there exists p ≥≥ 0 such that Bp = ρ(B)p. Thus, AT p = Bp − αp = (ρ(B) − α)p ≤≤ 0, which proves that there exist p ≥≥ 0 and r ≥≥ 0 such that (2.42) holds. iv) Assume there exist p ≥≥ 0 and r ≥≥ 0 such that (2.42) holds and suppose (A, r T ) is observable. Now, consider the function V (x) = pT x, x ∈ n n R+ , and note that, since V (x) ≥ 0, x ∈ R+ , and V˙ (x) = pT Ax = −r T x ≤ 0, n △ it follows that if x(0) ∈ P = {x ∈ R+ : pT x = 0}, then V (x(t)) = 0, t ≥ 0, which implies that dV (x(t)) = 0. Specifically, dt dV (x(t)) = pT Ax(0) = 0. dt t=0 Hence, if x ˆ ∈ P then V˙ (ˆ x) = pT Aˆ x = −r T x ˆ = 0. Thus, if x ˆ ∈ P then n △ T Aˆ x ∈ P and x ˆ ∈ Q = {x ∈ R+ : r x = 0}. Now, since Aˆ x ∈ P it follows
NNBook
40
September 1, 2009
CHAPTER 2
that A2 x ˆ ∈ P and Aˆ x ∈ Q. Repeating these arguments yields Ak x ˆ ∈ Q, T k k = 0, 1, . . . , n, or, equivalently, r A x ˆ = 0, k = 1, 2, . . . , n. Now, since (A, r T ) is observable it follows that x ˆ = 0 and P = {0}, which implies that p >> 0. Asymptotic stability of (2.35) now follows as a direct consequence of the Krasovskii-LaSalle invariant set theorem with V (x) = pT x and using the fact that (A, r T ) is observable. To show the equivalence among v)–viii) first suppose there exist p ≥≥ 0 and r >> 0 such that (2.42) holds. Now, there exists sufficiently small ε > 0 such that AT (p + εe) << 0 and p + εe >> 0, which proves that vii) implies vi). Since vi) implies vii) it trivially follows that vi) and vii) are equivalent. Now, suppose vi) holds, that is, there exist p >> 0 and r >> 0 such that (2.42) holds, and consider the Lyapunov function candidate n V (x) = pT x, x ∈ R+ . Computing the Lyapunov derivative yields V˙ (x) = pT Ax = −r T x < 0, x 6= 0, and hence, it follows that (2.35) is asymptotically stable. Thus, vi) implies v). Next, suppose (2.35) is asymptotically stable. △ Hence, −A−T ≥≥ 0 and thus for every r ∈ Rn+ , p = −A−T r ≥≥ 0 satisfies (2.42), which proves that v) implies vii). Finally, suppose (2.35) is asymptotically stable. Now, as in the proof n given above, for every r ∈ Rn+ , there exists p ∈ R+ such that (2.42) holds. n Next, suppose, ad absurdum, there exists x ∈ R+ , x 6= 0, such that xT p = 0, that is, there exists at least one i ∈ {1, 2, . . . , n} such that pi = 0. Hence, −xT A−T r = 0. However, since −AT ≥≥ 0 it follows that −A−1 x ≥≥ 0 and, since r >> 0, it follows that −A−1 x = 0, which implies that x = 0 yielding a contradiction. Hence, for every r ∈ Rn+ , there exists p ∈ Rn+ such that (2.42) holds, which proves that v) implies viii). Since viii) implies vi) trivially, the equivalence of v)–viii) is established. Next, using Theorem 2.11, we show that every asymptotically stable linear nonnegative system is equivalent, modulo a similarity transformation, to a compartmental system. Proposition 2.7. Let A ∈ Rn×n be essentially nonnegative and asymptotically stable. Then there exist an invertible matrix S ∈ Rn×n and a matrix Aˆ ∈ Rn×n such that Aˆ = SAS −1 , Aˆ(i,j) ≥ 0, i 6= j, and Pn ˆ k=1 A(k,j) ≤ 0, i, j = 1, . . . , n.
Proof. It follows from v) and vi) of Theorem 2.11 that there exists △ p ∈ Rn+ such that AT p << 0. Now, define S = diag[p1 , . . . , pn ], where pi is the ith component of p. Next, since Aˆ(i,j) = pi A(i,j) p−1 j , i, j = 1, . . . , n, it ˆ follows that A(i,j) ≥ 0, i, j = 1, . . . , n. Furthermore, since S AˆT e = AT Se = AT p << 0, which, since S >> 0 and diagonal, implies that AˆT e << 0.
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
Hence,
Pn
ˆ
k=1 A(k,j)
41
≤ 0, i, j = 1, . . . , n.
The following propositions give additional necessary and sufficient conditions for asymptotic stability of linear nonnegative dynamical systems. Proposition 2.8. The linear nonnegative dynamical system given by (2.35) is asymptotically stable if and only if the first n leading principal minors of −A are positive. Proof. It follows from Theorem 4.14 of [20, p. 21] that all the leading principal minors of a Z-matrix are positive if and only if the Z-matrix is a nonsingular M-matrix. Now, the result is immediate by noting that −A is a nonsingular M-matrix. Proposition 2.9. The linear nonnegative dynamical system given by (2.35) is asymptotically stable if and only if the coefficients of χA (λ) = det(λIn − A) are positive. Proof. The proof is a direct consequence of Proposition 2.8. Next, we give necessary and sufficient conditions for asymptotic stability of a linear nonnegative dynamical system using quadratic Lyapunov functions. First, however, the following technical lemmas are necessary. Lemma 2.3. Let A ∈ Rn×n be essentially nonnegative. Then A is Hurwitz if and only if there exists a vector p ∈ Rn such that p >> 0 satisfies AT p << 0. Proof. The result is a direct consequence of v) and vi) of Theorem 2.11. Lemma 2.4. Let Aˆ ∈ Rn×n be essentially nonnegative matrix and ˆ << 0 and AˆT e << 0. Then Aˆ + AˆT < 0. assume Ae ˆ << 0, and AˆT e << 0, Proof. Since Aˆ is essentially nonnegative, Ae T it follows that Aˆ + Aˆ is essentially nonnegative and (Aˆ + AˆT )e << 0. Now, it follows from Lemma 2.3 that Aˆ + AˆT is Hurwitz which, since Aˆ + AˆT is symmetric, implies that Aˆ + AˆT < 0. Theorem 2.12. Consider the dynamical system given by (2.35) where A ∈ Rn×n is essentially nonnegative. Then (2.35) is asymptotically stable if and only if there exist a positive diagonal matrix P ∈ Rn×n and an n × n positive-definite matrix R such that 0 = AT P + P A + R.
(2.43)
NNBook
September 1, 2009
42
CHAPTER 2
Proof. Sufficiency follows from Theorem 2.1 with xe = 0 by noting that if there exist a positive diagonal matrix P ∈ Rn×n and an n × n matrix R > 0 such that (2.43) holds, then asymptotic stability is immediate with the quadratic Lyapunov function V (x) = xT P x. To show necessity, assume that A is essentially nonnegative and Hurwitz. Then it follows from Lemma 2.3 that there exists a vector l ∈ Rn , l >> 0 such that AT l << 0, which implies that AT Le << 0, where L = diag[l1 , . . . , ln ] and li is the ith component of l. This further implies that LA is essentially nonnegative and Hurwitz. Since LA is essentially nonnegative and Hurwitz, it follows that AT L is essentially nonnegative and Hurwitz. Hence, by Lemma 2.3, there exists a vector m ∈ Rn , m >> 0 such that LAm << 0, which implies that LAM e << 0, where M = diag[m1 , . . . , mn ] and mi is the ith component of m. Furthermore, since AT Le << 0, it follows that M AT Le << 0. Now, with Aˆ = LAM , it follows from Lemma 2.4 that M AT L + LAM < 0, or, equivalently, AT LM −1 + M −1 LA < 0, establishing (2.43) with P = LM −1 and R = −(AT P + P A). Theorem 2.13. Consider the dynamical system given by (2.35) where A ∈ Rn×n is essentially nonnegative. Then (2.35) is asymptotically stable if and only if for every positive, positive-definite n × n matrix R, there exists a positive, positive-definite n × n matrix P satisfying (2.43). Proof. If for every positive, positive-definite n × n matrix R (i.e., R > 0 and R >> 0) there exists a positive, positive-definite n × n matrix P , that is, P > 0 and P >> 0, then asymptotic stability of A follows from standard Lyapunov theory with Lypunov function V (x) = xT P x. Conversely, assume that A is essentially nonnegative and asymptotically stable, and let R be a positive, positive-definite matrix. Since A is asymptotically stable it follows that there exists a unique n × n positivedefinite matrix P such that (2.43) is satisfied and (A ⊕ A)T vec P = vec R, where vec(·) denotes the column stacking operator. Next, since A is essentially nonnegative and asymptotically stable it follows that A ⊕ A is essentially nonnegative and asymptotically stable. Now, since R >> 0, it follows that vec R >> 0, and hence, viii) of Theorem 2.11 implies that vec P >> 0, which establishes that P >> 0.
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
43
2.6 Nonlinear Compartmental Dynamical Systems Many applications in life sciences give rise to nonlinear compartmental dynamical systems. These include metobolic pathways, membrane transports, pharmacodynamics, epidemiology, and ecology. In this section, we develop linearization results for nonlinear nonnegative dynamical systems as well as several stability results for nonlinear compartmental dynamical systems. First, we show that if a nonlinear system is nonnegative, then its linearization is also nonnegative. Proposition 2.10. Consider the nonlinear dynamical system (2.1) where f (0) = 0 and f : D → Rn is essentially nonnegative and continuously n △ ∂f differentiable in R+ . Then, A = ∂x (x) is essentially nonnegative. x=0
Proof. Since f : D → Rn is essentially nonnegative it follows that n fi (x)|xi =0 ≥ 0, x ∈ R+ . Now, note that for all i 6= j, ∂fi A(i,j) = (x) ∂xj x=0 fi (0, . . . , h, . . . , 0) − fi (0) = lim+ h→0 h fi (0, . . . , h, . . . , 0) , = lim+ h h→0 where h in fi (0, . . . , h, . . . , 0) is in the jth location, which implies that fi (0, . . . , h, . . . , 0) ≥ 0. Hence, A(i,j) ≥ 0, i 6= j, which proves essential nonnegativity of A. Next, we present a key result on stability of a linearized nonlinear nonnegative dynamical system. First, however, note that the definition of a domain of attraction can be extended to nonlinear nonnegative dynamical n systems by restricting the domain to the nonnegative orthant R+ . Theorem 2.14. Let x(t) ≡ xe be an equilibrium point for the nonlinear dynamical system (2.1). Furthermore, let f : D → Rn be essentially nonnegative and let ∂f A= (x) . ∂x x=xe
Then the following statements hold:
i ) If Re λ < 0, where λ ∈ spec(A), then the equilibrium solution x(t) ≡ xe of the nonlinear dynamical system (2.1) is asymptotically stable. ii ) If there exists λ ∈ spec(A) such that Re λ > 0, then the equilibrium
NNBook
September 1, 2009
44
CHAPTER 2
wi (t) ' ?
ith Subsystem xi (t) &
wj (t) $ ) %
a ˆij (x(t))
a ˆji (x(t))
a ˆii (x(t)) ?
'
?
jth Subsystem xj (t) 1&
$ %
a ˆjj (x(t)) ?
Figure 2.2 Nonlinear compartmental interconnected subsystem model.
solution x(t) ≡ xe of the nonlinear dynamical system (2.1) is unstable. iii) Let xe = 0, let Re λ < 0, where λ ∈ spec(A), let p >> 0 be such that n △ △ AT p << 0, and define DA = {x ∈ R+ : pT x < γ}, where γ = sup{ε > P n △ 0 : pT f (x) < 0, x ∈ R+ , kxk < ε} and kxk = ni=1 pi |xi |. Then DA is a subset of the domain of attraction for (2.1). Proof. Statements i) and ii) are restatements of Lyapunov’s indirect method [112] as applied to nonlinear nonnegative systems. To prove iii), note that it follows from Lemma 2.10 that if f : D → Rn is essentially nonnegative, then A is essentially nonnegative. Hence, since Re λ < 0, where λ ∈ spec(A), it follows from vi) of Theorem 2.11 that there exists p >> 0 such that AT p << 0. Now, using the linear Lyapunov function n candidate V (x) = pT x, it follows that the closed subset DA of R+ is a subset of the domain of attraction for (2.1) since V˙ (x) < 0 for all x ∈ DA \{0} ⊆ n R+ \{0}. n
Definition 2.12. Let f : D ⊆ R+ → Rn . Then f is compartmental if n f is essentially nonnegative and eT f (x) ≤ 0, x ∈ R+ . Next, we show that nonlinear compartmental dynamical systems are a special case of nonlinear nonnegative dynamical systems. To see this, once again let xi (t), i = 1, . . . , n, denote the mass (and hence a nonnegative quantity) of the ith subsystem of the compartmental system shown in Figure n 2.2, let a ˆii (x) ≥ 0, x ∈ R+ , denote the instantaneous rate of flow of material loss of the ith subsystem, let wi (t) ≥ 0, i = 1, . . . , n, denote the mass inflow supplied to the ith subsystem, and let φij (x(t)) i 6= j, i, j = 1, . . . , n, denote the net mass flow from the jth subsystem to the ith subsystem given by φij (x(t)) = a ˆij (x(t)) − a ˆji (x(t)), where the instantaneous rate of material flow a ˆij (x) ≥ 0, i 6= j, i, j = 1, . . . , n.
NNBook
September 1, 2009
45
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
A mass balance for the whole compartmental system yields x˙ i (t) = −ˆ aii (x(t)) +
n X
j=1,i6=j
[ˆ aij (x(t)) − a ˆji (x(t))] + wi (t), t ≥ 0,
i = 1, . . . , n,
(2.44)
t ≥ 0,
(2.45)
or, equivalently, x(t) ˙ = f (x(t)) + w(t),
x(0) = x0 ,
where x = [x1 , . . . , xn ]T , w = [w1 , . P . . , wn ]T , f (x) = [f1 (x), . . . , fn (x)]T , and aij (x) − a ˆji (x)]. Since all mass for i = 1, . . . , n, fi (x) = −ˆ aii (x) + nj=1,i6=j [ˆ flows as well as compartment sizes are nonnegative, it follows that for all n i = 1, . . . , n, fi (x) ≥ 0 for all x ∈ R+ whenever xi = 0 and whatever the values of xj , j 6= i. The above physical constraints are implied by a ˆij (x) ≥ 0, n a ˆii (x) ≥ 0, and wi ≥ 0, for all i, j = 1, . . . , n, and x ∈ R+ , and if xi = 0, then a ˆii (x) = 0 and a ˆji (x) = 0 for all i, j = 1, . . . , n, so that x˙ i ≥ 0. The above physical constraints imply that f is essentially nonnegative. It is important to note that the exchange of material between compartments (2.44) is assumed to be a nonlinear function of all the n compartments, that is, a ˆij = a ˆij (x), x ∈ R+ , i 6= j, i, j = 1, . . . , n. This assumption is made for generality and depends on the complexity of the intercompartmental transfer process. If the intercompartmental transfer process is such that material flow from the jth compartment to the ith compartment is dependent only (possibly nonlinearly) on the material in the jth compartment, then the transfer coefficient a ˆij (·) is a function only of xj and not x. In this case, (2.44) becomes x˙ i (t) = −ˆ aii (xi (t)) +
n X
j=1,i6=j
[ˆ aij (xj (t)) − a ˆji (xi (t))] + wi (t), t ≥ 0,
i = 1, . . . , n,
(2.46)
where for i = 1, . . . , n, aij : R+ → R+ , and aij (0) = 0. The nonlinear compartmental system (2.46) is known as a nonlinear-donor-controlled compartmental system [155]. Other functional forms of the flow rates a ˆij (·) include recipient-controlled compartmental systems where a ˆij (x) = a ˆij (xi ), Lotka-Volterra compartmental systems where a ˆij (x) = aij xj xi , and chemostat compartmental systems where a ˆij (x) = aij xj /(bij + xj ). T Pn Taking the total mass of the compartmental system V (x) = e x = i=1 xi as a Lyapunov function for (2.45) (with w(t) ≡ 0) and assuming a ˆij (0) = 0, i, j = 1, . . . , n, it follows that
V˙ (x) = eT f (x)
NNBook
September 1, 2009
46
CHAPTER 2
=
n X
x˙ i
i=1
= − = − ≤ 0,
n X i=1 n X
a ˆii (x) +
n n X X
i=1 j=1,i6=j
[ˆ aij (x) − a ˆji (x)]
a ˆii (x)
i=1
n
x ∈ R+ ,
(2.47)
which shows that the zero solution x(t) ≡ 0 of the nonlinear, inflow-closed (w(t) ≡ 0) compartmental system given by (2.45) is Lyapunov stable. However, unlike linear compartmental systems, the zero solution x(t) ≡ 0 to (2.45) with w(t) ≡ 0 is not necessarily semistable. In fact, (2.45) can exhibit limit cycles, bifurcations, and even chaos (for n ≥ 4). For details see [158]. If, however, the Jacobian matrix ∂f ∂x (x) is essentially nonnegative n for all x ∈ R+ , then it follows from Theorem 2.1 of [142] (see also [211,259]) that every trajectory of (2.45) (with w(t) ≡ 0) is bounded and tends to an equilibrium set. Note that this assumption is automatically satisfied for linear nonnegative (and hence compartmental) systems. Of course, if (2.45) with w(t) ≡ 0 has losses (outflows) from all compartments, then a ˆii (x) > 0, n x ∈ R+ , x 6= 0, and by (2.47), the zero solution x(t) ≡ 0 to (2.45) (with w(t) ≡ 0) is asymptotically stable. As in the linear case, nonlinear compartmental systems are portcontrolled Hamiltonian systems. This follows from the fact that (2.44) can be equivalently written as x(t) ˙ = [Jn (x) − D(x)]
∂V ∂x
T
+ w(t),
x(0) = x0 ,
t ≥ 0,
(2.48)
where Jn (x) is a skew-symmetric matrix function with Jn(i,i) (x) = 0 and ˆij (x) − a Jn(i,j) (x) = a ˆji (x), i 6= j, and D(x) = diag[ˆ a11 (x), a ˆ22 (x), . . ., n a ˆnn (x)] ≥≥ 0, x ∈ R+ . n
Finally, if f : R+ → Rn in (2.45) is r times continuously differentiable and xe = 0 so that f (0) = 0, then representing f (x) =
Z
1 0
∂f (σx)xdσ ∂x
and using the fact that f is essentially nonnegative it follows that (see [158] for details) a ˆij (x) = aij (x)xj , where the state-dependent transfer coefficients n aij (x) ≥ 0, x ∈ R+ , i, j = 1, . . . , n, and aij (·) is at least r − 1 times
NNBook
September 1, 2009
47
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
continuously differentiable. In this case, (2.44) becomes n X x˙ i (t) = − aii (x(t)) + +aji (x(t)) xi (t) j=1,i6=j
+
n X
aij (x(t))xj (t) + wi (t),
j=1,i6=j
t ≥ 0,
i = 1, . . . , n,
(2.49)
or, equivalently, x(t) ˙ = A(x(t))x(t) + w(t),
t ≥ 0,
x(0) = x0 ,
(2.50)
where, for i, j = 1, . . . , n, A(i,j) (x) =
−
Pn
k=1 aki (x), i = j, aij (x), i= 6 j.
(2.51)
n
Note that A(x) is essentially nonnegative for all x ∈ R+ . Hence, once again using the total mass V (x) = eT x as a Lyapunov function for (2.50) (with w(t) ≡ 0) it follows that V˙ (x) = eT x˙ = eT A(x)x = −
n X i=1
aii (x)xi ≤ 0,
n
x ∈ R+ ,
(2.52)
which shows that the zero solution x(t) ≡ 0 of the inflow-closed (w(t) ≡ 0) system given by (2.50) is Lyapunov stable. As in the case of (2.44), (2.50) can have a full range of nonlinear behavior including bifurcations, limit cycles, and even chaos. However, it is of interest to determine conditions under which masses/concentrations for a nonlinear compartmental system converge. In light of the above and (2.48), we have the following result on stability, convergence, and global existence and uniqueness of solutions for nonlinear inflow-closed compartmental systems. Theorem 2.15. Consider the inflow-closed nonlinear compartmental system given by (2.48) where V (x) = eT x. Then the following statements hold: n n i ) If D(x) > 0, x ∈ R+ \{0}, and D(0) = 0, then V˙ (x) ≤ 0 for all x ∈ R+ and V˙ (x) = 0 if and only if x = 0. n
ii ) If Jn (0) = 0, D(x) ≥≥ 0, x ∈ R+ , and D(0) = 0, then the zero solution x(t) ≡ 0 to (2.48) is Lyapunov stable. If, in addition, D(x) > 0, n x ∈ R+ \{0}, then the zero solution x(t) ≡ 0 to (2.48) is asymptotically stable.
NNBook
September 1, 2009
48
CHAPTER 2 △
n
iii ) Let Dc = {x ∈ R+ : V (x) ≤ β} be compact for every β ∈ R+ and let x0 ∈ Dc . Then there exists a unique solution to (2.48) (with w(t) ≡ 0) that is defined for all t ≥ 0. In addition, every solution x(t) → M as △ t → ∞, where M is the largest invariant set contained in R = {x ∈ n n R+ : D(x) = 0}. Finally, if D(i,i) (x) 6= 0, x ∈ R+ , i = 1, . . . , n, except for a finite number of equilibrium points {p1 , p2 , . . . , pr }, then for every x0 ∈ Dc , limt→∞ x(t) = pi , where i ∈ {1, . . . , r}. Proof. i) Note that ∂V x˙ V˙ (x) = ∂x ∂V ∂V T = [Jn (x) − D(x)] ∂x ∂x T ∂V ∂V = − D(x) ∂x ∂x ≤ 0,
n
x ∈ R+ ,
which, using D(0) = 0, shows that V˙ (x) = 0 if and only if x = 0. ii) Lyapunov stability follows by noting that V (x) = eT x is a ∂V T Lyapunov function candidate for (2.48) and V˙ (x) = − ∂V ∂x D(x)( ∂x ) ≤ 0, n n x ∈ R+ . To show asymptotic stability note that if D(x) > 0, x ∈ R+ \{0}, n then V˙ (x) = −eT D(x)e < 0, x ∈ R+ \{0}. iii) Suppose x0 ∈ Dc with β ≥ V (x0 ). Now, since V˙ (x) ≤ 0 for all x ∈ Dc , it follows that x(t) ∈ Dc for all t ≥ 0. Hence, since Dc is compact, it follows from Corollary 2.5 of [112] that there exists a unique solution to (2.48) that is defined for all t ≥ 0. The fact that x(t) → M as t → ∞ is a direct consequence of the Krasovskii-LaSalle invariant set theorem. n
Finally, if D(i,i) (x) 6= 0, x ∈ R+ , i = 1, . . . , n, except for a finite n number of equilibrium points {p1 , p2 , . . . , pr }, then R = {x ∈ R : V˙ (x) = n 0} = {x ∈ R+ : D(i,i) (x) = 0, i = 1, . . . , n} = {p1 , p2 , . . . , pr }. Now, it follows that the largest invariant set M contained in R is given by M = {p1 , p2 , . . . , pr } and by the Krasovskii-LaSalle invariant set theorem, x(t) → M = {p1 , p2 , . . . , pr } as t → ∞. Next, since there exists a unique solution to n (2.48) it follows that for every initial condition x0 ∈ R+ , the positive limit set ω(x0 ) of (2.48) is a connected set. Hence, since M consists of a set of finite isolated points it follows that x(t), t ≥ 0, approaches one of the points in M, which shows that limt→∞ x(t) = pi , where i ∈ {1, . . . , r}. n
Note that if for every β ∈ R+ , the set {x ∈ R+ : D(x) = 0, eT x =
NNBook
September 1, 2009
49
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
β} does not contain any closed orbits, then x(t), t ≥ 0, approaches an equilibrium point of (2.48). For two-dimensional (n = 2) nonlinear 2 compartmental systems, the set {x ∈ R+ : D(x) = 0, eT x = β} is an empty set, a finite set of points, or a line, for every β ∈ R+ , and hence, it 2 2 follows that (2.48) is semistable for every D(x), x ∈ R+ , and x0 ∈ R+ .
2.7 Compartmental Systems in Biology, Ecology, Epidemiology, and Pharmacology As mentioned in Chapter 1, nonnegative dynamical systems arise in a number of areas such as biomedicine, physiology, genetics, ecology, chemical kinetics, epidemiology, economics, and thermodynamics. Moreover, many traditional models, such as the logistic equation for population dynamics, Lotka-Volterra equations for predator-prey or host-parasite dynamics, Markov chains, and Leslie models used to model the age classes of a biological population, fall under the class of nonnegative dynamical systems. In this section, we provide several examples that draw from the aforementioned areas to demonstrate the utility of the basic mathematical results developed in this chapter. Example 2.2. This example considers a lipoprotein metabolism and potassium ion transfer model. Specifically, consider the general form of a two-compartment model with arbitrary inputs (inflows) and outflows (excretions) shown in Figure 2.3, where for i, j = 1, 2, xi is the size of compartment i in mass units, aij is the instantaneous transfer coefficient of material flow from j to i in units of (time)−1 , aii is the flow loss coefficient from compartment i out of the system in units of (time)−1 , and ui is the instantaneous rate of flow of material from outside the system (environment) into the compartment i in units of mass/time. A mass balance for the two-compartment system yields x(t) ˙ = Ax(t) + Bu(t),
x(0) = x0 ,
where x = [x1 x2 ]T , u = [u1 u2 ]T , and −(a11 + a21 ) a12 A= , a21 −(a22 + a12 )
t ≥ 0,
B=
(2.53)
1 0 0 1
.
This model is frequently used to analyze the distribution or flow of a drug or other material (the tracer) through the human body after injection into the bloodstream [155]. The flow of the material to be studied is assumed to be near steady state, that is, the material is mixed in the blood plasma so that the amount in the plasma is at a uniform concentration. Furthermore, the tracer is introduced in a comparatively small quantity so that even if
NNBook
September 1, 2009
50
CHAPTER 2
the original flows are nonlinear, the tracer flows can be modeled by linear equations. A simple example of such a model would be of a lipoprotein metabolism. In this case, the first compartment corresponds to the blood plasma and the second compartment corresponds to the extravascular space. Here, we assume that the tracer is introduced intravenously as an impulsive injection, that is, a bolus injection, into the bloodstream and hence u2 = 0. Furthermore, we assume that the tracer does not enter cells so that a22 = 0. Finally, we assume that the compound is removed from the plasma by excretion into the kidneys and the amount excreted is some fraction of the amount filtered in the renal glomeruli so that a11 > 0. u1 (t) ' ?
Compartment I x1 (t) &
u2 (t) $ ) %
a12 x2 (t)
a21 x1 (t)
'
?
$
Compartment II x2 (t) 1& %
a11 x1 (t) ?
a22 x2 (t) ?
Figure 2.3 General linear two-compartment model.
To analyze this system, note that A is nonsingular and essentially nonnegative. Furthermore, since the input material is a bolus injection, we can always reproduce the impulsive response with the free response by setting x(0) = Bv, where v ∈ R2 denotes the impulse strength. Hence, the above model can be analyzed as an input-closed compartmental model. Now, it follows from Proposition 2.5 that eAt ≥≥ 0 for all t ≥ 0 and consequently if x(0) is nonnegative, then the solution x(t) = eAt x(0) is nonnegative for all t ≥ 0. Furthermore, since A is a nonsingular matrix it follows that the set 2 of equilibria of (2.53) (with u(t) ≡ 0) is given by E = {(x1 , x2 ) ∈ R+ : Ax = 0} = N (A) = {(0, 0)}. Next, taking p = e >> 0 and r = [−a11 , 0]T ≥≥ 0, it follows that (2.42) holds, and hence, since (A, r T ) is observable, the system is asymptotically stable by iv) of Theorem 2.11. Finally, we use the two-compartment model shown in Figure 2.3 to study the behavior of a closed compartmental system, that is, u1 = u2 = 0 and a11 = a22 = 0. These systems can arise when studying potassium ions continually moving from the plasma into the red blood cells and vice versa in the human bloodstream. Since potassium is concentrated in red blood cells by a nonlinear active transport mechanism, the resulting compartmental
NNBook
September 1, 2009
51
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
model is inherently nonlinear. However, experimental data reported in [272] show that potassium levels in both the plasma and red cells stay relatively constant over time, and hence, at steady state the tracer distribution is linear. Hence, we use the model in Figure 2.3 with u1 = u2 = 0 and a11 = a22 = 0 to analyze this system with the total red blood cells containing an amount x1 of potassium (the tracee) designated as the first compartment, and blood plasma, containing a quantity x2 of potassium, as the second compartment. In this case, A is singular and essentially nonnegative. Hence, " ! # −(a21 +a12 )t 1 − e A x0 ≥≥ 0, t ≥ 0. x(t) = eAt x(0) = I2 + a21 + a12 2
Furthermore, the set of equilibria is given by E = {(x1 , x2 ) ∈ R+ : Ax = 2 0} = N (A) = {(x1 , x2 ) ∈ R+ : x2 = aa21 x1 }. Finally, taking p = e >> 0 and 12 T r = [0, 0] , it follows that (2.42) holds, and hence, the system is semistable by ii) of Theorem 2.11. Alternatively, semistability also follows by noting 1 At △ that limt→∞ e exists and is equal to I2 + a21 +a12 A.
Example 2.3. This example models the flow of lead in the human body. Lead enters the human body via food, liquid, and air inhalation. A simple yet accurate model for the lead kinetics in the human body is captured by the three-compartment model shown in Figure 2.4 [301]. The first compartment corresponds to the red blood cells and to a lesser extent blood plasma. From the blood (Compartment I), lead is rapidly distributed to the tissues (e.g., liver and kidneys) denoted by Compartment II. Finally, at a slower rate, lead is eventually transferred to the bones (Compartment III). For low concentrations of lead, the intercompartmental flow diffusion process is linear. Thus, with xi , i = 1, 2, 3, denoting the amount of lead in micrograms of the ith compartment and u1 denoting the input rate in Compartment I, a mass balance of the three-state compartmental model shown in Figure 2.4 yields (2.53) with x = [x1 , x2 , x3 ]T , u = u1 , and −a11 − a21 − a31 a12 a13 1 a −a − a 0 A= , B = 0 . 21 22 12 a31 0 −a13 0 To analyze this system, let u1 (t) ≡ 0 and note that A is nonsingular and essentially nonnegative. Now, it follows from Proposition 2.5 that eAt ≥≥ 0 for all t ≥ 0 and consequently if x(0) is nonnegative, then the solution x(t) = eAt x(0) is nonnegative for all t ≥ 0. Furthermore, since A is a nonsingular matrix it follows that the set of equilibria of this system is 3 given by E = {(x1 , x2 , x3 ) ∈ R+ : Ax = 0} = N (A) = {(0, 0, 0)}. Next, taking p = e >> 0 and r = [a11 a22 0]T ≥≥ 0, it follows that (2.42) holds
NNBook
September 1, 2009
52
CHAPTER 2
and hence, since (A, r T ) is observable, the system is asymptotically stable by iv) of Theorem 2.11. △ u1 (air, water, food) a31 x1 (t) a12 x2 (t) ' ' $ '? $ $ ) ) Compartment I Compartment III Compartment II blood (red cells, skeleton tissue plasma) & % 1& % 1& % a13 x3 (t) a21 x1 (t) ? ? a11 a22 (urine) (hair, nails, sweat)
Figure 2.4 Compartmental model of lead flow in the human body.
Example 2.4. Forest ecosystem dynamics are highly nonlinear and notoriously complex. However, a simple yet accurate linear model is given by the four-compartment model shown in Figure 2.5. The four compartments correspond to leaves, debris, soil, and wood. The intercompartmental flow dynamics are such that leaves fall and contribute to forest debris, which in turn decomposes into soil. The cycle is completed as the nutrients from the soil are converted into wood and leaves. Input and output flows of the system can enter and exit primarily to and from the soil compartment. Thus, with xi , i = 1, 2, 3, 4, denoting potassium concentrations in the ith compartment and assuming that the inputs u are balanced by the system outflows, that is, u = a33 x3 , a mass balance of the four-state compartment model yields (2.35) with x = [x1 , x2 , x3 , x4 ]T and −a21 0 0 a14 a21 −a32 0 0 . A= 0 a32 −a43 0 0 0 a43 −a14
Note that A is essentially nonnegative and singular.
Now, it follows from Proposition 2.5 that eAt ≥≥ 0 for all t ≥ 0, and hence, for every nonnegative initial value x(0) the solution x(t) = eAt x(0) is nonnegative for all t ≥ 0. Furthermore, since A is a singular matrix it follows that the set of equilibria for this system is given by E = N (A) = 4 {(x1 , x2 , x3 , x4 ) ∈ R+ : x1 = aa14 x4 , x2 = aa14 x4 , x3 = aa14 x4 }. Finally, taking 21 32 43 T p = e >> 0 and r = [0, 0, 0, 0] it follows by ii) of Theorem 2.11 that the forest ecosystem is semistable. Semistability in a living forest reflects the fact that potassium concentrations converge to Lyapunov stable (nonzero) equilibrium points determined by the initial potassium concentrations in the ecosystem. △ Example 2.5. In this and the next three examples we consider various nonlinear compartmental models for epidemiology, that is, the spread
NNBook
September 1, 2009
53
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
'
$ )
'
&
%
&
$
'
a14 x4 (t)
Compartment I leaves
'
a21 x1 (t) ?
Compartment II debris
&
%
a32 x2 (t)
Compartment IV wood 6
a43 x3 (t)
$ % $
Compartment III soil u(t) 1& % ?a33 x3 (t)
Figure 2.5 Compartmental model of potassium flow in a forest.
of epidemics. There are several such models in the literature and in this and the next three examples we consider the Susceptible-Infected (SI) model [157], the Susceptible-Infected-Removed (SIR) model [155], the Susceptible-Infected-Susceptible (SIS) model [157], and the SusceptibleInfected-Recovered-Susceptible (SIRS) model [301]. The Susceptible-Infected (SI) model is shown in Figure 2.6 and is given by cβ x2 (t)x1 (t) − µx1 (t) + u(t), x1 (0) = x01 , N cβ x˙ 2 (t) = x2 (t)x1 (t) − (k + µ)x2 (t), x2 (0) = x02 , N
x˙ 1 (t) = −
t ≥ 0, (2.54) (2.55)
where x1 denotes the number of susceptibles, x2 denotes the number of infectives, µ > 0 is the background death rate coefficient, k is the additional death rate due to the disease, N is a constant denoting the total size of the population (that is, x1 (t) + x2 (t) = N ), u is the rate of recruitment of new members into the susceptible pool and, since x1 (t) + x2 (t) = N , is given by u(t) = µx1 (t) + (k + µ)x2 (t), c > 0 is the contact rate per individual, and β > 0 is the probability of transmission in a contact. Note that the nonlinear terms in (2.54) and (2.55) arise due to the fact that the rate of susceptibles becoming infected is given by the nonlinear transfer λ(x1 , x2 )x1 = cβ N x1 x2 ; that is, the product of the rate of infecteds that make contact and transmit the disease (βx2 ) and the fraction of susceptibles in the population (cx1 /N ). To analyze this model, first note that the vector field of (2.54) and (2.55) is essentially nonnegative. Furthermore, since x1 (t) + x2 (t) = N , (2.54) is superfluous and one need only consider (2.55). In addition, (2.55)
NNBook
54 -
u(t)
September 1, 2009
'
$
&
%
Compartment I x1 (t) µx1 (t) ?
λ(x1 , x2 )x1 (t)
-
CHAPTER 2
'
$
&
%
Compartment II x2 (t) µx2 (t) ?
-
kx2 (t)
Figure 2.6 SI compartmental model.
can be equivalently written as x2 (t) x˙ 2 (t) = (k + µ) α(1 − ) − 1 x2 (t), N
x2 (0) = x02 ,
t ≥ 0,
(2.56)
cβ where α , k+µ represents the basic reproduction number. Now, the set of equilibria for (2.56) is E = {x2 ∈ R+ : x˙ 2 (t) = 0} = {0} if α ≤ 1 and E = {0, N (1 − α1 )} if α > 1.
In the case where α > 1, linearizing (2.56) about the two equilibria, it follows from Theorem 2.14 that the origin of the SI model is unstable and {N (1 − α1 )} is locally asymptotically stable. Hence, in this case, there exists a stable epidemic level. Finally, we consider the case where α ≤ 1. Consider the Lyapunov function candidate V (x2 ) = x2 > 0, x2 6= 0, and note that V˙ (x2 ) = (k + µ)[α(1 − xN2 ) − 1]x2 < 0, x2 ∈ R+ , x2 6= 0. Hence, in the case where α ≤ 1, a disease introduced into the population dies out, that is, it cannot give rise to an epidemic. △ Example 2.6. The Susceptible-Infected-Removed (SIR) model is shown in Figure 2.7 and is given by x˙ 1 (t) = − Nλ x1 (t)x2 (t) − µx1 (t) + u(t), λ N x1 (t)x2 (t)
x1 (0) = x01 ,
x˙ 2 (t) = − (γ + µ)x2 (t), x2 (0) = x02 , x˙ 3 (t) = γx2 (t) − µx3 (t), x3 (0) = x03 ,
t ≥ 0, (2.57)
(2.58) (2.59)
where x1 denotes the number of susceptibles, x2 denotes the number of infectives, x3 denotes the number of immunes, µ > 0 is the death rate coefficient, N is a constant denoting the total size of the population (that is, x1 (t) + x2 (t) + x3 (t) = N ), u is the rate of recruitment of new members into the susceptible pool and is assumed to be a constant rate that just makes up for the deaths (that is, u(t) = u = µN ), γ > 0 is a rate constant for recovery, and λ > 0 is the mean contact rate per person for contacts that transmit the disease. Note that the nonlinear terms in (2.57) and (2.58) arise due to the fact that the rate of susceptibles that become infected is λx1 x2 /N ; that is, the product of the rate of infecteds that make contact and transmit the disease (λx2 ) and the fraction of susceptibles in the population (x1 /N ).
NNBook
September 1, 2009
55
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
u(t) ' ?
$
'
&
%
&
Compartment I x1 (t) µx1 (t) ?
λ x (t)x2 (t) N 1 -
Compartment II x2 (t) µx2 (t) ?
$'
γx2 (t)
-
Compartment III x3 (t)
%&
µx3 (t) ?
$ %
Figure 2.7 SIR compartmental model.
To analyze this system, first note that the vector field of (2.57)–(2.59) is essentially nonnegative. Furthermore, since x1 (t) + x2 (t) + x3 (t) = N , (2.59) is superfluous and we need only consider (2.57) and (2.58). In addition note that (2.58) can be equivalently written as hα i x˙ 2 (t) = (γ + µ) x1 (t) − 1 x2 (t), x2 (0) = x02 , (2.60) N △
where α = λ/(γ+µ) represents the number of infections that are transmitted by an infective, over the lifetime of the infection, if all contacts are with susceptibles. Now, the set of equilibria for (2.57) and (2.58) is 2 E = {(x1 , x2 ) ∈ R+ : f (x) = 0} = {(N, 0)} if α ≤ 1 and E = µN (α−1) {(N, 0), ( N )} if α > 1, where f denotes the vector field of (2.57) α, λ and (2.58).
In the case where α > 1, linearizing (2.57) and (2.58) about the two equilibria and computing the eigenvalues of the resulting Jacobian matrix, it follows from Theorem 2.14 that the equilibrium point (N, 0) of the SIR model µN (α−1) is unstable and the equilibrium point ( N ) is locally asymptotically α, λ stable. Hence, in this case, there exists a stable epidemic level. Now, we consider the case where α ≤ 1. Consider the Lyapunov function candidate V (x) = 21 (x1 − N )2 + N x2 and note that since α ≤ 1 it follows that V˙ (x) = −µ(x1 − N )2 − Nλ x2 (x1 − N )2 + N (γ + µ)(α − 1)x2 ≤ 0, 2
x ∈ R+ , which shows that the equilibrium point (N, 0) is Lyapunov stable. Now, consider the function E(x) α = x2 and note that since x1 ≤ N it follows ˙ that E(x) = (γ + µ) N x1 − 1 x2 ≤ 0. Next, using the Krasovskii-LaSalle theorem it can be shown that the largest invariant set M contained in the 2 △ ˙ = 0} is given by M = {(N, 0)}, which shows that set R = {x ∈ R+ : E(x) (N, 0) is a globally asymptotically stable equilibrium. Hence, in the case where α ≤ 1, a disease introduced into the population dies out, that is, it cannot propagate and give rise to an epidemic.
Next, we consider the case corresponding to zero death rate, that is, u = µ = 0. In this case, the system equilibria are given by E =
NNBook
September 1, 2009
56
CHAPTER 2 2
{(x1 , x2 ) ∈ R+ : x2 = 0}. First, using the Lyapunov function candidate V (x) = 21 (x1 − x1e )2 + γN λ x2 , it can be shown that every point in the 2
set Es = {(x1e , x2e ) ∈ R+ : x1e ≤ γN λ , x2e = 0} is Lyapunov stable. Alternatively, using Theorem 2.14 it can be shown that every point in 2 the set {(x1 , x2 ) ∈ R+ : x1 > γN λ , x2 = 0} is unstable. To further analyze these equilibria, consider the function E(x) = x1 + x2 and note that 2 ˙ E(x) = −γx2 ≤ 0, x ∈ R+ . Now, applying the Krasovskii-LaSalle theorem it △ can be shown that the largest invariant set M contained in the set R = {x ∈ 2 ˙ R+ : E(x) = 0} is given by M = E. Furthermore, since x1 (t) is bounded and monotonic it follows from the monotone convergence theorem [112, p. 37] 2 that limt→∞ x1 (t) exists. Hence, for every initial condition x(0) ∈ R+ , limt→∞ x(t) exists, limt→∞ x2 (t) = 0, and limt→∞ x1 (t) + x3 (t) = N . In addition, it can be shown that limt→∞ x1 (t) ≤ γN λ , which shows that every △ equilibrium point in Es is semistable. △
Example 2.7. In this example, we consider the Susceptible-InfectedSusceptible (SIS) model. In this model, a susceptible who becomes infected and recovers is then susceptible again. An example of an SIS disease is gonorrhea. The SIS model is shown in Figure 2.8 and is given by x˙ 1 (t) = − Nλ x1 (t)x2 (t) − µx1 (t) + δx2 (t) + u(t), x˙ 2 (t) =
λ N x1 (t)x2 (t)
− (δ + µ)x2 (t),
x1 (0) = x01 ,
x2 (0) = x02 ,
t ≥ 0, (2.61) (2.62)
where x1 denotes the number of susceptibles, x2 denotes the number of infectives, µ > 0 is the death rate coefficient, N is a constant denoting the total size of the population (that is, x1 (t) + x2 (t) = N ), u is the rate of recruitment of new members into the susceptible pool and is assumed to be a constant rate that just makes up for the deaths (that is, u(t) = u = µN ), λ > 0 is the mean contact rate per person for contacts that transmit the disease, and δ > 0 is a rate constant for recovery. Hence, δx2 gets fed back into the susceptible pool (Compartment I).
u(t)
'
Compartment I x1 (t) &
$ ) %
δx2 (t)
λ N x1 (t)x2 (t)
'
Compartment II x2 (t) 1&
µx1 (t) ?
$ %
µx2 (t) ?
Figure 2.8 SIS compartmental model.
To analyze this system, first note that the vector field of (2.61) and
NNBook
September 1, 2009
57
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
(2.62) is essentially nonnegative. Furthermore, since x1 (t) + x2 (t) = N , (2.61) is superfluous and we need only consider (2.62). In addition, note that (2.62) can be equivalently written as i h α x˙ 2 (t) = (δ + µ) − x2 (t) − 1 + α x2 (t), x2 (0) = x02 , (2.63) N △
where α = λ/(δ + µ). Now, the set of equilibria for (2.63) is E = {x2 ∈ R+ : f (x) = 0} = {0} if α ≤ 1 and E = {0, N (α−1) } if α > 1, where f denotes α the vector field of (2.63).
In the case where α > 1, linearizing (2.63) about the two equilibria, it follows from Theorem 2.14 that the origin of the SIS model is unstable and the equilibrium point N (α−1) is locally asymptotically stable. Hence, in this α case, there exists a stable epidemic level. Finally, we consider the case where α ≤ 1. Consider the Lyapunov function candidate V (x2 ) = x2 > 0, x2 6= 0, and note that since α ≤ 1 α it follows that V˙ (x2 ) = (δ + µ) − N x2 − 1 + α x2 < 0, x2 ∈ R+ , x2 6= 0, which shows that the origin is globally asymptotically stable. Hence, in the case where α ≤ 1, a disease introduced into the population dies out, that is, it cannot propagate and give rise to an epidemic. △ Example 2.8. In this example we consider the Susceptible-InfectedRecovered-Susceptible (SIRS) model. In this model, the recovered population can lose its immunity and again become susceptible. The SIRS model is shown in Figure 2.9 and is given by (with no death rate and no input) x˙ 1 (t) = − Nλ x1 (t)x2 (t) + δx3 (t),
x1 (0) = x01 ,
λ N x1 (t)x2 (t)
x˙ 2 (t) = − γx2 (t), x2 (0) = x02 , x˙ 3 (t) = γx2 (t) − δx3 (t), x3 (0) = x03 ,
t ≥ 0,
(2.64) (2.65) (2.66)
where x1 denotes the number of susceptibles, x2 denotes the number of infectives, x3 denotes the number of immunes, γ > 0 is a rate constant for recovery, λ > 0 is the mean contact rate per person for contacts that transmit the disease, and δ > 0 is the fraction of recovered members of the population which are not immune to the disease. '
Compartment I x1 (t)
&
6
$
'
$'
$
%
&
%&
%
λ x (t)x2 (t) N 1 -
Compartment II x2 (t) δx3 (t)
γx2 (t)
-
Compartment III x3 (t)
Figure 2.9 SIRS compartmental model.
To analyze this system, first note that the vector field of (2.64)–(2.66)
NNBook
September 1, 2009
58
CHAPTER 2
is essentially nonnegative. Furthermore, since x1 (t) + x2 (t) + x3 (t) = N , (2.66) is superfluous and we need only consider (2.64) and (2.65). In addition, note that (2.64) and (2.65) can be equivalently written as x˙ 1 (t) = − Nλ x1 (t)x2 (t) + δ(N − x1 (t) − x2 (t)), x˙ 2 (t) = γ △
hα
N
i x1 (t) − 1 x2 (t),
x1 (0) = x01 ,
x2 (0) = x02 ,
t ≥ 0, (2.67) (2.68)
where α = λ/γ. Now, the set of equilibria for (2.67) and (2.68) is 2 E = {(x1 , x2 ) ∈ R+ : f (x) = 0} = {(N, 0)} if α ≤ 1 and E = δN (α−1) {(N, 0), ( N α , α(γ+δ) )} if α > 1, where f denotes the vector field of (2.67) and (2.68). In the case where α > 1, linearizing (2.67) and (2.68) about the two equilibria and computing the eigenvalues of the resulting Jacobian matrix, it follows from Theorem 2.14 that the equilibrium point (N, 0) of δN (α−1) the SIRS model is unstable and the equilibrium point ( N α , α(γ+δ) ) is locally asymptotically stable. Hence, in this case, there exists a stable epidemic level. Finally, we consider the case where α ≤ 1. Consider the Lyapunov function candidate V (x) = 12 (x1 + x2 − N )2 + N x2 and note that since α ≤ 1 it follows that V˙ (x) = −δ(x1 + x2 − N )2 + γx2 (αx1 − x1 − x2 ) < 0, 2 x ∈ R+ , x 6= (N, 0), which shows that the equilibrium point (N, 0) is a globally asymptotically stable equilibrium. Hence, in the case where α ≤ 1, a disease introduced into the population dies out, that is, it cannot propagate and give rise to an epidemic. △ Example 2.9. One of the most classical areas in which nonnegative dynamical systems arise is population growth and predator-prey models. A classical model for two populations that interact in a predator-prey relationship without age structure in the populations is given by the LotkaVolterra equations [155] x˙ 1 (t) = αx1 (t) − βx1 (t)x2 (t), x1 (0) = x01 , t ≥ 0, x˙ 2 (t) = −γx2 (t) + δx1 (t)x2 (t), x2 (0) = x02 ,
(2.69) (2.70)
where α, β, γ, δ > 0, x1 denotes the number of prey, and x2 denotes the number of predators. Note that in the absence of predators (x2 = 0), (2.69) results in exponential growth of prey while in the absence of prey (x1 = 0), (2.70) results in exponential decay of predators. To analyze this system, first note that the vector field of (2.69) and (2.70) is essentially nonnegative. Furthermore, the set of all equilibria
NNBook
September 1, 2009
59
STABILITY THEORY FOR NONNEGATIVE SYSTEMS 2
of (2.69) and (2.70) is given by E = {(x1 , x2 ) ∈ R+ : f (x) = 0} = {(0, 0), ( γδ , αβ )}, where f denotes the vector field of (2.69) and (2.70). Now, linearizing (2.69) and (2.70) about the origin, it follows from ii) of Theorem 2.14 that the origin is unstable. To analyze the stability of the equilibrium xe = ( γδ , αβ ) define E(x) , 2 ˙ = 0 for all x ∈ R+ . Now, δx1 + βx2 − γln x1 − αln x2 and note that E(x) since xe is the only singular point in R2+ , E ′ (xe ) = 0, and E ′′ (xe ) > 0, it 2 follows that ( γδ , αβ ) is a local minimizer of E(x). Since E ′′ (x) > 0, x ∈ R+ , it follows that E(x) is convex, and hence, xe is a global minimizer. Next, using the Lyapunov function candidate V (x) = E(x)−E(xe ) with V (xe ) = 0 2 and V (x) > 0, x ∈ R+ \{xe }, it follows that V˙ (x) = 0, x ∈ R2+ , which shows that the equilibrium point ( γδ , αβ ) is Lyapunov stable. However, this point is neither asymptotically stable nor semistable. To see this, since 2 △ E(·) is locally convex at xe , it follows that the set S = {(x1 , x2 ) ∈ R+ : E(x1 , x2 ) = E(x01 , x02 )} is a closed curve for all (x01 , x02 ) sufficiently close to the equilibrium xe . Hence, since xe is the only equilibrium point in R2+ , the trajectory starting from all (x01 , x02 ) in the neighborhood of xe remains △ in S, which shows that S is a periodic orbit. Example 2.10. In this example, we consider a pharmacokinetic and pharmacodynamic model for clinical anesthesia. Almost all anesthetics are myocardial depressants which lower cardiac output (i.e., the amount of blood pumped by the heart per unit time). As a consequence, decreased cardiac output slows down redistribution kinetics, that is, the transfer of blood from the central compartments (heart, brain, kidney, and liver) to peripheral compartments (muscle and fat). In addition, decreased cardiac output could increase drug concentrations in the central compartments, causing even more myocardial depression and further decrease in cardiac output. To study the effects of pharmacological agents and anesthetics we propose the two-compartment model shown in Figure 2.10, where x1 denotes the drug concentration in the central compartment, which is the site for drug administration and is generally thought to be comprised of the intravascular blood volume as well as highly perfused organs such as the heart, brain, kidney, and liver. These organs receive a large fraction of the cardiac output. The state x2 is the concentration of drug in the peripheral compartment, comprised of muscle and fat, which receive a smaller proportion of the cardiac output.
NNBook
September 1, 2009
60
CHAPTER 2
'
6
u- Compartment I x1 (t) &
$
Ke (x1 (t))x1 (t)
6
%
k1 (x1 (t))x1 (t)
k2 (x1 (t))x2 (t)
-
'
$
&
%
Compartment II x2 (t)
Figure 2.10 Pharmacokinetic model for drug distribution during anesthesia.
A concentration balance of the two-state compartment model yields x˙ 1 (t) = −k1 (x1 (t))x1 (t) − Ke (x1 (t))x1 (t) + k2 (x1 (t))x2 (t), x1 (0) = x01 , t ≥ 0, x˙ 2 (t) = k1 (x1 (t))x1 (t) − k2 (x1 (t))x2 (t), x2 (0) = x02 ,
(2.71) (2.72)
where k1 (x1 ) is the rate of transfer of drug from Compartment I to Compartment II, k2 (x1 ) is the rate of transfer of drug from Compartment II to Compartment I, and Ke (x1 ) is the rate of drug metabolism and elimination (metabolism typically occurs in the liver). In this model we assume that each of these rate constants is proportional to the cardiac output. This reflects the fact that the drug transfer from the central compartment to the peripheral compartment (or the reverse) requires physical transport via the bloodstream from the heart, brain, etc., to muscle and fat (or the reverse). It is generally assumed that this transport in the vascular tree will be proportional to the cardiac output Q(x1 ). Furthermore, for many drugs the rate of metabolism (i.e., Ke (x1 )) will be proportional to the rate of transport of drug to the liver, and hence, we assume that Ke (x1 ) is also proportional to the cardiac output. Thus, we assume k1 (x1 ) = A1 Q(x1 ), k2 (x1 ) = A2 Q(x1 ), and Ke (x1 ) = Ae Q(x1 ), where A1 , A2 , and Ae are positive constants. Finally, since many anesthetics depress the heart, and thus decrease the cardiac output, the pharmacodynamic effects are almost universally described by a sigmoid relationship between drug concentration and effect, so that α Q0 C50 Q(x1 ) = (2.73) α + xα ) , (C50 1 where the effect is related to x1 (since that is the presumed concentration in the highly perfused myocardium), Q0 > 0 is a constant, C50 > 0 is the drug concentration associated with a 50% decrease in the cardiac output, and α > 1 determines the steepness of this curve (that is, how rapidly the cardiac output decreases with increasing drug concentration x1 ). Furthermore, this model assumes instantaneous mixing, and as x1 increases the rate constants decrease through their dependence on the cardiac output.
NNBook
September 1, 2009
61
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
To analyze this system, first note that the vector field f (x) of (2.71) and (2.71) is essentially nonnegative. Furthermore, the set of equilibria of 2 (2.71) and (2.71) is given by E = {(x1 , x2 ) ∈ R+ : f (x) = 0} = {(0, 0)}. To study the stability of the pharmacokinetic and pharmacodynamic system (2.71) and (2.71), consider the Lyapunov function candidate V (x) = x1 + x2 α 2 Ae Q0 C50 and note that V˙ (x) = x˙ 1 + x˙ 2 = (C α α x1 ≤ 0, (x1 , x2 ) ∈ R+ , which 50 +x1 ) implies that the origin is Lyapunov stable. Next, since the pharmacokinetic and pharmacodynamic system (2.71) and (2.71) is Lipschitz continuous, it △ follows that the largest invariant set M contained in the set R = {(x1 , x2 ) ∈ R+ × R+ : V˙ (x1 , x2 ) = 0} = {(x1 , x2 ) ∈ R+ × R+ : x1 = 0} is given by M = {0, 0}. Hence, it follows from the Krasovskii-LaSalle theorem that (x1 (t), x2 (t)) → M = {0, 0} as t → ∞, establishing global asymptotic stability of (2.71) and (2.71). △
2.8 Discrete-Time Lyapunov Stability Theory for Nonnegative Dynamical Systems Even though numerous results on continuous-time compartmental systems and, to a lesser extent, nonnegative systems have been developed in the literature (see [4, 20, 29, 88, 100, 111, 113, 155, 158, 209, 211, 220, 230, 233, 259], and the references therein), the development of discrete-time nonnegative and compartmental systems theory has received far less attention. In the remainder of this chapter, we develop several basic mathematical results on the stability of discrete-time linear and nonlinear nonnegative dynamical systems. In addition, using linear Lyapunov functions, we develop necessary and sufficient conditions for Lyapunov stability and asymptotic stability for linear nonnegative dynamical systems. The consideration of a linear Lyapunov function leads to a new Lyapunov-like equation for examining the stability of linear nonnegative systems. This Lyapunov-like equation is analyzed using nonnegative matrix theory [21, 145]. As in the continuoustime case, the motivation for using a linear Lyapunov function follows from the fact that the state of a nonnegative dynamical system is nonnegative, and hence, a linear Lyapunov function is a valid Lyapunov function candidate. This considerably simplifies the stability analysis of nonnegative dynamical systems. We begin by considering the general discrete-time nonlinear dynamical system x(k + 1) = f (x(k)),
x(0) = x0 ,
k ∈ Z+ ,
(2.74)
where x(k) ∈ D ⊆ Rn , k ∈ Z+ , is the system state vector, D is a relatively open set, and f : D → Rn . Furthermore, we denote the solution to (2.74) with initial condition x(0) = x0 by s(·, x0 ), so that the map of
NNBook
September 1, 2009
62
CHAPTER 2
the dynamical system given by s : Z+ × D → D is continuous on D and satisfies the consistency property s(0, x0 ) = x0 and the semigroup property s(κ, s(k, x0 )) = s(k + κ, x0 ), for all x0 ∈ D and k, κ ∈ Z+ . For discretetime systems we use the notation s(k, x0 ), k ∈ Z+ , and x(k), k ∈ Z+ , interchangeably as the solution of the nonlinear discrete-time system (2.74) with initial condition x(0) = x0 . Unless otherwise stated, we assume f (·) is continuous on D. Furthermore, xe ∈ D is an equilibrium point of (2.74) if and only if f (xe ) = xe . The following definition introduces the notion of nonnegative vector fields. n
Definition 2.13. Let f = [f1 , . . . , fn ]T : D ⊆ R+ → Rn . Then f is n nonnegative if f (x) ≥≥ 0 for all x ∈ R+ . n
The following proposition shows that R+ is an invariant set of (2.74) if and only if f is nonnegative. n
n
Proposition 2.11. Suppose R+ ⊂ D. Then R+ is an invariant set with respect to (2.74) if and only if f : D → Rn is nonnegative. n
Proof. Suppose f : D → Rn is nonnegative and let x(0) ∈ R+ . Then, for every i ∈ {1, . . . , n} it follows that xi (k+1) = fi (x(k)) ≥ 0. Thus, x(k) ∈ n n n R+ , k ∈ Z+ . Conversely, suppose x(k) ∈ R+ , k ∈ Z+ , for all x(0) ∈ R+ n and assume, ad absurdum, that there exists i ∈ {1, . . . , n} and x0 ∈ R+ such that fi (x0 ) < 0. In this case, with x(0) = x0 , xi (1) = fi (x(0)) = fi (x0 ) < 0, which is a contradiction. It follows from Proposition 2.11 that if x0 ≥≥ 0, then x(k) ≥≥ 0, k ∈ Z+ , if and only if f is nonnegative. In this case, we say that (2.74) is a discrete-time nonnegative dynamical system. Henceforth, in this monograph, we assume that f is nonnegative so that the discrete-time nonlinear dynamical system (2.74) is a nonnegative dynamical system. The following definition introduces several types of stability corresponding to the equilibrium solution x(k) ≡ xe of the discrete-time system (2.74). Definition 2.14. i) The equilibrium solution x(k) ≡ xe to (2.74) is n Lyapunov stable with respect to R+ if, for all ε > 0, there exists δ = δ(ε) > 0 n n such that if x0 ∈ Bδ (xe ) ∩ R+ , then x(k) ∈ Bε (xe ) ∩ R+ , k ∈ Z+ . ii) The equilibrium solution x(k) ≡ xe to (2.74) is (locally) asymptotn n ically stable with respect to R+ if it is Lyapunov stable with respect to R+ n and there exists δ > 0 such that if x0 ∈ Bδ (xe )∩R+ , then limk→∞ x(k) = xe .
NNBook
September 1, 2009
63
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
iii) The equilibrium solution x(k) ≡ xe to (2.74) is globally asymptotn n ically stable with respect to R+ if it is Lyapunov stable with respect to R+ n and, for all x(0) ∈ R+ , limk→∞ x(k) = xe . The following result gives sufficient conditions for Lyapunov and asymptotic stability of a discrete-time nonlinear dynamical system. n
Theorem 2.16. Let D be a relatively open subset of R+ that contains xe . Consider the discrete-time nonlinear dynamical system (2.74) where f is nonnegative and f (xe ) = xe , and assume that there exists a continuous function V : D → R such that V (xe ) = 0, V (x) > 0, V (f (x)) − V (x) ≤ 0,
x ∈ D, x ∈ D.
(2.75) (2.76) (2.77)
x 6= xe ,
Then the equilibrium solution x(k) ≡ xe to (2.74) is Lyapunov stable with n respect to R+ . If, in addition, V (f (x)) − V (x) < 0,
x ∈ D,
x 6= xe ,
(2.78)
then the equilibrium solution x(k) ≡ xe to (2.74) is asymptotically stable n with respect to R+ . Finally, if V (·) is such that V (x) → ∞ as kxk → ∞,
(2.79)
then (2.78) implies that the equilibrium solution x(k) ≡ xe to (2.74) is n globally asymptotically stable with respect to R+ . n
n
Proof. Let ε > 0 be such that Bε (xe ) ∩ R+ ⊆ D. Since R+ ∩ B ε (xe ) is compact and f (x), x ∈ D, is continuous, it follows that ( ) △
η = max ε,
max n
x∈R+ ∩Bε (xe )
△
kf (x) − xe k
(2.80)
exists. Next, let α = minx∈D: ε≤kxk≤η V (x). Note α > 0 since xe 6∈ ∂Bε (xe ) △ and V (x) > 0, x ∈ D, x 6= xe . Next, let β ∈ (0, α) and define Dβ = {x ∈ n R+ ∩ Bε (xe ) : V (x) ≤ β}. Now, for every x ∈ Dβ , it follows from (2.77) that V (f (x)) ≤ V (x) ≤ β, and hence, it follows from (2.80) that kf (x) − xek ≤ η, x ∈ Dβ . Next, suppose, ad absurdum, that there exists x ∈ Dβ such that kf (x) − xe k ≥ ε. This implies V (x) ≥ α, which is a contradiction. Hence, n since f is nonnegative, for every x ∈ Dβ it follows that f (x) ∈ R+ ∩Bε (xe ) ⊂ Dβ , which implies that Dβ is a positively invariant set (see Definition 2.16) with respect to (2.74). Next, since V (·) is continuous and V (xe ) = 0, there n exists δ = δ(ε) ∈ (0, ε) such that V (x) < β, x ∈ R+ ∩ Bδ (xe ). Now, let n n x(k), k ∈ Z+ , satisfy (2.74). Since R+ ∩ Bδ (xe ) ⊂ Dβ ⊂ R+ ∩ Bε (xe ) ⊆ D and Dβ is positively invariant with respect to (2.74) it follows that for all
NNBook
September 1, 2009
64
CHAPTER 2 n
n
x(0) ∈ Bδ (xe ) ∩ R+ , x(k) ∈ Bε (xe ) ∩ R+ , k ∈ Z+ , which proves Lyapunov n stability of xe with respect to R+ . n
To prove asymptotic stability with respect to R+ , suppose that n V (f (x)) < V (x), x ∈ D, x 6= xe , and x(0) ∈ Bδ (xe ) ∩ R+ . Then it n follows that x(k) ∈ Bε (xe ) ∩ R+ , k ∈ Z+ . However, V (x(k)), k ∈ Z+ , is decreasing and bounded from below by zero. Now, suppose, ad absurdum, that x(k), k ∈ Z+ , does not converge to xe . This implies that V (x(k)), k ∈ Z+ , is lower bounded by a positive number, that is, there exists L > 0 such that V (x(k)) ≥ L > 0, k ∈ Z+ . Hence, by continuity of V (x), n x ∈ D, there exists δ′ > 0 such that V (x) < L for x ∈ Bδ′ (xe ) ∩ R+ , n which further implies that x(k) 6∈ Bδ′ (xe ) ∩ R+ , k ∈ Z+ . Next, let n △ L1 = min{V (x) − V (f (x)) : δ′ ≤ kx − xe k ≤ ε, x ∈ R+ }. Now, (2.78) n implies V (x) − V (f (x)) ≥ L1 , δ′ ≤ kx − xe k ≤ ε, , x ∈ R+ , or, equivalently, V (x(k)) − V (x(0)) = n
k−1 X i=0
[V (f (x(i))) − V (x(i))] ≤ −L1 k,
and hence, for all x(0) ∈ R+ ∩ Bδ (xe ), V (x(k)) ≤ V (x(0)) − L1 k.
, it follows that V (x(k)) < L, which is a contradiction. Letting k > V (x(0))−L L1 Hence, x(k) → xe as k → ∞, establishing asymptotic stability with respect n to R+ . Finally, to prove global asymptotic stability with respect to R+ , let n △ x0 ∈ R+ , and let β = V (x0 ). Now, the radial unboundedness condition (2.79) implies that there exists ε > 0 such that V (x) ≥ β for kx − xe k ≥ ε, x ∈ Rn . Hence, since f is nonnegative it follows from (2.78) that V (x(k)) ≤ n V (x(0)) = β, k ∈ Z+ , which implies that x(k) ∈ R+ ∩ Bε(xe ), k ∈ Z+ . Now, the proof follows as in the proof of the local result. A continuous function V (·) satisfying (2.75) and (2.76) is called a Lyapunov function candidate for the discrete-time nonlinear dynamical system (2.74). If, additionally, V (·) satisfies (2.77), V (·) is called a Lyapunov function for the discrete-time nonlinear dynamical system (2.74).
2.9 Discrete-Time Invariant Set Theorems and Semistability Theorems In this section, we use the discrete-time Krasovskii-LaSalle invariance principle to relax one of the conditions on the Lyapunov function V (·) in the theorems given in Section 2.8. In particular, the strict negative-
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
65
definiteness condition on the Lyapunov difference can be relaxed while ensuring system asymptotic stability. To state the main results of this section several definitions and a key lemma analogous to the ones given in Section 2.3 are needed. Definition 2.15. The trajectory x(k), k ∈ Z+ , of (2.74) is bounded if there exists γ > 0 such that kx(k)k < γ, k ∈ Z+ . Definition 2.16. A set M ⊂ D ⊆ Rn is a positively invariant set for the nonlinear dynamical system (2.74) if sk (M) ⊆ M, for all k ∈ Z+ , where △ sk (M) = {sk (x) : x ∈ M}. A set M ⊆ D ⊆ Rn is an invariant set for the dynamical system (2.74) if sk (M) = M for all k ∈ Z+ . Definition 2.17. A point p ∈ D is a positive limit point of the trajectory x(k), k ∈ Z+ , of (2.74) if there exists a monotonic sequence {kn }∞ n=0 of nonnegative numbers, with kn → ∞ as n → ∞, such that x(kn ) → p as n → ∞. The set of all positive limit points of x(k), k ∈ Z+ , is the positive limit set ω(x0 ) of x(k), k ∈ Z+ . Note that if p ∈ D is a positive limit point of the trajectory x(·), then, for all ε > 0 and finite K ∈ Z+ , there exists k > K such that kx(k) − pk < ε. This follows from the fact that kx(k) − pk < ε for all ε > 0 and some k > K > 0 is equivalent to the existence of a sequence of integers {kn }∞ n=0 , with kn → ∞ as n → ∞, such that x(kn ) → p as n → ∞. Next, we state and prove a key lemma involving positive limit sets for discrete-time systems. Lemma 2.5. Consider the nonlinear dynamical system (2.74) where f is nonnegative. Suppose the solution x(k) to (2.74) corresponding to an initial condition x(0) = x0 is bounded for all k ∈ Z+ . Then the positive limit set ω(x0 ) of x(k), k ∈ Z+ , is a nonempty, compact, invariant subset of n R+ . Furthermore, x(k) → ω(x0 ) as k → ∞. Proof. Let x(k), k ∈ Z+ , denote the solution to (2.74) corresponding to the initial condition x(0) = x0 . Next, since x(k) is bounded for all k ∈ Z+ , it follows from the Bolzano-Weierstrass theorem [112, p. 27] that △ every sequence in the positive orbit Ox+0 = {s(k, x0 ) : k ∈ Z+ } has at least one accumulation point p ∈ D as k → ∞, and hence, ω(x0 ) is nonempty. Next, let p ∈ ω(x0 ) so that there exists an increasing unbounded sequence {kn }∞ n=0 , with k0 = 0, such that limn→∞ x(kn ) = p. Now, since x(kn ) is uniformly bounded in n it follows that the limit point p is bounded, which implies that ω(x0 ) is bounded. To show that ω(x0 ) is closed let {pi }∞ i=0 be a sequence contained in ω(x0 ) such that limi→∞ pi = p. Now, since pi → p as
NNBook
September 1, 2009
66
CHAPTER 2
i → ∞ for every ε > 0, there exists i such that kp − pi k < ε/2. Next, since pi ∈ ω(x0 ), there exists k ≥ K, where K ∈ Z+ is arbitrary and finite, such that kpi − x(k)k < ε/2. Now, since kp − pi k < ε/2 and kpi − x(k)k < ε/2, k ≥ K, it follows that kp − x(k)k ≤ kpi − x(k)k + kp − pi k < ε. Thus, p ∈ ω(x0 ). Hence, every accumulation point of ω(x0 ) is an element of ω(x0 ) so that ω(x0 ) is closed. Thus, since ω(x0 ) is closed and bounded, ω(x0 ) is compact. To show positive invariance of ω(x0 ) let p ∈ ω(x0 ) so that there exists an increasing sequence {kn }∞ n=0 such that x(kn ) → p as n → ∞. Now, let s(kn , x0 ) denote the solution x(kn ) of (2.74) with initial condition x(0) = x0 and note that, since f : D → D in (2.74) is continuous, x(k), k ∈ Z+ , is the unique solution to (2.74) so that s(k +kn , x0 ) = s(k, s(kn , x0 )) = s(k, x(kn )). Now, since s(k, x0 ), k ∈ Z+ , is continuous with respect to x0 , it follows that, for k + kn ≥ 0, limn→∞ s(k + kn , x0 ) = limn→∞ s(k, x(kn )) = s(k, p), and hence, s(k, p) ∈ ω(x0 ). Hence, sk (ω(x0 )) ⊆ ω(x0 ), k ∈ Z+ , establishing positive invariance of ω(x0 ). To show invariance of ω(x0 ) let y ∈ ω(x0 ) so that there exists an increasing unbounded sequence {kn }∞ n=0 such that s(kn , x0 ) → y as n → ∞. Next, let k ∈ Z+ and note that there exists N such that kn > k, n ≥ N . Hence, it follows from the semigroup property that s(k, s(kn − k, x0 )) = s(kn , x0 ) → y as n → ∞. Now, it follows from the Bolzano-Lebesgue theorem [112, p. 28] that there exists a subsequence zni of the sequence zn = s(kn −k, x0 ), n = N, N +1, . . ., such that zni → z ∈ D and, by definition, z ∈ ω(x0 ). Next, it follows from the continuous dependence property that limi→∞ s(k, zni ) = s(k, limi→∞ zni ), and hence, y = s(t, z), which implies that ω(x0 ) ⊆ sk (ω(x0 )), k ∈ Z+ . Now, using positive invariance of ω(x0 ) it follows that sk (ω(x0 )) = ω(x0 ), k ∈ Z+ , establishing invariance of the positive limit set ω(x0 ). Finally, to show x(k) → ω(x0 ) as k → ∞, suppose, ad absurdum, that x(k) 6→ ω(x0 ) as k → ∞. In this case, there exists a sequence {kn }∞ n=0 , with kn → ∞ as n → ∞, such that inf
p∈ω(x0 )
kx(kn ) − pk > ε,
n ∈ Z+ .
(2.81)
However, since x(k), k ∈ Z+ , is bounded, the bounded sequence {x(kn )}∞ n=0 ∗ ∗ contains a convergent subsequence {x(kn∗ )}∞ n=0 such that x(kn ) → p ∈ ω(x0 ) as n → ∞, which contradicts (2.81). Hence, x(k) → ω(x0 ) as k → ∞ and, n since f is nonnegative, ω(x0 ) ⊆ R+ . Next, we present a discrete-time version of the Krasovskii-LaSalle invariance principle.
NNBook
September 1, 2009
67
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
Theorem 2.17. Consider the discrete-time nonlinear dynamical sysn tem (2.74) where f is nonnegative, assume Dc ⊂ D ⊆ R+ is a compact invariant set with respect to (2.74), and assume that there exists a continuous function V : Dc → R such that V (f (x)) − V (x) ≤ 0, x ∈ Dc . Let △ R = {x ∈ Dc : V (f (x)) = V (x)} and let M denote the largest invariant set contained in R. If x(0) ∈ Dc , then x(k) → M as k → ∞. Proof. Let x(k), k ∈ Z+ , be a solution to (2.74) with x(0) ∈ Dc . Since V (f (x)) ≤ V (x), x ∈ Dc , it follows that V (x(k)) − V (x(κ)) =
k−1 X i=κ
[V (f (x(i))) − V (x(i))] ≤ 0,
k − 1 ≥ κ,
and hence, V (x(k)) ≤ V (x(κ)), k − 1 ≥ κ, which implies that V (x(k)) is a nonincreasing function of k. Next, since V (x) is continuous on the compact set Dc , there exists L ≥ 0 such that V (x) ≥ L, x ∈ Dc . Hence, △ γx0 = limk→∞ V (x(k)) exists. Now, for all p ∈ ω(x0 ) there exists an increasing unbounded sequence {kn }∞ n=0 , with k0 = 0, such that x(kn ) → p as n → ∞. Since V (x), x ∈ D, is continuous, V (p) = V (limn→∞ x(kn )) = limn→∞ V (x(kn )) = γx0 , and hence, V (x) = α on ω(x0 ). Now, since Dc is compact and invariant it follows that x(k), k ∈ Z+ , is bounded, and hence, it follows from Lemma 2.5 that ω(x0 ) is a nonempty, compact invariant set. Hence, it follows that V (f (x)) = V (x) on ω(x0 ), and hence, ω(x0 ) ⊂ M ⊂ R ⊂ Dc . Finally, since x(k) → ω(x0 ) as k → ∞ it follows that x(k) → M as k → ∞. Now, using Theorem 2.17 we provide a generalization of Theorem 2.16 for local asymptotic stability of a nonlinear dynamical system. Corollary 2.2. Consider the nonlinear dynamical system (2.74) where n f is nonnegative, assume Dc ⊂ D ⊆ R+ is a compact invariant set with respect to (2.74) such that xe ∈ Dc , and assume that there exists a continuous function V : Dc → R such that V (xe ) = 0, V (x) > 0, x 6= xe , and V (f (x)) − V (x) ≤ 0, x ∈ Dc . Furthermore, assume that the set △ R = {x ∈ Dc : V (f (x)) = V (x)} contains no invariant set other than the set {xe }. Then the equilibrium solution x(k) ≡ xe to (2.74) is asymptotically n stable with respect to R+ . Proof. The result is a direct consequence of Theorem 2.17. In Theorem 2.17 and Corollary 2.2 we explicitly assumed that there n exists a compact invariant set Dc ⊂ D ⊆ R+ of (2.74). Next, we provide a result that does not require the existence of a compact invariant set Dc .
NNBook
September 1, 2009
68
CHAPTER 2
Theorem 2.18. Consider the nonlinear dynamical system (2.74) where f is nonnegative and assume that there exists a continuous function n V : R+ → R such that V (xe ) = 0, V (x) > 0, V (f (x)) − V (x) ≤ 0,
x∈
x∈
n R+ , n R+ .
(2.82) (2.83)
x 6= xe ,
(2.84)
Let R = {x ∈ Rn : V (f (x)) = V (x)} and let M be the largest invariant set contained in R. Then all solutions x(k), k ∈ Z+ , to (2.74) that are bounded approach M as k → ∞. △
n
Proof. Let x ∈ R+ be such that trajectory s(k, x), k ∈ Z+ , of (2.74) n is bounded. Since f is nonnegative it follows that s(k, x) ∈ R+ , k ∈ Z+ . Now, with Dc = Ox+ , it follows from Theorem 2.17 that s(k, x) → M as k → ∞. Next, we present the global invariant set theorem for guaranteeing global asymptotic stability of a discrete-time nonlinear dynamical system. Theorem 2.19. Consider the nonlinear dynamical system (2.74) where n f is nonnegative and assume that there exists a continuous function V : R+ → R such that V (xe ) = 0, V (x) > 0,
x∈
n R+ , n R+ ,
(2.85) (2.86)
x 6= xe ,
V (f (x)) − V (x) ≤ 0, x ∈ V (x) → ∞ as kxk → ∞.
(2.87) (2.88)
△
Furthermore, assume that the set R = {x ∈ D: V (f (x)) = V (x)} contains no invariant set other than the set {xe }. Then the equilibrium solution n x(k) ≡ xe to (2.74) is globally asymptotically stable with respect to R+ . Proof. Since (2.85)–(2.87) hold, it follows from Theorem 2.16 that the equilibrium solution x(k) ≡ xe to (2.74) is Lyapunov stable, while the radial unboundedness condition (2.88) implies that all solutions to (2.74) are bounded. Now, Theorem 2.18 implies that x(k) → M as k → ∞. However, since R contains no invariant set other than the set {xe }, the set M is {xe }, and hence, global asymptotic stability is immediate. Finally, we introduce the notion of semistability for discrete-time nonnegative dynamical systems. n
Definition 2.18. An equilibrium solution x(k) ≡ xe ∈ R+ to (2.74) is
NNBook
September 1, 2009
69
STABILITY THEORY FOR NONNEGATIVE SYSTEMS n
n
semistable with respect to R+ if it is Lyapunov stable with respect to R+ and n there exists δ > 0 such that if x0 ∈ Bδ (xe )∩R+ , then limk→∞ x(k) exists and n corresponds to a Lyapunov stable equilibrium point with respect to R+ . An n equilibrium point xe ∈ R is a globally semistable equilibrium with respect n n n to R+ if it is Lyapunov stable with respect to R+ and, for every x0 ∈ R+ , limk→∞ x(k) exists and corresponds to a Lyapunov stable equilibrium point n with respect to R+ . The system (2.74) is said to be Lyapunov stable with n respect to R+ if every equilibrium point of (2.74) is Lyapunov stable with n respect to R+ . The system (2.74) is said to be semistable with respect to n n R+ if every equilibrium point of (2.74) is semistable with respect to R+ . n Finally, (2.74) is said to be globally semistable with respect to R+ if every n equilibrium point of (2.74) is globally semistable with respect to R+ . n
Theorem 2.20. Let Dc ⊂ R+ be a compact invariant set with respect to (2.74). Suppose there exists a continuous function V : Dc → R such that V (f (x)) − V (x) ≤ 0, x ∈ Dc . Let R , {x ∈ Dc : V (f (x)) = V (x)} and let M denote the largest invariant set contained in R. If every element in M is a Lyapunov stable equilibrium point with respect to Dc , then (2.74) is semistable with respect to Dc . Proof. Since every solution of (2.74) is bounded, it follows from the hypotheses on V (·) that, for every x ∈ Dc , the positive limit set ω(x) of (2.74) is nonempty and contained in the largest invariant subset M of R. Since every point in M is a Lyapunov stable equilibrium point, it follows that every point in ω(x) is a Lyapunov stable equilibrium point. Next, let z ∈ ω(x) and let Uε be a relatively open neighborhood of z. By Lyapunov stability of z, it follows that there exists a relatively open n n subset Uδ containing z such that sk (Uδ ∩ R+ ) ⊆ Uε ∩ R+ for every k ≥ k0 . n Since z ∈ ω(x), it follows that there exists h ≥ 0 such that s(h, x) ∈ Uδ ∩ R+ . n n Thus, s(k + h, x) = sk (s(h, x)) ∈ sk (Uδ ∩ R+ ) ⊆ Uε ∩ R+ for every k > k0 . Hence, since Uε was chosen arbitrarily, it follows that z = limk→∞ s(k, x). Now, it follows that limi→∞ s(ki , x) → z for every divergent sequence {ki }, and hence, ω(x) = {z}. Finally, since limk→∞ s(k, x) ∈ M is Lyapunov stable for every x ∈ Dc , it follows from the definition of semistability that every equilibrium point in M is semistable.
2.10 Stability Theory for Discrete-Time Linear Nonnegative Dynamical Systems In this section, we provide necessary and sufficient conditions for stability of linear discrete-time nonnegative dynamical systems. First, however, we
NNBook
September 1, 2009
70
CHAPTER 2
introduce several definitions and some key results concerning nonnegative matrices [21, 22, 145, 218] that are necessary for developing the main results of this section. n×n . Then A is (discrete-time) compartDefinition 2.19. Let A ∈ PR n mental if A is nonnegative and i=1 A(i,j) ≤ 1, j = 1, . . . , n, or, equivalently, eT (A − In ) ≤≤ 0.
Definition 2.20. A real function u : Z+ → Rm is a nonnegative (resp., positive) function if u(k) ≥≥ 0 (resp., u(k) >> 0), k ∈ Z+ . The following lemma is needed for developing several stability results of this monograph. Lemma 2.6. Let A ∈ Rn×n be nonnegative. statements are equivalent:
Then the following
i ) I − A is an M-matrix. ii ) ρ(A) ≤ 1. Furthermore, the following statements are equivalent: iii ) I − A is a nonsingular M-matrix.
iv ) det(I − A) 6= 0 and (I − A)−1 ≥≥ 0.
v ) For each y ∈ Rn , y ≥≥ 0, there exists a unique x ∈ Rn , x ≥≥ 0, such that (I − A)x = y.
vi ) There exists x ∈ Rn , x ≥≥ 0, such that x >> Ax.
vii ) There exists x ∈ Rn , x >> 0, such that x >> Ax. Proof. Since A ≥≥ 0 it follows from Theorem 2.9 that ρ(A) ∈ spec(A), and hence, ρ(A) = max{Re λ : λ ∈ spec(A)}. The equivalence of i) and ii) follows by noting that I − A is an M-matrix if and only if Re λ ≤ 1 for all λ ∈ spec(A) or, equivalently, max{Re λ : λ ∈ spec(A)} ≤ 1. The equivalence of statements iii)–vii) follows from v)–ix) of Lemma 2.2 with A replaced by I − A. Note that if f (x) = Ax, where A ∈ Rn×n , then f is nonnegative if and only if A is nonnegative. To address discrete-time linear nonnegative dynamical systems, consider (2.74) with f (x) = Ax so that x(k + 1) = Ax(k),
x(0) = x0 ,
k ∈ Z+ ,
(2.89)
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
71
where x(k) ∈ Rn , k ∈ Z+ , and A ∈ Rn×n . Since the solution to (2.35) is given by x(k) = Ak x0 it follows that x(k) ≥≥ 0, k ∈ Z+ , if and only if A is nonnegative. Henceforth, we assume that A is nonnegative. Definition 2.21. Let A ∈ Rn×n . Then: i ) A is (discrete-time) Lyapunov stable if spec(A) ⊂ {z ∈ C : |z| ≤ 1} and, if λ ∈ spec(A) and |λ| = 1, then λ is semisimple. ii ) A is (discrete-time) semistable if spec(A) ⊂ {z ∈ C : |z| < 1} ∪ {1} and, if 1 ∈ spec(A), then 1 is semisimple. iii ) A is (discrete-time) asymptotically stable or Schur if spec(A) ⊂ {z ∈ C : |z| < 1}. The following proposition concerning Lyapunov stability, semistability, and asymptotic stability of (2.89) is immediate. This result holds whether or not A is a nonnegative matrix. Proposition 2.12 ([23]). Let A ∈ Rn×n and consider the linear discrete-time dynamical system (2.89). Then the following statements are equivalent: i ) A is Lyapunov stable. ii ) For every initial condition x(0) ∈ Rn , the sequence {kx(k)k}∞ k=1 is bounded, where k · k is a vector norm on Rn . iii) For every initial condition x(0) ∈ Rn , the sequence {kAk x(0)k}∞ k=1 is bounded, where k · k is a vector norm on Rn . iv ) The sequence {kAk k}∞ k=1 is bounded, where k · k is a matrix norm on Rn×n . The following statements are equivalent: v ) A is semistable. vi ) limk→∞ Ak exists. In fact, limk→∞ Ak = I − (I − A)# (I − A). vii ) For every initial condition x(0) ∈ Rn , limk→∞ x(k) exists. The following statements are equivalent:
NNBook
September 1, 2009
72
CHAPTER 2
viii ) A is asymptotically stable. ix ) ρ(A) < 1. x ) For every initial condition x(0) ∈ Rn , limk→∞ x(k) = 0. xi ) For every initial condition x(0) ∈ Rn , limk→∞ Ak x(0) = 0. xii ) limk→∞ Ak = 0. The following theorem gives several properties of a discrete-time nonnegative dynamical system when a Lyapunov-like equation is satisfied for (2.89). Note that it follows from Proposition 2.12 that if A is asymptotically stable, then N (A − I) = {0}. Theorem 2.21. Let A ∈ Rn×n be nonnegative. If there exist p, r ∈ Rn such that p >> 0 and r ≥≥ 0 satisfy p = AT p + r,
(2.90)
then the following statements hold: i ) I − A is an M -matrix. Pk i # k+1 − I) + [I − (A − I)(A − I)# ](k + 1), k ∈ Z . ii ) + i=0 A = (A − I) (A
iii) A − I is nonsingular if and only if I − A is a nonsingular M-matrix.
Proof. i) The proof is a direct consequence of i) of Theorem 2.10 with A replaced by A − I. ii) Since I − A is an M-matrix is follows that Re λ < 1 or λ = 1 for all λ ∈ spec(A). Hence, the eigenvalue λ = 1 (if it exists) is semisimple and it follows from the Jordan decomposition that there exist invertible matrices J ∈ Rr×r and S ∈ Rn×n , where r = rank(I − A), such that Ir − J 0 A=S S −1 . 0 In−r Hence, it follows that k k X X (Ir − J)i 0 Ai = S S −1 0 In−r i=0 i=0 Pk (Ir − J)i 0 i=0 = S S −1 0 In−r (k + 1) −J −1 ([Ir − J]k+1 − Ir ) 0 = S S −1 0 In−r (k + 1)
NNBook
September 1, 2009
73
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
wi (k) ' ?
ith Subsystem xi (k) &
wj (k) $ ) %
aij xj (k)
aji xi (k)
'
?
jth Subsystem xj (k) 1&
aii xi (k) ?
$ %
ajj xj (k) ?
Figure 2.11 Discrete-time linear compartmental interconnected subsystem model.
−J −1 0 ([Ir − J]k+1 − Ir ) −1 = S S S 0 0 0 0 0 +S S −1 0 In−r (k + 1) J − Ir # k+1 − I) + In − S = (A − I) (A 0 (J − Ir )−1 0 ·S S −1 (k + 1) 0 0
0 0
0 0
S −1
S −1
= (A − I)# (Ak+1 − I) + (I − (A − I)(A − I)# )(k + 1),
k ∈ Z+ .
iii) The result follows from i). Next, we show that discrete-time linear compartmental dynamical systems [4,29,88,100,155,158,209,211,220,259] are a special case of discretetime nonnegative dynamical systems. To see this, let xi (k), i = 1, . . . , n, denote the mass (and hence a nonnegative quantity) of the ith subsystem of the compartmental system shown in Figure 2.11, let aii ≥ 0 denote the loss coefficient of the ith subsystem averaged over the discretization interval h, let wi (k) ≥ 0, i = 1, . . . , n, denote the mass inflow supplied to the ith subsystem, and let φij (k), i 6= j, i, j = 1, . . . , n, denote the net mass flow from the jth subsystem to the ith subsystem given by φij (k) = aij xj (k) − aji xi (k), k ∈ Z+ , where the transfer coefficient aij ≥ 0, i 6= j, i, j = 1, . . . , n, is averaged over the discretization interval h. A mass balance for the whole compartmental system with time step h = 1 yields ∆xi (k) , xi (k + 1) − xi (k)
NNBook
September 1, 2009
74
CHAPTER 2
= −aii xi (k) +
n X
j=1,i6=j
φij (k) + wi (k), k ∈ Z+ , i = 1, . . . , n, (2.91)
or, equivalently, x(k + 1) = Ax(k) + w(k),
x(0) = x0 ,
k ∈ Z+ ,
(2.92)
where x(k) = [x1 (k), . . . , xn (k)]T , w(k) = [w1 (k), . . . , wn (k)]T , and for i, j = 1, . . . , n, P 1 − nl=1 ali , i = j, A(i,j) = (2.93) aij , i 6= j.
Note that since at any given instant of time mass can only be transported, stored, or discharged but not created and the maximum amount of mass that can be transported and/or P discharged cannot exceed the mass in a compartment, it follows that 1 ≥ nl=1 ali . Thus A is a nonnegative matrix, and hence, the compartmental model given by (2.91) is a nonnegative dynamical system. Furthermore, note that AT e = [−a11 , −a22 , . . . , −ann ]T + e,
and hence, with p = e and r = (I − A)T e ≥≥ 0, it follows that (2.90) is satisfied, which implies that the compartmental model given byP(2.91) n (w(k) ≡ 0) is Lyapunov stable. In this case, V (x) = eT x = i=1 xi denoting the total mass of the system serves as a Lyapunov function for the undisturbed (w(k) ≡ 0) system (2.91) with ∆V (x) = V (Ax) − V (x) = eT (A − I)x n n X X = (1 − aii )xi − xi i=1
= − ≤ 0,
i=1
n X
aii xi
i=1
n
x ∈ R+ .
As in the continuous-time case, the compartmental system (2.91) with no inflows, that is, wi (k) ≡ 0, i = 1, . . . , n, is said to be inflow-closed [155]. Alternatively, if (2.91) possesses no losses (outflows) it is said to be outflowclosed [155]. A compartmental system is said to be closed if it is inflow-closed n and outflow-closed. Note that for a closed system ∆V (x) = 0, x ∈ R+ , which shows that the total mass inside a closed system is conserved. Alternatively, it follows that (2.91) can be equivalently written as T ∂V ∆x(k) = [Jn (x(k)) − D(x(k))] (x(k)) + w(k), x(0) = x0 , k ∈ Z+ , ∂x
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
75
where Jn (x) is a skew-symmetric matrix function with Jn(i,i) (x) = 0 and Jn(i,j) (x) = aij xj − aji xi , i 6= j, and D(x) = diag[a11 x1 , a22 x2 , . . . , ann xn ] n ≥≥ 0, x ∈ R+ . Hence, a discrete-time linear compartmental system is a discrete-time port-controlled Hamiltonian system with a Hamiltonian n H(x) = V (x) = eT x, x ∈ R+ , representing the total mass in the system, n Jn (x), x ∈ R+ , representing the internal system interconnection structure, n D(x), x ∈ R+ , representing the outflow dissipation, and w(k) representing the supplied mass to the system. This observation shows that discrete-time closed compartmental systems are conservative systems. This will be further elaborated in Chapter 5. Next, motivated by the fact that for a discrete-time compartmental system the total mass in the system can serve as a Lyapunov function, we give necessary and sufficient conditions for Lyapunov stability and asymptotic stability for discrete-time linear nonnegative dynamical systems using linear Lyapunov functions. Theorem 2.22. Consider the discrete-time linear dynamical system given by (2.89) where A ∈ Rn×n is nonnegative. Then the following statements hold: i ) If there exist vectors p, r ∈ Rn such that p >> 0 and r ≥≥ 0 satisfy p = AT p + r,
(2.94)
then A is Lyapunov stable. ii ) If A is Lyapunov stable, then there exist vectors p, r ∈ Rn such that p ≥≥ 0, p 6= 0, and r ≥≥ 0 satisfy (2.94).
iii ) If there exist vectors p, r ∈ Rn such that p ≥≥ 0 and r ≥≥ 0 satisfy (2.94) and (A, r T ) is observable, then p >> 0 and (2.89) is asymptotically stable. Furthermore, the following statements are equivalent: iv ) A is asymptotically stable. v ) There exist vectors p, r ∈ Rn such that p >> 0 and r >> 0 satisfy (2.94). vi ) There exist vectors p, r ∈ Rn such that p ≥≥ 0 and r >> 0 satisfy (2.94). vii ) For every r ∈ Rn such that r >> 0, there exists p ∈ Rn such that p >> 0 satisfies (2.94).
NNBook
September 1, 2009
76
CHAPTER 2
Proof. i) Consider the linear Lyapunov function candidate V (x) = n Note that V (0) = 0 and V (x) > 0, x ∈ R+ , x 6= 0. Now, computing the Lyapunov difference yields
pT x.
∆V (x) , V (Ax) − V (x) = pT Ax − pT x = −r T x ≤ 0,
n
x ∈ R+ ,
establishing Lyapunov stability. ii) If A is Lyapunov stable it follows from i) of Lemma 2.6 that (I −A)T is an M-matrix. Since AT ≥≥ 0, it follows from Theorem 2.9 that ρ(A) ∈ spec(A), and hence, there exists p ≥≥ 0, p 6= 0, such that AT p = ρ(A)p. Thus, AT p − p = (ρ(A) − 1)p ≤≤ 0, which proves that there exist p ≥≥ 0, p 6= 0, and r ≥≥ 0 such that (2.94) holds. iii) Assume there exist p ≥≥ 0 and r ≥≥ 0 such that (2.94) holds and suppose (A, r T ) is observable. Now, consider the function V (x) = pT x, n n x ∈ R+ , and note that, since V (x) ≥ 0, x ∈ R+ , and ∆V (x) = pT Ax−pT x = n △ −r T x ≤ 0, it follows that if x(0) ∈ P = {x ∈ R+ : pT x = 0}, then V (x(k)) = 0, k ∈ Z+ , which implies that 0 ≥ ∆V (x(k)) = pT Ax(k) − pT x(k) = pT Ax(k) ≥ 0, k ∈ Z+ . Specifically, ∆V (x(0)) = pT Ax(0) = 0. Hence, if x ˆ ∈ P then ∆V (ˆ x) = pT Aˆ x = −r T x ˆ = 0. Thus, if x ˆ ∈ P n △ T then Aˆ x ∈ P and x ˆ ∈ Q = {x ∈ R+ : r x = 0}. Now, since Aˆ x ∈ P it follows that A2 x ˆ ∈ P and Aˆ x ∈ Q. Repeating these arguments yields Ak x ˆ ∈ Q, k = 0, 1, . . . , n−1, or, equivalently, r T Ak x ˆ = 0, k = 0, 1, . . . , n−1. Now, since (A, r T ) is observable it follows that x ˆ = 0 and P = {0}, which implies that p >> 0. Asymptotic stability of (2.89) now follows as a direct consequence of the Krasovskii-LaSalle theorem with V (x) = pT x and using the fact that (A, r T ) is observable. To show the equivalence among iv)–vii) first suppose there exist p ≥≥ 0 and r >> 0 such that (2.94) holds. Now, there exists sufficiently small ε > 0 such that AT (p + εe) << p + εe and p + εe >> 0, which proves that vi) implies v). Since v) implies vi) it trivially follows that v) and vi) are equivalent. Now, suppose v) holds, that is, there exist p >> 0 and r >> 0 such that (2.94) holds, and consider the Lyapunov function n candidate V (x) = pT x, x ∈ R+ . Computing the Lyapunov difference yields n ∆V (x) = pT Ax − pT x = −r T x < 0, x ∈ R+ , x 6= 0, and hence, it follows that (2.89) is asymptotically stable. Thus, v) implies iv). Next, suppose (2.89) is asymptotically stable. Hence, (I − A)−T ≥≥ 0 and thus for every △ r ∈ Rn+ , p = (I − A)−T r ≥≥ 0 satisfies (2.94), which proves that iv) implies vi). Finally, suppose (2.89) is asymptotically stable. Now, as in the proof n given above, for every r ∈ Rn+ , there exists p ∈ R+ such that (2.94) holds. n Next, suppose, ad absurdum, that there exists x ∈ R+ , x 6= 0, such that
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
77
xT p = 0, that is, there exists at least one i ∈ {1, 2, . . . , n} such that pi = 0. Hence, xT (I − A)−T r = 0. However, since (I − A)−T ≥≥ 0 it follows that (I − A)−1 x ≥≥ 0 and, since r >> 0, it follows that (I − A)−1 x = 0, which implies that x = 0 yielding a contradiction. Hence, for every r ∈ Rn+ , there exists p ∈ Rn+ such that (2.94) holds, which proves iv) implies vii). Since vii) implies v) trivially, the equivalence of iv)–vii) is established. Next, we give necessary and sufficient conditions for semistability of a nonnegative matrix. Theorem 2.23. Let A ∈ Rn×n be nonnegative. A is semistable if and only if |λ| < 1 or λ = 1 and λ = 1 is semisimple, where λ ∈ spec(A). Furthermore, if A is semistable then limk→∞ Ak = I −(A−I)(A−I)# ≥≥ 0. Proof. The result is a direct consequence of Proposition 2.12. For completeness of exposition, we provide a proof here. If |λ| < 1 or λ = 1 and λ = 1 is semisimple, then A is Lyapunov stable. Now, it follows from the Jordan decomposition that there exists an invertible matrix S ∈ Cn×n such that J 0 A=S S −1 , 0 In−r where J ∈ Cr×r , r = rank A, and ρ(J) < 1. Hence, it follows that k J 0 lim Ak = lim S S −1 0 In−r k→∞ k→∞ 0 0 = S S −1 0 In−r J − Ir 0 (J − Ir )−1 0 −1 = In − S S S S −1 0 0 0 0 = In − (A − In )(A − In )# ,
which implies that limk→∞ Ak exists. Hence, A is semistable. Furthermore, since Ak ≥≥ 0, k ∈ Z+ , it follows that I − (A − I)(A − I)# ≥≥ 0. Conversely, suppose A is semistable, that is, limk→∞ Ak exists. Since A is semistable it follows that A is Lyapunov stable, that is, if λ ∈ spec(A), then either |λ| < 1, or |λ| = 1 and λ is semisimple. Now, it follows from the Jordan decomposition that there exists an invertible matrix S ∈ Cn×n such that J1 0 A=S S −1 , 0 J2 where J1 ∈ Cr×r such that ρ(J1 ) < 1 and J2 ∈ C(n−r)×(n−r) is diagonal such
NNBook
September 1, 2009
78
CHAPTER 2
that |λ| = 1, λ ∈ spec(J2 ). Hence, k J1 0 k A =S S −1 . 0 J2k Now, since for λ ∈ C, |λ| = 1, limk→∞ λk exists if and only if λ = 1, it follows that limk→∞ Ak exists if and only if J2 = In−r , which proves the result. It is important to note that unlike the case of continuous-time linear nonnegative systems, Lyapunov stability of discrete-time linear nonnegative systems does not necessarily imply semistability of a discrete-time linear nonnegative system. To see this, let n = 2 and let 0 1 A= 1 0
so that A is nonnegative and discrete-time Lyapunov stable. In this case, limk→∞ Ak does not exist, which shows that A is not semistable. However, if the discrete-time linear nonnegative system is derived from the discretization of a continuous-time linear nonnegative semistable system, then it can be shown that the discrete-time system is semistable. To see this, consider the continuous-time linear nonnegative system x(t) ˙ = Ac x(t),
t ≥ 0,
x(0) = x0 ,
(2.95)
where x(t) ∈ Rn , t ≥ 0, Ac ∈ Rn×n is essentially nonnegative and semistable, so that the discretization of (2.95) (with sampling rate h = 1) is given by x(k + 1) = Ad x(k),
x(0) = x0 ,
eAc .
k ∈ Z+ ,
(2.96)
where Ad = In this case, since Ac is (continuous-time) semistable, it follows from the real Jordan decomposition that there exists an invertible matrix S ∈ Rn×n such that Jc 0 Ac = S S −1 , 0 0 where Jc is Hurwitz, so that Ac
Ad = e
=S
eJc 0 0 I
S −1 .
Since ρ(eJc ) < 1, it follows that if λ ∈ spec(Ad ), then either |λ| < 1, or λ = 1 and λ is semisimple. Now, it follows from Theorem 2.23 that Ad is (discrete-time) semistable. Next, we show that every asymptotically stable discrete-time linear nonnegative system is equivalent, modulo a similarity transformation, to a compartmental system.
NNBook
September 1, 2009
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
79
Proposition 2.13. Let A ∈ Rn×n be nonnegative and asymptotically n×n stable. Then there Pn exists a diagonal invertible matrix S ∈ R −1 such that ˆ ˆ ˆ A(i,j) ≥ 0 and k=1 A(k,j) ≤ 1, i, j = 1, . . . , n, where A = SAS .
Proof. It follows from iv) and v) of Theorem 2.22 that there exists △ p ∈ Rn+ such that AT p − p << 0. Now, define S = diag[p1 , . . . , pn ], where pi is the ith component of p. Next, since Aˆ(i,j) = pi A(i,j) p−1 j , i, j = 1, . . . , n, ˆ it follows that A(i,j) ≥ 0, i, j = 1, . . . , n. Furthermore, since S AˆT e − Se = AT Se − p = AT p − P p << 0, which, since S >> 0 and diagonal, implies that AˆT e << e. Hence, nk=1 Aˆ(k,j) ≤ 1, i, j = 1, . . . , n. The following propositions give additional necessary and sufficient conditions for asymptotic stability of discrete-time linear nonnegative dynamical systems.
Proposition 2.14. The linear nonnegative dynamical system given by (2.89) is asymptotically stable if and only if the first n leading principal minors of I − A are positive. Proof. It follows from Theorem 4.14 of [20, p. 21] that all leading principal minors of a Z-matrix are positive if and only if the Z-matrix is a nonsingular M-matrix. Now, the result is immediate by noting that I − A is a nonsingular M-matrix. Proposition 2.15. The linear nonnegative dynamical system given by (2.89) is asymptotically stable if and only if the coefficients of χA (λ) = det(λIn − A + In ) are positive. Proof. The proof is a direct consequence of Proposition 2.14. Finally, we give necessary and sufficient conditions for asymptotic stability of a discrete-time linear nonnegative dynamical system using quadratic Lyapunov functions. First, however, the following technical lemma is needed. Lemma 2.7. Let A ∈ Rn×n be nonnegative. Then A is Schur if and only if there exists a vector p ∈ Rn such that p >> 0 satisfies AT p << p. Proof. The result is a direct consequence of iv) and v) of Theorem 2.22. Theorem 2.24. Consider the dynamical system given by (2.89) where A ∈ Rn×n is nonnegative. Then (2.89) is asymptotically stable if and only if there exist a positive diagonal matrix P ∈ Rn×n and an n × n positive-
NNBook
September 1, 2009
80
CHAPTER 2
definite matrix R such that P = AT P A + R.
(2.97)
Proof. Sufficiency follows from Theorem 2.16 with xe = 0 by noting that if there exist a positive diagonal matrix P ∈ Rn×n and an n × n matrix R > 0 such that (2.97) holds, then asymptotic stability is immediate with the quadratic Lyapunov function V (x) = xT P x. To show necessity, assume that A is nonnegative and Schur. Then it follows from Lemma 2.7 that there exist vectors l, m ∈ Rn , with l >> 0 and m >> 0 such that AT l << l and Am << m, which implies that AT Le << Le and AM e << M e, where L = diag[l1 , . . . , ln ], M = diag[m1 , . . . , mn ], and li and mi are the ith components of l and m, respectively. Hence, M AT Le << M Le and LAM e << LM e, which implies that −LM M AT L △ X= e << 0. LAM −M L Now, since X is essentially nonnegative it follows from Lemma 2.3 that X is Hurwitz which, since X is symmetric, implies that X < 0. Using Schur complements it follows that X < 0 is equivalent to M AT L(LM )−1 LAM < LM or, equivalently, AT LM −1 A < LM −1 , which implies the result with P = LM −1 and R = P − AT P A.
Theorem 2.25. Consider the dynamical system given by (2.89) where A ∈ Rn×n is nonnegative. Then (2.89) is asymptotically stable if and only if for every positive, positive-definite n × n matrix R, there exists a positive, positive-definite n × n matrix P such that (2.97) holds. Proof. Sufficiency follows from standard discrete-time Lyapunov theory with Lyapunov function V (x) = xT P x. Conversely, assume A is nonnegative and asymptotically stable, and let R be a positive, positivedefinite matrix (i.e., R > 0 and R >> 0). Since A is asymptotically stable it follows that there exists a unique n × n positive-definite matrix P such that (2.97) is satisfied and vec P = (A ⊗ A)T vec P + vec R, where vec(·) denotes the column stacking operator. Next, since A is nonnegative and asymptotically stable, it follows that A ⊗ A is nonnegative and asymptotically stable. Now, since R >> 0, it follows that vec R >> 0, and hence, vii) of Theorem 2.22 implies that vec P >> 0, which establishes that P >> 0. Example 2.11. This example models the flow of thyroxine when injected into the blood stream and then carried into the liver where it is converted into iodine which in turn is absorbed into the bile. A simple yet accurate model for the flow of thyroxine into the blood stream is captured
NNBook
September 1, 2009
81
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
by the three-compartment model shown in Figure 2.12. u1 ' ?
'
$
%
1 &
%
a12
Compartment I blood
&
)$
a21
Compartment II liver
a32
'
$
&
%
- Compartment III bile
Figure 2.12 Three-compartment thyroxine model.
The first compartment corresponds to the blood plasma, the second compartment to the liver, and the third compartment to the bile. Note that the feedback path between Compartments I and II reflects the fact that neither conversion nor absorption occurs instantaneously; that is, a fraction of the thyroxine that enters the liver is fed back to the blood before conversion to iodine. To analyze this compartmental system let, for i, j = 1, 2, 3, xi denote the concentration of thyroxine in compartment i, aij denote the instantaneous transfer coefficient of thyroxine flow rates from compartment j to compartment i in units of (time)−1 , and u1 denote a bolus (impulse) injection into the blood stream. Since at t = 0 no absorption or transfer of thyroxine can occur it follows that x2 (0) = x3 (0) = 0. Furthermore, since the input material is a bolus injection we can always reproduce the impulsive response with the free response by setting x3 (0) = bv, where v ∈ R denotes the impulse strength. Hence, a mass balance of the three-state compartment model shown in Figure 2.12 yields (2.95) with −a21 a12 0 Ac = a21 −(a12 + a32 ) 0 . (2.98) 0 a32 0
Now, it follows that the discretization of (2.95) is given by (2.96) where Ad = eAc h and h is the sampling rate. Note that since Ac is essentially nonnegative it follows from Proposition 2.5 that Ad ≥≥ 0. Hence, Akd ≥≥ 0, k ∈ Z+ , and consequently if x(0) is nonnegative, then the solution x(k) = Akd x(0) is nonnegative for all k ∈ Z+ . we assume that the sample rate h is small so that Ad = eAc h = P∞ Next, −1 i i=0 (i!) (Ac h) ≈ I + hAc . In this case, 1 − ha21 ha12 0 1 − h(a12 + a32 ) 0 . Ad = ha21 (2.99) 0 ha32 1 Furthermore, since Ad − I is singular it follows that the set of equilibria
NNBook
September 1, 2009
82
CHAPTER 2 3
E = {(x1 , x2 , x3 ) ∈ R+ : Ad x = x} = N (Ad − I) = {(x1 , x2 , x3 ) ∈ 3 R+ : (0, 0, x3 )}. Now, taking p = e >> 0 and r = [0, 0, 0]T , it follows that (2.94) holds, and hence, the discretized system is Lyapunov stable by i) of Theorem 2.22. In addition, since spec(Ad ) = {1 − p h h (a12 + a21 + a32 )2 − 4a21 a32 , 1 − h2 (a12 + a21 + a32 ) − 12 + a21 + a32 ) − 2 2 (a p h (a12 + a21 + a32 )2 − 4a21 a32 , 1}, it follows from Theorem 2.23 that the 2 discretized system is semistable. △ Example 2.12. One of the key areas in which discrete-time nonnegative dynamical systems arise is age-structured population models. Typically in such systems the state variables can present biomass, population density, or the number of species in a population. One of the most classical models for developing demographic projections in age-structured population models is the Leslie model [51, 225]. In this model the discrete-time k denotes the year or reproduction season and the state variables xi (k), k ∈ Z+ , typically denote the number of females of age i at the beginning of year k. Alternatively, xi (k), k ∈ Z+ , can denote the number of males, individuals, or couples of each age class [51]. Assuming a balanced sex ratio with equal probability of survival between males and females, the aging process is characterized by xi+1 (k + 1) = σi xi (k),
i = 1, . . . , n − 1,
(2.100)
where σi is the probability of survival from age i to age i + 1. Note that δi = 1 − σi gives the probability of dying during the same age. The first state equation captures the reproduction process and is given by x1 (k + 1) = σ0 (φ1 x1 (k) + φ2 x2 (k) + · · · + φn xn (k)),
(2.101)
where σ0 is the probability of survival in the first year of life and φi ≥ 0, i = 1, . . . , n, is the fertility rate of females at age i. Hence, the Leslie model is given by (2.89) where σ0 φ1 σ0 φ2 . . . σ0 φn−1 σ0 φn σ1 0 ... 0 0 σ2 . . . 0 0 A= 0 (2.102) . .. .. .. .. .. . . . . . 0 0 . . . σn−1 0 Note that A ≥≥ 0, and hence, Ak ≥≥ 0, k ∈ Z+ . Hence, if x(0) is nonnegative, then demographic projections obtained from the Leslie model given by x(k) = Ak x(0) are nonnegative for all k ∈ Z+ . To study the stability of this model form χA (λ) = det(λIn − A + In )
NNBook
September 1, 2009
83
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
= (λ + 1)n − σ0 φ1 (λ + 1)n−1 − σ0 σ1 φ2 (λ + 1)n−2 −σ0 σ1 σ2 φ3 (λ + 1)n−3 − · · · − σ0 σ1 · · · σn−1 φn ,
(2.103)
or, equivalently using the binomial theorem, n−2 χA (λ) = λn + (n − σ0 φ1 )λn−1 + n(n−1) − σ0 φ1 (n − 1) − σ0 σ1 φ2 λ 2 n(n − 1)(n − 2) (n − 1)(n − 2) − σ0 φ1 + 6 2 −σ0 σ1 φ2 (n − 2) − σ0 σ1 σ2 φ3 λn−3
+ · · · + (1 − σ0 φ1 − σ0 σ1 φ2 − σ0 σ1 σ2 φ3 − · · · − σ0 σ1 · · · σn−1 φn ). (2.104)
Now, it follows from Proposition 2.15 that the Leslie system is asymptotically stable if and only if the coefficients of χA (λ) are positive. Note that σ0 σ1 · · · σi−1 denotes the probability that a newly born female will survive to the age of i. Furthermore, the coefficient of (2.104) corresponding to the ith age is given by αi =
(
n i
−
i X l=0
"
n−l i−l
φl
l−1 Y
σj
j=0
# )
,
(2.105)
n n n(n−1)···(n−i+1) where , and , 1. Hence, if αi > 0, i = i! i 0 1, . . . , n, then the population will become extinct; otherwise if αi < 0, i = 1, . . . , n, the population will experience a demographic explosion. Clearly what governs the sign of αi are the fertility rates of the females up to age i and the probability that a newly born female will survive to the age of i. △
2.11 Discrete-Time Nonlinear Compartmental Dynamical Systems In this section, we develop linearization results for discrete-time nonlinear nonnegative dynamical systems as well as several stability results for nonlinear compartmental systems. First, we show that if a nonlinear system is nonnegative, then its linearization is also nonnegative. Lemma 2.8. Consider the nonlinear dynamical system (2.74) where f (0) = 0 and f : D → Rn is nonnegative and continuously differentiable in n △ R+ . Then, A = ∂f is nonnegative. ∂x (x) x=0
NNBook
September 1, 2009
84
CHAPTER 2
Proof. Since f : D → Rn is nonnegative it follows that fi (x) ≥ 0, n x ∈ R+ . Now, note that for all i, j ∈ {1, . . . , n}, ∂fi A(i,j) = (x) ∂xj x=0 fi (0, . . . , h, . . . , 0) − fi (0) = lim+ h→0 h fi (0, . . . , h, . . . , 0) , = lim+ h→0 h where h in fi (0, · · · , h, · · · , 0) is in the jth location. Hence, since fi (·) is nonnegative, A(i,j) ≥ 0, which proves nonnegativity of A. Next, we present a key result on stability of a linearized discrete-time nonlinear nonnegative dynamical system. Theorem 2.26. Let x(k) ≡ xe be an equilibrium point for the nonlinear dynamical system (2.74). Furthermore, let f : D → Rn be nonnegative and let ∂f A= (x) . ∂x x=xe Then the following statements hold:
i ) If |λ| < 1, where λ ∈ spec(A), then the equilibrium solution x(k) ≡ xe of the discrete-time nonlinear dynamical system (2.74) is asymptotically stable. ii ) If there exists λ ∈ spec(A) such that |λ| > 1, then the equilibrium solution x(k) ≡ xe of the discrete-time nonlinear dynamical system (2.74) is unstable. iii ) Let xe = 0, let |λ| < 1, where λ ∈ spec(A), let p >> 0 be such that n △ △ AT p << p, and define DA = {x ∈ R+ : pT x < γ}, where γ = sup{ε > P n △ 0 : pT f (x) < pT x, x ∈ R+ , kxk < ε} and kxk = ni=1 pi |xi |. Then DA is a subset of the domain of attraction for (2.74). Proof. Statements i) and ii) are restatements of Lyapunov’s indirect method [112] as applied to discrete-time nonlinear nonnegative dynamical systems. To prove iii) note that it follows from Lemma 2.8 that, if f : D → Rn is nonnegative, then A is nonnegative. Hence, since |λ| < 1, where λ ∈ spec(A), it follows from vi) of Theorem 2.22 that there exists p >> 0 such that AT p << p. Now, using the linear Lyapunov function candidate n V (x) = pT x, it follows that the closed subset DA of R+ is a subset of the
NNBook
September 1, 2009
85
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
wi (k) ' ?
ith Subsystem xi (k) &
wj (k) $ ) %
'
a ˆij (x(k))
a ˆji (x(k))
$
?
jth Subsystem xj (k) 1&
a ˆii (x(k)) ?
%
a ˆjj (x(k)) ?
Figure 2.13 Discrete-time nonlinear compartmental interconnected subsystem model.
domain of attraction for (2.74) since ∆V (x) < 0 for all x ∈ DA \{0} ⊆ n R+ \{0}. n
Definition 2.22. Let f : D ⊆ R+ → Rn . Then f is (discrete-time) n compartmental if f is nonnegative and eT f (x) ≤ eT x, x ∈ R+ . Next, we show that discrete-time nonlinear compartmental dynamical systems are a special case of discrete-time nonlinear nonnegative dynamical systems. To see this, once again let xi (k), i = 1, . . . , n, denote the mass (and hence a nonnegative quantity) of the ith subsystem of the compartmental n system shown in Figure 2.13, let a ˆii (x) ≥ 0, x ∈ R+ , denote the average flow of material loss of the ith subsystem over the discretized interval h, let wi (k) ≥ 0, i = 1, . . . , n, denote the mass inflow supplied to the ith subsystem, and let φij (x(k)) i 6= j, i, j = 1, . . . , n, denote the net mass flow from the jth subsystem to the ith subsystem given by φij (x(k)) = a ˆij (x(k)) − a ˆji (x(k)), where the average (over the discretized interval h) rate of material flow a ˆij (x) ≥ 0, i 6= j, i, j = 1, . . . , n. A mass balance for the whole compartmental system with step h = 1 yields ∆xi (k) = −ˆ aii (x(k)) +
n X
j=1,i6=j
[ˆ aij (x(k)) − a ˆji (x(k))] + wi (k), k ∈ Z+ ,
i = 1, . . . , n, (2.106)
or, equivalently, x(k + 1) = f (x(k)) + w(k),
x(0) = x0 ,
k ∈ Z+ ,
(2.107)
T T where x = [x1 , . . . , xn ]T , w = [w1 , . . . , wP n ] , f (x) = [f1 (x), . . . , fn (x)] , and n for i = 1, . . . , n, fi (x) = xi − a ˆii (x) + j=1,i6=j [ˆ aij (x) − a ˆji (x)]. Since all mass flows as well as compartment sizes are nonnegative, it follows that for
NNBook
September 1, 2009
86
CHAPTER 2 n
all i = 1, . . . , n, fi (x) ≥ 0 for all x ∈ R+ . The above physical constraints are implied by a ˆij (x) ≥ 0, a ˆii (x) ≥ 0, and wi ≥ 0, for all i, j = 1, . . . , n, and n x ∈ R+ . The above physical constraints imply that f is nonnegative. T Pn Taking the total mass of the compartmental system V (x) = e x = i=1 xi as a Lyapunov function for (2.107) (with w(k) ≡ 0) and assuming a ˆij (0) = 0, i, j = 1, . . . , n, it follows that
∆V (x) = eT f (x) − eT x n X = ∆xi i=1
= − = − ≤ 0,
n X
a ˆii (x) +
i=1 j=1,i6=j
i=1
n X
n n X X
[ˆ aij (x) − a ˆji (x)]
a ˆii (x)
i=1
n
x ∈ R+ ,
(2.108)
which shows that the zero solution x(k) ≡ 0 of the discrete-time nonlinear inflow-closed (w(k) ≡ 0) compartmental system given by (2.107) is Lyapunov stable. If (2.107) with w(k) ≡ 0 has losses (outflows) from all n compartments, then a ˆii (x) > 0, x ∈ R+ , x 6= 0, and by (2.108), the zero solution x(k) ≡ 0 to (2.107) (with w(k) ≡ 0) is asymptotically stable. As in the linear case, nonlinear discrete-time compartmental systems are port-controlled Hamiltonian systems. This follows from the fact that (2.106) can be equivalently written as ∆x(k) = [Jn (x(k))−D(x(k))]
T ∂V (x(k)) +w(k), ∂x
x(0) = x0 ,
k ∈ Z+ ,
(2.109) where Jn (x) is a skew-symmetric matrix function with Jn(i,i) (x) = 0 and Jn(i,j) (x) = a ˆij (x) − a ˆji (x), i 6= j, and D(x) = diag[ˆ a11 (x), a ˆ22 (x), . . ., n a ˆnn (x)] ≥≥ 0, x ∈ R+ . n
Finally, if f : R+ → Rn is continuously differentiable and xe = 0 so that f (0) = 0, then it follows that (see [158] for details) a ˆij (x) = aij (x)xj , n where the state-dependent transfer coefficients aij (x) ≥ 0, x ∈ R+ , i, j = 1, . . . , n, and aij (·) is continuous. In this case, (2.106) becomes n X xi (k + 1) = xi (k) − aii (x(k)) + aji (x(k)) xi (k) j=1,i6=j
NNBook
September 1, 2009
87
STABILITY THEORY FOR NONNEGATIVE SYSTEMS
+
n X
aij (x(k))xj (k) + wi (k),
j=1,i6=j
k ∈ Z+ ,
i = 1, . . . , n,
(2.110)
k ∈ Z+ ,
(2.111)
or, equivalently, x(k + 1) = A(x(k))x(k) + w(k),
x(0) = x0 ,
where, for i, j = 1, . . . , n, A(i,j) (x) =
1−
Pn
l=1 ali (x), i = j, aij (x), i= 6 j.
(2.112)
P Note that using identical arguments as in the linear case, 1 ≥ nl=1 ali (x), n n x ∈ R+ , and hence A(x) is nonnegative for all x ∈ R+ . Hence, once again using the total mass V (x) = eT x as a Lyapunov function for (2.111) (with w(k) ≡ 0) it follows that T
T
∆V (x) = e ∆x = e [A(x) − I]x = −
n X i=1
aii (x)xi ≤ 0,
n
x ∈ R+ , (2.113)
which shows that the zero solution x(k) ≡ 0 of the inflow-closed (w(k) ≡ 0) discrete-time system given by (2.111) is Lyapunov stable. In light of the above and (2.109) we have the following result on stability of solutions for discrete-time nonlinear inflow-closed compartmental systems. Theorem 2.27. Consider the inflow-closed nonlinear compartmental system given by (2.109) where V (x) = eT x. If Jn (0) = 0, D(x) ≥≥ 0, n x ∈ R+ , and D(0) = 0, then the zero solution x(k) ≡ 0 to (2.109) (with n w(k) ≡ 0) is Lyapunov stable. If, in addition, D(x) > 0, x ∈ R+ \{0}, then the zero solution x(k) ≡ 0 to (2.109) is asymptotically stable. Proof. Lyapunov stability follows by noting that V (x) = eT x is a Lyapunov function candidate for (2.109) and ∆V (x) = = = ≤
eT ∆xe eT [Jn (x) − D(x)] e −eT D(x)e n 0, x ∈ R+ .
n
To show asymptotic stability note that if D(x) > 0, x ∈ R+ \{0}, then n ∆V (x) = −eT D(x)e < 0, x ∈ R+ \{0}.
NNBook
September 1, 2009
NNBook
September 1, 2009
Chapter Three
Stability Theory for Nonnegative and Compartmental Dynamical Systems with Time Delay
3.1 Introduction As discussed in Chapter 1, nonnegative and compartmental models play a key role in understanding many processes in biological and medical sciences [4,100,113,155,158,259]. Such models are composed of homogeneous interconnected subsystems (or compartments) which exchange variable nonnegative quantities of material with conservation laws describing transfer, accumulation, and outflows between compartments and the environment. A key physical limitation of such systems is that transfer between compartments is not instantaneous, and realistic models for capturing the dynamics of such systems should account for material, energy, or information in transit between compartments [106, 155, 210]. Hence, to accurately describe the evolution of compartmental systems, it is necessary to include in any mathematical model of the system dynamics some information about the past system states. This of course leads to (infinite-dimensional) delay dynamical systems [128, 229]. In this chapter, we develop stability theorems for time-delay nonnegative and compartmental dynamical systems. In addition, using linear Lyapunov-Krasovskii functionals, we develop necessary and sufficient conditions for asymptotic stability of linear nonnegative dynamical systems with time delay. The consideration of a linear Lyapunov-Krasovskii functional leads to a new Lyapunov-like equation for examining the stability of time-delay nonnegative dynamical systems. The motivation for using a linear Lyapunov-Krasovskii functional follows from the fact that the (infinite-dimensional) state of a retarded nonnegative dynamical system is nonnegative, and hence, a linear Lyapunov-Krasovskii functional is a valid candidate Lyapunov-Krasovskii functional. For a time-delay compartmental system, a linear Lyapunov-Krasovskii functional is shown to correspond to
NNBook
September 1, 2009
90
CHAPTER 3
the total mass of the system at a given time plus the integral of the mass flow in transit between compartments over the time intervals it takes for the mass to flow through the intercompartmental connections.
3.2 Lyapunov Stability Theory for Time-Delay Nonnegative Dynamical Systems In this section, we develop the fundamental results of Lyapunov stability theory for time-delay nonnegative dynamical systems. We begin by considering the general nonlinear autonomous time-delay dynamical system x(t) ˙ = f (x(t)) + fd (x(t − τd )),
x(θ) = φ(θ),
−τd ≤ θ ≤ 0, (3.1)
where x ∈ Rn , f : Rn → Rn , fd : Rn → Rn , f (0) = fd (0) = 0, and φ ∈ C = C([−τd , 0], Rn ), where C is a Banach space of continuous functions mapping the interval [−τd , 0] into Rn with topology of uniform convergence and designated norm given by |||φ||| = sup−τd ≤θ≤0 kφ(θ)k. Here, φ : [−τd , 0] → Rn is a continuous vector-valued function specifying the initial state of the system. Furthermore, let xt ∈ C defined by xt (θ) = x(t + θ), θ ∈ [−τd , 0], denote the (infinite-dimensional) state of (3.1) at time t corresponding to the piece of trajectories x between t − τd and t or, equivalently, the element xt in the space of continuous functions defined on the interval [−τd , 0] and taking values in Rn . Unless otherwise stated, we assume f (·) and fd (·) are locally Lipschitz continuous on Rn . Furthermore, xe ∈ Rn is an equilibrium point of (3.1) if and only if f (xe ) = 0 and fd (xe ) = 0. n
Proposition 3.1. R+ is an invariant set with respect to (3.1) if and only if f : Rn → Rn is essentially nonnegative and fd : Rn → Rn is nonnegative. n
n
Proof. Assume R+ is invariant with respect to (3.1), φ(0) = x ∈ R+ , φ(θ) = 0 for all θ ∈ [−τd , 0), and suppose, ad absurdum, that x is such that there exists i ∈ {1, . . . , q} such that xi = 0 and fi (x) < 0. Then, since f and fd are continuous and fd (0) = 0, there exists sufficiently small h > 0 such that x˙ i (t) < 0 for all t ∈ [0, h). Hence, xi (t) is strictly decreasing on [0, h), n and thus x(t) 6∈ R+ for all t ∈ (0, h), which leads to a contradiction. Next, n assume that φ(−τd ) = x ∈ R+ , φ(θ) = 0 for all θ ∈ (−τd , 0], and suppose, ad absurdum, x is such that fdi (x) < 0. Hence, there exists sufficiently small h > 0 such that x˙ i (t) < 0 for all t ∈ [0, h) and xi (t) is strictly decreasing on n [0, h), and thus, x(t) 6∈ R+ for all t ∈ (0, h), which leads to a contradiction. Conversely, assume that f is essentially nonnegative and fd is nonnegative. Now, consider the nonlinear dynamical system y(t) ˙ = f (y(t)) + w(t),
y(0) = φ(0),
t ≥ 0,
(3.2)
NNBook
September 1, 2009
91
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
where w(t) =
fd (φ(t − τd )), 0 ≤ t ≤ τd , 0, t > τd .
Note that the solution x(t), t ≥ 0, to (3.1) satisfies (3.2) for all t ∈ [0, τd ]. Furthermore, since f (·) is Lipschitz continuous it follows that y(t) = x(t), t ∈ [0, τd ]. Next, since f (·) is essentially nonnegative and w(t) ≥≥ 0 for all t ≥ 0, it follows from Proposition 4.3 that y(t) ≥≥ 0, t ≥ 0. Hence, x(t) ≥≥ 0, t ∈ [0, τd ]. Now, repeating the above procedure by replacing t with t − τd in (3.1), we can show that x(t) ≥≥ 0, t ∈ [τd , 2τd ]. Repeating this procedure iteratively, it follows that x(t) ≥≥ 0, t ≥ 0. It follows from Proposition 3.1 that if φ(θ) ≥≥ 0, θ ∈ [−τd , 0], then x(t) ≥≥ 0, t ≥ 0, if and only if f is essentially nonnegative and fd is nonnegative. In this case, we say that (3.1) is a nonnegative time-delay dynamical system. Henceforth, we assume that f is essentially nonnegative and fd is nonnegative so that the nonlinear time-delay dynamical system (3.1) is a nonnegative time-delay dynamical system. The following definition introduces several types of stability for the n equilibrium solution x(t) ≡ xe ∈ R+ of the nonlinear nonnegative dynamical n △ system (3.1). Define C+ = {ψ : [−τd , 0] → R+ : ψ ∈ C} and, for xe ∈ Rn , △ define Bˆδ (xe ) = {ψ ∈ C : kψ(θ) − xe k ≤ δ, −τd ≤ θ ≤ 0}. n
Definition 3.1. i) The equilibrium solution x(t) ≡ xe ∈ R+ to (3.1) is n Lyapunov stable with respect to R+ if, for all ε > 0, there exists δ = δ(ε) > 0 n such that if φ ∈ Bˆδ (xe ) ∩ C+ , then x(t) ∈ Bε (xe ) ∩ R+ , t ≥ 0. n
ii) The equilibrium solution x(t) ≡ xe ∈ R+ to (3.1) is (locally) n asymptotically stable with respect to R+ if it is Lyapunov stable with n respect to R+ and there exists δ > 0 such that if φ ∈ Bˆδ (xe ) ∩ C+ , then limt→∞ x(t) = xe . n
iii) The equilibrium solution x(t) ≡ xe ∈ R+ to (3.1) is globally n asymptotically stable with respect to R+ if it is Lyapunov stable with respect n to R+ and, for all φ ∈ C+ , limt→∞ x(t) = xe . The following result gives sufficient conditions for Lyapunov and asymptotic stability of a nonlinear nonnegative dynamical system with time delay. For this result, let V : C → R be a continuously differentiable functional with derivative along the trajectories of (3.1) given by 1 △ V˙ (ψ) = lim [V (xh (ψ)) − V (ψ)], h→0 h
NNBook
September 1, 2009
92
CHAPTER 3
where xh (ψ) denotes the state of (3.1) at t = h with initial condition ψ. Note that V˙ (ψ) is dependent on the system dynamics (3.1). First, the following definition is needed. Definition 3.2. A set Q ⊆ C+ is open relative to C+ if there exists an open set R ⊆ C such that Q = R ∩ C+ . A set Q ⊆ C+ is closed relative to C+ if there exists a closed set R ⊆ C such that Q = R ∩ C+ . A set Q ⊆ C+ is compact relative to C+ if there exists an compact set R ⊆ C such that Q = R ∩ C+ . Theorem 3.1. Let D be an open subset relative to C+ that contains xe . Consider the nonlinear dynamical system (3.1) where f is essentially nonnegative, fd is nonnegative, f (xe ) = 0, and fd (xe ) = 0, and assume that there exist a continuously differentiable functional V : D → R and a class K function α(·) such that V (xe ) = 0, α(kψ(0) − xe k) ≤ V (ψ), ψ ∈ D, V˙ (ψ) ≤ 0, ψ ∈ D.
(3.3) (3.4) (3.5)
Then the equilibrium solution x(t) ≡ xe to (3.1) is Lyapunov stable with n respect to R+ . If, in addition, there exists a class K function γ(·) such that V˙ (ψ) ≤ −γ(kψ(0) − xe k),
ψ ∈ D,
(3.6)
then the equilibrium solution x(t) ≡ xe to (3.1) is asymptotically stable n with respect to R+ . Finally, if, in addition, D = C+ and α(·) is a class K∞ function, then the equilibrium solution x(t) ≡ xe to (3.1) is globally n asymptotically stable with respect to R+ . △ Proof. Let ε > 0 be such that Bˆε (xe ) ∩ C+ ⊂ D, define η = α(ε), and △ define Dη = {ψ ∈ Bˆε (xe ) ∩ C+ : V (ψ) < η}. Since V (·) is continuous and V (xe ) = 0 it follows that Dη is nonempty and there exists δ = δ(ε) > 0 such that V (ψ) < η, ψ ∈ Bˆδ (xe ) ∩ C+ . Hence, Bˆδ (xe ) ∩ C+ ⊆ Dη . Next, since V˙ (ψ) ≤ 0 it follows that V (xt ) is a nonincreasing function of time, and hence, for every φ ∈ Bˆδ (xe ) ∩ C+ ⊆ Dη it follows that
α(kx(t) − xe k) ≤ V (xt ) ≤ V (φ) < η = α(ε). Thus, since f is essentially nonnegative and fd is nonnegative it follows from Proposition 3.1 that C+ is invariant with respect to (3.1). Hence, for every φ ∈ Bˆδ (xe ) ∩ C+ , x(t) ∈ Bε (xe ), t ≥ 0, establishing Lyapunov stability with n respect to R+ . Next, assume that (3.6) holds and note that Lyapunov stability follows from the first assertion. Now, to prove asymptotic stability with respect
NNBook
September 1, 2009
93
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
n to R+ , let ε > 0 and δ = δ(ε) be such that for every φ ∈ Bˆδ (xe ) ∩ C+ , x(t) ∈ Bˆε (xe ) ∩ C+ , t ≥ 0 (the existence of such a (δ, ε) pair follows from n Lyapunov stability with respect to R+ ). Note that V (xt ) is a nonincreasing function of time and, since V (·) is bounded from below, it follows from the monotone convergence theorem [112, p. 37] that there exists L ≥ 0 such that limt→∞ V (xt ) = L. Now, suppose that for some ψ ∈ Bˆδ (xe ) ∩ C+ , ad △ absurdum, L > 0 so that DL = {ψ ∈ Bˆε (xe ) ∩ C+ : V (ψ) ≤ L} is nonempty and x(t) 6∈ DL , t ≥ 0. Thus, as in the proof of Lyapunov stability, there exists δˆ > 0 such that Bˆδˆ(xe ) ∩ C+ ⊂ DL . Hence, it follows from (3.6) that, for a given φ ∈ Bˆδ (xe ) ∩ C+ \DL and t ≥ 0, Z t V (xt ) = V (φ) + V˙ (xs )ds 0 Z t ≤ V (φ) − γ(kx(s) − xe k)ds 0
Letting t >
V (φ)−L ˆ , γ(δ)
ˆ ≤ V (φ) − γ(δ)t.
it follows that V (xt ) < L, which is a contradiction. Hence, L = 0, and, since φ ∈ Bˆδ (xe ) ∩ C+ was chosen arbitrarily, it follows that V (xt ) → 0 as t → ∞ for all φ ∈ Bˆδ (xe ) ∩ C+ . Now, since V (xt ) ≥ α(kx(t) − xe k) ≥ 0, it follows that α(kx(t) − xe k) → 0 or, equivalently, n x(t) → xe as t → ∞, establishing asymptotic stability with respect to R+ . n
Finally, to prove global asymptotic stability with respect to R+ , let δ > 0 be such that φ ∈ Bˆδ (xe ) ∩ C+ and assume α(·) is a class K∞ function. Since α(·) is a class K∞ function it follows that there exists ε > 0 such that V (φ) < α(ε). Now, (3.6) implies that V (xt ) is a nonincreasing function of time, and hence, it follows from (3.4) that α(kx(t) − xe k) ≤ V (xt ) ≤ V (φ) < α(ε),
t ≥ 0.
Hence, x(t) ∈ Bε (xe ) ∩ C+ , t ≥ 0. Now, the proof follows as in the proof of the local asymptotic stability result.
3.3 Invariant Set Stability Theorems In this section, we introduce the Krasovskii-LaSalle invariance principle for time-delay dynamical systems. To state the main results of this section several definitions and a key theorem are needed. First, we introduce the notion of invariance with respect to the flow st (ψ) of a nonlinear dynamical system with time delay. Consider the nonlinear dynamical system (3.1) and for ψ ∈ D, let the map s(·, ψ) : R → D denote the solution curve or trajectory of (3.1) through the point ψ in D.
NNBook
September 1, 2009
94
CHAPTER 3
Identifying s(·, ψ) with its graph, the trajectory or orbit of a point φ ∈ D is defined as the motion along the curve △
Oφ = {ψ ∈ D : ψ = s(t, φ), t ∈ R}.
(3.7)
For t ≥ 0, we define the positive orbit through the point φ ∈ D as the motion along the curve Oφ+ = {ψ ∈ D : ψ = s(t, φ), t ≥ 0}. △
(3.8)
Definition 3.3. A point p ∈ D is a positive limit point of the trajectory s(·, ψ) of (3.1) if there exists a monotonic sequence {tn }∞ n=0 of positive numbers, with tn → ∞ as n → ∞, such that s(tn , ψ) → p as n → ∞. The set of all positive limit points of s(t, ψ), t ≥ 0, is the positive limit set ω(ψ) of s(·, ψ) of (3.1). Definition 3.4. A set M ⊂ D ⊆ C is a positively invariant set with respect to the nonlinear dynamical system (3.1) if st (M) ⊆ M for all t ≥ 0, △ where st (M) = {st (ψ) : ψ ∈ M}. A set M ⊆ D is an invariant set with respect to the dynamical system (3.1) if st (M) = M for all t ∈ R. Next, we state a key theorem involving positive limit sets. Furthermore, we use the notation xt → M ⊆ D as t → ∞ to denote that xt approaches M, that is, for each ε > 0 there exists T > 0 such that △ dist(xt , M) < ε for all t > T , where dist(p, M) = inf ψ∈M |||p − ψ|||. Theorem 3.2. Consider the nonlinear dynamical system (3.1) where f is essentially nonnegative and fd is nonnegative. Suppose the solution x(t) to (3.1) corresponding to an initial condition φ ∈ C+ is bounded for all t ≥ 0. Then the positive limit set ω(φ) of xt , t ≥ 0, is a nonempty, compact, and invariant subset of C+ . Furthermore, xt → ω(φ) as t → ∞. Proof. It follows from Lemma 1.4 of [128, p. 103] that for every φ ∈ C+ , + Oφ is compact. Furthermore, note that it is easy to show that ω(φ) =
\
+
{O ψ : ψ = s(t, φ), t ≥ 0}.
(3.9)
Hence, it follows from (3.9) that ω(φ) is nonempty and compact. To show positive invariance of ω(φ), let p ∈ ω(φ) so that there exists an increasing unbounded sequence {tn }∞ n=0 such that s(tn , φ) → p as n → ∞. Now, it follows from the semigroup property that s(t + tn , φ) = s(t, s(tn , φ)) for all t ≥ 0. Next, since s(·, φ) is continuous, it follows that, for t + tn ≥ 0, limn→∞ s(t + tn , φ) = limn→∞ s(t, s(tn , φ)) = s(t, p), and hence, s(t, p) ∈ ω(φ), establishing positive invariance of ω(φ).
NNBook
September 1, 2009
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
95
To show invariance of ω(φ) let y ∈ ω(φ) so that there exists an increasing unbounded sequence {tn }∞ n=0 such that s(tn , φ) → y as n → ∞. Next, let t ∈ [0, ∞) and note that there exists N such that tn > t, n ≥ N . Hence, it follows from the semigroup property that s(t, s(tn − t, φ)) = + s(tn , φ) → y as n → ∞. Now, since Oφ is compact there exists a subsequence {znk }∞ k=1 of the sequence zn = s(tn −t, φ), n = N, N +1, . . ., such that znk → z ∈ D as k → ∞ and, by definition, z ∈ ω(φ). Next, it follows from the continuous dependence property that limk→∞ s(t, znk ) = s(t, limk→∞ znk ), and hence, y = s(t, z), which implies that ω(φ) ⊆ st (ω(φ)), t ∈ [0, ∞). Now, using positive invariance of ω(φ) it follows that st (ω(φ)) = ω(φ), t ≥ 0, establishing invariance of the positive limit set ω(φ). Finally, to show s(t, φ) → ω(φ) as t → ∞, suppose, ad absurdum, s(t, φ) 6→ ω(φ) as t → ∞. In this case, there exists a sequence {tn }∞ n=0 , with tn → ∞ as n → ∞, and ε > 0 such that dist(x(tn ), ω(φ)) > ε, +
n ∈ Z+ .
(3.10)
However, since Oφ is compact there exists a convergent subsequence ∗ ∗ {s(t∗n , φ)}∞ n=0 such that s(tn , φ) → p ∈ ω(φ) as n → ∞, which contradicts (3.10). Hence, s(t, φ) → ω(φ) as t → ∞. Next, we present the Krasovskii-LaSalle theorem for nonnegative dynamical systems with time delay. Theorem 3.3. Consider the nonlinear dynamical system (3.1) where f is essentially nonnegative and fd is nonnegative, assume that Dc ⊂ D ⊆ C+ is a closed positively invariant set with respect to (3.1), and assume there exists a continuously differentiable functional V : Dc → R such that V (·) is △ bounded from below and V˙ (ψ) ≤ 0, ψ ∈ Dc . Let R = {ψ ∈ Dc : V˙ (ψ) = 0} and let M be the largest invariant set contained in R. If φ ∈ Dc and x(t), t ≥ 0, is bounded, then xt → M as t → ∞. Proof. Let x(t), t ≥ 0, be a solution to (3.1) with φ ∈ Dc . Since V˙ (ψ) ≤ 0, ψ ∈ Dc , it follows that Z t V (xt ) − V (xτ ) = V˙ (xs )ds ≤ 0, t ≥ τ, τ
and hence, V (xt ) ≤ V (xτ ), t ≥ τ , which implies that V (xt ) is a nonincreasing function of t. Next, since V (·) is continuous on the closed set Dc and bounded from below, there exists β ∈ R such that V (ψ) ≥ β, △ ψ ∈ Dc . Hence, γφ = limt→∞ V (xt ) exists. Now, for all p ∈ ω(φ), there exists an increasing unbounded sequence {tn }∞ n=0 , with t0 = 0, such that s(tn , φ) → p as n → ∞. Since V (ψ), ψ ∈ Dc , is continuous, V (p) = V (limn→∞ s(tn , φ)) = limn→∞ V (s(tn , φ)) = γφ , and hence, V (ψ) = γφ on
NNBook
September 1, 2009
96
CHAPTER 3
ω(φ). Now, since x(t), t ≥ 0, is bounded it follows from Theorem 3.2 that ω(φ) is a nonempty invariant set. Hence, it follows that V˙ (ψ) = 0 on ω(φ) and thus ω(φ) ⊂ M ⊂ R ⊂ Dc . Finally, since xt → ω(φ) as t → ∞, it follows that xt → M as t → ∞. Next, using Theorem 3.3 we provide a generalization of Theorem 3.1 for local asymptotic stability of a nonlinear dynamical system with time delay. Corollary 3.1. Consider the nonlinear dynamical system (3.1) where f is essentially nonnegative and fd is nonnegative, assume that Dc ⊂ D ⊆ C+ is a positively invariant set with respect to (3.1) such that xe ∈ Dc , and assume that there exist a continuously differentiable functional V : Dc → R and a class K function α(·) such that V (xe ) = 0, V (ψ) ≥ α(kψ(0)−xe k), and △ V˙ (ψ) ≤ 0, ψ ∈ Dc . Furthermore, assume that the set R = {ψ ∈ Dc : V˙ (ψ) = 0} contains no invariant set other than the set {xe }. Then the equilibrium n solution x(t) ≡ xe to (3.1) is asymptotically stable with respect to R+ . Proof. Since V˙ (ψ) ≤ 0, ψ ∈ Dc , it follows from Theorem 3.3 that if φ ∈ Dc , then ω(φ) ⊆ M, where M denotes the largest invariant set contained in R, which implies that M = {xe }. Hence, xt → M = {xe } as t → ∞, establishing asymptotic stability of the equilibrium solution x(t) ≡ n xe to (3.1) with respect to R+ . Finally, we present a global invariant set theorem for guaranteeing global asymptotic stability of a nonlinear nonnegative dynamical system with time delay. Theorem 3.4. Consider the nonlinear dynamical system (3.1) where f is essentially nonnegative and fd is nonnegative, and assume there exist a continuously differentiable functional V : C+ → R and class K∞ functions α(·) and γ(·) such that V (xe ) = 0, α(kψ(0) − xe k) ≤ V (ψ), ψ ∈ C+ , V˙ (ψ) ≤ −γ(kψ(0) − xe k),
ψ ∈ C+ .
(3.11) (3.12) (3.13)
△ Furthermore, assume that the set R = {ψ ∈ C+ : V˙ (ψ) = 0} contains no invariant set other than the set {xe }. Then the equilibrium solution n x(t) ≡ xe to (3.1) is globally asymptotically stable with respect to R+ .
Proof. Since (3.11)–(3.13) hold and α(·) is a class K∞ function, it follows from Theorem 3.1 that the equilibrium solution x(t) ≡ xe to (3.1) n is Lyapunov stable with respect to R+ and bounded. Now, Theorem 3.3 implies that xt → M as t → ∞. However, since R contains no invariant set
NNBook
September 1, 2009
97
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
other than the set {xe }, the set M is {xe }, and hence, global asymptotic n stability with respect to R+ is immediate.
3.4 Stability Theory for Continuous-Time Nonnegative Dynamical Systems with Time Delay In this section, we consider a linear time-delay dynamical system G of the form x(t) ˙ = Ax(t) + Ad x(t − τ ),
x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
t ≥ 0,
(3.14)
where x(t) ∈ Rn , t ≥ 0, A ∈ Rn×n , Ad ∈ Rn×n , τ ≥ 0, and φ(·) ∈ C = C([−τ, 0], Rn ) is a continuous vector-valued function specifying the initial state of the system. Note that since φ(·) is continuous it follows from Theorem 2.1 of [128, p. 14] that there exists a unique solution x(φ) defined on [−τ, ∞) that coincides with φ on [−τ, 0] and satisfies (3.14) for t ≥ 0. The following definition is needed for the main results of this section. Definition 3.5. The linear time-delay dynamical system G given by △ (3.14) is nonnegative if for every φ(·) ∈ C+ , where C+ = {ψ(·) ∈ C : ψ(θ) ≥≥ 0, θ ∈ [−τ, 0]}, the solution x(t), t ≥ 0, to (3.14) is nonnegative. Proposition 3.2. The linear time-delay dynamical system G given by (3.14) is nonnegative if and only if A ∈ Rn×n is essentially nonnegative and Ad ∈ Rn×n is nonnegative. Proof. The proof is a direct consequence of Proposition 3.1. The proof can also be shown using matrix mathematics. Specifically, the solution to (3.14) is given by Z t At x(t) = e x(0) + eA(t−θ) Ad x(θ − τ )dθ 0 Z t−τ = eAt φ(0) + eA(t−τ −θ) Ad x(θ)dθ. (3.15) −τ
Now, if A is essentially nonnegative, then it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0; and if φ(·) ∈ C+ and Ad is nonnegative, then it follows that Z t−τ x(t) = eAt φ(0) + eA(t−τ −θ) Ad φ(θ)dθ ≥≥ 0, t ∈ [0, τ ). −τ
Alternatively, for all τ < t, Aτ
x(t) = e
x(t − τ ) +
Z
τ 0
eA(τ −θ) Ad x(t + θ − 2τ )dθ,
NNBook
September 1, 2009
98
CHAPTER 3
and hence, since x(t) ≥≥ 0, t ∈ [−τ, τ ), it follows that x(t) ≥≥ 0, τ ≤ t < 2τ . Repeating this procedure iteratively, it follows that x(t) ≥≥ 0, t ≥ 0. Conversely, assume G is nonnegative and suppose, ad absurdum, that A is not essentially nonnegative. That is, suppose there exist I, J ∈ {1, 2, . . . , n}, I 6= J, such that A(I,J) < 0. Now, let φ(·) ∈ C+ be such that φ(θ) = 0, −τ ≤ θ ≤ τ − η, and φ(0) = eJ , where τ > η > 0 and eJ ∈ Rn is a vector of zeros with one in the Jth component. Next, it follows from (3.15) that x(t) = eAt eJ , 0 ≤ t < η. Hence, for sufficiently small T > 0, M(I,J) < 0, where M = eAT , which implies that xI (T ) < 0, leading to a contradiction. Now, suppose, ad absurdum, Ad is not nonnegative, that is, there exist I, J ∈ {1, 2, . . . , n} such that Ad(I,J) < 0. Next, let {vn }∞ n=1 ⊂ C+ denote a sequence of functions such that limn→∞ vn (θ) = eJ δ(θ + η − τ ), where 0 < η < τ and δ(·) denotes the Dirac delta function. In this case, it follows from (3.15) that Z η xn (η) = eAη vn (0) + eA(η−θ) Ad x(θ − τ )dθ, △
0
which implies that x(η) = limn→∞ xn (η) = eAη Ad eJ . Now, by choosing η sufficiently small it follows that xI (η) < 0, which is a contradiction. Note that it follows from Proposition 3.2 that, since Ad in (3.14) is required to be nonnegative, the linear time-delay dynamical system given by x(t) ˙ = Ax(t − τ ), x(θ) = φ(θ), −τ ≤ θ ≤ 0, t ≥ 0, (3.16)
where x(t) ∈ Rn , t ≥ 0, A ∈ Rn×n is essentially nonnegative, τ ≥ 0, and φ(·) ∈ C+ , fails to yield a nonnegative trajectory under arbitrarily small delays τ > 0. As an example, consider the scalar (n = 1) linear time-delay dynamical system G given by x(t) ˙ = −x(t − τ ),
x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
t ≥ 0.
Now, note that G is nonnegative if τ = 0, whereas G is not nonnegative if τ > 0 with φ(θ) = −θ. To see this, it need only be noted that Z 0 x(τ ) = x(0) + −x(θ)dθ = −τ 2 /2. −τ
For the remainder of this section, we assume that A is essentially nonnegative and Ad is nonnegative so that for every φ(·) ∈ C+ , the linear time-delay dynamical system G given by (3.14) is nonnegative. Next, we present necessary and sufficient conditions for asymptotic stability for the linear time-delay nonnegative dynamical system (3.14).
NNBook
September 1, 2009
99
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
Theorem 3.5. Consider the linear nonnegative time-delay dynamical system G given by (3.14) where A ∈ Rn×n is essentially nonnegative and Ad ∈ Rn×n is nonnegative, and let τ¯ > 0. Then G is asymptotically stable for all τ ∈ [0, τ¯] if and only if there exist p, r ∈ Rn such that p >> 0 and r >> 0 satisfy 0 = (A + Ad )T p + r. (3.17) Proof. To prove necessity, assume that the linear time-delay dynamical system G given by (3.14) is asymptotically stable for all τ ∈ [0, τ¯]. In this case, it follows that the linear nonnegative dynamical system n
x(0) = x0 ∈ R+ ,
x(t) ˙ = (A + Ad )x(t),
t ≥ 0,
(3.18)
or, equivalently, (3.14), with τ = 0, is asymptotically stable. Now, it follows from Theorem 2.11 that there exist p >> 0 and r >> 0 such that (3.17) is satisfied. Conversely, to prove sufficiency, assume that (3.17) holds and consider the candidate Lyapunov-Krasovskii functional V : C+ → R given by Z 0 V (ψ) = pT ψ(0) + pT Ad ψ(θ)dθ, ψ(·) ∈ C+ . −τ
Now, note that V (ψ) ≥ pT ψ(0) ≥ αkψ(0)k, where α = mini∈{1,2,...,n} pi > 0. Next, using (3.17), it follows that the Lyapunov-Krasovskii directional derivative along the trajectories of (3.14) is given by △
V˙ (xt ) = = = ≤
pT x(t) ˙ + pT Ad [x(t) − x(t − τ )] pT (A + Ad )x(t) −r T x(t) −βkx(t)k,
△
where β = mini∈{1,2,...,n} ri > 0 and xt (θ) = x(t + θ), θ ∈ [−τ, 0], denotes the (infinite-dimensional) state of the time-delay dynamical system G. Now, it follows from Theorem 3.1 that the linear nonnegative time-delay dynamical system G is asymptotically stable for all τ ∈ [0, τ¯]. The results presented in Proposition 3.2 and Theorem 3.5 can be easily extended to systems with multiple delays of the form x(t) ˙ = Ax(t) +
nd X i=1
Adi x(t − τi ),
x(θ) = φ(θ),
−¯ τ ≤ θ ≤ 0,
t ≥ 0,
(3.19) where x(t) ∈ Rn , t ≥ 0, A ∈ Rn×n is essentially nonnegative, Adi ∈ Rn×n , i = 1, . . . , nd , is nonnegative, τ¯ = maxi∈{1,...,nd } τi , and φ(·) ∈ {ψ(·) ∈
NNBook
September 1, 2009
100
CHAPTER 3
'
$ )
&
%
ith Subsystem xi (t)
aij xj (t), τ
'
$
1&
%
jth Subsystem xj (t)
aji xi (t), τ
aii xi (t)
ajj xj (t)
?
?
Figure 3.1 Linear compartmental interconnected subsystem model with time delay.
C([−¯ τ , 0], Rn ) : ψ(θ) ≥≥ 0, θ ∈ [−¯ τ , 0]}. In this case, (3.17) becomes 0=
A+
nd X
Adi
i=1
!T
p + r,
(3.20)
which is associated with the Lyapunov-Krasovskii functional T
V (ψ) = p ψ(0) +
nd Z X i=1
0 −τi
pT Adi ψ(θ)dθ.
(3.21)
Next, we show that inflow-closed, linear compartmental dynamical systems with time delays [155] are a special case of the linear nonnegative time-delay systems (3.14). To see this, for i = 1, . . . , n, let xi (t), t ≥ 0, denote the mass (and hence a nonnegative quantity) of the ith subsystem of the compartmental system shown in Figure 3.1, let aii ≥ 0 denote the loss coefficient of the ith subsystem, and let φij (t − τ ), i 6= j, denote the net mass flow (or flux) from the jth subsystem to the ith subsystem given by φij (t−τ ) = aij xj (t−τ )−ajixi (t), where the transfer coefficient aij ≥ 0, i 6= j, and τ is the fixed time it takes for the mass to flow from the jth subsystem to the ith subsystem. For simplicity of exposition we have assumed that all transfer times between compartments are given by τ . The more general multiple-delay case can be addressed as shown above. Now, a mass balance for the whole compartmental system yields n n X X x˙ i (t) = − aii + aji xj (t)+ aij xj (t−τ ), t ≥ 0, i = 1, . . . , n, j=1,i6=j
j=1,i6=j
(3.22)
or, equivalently, x(t) ˙ = Ax(t) + Ad x(t − τ ),
x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
t ≥ 0,
(3.23)
NNBook
September 1, 2009
101
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
where x(t) = [x1 (t), . . . , xn (t)]T , φ(·) ∈ C+ , and, for i, j = 1, . . . , n, Pn − k=1 aki , i = j, 0, i = j, A(i,j) = Ad(i,j) = 0, i 6= j, aij , i 6= j.
(3.24)
Note that A is essentially nonnegative and Ad is nonnegative. Furthermore, A + Ad is a compartmental matrix, and hence, it follows from Theorem 2.10 that Re λ < 0 or λ = 0, where λ is an eigenvalue of A + Ad . Now, it follows from Theorems 2.11 and 3.5 that the zero solution x(t) ≡ 0 to (3.23) is asymptotically stable for all τ ∈ [0, τ¯] if and only if A + Ad is Hurwitz. Alternatively, asymptotic stability of (3.23) for all τ ∈ [0, τ¯] can be deduced using the Lyapunov-Krasovskii functional Z 0 T eT Ad ψ(θ)dθ, ψ(·) ∈ C+ , (3.25) V (ψ) = e ψ(0) + −τ
which captures the total mass of the system at t = 0 plus the integral of the mass flow in transit between compartments over the time intervals it takes for the mass to flow through the intercompartmental connections. In △ this case, it follows that V˙ (xt ) ≤ −βkx(t)k, where β = mini∈{1,...,n} aii and xt (θ) = x(t+θ), θ ∈ [−τ, 0]. This result is not surprising, since for an inflowclosed compartmental system the law of conservation of mass eliminates the possibility of unbounded solutions. Next, we present a nonlinear extension of Proposition 3.2 and Theorem 3.5. Specifically, we consider nonlinear time delay dynamical systems G of the form x(t) ˙ = Ax(t) + fd (x(t − τ )),
x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
t ≥ 0, (3.26)
where x(t) ∈ Rn , t ≥ 0, A ∈ Rn×n , fd : Rn → Rn is locally Lipschitz and fd (0) = 0, τ ≥ 0, and φ(·) ∈ C. Once again, since φ(·) is continuous, the existence and uniqueness of solutions to (3.26) follow from Theorem 2.3 of [128, p. 44]. Nonlinear time-delay systems of the form given by (3.26) arise in the study of physiological and biomedical systems [45], ecological systems [103], and population dynamics [184], as well as neural Hopfield networks [213]. For the nonlinear time-delay dynamical system (3.26), the definition of nonnegativity holds with (3.14) replaced by (3.26). Proposition 3.3. Consider the nonlinear time-delay dynamical system G given by (3.26). If A ∈ Rn×n is essentially nonnegative and fd : Rn → Rn is nonnegative, then G is nonnegative. Proof. The solution to (3.26) is given by Z t At x(t) = e x(0) + eA(t−θ) fd (x(θ − τ ))dθ 0
NNBook
September 1, 2009
102
CHAPTER 3 At
= e φ(0) +
Z
t−τ
−τ
eA(t−τ −θ) fd (x(θ))dθ.
(3.27)
Now, if A is essentially nonnegative, then it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0; and if φ(·) ∈ C+ and fd is nonnegative, then it follows that Z t−τ At x(t) = e φ(0) + eA(t−τ −θ) fd (φ(θ))dθ ≥≥ 0, t ∈ [0, τ ). −τ
Alternatively, for all τ < t, At
x(t) = e x(t − τ ) +
Z
τ 0
eA(τ −θ) fd (x(t + θ − 2τ ))dθ,
and hence, since x(t) ≥≥ 0, t ∈ [−τ, τ ), it follows that x(t) ≥≥ 0, τ ≤ t < 2τ . Repeating this procedure iteratively, it follows that x(t) ≥≥ 0, t ≥ 0. Next, we present sufficient conditions for asymptotic stability for nonlinear nonnegative dynamical systems given by (3.26). Theorem 3.6. Consider the nonlinear nonnegative time-delay dynamical system G given by (3.26) where A ∈ Rn×n is essentially nonnegative, n fd : Rn → Rn is nonnegative, and fd (x) ≤≤ γx, x ∈ R+ , where γ > 0, and let τ¯ > 0. If there exist p, r ∈ Rn such that p >> 0 and r >> 0 satisfy 0 = (A + γIn )T p + r,
(3.28)
then G is asymptotically stable for all τ ∈ [0, τ¯]. Proof. Consider the candidate Lyapunov-Krasovskii functional V : C+ → R given by Z 0 T V (ψ) = p ψ(0) + pT fd (ψ(θ))dθ, ψ(·) ∈ C+ . −τ
Now, note that V (ψ) ≥ pT ψ(0) ≥ αkψ(0)k, where α = mini∈{1,2,...,n} pi > 0. Next, using (3.28), it follows that the Lyapunov-Krasovskii directional derivative along the trajectories of (3.26) is given by △
V˙ (xt ) = = ≤ = ≤ △
pT x(t) ˙ + pT [fd (x(t)) − fd (x(t − τ ))] pT (Ax(t) + fd (x(t))) pT Ax(t) + γpT x(t) −r T x(t) −βkx(t)k,
where β = mini∈{1,2,...,n} ri > 0. Now, it follows from Theorem 3.1 that the nonlinear nonnegative time-delay dynamical system G is asymptotically stable for all τ ∈ [0, τ¯].
NNBook
September 1, 2009
103
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS n
The structural constraint fd (x) ≤≤ γx, x ∈ R+ , where γ > 0, in the statement of Theorem 3.6 is naturally satisfied for many compartmental dynamical systems. For example, in nonlinear pharmacokinetic models [12, 114] the transport across biological membranes may be facilitated by carrier molecules with the flux described by a saturable form fdi (xi , xj ) = φmax [(xαi /(xαi + β) − (xαj /(xαj + β)], where xi , xj are the concentrations of the ith and jth compartments, respectively, and φmax , α, and β are model parameters. This nonlinear intercompartmental flow model satisfies the structural constraint of Theorem 3.6.
3.5 Discrete-Time Lyapunov Stability Theory for Time-Delay Nonnegative Dynamical Systems In this section, we develop the fundamental results of Lyapunov stability theory for discrete-time time-delay nonnegative dynamical systems. We begin by considering the general discrete-time nonlinear autonomous timedelay dynamical system x(k + 1) = f (x(k)) + fd (x(k − κd )), x(κ) = φ(κ), −κd ≤ κ ≤ 0, (3.29) where x ∈ Rn , f : Rn → Rn , fd : Rn → Rn , f (0) = fd (0) = 0, and φ ∈ C = C([{−κ, . . . , 0}, Rn ]), where C is a Banach space of functions mapping the set {−κd , . . . , 0} into Rn with topology of uniform convergence and designated norm given by |||φ||| = sup−κd ≤κ≤0 kφ(κ)k. Here, φ : {−κd , . . . , 0} → Rn is a vector sequence specifying the initial state of the system. Furthermore, let xk ∈ C defined by xk (κ) = x(k + κ), κ ∈ {−κd , . . . , 0}, denote the state of (3.29) at time k corresponding to the piece of trajectories x between k − κd and k or, equivalently, the element xk in the space of functions defined on the interval {−κd , . . . , 0} and taking values in Rn . Furthermore, xe ∈ Rn is an equilibrium point of (3.29) if and only if f (xe ) = xe and fd (xe ) = 0. n
Proposition 3.4. R+ is an invariant set with respect to (3.29) if and only if f : Rn → Rn and fd : Rn → Rn are nonnegative. Proof. Note that (3.29) can be equivalently written as x(k + 1) = f (x(k)) + fd (yκd (k)), x(0) = φ(0), y1 (k + 1) = x(k), y1 (0) = φ(−1), y2 (k + 1) = y1 (k), y2 (0) = φ(−2), .. . yκd (k + 1) = yκd −1 (k), yκd (0) = φ(−κd ),
k ≥ 0,
(3.30) (3.31) (3.32) (3.33)
where yi (k) = x(k − i) for all i = 1, . . . , κd and k ≥ 0. Now, the result is a direct consequence of Proposition 2.11.
NNBook
September 1, 2009
104
CHAPTER 3
The following definition introduces several types of stability for the n equilibrium solution x(k) ≡ xe ∈ R+ of the nonlinear nonnegative dynamical n △ system (3.29). Define C+ = {ψ : {−κd , . . . , 0} → R+ : ψ ∈ C} and, for △ xe ∈ Rn , define Bˆδ (xe ) = {ψ ∈ C : kψ(κ) − xe k ≤ δ, −κd ≤ κ ≤ 0}. n
Definition 3.6. i) The equilibrium solution x(k) ≡ xe ∈ R+ to (3.29) is n Lyapunov stable with respect to R+ if, for all ε > 0, there exists δ = δ(ε) > 0 n such that if φ ∈ Bˆδ (xe ) ∩ C+ , then x(k) ∈ Bε (xe ) ∩ R+ , k ≥ 0. n
ii) The equilibrium solution x(k) ≡ xe ∈ R+ to (3.29) is (locally) n asymptotically stable with respect to R+ if it is Lyapunov stable with n respect to R+ and there exists δ > 0 such that if φ ∈ Bˆδ (xe ) ∩ C+ , then limk→∞ x(k) = xe . n
iii) The equilibrium solution x(k) ≡ xe ∈ R+ to (3.29) is globally n asymptotically stable with respect to R+ if it is Lyapunov stable with respect n to R+ and, for all φ ∈ C+ , limk→∞ x(k) = xe . The following result gives sufficient conditions for Lyapunov and asymptotic stability of a nonlinear nonnegative dynamical system with time delay. For this result, let V : C → R be a continuous function with difference △ along the trajectories of (3.29) given by ∆V (ψ) = [V (x1 (ψ)) − V (ψ)], where x1 (ψ) denotes the state of (3.29) at k = 1 with initial condition ψ. Note that ∆V (ψ) is dependent on the system dynamics (3.29). Theorem 3.7. Let D be an open subset relative to C+ that contains xe . Consider the nonlinear dynamical system (3.29) where f and fd are nonnegative, f (xe ) = xe , and fd (xe ) = 0, and assume that there exist a continuous functional V : D → R and a class K function α(·) such that V (xe ) = 0, α(kψ(0) − xe k) ≤ V (ψ), ψ ∈ D, ∆V (ψ) ≤ 0, ψ ∈ D.
(3.34) (3.35) (3.36)
Then the equilibrium solution x(k) ≡ xe to (3.29) is Lyapunov stable with n respect to R+ . If, in addition, there exists a class K function γ(·) such that ∆V (ψ) ≤ −γ(kψ(0) − xe k),
ψ ∈ D,
(3.37)
then the equilibrium solution x(k) ≡ xe to (3.29) is asymptotically stable n with respect to R+ . Finally, if, in addition, D = C+ and α(·) is a class K∞ function, then the equilibrium solution x(k) ≡ xe to (3.29) is globally n asymptotically stable with respect to R+ . Proof. The proof is similar to the proof of Theorem 3.1 and, hence,
NNBook
September 1, 2009
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
105
is omitted. Next, we introduce the Krasovskii-LaSalle invariance principle for discrete-time, time-delay nonnegative dynamical systems. To state this result, we first introduce the notion of invariance with respect to the map sk (ψ) of a discrete-time nonlinear dynamical system with time delay. Consider the nonlinear dynamical system (3.29) and for ψ ∈ D, let the map s(·, ψ) : R → D denote the solution curve or trajectory of (3.29) through the point ψ in D. Identifying s(·, ψ) with its graph, the trajectory or orbit of a point φ ∈ D is defined as the motion along the curve △
Oφ = {ψ ∈ D : ψ = s(k, φ), k ∈ Z}.
(3.38)
For k ∈ Z+ , we define the positive orbit through the point φ ∈ D as the motion along the curve Oφ+ = {ψ ∈ D : ψ = s(k, x0 ), k ∈ Z+ }. △
(3.39)
Definition 3.7. A point p ∈ D is a positive limit point of the trajectory s(·, ψ) of (3.29) if there exists a monotonic sequence {kn }∞ n=0 of positive numbers, with kn → ∞ as n → ∞, such that s(kn , ψ) → p as n → ∞. The set of all positive limit points of s(k, ψ), k ∈ Z+ , is the positive limit set ω(ψ) of s(·, ψ) of (3.29). Definition 3.8. A set M ⊂ D ⊆ C is a positively invariant set with respect to the nonlinear dynamical system (3.29) if sk (M) ⊆ M for all △ k ∈ Z+ , where sk (M) = {sk (ψ) : ψ ∈ M}. A set M ⊆ D is an invariant set with respect to the dynamical system (3.29) if sk (M) = M for all k ∈ Z. Theorem 3.8. Consider the nonlinear dynamical system (3.29) where f and fd are nonnegative, assume that Dc ⊂ D ⊆ C+ is a closed positively invariant set with respect to (3.29), and assume there exists a continuous functional V : Dc → R such that V (·) is bounded from below and ∆V (ψ) ≤ △ 0, ψ ∈ Dc . Let R = {ψ ∈ Dc : ∆V (ψ) = 0} and let M be the largest invariant set contained in R. If φ ∈ Dc and x(k), k ≥ 0, is bounded, then xk → M as t → ∞. Next, using Theorem 3.8 we provide a generalization of Theorem 3.7 for local asymptotic stability of a nonlinear dynamical system. Corollary 3.2. Consider the nonlinear dynamical system (3.29) where f and fd are nonnegative, assume that Dc ⊂ D ⊆ C+ is a closed positively invariant set with respect to (3.29) such that xe ∈ Dc , and assume that there exist a continuous functional V : Dc → R and a class K function α(·) such that V (xe ) = 0, V (ψ) ≥ α(kψ(0) − xe k), and ∆V (ψ) ≤ 0, ψ ∈ Dc . △ Furthermore, assume that the set R = {ψ ∈ Dc : ∆V (ψ) = 0} contains
NNBook
September 1, 2009
106
CHAPTER 3
no invariant set other than the set {xe }. Then the equilibrium solution n x(k) ≡ xe to (3.29) is asymptotically stable with respect to R+ . Finally, we present a global invariant set theorem for guaranteeing global asymptotic stability for a nonlinear discrete-time nonnegative system with time delay. Theorem 3.9. Consider the nonlinear dynamical system (3.29) where f and fd are nonnegative, and assume there exist a continuous functional V : C+ → R and class K∞ functions α(·) and γ(·) such that V (xe ) = 0, α(kψ(0) − xe k) ≤ V (ψ), ψ ∈ C+ , ∆V (ψ) ≤ −γ(kψ(0) − xe k),
ψ ∈ C+ .
(3.40) (3.41) (3.42)
△
Furthermore, assume that the set R = {ψ ∈ C+ : ∆V (ψ) = 0} contains no invariant set other than the set {xe }. Then the equilibrium solution n x(k) ≡ xe to (3.29) is globally asymptotically stable with respect to R+ .
3.6 Stability Theory for Discrete-Time Nonnegative Dynamical Systems with Time Delay In this section, we present a discrete-time analog to the results developed in Section 3.4. Specifically, we consider discrete-time dynamical systems G of the form x(k + 1) = Ax(k) + Ad x(k − κ),
k ∈ Z+ , (3.43) where x(k) ∈ Rn , k ∈ Z+ , A ∈ Rn×n , Ad ∈ Rn×n , κ ∈ Z+ , φ(·) ∈ C = C({−κ, . . . , 0}, Rn ) is a vector sequence specifying the initial state of the system, and C denotes the space of all sequences mapping {−κ, . . . , 0} into Rn with norm |||φ||| = maxk∈{−κ,...,0} kφ(k)k. The following definition is needed for the main results of this section. x(θ) = φ(θ),
−κ ≤ θ ≤ 0,
Definition 3.9. The discrete-time, linear time-delay dynamical system △ G given by (3.43) is nonnegative if for every φ(·) ∈ C+ , where C+ = {ψ(·) ∈ C : ψ(θ) ≥≥ 0, θ ∈ {−κ, . . . , 0}}, the solution x(k), k ∈ Z+ , to (3.43) is nonnegative. Proposition 3.5. The discrete-time, linear time-delay dynamical system G given by (3.43) is nonnegative if and only if A ∈ Rn×n and Ad ∈ Rn×n are nonnegative. Proof. The proof is a direct consequence of Proposition 3.4. The proof can also be shown using matrix mathematics. Specifically, the solution to
NNBook
September 1, 2009
107
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
(3.43) is given by k−1 X
x(k) = Ak x(0) + = Ak φ(0) +
Ak−θ−1 Ad x(θ − κ)
θ=0 k−κ−1 X
Ak−κ−θ−1 Ad x(θ).
(3.44)
θ=−κ
Now, if A is nonnegative, then it follows that Ak ≥≥ 0, k ∈ Z+ ; and if φ(·) ∈ C+ and Ad is nonnegative, then it follows that x(k) = Ak φ(0) +
k−κ−1 X θ=−κ
Ak−κ−θ−1 Ad φ(θ) ≥≥ 0,
k ∈ {0, . . . , κ}.
Alternatively, for all κ < k, κ
x(k) = A x(k − κ) +
κ−1 X θ=0
Aκ−θ−1 Ad x(k + θ − 2τ ),
and hence, since x(k) ≥≥ 0, k ∈ {−κ, . . . , κ}, it follows that x(k) ≥≥ 0, κ ≤ k < 2κ. Repeating this procedure iteratively, it follows that x(k) ≥≥ 0, k ∈ Z+ . Conversely, assume G is nonnegative and suppose, ad absurdum, that A is not nonnegative. That is, suppose there exist I, J ∈ {1, 2, . . . , n} such that A(I,J) < 0. Now, let φ(·) ∈ C+ be such that φ(−κ) = 0 and φ(0) = eJ . Next, it follows from (3.44) that x(1) = AeJ , which implies that xI (1) = A(I,J) < 0, leading to a contradiction. Now, suppose, ad absurdum, that Ad is not nonnegative, that is, there exist I, J ∈ {1, 2, . . . , n} such that Ad(I,J) < 0. Next, let φ ∈ C+ be such that φ(−κ) = eJ and φ(0) = 0. In this case, it follows from (3.44) that x(1) = Ad x(−κ), which implies that x(1) = Ad eJ and xJ (1) < 0, which is a contradiction. For the remainder of this section, we assume that A and Ad are nonnegative so that the discrete-time, linear time-delay dynamical system G given by (3.43) is nonnegative. Next, we present necessary and sufficient conditions for asymptotic stability of the discrete-time linear time-delay nonnegative dynamical system (3.43). Theorem 3.10. Consider the discrete-time, linear nonnegative timedelay dynamical system G given by (3.43) where A ∈ Rn×n and Ad ∈ Rn×n are nonnegative, and let κ ¯ > 0. Then G is asymptotically stable for all κ ∈ {0, . . . , κ ¯ } if and only if there exist p, r ∈ Rn such that p >> 0 and
NNBook
September 1, 2009
108
CHAPTER 3
r >> 0 satisfy
p = (A + Ad )T p + r.
(3.45)
Proof. To prove necessity, assume that the discrete-time, linear timedelay dynamical system G given by (3.43) is asymptotically stable for all κ ∈ {0, . . . , κ ¯ }. In this case, it follows that the discrete-time linear nonnegative dynamical system n
x(0) = x0 ∈ R+ ,
x(k + 1) = (A + Ad )x(k),
k ∈ Z+ ,
(3.46)
or, equivalently, (3.43), with κ = 0, is asymptotically stable. Now, it follows from Theorem 2.22 that there exist p >> 0 and r >> 0 such that (3.45) is satisfied. Conversely, to prove sufficiency, assume that (3.45) holds and consider the candidate Lyapunov-Krasovskii functional V : C+ → R given by V (ψ) = pT ψ(0) +
−1 X
pT Ad ψ(θ),
θ=−κ
ψ(·) ∈ C+ .
Now, note that V (ψ) ≥ pT ψ(0) ≥ αkψ(0)k, △
where α = mini∈{1,2,...,n} pi > 0. Next, using (3.45), it follows that the Lyapunov-Krasovskii difference along the trajectories of (3.43) is given by ∆V (xk ) = = = ≤
pT [x(k + 1) − x(k)] + pT Ad [x(k) − x(k − κ)] pT (A + Ad − I)x(k) −r T x(k) −βkx(k)k,
△
where β = mini∈{1,2,...,n} ri > 0 and xk (θ) = x(k + θ), θ ∈ {−κ, . . . , 0}, denotes the state of the time-delay dynamical system G. Now, it follows from Theorem 3.7 that the discrete-time, linear nonnegative time-delay dynamical system G is asymptotically stable for all κ ∈ {0, . . . , κ ¯ }. Next, we present a nonlinear extension of Proposition 3.5 and Theorem 3.10. Specifically, we consider nonlinear time-delay dynamical systems G of the form x(k + 1) = Ax(k) + fd (x(k − κ)),
k ∈ Z+ , (3.47) n n×n n n where x(k) ∈ R , k ∈ Z+ , A ∈ R , fd : R → R is continuous and fd (0) = 0, κ ≥ 0, and φ(·) ∈ C. Note that Definition 3.9 also holds for the nonlinear time-delay dynamical system G given by (3.47) with appropriate modifications. x(θ) = φ(θ),
−κ ≤ θ ≤ 0,
NNBook
September 1, 2009
109
STABILITY THEORY FOR TIME-DELAY NONNEGATIVE SYSTEMS
Proposition 3.6. Consider the discrete-time, nonlinear time-delay dynamical system G given by (3.47). If A ∈ Rn×n is nonnegative and fd : Rn → Rn is nonnegative, then G is nonnegative. Proof. The solution to (3.47) is given by k−1 X
k
x(k) = A x(0) + = Ak φ(0) +
Ak−θ−1 fd (x(θ − κ))
θ=0 k−κ−1 X
Ak−κ−θ−1 fd (x(θ)).
(3.48)
θ=−κ
Now, if A is nonnegative, then it follows that Ak ≥≥ 0, k ∈ Z+ ; and if φ(·) ∈ C+ and fd is nonnegative, then it follows that x(k) = Ak φ(0) +
k−κ−1 X θ=−κ
Ak−κ−θ−1 fd (φ(θ)) ≥≥ 0,
k ∈ {0, · · · , κ}.
Alternatively, for all κ < k, x(k) = Aκ x(k − κ) +
κ−1 X θ=0
Aκ−θ−1 fd (x(k + θ − 2κ)),
and hence, since x(k) ≥≥ 0, k ∈ {−κ, . . . , κ}, it follows that x(k) ≥≥ 0, κ ≤ k < 2κ. Repeating this procedure iteratively, it follows that x(k) ≥≥ 0, k ∈ Z+ . Finally, we present sufficient conditions for asymptotic stability of discrete-time, nonlinear nonnegative dynamical systems given by (3.47). Theorem 3.11. Consider the discrete-time, nonlinear nonnegative time-delay dynamical system G given (3.47) where A ∈ Rn×n is nonnegative, n fd : Rn → Rn is nonnegative, and fd (x) ≤≤ γx, x ∈ R+ , where γ > 0, and let κ ¯ > 0. If there exist p, r ∈ Rn such that p >> 0 and r >> 0 satisfy p = (A + γIn )T p + r,
(3.49)
then G is asymptotically stable for all κ ∈ {0, . . . , κ ¯ }. Proof. Consider the candidate Lyapunov-Krasovskii functional V : C+ → R given by T
V (ψ) = p ψ(0) +
−1 X
θ=−κ
pT fd (ψ(θ)),
ψ(·) ∈ C+ .
NNBook
September 1, 2009
110
CHAPTER 3
Now, note that V (ψ) ≥ pT ψ(0) ≥ αkψ(0)k, △
where α = mini∈{1,2,...,n} pi > 0. Next, using (3.49), it follows that the Lyapunov-Krasovskii difference along the trajectories of (3.47) is given by ∆V (xk ) = = ≤ = ≤ △
pT [x(k + 1) − x(k)] + pT [fd (x(k)) − fd (x(k − κ))] pT (Ax(k) − x(k) + fd (x(k))) pT Ax(k) − pT x(k) + γpT x(k) −r T x(k) −βkx(k)k,
where β = mini∈{1,2,...,n} ri > 0. Now, it follows from Theorem 3.7 that the discrete-time, nonlinear nonnegative time-delay dynamical system G is asymptotically stable for all κ ∈ {0, . . . , κ ¯ }.
NNBook
September 1, 2009
Chapter Four
Nonoscillation and Monotonicity of Solutions of Nonnegative Dynamical Systems
4.1 Introduction While compartmental systems have wide applicability in biology and medicine, their use in the specific field of pharmacokinetics [95, 297] is particularly noteworthy. The goal of pharmacokinetic analysis often is to characterize the kinetics of drug disposition in terms of the parameters of a compartmental model. This is accomplished by postulating a model, collecting experimental data (typically drug concentrations in blood as a function of time), and then using statistical analysis to estimate parameter values which best describe the data. Differences between the experimental data and those predicted by the model are attributed to measurement noise. Because the ultimate disposition of exogenous drugs is metabolism and elimination from the body, it is frequently assumed that drug concentrations will monotonically decline after discontinuation of drug administration. However, compartmental systems may admit nonmonotonic solutions (e.g., underdamped oscillations), that is, they can predict drug concentrations that do not decay monotonically with time after discontinuation of drug administration. Hence, it would be useful to identify compartmental systems which guarantee monotonicity of solutions in order to avoid attributing error (differences between model predictions and experimental data) to random noise, when the problem is in fact model misspecification. Similar considerations are also relevant to the other applications of nonnegative and compartmental dynamical systems. In this chapter, we present necessary and sufficient conditions for identifying nonnegative and compartmental dynamical systems that admit only nonoscillatory and monotonic solutions. Furthermore, we provide sufficient conditions that guarantee the absence of limit cycles in nonlinear compartmental systems.
NNBook
September 1, 2009
112
CHAPTER 4
4.2 Nonoscillation and Monotonicity of Linear Nonnegative Dynamical Systems In this section, we present sufficient conditions that guarantee nonoscillatory behavior of nonnegative systems as well as necessary and sufficient conditions for monotonicity of solutions. Consider the linear nonnegative dynamical system given by x(t) ˙ = Ax(t),
x(0) = x0 ,
t ≥ 0,
(4.1)
where x(t) ∈ Rn , t ≥ 0, and A ∈ Rn×n is essentially nonnegative. The following definition is needed. Definition 4.1. The linear nonnegative dynamical system (4.1) is nonoscillatory if there exist a finite time T > 0 and a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, 2, . . . , n, and, for every n x0 ∈ R+ , Qx(t2 ) ≤≤ Qx(t1 ), T ≤ t1 ≤ t2 , where x(t), t ≥ 0, denotes the solution to (4.1). Next, we present a result that shows that every two-dimensional compartmental dynamical system is nonoscillatory. First, however, the following lemma is needed. Lemma 4.1. Consider the linear nonnegative dynamical system (4.1) where n = 2 and A ∈ R2×2 is a compartmental matrix. Then the following statements hold: 2
i ) For every x0 ∈ R+ such that Ax0 ≤≤ 0, x(t) ˙ = Ax(t) ≤≤ 0, t ≥ 0. 2
ii ) For every x0 ∈ R+ , eT x(t) ˙ ≤ 0, t ≥ 0. iii ) For i = 1, 2, if x˙ i (0) < 0, then x˙ i (t) ≤ 0, t ≥ 0. Proof. i) Since A is essentially nonnegative it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0. The result now follows immediately by noting that x(t) ˙ = AeAt x0 = eAt Ax0 . ii) Since A is essentially nonnegative it follows from Proposition 2.5 that x(t) ≥≥ 0, t ≥ 0. Now, since A is additionally a compartmental matrix, it follows that " 2 # 2 X X T T A(i,j) xj (t) ≤ 0, t ≥ 0. e x(t) ˙ = e Ax(t) = j=1
i=1
iii) Assume x˙ 1 (0) < 0. If x˙ 2 (0) ≤ 0, then it follows from i) that
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
113
x(t) ˙ ≤≤ 0, t ≥ 0. Alternatively, let x˙ 2 (0) > 0 and suppose, ad absurdum, t ≥ 0, there exists a finite time T > 0 such that x˙ 1 (T ) > 0. Now, since x(t), ˙ is continuous it follows that there exists τ > 0 such that x˙ 1 (τ ) = 0. In this case, it follows from ii) that 0 ≥ eT x(τ ˙ ) = x˙ 1 (τ ) + x˙ 2 (τ ) = x˙ 2 (τ ). Hence, it follows from i) that x(t) ˙ ≤≤ 0, t ≥ τ , which is a contradiction. The proof of the case in which x˙ 2 (0) < 0 is completely analogous and, hence, is omitted. Theorem 4.1. Consider the linear nonnegative dynamical system (4.1) where n = 2 and A ∈ R2×2 is a compartmental matrix. Then the linear compartmental dynamical system (4.1) is nonoscillatory. 2
Proof. It follows from ii) of Lemma 4.1 that for every x0 ∈ R+ , T e x(0) ˙ ≤≤ 0, which implies that either (a) x˙ 1 (0) ≤ 0, x˙ 2 (0) ≤ 0, (b) x˙ 1 (0) > 0, x˙ 2 (0) < 0, or (c) x˙ 1 (0) < 0, x˙ 2 (0) > 0 holds. If (a) holds, then it follows from i) of Lemma 4.1 that x(t) ˙ ≤≤ 0, t ≥ 0. Alternatively, if (b) holds, then it follows from iii) of Lemma 4.1 that x˙ 2 (t) ≤ 0, t ≥ 0. In this case, if x˙ 1 (t) ≥ 0, t ≥ 0, then x˙ i (t), t ≥ 0, i = 1, 2, is monotonic. However, if there exists a finite time T > 0 such that x˙ 1 (T ) ≤ 0, then it follows from ˙ ≤≤ 0, t ≥ T . Similarly it can be shown that if (c) i) of Lemma 4.1 that x(t) holds, then there exists T > 0 such that x˙ i (t), t ≥ T , i = 1, 2, is monotonic. 2 Hence, for every x0 ∈ R+ , there exists T > 0 such that x˙ i (t), t ≥ T , i = 1, 2, is monotonic or, equivalently, there exists Q = diag[q1 , q2 ], qi = ±1, i = 1, 2, such that Qx(t) ˙ ≤≤ 0, t ≥ T . Now, it follows from (4.1) that for every T ≤ t1 ≤ t2 , Z t2 Qx(t)dt ˙ ≤≤ Qx(t1 ), Qx(t2 ) = Qx(t1 ) + t1
which proves that (4.1) is nonoscillatory. Theorem 4.1 shows that two-dimensional compartmental systems have monotonic solutions after a finite time T . However, this result is not true in the case of higher dimensions. Next, we give necessary and sufficient conditions for monotonicity of solutions over all time of linear n-dimensional nonnegative dynamical systems of the form x(t) ˙ = Ax(t) + Bu(t),
x(0) = x0 ,
t ≥ 0,
(4.2)
where x ∈ Rn , u ∈ Rm , A ∈ Rn×n , and B ∈ Rn×m . First, however, the following two definitions are needed. Definition 4.2. The linear dynamical system given by (4.2) is nonnegn ative if for every x(0) ∈ R+ and u(t) ≥≥ 0, t ≥ 0, the solution x(t), t ≥ 0, to (4.2) is nonnegative.
NNBook
September 1, 2009
114
CHAPTER 4
Definition 4.3. Consider the linear nonnegative dynamical system n (4.2) where x0 ∈ X0 ⊆ R+ , A is essentially nonnegative, B is nonnegative, u(t), t ≥ 0, is nonnegative, and X0 denotes a set of feasible initial conditions n △ contained in R+ . Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . The linear nonnegative dynamical system (4.2) is partially monotonic with respect to x ˆ if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and, for every x0 ∈ X0 , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 , where x(t), t ≥ 0, denotes the solution to (4.2). The linear nonnegative dynamical system (4.2) is monotonic if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and, for every x0 ∈ X0 , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 . The notion of partial monotonicity with respect to part of the system states is very relevant in pharmacokinetic modeling since it allows for some compartmental masses/concentrations to exhibit oscillations while guaranteeing nonoscillation in the other compartments, which can include the central compartment. The following proposition is required for the main theorems of this section. Proposition 4.1. The linear dynamical system given by (4.2) is nonnegative if and only if A ∈ Rn×n is essentially nonnegative and B ∈ Rn×m is nonnegative. Proof. First, note that the solution x(t), t ≥ 0, to (4.2) is given by At
x(t) = e x0 +
Z
t 0
eA(t−s) Bu(s)ds,
t ≥ 0.
Now, if A is essentially nonnegative, then it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0, and if B ≥≥ 0, then it follows that x(t) ≥≥ 0 for all n t ≥ 0 and x(0) ∈ R+ , which implies that G is nonnegative. Conversely, suppose G is nonnegative. Now, let x0 = 0 and let u(t) = δ(t − tˆ)ˆ u, t ≥ 0, where u ˆ ≥≥ 0. In this case, since x(tˆ) = B u ˆ ≥≥ 0 for all m u ˆ ∈ R+ it follows that B ≥≥ 0. Finally, with u(t) = 0, t ≥ 0, x(t) = eAt x0 , and hence, it follows from Proposition 2.5 that if x(t) ≥≥ 0, t ≥ 0, for all n x0 ∈ R+ , then A is essentially nonnegative, which proves the result. Next, we present a sufficient condition for monotonicity of a linear n-dimensional nonnegative dynamical system. Theorem 4.2. Consider the linear nonnegative dynamical system
NNBook
September 1, 2009
115
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS n
given by (4.2) where x0 ∈ R+ , A ∈ Rn×n is essentially nonnegative, ˆ ≤ n, B ∈ Rn×m is nonnegative, and u(t), t ≥ 0, is nonnegative. Let n △ {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and QA ≤≤ 0 and QB ≤≤ 0. Then the linear nonnegative dynamical system (4.2) is partially monotonic with respect to x ˆ. Proof. It follows from (4.2) that Qx(t) ˙ = QAx(t) + QBu(t),
x(0) = x0 ,
t ≥ 0,
which further implies that Qx(t2 ) = Qx(t1 ) +
Z
t2
[QAx(t) + QBu(t)]dt. t1
Next, since A is essentially nonnegative, B is nonnegative, and u(t), t ≥ 0, is nonnegative, it follows from Proposition 4.1 that x(t) ≥≥ 0, t ≥ 0. Hence, since −QA and −QB are nonnegative it follows that QAx(t) ≤≤ 0 and n QBu(t) ≤≤ 0, t ≥ 0, which implies that, for every x0 ∈ R+ , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 . Corollary 4.1. Consider the linear nonnegative dynamical system n given by (4.2) where x0 ∈ R+ , A ∈ Rn×n is essentially nonnegative, B ∈ Rn×m is nonnegative, and u(t), t ≥ 0, is nonnegative. Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and −QA and −QB are nonnegative. Then the linear nonnegative dynamical system given by (4.2) is monotonic. Proof. The proof is a direct consequence of Theorem 4.2 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Next, we present necessary and sufficient conditions for partial monotonicity and monotonicity of (4.2) in the case where u(t) ≡ 0. Theorem 4.3. Consider the linear nonnegative dynamical system n given by (4.2) where x0 ∈ R+ and A ∈ Rn×n is essentially nonnegative. △ Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . The linear nonnegative dynamical system (4.2) is partially monotonic with respect to x ˆ if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and QA ≤≤ 0. Proof. Sufficiency follows from Theorem 4.2 with u(t) ≡ 0. To show necessity, assume that the linear dynamical system given by (4.2) is partially
NNBook
September 1, 2009
116
CHAPTER 4
monotonic with respect to x ˆ. In this case, it follows from (4.2) that Qx(t) ˙ = QAx(t),
x(0) = x0 ,
t ≥ 0,
which further implies that Qx(t2 ) = Qx(t1 ) +
Z
t2
QAeAt x0 dt.
t1
Now, suppose, ad absurdum, there exist I, J ∈ {1, 2, . . . , n} such that n △ M(I,J) > 0, where M = QA. Next, let x0 ∈ R+ be such that x0J > 0 △ and x0i = 0, i 6= J, and define v(t) = eAt x0 so that v(0) = x0 and vJ (0) > 0. Now, it follows from continuity that there exists τ > 0 such that vJ (t) > 0, t ∈ [0, τ ). Thus, it follows that Z τ [Qx(τ )]J = [Qx(0)]J + [M v(t)]J dt Z0 τ = [Qx(0)]J + M(I,J) vJ (t)dt 0
> [Qx(0)]J ,
which is a contradiction. Hence, QA ≤≤ 0. Corollary 4.2. Consider the linear nonnegative dynamical system n given by (4.2) where x0 ∈ R+ and A ∈ Rn×n is essentially nonnegative. The linear nonnegative dynamical system (4.2) is monotonic if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, 2, . . . , n, and QA ≤≤ 0. Proof. The proof is a direct consequence of Theorem 4.3 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Finally, we present a sufficient condition for weighted monotonicity of a linear nonnegative dynamical system. Proposition 4.2. Consider the linear dynamical system given by (4.2) △ where A is essentially nonnegative and x0 ∈ X0 = {SAx0 ≤≤ 0 : x0 ∈ Rn }, n×n −1 where S ∈ R is an invertible matrix. If SAS is essentially nonnegative, then for every x0 ∈ X0 , S x(t) ˙ = SAx(t) ≤≤ 0, t ≥ 0, and Sx(t2 ) ≤≤ Sx(t1 ), 0 ≤ t1 ≤ t2 . n
△
Proof. Let y(t) = −SAx(t) and note that y(0) = −SAx0 ∈ R+ . It follows from (4.2) that y(t) ˙ = −SAx(t) ˙ = −SA2 x(t) = SAS −1 y(t),
t ≥ 0.
Next, since SAS −1 is essentially nonnegative, it follows from Proposition n 2.5 that y(t) ∈ R+ , t ≥ 0. Now, the result follows immediately by noting
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
117
that y(t) = −SAx(t), ˙ t ≥ 0. Example 4.1. Consider the linear dynamical system (4.2) with −(a + b) c A= , b −(c + d) where a, b, c, d > 0 so that A is a compartmental matrix. In this case, with S = I2 , Proposition 4.2 yields i) of Lemma 4.1. Alternatively, with 1 0 , S= b a+b ac+ad+bd
ac+ad+bd
it follows from Proposition 4.2 that if x˙ 1 (0) ≤ 0, then x˙ 1 (t) ≤ 0, t ≥ 0. A similar construction of S can be used to show that if x˙ 2 (0) ≤ 0, then △ x˙ 2 (t) ≤ 0, t ≥ 0, thus providing an alternative proof of Lemma 4.1. Example 4.2. To demonstrate the utility of Proposition 4.2 we consider a three-compartment mammillary system [155] in which the first compartment acts as the central compartment and the remaining two compartments exchange with the central compartment, which in turn outflows to the environment. Compartmental mammillary systems provide simple yet effective models of a distribution of a material which is injected into the plasma (the central compartment) and then distributes into the interstitial spaces of the organs of the body. An inflow-closed, three-compartment mammillary system is given by (4.2) with A given by −(k11 + k21 + k31 ) k12 k13 k21 −k12 0 , A= k31 0 −k13
where the transfer coefficients k11 , k12 , k21 , k13 , k31 ≥ 0. Here we assume that x0 = [1, 0, 0]T (or a positive scalar multiple of [1, 0, 0]T ). Letting 1 0 0 k21 21 S = k12k21k11 kk1112+k k11 k12 k11 k31 k13 k11
△
k31 k13 k11
k31 +k11 k13 k11
n
and noting that x0 ∈ X0 = {x ∈ R+ : SAx ≤≤ 0}, it can be shown that if k12 (k11 + k31 ) − k13 k31 ≤ 0, k13 (k11 + k21 ) − k12 k21 ≤ 0,
(4.3) (4.4)
then SAS −1 is essentially nonnegative. Hence, it follows from Proposition 4.2 that if (4.3) and (4.4) hold, then Sx(t2 ) ≤≤ Sx(t1 ), 0 ≤ t1 ≤ t2 , which implies that x1 (t2 ) ≤ x1 (t1 ), 0 ≤ t1 ≤ t2 , establishing that the concentrations/masses of the central compartment of the mammillary
NNBook
September 1, 2009
118
CHAPTER 4
model are monotonic. Note that (4.3) and (4.4) are only sufficient and not necessary conditions for monotonicity of concentrations/masses of the central compartment. △ Example 4.3. In this example, we use the results of this section to provide a taxonomy of linear three-dimensional, inflow-closed compartmental dynamical systems that exhibit monotonic solutions. A similar classification can be obtained for nonlinear and higher-order compartmental systems but we do not do so here for simplicity of exposition. To characterize the class of all three-dimensional monotonic compartmental systems, let △ Q = {Q ∈ R3×3 : Q = diag[q1 , q2 , q3 ], qi = ±1, i = 1, 2, 3}. Furthermore, let A ∈ R3×3 be a compartmental matrix and let x1 (t), x2 (t), and x3 (t), t ≥ 0, denote compartmental masses for compartments 1, 2, and 3, respectively. Note that there are exactly eight matrices in the set Q. Now, it follows from Corollary 4.2 that if QA ≤≤ 0, Q ∈ Q, then the corresponding compartmental dynamical system is monotonic. Hence, for every Q ∈ Q we seek all compartmental matrices A ∈ R3×3 such that qi A(i,j) ≤ 0, i, j = 1, 2, 3. First, we consider the case where Q = diag[1, 1, 1]. In this case, qi A(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(1,2) = A(1,3) = A(2,1) = A(3,1) = A(3,2) = A(2,3) = 0. This corresponds to a trivial (decoupled) case since there are no intercompartmental flows between the three compartments (see Figure 4.1 (a)). Next, let Q = diag[1, −1, −1] and note that qi A(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(1,2) = A(1,3) = A(2,2) = A(3,3) = 0. In addition, since 3 X i=1
A(i,j ) ≤ 0,
j = 1, 2, 3,
it follows that A(2,3) = A(3,2) = 0. Figure 4.1 (b) shows the compartmental structure for this case. Finally, let Q = diag[−1, 1, 1]. In this case, qi A(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(2,1) = A(3,1) = A(3,2) = A(2,3) = A(1,1) = 0. Figure 4.1 (c) shows the corresponding compartmental structure. It is important to note that in the case where Q = diag[−1, −1, −1], there does not exist a compartmental matrix satisfying QA ≤≤ 0 except for the zero matrix. This case would correspond to a compartmental dynamical system where all three states are monotonically increasing. Hence, the compartmental system would be unstable, contradicting the fact that all compartmental systems are Lyapunov stable. Finally, the remaining four cases corresponding to Q = diag[−1, 1, −1], Q = diag[−1, −1, 1], Q = diag[1, −1, 1], and Q = diag[1, 1, −1] are dual to the cases where Q = diag[1, −1, −1] and Q = diag[−1, 1, 1] and, hence, are not presented here. △
NNBook
September 1, 2009
119
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
a11 x1 (t) Compartment 1 x1 (t)
a11 x1 (t) Compartment 1 x1 (t) a21 x2 (t)
Compartment 2 x2 (t)
a31 x3 (t)
Compartment 3 x3 (t)
a22 x2 (t)
Compartment 2 x2 (t)
a33 x3 (t)
(a)
Compartment 3 x3 (t)
(b) Compartment 1 x1 (t) a12 x2 (t)
a13 x3 (t)
Compartment 2 x2 (t)
Compartment 3 x3 (t)
a22 x2 (t)
a33 x3 (t)
(c) Figure 4.1 Three-dimensional monotonic compartmental systems.
4.3 Mammillary Systems The most common pharmacokinetic models are linear and mammillary, that is, they are comprised of a central compartment from which there is outflow from the system and which exchanges material reversibly with one or more peripheral compartments. An inflow-closed mammillary system is given by (4.1) with A given by Pn − j=1 kj1 k12 . . . k1n k21 −k12 . . . 0 A= (4.5) .. .. .. , .. . . . . kn1
0
. . . −k1n
where the transfer coefficients kij , i 6= j, i, j = 1, . . . , n, and the loss coefficient k11 are positive. It follows from Theorem 4.2 and Corollary 4.1 that mammillary models are neither monotonic nor partially monotonic with respect to any compartment.
In numerous pharmacological applications, the initial state (at t = 0) is
NNBook
September 1, 2009
120
CHAPTER 4
characterized by a nonzero concentration in the central (first) compartment with all other compartments having zero initial concentrations. This, for example, can happen when a drug that is not synthesized by the body is administered as an impulsive intravenous injection. It is well documented via simulations that in this case the central compartment concentration monotonically decays. In the next theorem we state and prove this result. For the following theorem xj (t), j = 1, . . . , n, t ≥ 0, denotes the concentration of the jth compartment. Theorem 4.4. Consider the mammillary system given by (4.1) where △ A is given by (4.5) and x0 = e1 , where e1 = [1, 0, . . . , 0]T . Then the following statements hold: i) p DAD −1 is symmetric, where D = diag[1, d2 , . . . , dn ] and dj = k1j /kj1 , j = 2, . . . , n.
ii ) Let λ ∈ spec(A). Then λ ∈ R and λ ≤ 0.
iii ) x˙ 1 (t) ≤ 0, t ≥ 0, or, equivalently, the mammillary system is partially monotonic with respect to x1 . Proof. i) The proof follows by direct substitution. ii) Let λ ∈ spec(A). It follows from i) that A is similar to a symmetric matrix and, hence, λ ∈ R. Furthermore, since A is compartmental, and hence, Lyapunov stable, it follows that λ ≤ 0. iii) Since DAD −1 is symmetric it follows from the Schur decomposition that there exists a matrix S ∈ Rn×n such that SS T = In and DAD −1 = S T ΛS, where Λ = diag[λ1 , . . . , λn ], λi ∈ spec(DAD −1 ) = spec(A), i = △ 1, . . . , n. Now, let y(t) = Dx(t), t ≥ 0, and note that y(t) ˙ = DAD −1 y(t) = S T ΛSy(t),
t ≥ 0,
which further implies that y(t) = S T eΛt Sy(0), t ≥ 0. Next, note that x1 (t) = T T Λt y1 (t) = eT 1 y(t) = e1 S e Sy(0), t ≥ 0. Furthermore, y(0) = Dx0 = e1 , and hence, T Λt T Λt x1 (t) = eT 1 S e Se1 = z e z =
n X
eλj t zj2 ,
j=1
△
where z = Se1 . Hence, x˙ 1 (t) =
n X j=1
λj eλj t zj2 ≤ 0,
t ≥ 0,
t ≥ 0,
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
121
which proves that the mammillary system is partially monotonic with respect to x1 . While identification of monotonicity of the central compartment when it is the only compartment to have a nonzero initial condition is interesting, it should be noted that the results in this chapter provide necessary and sufficient conditions for monotonicity and partial monotonicity for all initial conditions. Thus, the main application of the results in this chapter is for models in which the initial conditions are less constrained, with nonzero initial states in multiple compartments. Noteworthy among potential applications is the exogenous administration of a pharmacological agent that is also endogenously synthesized. For example, consider the endogenous modulator of coagulation, antithrombin III (AT-3). The action of the exogenous anticoagulant heparin is dependent on activation of AT-3. AT-3 deficiency (congenital and acquired) is not uncommon and sometimes necessitates exogenous administration of AT-3. Hence, there has been interest in the pharmacokinetics of AT-3. In a study of transgenic AT-3, the authors in [205] assumed partial monotonicity of the central compartment with a two-compartment mammillary model. Since there is endogenous synthesis of AT-3, it is not immediately clear that the assumption of central compartment monotonicity after a single-bolus dose was valid. However, Lemma 4.1 indicates that this assumption was, indeed, valid since x˙ 1 (0) < 0. Note, however, that this lemma is applicable only to two-compartment models. There are numerous examples of other endogenously synthesized pharmacological agents, such as hormones, whose kinetics are described by more complex models after exogenous supplementation. Theorem 4.2 and Proposition 4.2 (weighted monotonicity) should aid in identifying monotonic behavior for these more complex models. Another area of potential applicability of our results is the kinetics of plasma volume expanders, especially hypertonic volume expanders. The kinetics of intravenous fluids, such as hypertonic saline, used for plasma volume expansion can be described by compartment models, and, obviously, the initial conditions will be comprised of material (in this case, fluid volume) in all compartments [69]. The dilution of various compartments could be complex depending on the exact initial conditions. An interesting, although more speculative, application is to the effect of cardiopulmonary bypass (CPB) on pharmacokinetics. The institution of CPB can be expected to result in a nearly stepwise decrease in the central compartment concentration of any drugs previously administered, due to the mixing of the patient’s circulating blood volume with the priming volume of
NNBook
September 1, 2009
122
CHAPTER 4
Figure 4.2 Nonmonotonicity of a mammillary model.
the extracorporeal circulation circuit. In contrast to bolus administration into the central compartment, in which the initial state is nonzero for this compartment only, the initial state at the institution of CPB may be characterized by a central compartment concentration that is less than the peripheral compartments due to hemodilution of the central compartment. As an example, consider a three-compartment mammillary CPB model. Application of Theorem 4.2 rules out partial monotonicity with respect to any compartment. Figure 4.2 shows a simulation of a threecompartment mammillary model with model parameters k11 = 0.001, k21 = 0.2, k12 = 0.2, k31 = 0.01, and k13 = 0.02, and initial conditions x1 (0) = 0.5, x2 (0) = 1, and x3 (0) = 1. While these parameters and initial conditions are arbitrary, they serve to illustrate the implications of Theorem 4.2. There is a monotonic decrease in the concentration of Compartment 3. However, the concentration of Compartment 1 increases, then decreases before settling into a monotonic decay. Alternatively, the concentration of Compartment 2 decreases, then increases before settling into a monotonic decay. If Compartment 2 is also identified as the site of the biological effect, for example a peripheral compartment comprised primarily of muscle, and hence, the site of action of muscle relaxants, then institution of CPB could be expected to result in a sudden decrease in the concentration of the muscle relaxant at its site of action, which, if the patient is treated with additional muscle relaxant, could result in a subsequent relative overdose.
NNBook
September 1, 2009
123
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
4.4 Monotonicity of Nonlinear Nonnegative Dynamical Systems In this section, we consider monotonicity of solutions over all time of nonlinear nonnegative dynamical systems. Specifically, we consider nonlinear dynamical systems G of the form x(t) ˙ = f (x(t)) + G(x(t))u(t),
x(0) = x0 ,
t ≥ 0,
(4.6)
where x ∈ Rn , u ∈ Rm , f : Rn → Rn , and G : Rn → Rn×m . We assume that f (·) and G(·) are continuously differentiable mappings and f (xe ) = 0, xe ∈ Rn . For the nonlinear dynamical system G given by (4.6) the definitions of monotonicity and partial monotonicity hold with (4.2) replaced by (4.6). The following definition generalizes Definition 4.2 to nonlinear systems. Definition 4.4. The nonlinear dynamical system given by (4.6) is n nonnegative if for every x(0) ∈ R+ and u(t) ≥≥ 0, t ≥ 0, the solution x(t), t ≥ 0, to (4.6) is nonnegative. The following proposition is required for the main theorem of this section. Proposition 4.3. Consider the nonlinear dynamical system G given by n (4.6). If f : Rn → Rn is essentially nonnegative and G(x) ≥≥ 0, x ∈ R+ , then G is nonnegative. △
△
Proof. Define x ˆ1 = x and x ˆ2 = t, so that (4.6) can be written as x ˆ˙ 1 (τ ) = f (ˆ x1 (τ )) + G(ˆ x1 (τ ))u(ˆ x2 (τ )), ˙x ˆ2 (τ ) = 1, x ˆ2 (0) = 0, or, equivalently,
x ˜˙ (τ ) = f˜(˜ x(t)),
x ˆ1 (0) = x0 ,
x ˜(0) = x ˜0 ,
τ ≥ 0,
(4.7) (4.8) (4.9)
where the differentiation in (4.7) and (4.8) is with respect to τ , x ˜ = [ˆ x1 , x ˆ2 ]T , T T x ˜0 = [x0 , 0] , and f˜(˜ x) = [f (ˆ x1 ) + G(ˆ x1 )u(ˆ x2 ), 1] . Next, define n+1
d(˜ x, R+ ) ,
infn+1 k˜ y−x ˜k,
y˜∈R+
x ˜ ∈ Rn+1 .
Now, since f (x) is essentially nonnegative and G(x) is nonnegative, it follows that for every i ∈ {1, . . . , n} such that xi = 0, xi + hx˙ i = hx˙ i ≥ 0 for h ≥ 0, whereas for every i ∈ {1, . . . , n} such that xi > 0, xi +hx˙ i > 0 for sufficiently n+1 small |h|. Thus, x ˜ + hf˜(˜ x) ∈ R+ for all sufficiently small h > 0, and hence, n+1 limh→0+ d(˜ x + hf˜(˜ x), R+ )/h = 0. Now, it follows from Lemma 2.1, with n+1 n x ˜(0) = x ˜, that x ˜(τ ) ∈ R+ for all τ ≥ 0. Hence, x(t) ∈ R+ for all t ≥ 0. Definition 4.5. Consider the nonlinear nonnegative dynamical system
NNBook
September 1, 2009
124
CHAPTER 4 n
(4.6) where x0 ∈ X0 ⊆ R+ , f : Rn → Rn is essentially nonnegative, G(x) ≥≥ n 0, x ∈ R+ , u(t), t ≥ 0, is nonnegative, and X0 denotes a set of initial n conditions contained in R+ . Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and △ T x ˆ(t) = [xk1 (t), . . . , xknˆ (t)] . The nonlinear nonnegative dynamical system (4.6) is partially monotonic with respect to x ˆ if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and, for every x0 ∈ X0 , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 , where x(t), t ≥ 0, denotes the solution to (4.6). The nonlinear nonnegative dynamical system (4.6) is monotonic if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and, for every x0 ∈ X0 , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 . Next, we present necessary and sufficient conditions for monotonicity of a nonlinear nonnegative dynamical system. Theorem 4.5. Consider the nonlinear nonnegative dynamical system n G given by (4.6) where x0 ∈ R+ , f : Rn → Rn is essentially nonnegative, n G(x) ≥≥ 0, x ∈ R+ , and u(t), t ≥ 0, is nonnegative. Let n ˆ ≤ n, △ T ˆ(t) = [xk1 (t), . . . , xknˆ (t)] . Then the {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x following statements hold: i ) If there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, Qf (x) ≤≤ 0, n n x ∈ R+ , and QG(x) ≤≤ 0, x ∈ R+ , then G is partially monotonic with respect to x ˆ. ii ) If u(t) ≡ 0, then G is partially monotonic with respect to x ˆ if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and Qf (x) ≤≤ 0, n x ∈ R+ . Proof. i) It follows from (4.6) that Qx(t) ˙ = Qf (x(t)) + QG(x(t))u(t),
x(0) = x0 ,
t ≥ 0,
which further implies that Qx(t2 ) = Qx(t1 ) +
Z
t2
[Qf (x(t)) + QG(x(t))u(t)]dt.
t1 n
Next, since f : Rn → Rn is essentially nonnegative, G(x) ≥≥ 0, x ∈ R+ , and u(t), t ≥ 0, is nonnegative it follows from Proposition 4.3 that x(t) ≥≥ 0, n t ≥ 0. Hence, since −Qf (x) and −QG(x) are nonnegative for all x ∈ R+ it follows that Qf (x(t)) ≤≤ 0 and QG(x(t))u(t) ≤≤ 0, t ≥ 0, which implies n that, for every x0 ∈ R+ , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 .
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
125
ii) Sufficiency follows from i) with u(t) ≡ 0. To show necessity assume that G with u(t) ≡ 0 is partially monotonic with respect to x ˆ. In this case, it follows from (4.6) that Qx(t) ˙ = Qf (x(t)),
x(0) = x0 ,
t ≥ 0,
which further implies that, for every τ > 0, Z τ Qx(τ ) = Qx0 + Qf (x(t))dt. 0
n
Now, suppose, ad absurdum, that there exist J ∈ {1, 2, . . . , n} and x0 ∈ R+ such that [Qf (x0 )]J > 0. Since the mapping Qf (·) and the solution x(t), t ≥ 0, to (4.6) are continuous it follows that there exists τ > 0 such that [Qf (x(t))]J > 0, 0 ≤ t ≤ τ , which implies that [Qx(τ )]J > [Qx0 ]J , which is n a contradiction. Hence, Qf (x) ≤≤ 0, x ∈ R+ . Corollary 4.3. Consider the nonlinear nonnegative dynamical system n G given by (4.6) where x0 ∈ R+ , f : Rn → Rn is essentially nonnegative, n G(x) ≥≥ 0, x ∈ R+ , and u(t), t ≥ 0, is nonnegative. Then the following statements hold: i ) If there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], n qi = ±1, i = 1, . . . , n, Qf (x) ≤≤ 0, x ∈ R+ , and QG(x) ≤≤ 0, n x ∈ R+ , then G is monotonic. ii ) If u(t) ≡ 0, then G is monotonic if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and n Qf (x) ≤≤ 0, x ∈ R+ . Proof. The proof is a direct consequence of Theorem 4.5 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Corollary 4.3 provides some interesting ramifications with regards to the absence of limit cycles of inflow-closed nonlinear compartmental systems. To see this, consider the inflow-closed (u(t) ≡ 0) compartmental system (4.6) where f (x) = [f1 (x), . . . , fn (x)]T is such that fi (x) = −aii (x) +
n X
j=1,i6=j
[aij (x) − aji (x)],
i = 1, . . . , n,
(4.10)
and where the instantaneous rates of compartmental material losses aii (·), i = 1, . . . , n, and intercompartmental material flows aij (·), i 6= j, i, j = n 1, . . . , n, are such that aii (x) ≥ 0 and aij (x) ≥ 0, x ∈ R+ , i, j = 1, . . . , n. Since all mass flows as well as compartment sizes are nonnegative, it follows
NNBook
September 1, 2009
126
CHAPTER 4 n
that, for all i = 1, . . . , n, fi (x) ≥ 0 for all x ∈ R+ whenever xi = 0 and whatever the values of xj , j = 6 i. Hence, f is essentially nonnegative. As shown in Chapter 2, inflow-closed nonlinear compartmental systems are Lyapunov stable since the total mass in the system given by the sum of all components of the state x(t), t ≥ 0, is nonincreasing along the forward trajectories of (4.6). Recall that with V (x) = eT x and assuming aij (0) = 0, i, j = 1, . . . , n, it follows that V˙ (x) = eT f (x) n X = x˙ i i=1
= − = − ≤ 0,
n X
i=1 n X
aii (x) +
n n X X
i=1 j=1,i6=j
[aij (x) − aji (x)]
aii (x)
i=1
n
x ∈ R+ ,
(4.11)
which shows that the zero solution x(t) ≡ 0 of the inflow-closed nonlinear compartmental system (4.6) is Lyapunov stable, and hence, for every x0 ∈ n R+ , the solution to (4.6) is bounded. However, unlike the case of linear compartmental systems, the zero solution x(t) ≡ 0 to (4.6) with u(t) ≡ 0 is not necessarily convergent. In fact, (4.6) with f (x) given by (4.10) can exhibit limit cycles, bifurcations, and even chaos [158]. In light of the above, it is of interest to determine sufficient conditions under which masses/concentrations for nonlinear compartmental systems are Lyapunov stable and convergent, guaranteeing the absence of limit cycling behavior. The following result is a direct consequence of Corollary 4.3 and provides sufficient conditions for the absence of limit cycles in nonlinear compartmental systems. Theorem 4.6. Consider the nonlinear nonnegative dynamical system G given by (4.6) with u(t) ≡ 0 and f (x) = [f1 (x), . . . , fn (x)]T such that (4.10) holds. If there exists a matrix Q ∈ Rn×n such that Q = n diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and Qf (x) ≤≤ 0, x ∈ R+ , then, n for every x0 ∈ R+ , limt→∞ x(t) exists. n
Proof. Let V (x) = eT x, x ∈ R+ . Now, it follows from (4.11) that V˙ (x(t)) ≤ 0, t ≥ 0, where x(t), t ≥ 0, denotes the solution of G, which n implies that V (x(t)) ≤ V (x0 ) = eT x0 , t ≥ 0, and hence, for every x0 ∈ R+ , the solution x(t), t ≥ 0, of G is bounded. Hence, for every i ∈ {1, . . . , n},
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
127
xi (t), t ≥ 0, is bounded. Furthermore, it follows from Corollary 4.3 that xi (t), t ≥ 0, is monotonic. Now, since xi (·), i ∈ {1, . . . , n}, is continuous and every bounded nonincreasing or nondecreasing scalar sequence converges to a finite real number, it follows from the monotone convergence theorem [112, p. 37] that limt→∞ xi (t), i = 1, . . . , n, exists. Hence, limt→∞ x(t) exists.
4.5 Monotonicity of Discrete-Time Linear Nonnegative Dynamical Systems In this section, we present analogous results to Section 4.2 for discretetime, linear nonnegative dynamical systems. Specifically, we consider monotonicity of solutions of dynamical systems of the form given by x(k + 1) = Ax(k) + Bu(k),
x(0) = x0 ,
k ∈ Z+ ,
(4.12)
where x ∈ Rn , u ∈ Rm , A ∈ Rn×n , and B ∈ Rn×m . The following definition and proposition are needed for the main results of this section. Definition 4.6. The linear dynamical system given by (4.12) is n nonnegative if for every x(0) ∈ R+ and u(k) ≥≥ 0, k ∈ Z+ , the solution x(k), k ∈ Z+ , to (4.12) is nonnegative. Proposition 4.4. The linear dynamical system given by (4.12) is nonnegative if and only if A ∈ Rn×n is nonnegative and B ∈ Rn×m is nonnegative. by
Proof. First, note that the solution x(k), k ∈ Z+ , to (4.12) is given k
x(k) = A x0 +
k−1 X i=0
A(k−1−i) Bu(i),
k ∈ Z+ .
Now, if A is nonnegative, then it follows that Ak ≥≥ 0, k ∈ Z+ , and if n B ≥≥ 0, then it follows that x(k) ≥≥ 0 for all k ∈ Z+ and x(0) ∈ R+ , which implies that G is nonnegative. Conversely, suppose G is nonnegative. Now, with u(k) = 0, k ∈ Z+ , n x(k) = Ak x0 it follows that if x(1) ≥≥ 0 for all x0 ∈ R+ , then A is nonnegative. Finally, let x0 = 0 and let u(0) > 0, u(k) = 0, k ∈ Z+ , m k > 0. In this case, since x(1) = Bu(0) ≥≥ 0 for all u(0) ∈ R+ , it follows that B ≥≥ 0, which proves the result. Next, we give a discrete-time analog to Definition 4.3. Definition 4.7. Consider the discrete-time, linear nonnegative dynamn ical system (4.12) where x0 ∈ X0 ⊆ R+ , A is nonnegative, B is nonnegative,
NNBook
September 1, 2009
128
CHAPTER 4
u(k), k ∈ Z+ , is nonnegative, and X0 denotes a set of feasible initial n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, conditions contained in R+ . Let n △ T and x ˆ(k) = [xk1 (k), . . . , xknˆ (k)] . The discrete-time, linear nonnegative dynamical system (4.12) is partially monotonic with respect to x ˆ if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and, for every x0 ∈ X0 , Qx(k2 ) ≤≤ Qx(k1 ), 0 ≤ k1 ≤ k2 , where x(k), k ∈ Z+ , denotes the solution to (4.12). The discrete-time, linear nonnegative dynamical system (4.12) is monotonic if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and, for every x0 ∈ X0 , Qx(k2 ) ≤≤ Qx(k1 ), 0 ≤ k1 ≤ k2 . Next, we present a sufficient condition for monotonicity of a discretetime, linear nonnegative dynamical system. Theorem 4.7. Consider the discrete-time, linear nonnegative dynamn ical system given by (4.12) where x0 ∈ R+ , A ∈ Rn×n is nonnegative, B ∈ Rn×m is nonnegative, and u(k), k ∈ Z+ , is nonnegative. Let △ n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(k) = [xk1 (k), . . . , xknˆ (k)]T . Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and QA ≤≤ Q and QB ≤≤ 0. Then the discrete-time, linear nonnegative dynamical system (4.12) is partially monotonic with respect to x ˆ. Proof. It follows from (4.12) that Qx(k + 1) = QAx(k) + QBu(k),
x(0) = x0 ,
k ∈ Z+ ,
which implies that Qx(k2 ) = Qx(k1 ) +
kX 2 −1
k=k1
[Q(A − I)x(k) + QBu(k)].
Next, since A and B are nonnegative and u(k), k ∈ Z+ , is nonnegative it follows from Proposition 4.4 that x(k) ≥≥ 0, k ∈ Z+ . Hence, since −Q(A − I) and −QB are nonnegative it follows that Q(A − I)x(k) ≤≤ n 0 and QBu(k) ≤≤ 0, k ∈ Z+ , which implies that, for every x0 ∈ R+ , Qx(k2 ) ≤≤ Qx(k1 ), 0 ≤ k1 ≤ k2 . Corollary 4.4. Consider the discrete-time, linear nonnegative dynamn ical system given by (4.12) where x0 ∈ R+ , A ∈ Rn×n is nonnegative, B ∈ Rn×m is nonnegative, and u(k), k ∈ Z+ , is nonnegative. Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and QA ≤≤ Q and QB ≤≤ 0 are nonnegative. Then the discrete-time, linear nonnegative dynamical system given by (4.12) is
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
129
monotonic. Proof. The proof is a direct consequence of Theorem 4.7 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Next, we present partial converses to Theorem 4.7 and Corollary 4.4 in the case where u(k) ≡ 0. Theorem 4.8. Consider the discrete-time, linear nonnegative dynamn ical system given by (4.12) where x0 ∈ R+ , A ∈ Rn×n is nonnegative, △ ˆ(k) = and u(k) ≡ 0. Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x [xk1 (k), . . . , xknˆ (k)]T . The discrete-time, linear nonnegative dynamical system (4.12) is partially monotonic with respect to x ˆ if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and QA ≤≤ Q. Proof. Sufficiency follows from Theorem 4.7 with u(k) ≡ 0. To show necessity assume the discrete-time, linear dynamical system given by (4.12) with u(k) ≡ 0 is partially monotonic with respect to x ˆ. In this case, it follows from (4.12) that Qx(k + 1) = QAx(k),
x(0) = x0 ,
k ∈ Z+ ,
which further implies that Qx(k2 ) = Qx(k1 ) +
kX 2 −1
k=k1
[Q(A − I)Ak x0 ].
Now, suppose, ad absurdum, that there exist I, J ∈ {1, 2, . . . , n} such that n △ M(I,J) > 0, where M = QA − Q. Next, let x0 ∈ R+ be such that x0J > 0 △ and x0i = 0, i 6= J, and define v(k) = Ak x0 so that v(0) = x0 , v(k) ≥≥ 0, k ∈ Z+ , and vJ (0) > 0. Thus, it follows that [Qx(1)]J = [Qx0 ]J + [M v(0)]J = [Qx0 ]J + M(I,J) vJ (0) > [Qx0 ]J , which is a contradiction. Hence, QA ≤≤ Q. Corollary 4.5. Consider the discrete-time, linear nonnegative dynamn ical system given by (4.12) where x0 ∈ R+ , A ∈ Rn×n is nonnegative, and u(k) ≡ 0. The linear nonnegative dynamical system (4.12) is monotonic if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, 2, . . . , n, and QA ≤≤ Q. Proof. The proof is a direct consequence of Theorem 4.8 with n ˆ=n
NNBook
September 1, 2009
130
CHAPTER 4
and {k1 , . . . , knˆ } = {1, . . . , n}. Finally, we present a sufficient condition for weighted monotonicity of a discrete-time, linear nonnegative dynamical system. Proposition 4.5. Consider the discrete-time, linear dynamical system △ given by (4.12) where A is nonnegative, u(k) ≡ 0, x0 ∈ X0 = {x0 ∈ Rn : S(A − I)x0 ≤≤ 0}, where S ∈ Rn×n is an invertible matrix. If SAS −1 is nonnegative, then, for every x0 ∈ X0 , Sx(k2 ) ≤≤ Sx(k1 ), 0 ≤ k1 ≤ k2 . △
n R+ .
Proof. Let y(k) = −S(A−I)x(k) and note that y(0) = −S(A−I)x0 ∈ Hence, it follows from (4.12) that y(k + 1) = = = =
−S(A − I)x(k + 1) −S(A − I)Ax(k) −SAS −1 S(A − I)x(k) SAS −1 y(k). n
Next, since SAS −1 is nonnegative, it follows that y(k) ∈ R+ , k ∈ Z+ . Now, the result follows immediately by noting that y(k) = −S(A − I)x(k) >> 0,
k ∈ Z+ ,
and hence, S(A−I)x(k) ≤≤ 0, k ∈ Z+ , or, equivalently, Sx(k+1) ≤≤ Sx(k), k ∈ Z+ , which implies that Sx(k2 ) ≤≤ Sx(k1 ), 0 ≤ k1 ≤ k2 . Example 4.4. In this example, we use the results of this section to provide a taxonomy of linear three-dimensional, discrete-time inflowclosed compartmental dynamical systems that exhibit monotonic solutions. A similar classification can be obtained for nonlinear and higher-order compartmental systems but we do not do so here for simplicity of exposition. To characterize the class of all three-dimensional monotonic compartmental △ systems, let Q = {Q ∈ R3×3 : Q = diag[q1 , q2 , q3 ], qi = ±1, i = 1, 2, 3}. Furthermore, let A ∈ R3×3 be a compartmental matrix and let x1 (k), x2 (k), x3 (k), k ∈ Z+ , denote compartmental masses for compartments 1, 2, and 3, respectively. Note that there are exactly eight matrices in the set Q. Now, it follows from Corollary 4.5 that if QA ≤≤ Q, Q ∈ Q, then the corresponding compartmental dynamical system is monotonic. Hence, for every Q ∈ Q we seek all compartmental matrices A ∈ R3×3 such that qi A(i,i) ≤ qi , i = 1, 2, 3 and qi A(i,j) ≤ 0, i 6= j, i, j = 1, 2, 3. First, we consider the case where Q = diag[1, 1, 1]. In this case, qi A(i,i) ≤ qi , i = 1, 2, 3 and qi A(i,j) ≤ 0, i 6= j, i, j = 1, 2, 3, if and only if A(1,2) = A(1,3) = A(2,1) = A(3,1) = A(3,2) = A(2,3) = 0. This corresponds to a trivial (decoupled) case since there are no intercompartmental flows between the three compartments (see Figure 4.3 (a)). Next, let Q = diag[1, −1, −1]
NNBook
September 1, 2009
131
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
a11 x1 (k )
a11 x1 (k)
Compartment 1
Compartment 1
x1 (k )
x1 (k)
a21 x1 (k)
Compartment 2
Compartment 3
x2 (k )
Compartment 2
x3 (k )
a22 x2 (k )
a31 x1 (k)
Compartment 3
x2 (k)
x3 (k)
x2 (k)
a33 x3 (k )
x3 (k)
(a)
(b) x1 (k) Compartment 1
x1 (k)
a12 x2 (k)
a13 x3 (k)
Compartment 2
Compartment 3
x2 (k)
x3 (k)
a22 x2 (k)
a33 x3 (k)
(c) Figure 4.3 Three-dimensional monotonic compartmental systems.
and note that qi A(i,i) ≤ qi , i = 1, 2, 3 and qi A(i,j) ≤ 0, i 6= j, i, j = 1, 2, 3, if and only if A(2,2) = A(3,3) = 1 and A(1,2) = A(1,3) = A(2,3) = A(3,2) = 0. Figure 4.3 (b) shows the compartmental structure for this case. Finally, let Q = diag[−1, 1, 1]. In this case, qi A(i,i) ≤ qi , i = 1, 2, 3 and qi A(i,j) ≤ 0, i 6= j, i, j = 1, 2, 3, if and only if A(1,1) = 1 and A(2,1) = A(3,1) = A(3,2) = A(2,3) = 0. Figure 4.3 (c) shows the corresponding compartmental structure. It is important to note that in the case where Q = diag[−1, −1, −1], there does not exist a compartmental matrix satisfying QA ≤≤ Q except for the identity matrix. This case would correspond to a compartmental dynamical system where all three states are monotonically increasing. Hence, the compartmental system would be unstable, contradicting the fact that all compartmental systems are Lyapunov stable. Finally, the remaining four cases corresponding to Q = diag[−1, 1, −1], Q = diag[−1, −1, 1], Q = diag[1, −1, 1], and Q = diag[1, 1, −1] are dual to the cases where Q = diag[1, −1, −1] and Q = diag[−1, 1, 1] and, hence, are not presented here. △
NNBook
September 1, 2009
132
CHAPTER 4
4.6 Monotonicity of Discrete-Time Nonlinear Nonnegative Dynamical Systems In this section, we extend the results of Section 4.5 to nonlinear nonnegative dynamical systems. Specifically, we consider discrete-time, nonlinear dynamical systems G of the form x(k + 1) = f (x(k)) + G(x(k))u(k),
x(0) = x0 , n
k ∈ Z+ , (4.13)
where x(k) ∈ D, D is a relatively open subset of R+ with 0 ∈ D, u(k) ∈ Rm , f : D → Rn , and G : D → Rn×m . We assume that f (·) and G(·) are continuous in D and f (xe ) = xe , xe ∈ D. For the nonlinear dynamical system G given by (4.13) the definitions of monotonicity and partial monotonicity hold with (4.12) replaced by (4.13). The following definition generalizes Definition 4.6 to nonlinear systems. Definition 4.8. The nonlinear dynamical system (4.13) is nonnegative n if for every x(0) ∈ R+ and u(k) ≥≥ 0, k ∈ Z+ , the solution x(k), k ∈ Z+ , to (4.13) is nonnegative. Proposition 4.6. Consider the discrete-time, nonlinear dynamical system G given by (4.13). If f : D → Rn is nonnegative and G(x) ≥≥ 0, n x ∈ R+ , then G is nonnegative. n
Proof. Let x(0) ∈ R+ , u(k) ≡ 0, and suppose f : D → Rn is n nonnegative and G(x) ≥≥ 0, x ∈ R+ . For every i ∈ {1, . . . , n} it follows that xi (k + 1) = fi (x(k)) ≥≥ 0. Hence, x(k + 1) = f (x(k)) ≥≥ 0, k ∈ Z+ . Furthermore, for u(k) ≥≥ 0, k ∈ Z+ , it follows that x(k + 1) = n f (x(k)) + G(x(k))u(k) ≥≥ 0, k ∈ Z+ . Thus, x(k) ∈ R+ , k ∈ Z+ . Hence, G is nonnegative. Next, we present a sufficient condition for monotonicity of a nonlinear nonnegative dynamical system. Theorem 4.9. Consider the discrete-time, nonlinear nonnegative dyn namical system G given by (4.13) where x0 ∈ R+ , f : D → Rn is nonnegative, n ˆ ≤ n, G(x) ≥≥ 0, x ∈ R+ , and u(k), k ∈ Z+ , is nonnegative. Let n △ {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(k) = [xk1 (k), . . . , xknˆ (k)]T . Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, n i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, Qf (x) ≤≤ Qx, x ∈ R+ , n and QG(x) ≤≤ 0, x ∈ R+ . Then the discrete-time, nonlinear nonnegative dynamical system G is partially monotonic with respect to x ˆ. Proof. The proof is similar to the proof of Theorem 4.7 with Proposition 4.6 invoked in place of Proposition 4.4.
NNBook
September 1, 2009
133
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
Corollary 4.6. Consider the discrete-time, nonlinear nonnegative dyn namical system G given by (4.13) where x0 ∈ R+ , f : D → Rn is nonnegative, n G(x) ≥≥ 0, x ∈ R+ , and u(k), k ∈ Z+ , is nonnegative. Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, n n Qf (x) ≤≤ Qx, x ∈ R+ , and QG(x) ≤≤ 0, x ∈ R+ . Then the discrete-time, nonlinear nonnegative dynamical system G is monotonic. Proof. The proof is a direct consequence of Theorem 4.9 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Next, we present necessary and sufficient conditions for partial monotonicity and monotonicity of (4.13) in the case where u(k) ≡ 0. Theorem 4.10. Consider the discrete-time, nonlinear nonnegative n dynamical system G given by (4.13) where x0 ∈ R+ , f : D → Rn is nonnegative, and u(k) ≡ 0. Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, △ and x ˆ(k) = [xk1 (k), . . . , xknˆ (k)]T . The discrete-time, nonlinear nonnegative dynamical system G is partially monotonic with respect to x ˆ if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, n i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and Qf (x) ≤≤ Qx, x ∈ R+ . Proof. Sufficiency follows from Theorem 4.9 with u(k) ≡ 0. To show necessity, assume that the nonlinear dynamical system given by (4.13) with u(k) ≡ 0 is partially monotonic with respect to x ˆ. In this case, it follows from (4.13) that Qx(k + 1) = Qf (x(k)),
x(0) = x0 ,
k ∈ Z+ ,
which implies that, for every k ∈ Z+ , Qx(k2 ) = Qx(k1 ) +
kX 2 −1
k=k1
[Qf (x(k)) − Qx(k)]. n
Now, suppose, ad absurdum, there exist J ∈ {1, 2, . . . , n} and x0 ∈ R+ such that [Qf (x0 ))]J > [Qx0 ]J . Hence, [Qx(1)]J = [Qx0 ]J + [Qf (x0 ) − Qx0 ]J > [Qx0 ]J , n
which is a contradiction. Hence, Qf (x) ≤≤ Qx, x ∈ R+ . Corollary 4.7. Consider the discrete-time, nonlinear nonnegative dyn namical system G given by (4.13) where x0 ∈ R+ , f : D → Rn is nonnegative, and u(k) ≡ 0. The discrete-time, nonlinear nonnegative dynamical system G is monotonic if and only if there exists a matrix Q ∈ Rn×n such that n Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and Qf (x) ≤≤ Qx, x ∈ R+ .
NNBook
September 1, 2009
134
CHAPTER 4
Proof. The proof is a direct consequence of Theorem 4.10 with n ˆ=n and {k1 , . . . , knˆ } = {1, . . . , n}. Corollary 4.7 provides some interesting ramifications with regard to the absence of limit cycles of inflow-closed, discrete-time nonlinear compartmental systems. To see this, consider the inflow-closed (u(k) ≡ 0) compartmental system (4.13) where f (x) = [f1 (x), . . . , fn (x)] is such that fi (x) = xi − aii (x) +
n X
j=1,i6=j
[aij (x) − aji (x)],
i = 1, . . . , n,
(4.14)
and where the instantaneous rates of compartmental material losses aii (·), i = 1, . . . , n, and intercompartmental material flows aij (·), i 6= j, i, j = n 1, . . . , n, are such that aij (x) ≥ 0, x ∈ R+ , i, j = 1, . . . , n. Since all mass flows as well as compartment sizes are nonnegative, it follows that for all n i = 1, . . . , n, fi (x) ≥ 0 for all x ∈ R+ . Hence, f is nonnegative. As shown in Chapter 2, inflow-closed nonlinear compartmental systems are Lyapunov stable since the total mass in the system given by the sum of all components of the state x(k), k ∈ Z+ , is nonincreasing along the forward trajectories of (4.13). Recall that with V (x) = eT x and assuming aij (0) = 0, i, j = 1, . . . , n, it follows that ∆V (x) = eT f (x) − eT x n X = ∆xi i=1
= − = − ≤ 0,
n X
aii (x) +
i=1
n X
n n X X
i=1 j=1,i6=j
[aij (x) − aji (x)]
aii (x)
i=1
n
x ∈ R+ ,
(4.15)
which shows that the zero solution x(k) ≡ 0 of the inflow-closed nonlinear compartmental system (4.13) is Lyapunov stable, and hence, for every n x0 ∈ R+ , the solution to (4.13) is bounded. The following result is a direct consequence of Corollary 4.7 and provides sufficient conditions for the absence of limit cycles in discrete-time nonlinear compartmental systems. Theorem 4.11. Consider the nonlinear nonnegative dynamical system G given by (4.13) with u(k) ≡ 0 and f (x) = [f1 (x), . . . , fn (x)] such that (4.14) holds. If there exists a matrix Q ∈ Rn×n such that Q = n diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and Qf (x) ≤≤ Qx, x ∈ R+ , then, for n every x0 ∈ R+ , limk→∞ x(k) exists.
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
135
n
Proof. Let V (x) = eT x, x ∈ R+ . Now, it follows from (4.15) that ∆V (x(k)) ≤ 0, k ∈ Z+ , where x(k), k ∈ Z+ , denotes the solution of G, which implies that V (x(k)) ≤ V (x0 ) = eT x0 , k ∈ Z+ , and hence, for n every x0 ∈ R+ , the solution x(k), k ∈ Z+ , of G is bounded. Hence, for every i ∈ {1, . . . , n}, xi (k), k ∈ Z+ , is bounded. Furthermore, it follows from Corollary 4.7 that xi (k), k ∈ Z+ , is monotonic. Now, since xi (·), i ∈ {1, . . . , n}, is bounded and monotonic, it follows that limk→∞ xi (k), i = 1, . . . , n, exists. Hence, limk→∞ x(k) exists.
4.7 Monotonicity of Nonnegative Dynamical Systems with Time Delay Pharmacokinetic models with time delay can introduce oscillations in system solutions that may otherwise be nonoscillatory in the absence of time delay [155, 207]. Since drug concentrations should monotonically decline after discontinuation of drug administration, it is of interest to determine necessary and sufficient conditions under which these systems possess monotonic solutions. In this section, necessary and sufficient conditions are developed for identifying nonnegative and compartmental dynamical systems that admit only nonoscillatory and monotonic solutions in the presence of time lags. Consider the linear time-delay dynamical system G given by x(t) ˙ = Ax(t) + Ad x(t − τ ) + Bu(t),
t ≥ 0, (4.16) where x(t) ∈ Rn , u(t) ∈ Rm , t ≥ 0, A ∈ Rn×n , Ad ∈ Rn×n , B ∈ Rl×m , τ ≥ 0, φ(·) ∈ C = C([−τ, 0], Rn ) is a continuous vector-valued function specifying the initial state of the system, and C([−τ, 0], Rn ) denotes a Banach space of continuous functions mapping the interval [−τ, 0] into Rn with the topology of uniform convergence. x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
The following definition is needed for the main results in this section. Definition 4.9. The linear time-delay dynamical system G given by △ (4.16) is nonnegative if for every φ(·) ∈ C+ , where C+ = {ψ(·) ∈ C : ψ(θ) ≥≥ 0, θ ∈ [−τ, 0]}, and u(t) ≥≥ 0, t ≥ 0, the solution x(t), t ≥ 0, to (4.16) is nonnegative. Proposition 4.7. The linear time-delay dynamical system G given by (4.16) is nonnegative if and only if A ∈ Rn×n is essentially nonnegative, Ad ∈ Rn×n is nonnegative, and B ≥≥ 0.
NNBook
September 1, 2009
136
CHAPTER 4
Proof. First, note that the solution to (4.16) is given by Z t x(t) = eAt x(0) + eA(t−θ) [Ad x(θ − τ ) + Bu(θ)]dθ 0 Z t−τ Z t At A(t−τ −θ) = e φ(0) + e Ad x(θ)dθ + eA(t−θ) Bu(θ)dθ. (4.17) −τ
0
Now, if A is essentially nonnegative, then it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0; and if φ(·) ∈ C+ , Ad ≥≥ 0, and B ≥≥ 0, then it follows that Z t−τ Z t At A(t−τ −θ) x(t) = e φ(0) + e Ad x(θ)dθ + eA(t−θ) Bu(θ)dθ ≥≥ 0, −τ
0
t ∈ [0, τ ),
(4.18)
and y(t) ≥≥ 0 for all t ∈ [0, τ ). Alternatively, for all t > τ , Z t Z τ eA(t−θ) Bu(θ)dθ, x(t) = eAτ x(t − τ ) + eA(τ −θ) Ad x(t + θ − 2τ )dθ + 0
0
(4.19) and hence, since x(t) ≥≥ 0, t ∈ [−τ, τ ), it follows that x(t) ≥≥ 0, t ∈ [τ, 2τ ). Repeating this procedure iteratively, it follows that x(t) ≥≥ 0, t ≥ 0, which implies that G is nonnegative. Conversely, suppose G is nonnegative. Now, let φ(θ) = 0, −τ ≤ θ ≤ 0, and let u(t) = δ(t − tˆ)ˆ u, t, tˆ ∈ [0, τ ), where δ(·) denotes the Dirac delta m function and u ˆ ≥≥ 0. In this case, since x(tˆ) = B u ˆ ≥≥ 0 for all u ˆ ∈ R+ it follows that B ≥≥ 0. Furthermore, with u(t) = 0, φ(θ) = 0, −τ ≤ θ ≤ 0, x(t) = eAt φ(0), t ∈ [0, τ ), and hence, it follows from Proposition 2.5 that n if x(t) ≥≥ 0, t ≥ 0, for all φ(0) ∈ R+ , then A is essentially nonnegative. Finally, suppose, ad absurdum, that Ad is not nonnegative, that is, there exist I, J ∈ {1, 2, ...., n} such that Ad(I,J) < 0. Let u(t) = 0, t ≥ 0, and let {vn }∞ n=1 ⊂ C+ denote a sequence of functions such that limn→∞ vn (θ) = eJ δ(θ + η − τ ), where 0 < η < τ and δ(·) denotes the Dirac delta function. In this case, it follows from (4.17) that Z η Aη xn (t) = e vn (0) + eA(η−θ) Ad x(θ − τ )dθ, (4.20) 0
which implies that x(η) = limn→∞ xn (η) = eAη Ad eJ . Now, by choosing η sufficiently small it follows that xI (η) < 0, which is a contradiction. Next, we present a definition for the monotonicity of solutions over all time for a time-delay nonnegative dynamical system of the form given by (4.16). Definition 4.10. Consider the linear nonnegative time-delay dynam-
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
137
ical system (4.16) where φ(·) ∈ C+ , A is essentially nonnegative, Ad is nonnegative, B is nonnegative, and u(t), t ≥ 0, is nonnegative. Let n ˆ ≤ n, △ ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . The linear {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x nonnegative time delay dynamical system (4.16) is partially monotonic with respect to x ˆ if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and, for every φ(·) ∈ C+ , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 , where x(t), t ≥ 0, denotes the solution to (4.16). The linear nonnegative time delay dynamical system (4.16) is monotonic if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, . . . , n, and, for every φ(·) ∈ C+ , Qx(t2 ) ≤≤ Qx(t1 ), 0 ≤ t1 ≤ t2 . Next, we present necessary and sufficient conditions that guarantee partial monotonicity and monotonicity for nonnegative dynamical systems with time delay. Theorem 4.12. Consider the linear time-delay nonnegative dynamical system given by (4.16) where φ(·) ∈ C+ , A ∈ Rn×n is essentially nonnegative, Ad ∈ Rn×n is nonnegative, B ∈ Rl×m is nonnegative, and u(t), t ≥ 0, △ is nonnegative. Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, and QA ≤≤ 0, QAd ≤≤ 0, and QB ≤≤ 0. Then the linear nonnegative dynamical system (4.16) is partially monotonic with respect to x ˆ. Proof. The proof is a direct consequence of Theorem 4.2 with B replaced by [Ad B] and u(t), t ≥ 0, replaced by [xT (t − τ ) uT (t)]T , t ≥ 0. The following result gives necessary and sufficient conditions for monotonicity in the case where u(t) ≡ 0. Theorem 4.13. Consider the linear time-delay nonnegative dynamical system given by (4.16) where φ(·) ∈ C+ , A ∈ Rn×n is essentially nonnegative, Ad ∈ Rn×n is nonnegative, and u(t) ≡ 0. Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ △ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . Then the linear time delay dynamical system is partially monotonic with respect to x ˆ if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, QA ≤≤ 0, and QAd ≤≤ 0. Proof. Sufficiency follows from Theorem 4.12 with u(t) ≡ 0. To show necessity, assume the linear time-delay dynamical system given by (4.16) is partially monotonic with respect to x ˆ. In this case, it follows from (4.16) that Qx(t) ˙ = QAx(t) + QAd x(t − τ ),
x(θ) = φ(θ),
−τ ≤ θ ≤ 0,
t ≥ 0,
NNBook
September 1, 2009
138
CHAPTER 4
which implies that, for some t1 ≥ 0 and t2 > t1 , Z t2 Qx(t2 ) = Qx(t1 ) + [QAx(t) + QAd x(t − τ )]dt. t1
Now, suppose, ad absurdum, that there exist I, J ∈ {1, 2, . . . , n} such that M(I,J) > 0, where M , QA. Next, let φ(·) ∈ C+ be such that φ(t) = 0, −τ < t < η − τ and let φ(0) = eJ , where τ > η > 0 and eJ ∈ Rn is a vector of zeros with one in the Jth component. Next, it follows from continuity of solutions that there exists 0 < ε ≤ η such that xJ (t) > 0, 0 ≤ t ≤ ε. Thus, for every t ∈ [0, η], it follows that Z t [Qx(t)]I = [Qx(0)]I + [QAx(s) + QAd x(s − τ )]I ds 0 Z t−τ = [Qx(0)]I + [QAx(s + τ ) + QAd x(s)]I ds −τ t−τ
= [Qx(0)]I + > [Qx(0)]I ,
Z
−τ
[QAx(s + τ )]I ds (4.21)
which is a contradiction. Hence, QA ≤≤ 0. Now, suppose, ad absurdum, that there exist I, J ∈ {1, 2, . . . , n} such that M(I,J) > 0, where M , QAd . Next, let {vn }∞ n=1 ⊂ C+ denote a sequence of functions such that limn→∞ vn (t) = eJ δ(t − η + τ ), where 0 < η < τ and δ(·) denotes the Dirac delta function. Furthermore, let φ(·) ∈ C+ be such that φ(t) = limn→∞ vn (t), −τ < t < 0. In this case, it follows from (4.21) that Z t [QAxn (s) + QAd xn (s − τ )]ds Qxn (t) = Qvn (0) + 0 Z t−τ = [QAvn (s + τ ) + QAd vn (s)]ds, −τ
where xn (·) denotes the solution to (4.16) with φ(·) = vn (t). Now, note that x ˆ(t) , limn→∞ [Qxn (t)]I = QAd eJ . Hence, x ˆI (t) = [Qx(t)]I > [Qx(0)]I = x ˆI (0) = 0. Thus, there exists n > 0 such that φ(t) = vn (t) implies [Qx(t)]I > [Qx(0)] and, hence, QAd ≤≤ 0. Corollary 4.8. Consider the linear time-delay dynamical system given by (4.16) where φ(·) ∈ C+ , A ∈ Rn×n is essentially nonnegative, Ad ∈ Rn×n is nonnegative, and u(t) ≡ 0. The linear time-delay dynamical system is monotonic if and only if there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = ±1, i = 1, 2, . . . , n, QA ≤≤ 0, and QAd ≤≤ 0. Proof. The proof is a direct consequence of Theorem 4.13 with n ˆ=n
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
139
and {k1 , . . . , knˆ } = {1, . . . , n}. Example 4.5. In this example, we use the results of this section to provide a taxonomy of linear three-dimensional, inflow-closed (i.e., u(t) ≡ 0) compartmental dynamical systems with time delay that exhibit monotonic solutions. To characterize the class of all three-dimensional monotonic compartmental systems with time delay, let Q , {Q ∈ R3×3 : Q = diag[q1 , q2 , q3 ], qi = ±1, i = 1, 2, 3}. It was shown in Chapter 3 that a compartmental dynamical system with time delay satisfies the property that A ∈ Rn×n is essentially nonnegative, Ad ∈ Rn×n is nonnegative, and A + Ad is a compartmental matrix. Let x1 (t), x2 (t), and x3 (t), t ≥ 0, denote compartmental masses for Compartments 1, 2, and 3, respectively. Note that there are exactly eight matrices in the set Q. Now, it follows from Corollary 4.8 that if QA ≤≤ 0 and QAd ≤≤ 0, Q ∈ Q, then the corresponding compartmental dynamical system is monotonic. Hence, for every Q ∈ Q we seek all matrices A ∈ R3×3 and Ad ∈ R3×3 such that qi A(i,j) ≤ 0 and qi Ad(i,j) ≤ 0, i, j = 1, 2, 3. First, we consider the case where Q = diag[1, 1, 1]. In this case, qi A(i,j) ≤ 0 and qi Ad(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(1,2) = A(1,3) = A(2,1) = A(3,1) = A(3,2) = A(2,3) = 0. Similarly, qi Ad(i,j) ≤ 0 if and only if Ad = 0. This corresponds to the trivial (decoupled) case since there are no intercompartmental flows between the three compartments (see Figure 4.1 (a)). Next, let Q = diag[1, −1, 1] and note that qi Ad(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(1,2) = A(1,3) = 0. In addition, since A + Ad is a compartmental matrix, it follows that A(2,2) = A(3,2) = A(2,3) = A(3,3) = 0. Figure 4.1 (b) shows the compartmental structure for this case. Finally, let Q = diag[−1, 1, 1]. In this case qi Ad(i,j) ≤ 0, i, j = 1, 2, 3, if and only if A(2,1) = A(2,3) = A(3,1) = A(3,2) = 0. Since, A + Ad is compartmental, A(2,2) = 0. Figure 4.1 (c) shows the corresponding compartmental structure. It is important to note that in the case where Q = diag[−1, −1, −1], there does not exist a compartmental matrix A + Ad satisfying QA ≤≤ 0 and QAd ≤≤ 0 except for the zero matrix. This case would correspond to a compartmental dynamical system where all three states are monotonically increasing. Hence, the compartmental system would be unstable contradicting the fact that all compartmental systems are Lyapunov stable [110, 113]. Finally, the remaining four cases corresponding to Q = diag[−1, 1, −1], Q = diag[−1, −1, 1], Q = diag[1, −1, 1], and Q = diag[1, 1, −1] are dual to the cases where Q = diag[1, −1, −1] and Q = diag[−1, 1, 1] and, hence, are not presented here. △ Example 4.6. Consider a three-compartment model with time delay between compartments. Here, for simplicity of exposition, we assume that
NNBook
September 1, 2009
140
CHAPTER 4
$ )
'
ith Compartment xi (t) & %
aji xi (t), τ
$
'
aij xj (t), τ
jth Compartment xj (t) 1& %
aii xi (t) ?
ajj xj (t) ?
Figure 4.4 Linear compartmental interconnected subsystem model with time delay.
all transfer times between compartments are equal and given by τ . Now, a mass balance for the compartmental system, with state variables and transfer coefficients aij ≥ 0, i = 1, 2, 3, defined as in Figure 4.4, yields (4.16) with u(t) ≡ 0, and A and Ad given by P3 0, i = j, − k=1 aki , i = j, A(i,j) = Ad(i,j) = (4.22) aij , i 6= j, i 6= j, 0, where i, j = 1, 2, 3. Note that A is essentially nonnegative, Ad is nonnegative, and A + Ad is a compartmental matrix.
Here, we are interested in the monotonicity of the first compartment and hence we choose Q = diag[1, 0, 0]. Now, it follows from Theorem 4.13 that if QA ≤≤ 0 and QAd ≤≤ 0, then the first compartment is monotonic. Note that QA ≤≤ 0 and QAd ≤≤ 0 if and only if A(1,2) = A(1,3) = Ad(1,1) = Ad(1,2) = Ad(1,3) = 0. For our simulation we let −5 0 0 A = 0 −5 0 , 0 0 −5
(4.23)
0 0 0 Ad = 1 0 3 . 2 2 0
With τ = 2 and the initial condition φ(t) = [1, 0, 0]T , −τ ≤ t ≤ 0, Figure 4.5 shows that the mass of the first compartment is monotonic. Next, let
−5 0 0 A = 0 −5 0 , 0 0 −5
0 2 2 Ad = 1 0 3 . 2 2 0
Figure 4.6 shows the mass of the first compartment with respect to time for τ = 2 and the initial condition φ(t) = [1, 0, 0]T , −τ ≤ t ≤ 0. However, since (4.23) is a necessary and sufficient condition for monotonicity of the first compartment, the mass in the first compartment does not exhibit a monotonic behavior. △
NNBook
September 1, 2009
NONOSCILLATION AND MONOTONICITY OF NONNEGATIVE SYSTEMS
141
Figure 4.5 Monotonicity of the first compartment.
Figure 4.6 Nonmonotonicity of the first compartment.
Next, we present a sufficient condition that guarantees partial monotonicity and monotonicity for nonlinear nonnegative dynamical systems with time delay. In particular, we consider nonlinear time-delay dynamical systems G of the form x(t) ˙ = Ax(t) + fd (x(t − τ )) + G(x(t))u(t), x(θ) = φ(θ), −τ ≤ θ ≤ 0, t ≥ 0,
(4.24)
where x(t) ∈ Rn , u(t) ∈ Rm , t ≥ 0, A ∈ Rn×n , fd : Rn → Rn is locally
NNBook
142
September 1, 2009
CHAPTER 4
Lipschitz and fd (0) = 0, τ ≥ 0, G : Rn → Rn×m, and φ(·) ∈ C. For the nonlinear dynamical system G given by (4.24) the definitions of monotonicity and partial monotonicity hold with (4.16) replaced by (4.24) Theorem 4.14. Consider the nonlinear time-delay nonnegative dynamical system given by (4.24) where φ(·) ∈ C+ , A ∈ Rn×n is essentially nonnegative, fd ∈ Rn×n is nonnegative, G(x) ≥≥ 0, and u(t), t ≥ 0, △ is nonnegative. Let n ˆ ≤ n, {k1 , k2 , . . . , knˆ } ⊆ {1, 2, . . . , n}, and x ˆ(t) = [xk1 (t), . . . , xknˆ (t)]T . Assume there exists a matrix Q ∈ Rn×n such that Q = diag[q1 , . . . , qn ], qi = 0, i 6∈ {k1 , . . . , knˆ }, qi = ±1, i ∈ {k1 , . . . , knˆ }, QA ≤≤ 0, Qfd (x) ≤≤ 0, and QG(x) ≤≤ 0, x ∈ Rn . Then the nonlinear nonnegative dynamical system (4.24) is partially monotonic with respect to x ˆ. Proof. The proof is similar to the proof of Theorem 4.5 and, hence, is omitted. Finally, it is important to note that discrete-time extensions for linear and nonlinear nonnegative dynamical systems with time delay possessing monotonic solutions can be derived in a similar fashion.
NNBook
September 1, 2009
Chapter Five
Dissipativity Theory for Nonnegative Dynamical Systems
5.1 Introduction In control engineering, dissipativity theory provides a fundamental framework for the analysis and control design of dynamical systems using an input, state, and output system description based on system-energy-related considerations [112]. The notion of energy here refers to abstract energy notions for which a physical system energy interpretation is not necessary. The dissipation hypothesis on dynamical systems results in a fundamental constraint on their dynamic behavior, wherein a dissipative dynamical system can deliver only a fraction of its energy to its surroundings and can store only a fraction of the work done to it. Many of the great landmarks of feedback control theory are associated with dissipativity theory. In particular, dissipativity theory provides the foundation for absolute stability theory which in turn forms the basis of the Lur´e problem, as well as the circle and Popov criteria, which are extensively developed in the classical monographs of Aizerman and Gantmacher [2], Lefschetz [194], and Popov [244]. Since absolute stability theory concerns the stability of a dynamical system for classes of feedback nonlinearities which, as noted in [107, 108], can readily be interpreted as an uncertainty model, it is not surprising that absolute stability theory (and, hence, dissipativity theory) also forms the basis of modern-day robust stability analysis and synthesis [107, 109, 123]. The key foundation in developing dissipativity theory for general nonlinear dynamical systems was presented by J. C. Willems [308, 309] in his seminal two-part paper on dissipative dynamical systems. In particular, Willems [308] introduced the definition of dissipativity for general dynamical systems in terms of a dissipation inequality involving a generalized system power input, or supply rate, and a generalized energy function, or storage function. The dissipation inequality implies that the increase in generalized system energy over a given time interval cannot exceed the generalized energy supply delivered to the system during this time interval. The
NNBook
144
September 1, 2009
CHAPTER 5
set of all possible system storage functions is convex and every system storage function is bounded from below by the available system storage and bounded from above by the required supply. The available storage is the amount of internal generalized stored energy which can be extracted from the dynamical system and the required supply is the amount of generalized energy which can be delivered to the dynamical system to transfer it from a state of minimum potential to a given state. Hence, as noted above, a dissipative dynamical system can deliver only a fraction of its stored generalized energy to its surroundings and can store only a fraction of generalized work done to it. Dissipativity theory is a system-theoretic concept that provides a powerful framework for the analysis and control design of dynamical systems based on generalized energy considerations. In particular, dissipativity theory exploits the notion that numerous physical dynamical systems have certain input, state, and output system properties related to conservation, dissipation, and transport of mass and energy. Such conservation laws are prevalent in dynamical systems such as mechanical systems, fluid systems, electromechanical systems, electrical systems, combustion systems, structural systems, biological systems, physiological systems, biomedical systems, ecological systems, economic systems, as well as feedback control systems. On the level of analysis, dissipativity can involve conditions on system parameters that render an input, state, output system dissipative. Or, alternatively, analyzing system stability robustness by viewing a dynamical system as an interconnection of dissipative dynamical subsystems. On the synthesis level, dissipativity can be used to design feedback controllers that add dissipation and guarantee stability robustness, allowing stabilization to be understood in physical terms [112]. In this chapter, we use linear and nonlinear storage functions and linear supply rates to develop new notions of classical dissipativity theory [308, 309] and exponential dissipativity theory [55, 112] for linear and nonlinear nonnegative dynamical systems. The overall approach provides a new interpretation of a mass balance for nonnegative systems with linear supply rates and linear and nonlinear storage functions. Specifically, we show that dissipativity of a nonnegative dynamical system involving a linear storage function and a linear supply rate implies that the system mass transport is equal to the supplied system flux minus the expelled system flux. In the special case where the linear supply rate is taken to be the excess input mass flux over the output mass flux the system dissipativity notion collapses to a nonaccumulativity system constraint, wherein the system mass transport is always less than or equal to the difference between the system flux input and system flux output. Furthermore, we show that all compartmental systems with measured outputs corresponding to material outflows are
NNBook
September 1, 2009
145
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
nonaccumulative. In addition, we develop new Kalman-Yakubovich-Popov equations for nonnegative systems to characterize dissipativeness with linear and nonlinear storage functions and linear supply rates. Next, using the concepts of dissipativity and exponential dissipativity with linear and nonlinear storage functions and linear supply rates we develop feedback interconnection stability results for nonnegative dynamical systems. General stability criteria are given for Lyapunov, semi-, and asymptotic stability of feedback linear and nonlinear nonnegative systems. These results can be viewed as a generalization of the positivity and the small gain theorems [112, 140] to nonnegative systems with linear and nonlinear storage functions and linear supply rates. A key observation of these results is that unlike the classical results on positivity and the small gain theorems requiring negative feedback interconnections, positive feedback interconnections are required in order to ensure that the resulting feedback system is a nonnegative dynamical system.
5.2 Dissipativity Theory for Nonnegative Dynamical Systems Dissipativity theory has been extensively developed for the analysis and design of control systems for engineering systems using input, state, and output system descriptions based on energy-related considerations without the consideration of nonnegative and compartmental models [112, 203, 308, 309]. Since biological and physiological systems have numerous input, state, and output1 properties related to conservation, dissipation, and transport of mass and energy, it seems natural to extend dissipativity theory to nonnegative and compartmental models which themselves behave in accordance to conservation laws. In this section, we extend the notion of dissipativity to nonnegative dynamical systems. Specifically, we consider dynamical systems G of the form2 x(t) ˙ = Ax(t) + Bu(t), y(t) = Cx(t) + Du(t),
x(0) = x0 ,
t ≥ 0,
(5.1) (5.2)
where x ∈ Rn , u ∈ Rm , y ∈ Rl , A ∈ Rn×n , B ∈ Rn×m , C ∈ Rl×n , and D ∈ Rl×m . First, however, we provide definitions and several results concerning dynamical systems of the form (5.1) and (5.2) with nonnegative inputs and nonnegative outputs. 1 The outputs here refer to measured outputs or observations and may have nothing to do with material outflows of the nonnegative compartmental system. 2 In the life sciences such as biology, biochemistry, and physiology, input, state, and output system descriptions can be very useful in determining system structure and estimating system parameters.
NNBook
September 1, 2009
146
CHAPTER 5
Definition 5.1. The linear dynamical system G given by (5.1) and (5.2) with x(0) = 0 is input-output nonnegative if y(t), t ≥ 0, is nonnegative for every nonnegative input u(t), t ≥ 0. The following result shows that the dynamical system G is inputoutput nonnegative if and only if the impulse response function is nonnegative and D ≥≥ 0. Theorem 5.1. The linear dynamical system G given by (5.1) and (5.2) is input-output nonnegative if and only if D ≥≥ 0 and the impulse response △ matrix function H(t) = CeAt B, t ≥ 0, of G is nonnegative. Proof. Consider the dynamical system G given by (5.1) and (5.2) with x(0) = 0. Then, it follows that Z t y(t) = H(t − s)u(s)ds + Du(t), t ≥ 0. 0
Now, suppose the impulse response function H(t) ≥≥ 0, t ≥ 0, and D ≥≥ 0. Then, for every nonnegative input u(t) ≥≥ 0, t ≥ 0, the output is also nonnegative, that is, y(t) ≥≥ 0, t ≥ 0. Conversely, suppose G is input-output nonnegative and assume, ad absurdum, there exist i, j, with i 6= j, such that H(i,j)(τ ) < 0 at some τ > 0. By continuity, there exists 0 < t1 < τ such that H(i,j)(t) < 0, t ∈ [t1 , τ ]. Now, for every u(t), t ≥ 0, such that u(t) = 0, t 6∈ [0, τ − t1 ], and u(t) = u ˆ ej , t ∈ [0, τ − t1 ], where u ˆ > 0, it follows that Z τ −t1 yi (τ ) = H(i,j) (τ − s)uj (s)ds < 0, (5.3) 0
which is a contradiction. Hence, H(t) ≥≥ 0, t ≥ 0. Finally, for every u(t) ≥≥ 0, t ≥ 0, y(0) = Du(0) ≥≥ 0, which implies that D ≥≥ 0. Definition 5.2. The linear dynamical system G given by (5.1) and (5.2) n is nonnegative if for every x(0) ∈ R+ and u(t) ≥≥ 0, t ≥ 0, the solution x(t), t ≥ 0, to (5.1) and the output y(t), t ≥ 0, are nonnegative. n
Definition 5.2 states that the nonnegative orthant R+ of the state space is an invariant set with respect to (5.1) for all nonnegative inputs u(t), t ≥ 0. Furthermore, note that nonnegativity of G implies input-output nonnegativity; however, the converse is not generally true. Theorem 5.2. The linear dynamical system G given by (5.1) and (5.2) is nonnegative if and only if A is essentially nonnegative, B ≥≥ 0, C ≥≥ 0, and D ≥≥ 0.
NNBook
September 1, 2009
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
147
Proof. First, note that the solution x(t), t ≥ 0, to (5.1) is given by Z t At x(t) = e x0 + eA(t−s) Bu(s)ds, t ≥ 0. 0
Now, if A is essentially nonnegative, then it follows from Proposition 2.5 that eAt ≥≥ 0, t ≥ 0, and if B ≥≥ 0, C ≥≥ 0, and D ≥≥ 0, then it follows n that x(t) ≥≥ 0 and y(t) ≥≥ 0 for all t ≥ 0 and x(0) ∈ R+ , which implies that G is nonnegative. Conversely, suppose G is nonnegative. Now, note that, with u(0) = 0, n y(0) = Cx0 and, since y(0) ≥≥ 0 for all x0 ∈ R+ , it follows that C ≥≥ 0. m Next, with x0 = 0, y(0) = Du(0) and, since y(0) ≥≥ 0 for all u(0) ∈ R+ , it follows that D ≥≥ 0. Now, let x0 = 0 and let u(t) = δ(t − tˆ)ˆ u, t ≥ 0, where m u ˆ ≥≥ 0. In this case, since x(tˆ) = B u ˆ ≥≥ 0 for all u ˆ ∈ R+ , it follows that B ≥≥ 0. Finally, with u(t) = 0, t ≥ 0, x(t) = eAt x0 , and hence, it follows n from Proposition 2.5 that if x(t) ≥≥ 0, t ≥ 0, for all x0 ∈ R+ , then A is essentially nonnegative, which proves the result. For the dynamical system G given by (5.1) and (5.2) defined on the state space Rn , let U and Y define input and output spaces, respectively, consisting of continuous bounded U -valued and Y -valued functions on the semi-infinite interval [0, ∞). The set U ⊆ Rm contains the set of input values, that is, for every u(·) ∈ U and t ∈ [0, ∞), u(t) ∈ U . The set Y ⊆ Rl contains the set of output values, that is, for every y(·) ∈ Y and t ∈ [0, ∞), y(t) ∈ Y . The spaces U and Y are assumed to be closed under the shift operator, that is, if u(·) ∈ U (respectively, y(·) ∈ Y), then the function △ △ defined by uT = u(t + T ) (respectively, yT = y(t + T )) is contained in U (respectively, Y) for all T ≥ 0. Similar definitions hold for the dynamical n system G given by (5.1) and (5.2) defined on the nonnegative orthant R+ with U and Y replaced by U+ and Y+ , where U+ and Y+ denote subsets of U and Y consisting of all nonnegative functions. A similar notation also holds for discrete-time as well as hybrid systems discussed later in this and the next chapter. For the dynamical system G given by (5.1) and (5.2), a function s : Rm × Rl → R such that s(0, 0) = 0 is called a supply rate [308] if it is locally integrable for all input-output pairs satisfying (5.1) and (5.2), that is, for all input-output pairs u(·) ∈ U and y(·) ∈ Y satisfying (5.1) and (5.2), s(·, ·) Rt satisfies t12 |s(u(σ), y(σ))|dσ < ∞, t1 , t2 ≥ 0. For the remainder of the results of this chapter we assume that G is a nonnegative dynamical system, and hence, by Theorem 5.2, A is essentially nonnegative, B ≥≥ 0, C ≥≥ 0, and D ≥≥ 0. The following definition introduces the notion of dissipativity and
NNBook
September 1, 2009
148
CHAPTER 5
exponential dissipativity for a nonnegative dynamical system. Definition 5.3. The nonnegative dynamical system G given by (5.1) and (5.2) is exponentially dissipative (respectively, dissipative) with respect m l to supply rate s : R+ × R+ → R if there exist a continuous, nonnegativen definite function Vs : R+ → R+ , called a storage function, and a scalar ε > 0 (respectively, ε = 0) such that Vs (0) = 0 and the dissipation inequality Z t2 εt2 εt1 e Vs (x(t2 )) ≤ e Vs (x(t1 )) + eεt s(u(t), y(t))dt, t2 ≥ t1 , (5.4) t1
is satisfied for all t1 , t2 ≥ 0, where x(t), t ≥ t1 , is the solution of (5.1) with u(·) ∈ U+ . The nonnegative dynamical system G given by (5.1) and (5.2) is m l lossless with respect to the supply rate s : R+ × R+ → R if the dissipation inequality (5.4) is satisfied as an equality with ε = 0 for all t2 ≥ t1 and all u(·) ∈ U+ . If Vs (·) is continuously differentiable, then an equivalent statement for exponential dissipativity of a nonnegative dynamical system G is V˙ s (x(t)) + εVs (x(t)) ≤ s(u(t), y(t)),
t ≥ 0,
m
u ∈ R+ ,
l
y ∈ R+ ,
(5.5)
where V˙ s (x(t)) denotes the total derivative of Vs (x) along the state trajectories x(t), t ≥ 0, of (5.1). Since linear nonnegative dynamical systems are a subset of linear dynamical systems, standard dissipativity theory [112, 309] with quadratic storage functions and quadratic supply rates involving Kalman-YakubovichPopov conditions also hold for linear nonnegative dynamical systems. Hence, dissipativity with respect to a quadratic supply rate can be established by formulating a linear matrix inequality feasibility problem [39]. In this chapter, however, motivated by conservation of mass laws, we develop dissipativity notions for nonnegative dynamical systems with respect to linear and nonlinear storage functions and linear supply rates. For a linear dynamical system to be dissipative with respect to a linear supply rate it is necessary that the storage function is also linear. However, since all storage functions are nonnegative by definition, it follows that a storage function is nonnegative if and only if there exists a linear transformation such that the linear dynamical system is nonnegative in a transformed basis. Hence, dissipativity theory of linear dynamical systems with respect to linear supply rates is complete if we restrict our consideration to the class of linear nonnegative dynamical systems. The following result presents Kalman-Yakubovich-Popov conditions for linear nonnegative dynamical systems with linear supply rates of the
NNBook
September 1, 2009
149
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
form s(u, y) = q T y + r T u, where q ∈ Rl , q 6= 0, and r ∈ Rm , r 6= 0. For this result, we assume that there exists a continuously differentiable storage function Vs (x), x ∈ Rn , for the nonnegative dynamical system G. Theorem 5.3. Let q ∈ Rl and r ∈ Rm . Consider the nonnegative dynamical system G given by (5.1) and (5.2) where A is essentially nonnegative, B ≥≥ 0, C ≥≥ 0, and D ≥≥ 0. Then G is exponentially dissipative (respectively, dissipative) with respect to the supply rate s(u, y) = q T y+r T u n n m if and only if there exist p ∈ R+ , l ∈ R+ , and w ∈ R+ , and a scalar ε > 0 (respectively, ε = 0) such that 0 = AT p + εp − C T q + l, 0 = B T p − D T q − r + w. n
(5.6) (5.7) n
m
Proof. Assume that there exist p ∈ R+ , l ∈ R+ , and w ∈ R+ , and a scalar ε > 0 such that (5.6) and (5.7) hold. Then, with Vs (x) = pT x it n m follows that for all x ∈ R+ and u ∈ R+ , V˙ s (x) + εVs (x) = pT (Ax + Bu) + εpT x = q T Cx − lT x + q T Du + r T u − wT u ≤ q T y + r T u,
which implies that G is exponentially dissipative with respect to the supply rate s(u, y) = q T y + r T u. Conversely, assume that G is exponentially dissipative with respect to the supply rate s(u, y) = q T y + r T u. Now, it follows that there exists a continuously differentiable function Vs (·) such that V˙ s (x) + εVs (x) = Vs′ (x)(Ax + Bu) + εVs (x) ≤ q T y + r T u. n
m
Next, let d : R+ × R+ → R+ be such that d(x, u) = −V˙ s (x) − εVs (x) + s(u, y) = −Vs′ (x)(Ax + Bu) − εVs (x) + q T (Cx + Du) + r T u n m ≥ 0, x ∈ R+ , u ∈ R+ , △
n
m
and note that d(x, u) is linear in u. Hence, since x ∈ R+ and u ∈ R+ are n n arbitrary, there exist continuous functions dx : R+ → R+ and du : R+ → 1×m R+ such that du (0) ≥≥ 0 and d(x, u) = dx (x) + du (x)u, which implies n m that, for all x ∈ R+ and u ∈ R+ , 0 = Vs′ (x)Ax + εVs (x) − q T Cx + dx (x) + [Vs′ (x)B − q T D − r T + du (x)]u.
Now, setting u = 0 yields 0 = Vs′ (x)Ax + εVs (x) − q T Cx + dx (x),
n
x ∈ R+ ,
(5.8)
NNBook
September 1, 2009
150
CHAPTER 5
which further implies that 0 = Vs′ (x)B − q T D − r T + du (x),
n
x ∈ R+ .
(5.9)
Next, expand Vs (·), dx (·), and du (·) as Vs (x) = pT x + Vsr (x), dx (x) = n n m + dxr (x), and du (x) = wT + dur (x), where p ∈ R+ , l ∈ R+ , w ∈ R+ , Vsr (x)/kxk → 0, and dxr (x)/kxk → 0 as kxk → 0. Now, substituting the above expressions into (5.8) and equating coefficients of equal powers yields (5.6). Furthermore, setting x = 0 in (5.9) yields (5.7) with w = dT u (0).
lT x
Finally, the proof of the equivalence between dissipativity with respect to the supply rate s(u, y) = q T y+r T u and (5.6) (with ε = 0) and (5.7) follows analogously with ε = 0. Next, we provide necessary and sufficient conditions for the case where G given by (5.1) and (5.2) is lossless with respect to the linear supply rate s(u, y) = q T y + r T u. Theorem 5.4. Let q ∈ Rl and r ∈ Rm . Consider the nonnegative dynamical system G given by (5.1) and (5.2) where A is essentially nonnegative, B ≥≥ 0, C ≥≥ 0, and D ≥≥ 0. Then G is lossless with respect to the supply rate s(u, y) = q T y + r T u if and only if there exists n p ∈ R+ such that 0 = AT p − C T q, 0 = B T p − D T q − r.
(5.10) (5.11)
Proof. The proof is analogous to the proof of Theorem 5.3. Recall that in standard dissipativity theory if G is zero-state observable (see Definition 5.5) and there exists a function κ : Rl → Rm such that s(κ(y), y) < 0, y 6= 0, then the storage function Vs (·) satisfies Vs (x) > 0, x ∈ Rn , x 6= 0, [112, 139]. Similarly, for the nonnegative dynamical system G, it can be shown that if G is zero-state observable and there exists a l m l function κ : R+ → R+ such that s(κ(y), y) < 0, y ∈ R+ , y 6= 0, then n Vs (x) > 0, x ∈ R+ , x 6= 0. In the case of a linear supply rate, there exists a matrix K ∈ Rm×l such that q + Kr << 0, which implies that if (A, C) is n observable, then Vs (x) > 0, x ∈ R+ , x 6= 0. For a given l ∈ Rn and w ∈ Rm , note that there exists p ∈ Rn such that (5.6) and (5.7) are satisfied if and only if rank[M, y] = rank M , where (A + εIn )T C Tq − l △ △ M= , y= . BT DT q + r − w
NNBook
September 1, 2009
151
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
Now, there exist p ≥≥ 0, l ≥≥ 0, and w ≥≥ 0 such that (5.6) and (5.7) are satisfied if and only if the inequalities p ≥≥ 0, z − M p ≥≥ 0
(5.12) (5.13)
are satisfied, where △
z=
C Tq DT q + r
.
Equations (5.12) and (5.13) comprise a set of 2n linear inequalities with pi , i = 1, . . . , n, variables, and hence, the feasibility of p ≥≥ 0 such that (5.12) and (5.13) hold can be checked by standard linear matrix inequality (LMI) techniques [39]. As in the standard dissipativity theory with quadratic supply rates [112, 139], the concepts of linear supply rates and linear storage functions provide a generalized mass and energy interpretation. Specifically, using (5.6) and (5.7) it follows that Z t Z t T T T T [lT x(σ) + wT u(σ)]dσ, [q y(σ) + r u(σ)]dσ = p x(t) − p x(t0 ) + t0
t0
(5.14)
which can be interpreted as a generalized mass balance equation where pT x(t)−pT x(t0 ) is the stored mass of the nonnegative system and the second path-dependent term on the right corresponds to the expelled mass of the nonnegative system. Rewriting (3.22) as V˙ s (x) = pT x˙ = q T y + r T u − [lT x + wT u]
(5.15)
yields a mass flux conservation equation which shows that the system mass transport is equal to the supplied system flux minus the expelled system flux. Note that if a linear nonnegative dynamical system G is dissipative with respect to the linear supply rate s(u, y) = q T y + r T u and if q ≤≤ 0 and u ≡ 0, then it follows that V˙ s (x(t)) ≤ q T y(t) ≤ 0, t ≥ 0. Hence, the undisturbed (u(t) ≡ 0) system G is Lyapunov stable, and hence, by Theorem 2.11, semistable. Furthermore, if a nonnegative dynamical system G is exponentially dissipative with respect to the linear supply rate s(u, y) = q T y + r T u and if q ≤≤ 0 and u ≡ 0, then it follows that V˙ s (x(t)) ≤ −εVs (x(t)) + q T y(t) < 0, x(t) 6= 0, t ≥ 0, where ε > 0. Hence, the undisturbed (u(t) ≡ 0) system G is asymptotically stable. Next, we provide a key definition for nonnegative dynamical systems which are dissipative with respect to a very special supply rate.
NNBook
September 1, 2009
152
CHAPTER 5
Definition 5.4. A nonnegative dynamical system G of the form (5.1) and (5.2) is nonaccumulative (respectively, exponentially nonaccumulative) if G is dissipative (respectively, exponentially dissipative) with respect to the supply rate s(u, y) = eT u − eT y. If G is nonaccumulative, then it follows from (5.15) that V˙ s (x(t)) ≤ eT u(t) − eT y(t),
t ≥ 0,
(5.16)
where u(·) ∈ U+ and y(·) ∈ Y+ . If the components ui (·), i = 1, . . . , m, of u(·) denote flux inputs to the system G and the components yi (·), i = 1, . . . , l, of y(·) denote the flux outputs of the system G, then dissipativity with respect to the linear supply rate s(u, y) = eT u − eT y implies that the system mass transport is always less than or equal to the difference between the system flux input and system flux output. Finally, we show that all compartmental systems with measured outputs corresponding to material outflows are nonaccumulative. Specifially, consider (2.41) with w(t) = u(t) or, equivalently, ∂Vs T x(t) ˙ = [Jn (x) − D(x)] + u(t), x(0) = x0 , t ≥ 0, (5.17) ∂x and with storage function Vs (x) = eT x and output ∂Vs T = [a11 x1 , a22 x2 , . . . , ann xn ]T . y = D(x) ∂x Now, it follows that V˙ s (x) = e
T
"
[Jn (x) − D(x)]
∂Vs ∂x
T
+u
#
= eT u − eT y + eT Jn (x)e n = eT u − eT y, x ∈ R+ , which shows that all compartmental systems with outputs y = D(x) are lossless with respect to the supply rate s(u, y) = eT u − eT y.
(5.18) ∂Vs T ∂x
If, alternatively, the outputs y correspond to a partial observation of the material outflows, then it follows that the compartmental system is dissipative with respect to the supply rate s(u, y) = eT u − eT y. To see this, assume without loss of generality that the first l outflows are observed, that is, y = [a11 x1 , a22 x2 , . . . , all xl ]. Now, note that in this case ∂Vs T ∂Vs T y = D(x) − Dr (x) , ∂x ∂x
NNBook
September 1, 2009
153
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS n
where Dr (x) = diag[0, . . . , 0, al+1l+1 xl+1 , . . . , ann xn ] ≥≥ 0, x ∈ R+ . Hence, " # T ∂V s V˙ s (x) = eT [Jn (x) − D(x)] +u ∂x ∂Vs ∂Vs T T T = e u−e y− Dr (x) ∂x ∂x ≤ eT u − eT y,
n
x ∈ R+ .
(5.19)
n Note that in the case where the system is closed, V˙ s (x) = 0, x ∈ R+ , indicating conservation of mass in the system.
Example 5.1. In this example, we show that the lipoprotein metabolism model considered in Example 2.2 is nonaccumulative. Since the material outflow of the first compartment corresponding to blood plasma cannot be measured directly, we measure the concentration of the material, that is, y = a11 x1 /v1 , where v1 is the volume of distribution of the blood plasma in the first compartment. Now, using the storage function Vs (x1 , x2 ) = x1 + x2 it follows that the lipoprotein metabolism model is lossless with respect to the supply rate s(u, y) = u1 − v1 y. △ 6 0, t ≥ 0, and Example 5.2. In this example, we show that for u(t) = output y(t) = a11 x1 (t) the lead kinetic model studied in Example 2.3 is nonaccumulative. This is immediate with storage function Vs (x1 , x2 , x3 ) = x1 + x2 + x3 . △
5.3 Feedback Interconnections of Nonnegative Dynamical Systems Feedback systems are pervasive in nature and can be found almost everywhere in living systems. In particular, control at the intercellular level, DNA replication and cell division, control of gene expression, control of enzyme activity, control at the organ system and organism level, humoral control, neural control, and regulation in biological systems all involve feedback systems [155]. To analyze these complex nonnegative systems, the notion of dissipativity, with appropriate storage functions and supply rates, can be used to construct Lyapunov functions by appropriately combining storage functions for each subsystem and examining their respective structure. In this section, we consider feedback interconnections of nonnegative dynamical systems. We begin by considering the nonnegative dynamical system G given by (5.1) and (5.2) with the nonnegative dynamical feedback system Gc given by x˙ c (t) = Ac xc (t) + Bc uc (t),
xc (0) = xc0 ,
t ≥ 0,
(5.20)
NNBook
September 1, 2009
154
CHAPTER 5
yc (t) = Cc xc (t),
(5.21)
where Ac ∈ Rnc ×nc , Bc ∈ Rnc ×mc , Cc ∈ Rlc ×nc , Ac is essentially nonnegative, Bc ≥≥ 0, and Cc ≥≥ 0. Theorem 5.5. Let q ∈ Rl , r ∈ Rm , qc ∈ Rlc , and rc ∈ Rmc . Consider the linear nonnegative dynamical systems G and Gc given by (5.1) and (5.2), and (5.20) and (5.21), respectively, with uc = y and yc = u. Assume that G is dissipative with respect to the linear supply rate s(u, y) = q T y+r T u and with a positive-definite, linear storage function Vs (x) = pT x, and assume that Gc is dissipative with respect to the linear supply rate s(uc , yc ) = qcT yc + rcT uc and with a positive-definite, linear storage function Vsc (xc ) = pT c xc . Then the following statements hold: i ) If there exists a scalar σ > 0 such that q + σrc ≤≤ 0 and r + σqc ≤≤ 0, then the positive feedback interconnection of G and Gc is semistable. ii ) If (A, C) and (Ac , Cc ) are observable and there exists a scalar σ > 0 such that q + σrc << 0 and r + σqc << 0, then the positive feedback interconnection of G and Gc is asymptotically stable. iii) If (A, C) is observable, rank Bc = mc , Gc is exponentially dissipative with respect to the supply rate s(uc , yc ) = qcT yc + rcT uc , and there exists a scalar σ > 0 such that q + σrc ≤≤ 0 and r + σqc ≤≤ 0, then the positive feedback interconnection of G and Gc is asymptotically stable. iv ) If G is exponentially dissipative with respect to the supply rate s(u, y) = q T y + r T u, Gc is exponentially dissipative with respect to the supply rate s(uc , yc ) = qcT yc + rcT uc , and there exists a scalar σ > 0 such that q + σrc ≤≤ 0 and r + σqc ≤≤ 0, then the positive feedback interconnection of G and Gc is asymptotically stable. Proof. Note that the positive feedback interconnection of G and Gc is given by u = yc and uc = y so that the closed-loop dynamics of G and Gc is given by x(t) ˙ A BCc x(t) = , x˙ c (t) Bc C Ac + Bc DCc xc (t) which implies that the closed-loop dynamics matrix A BCc △ A˜ = Bc C Ac + Bc DCc is essentially nonnegative. Hence, the closed-loop system is also nonnegative, and thus, x(t) ≥≥ 0, xc (t) ≥≥ 0, u(t) ≥≥ 0, and y(t) ≥≥ 0, t ≥ 0.
NNBook
September 1, 2009
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
155
i) Consider the Lyapunov function candidate V (x, xc ) = pT x + σpT c xc and note that the Lyapunov derivative satisfies V˙ (x, xc ) ≤ q T y + r T u + σ(qcT yc + rcT uc ) = (q + σrc )T y + (r + σqc )T u ≤ 0, for all y ≥≥ 0 and u ≥≥ 0, establishing Lyapunov stability. semistability is an immediate consequence of Theorem 2.11.
(5.22) Now,
ii) With V (x, xc ) = pT x + σpT c xc Lyapunov stability follows as in i). Furthermore, if q + σrc << 0 and r + σqc << 0, then it follows from (5.22) that V˙ (x, xc ) < 0 for all y >> 0 and u >> 0 such that either y 6= 0 or u 6= 0. The result now follows by applying the Krasovskii-LaSalle theorem and using the observability assumptions. iii) With V (x, xc ) = pT x + σpT c xc Lyapunov stability follows as in i). Next, if Gc is exponentially dissipative it follows that V˙ (x, xc ) ≤ −εVsc (xc ), nc n nc △ xc ∈ R+ . Now, define R = {(x, xc ) ∈ R+ × R+ : V˙ (x, xc ) = 0}. Since V˙ (x(t), xc (t)) ≤ −εVsc (xc (t)), it follows that xc (t) ≡ 0 and u(t) = yc (t) = Cc xc (t) ≡ 0 and, since rank Bc = mc , it follows that uc (t) = y(t) = 0 and Cx(t) = 0. Now, since (A, C) is observable it follows that x(t) ≡ 0. Hence, the largest invariant subset contained in R is given by M = {(0, 0)}, and hence, it follows from the Krasovskii-LaSalle theorem that (x(t), xc (t)) → (0, 0) as t → ∞. iv) With V (x, xc ) = pT x + σpT c xc Lyapunov stability follows as in i). Next, if G and Gc are exponentially dissipative it follows that n nc V˙ (x, xc ) ≤ −εVs (x) − εc Vsc (xc ) ≤ − min{ε, εc }V (x, xc ), (x, xc ) ∈ R+ × R+ , which establishes asymptotic stability. It is important to note that Theorem 5.5 also holds for the more general architecture of the feedback system Gc wherein yc (t) = Cc xc (t) + Dc uc (t), where Dc ∈ Rlc ×mc and Dc ≥≥ 0. In this case, however, we assume that the positive feedback interconnection of G and Gc is well posed, that is, det[Im − Dc D] 6= 0. Similar remarks hold for the rest of the results in this section as well as the results of Section 5.7. The following corollary to Theorem 5.5 addresses linear supply rates of the form s(u, y) = eT u − eT y. Corollary 5.1. Consider the linear nonnegative dynamical systems G and Gc given by (5.1) and (5.2), and (5.20) and (5.21), respectively, with uc = y and yc = u. Assume that G is nonaccumulative with a positive-definite, linear storage function Vs (x) = pT x, and assume that Gc is exponentially
NNBook
September 1, 2009
156
CHAPTER 5
nonaccumulative with a positive-definite, linear storage function Vsc (xc ) = pT c xc . Then the following statements hold: i ) If (A, C) is observable and rank Bc = mc , then the positive feedback interconnection of G and Gc is asymptotically stable. ii ) If G is exponentially nonaccumulative, then the positive feedback interconnection of G and Gc is asymptotically stable. Proof. The proof is a direct consequence of iii) and iv) of Theorem 5.5 with σ = 1, q = −rc = −e, and r = −qc = e. Next, we develop absolute stability criteria for nonnegative feedback systems with nonnegative time-varying memoryless input nonlinearities. Since absolute stability theory concerns the stability for classes of feedback nonlinearities which, as noted in [107], can readily be interpreted as an uncertainty model, the proposed framework can be used to analyze robustness of biological and physiological systems developed from data models. Specifically, given the linear nonnegative system G characterized by (5.1) and (5.2) we derive sufficient conditions that guarantee asymptotic stability of the feedback interconnection involving the linear nonnegative system G and the feedback nonnegative time-varying input nonlinearity σ(·, ·) ∈ Φ, where △
l
m
l
Φ = {σ : R+ × R+ → R+ : σ(·, 0) = 0, 0 ≤≤ σ(t, y) ≤≤ M y, y ∈ R+ , l
a.a. t ≥ 0, and σ(·, y) is Lebesgue measurable for all y ∈ R+ }, (5.23) M >> 0, and M ∈ Rm×l . Theorem 5.6. Consider the nonnegative dynamical system G given by (5.1) and (5.2), and assume that (A, C) is observable and G is exponentially dissipative with respect to the supply rate s(u, y) = eT u − eT M y, where M >> 0. Then, the positive feedback interconnection of G and σ(·, ·) is globally (uniformly)3 asymptotically stable for all σ(·, ·) ∈ Φ. l
Proof. Since σ(t, y) ≥≥ 0 for all t ≥ 0, y ∈ R+ , and (5.1) and (5.2) is a nonnegative dynamical system, it follows that the positive feedback interconnection of G and σ(·, ·) given by x(t) ˙ = Ax(t) + Bσ(t, y(t)),
x(0) = x0 ,
t ≥ 0,
3 Since the positive feedback interconnection of G and σ(·, ·) results in a time-varying system, it is important to distinguish between asymptotic stability and uniform asymptotic stability. As for the case of time-invariant systems, stability notions for time-varying nonnegative systems need to n be defined with respect to relatively open subsets of R+ .
NNBook
September 1, 2009
157
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
is a nonnegative dynamical system for all σ(·, ·) ∈ Φ. Next, since (A, C) is observable and G is exponentially dissipative with respect to the supply rate s(u, y) = eT u−eT M y, it follows from Theorem 5.3 of [112] and Theorem 5.3, n m with r = e and q = −M T e, that there exist p ∈ Rn+ , l ∈ R+ , and w ∈ R+ , and a scalar ε > 0 such that 0 = AT p + εp + C T M T e + l, 0 = B T p + D T M T e − e + w.
(5.24) (5.25)
Next, consider the Lyapunov function candidate Vs (x) = pT x and note that the Lyapunov derivative satisfies V˙ s (x) = pT (Ax + Bσ) = −εpT x + eT [σ − M y] − lT x − wT σ ≤ −εVs (x) + eT [σ − M y]. n
Now, since Vs (x) > 0, x ∈ R+ , x 6= 0, and σ ≤≤ M y for all σ(·, ·) ∈ Φ, n it follows that V˙ s (x) < 0, x ∈ R+ , x 6= 0. Hence, the positive feedback interconnection of G and σ(·, ·) is globally (uniformly) asymptotically stable for all σ(·, ·) ∈ Φ. To consider nonlinearities with upper and lower bounds of the form M1 y ≤≤ σ(t, y) ≤≤ M2 y, where σ(·, ·) ∈ Φ, we can use the standard loop shifting techniques discussed in [112, 174]. In this case, Theorem 5.6 holds with σ(t, y), A, B, C, D, and M replaced by σ(t, y) − M1 y, A + B(I − M1 D)−1 M1 C, B(I −M1 D)−1 , (I −DM1 )−1 C, (I −DM1 )−1 D, and M2 −M1 , respectively. To develop robust stability results for nonnegative dynamical systems, consider the set F defined by m×l
△
F = {F : R+ → R+
: F (·) is Lebesgue measurable and 0 ≤≤ F (t) ≤≤ M, a.a. t ≥ 0}.
(5.26)
That is, F includes σ in Φ of the form σ(t, y) = F (t)y. Furthermore, consider the uncertain system x(t) ˙ = (A + ∆A(t))x(t),
x(0) = x0 ,
t ≥ 0,
(5.27)
where A is a nominal essentially nonnegative, asymptotically stable matrix and ∆A(·) ∈ U , where U is the uncertainty set △
U = {∆A(·) : ∆A(t) = BF (t)C, F (·) ∈ F}.
(5.28)
In this case, it follows from Theorem 5.6 with D = 0 that the zero solution x(t) ≡ 0 to the linear nonnegative uncertain system (5.27) is globally (uniformly) asymptotically stable for all F (·) ∈ F.
NNBook
September 1, 2009
158
CHAPTER 5
The uncertain dynamical system model given by (5.27) considers an additive (absolute) uncertainty structure. Next, we show that nonnegative dynamical systems are also robust with respect to a multiplicative (relative) uncertainty characterization. Specifically, consider the uncertain system x(t) ˙ = F AGx(t),
x(0) = x0 ,
t ≥ 0,
(5.29)
where A ∈ Rn×n is essentially nonnegative and F ∈ Rn×n and G ∈ Rn×n are positive and diagonal but otherwise unknown, and (5.29) is asymptotically stable with F = G = In , that is, the nominal system is asymptotically stable. Since the nominal system is asymptotically stable, it follows from Theorem 2.12 that there exist a positive diagonal matrix P ∈ Rn×n and a positive-definite matrix R ∈ Rn×n such that 0 = AT P + P A + R.
(5.30)
Now, choosing the Lyapunov function candidate V (x) = xT GP F −1 x for the n uncertain system (5.29), it follows that V˙ (x) = −xT GRGx < 0, x ∈ R+ , x 6= 0, which proves asymptotic stability for the perturbed system (5.29). Finally, we present a straightforward but key property of cascade interconnections of nonnegative dynamical systems. Proposition 5.1. Consider the nonnegative dynamical systems G1 and G2 with input-output pairs (u1 , y1 ) and (u2 , y2 ), respectively. Assume G1 and G2 are nonaccumulative. Then the cascade interconnection G = G2 G1 with input-output pair (u, y) = (u1 , y2 ) is nonaccumulative. Proof. The result is a direct consequence of Definition 5.3 by noting that the interconnection constraint for a cascade interconnection is given by u = u1 and y = y2 . Proposition 5.1 is not surprising in light of the fact that nonaccumulativity of a nonnegative dynamical system implies that the system mass transport is always less than or equal to the difference between the system flux input and system flux output. In fact, Proposition 5.1 holds for n cascade-interconnected systems. However, it is important to note that a similar result to Proposition 5.1 does not hold for parallel and feedback interconnections.
5.4 Dissipativity Theory for Nonlinear Nonnegative Dynamical Systems In this section, we extend the notion of dissipativity to nonlinear nonnegative dynamical systems. Specifically, we consider nonlinear dynamical systems
NNBook
September 1, 2009
159
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
G of the form x(t) ˙ = f (x(t)) + G(x(t))u(t), y(t) = h(x(t)) + J(x(t))u(t),
x(0) = x0 ,
t ≥ 0,
(5.31) (5.32)
where x ∈ Rn , u ∈ Rm , y ∈ Rl , f : Rn → Rn , G : Rn → Rn×m , h : Rn → Rl , and J : Rn → Rl×m . We assume that f (·), G(·), h(·), and J(·) are continuously differentiable mappings and f (xe ) = 0 and h(xe ) = 0. For simplicity of exposition here we assume xe = 0.4 For the nonlinear dynamical system G given by (5.31) and (5.32) the definitions of inputoutput nonnegativity, nonnegativity, dissipativity, exponential dissipativity, and losslessness hold with (5.1) and (5.2) replaced by (5.31) and (5.32). The following result is now immediate. Proposition 5.2. Consider the nonlinear dynamical system G given by (5.31) and (5.32). If f : D → Rn is essentially nonnegative, h(x) ≥≥ 0, n G(x) ≥≥ 0, and J(x) ≥≥ 0, x ∈ R+ , then G is nonnegative. Proof. The nonnegativity of x(t), t ≥ 0, is a direct consequence of n Proposition 4.3. Now, since h(x) and J(x) are nonnegative for all x ∈ R+ , y(t) ≥≥ 0, t ≥ 0, is immediate. Hence, G is nonnegative. To state the main result of this section, the following definition is required. Definition 5.5. A nonnegative dynamical system G is zero-state observable if u(t) ≡ 0 and y(t) ≡ 0 implies x(t) ≡ 0. G is completely n reachable if for all x0 ∈ D ⊆ R+ there exist a finite time ti < 0 and a square integrable nonnegative input u(t) defined on [ti , 0] such that the state x(t), t ≥ ti , can be driven from x(ti ) = 0 to x(0) = x0 . G is completely null n controllable if for all x0 ∈ D ⊆ R+ there exist a finite time tf > 0 and a square integrable nonnegative input u(t) defined on [0, tf ] such that x(t), t ≥ 0, can be driven from x(0) = x0 to x(tf ) = 0. The following result presents a nonlinear extension to Theorem 5.3. As in the linear case, if G is zero-state observable and there exists a function l m n κ : R+ → R+ such that s(κ(y), y) < 0, y 6= 0, then Vs (x) > 0, x ∈ R+ , x 6= 0. Hence, for linear supply rates s(u, y) = q T y + r T u, where q ∈ Rl , q 6= 0, and r ∈ Rm , r 6= 0, it follows that there exists K ∈ Rm×l such that q + Kr << 0, n which implies that if G is zero-state observable, then Vs (x) > 0, x ∈ R+ , x 6= 0. For this result we assume there exists a continuously differentiable 4 In the case where G is nonnegative, this assumption is not without loss of generality since shifting the equilibrium can destroy the essential nonnegativity of the vector field f and the nonnegativity of h. However, using minor modifications in the proofs of the theorems in this section, the results of this section can also be extended to the case where xe 6= 0.
NNBook
September 1, 2009
160
CHAPTER 5 n
storage function Vs (x), x ∈ R+ , for the nonnegative dynamical system G. Theorem 5.7. Let q ∈ Rl and r ∈ Rm . Consider the nonlinear nonnegative dynamical system G given by (5.31) and (5.32) where f : D → Rn is essentially nonnegative, G(x) ≥≥ 0, h(x) ≥≥ 0, and J(x) ≥≥ 0, n x ∈ R+ . Then G is exponentially dissipative (respectively, dissipative) with respect to the supply rate s(u, y) = q T y + r T u if and only if there exist n n n m functions Vs : R+ → R+ , ℓ : R+ → R+ , and W : R+ → R+ , and a scalar ε > 0 (respectively, ε = 0) such that Vs (·) is continuously differentiable, n Vs (0) = 0, and, for all x ∈ R+ , 0 = Vs′ (x)f (x) + εVs (x) − q T h(x) + ℓ(x), 0 = Vs′ (x)G(x) − q T J(x) − r T + W T (x). n
(5.33) (5.34) n
Proof. Assume that there exist Vs : R+ → R+ , ℓ : R+ → R+ , n m and W : R+ → R+ , and a scalar ε > 0 such that Vs (·) is continuously differentiable, Vs (0) = 0, and (5.33) and (5.34) hold. Then it follows that n for all x ∈ R+ and every admissible input u(·) ∈ U+ , V˙ s (x) + εVs (x) = Vs′ (x)(f (x) + G(x)u) + εVs (x) = q T h(x) − ℓ(x) + q T J(x)u + r T u − W T (x)u ≤ q T y + r T u,
which implies that G is exponentially dissipative with respect to the supply rate s(u, y) = q T y + r T u. Conversely, assume that G is exponentially dissipative with respect to the supply rate s(u, y) = q T y + r T u. Now, it follows that there exists a continuously differentiable function Vs (·) such that V˙ s (x) + εVs (x) = Vs′ (x)(f (x) + G(x)u) + εVs (x) ≤ q T y + r T u. n
m
Next, let d : R+ × R+ → R+ be such that d(x, u) = −V˙ s (x) − εVs (x) + s(u, y) = −Vs′ (x)[f (x) + G(x)u] − εVs (x) + q T [h(x) + J(x)u] + r T u n m ≥ 0, x ∈ R+ , u ∈ R+ , △
n
m
and note that d(x, u) is linear in u. Hence, since x ∈ R+ and u ∈ R+ are n n arbitrary, there exist continuous functions dx : R+ → R+ and du : R+ → 1×m n R+ such that du (x) ≥≥ 0, x ∈ R+ , and d(x, u) = dx (x) + du (x)u, which n m implies that, for all x ∈ R+ and u ∈ R+ ,
0 = Vs′ (x)f (x)+εVs (x)−q T h(x)+dx (x)+[Vs′ (x)G(x)−q T J(x)−r T +du (x)]u.
Now, setting u = 0 yields (5.33) with ℓ(x) = dx (x), which further implies
NNBook
September 1, 2009
161
DISSIPATIVITY THEORY FOR NONNEGATIVE SYSTEMS
(5.34) with W(x) = dT u (x). Finally, the proof of the equivalence between dissipativity with respect to the supply rate s(u, y) = q T y + r T u and (5.33) (with ε = 0) and (5.34) follows analogously with ε = 0. As in the linear case, Theorem 5.7 provides a generalized mass and energy balance interpretation. In particular, using (5.33) and (5.34) it follows that Z t [q T y(σ) + r T u(σ)]dσ = Vs (x(t)) − Vs (x(t0 )) t0
+
Z
t
t0
[ℓT (x(σ))x(σ) + W T (x(σ))u(σ)]dσ, (5.35)
which can be interpreted as a generalized mass balance equation where Vs (x(t)) − Vs (x(t0 )) is the stored mass of the nonnegative system and the second path-dependent term on the right corresponds to the expelled mass of the nonnegative system. Rewriting (5.14) as V˙ s (x) = Vs′ (x)x˙ = q T y + r T u − [ℓT (x)x + W T (x)u]
(5.36)
yields a mass flux conservation equation which shows that the system mass transport is equal to the supplied system flux minus the expelled system flux. The next result is a nonlinear extension to Theorem 5.4. Theorem 5.8. Let q ∈ Rl and r ∈ Rm . Consider the nonlinear nonnegative dynamical system G given by (5.31) and (5.32) where f : D → Rn is essentially nonnegative, G(x) ≥≥ 0, h(x) ≥≥ 0, and J(x) ≥≥ 0, n x ∈ R+ . Then G is lossless with respect to the supply rate s(u, y) = q T y+r T u n if and only if there exists a function Vs : R+ → R+ such that Vs (·) is n continuously differentiable, Vs (0) = 0, and, for all x ∈ R+ , 0 = Vs′ (x)f (x) − q T h(x), 0 = Vs′ (x)G(x) − q T J(x) − r T .
(5.37) (5.38)
Proof. The proof is analogous to the proof of Theorem 5.7. As in the linear case, it is important to note that all nonlinear compartmental systems with measured outputs corresponding to material outflows are lossless with respect to the supply rate s(u, y) = eT u − eT y.
NNBook
September 1, 2009
162
CHAPTER 5
This can be easily seen from (2.48) with w(t) = u(t) or, equivalently, ∂Vs T x(t) ˙ = [Jn (x) − D(x)] + u(t), x(0) = x0 , t ≥ 0, (5.39) ∂x and with storage function Vs (x) = eT x and output ∂Vs T y = D(x) a11 (x), a = h(x) = [ˆ ˆ22