Showing papers in "arXiv: Optimization and Control in 1999"

Notions of Input to Output Stability

Abstract: This paper deals with several related notions of output stability with respect to inputs. The inputs may be thought of as disturbances; when there are no inputs, one obtains generalizations of the classical concepts of partial stability. The main notion studied is called input to output stability (IOS), and it reduces to input to state stability (ISS) when the output equals the complete state. Several variants, which formalize in different manners the transient behavior, are introduced. The main results provide a comparison among these notions. A companion paper establishes necessary and sufficient Lyapunov-theoretic characterizations.

Lyapunov Characterizations of Input to Output Stability

Abstract: This paper presents necessary and sufficient characterizations of several notions of input to output stability. Similar Lyapunov characterizations have been found to play a key role in the analysis of the input to state stability property, and the results given here extend their validity to the case when the output, but not necessarily the entire internal state, is being regulated. The work is related to partial stability of differential equations (the particular case which arises when there are no external inputs).

Stability and stabilization: discontinuities and the effect of disturbances

Abstract: This expository paper deals with several questions related to stability and stabilization of nonlinear finite-dimensional continuous-time systems. The topics covered include a review of stability and asymptotic controllability, an introduction to the problem of stabilization and obstructions to continuous stabilization, the notion of control-Lyapunov functions, and a discussion of discontinuous feedback and methods of nonsmooth analysis. An emphasis is placed upon relatively new areas of research which concern stability with respect to noise, including the notion of insensitivity to small measurement and actuator errors as well as the more global notion of input-to-state stability.

Input-Output-to-State Stability

Abstract: This work explores Lyapunov characterizations of the input-output-to-state stability (IOSS) property for nonlinear systems. The notion of IOSS is a natural generalization of the standard zero-detectability property used in the linear case. The main contribution of this work is to establish a complete equivalence between the input-output-to-state stability property and the existence of a certain type of smooth Lyapunov function. As corollaries, one shows the existence of ``norm-estimators'', and obtains characterizations of nonlinear detectability in terms of relative stability and of finite-energy estimates.

Further equivalences and semiglobal versions of integral input to state stability

Abstract: This paper continues the study of the integral input-to-state stability (IISS) property. It is shown that the IISS property is equivalent to one which arises from the consideration of mixed norms on states and inputs, as well as to the superposition of a ``bounded energy bounded state'' requirement and the global asymptotic stability of the unforced system. A semiglobal version of IISS is shown to imply the global version, though a counterexample shows that the analogous fact fails for input to state stability (ISS). The results in this note complete the basic theoretical picture regarding IISS and ISS.

Extremal Optimization: Methods derived from Co-Evolution

Abstract: We describe a general-purpose method for finding high-quality solutions to hard optimization problems, inspired by self-organized critical models of co-evolution such as the Bak-Sneppen model. The method, called Extremal Optimization, successively eliminates extremely undesirable components of sub-optimal solutions, rather than ``breeding'' better components. In contrast to Genetic Algorithms which operate on an entire ``gene-pool'' of possible solutions, Extremal Optimization improves on a single candidate solution by treating each of its components as species co-evolving according to Darwinian principles. Unlike Simulated Annealing, its non-equilibrium approach effects an algorithm requiring few parameters to tune. With only one adjustable parameter, its performance proves competitive with, and often superior to, more elaborate stochastic optimization procedures. We demonstrate it here on two classic hard optimization problems: graph partitioning and the traveling salesman problem.

Duality between Multidimensional Convolutional Codes and Systems

Abstract: Multidimensional convolutional codes generalize (one dimensional) convolutional codes and they correspond under a natural duality to multidimensional systems widely studied in the systems literature.

Mathematical Problems in the Control of Underactuated Systems

Abstract: In this paper we will discuss problems and techniques related to underactuated systems. We give a mathematical formulation of several problems arising from applications, review some standard and new techniques, and pose some interesting and challenging open questions.

A differential game with constrained dynamics and viscosity solutions of a related HJB equation

Abstract: This paper considers a formulation of a differential game with constrained dynamics, where one player selects the dynamics and the other selects the applicable cost. When the game is considered on a finite time horizon, its value satisfies an HJB equation with oblique Neumann boundary conditions. The first main result is uniqueness for viscosity solutions to this equation. This uniqueness is applied to obtain the second main result,i which is a unique characterization of the value function for a corresponding infinite time problem. The motivation comes from problems associated with queueing networks, where the games appear in several contexts, including a robust approach to network modeling and optimization and risk-sensitive control.

Control of nonlinear underactuated systems

Abstract: In this paper we introduce a new method to design control laws for non-linear underactuated systems. Our method produces an infinite dimensional family of control laws, whereas most control techniques only produce a finite dimensional family. These control laws each come with a natural Lyapunov function. The inverted pendulum cart is used as an example. In addition, we construct an abstract system which is open loop unstable and cannot be stabilized using any linear control law, and demonstrate that our method produces a stabilizing control law.

Equity Allocation and Portfolio Selection in Insurance

Abstract: A discrete time probabilistic model, for optimal equity allocation and portfolio selection, is formulated so as to apply to (at least) reinsurance. In the context of a company with several portfolios (or subsidiaries), representing both liabilities and assets, it is proved that the model has solutions respecting constraints on ROE's, ruin probabilities and market shares currently in practical use. Solutions define global and optimal risk management strategies of the company. Mathematical existence results and tools, such as the inversion of the linear part of the Euler-Lagrange equations, developed in a preceding paper in the context of a simplified model are essential for the mathematical and numerical construction of solutions of the model.

Feedback Stabilization over Commutative Rings: Further study of the coordinate-free approach

Abstract: This paper is concerned with the coordinate-free approach to control systems. The coordinate-free approach is a factorization approach but does not require the coprime factorizations of the plant. We present two criteria for feedback stabilizability for MIMO systems in which transfer functions belong to the total rings of fractions of commutative rings. Both of them are generalizations of Sule's results in [SIAM J. Control Optim., 32-6, 1675-1695(1994)]. The first criterion is expressed in terms of modules generated from a causal plant and does not require the plant to be strictly causal. It shows that if the plant is stabilizable, the modules are projective. The other criterion is expressed in terms of ideals called generalized elementary factors. This gives the stabilizability of a causal plant in terms of the coprimeness of the generalized elementary factors. As an example, a discrete finite-time delay system is considered.

Further results on controllability of recurrent neural networks

Abstract: This paper studies controllability properties of recurrent neural networks. The new contributions are: (1) an extension of the result in the previous paper "Complete controllability of continuous-time recurrent neural networks" (Sontag and Sussmann) to a slightly different model, where inputs appear in an affine form, (2) a formulation and proof of a necessary and sufficient condition, in terms of local-local controllability, and (3) a complete analysis of the 2-dimensional case for which the hypotheses made in previous work do not apply

Games, predictions, interactivity

Abstract: This short note is devoted to the unraveling of the hidden interactivity of ordinary games which is an artefact of predictions of the behaviour of other players by the fixed player and describes deviations of their real behaviour from such predictions A method to improve the predictions is proposed Applications to the strategical analysis of interactive games are also briefly specified

Remarks regarding the gap between continuous, Lipschitz, and differentiable storage functions for dissipation inequalities appearing in $H_\infty$ control

Abstract: This paper deals with the regularity of solutions of the Hamilton-Jacobi Inequality which arises in H-infinity control. It shows by explicit counterexamples that there are gaps between existence of continuous and locally Lipschitz (positive definite and proper) solutions, and between Lipschitz and continuously differentiable ones. On the other hand, it is shown that it is always possible to smooth-out solutions, provided that an infinitesimal increase in gain is allowed.

Computation of maximal reachability submodules

Abstract: A new and conceptually simple procedure is derived for the compu- tation of the maximal reachability submodule of a given submodule of the state space of a linear discrete time system over a Noethenian ring R. The procedure is effective if R is effective and if kernels and inter- sections can be computed. The procedure is compared with a rather different procedure by Assan e.a. published recently.

A Parameterization of Stabilizing Controllers over Commutative Rings

Abstract: We present a parameterization of the stabilizing controllers over commutative rings. In the classical case, that is, in the case where there exist the right-/left-coprime factorizations of the given plant, the stabilizing controllers can be parameterized by the method called ``Youla-Kucera-parameterization''. However, it is known that there exist models in which some stabilizable transfer matrices do not have their right-/left-coprime factorizations. In such models, we cannot employ the Youla-Kucera-parameterization directly. Our method of this paper can be applied to even such models.

Improving the primal-dual algorithm for the transportation problem in the plane

Abstract: The transportation problem in the plane - how to move a set of objects from one set of points to another set of points in the cheapest way - is a very old problem going back several hundreds of years. In recent years the solution of the problem has found applications in the analysis of digital images when searching for similarities and discrepancies between images. The main drawback, however, is the long computation time for finding the solution. In this paper we present some new results by which the time for solving the transportation problem in the plane can be reduced substantially. As cost-function we choose a distance-function between points in the plane. We consider both the case when the distance-function is equal to the ordinary Euclidean distance, as well as the case when the distance-function is equal to the square of the Euclidean distance. This latter distance-function has the advantage that it is integer-valued if the coordinates of the points in the plane are integers.

Quadratic Control Lyapunov Functions for Bilinear Systems

Abstract: In this paper the existence of a quadratic control Lyapunov function for bilinear systems is considered. The existence of a control Lyapunov function ensures the existence of a control law which ensures the global asymptotic stability of the closed loop control system. In this paper we will derive conditions for the existence of a control Lyapunov function for bilinear systems. These conditions will be derived for the whole class of two dimensional bilinear systems with one control input. This will lead to a simple flow diagram representation for the controller design for bilinear systems using a quadratic control Lyapunov function. The controller design itself is carried out using Sontag's universal control law to obtain an asymptotically stable closed loop system. The Gutman control law which, however, only ensures practical stability of the closed loop system but which is considerably simpler than Sontag's control law will also be considered. An example will conclude the paper.

Feedback Stabilization over Commutative Rings with no Right-/Left-Coprime Factorizations

Abstract: Anantharam showed in 1985 the existence of a model in which some stabilizable plants do not have its right-/left-coprime factorizations. In this paper, we give a condition of the nonexistence of the right-/left-coprime factorizations of stabilizable plants as a generalization of Anantharam's result. As examples of the models which satisfy the condition, we present two models. We illustrate the construction of a stabilizing controller of stabilizable single-input single-output plants of such models.

A Convex Maximization Problem: Discrete Case

Abstract: We study a specific convex maximization problem in n-dimensional space. The conjectured solution is proved to be a vertex of the polyhedral feasible region, but only a partial proof of local maximality is known. Integer sequences with interesting patterns arise in the analysis, owing to the number theoretic origin of the problem.

A method for computing quadratic Brunovsky forms

Abstract: In this paper, for continuous, linearly-controllable quadratic control systems with a single input, an explicit, constructive method is proposed for studying their Brunovsky forms, initially studied in [W. Kang and A. J. Krener, Extended quadratic controller normal form and dynamic state feedback linearization of nonlinear systems, SIAM Journal on Control and Optimization, 30:1319-1337, 1992]. In this approach, the computation of Brunovsky forms and transformation matrices and the proof of their existence and uniqueness are carried out simultaneously. In addition, it is shown that quadratic transformations in the aforementioned paper can be simplified to prevent multiplicity in Brunovsky forms. This method is extended for studying discrete quadratic systems. Finally, computation algorithms for both continuous and discrete systems are summarized, and examples demonstrated.

Some Fundamental Properties of Successive Convex Relaxation Methods on LCP and Related Problems

Abstract: General Successive Convex Relaxation Methods (SRCMs) can be used to compute the convex hull of any compact set, in an Euclidean space, described by a system of quadratic inequalities and a compact convex set which is not very complicated. Linear Complementarity Problems (LCPs) make an interesting and rich class of structured nonconvex optimization problems. In this paper, we study a few of the specialized lift-and-project methods and some of the possible ways of applying the general SCRMs to LCPs and related problems.

A Tuner that Accelerates Parameters

Abstract: We propose a tuner, suitable for adaptive control and (in its discrete-time version) adaptive filtering applications, that sets the second derivative of the parameter estimates rather than the first derivative as is done in the overwhelming majority of the literature. Comparative stability and performance analyses are presented.

Zero Assignment, Pole Placement and Matrix Extension Problems: A Common Point of View

Abstract: The paper studies a general inverse eigenvalue problem which contains as special cases many well studied pole placement and matrix extension problems. It is shown that the studied problem corresponds on the geometric side to a central projection from some projective variety. The degree for this variety is computed in the critical dimension.

A Convex Maximization Problem: Continuous Case

Abstract: We study a specific convex maximization problem in the space of continuous functions defined on a semi-infinite interval. An unexplained connection to the discrete version of this problem is investigated.