Showing papers in "arXiv: Adaptation and Self-Organizing Systems in 1998"

Market force, ecology and evolution

Abstract: Markets have internal dynamics leading to excess volatility and other phenomena that are difficult to explain using rational expectations models. This paper studies these using a nonequilibrium price formation rule, developed in the context of trading with market orders. Because this is so much simpler than a standard inter-temporal equilibrium model, it is possible to study multi-period markets analytically. There price dynamics have second order oscillatory terms. Value investing does not necessarily cause prices to track values. Trend following causes short term trends in prices, but also causes longer-term oscillations. When value investing and trend following are combined, even though there is little linear structure, there can be boom-bust cycles,excess and temporally correlated volatility, and fat tails in price fluctuations. The long term evolution of markets can be studied in terms of flows of money. Profits can be decomposed in terms of aggregate pairwise correlations. Under reinvestment of profits this leads to a capital allocation model that is equivalent to a standard model in population biology. An investigation of market efficiency shows that patterns created by trend followers are more resistant to efficiency than those created by value investors, and that profit maximizing behavior slows the progression to efficiency. Order of magnitude estimates suggest that the timescale for efficiency is years to decades.

Emergence of Rules in Cell Society: Differentiation, Hierarchy, and Stability

Abstract: A dynamic model for cell differentiation is studied, where cells with internal chemical reaction dynamics interact with each other and replicate. It leads to spontaneous differentiation of cells and determination, as is discussed in the isologous diversification. Following features of the differentiation are obtained: (1)Hierarchical differentiation from a ``stem'' cell to other cell types, with the emergence of the interaction-dependent rules for differentiation; (2)Global stability of an ensemble of cells consisting of several cell types, that is sustained by the emergent, autonomous control on the rate of differentiation; (3)Existence of several cell colonies with different cell-type distributions. The results provide a novel viewpoint on the origin of complex cell society, while relevance to some biological problems, especially to the hemopoietic system, is also discussed.

TRANSIMS traffic flow characteristics

Abstract: Knowledge of fundamental traffic flow characteristics of traffi c simulation models is an essential requirement when using these models for the planning, design, and operation of transportation systems. In this paper we discuss the following: a description of how features relevant to traffic flow are currently under implementation in the TRANSIMS microsimulation, a proposition for standardized traffic flow tests for traffic simulation models, a nd the results of these tests for two different versions of the TRANSIMS microsimulation.

Neural network design for J function approximation in dynamic programming

Abstract: This paper shows that a new type of artificial neural network (ANN) -- the Simultaneous Recurrent Network (SRN) -- can, if properly trained, solve a difficult function approximation problem which conventional ANNs -- either feedforward or Hebbian -- cannot. This problem, the problem of generalized maze navigation, is typical of problems which arise in building true intelligent control systems using neural networks. (Such systems are discussed in the chapter by Werbos in K.Pribram, Brain and Values, Erlbaum 1998.) The paper provides a general review of other types of recurrent networks and alternative training techniques, including a flowchart of the Error Critic training design, arguable the only plausible approach to explain how the brain adapts time-lagged recurrent systems in real-time. The C code of the test is appended. As in the first tests of backprop, the training here was slow, but there are ways to do better after more experience using this type of network.

Autocatalytic closure in a cognitive system: a tentative scenario for the origin of culture

Abstract: This paper presents a speculative model of the cognitive mechanisms underlying the transition from episodic to mimetic (or memetic) culture with the arrival of Homo erectus, which Donald [1991] claims paved the way for the unique features of human culture. The model draws on Kauffman's [1993] theory of how an information-evolving system emerges through the formation of an autocatalytic network. Though originally formulated to explain the origin of life, this theory also provides a plausible account of how discrete episodic memories become woven into an internal model of the world, or worldview, that both structures, and is structured by, self-triggered streams of thought. Social interaction plays a role in (and may be critical to) this process. Implications for cognitive development are explored.

Stable Adaptive Control Using New Critic Designs

Abstract: Classical adaptive control proves total-system stability for control of linear plants, but only for plants meeting very restrictive assumptions. Approximate Dynamic Programming (ADP) has the potential, in principle, to ensure stability without such tight restrictions. It also offers nonlinear and neural extensions for optimal control, with empirically supported links to what is seen in the brain. However, the relevant ADP methods in use today -- TD, HDP, DHP, GDHP -- and the Galerkin-based versions of these all have serious limitations when used here as parallel distributed real-time learning systems; either they do not possess quadratic unconditional stability (to be defined) or they lead to incorrect results in the stochastic case. (ADAC or Q-learning designs do not help.) After explaining these conclusions, this paper describes new ADP designs which overcome these limitations. It also addresses the Generalized Moving Target problem, a common family of static optimization problems, and describes a way to stabilize large-scale economic equilibrium models, such as the old long-term energy model of DOE.

The Evolutionary Design of Collective Computation in Cellular Automata

Abstract: We investigate the ability of a genetic algorithm to design cellular automata that perform computations. The computational strategies of the resulting cellular automata can be understood using a framework in which ``particles'' embedded in space-time configurations carry information and interactions between particles effect information processing. This structural analysis can also be used to explain the evolutionary process by which the strategies were designed by the genetic algorithm. More generally, our goals are to understand how machine-learning processes can design complex decentralized systems with sophisticated collective computational abilities and to develop rigorous frameworks for understanding how the resulting dynamical systems perform computation.

Probabilistic Analysis of the Number Partitioning Problem

Abstract: Given a sequence of $N$ positive real numbers $\{a_1,a_2,, a_N \}$, the number partitioning problem consists of partitioning them into two sets such that the absolute value of the difference of the sums of $a_j$ over the two sets is minimized In the case that the $a_j$'s are statistically independent random variables uniformly distributed in the unit interval, this NP-complete problem is equivalent to the problem of finding the ground state of an infinite-range, random anti-ferromagnetic Ising model We employ the annealed approximation to derive analytical lower bounds to the average value of the difference for the best constrained and unconstrained partitions in the large $N$ limit Furthermore, we calculate analytically the fraction of metastable states, ie states that are stable against all single spin flips, and found that it vanishes like $N^{-3/2}$

Optimizing Epochal Evolutionary Search: Population-Size Independent Theory

Abstract: Epochal dynamics, in which long periods of stasis in population fitness are punctuated by sudden innovations, is a common behavior in both natural and artificial evolutionary processes. We use a recent quantitative mathematical analysis of epochal evolution to estimate, as a function of population size and mutation rate, the average number of fitness function evaluations to reach the global optimum. This is then used to derive estimates of and bounds on evolutionary parameters that minimize search effort.

Coherence and synchronization in diode-laser arrays with delayed global coupling

Abstract: The dynamics of a semiconductor-laser array whose individual elements are coupled in a global way through an external mirror is numerically analysed. A coherent in-phase solution is seen to be preferred by the system at intermediate values of the feedback coupling strength. At low values of this parameter, a strong amplification of the spontaneous emission noise is observed. A tendency towards chaos synchronization is also observed at large values of the feedback strength.

Cooperative mechanism of self-regulation in hierarchical living systems

Abstract: We study the problem of how a ``living'' system complex in structure can respond perfectly to local changes in the environment. Such a system is assumed to consist of a distributed ``living'' medium and a hierarchical ``supplying'' network that provides this medium with ``nutritious'' products. Because of the hierarchical organization each element of the supplying network has to behave in a self-consistent way for the system can adapt to changes in the environment. We propose a cooperative mechanism of self-regulation by which the system as a whole can react perfectly. This mechanism is based on an individual response of each element to the corresponding small piece of the information on the state of the ``living'' medium. The conservation of flux through the supplying network gives rise to a certain processing of information and the self-consistent behavior of the elements, leading to the perfect self-regulation. The corresponding equations governing the ``living'' medium state are obtained.

Biased Random-Walk Learning: A Neurobiological Correlate to Trial-and-Error

Abstract: Neural network models offer a theoretical testbed for the study of learning at the network level The only experimentally verified learning rule, Hebb’s rule, is extremely limited in its ability to train networks to perform complex tasks An identified cellular mechanism responsible for Hebbian-type longterm potentiation, the NMDA receptor, is highly versatile Its operation is modulated by a wide variety of conditions and may be involved in several non-Hebbian processes We have shown that another neural network learning rule, the chemotaxis algorithm, is theoretically much more powerful than Hebb’s rule and is consistent with neurobiological observations A biased random walk in synaptic weight space is a learning rule immanent in nervous activity and may account for some types of learning — notably the acquisition of skilled movement

Simple model of 1/f noise

Abstract: Simple analytically solvable model of 1/f noise is proposed. The model consists of one or few particles moving in the closed contour. The drift period of the particle round the contour fluctuates about some average value, e.g. due to the external random perturbations of the system's parameters. The model contains only one relaxation rate, however, the power spectral density of the current of particles reveals an exact 1/f spectrum in any desirable wide range of frequency and can be expressed by the Hooge formula. It is likely that the analysis and the generalizations of the model can strongly influence on the understanding of the origin of 1/f noise.

One Dimensional $n$ary Density Classification Using Two Cellular Automaton Rules

Abstract: Suppose each site on a one-dimensional chain with periodic boundary condition may take on any one of the states $0,1,..., n-1$, can you find out the most frequently occurring state using cellular automaton? Here, we prove that while the above density classification task cannot be resolved by a single cellular automaton, this task can be performed efficiently by applying two cellular automaton rules in succession.

Development and Evolution of Neural Networks in an Artificial Chemistry

Abstract: We present a model of decentralized growth for Artificial Neural Networks (ANNs) inspired by the development and the physiology of real nervous systems. In this model, each individual artificial neuron is an autonomous unit whose behavior is determined only by the genetic information it harbors and local concentrations of substrates modeled by a simple artificial chemistry. Gene expression is manifested as axon and dendrite growth, cell division and differentiation, substrate production and cell stimulation. We demonstrate the model's power with a hand-written genome that leads to the growth of a simple network which performs classical conditioning. To evolve more complex structures, we implemented a platform-independent, asynchronous, distributed Genetic Algorithm (GA) that allows users to participate in evolutionary experiments via the World Wide Web.

Dynamics of Individual Specialization and Global Diversification in Communities

Abstract: We discuss a model of an economic community consisting of $N$ interacting agents. The state of each agent at any time is characterized, in general, by a mixed strategy profile drawn from a space of $s$ pure strategies. The community evolves as agents update their strategy profiles in response to payoffs received from other agents. The evolution equation is a generalization of the replicator equation. We argue that when $N$ is sufficiently large and the payoff matrix elements satisfy suitable inequalities, the community evolves to retain the full diversity of available strategies even as individual agents specialize to pure strategies.

Modelling coevolution in multispecies communities

Abstract: We introduce the Webworld model, which links together the ecological modelling of food web structure with the evolutionary modelling of speciation and extinction events. The model describes dynamics of ecological communities on an evolutionary timescale. Species are defined as sets of characteristic features, and these features are used to determine interaction scores between species. A simple rule is used to transfer resources from the external environment through the food web to each of the species, and to determine mean population sizes. A time step in the model represents a speciation event. A new species is added with features similar to those of one of the existing species and a new food web structure is then calculated. The new species may (i) add stably to the web, (ii) become extinct immediately because it is poorly adapted, or (iii) cause one or more other species to become extinct due to competition for resources. We measure various properties of the model webs and compare these with data on real food webs. These properties include the proportions of basal, intermediate and top species, the number of links per species and the number of trophic levels. We also study the evolutionary dynamics of the model ecosystem by following the fluctuations in the total number of species in the web. Extinction avalanches occur when novel organisms arise which are significantly better adapted than existing ones. We discuss these results in relation to the observed extinction events in the fossil record, and to the theory of self-organized criticality.

Life as Complex Systems --- Viewpoint from Intra-Inter Dynamics

Abstract: Basic problems in complex systems are surveyed in connection with Life. As a key issue for complex systems, complementarity between syntax/rule/parts and semantics/behavior/whole is stressed. To address the issue, a constructive approach for a biological system is proposed. As a construction in a computer, intra-inter dynamics is presented for cell biology, where the following five general features are drawn from our model experiments; intrinsic diversification, recursive type formation, rule generation, formation of internal representation, and macroscopic robustness. Significance of the constructed logic to the biology of existing organisms is also discussed.

Critical Exponent of Species-Size Distribution in Evolution

Abstract: We analyze the geometry of the species- and genotype-size distribution in evolving and adapting populations of single-stranded self-replicating genomes: here programs in the Avida world. We find that a scale-free distribution (power law) emerges in complex landscapes that achieve a separation of two fundamental time scales: the relaxation time (time for population to return to equilibrium after a perturbation) and the time between mutations that produce fitter genotypes. The latter can be dialed by changing the mutation rate. In the scaling regime, we determine the critical exponent of the distribution of sizes and strengths of avalanches in a system without coevolution, described by first-order phase transitions in single finite niches.

A dynamical theory of speciation on holey adaptive landscapes

Abstract: The metaphor of holey adaptive landscapes provides a pictorial representation of the process of speciation as a consequence of genetic divergence. In this metaphor, biological populations diverge along connected clusters of well-fit genotypes in a multidimensional adaptive landscape and become reproductively isolated species when they come to be on opposite sides of a ``hole'' in the adaptive landscape. No crossing of any adaptive valleys is required. I formulate and study a series of simple models describing the dynamics of speciation on holey adaptive landscapes driven by mutation and random genetic drift. Unlike most previous models that concentrate only on some stages of speciation, the models studied here describe the complete process of speciation from initiation until completion. The evolutionary factors included are selection (reproductive isolation), random genetic drift, mutation, recombination, and migration. In these models, pre- and post-mating reproductive isolation is a consequence of cumulative genetic change. I study possibilities for speciation according to allopatric, parapatric, peripatric and vicariance scenarios. The analytic theory satisfactorily matches results of individual-based simulations reported by Gavrilets et al. (1998). It is demonstrated that rapid speciation including simultaneous emergence of several new species is a plausible outcome of the evolutionary dynamics of subdivided populations. I consider effects of population size, population subdivision, and local adaptation on the dynamics of speciation. I briefly discuss some implications of the dynamics on holey adaptive landscapes for molecular evolution.

Rapid parapatric speciation on holey adaptive landscapes

Abstract: A classical view of speciation is that reproductive isolation arises as a by-product of genetic divergence. Here, individual-based simulations are used to evaluate whether the mechanisms implied by this view may result in rapid speciation if the only source of genetic divergence are mutation and random genetic drift. Distinctive features of the simulations are the consideration of the complete process of speciation (from initiation until completion), and of a large number of loci, which was only one order of magnitude smaller than that of bacteria. It is demonstrated that rapid speciation on the time scale of hundreds of generations is plausible without the need for extreme founder events, complete geographic isolation, the existence of distinct adaptive peaks or selection for local adaptation. The plausibility of speciation is enhanced by population subdivision. Simultaneous emergence of more than two new species from a subdivided population is highly probable. Numerical examples relevant to the theory of centrifugal speciation and to the conjectures about the fate of ``ring species'' and ``sexual continuums'' are presented.

Large-scale evolution and extinction in a hierarchically structured environment

Abstract: A class of models for large-scale evolution and mass extinctions is presented. These models incorporate environmental changes on all scales, from influences on a single species to global effects. This is a step towards a unified picture of mass extinctions, which enables one to study coevolutionary effects and external abiotic influences with the same means. The generic features of such models are studied in a simple version, in which all environmental changes are generated at random and without feedback from other parts of the system.

Dynamics of clade diversification on the morphological hypercube

Abstract: Understanding the relationship between taxonomic and morphological changes is important in identifying the reasons for accelerated morphological diversification early in the history of animal phyla. Here, a simple general model describing the joint dynamics of taxonomic diversity and morphological disparity is presented and applied to the data on the diversification of blastozoans. I show that the observed patterns of deceleration in clade diversification can be explicable in terms of the geometric structure of the morphospace and the effects of extinction and speciation on morphological disparity without invoking major declines in the size of morphological transitions or taxonomic turnover rates. The model allows testing of hypotheses about patterns of diversification and estimation of rates of morphological evolution. In the case of blastozoans, I find no evidence that major changes in evolutionary rates and mechanisms are responsible for the deceleration of morphological diversification seen during the period of this clade's expansion. At the same time, there is evidence for a moderate decline in overall rates of morphological diversification concordant with a major change (from positive to negative values) in the clade's growth rate.

The Structure of Adaptive Competition in Minority Games

Abstract: In this paper we present results and analyses of a class of games in which heterogeneous agents are rewarded for being in a minority group. Each agent possesses a number of fixed strategies each of which are predictors of the next minority group. The strategies use a set of aggregate, publicly available information (reflecting the agents' collective previous decisions) to make their predictions. An agent chooses which group to join at a given moment by using one of his strategies. These games are adaptive in that agents can choose, at different points of the game, to exercise different strategies in making their choice of which group to join. We find, rather generally, that such systems evidence a phase change from a maladaptive, informationally efficient phase in which the system performs poorly at generating resources, to an inefficient phase in which there is an emergent cooperation among the agents, and the system more effectively generates resources. The best emergent coordination is achieved in a transition region between these two phases. This transition occurs when the dimension of the strategy space is of the order of the number of agents playing the game. We present explanations for this general behavior, based in part on an information theoretic analysis of the system and its publicly available information. We also propose a mean-field like model of the game which is most accurate in the maladaptive, efficient phase. In addition, we show that the best individual agent performance in the two different phases is achieved by sets of strategies with markedly different characteristics. We discuss implications of our results for various aspects of the study of complex adaptive systems.

Diversity, Stability, Recursivity, and Rule Generation in Biological System: Intra-inter Dynamics Approach

Abstract: Basic problems for the construction of a scenario for the Life are discussed. To study the problems in terms of dynamical systems theory, a scheme of intra-inter dynamics is presented. It consists of internal dynamics of a unit, interaction among the units, and the dynamics to change the dynamics itself, for example by replication (and death) of units according to their internal states. Applying the dynamics to cell differentiation, isologous diversification theory is proposed. According to it, orbital instability leads to diversified cell behaviors first. At the next stage, several cell types are formed, first triggered by clustering of oscillations, and then as attracting states of internal dynamics stabilized by the cell-to-cell interaction. At the third stage, the differentiation is determined as a recursive state by cell division. At the last stage, hierarchical differentiation proceeds, with the emergence of stochastic rule for the differentiation to sub-groups, where regulation of the probability for the differentiation provides the diversity and stability of cell society. Relevance of the theory to cell biology is discussed.

On the 1/f fluctuations in the nonlinear systems affected by noise

Abstract: We investigate a problem of the necessary and sufficient conditions for appearance of the 1/f fluctuations in the simple systems affected by the external random perturbations, i.e. the power spectral density of the flux of particles moving in some contours and perturbed by the external forces. In some cases we observe the 1/f behavior but only in some range of frequencies and parameters of the systems.

Decline in extinction rates and scale invariance in the fossil record

Abstract: We show that the decline in the extinction rate during the Phanerozoic can be accurately parameterized by a logarithmic fit to the cumulative total extinction. This implies that extinction intensity is falling off approximately as the reciprocal of time. We demonstrate that this observation alone is sufficient to explain the existence of the proposed power-law forms in the distribution of the sizes of extinction events and in the power spectrum of Phanerozoic extinction, results which previously have been explained by appealing to self-organized critical theories of evolutionary dynamics.

Invariant closure for the Fokker-Planck equation

Abstract: We develop the principle of dynamic invariance to obtain closed moment equations from the Fokker-Planck kinetic equation. The analysis is carried out to explicit formulae for computation of the lowest eigenvalue and of the corresponding eigenfunction for arbitrary potentials.

Reproductive Tradeoffs In Uncertain Environments: Explaining The Evolution Of Cultural Elaboration

Abstract: Dunnell's (1989) explanation for cultural elaboration proposed that elaboration could be a consequence of selection within uncertain environments. He developed the theory to the extent that it performed well explaining the distribution of elaboration at regional scales within eastern North America. More detailed studies require more detailed development of the theory, so that additional hypotheses and implications can be deduced. We draw upon theories of selection in fluctuating environments and portions of life history theory to propose a formal model of selection for "waste" in uncertain environments. We use agent-based simulation to explore the sufficiency of the theory for explaining the maintenance of high levels of elaboration within populations, and deduce novel implications for archaeological evidence usable by others to test the utility of Dunnell's model in specific localities.

Power spectra of extinction in the fossil record

Abstract: Recent Fourier analyses of fossil extinction data have indicated that the power spectrum of extinction during the Phanerozoic may take the form of 1/f noise, a result which, it has been suggested, could be indicative of the presence of "critical dynamics" in the processes giving rise to extinction. In this paper we examine extinction power spectra in some detail, using family-level data from a variety of different sources. We find that although the average form of the power spectrum roughly obeys the 1/f law, the spectrum can be represented more accurately by dividing it into two regimes: a low-frequency one which is well fit by an exponential, and a high-frequency one in which it follows a power law with a 1/f^2 form. We give explanations for the occurrence of each of these behaviours and for the position of the cross-over between them.