Showing papers in "arXiv: Disordered Systems and Neural Networks in 2001"

Neutron Scattering Studies of the Model Glass Former Ortho-terphenyl

Abstract: The van der Waals liquid orthoterphenyl has long been used as a model system in the study of the glass transition. Motivated by mode-coupling theory, extensive experiments have been undertaken to monitor the onset of structural relaxation on microscopic time and length scales. Using in particular quasielastic neutron scattering, the decay of density and tagged-particle correlations has been measured as a function of temperature, pressure and wave number. A consistent picture is developped in which the mode-coupling singularity appears as a change of transport mechanism in the moderately viscous liquid, at temperatures far above the conventional (caloric) glass transition.

Reply to Comment on "Stripe glasses: self generated randomness in a uniformly frustrated system"

Abstract: Using our previous results for the configurational entropy of a stripe glass as well as a variational result for the bare surface tension of entropic droplets we show that there is no disagreement between the numerical simulations of Grousson et al. and our theory. The claim that our theory disagrees with numerical simulations is based on the assumption that the surface tension is independent of the frustration parameter Q of the model. However, we show in this Reply that it varies strongly with Q and that the resulting Q-dependence of the kinetic fragility agrees with the one obtained by Grousson et al. We believe that this answers the questions raised in the Comment by Grousson et al.

Measuring Anti-Correlations in the Nordic Electricity Spot Market by Wavelets

Abstract: We consider the Nordic electricity spot market from mid 1992 to the end of year 2000. This market is found to be well approximated by an anti-persistent self-affine (mean-reverting) walk. It is characterized by a Hurst exponent of $H\simeq 0.41$ over three orders of magnitude in time ranging from days to years. We argue that in order to see such a good scaling behavior, and to locate cross-overs, it is crucial that an analyzing technique is used that {\em decouples} scales. This is in our case achieved by utilizing a (multi-scale) wavelet approach. The shortcomings of methods that do not decouple scales are illustrated by applying, to the same dat a set, the classic $R/S$- and Fourier techniques, for which scaling regimes and/or positions of cross-overs are hard to define.

Unsupervised learning and adaptation in a model of adult neurogenesis

Abstract: Adult neurogenesis has long been documented in the vertebrate brain, and recently even in humans. Although it has been conjectured for many years that its functional role is related to the renewing of memories, no clear mechanism as to how this can be achieved has been proposed. We present a scheme in which incorporation of new neurons proceeds at a constant rate, while their survival is activity-dependent and thus contingent upon new neurons establishing suitable connections. We show that a simple mathematical model following these rules organizes its activity so as to maximize the difference between its responses, and can adapt to changing environmental conditions in unsupervised fashion.

Metastability in Glauber dynamics in the low-temperature limit: Beyond exponential asymptotics

Abstract: We consider Glauber dynamics of classical spin systems of Ising type in the limit when the temperature tends to zero in finite volume. We show that information on the structure of the most profound minima and the connecting saddle points of the Hamiltonian can be translated into sharp estimates on the distribution of the times of metastable transitions between such minima as well as the low lying spectrum of the generator. In contrast with earlier results on such problems, where only the asymptotics of the exponential rates is obtained, we compute the precise pre-factors up to multiplicative errors that tend to 1 as $T\downarrow 0$. As an example we treat the nearest neighbor Ising model on the 2 and 3 dimensional square lattice. Our results improve considerably earlier estimates obtained by Neves-Schonmann and Ben Arous-Cerf. Our results employ the methods introduced by Bovier, Eckhoff, Gayrard, and Klein.

Perturbation of infinite networks of resistors

Abstract: The resistance between arbitrary nodes of infinite networks of resistors is studied when the network is perturbed by removing one bond from the perfect lattice. A connection is made between the resistance and the lattice Green's function of the perturbed network. Solving Dyson's equation the Green's function and the resistance of the perturbed lattice are expressed in terms of those of the perfect lattice. Numerical results are presented for a square lattice. Our method of the lattice Green's function in studying resistor networks can also be applied in the field of random walks as well as electrical and mechanical breakdown phenomena in insulators, thin films and modern ceramics.

A Stochastic Model for the Evolution of the Web

Abstract: Recently several authors have proposed stochastic models of the growth of the Web graph that give rise to power-law distributions. These models are based on the notion of preferential attachment leading to the ``rich get richer'' phenomenon. However, these models fail to explain several distributions arising from empirical results, due to the fact that the predicted exponent is not consistent with the data. To address this problem, we extend the evolutionary model of the Web graph by including a non-preferential component, and we view the stochastic process in terms of an urn transfer model. By making this extension, we can now explain a wider variety of empirically discovered power-law distributions provided the exponent is greater than two. These include: the distribution of incoming links, the distribution of outgoing links, the distribution of pages in a Web site and the distribution of visitors to a Web site. A by-product of our results is a formal proof of the convergence of the standard stochastic model (first proposed by Simon).

Diffusion and the Mesoscopic Hydrodynamics of Supercooled Liquids

Abstract: The description of molecular motion by macroscopic hydrodynamics has a long and continuing history. The Stokes-Einstein relation between the diffusion coefficient of a solute and the solvent viscosity predicted using macroscopic continuum hydrodynamics, is well satisfied for liquids under ordinary to high temperature conditions, even for solutes as small as the solvent. Diffusion in supercooled liquids near their glass transition temperature has been found to deviate by as much as 3 orders of magnitude from that predicted by the Stokes-Einstein Relation [1]. Based on the random first order transition theory [2-4], supercooled liquids possess a mosaic structure. The size- and temperature-dependence of the transport anomalies are quantitatively explained with an effective medium hydrodynamics model based on the microscopic theory of this mesoscale, mosaic structure.

Spin-Glass and Chiral-Glass Transitions in a $\pm J$ Heisenberg Spin-Glass Model in Three Dimensions

Abstract: The three-dimensional $\pm J$ Heisenberg spin-glass model is investigated by the non-equilibrium relaxation method from the paramagnetic state. Finite-size effects in the non-equilibrium relaxation are analyzed, and the relaxation functions of the spin-glass susceptibility and the chiral-glass susceptibility in the infinite-size system are obtained. The finite-time scaling analysis gives the spin-glass transition at $T_{\rm sg}/J=0.21_{-0.02}^{+0.01}$ and the chiral-glass transition at $T_{\rm cg}/J=0.22_{-0.03}^{+0.01}$. The results suggest that both transitions occur simultaneously. The critical exponent of the spin-glass susceptibility is estimated as $\gamma_{\rm sg}= 1.7 \pm 0.3$, which makes an agreement with the experiments of the insulating and the canonical spin-glass materials.

Aging in the random energy model

Abstract: In this letter we announce rigorous results on the phenomenon of aging in the Glauber dynamics of the random energy model and their relation to Bouchaud's 'REM-like' trap model. We show that, below the critical temperature, if we consider a time-scale that diverges with the system size in such a way that equilibrium is almost, but not quite reached on that scale, a suitably defined autocorrelation function has the same asymptotic behaviour than its analog in the trap model.

Transition from insulating to a non-insulating temperature dependence of the conductivity in granular metals

Abstract: We consider interaction effects in a granular normal metal at not very low temperatures. Assuming that all weak localization effects are suppressed by the temperature we replace the initial Hamiltonian by a proper functional of phases and study the possibility for a phase transition depending on the tunneling conductance $g$. It is demonstrated for any dimension that, while at small $g$ the conductivity decays with temperature exponentially, its temperature dependence is logarithmic at large $g.$ The formulae obtained are compared with an existing experiment and a good agreement is found.

A Classification of random Dirac fermions

Abstract: We present a detailed classification of random Dirac hamiltonians in two spatial dimensions based on the implementation of discrete symmetries. Our classification is slightly finer than that of random matrices, and contains thirteen classes. We also extend this classification to non-hermitian hamiltonians with and without Dirac structure.

Comment on 'Statistical mechanics of CDMA multiuser demodulation'

Abstract: In a recent paper, Tanaka formulated and solved a model of CDMA multiuser demodulation by applying the theory of spin glasses, the replica method in particular. It is shown in the present comment that some of his results can be derived without recourse to the replica method; conclusions from the somewhat tricky replica method are justified rigorously.

"Single Ring Theorem" and the Disk-Annulus Phase Transition

Abstract: Recently, an analytic method was developed to study in the large $N$ limit non-hermitean random matrices that are drawn from a large class of circularly symmetric non-Gaussian probability distributions, thus extending the existing Gaussian non-hermitean literature. One obtains an explicit algebraic equation for the integrated density of eigenvalues from which the Green's function and averaged density of eigenvalues could be calculated in a simple manner. Thus, that formalism may be thought of as the non-hermitean analog of the method due to Brezin, Itzykson, Parisi and Zuber for analyzing hermitean non-Gaussian random matrices. A somewhat surprising result is the so called "Single Ring" theorem, namely, that the domain of the eigenvalue distribution in the complex plane is either a disk or an annulus. In this paper we extend previous results and provide simple new explicit expressions for the radii of the eigenvalue distiobution and for the value of the eigenvalue density at the edges of the eigenvalue distribution of the non-hermitean matrix in terms of moments of the eigenvalue distribution of the associated hermitean matrix. We then present several numerical verifications of the previously obtained analytic results for the quartic ensemble and its phase transition from a disk shaped eigenvalue distribution to an annular distribution. Finally, we demonstrate numerically the "Single Ring" theorem for the sextic potential, namely, the potential of lowest degree for which the "Single Ring" theorem has non-trivial consequences.

Dynamical ultrametricity in the critical trap model

Abstract: We show that the trap model at its critical temperature presents dynamical ultrametricity in the sense of Cugliandolo and Kurchan [CuKu94]. We use the explicit analytic solution of this model to discuss several issues that arise in the context of mean-field glassy dynamics, such as the scaling form of the correlation function, and the finite time (or finite forcing) corrections to ultrametricity, that are found to decay only logarithmically with the associated time scale, as well as the fluctuation dissipation ratio. We also argue that in the multilevel trap model, the short time dynamics is dominated by the level which is at its critical temperature, so that dynamical ultrametricity should hold in the whole glassy temperature range. We revisit some experimental data on spin-glasses in light of these results.

The origin of fat tailed distributions in financial time series

Abstract: A classic problem in physics is the origin of fat tailed distributions generated by complex systems. We study the distributions of stock returns measured over different time lags $\tau.$ We find that destroying all correlations without changing the $\tau = 1$ d distribution, by shuffling the order of the daily returns, causes the fat tails almost to vanish for $\tau>1$ d. We argue that the fat tails are caused by known long-range volatility correlations. Indeed, destroying only sign correlations, by shuffling the order of only the signs (but not the absolute values) of the daily returns, allows the fat tails to persist for $\tau >1$ d.

The State(s) of Replica Symmetry Breaking: Mean Field Theories vs. Short-Ranged Spin Glasses

Abstract: We prove the impossibility of recent attempts to decouple the Replica Symmetry Breaking (RSB) picture for finite-dimensional spin glasses from the existence of many thermodynamic (i.e., infinite-volume) pure states while preserving another signature RSB feature --- space filling relative domain walls between different finite-volume states. Thus revisions of the notion of pure states cannot shield the RSB picture from the internal contradictions that rule out its physical correctness in finite dimensions at low temperature in large finite volume.

Statistical Physics of the Glass Phase

Abstract: This paper gives an introduction to some of the statistical physics problems which appear in the study of structural glasses. It is a shortened and updated version of a more detailed review paper which has appeared in cond-mat/0005173.

Low-temperature kinetics of exciton-exciton annihilation of weakly localized one-dimensional Frenkel excitons

Abstract: We present results of numerical simulations of the kinetics of exciton-exciton annihilation of weakly localized one-dimensional Frenkel excitons at low temperatures. We find that the kinetics is represented by two well-distinguished components: a fast short-time decay and a very slow long-time tail. The former arises from excitons that initially reside in states belonging to the same localization segment of the chain, while the slow component is caused by excitons created on different localization segments. We show that the usual bi-molecular theory fails in the description of the behavior found. We also present a qualitative analytical explanation of the non-exponential behavior observed in both the short- and the long-time decay components.

Gaussian Process Regression with Mismatched Models

Abstract: Learning curves for Gaussian process regression are well understood when the `student' model happens to match the `teacher' (true data generation process). I derive approximations to the learning curves for the more generic case of mismatched models, and find very rich behaviour: For large input space dimensionality, where the results become exact, there are universal (student-independent) plateaux in the learning curve, with transitions in between that can exhibit arbitrarily many over-fitting maxima. In lower dimensions, plateaux also appear, and the asymptotic decay of the learning curve becomes strongly student-dependent. All predictions are confirmed by simulations.

Spin-Glass Phase in the Random Temperature Ising Ferromagnet

Abstract: In this paper we study the phase diagram of the disordered Ising ferromagnet. Within the framework of the Gaussian variational approximation it is shown that in systems with a finite value of the disorder in dimensions D=4 and D < 4 the paramagnetic and ferromagnetic phases are separated by a spin-glass phase. The transition from paramagnetic to spin-glass state is continuous (second-order), while the transition between spin-glass and ferromagnetic states is discontinuous (first-order). It is also shown that within the considered approximation there is no replica symmetry breaking in the spin-glass phase. The validity of the Gaussian variational approximation for the present problem is discussed, and we provide a tentative physical interpretation of the results.

Measuring information spatial densities

Abstract: A novel definition of the stimulus-specific information is presented, which is particularly useful when the stimuli constitute a continuous and metric set, as for example, position in space. The approach allows one to build the spatial information distribution of a given neural response. The method is applied to the investigation of putative differences in the coding of position in hippocampus and lateral septum.

Against Chaos in Temperature in Mean-Field Spin-Glass Models

Abstract: We study the problem of chaos in temperature in some mean-field spin-glass models by means of a replica computation over a model of coupled systems. We propose a set of solutions of the saddle point equations which are intrinsically non-chaotic and solve a general problem regarding the consistency of their structure. These solutions are relevant in the case of uncoupled systems too, therefore they imply a non-trivial overlap distribution $P(q_{T1T2})$ between systems at different temperatures. The existence of such solutions is checked to fifth order in an expansion near the critical temperature through highly non-trivial cancellations, while it is proved that a dangerous set of such cancellations holds exactly at all orders in the Sherrington-Kirkpatrick (SK) model. The SK model with soft-spin distribution is also considered obtaining analogous results. Previous analytical results are discussed.

Saddle Points and Dynamics of Lennard-Jones Clusters, Solids and Supercooled Liquids

Abstract: The properties of higher-index saddle points have been invoked in recent theories of the dynamics of supercooled liquids. Here we examine in detail a mapping of configurations to saddle points using minimization of $| abla E|^2$, which has been used in previous work to support these theories. The examples we consider are a two-dimensional model energy surface and binary Lennard-Jones liquids and solids. A shortcoming of the mapping is its failure to divide the potential energy surface into basins of attraction surrounding saddle points, because there are many minima of $| abla E|^2$ that do not correspond to stationary points of the potential energy. In fact, most liquid configurations are mapped to such points for the system we consider. We therefore develop an alternative route to investigate higher-index saddle points and obtain near complete distributions of saddles for small Lennard-Jones clusters. The distribution of the number of stationary points as a function of the index is found to be Gaussian, and the average energy increases linearly with saddle point index in agreement with previous results for bulk systems.

Statistical Mechanics of Linear Compression Codes in Network Communication

Abstract: We analyze the performance of a linear code used for a data compression of Slepian-Wolf type. In our framework, two correlated data are separately compressed into codewords employing Gallager-type codes and casted into a communication network through two independent input terminals. At the output terminal, the received codewords are jointly decoded by a practical algorithm based on the Thouless-Anderson-Palmer approach. Our analysis shows that the achievable rate region presented in the data compression theorem by Slepian and Wolf is described as first-order phase transitions among several phases. The typical performance of the practical decoder is also well evaluated by the replica method.

p-Adic Models of Ultrametric Diffusion Constrained by Hierarchical Energy Landscapes

Abstract: We demonstrate that p-adic analysis is a natural basis for the construction of a wide variety of the ultrametric diffusion models constrained by hierarchical energy landscapes. A general analytical description in terms of p-adic analysis is given for a class of models. Two exactly solvable examples, i.e. the ultrametric diffusion constraned by the linear energy landscape and the ultrametric diffusion with reaction sink, are considered. We show that such models can be applied to both the relaxation in complex systems and the rate processes coupled to rearrangenment of the complex surrounding.

Investigation on gait by means of factorial moments

Abstract: By means of Factorial Moments(FM), the long-range correlations embedded in gait time series are investigated. It is found that FM is an effective tool to deal with this kind of time series. Keywords: Factorial Moments,Time series, Long-range correlations

Gauge Symmetry and Neural Networks

Abstract: We propose a new model of neural network. It consists of spin variables to describe the state of neurons as in the Hopfield model and new gauge variables to describe the state of synapses. The model possesses local gauge symmetry and resembles lattice gauge theory of high-energy physics. Time dependence of synapses describes the process of learning. The mean field theory predicts a new phase corresponding to confinement phase, in which brain loses ablility of learning and memory.

Extremely Dilute Modular Neuronal Networks: Neocortical Memory Retrieval Dynamics

Abstract: A model of the columnar functional organization of neocortical association areas is studied. The neuronal network is composed of many Hebbian autoassociators, or modules, each of which interacts with a relatively small number of the others. Every module encodes and stores a number of elementary percepts, or features. Memory items, or patterns, are peculiar combinations of features sparsely distributed over the multi-modular network. Any feature stored in any module can be involved in several of the stored patterns; feature-sharing is in fact source of local ambiguities and, consequently, a potential cause of erroneous memory retrieval activity spreading through the model network. The memory retrieval dynamics of the large multi-modular autoassociator is investigated by means of quantitative analysis and numerical simulations. An oscillatory retrieval process is found to be very efficient in overcoming feature-sharing drawbacks; it requires a mechanism that modulates the robustness of local attractors to noise, and neuronal activity sparseness such that quiescent and active modules are about equally noisy. Correlated activation of interconnected modules and extramodular neuronal contacts more effective than the intramodular ones seem to be general requirements in order to efficiently achieve satisfactory quality of memory retrieval. It is also shown that, even in ideal conditions, some spots of the network cannot be reached by retrieval activity spread. The locations of these activity isles depend on the pattern to retrieve and on the cue, while their extension only depends on architecture of the graph and statistics of the stored patterns. The existence of these isles determines an upper-bound to retrieval quality that does not depend on the specific retrieval dynamics adopted, nor on whether feature-sharing is permitted. The oscillatory retrieval process nearly saturates this bound.

A Classification of Non-Hermitian Random Matrices

Abstract: We present a classification of non-hermitian random matrices based on implementing commuting discrete symmetries. It contains 38 classes. This generalizes the classification of hermitian random matrices due to Altland-Zirnbauer and it also extends the Ginibre ensembles of non-hermitian matrices.