Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
Reads0
Chats0
TLDR
The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures that can be significantly more efficient than the standard algorithms in large-dimensional problems.Abstract:
The problem of finding a root of the multivariate gradient equation that arises in function minimization is considered. When only noisy measurements of the function are available, a stochastic approximation (SA) algorithm for the general Kiefer-Wolfowitz type is appropriate for estimating the root. The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures. Theory and numerical experience indicate that the algorithm can be significantly more efficient than the standard algorithms in large-dimensional problems. >read more
Citations
More filters
Model, identification & analysis of complex stochastic systems: Applications in stochastic partial differential equations and multiscale mechanics
TL;DR: This paper presents a meta-analysis of the asymptotic distribution of Polynomial Chaos in the Random Process using the nKL vector and the Fisher Information Matrix as a model for estimating the maximum likelihood probabilities of Z and Y coefficients.
Posted Content
Stochastic Variational Optimization.
TL;DR: It is concluded that, for differentiable objectives, using Directional Derivatives is preferable to using Variational Optimization to perform parallel Stochastic Gradient Descent.
Journal ArticleDOI
Parameter estimation using simultaneous perturbation stochastic approximation
TL;DR: In this article, a parameter estimation algorithm using the simultaneous perturbation stochastic approximation (SPSA) algorithm is proposed, where all parameters are perturbed simultaneously, since all parameters can be modified with only two measurements of an evaluation function regardless of the dimension of the parameter.
Journal ArticleDOI
Identification of continuous-time Hammerstein systems by simultaneous perturbation stochastic approximation
TL;DR: The main advantage of the SPSA-based method is that it can be applied to identification of Hammerstein systems with less restrictive assumptions, and is useful to obtain accurate models, even for high-dimensional parameter identification.
Proceedings ArticleDOI
Scalable on-chip quantum state tomography
James Titchener,Markus Gräfe,René Heilmann,Alexander S. Solntsev,Alexander Szameit,Andrey A. Sukhorukov +5 more
TL;DR: This work states that for an W-qubit system an exponentially increasing number of measurements are needed, which makes characterizing large quantum systems highly challenging.
References
More filters
Journal ArticleDOI
An Introduction to Probability Theory and Its Applications.
Journal ArticleDOI
Stochastic Estimation of the Maximum of a Regression Function
J. Kiefer,Jacob Wolfowitz +1 more
TL;DR: In this article, the authors give a scheme whereby, starting from an arbitrary point, one obtains successively $x_2, x_3, \cdots$ such that the regression function converges to the unknown point in probability as n \rightarrow \infty.
Journal ArticleDOI
Multidimensional Stochastic Approximation Methods
TL;DR: In this paper, a multidimensional stochastic approximation scheme is presented, and conditions are given for these schemes to converge a.s.p.s to the solutions of $k-stochastic equations in $k$ unknowns.
Journal ArticleDOI
Accelerated Stochastic Approximation
TL;DR: In this article, the Robbins-Monro procedure and the Kiefer-Wolfowitz procedure are considered, for which the magnitude of the $n$th step depends on the number of changes in sign in $(X_i - X_{i - 1})$ for n = 2, \cdots, n.