Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
Reads0
Chats0
TLDR
The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures that can be significantly more efficient than the standard algorithms in large-dimensional problems.Abstract:
The problem of finding a root of the multivariate gradient equation that arises in function minimization is considered. When only noisy measurements of the function are available, a stochastic approximation (SA) algorithm for the general Kiefer-Wolfowitz type is appropriate for estimating the root. The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures. Theory and numerical experience indicate that the algorithm can be significantly more efficient than the standard algorithms in large-dimensional problems. >read more
Citations
More filters
Posted Content
Adaptive system optimization using random directions stochastic approximation
TL;DR: It is established that the asymmetric Bernoulli variant of Newton RDSA method is better than 2SPSA of [1] .
Proceedings ArticleDOI
On simultaneous perturbation particle swarm optimization
TL;DR: The method has global search capability of the particle swarm optimization and local search one of gradient method by the simultaneous perturbation and some variations of the method are described.
Proceedings ArticleDOI
Simultaneous Perturbation Particle Swarm Optimization Using FPGA
Yutaka Maeda,N. Matsushita +1 more
TL;DR: An algorithm of the particle swarm optimization and the simultaneous perturbation optimization method and the SPPSO using FPGA, which utilize local information of an objective function and global shape of the function based on the usual PSO.
Journal ArticleDOI
Ensemble Kalman Filtering with Residual Nudging: An Extension to State Estimation Problems with Nonlinear Observation Operators
Xiaodong Luo,Ibrahim Hoteit +1 more
TL;DR: In this paper, the authors proposed an extension and modification of residual nudging to handle nonlinear observation operators, which achieved the objective of residual ndging for data assimilation problems with nonlinear observations.
Calibration of a Macroscopic Traffic Simulation Model Using Enhanced Simultaneous Perturbation Stochastic Approximation Methodology
Jung-Beom Lee,Kaan Ozbay +1 more
TL;DR: This paper proposes a calibration methodology based on the Bayesian sampling approach that uses randomly generated demand matrices and corresponding traffic conditions from an observed statistical distribution of these variables to accurately represent a wide range of all likely demand conditions observed at a facility.
References
More filters
Journal ArticleDOI
An Introduction to Probability Theory and Its Applications.
Journal ArticleDOI
Stochastic Estimation of the Maximum of a Regression Function
J. Kiefer,Jacob Wolfowitz +1 more
TL;DR: In this article, the authors give a scheme whereby, starting from an arbitrary point, one obtains successively $x_2, x_3, \cdots$ such that the regression function converges to the unknown point in probability as n \rightarrow \infty.
Journal ArticleDOI
Multidimensional Stochastic Approximation Methods
TL;DR: In this paper, a multidimensional stochastic approximation scheme is presented, and conditions are given for these schemes to converge a.s.p.s to the solutions of $k-stochastic equations in $k$ unknowns.
Journal ArticleDOI
Accelerated Stochastic Approximation
TL;DR: In this article, the Robbins-Monro procedure and the Kiefer-Wolfowitz procedure are considered, for which the magnitude of the $n$th step depends on the number of changes in sign in $(X_i - X_{i - 1})$ for n = 2, \cdots, n.