Multivariate stochastic approximation using a simultaneous perturbation gradient approximation
Reads0
Chats0
TLDR
The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures that can be significantly more efficient than the standard algorithms in large-dimensional problems.Abstract:
The problem of finding a root of the multivariate gradient equation that arises in function minimization is considered. When only noisy measurements of the function are available, a stochastic approximation (SA) algorithm for the general Kiefer-Wolfowitz type is appropriate for estimating the root. The paper presents an SA algorithm that is based on a simultaneous perturbation gradient approximation instead of the standard finite-difference approximation of Keifer-Wolfowitz type procedures. Theory and numerical experience indicate that the algorithm can be significantly more efficient than the standard algorithms in large-dimensional problems. >read more
Citations
More filters
Journal ArticleDOI
Adaptive optics correction based on stochastic parallel gradient descent technique under various atmospheric scintillation conditions: numerical simulation
TL;DR: Results indicate that the SPGD adaptive system always performs better than the system based on the least-squares wavefront reconstruction technique in the presence of relatively serious intensity scintillations.
Posted Content
Error Bounds and Applications for Stochastic Approximation with Non-Decaying Gain
TL;DR: In this paper, a stochastic approximation algorithm with non-decaying gains is proposed to track the time-varying optimum of a dynamical system with respect to a given parameter.
Journal ArticleDOI
Robust optimization of Random Early Detection
Rahul Vaidya,Shalabh Bhatnagar +1 more
TL;DR: The algorithm presented here is found to show better performance as compared to a recently proposed algorithm that adaptively tunes a RED parameter, and makes use of direct measurements in the network.
Journal ArticleDOI
Actor-Critic Algorithms with Online Feature Adaptation
TL;DR: It is proved that two new online actor-critic control algorithms with adaptive feature tuning for Markov Decision Processes (MDPs) converge to locally optimal policies.
Journal ArticleDOI
Decoding Delay Minimization in Inter-Session Network Coding
TL;DR: A novel framework for efficient rate allocation in networks where intermediate network nodes have the opportunity to combine packets from different sources using randomized network coding is proposed.
References
More filters
Journal ArticleDOI
An Introduction to Probability Theory and Its Applications.
Journal ArticleDOI
Stochastic Estimation of the Maximum of a Regression Function
J. Kiefer,Jacob Wolfowitz +1 more
TL;DR: In this article, the authors give a scheme whereby, starting from an arbitrary point, one obtains successively $x_2, x_3, \cdots$ such that the regression function converges to the unknown point in probability as n \rightarrow \infty.
Journal ArticleDOI
Multidimensional Stochastic Approximation Methods
TL;DR: In this paper, a multidimensional stochastic approximation scheme is presented, and conditions are given for these schemes to converge a.s.p.s to the solutions of $k-stochastic equations in $k$ unknowns.
Journal ArticleDOI
Accelerated Stochastic Approximation
TL;DR: In this article, the Robbins-Monro procedure and the Kiefer-Wolfowitz procedure are considered, for which the magnitude of the $n$th step depends on the number of changes in sign in $(X_i - X_{i - 1})$ for n = 2, \cdots, n.