No article text was recorded for this version.
two-timescale stochastic approximation
Version 2 of 2284 papers373 conceptsfrozen 2026-10-04
Papers in this version
- Blog: A Finite Time Analysis of Two Time-Scale Actor Critic Methods
- Blog: Convergent Reinforcement Learning Algorithms for Stochastic Shortest Path Problem
- Blog: Analysis of a Target-Based Actor-Critic Algorithm with Linear Function Approximation
- Blog: A Two-Time-Scale Stochastic Optimization Framework with Applications in Control and Reinforcement Learning
- Blog: Quantile-Based Deep Reinforcement Learning using Two-Timescale Policy Gradient Algorithms
- Blog: Linear Off-Policy Actor-Critic
- Blog: Provably Global Convergence of Actor-Critic: A Case for Linear Quadratic Regulator with Ergodic Cost
- Blog: Policy Gradients for CVaR-Constrained MDPs
- Blog: Adaptive Bases for Reinforcement Learning
- Blog: Global Convergence of Two-timescale Actor-Critic for Solving Linear Quadratic Regulator
- Blog: Policy Gradients with Variance Related Risk Criteria
- Blog: Towards 6G Native-AI Edge Networks: A Semantic-Aware and Agentic Intelligence Paradigm
- Blog: Risk-Constrained Reinforcement Learning with Percentile Risk Criteria
- Blog: Convergence of an actor-critic gradient flow for entropy regularised MDPs in general spaces
- Blog: Maximum-Likelihood Inverse Reinforcement Learning with Finite-Time Guarantees
- Blog: Independent and Decentralized Learning in Markov Potential Games
- Blog: A Survey of Multi Agent Reinforcement Learning: Federated Learning and Cooperative and Noncooperative Decentralized Regimes
- Blog: Analysis of a Target-Based Actor-Critic Algorithm with Linear Function Approximation
- Blog: Off-Policy Average Reward Actor-Critic with Deterministic Policy Search
- Blog: A constrained optimization perspective on actor-critic algorithms and application to network routing
- Blog: Episodic Logit-Q Dynamics for Efficient Learning in Stochastic Teams
- Blog: Quantile-Based Policy Optimization for Reinforcement Learning
- Blog: Aggregate Fictitious Play for Learning in Anonymous Polymatrix Games
- Blog: Parameter-Free Federated TD Learning with Markov Noise in Heterogeneous Environments
- Blog: Global Optimality and Finite Sample Analysis of Softmax Off-Policy Actor Critic under State Distribution Mismatch
- Blog: Incremental Natural Actor-Critic Algorithms
- Blog: Quantile Reinforcement Learning
- Blog: Reinforcement Learning for Sleep-Wake Scheduling in Sensor Networks
- Blog: Variance Adjusted Actor Critic Algorithms
- Blog: GINO-Q: Learning an Asymptotically Optimal Index Policy for Restless Multi-armed Bandits
- Blog: Reinforcement Learning for Sleep-Wake Scheduling in Sensor Networks
- Blog: Finite Sample Analysis of Two-Time-Scale Natural Actor-Critic Algorithm
- Blog: Intrinsic-Motivation Multi-Robot Social Formation Navigation with Coordinated Exploration
- Blog: Whittle Index based Q-Learning for Wireless Edge Caching with Linear Function Approximation
- Blog: Off-Policy Temporal Difference Learning with Bellman Residuals
- Blog: N-Timescale Stochastic Approximation: Stability and Convergence
- Blog: Two-Timescale Q-Learning with Function Approximation in Zero-Sum Stochastic Games
- Blog: $Q$-learning with regularization converges with non-linear non-stationary features
- Blog: Global Convergence of Two-Timescale Actor-Critic for Solving Linear Quadratic Regulator
- Blog: Independent and Decentralized Learning in Markov Potential Games
- Blog: Approximate information state for approximate planning and reinforcement learning in partially observed systems
- Blog: Finite-Time Error Bounds for Greedy-GQ
- Blog: A new convergent variant of Q-learning with linear function approximation
- Blog: Finite-Time Performance Bounds and Adaptive Learning Rate Selection for Two Time-Scale Reinforcement Learning
- Blog: Two-Timescale Networks for Nonlinear Value Function Approximation
- Blog: Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks
- Blog: n-step temporal difference learning with optimal n
- Blog: Reinforcement Learning with Quasi-Hyperbolic Discounting
- Blog: Reward Constrained Policy Optimization
- Blog: A constrained optimization perspective on actor critic algorithms and application to network routing
- Blog: Oracle-free Reinforcement Learning in Mean-Field Games along a Single Sample Path
- Blog: Online Attentive Kernel-Based Temporal Difference Learning
- Blog: Decentralized Q-Learning in Zero-sum Markov Games
- Blog: Game-theoretical control with continuous action sets
- Blog: Breaking the Deadly Triad with a Target Network
- Blog: Actor-Critic Algorithms
- Blog: Reinforcement Learning for Decentralized Stochastic Control and Coordination Games
- Blog: Two timescale convergent Q-learning for sleep-scheduling in wireless sensor networks
- Blog: Reward Constrained Policy Optimization
- Blog: Concentration bounds for two time scale stochastic approximation
Showing 60 of 284 papers.
History & citation
Current · Permanent link
- Multi-Timescale Stochastic Approximation for Stable Reinforcement Learning merged into this direction (75% overlap)
Cite this direction
Latest version (a living page):
@misc{lacuna_two_timescale_stochastic_approximation_729084c5,
title = {two-timescale stochastic approximation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/two-timescale-stochastic-approximation/rdr_729084c51ec9457294c6c18c7f838745},
note = {Latest version of a living research direction; cite a version for a fixed text. Accessed 2026-11-20},
}This exact version (version 2, frozen text):
@misc{lacuna_two_timescale_stochastic_approximation_729084c5_v2,
title = {two-timescale stochastic approximation},
author = {{Lacuna}},
howpublished = {Lacuna research direction},
year = {2026},
url = {https://lacuna.tiptreesystems.com/direction/two-timescale-stochastic-approximation/rdr_729084c51ec9457294c6c18c7f838745/v/2},
note = {Version 2, frozen 2026-10-04. Accessed 2026-11-20},
}