Vivek Borkar

Q: What Schools Are Affiliated With Vivek Borkar

Vivek Borkar is affiliated with the following schools: Tata Institute of Fundamental Research, University of California, Berkeley, Indian Institute of Science, IIT Bombay, Case Western Reserve University

Vivek Borkar's AcademicInfluence.com Rankings

Vivek Borkar

Engineering

#2080

World Rank

#2918

Historical Rank

Electrical Engineering

#607

World Rank

#668

Historical Rank

engineering Degrees

Vivek Borkar

Mathematics

#4407

World Rank

#6268

Historical Rank

Measure Theory

#775

World Rank

#1034

Historical Rank

mathematics Degrees

Download Badge

Engineering
Mathematics

Vivek Borkar's Degrees

PhD Electrical Engineering University of California, Berkeley

Why Is Vivek Borkar Influential?

(Suggest an Edit or Addition)

According to Wikipedia, Vivek Shripad Borkar is an Indian electrical engineer, mathematician and an Institute chair professor at the Indian Institute of Technology, Mumbai. He is known for introducing analytical paradigm in stochastic optimal control processes and is an elected fellow of all the three major Indian science academies viz. the Indian Academy of Sciences, Indian National Science Academy and the National Academy of Sciences, India. He also holds elected fellowships of The World Academy of Sciences, Institute of Electrical and Electronics Engineers, Indian National Academy of Engineering and the American Mathematical Society. The Council of Scientific and Industrial Research, the apex agency of the Government of India for scientific research, awarded him the Shanti Swarup Bhatnagar Prize for Science and Technology, one of the highest Indian science awards for his contributions to Engineering Sciences in 1992. He received the TWAS Prize of the World Academy of Sciences in 2009.

(See a Problem?)

Vivek Borkar's Published Works

Number of citations in a given year to any of this author's works

Total number of citations to an author for the works they published in a given year. This highlights publication of the most important work(s) by the author

Published Works

A unified framework for hybrid control: model and optimal control theory (1998) (1406)
Stochastic Approximation: A Dynamical Systems Viewpoint (2008) (1031)
Manufacturing consent (2010) (820)
Discrete-time controlled Markov processes with average cost criterion: a survey (1993) (603)
Controlled diffusion processes (2005) (575)
Stochastic approximation with two time scales (1997) (444)
The O.D.E. Method for Convergence of Stochastic Approximation and Reinforcement Learning (2000) (390)
Asymptotic agreement in distributed estimation (1982) (306)
A unified framework for hybrid control (1994) (290)
A Theory of QoS for Wireless (2009) (266)
A New Distributed Time Synchronization Protocol for Multihop Wireless Networks (2006) (239)
Actor-Critic - Type Learning Algorithms for Markov Decision Processes (1999) (233)
Optimal Control of Diffusion Processes (1989) (194)
Learning Algorithms for Markov Decision Processes with Average Cost (2001) (190)
An actor-critic algorithm for constrained Markov decision processes (2005) (175)
Distributed Asynchronous Incremental Subgradient Methods (2001) (175)
Probability Theory: An Advanced Course (1995) (155)
Asynchronous Stochastic Approximations (1998) (149)
LQG Control with Communication Constraints (1997) (147)
Topics in controlled Markov chains (1991) (145)
Occupation measures for controlled Markov processes: characterization and optimality (1996) (143)
Convex Analytic Methods in Markov Decision Processes (2002) (133)
Risk-Sensitive Optimal Control for Markov Decision Processes with Monotone Cost (2002) (131)
An on-line learning algorithm for energy efficient delay constrained scheduling over a fading channel (2008) (130)
A convex analytic approach to Markov decision processes (1988) (120)
Q-Learning for Risk-Sensitive Control (2002) (117)
Epsilon-Approximation of Differential Inclusions (1996) (111)
Adaptive control of Markov chains, I: Finite parameter set (1979) (110)
Optimal sequential vector quantization of Markov sources (1998) (95)
Ergodic Control of Diffusion Processes (2012) (90)
White-noise representations in stochastic realization theory (1993) (88)
A unified framework for hybrid control : b background, model, and theory (1994) (79)
Dynamic Cesaro-Wardrop equilibration in networks (2003) (77)
Risk-constrained Markov decision processes (2010) (73)
Adaptive Importance Sampling Technique for Markov Chains Using Stochastic Approximation (2006) (71)
Stochastic Approximation for Nonexpansive Maps: Application to Q-Learning Algorithms (1997) (71)
Index Policies for Real-Time Multicast Scheduling for Wireless Broadcast Systems (2008) (65)
On Minimum Cost Per Unit Time Control of Markov Chains (1984) (60)
Ergodic control of multidimensional diffusions 1: the existence results (1988) (58)
Ergodic Control of Markov Chains with Constraints---The General Case (1994) (55)
Stochastic quantization of field theory in finite and infinite volume (1988) (55)
Common randomness and distributed control: A counterexample (2007) (55)
An analog scheme for fixed point computation. I. Theory (1997) (53)
Distributed Reinforcement Learning via Gossip (2013) (53)
Control of Markov chains with long-run average cost criterion: the dynamic programming equations (1989) (52)
Identification and adaptive control of Markov chains (1982) (50)
A sensitivity formula for risk-sensitive cost and the actor-critic algorithm (2001) (49)
A Learning Algorithm for Risk-Sensitive Cost (2008) (48)
A model-based approach to clock synchronization (2009) (47)
Structural Properties of Optimal Transmission Policies Over a Randomly Varying Channel (2008) (47)
Control of Markov Chains with Long-Run Average Cost Criterion (1988) (47)
A two Timescale Stochastic Approximation Scheme for Simulation-Based Parametric Optimization (1998) (46)
Average Cost Dynamic Programming Equations For Controlled Markov Chains With Partial Observations (2000) (45)
Averaging of Singularly Perturbed Controlled Stochastic Differential Equations (2007) (44)
A Concentration Bound for Stochastic Approximation via Alekseev’s Formula (2015) (44)
Stochastic differential games: Occupation measure based approach (1996) (43)
Parameter estimation in continuous-time stochastic processes (1982) (42)
A Stable Online Algorithm for Energy-Efficient Multiuser Scheduling (2010) (42)
Controlled Markov Chains and Stochastic Networks (1983) (42)
Ergodic Control of Diffusion Processes: Subject index (2011) (39)
Parameter identification in infinite dimensional linear systems (1981) (37)
The actor-critic algorithm as multi-time-scale stochastic approximation (1997) (37)
Asymptotics of the invariant measure in mean field models with jumps (2011) (35)
Reinforcement Learning in Markovian Evolutionary Games (2002) (35)
Multiscale Stochastic Approximation for Parametric Optimization of Hidden Markov Models (1997) (35)
Stochastic approximation with 'controlled Markov' noise (2006) (34)
McKean–Vlasov Limit in Portfolio Optimization (2010) (33)
Ergodic control of multidimensional diffusions, II: Adaptive control (1990) (33)
Optimal Control of Sleep Periods for Wireless Terminals (2011) (33)
Differential join prices for parallel queues: social optimality, dynamic pricing algorithms and application to Internet pricing (2002) (33)
Multiscale Chaotic SPSA and Smoothed Functional Algorithms for Simulation Optimization (2003) (32)
Whittle index based Q-learning for restless bandits with average reward (2020) (32)
Controlled diffusions with constraints (1990) (32)
Submodularity in Team Formation Problem (2014) (32)
A Variational Formula for Risk-Sensitive Reward (2015) (31)
Opportunistic Scheduling as Restless Bandits (2017) (30)
Risk-Sensitive Control with Near Monotone Cost (2010) (30)
Peformance Analysis Conditioned on Rare Events: An Adaptive Simulation Scheme (2003) (29)
DIMENSIONAL LINEAR SYSTEMS (1981) (28)
A learning algorithm for Markov decision processes with adaptive state aggregation (2000) (28)
Learning Algorithms for Risk-Sensitive Control (2010) (27)
Denumerable state stochastic games with limiting average payoff (1993) (26)
A topology for Markov controls (1989) (26)
An analog scheme for fixed-point computation-Part II: Applications (1999) (26)
A Note on Stochastic Dissipativeness (2003) (26)
Ergodic Control for Constrained Diffusions: Characterization Using HJB Equations (2004) (25)
Markov control problems under communication constraints (2001) (25)
On Existence of Limit Occupational Measures Set of a Controlled Stochastic Differential Equation (2005) (25)
Uniform Recurrence Properties of Controlled Diffusions and Applications to Optimal Control (2010) (24)
On the Lock-in Probability of Stochastic Approximation (2002) (24)
A Strong Approximation Theorem for Stochastic Recursive Algorithms (1999) (24)
Dynamic programming for ergodic control with partial observations (2003) (23)
Who is the fairest of them all? (2012) (23)
Whittle index policy for crawling ephemeral content (2015) (23)
Fast rumor source identification via random walks (2016) (22)
Optimal random access in networks with two-way traffic (2004) (22)
Charge-based control of DiffServ-like queues (2004) (21)
Nonlinear Gossip (2016) (21)
A further remark on dynamic programming for partially observed Markov processes (2004) (19)
Singular Perturbations in Ergodic Control of Diffusions (2007) (19)
Concentration bounds for two time scale stochastic approximation (2018) (19)
Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula (2013) (19)
Adaptive control of Markov chains (1979) (19)
Dynamic Programming for Ergodic Control of Markov Chains under Partial Observations: A Correction (2007) (19)
Controlled Markov chains with constraints (1990) (18)
Low Complexity Online Radio Access Technology Selection Algorithm in LTE-WiFi HetNet (2020) (18)
The Kumar-Becker-Lin scheme revisited (1990) (18)
Self-tuning control of diffusions without the identifiability condition (1991) (18)
Reinforcement Learning — A Bridge Between Numerical Methods and Monte Carlo (2009) (17)
An index policy for dynamic pricing in cloud computing under price commitments (2017) (17)
Whittle indexability in egalitarian processor sharing systems (2017) (17)
Ergodic Control of Diffusion Processes: Preface (2011) (17)
Sequential Source Coding: An optimization viewpoint (2005) (17)
A LEARNING ALGORITHM FOR DISCRETE-TIME STOCHASTIC CONTROL (2000) (16)
A Variational Characterization of the Risk-Sensitive Average Reward for Controlled Diffusions on ℝd (2019) (16)
A New Markov Selection Procedure for Degenerate Diffusions (2010) (16)
A novel ACO algorithm for optimization via reinforcement and initial bias (2009) (16)
Some Game-Theoretic Problems in Wireless Ad-Hoc Networks (2004) (16)
Closed and open loop optimal control of buffer and energy of a wireless device (2005) (15)
Temporally Agnostic Rumor-Source Detection (2017) (15)
WLC39-3: Power Optimal Opportunistic Scheduling (2006) (15)
Stochastic approximation (2013) (15)
Distributed topology control of wireless networks (2005) (15)
On the diffusion of messages in on-line social networks (2013) (15)
Hamiltonian Cycle Problem and Markov Chains (2012) (14)
Empirical Q-Value Iteration (2014) (14)
Small noise asymptotics for invariant densities for a class of diffusions: A control theoretic view (2009) (14)
Dynamics of individual specialization and global diversification in communities (1998) (13)
A remark on the attainable distributions of controlled diffusions (1986) (13)
Distributed Stochastic Approximation with Local Projections (2017) (13)
Directed graphs, Hamiltonicity and doubly stochastic matrices (2004) (13)
Asynchronous Gossip for Averaging and Spectral Ranking (2013) (12)
A reinforcement learning algorithm for restless bandits (2018) (12)
The ODE Method for Asymptotic Statistics in Stochastic Approximation and Reinforcement Learning (2021) (12)
Ergodic control of partially observed Markov chains (1998) (12)
Q-learning for Markov decision processes with a satisfiability criterion (2018) (12)
Evolution of interacting particles in a brownian medium (1984) (12)
On the Hamiltonicity Gap and doubly stochastic matrices (2009) (12)
TRANSMISSION RATE CONTROL OVER RANDOMLY VARYING CHANNELS (2005) (11)
Whittle Index for Partially Observed Binary Markov Decision Processes (2017) (11)
Whittle Index Policy for Crawling Ephemeral Content (2018) (11)
Convergence of the Relative Value Iteration for the Ergodic Control Problem of Nondegenerate Diffusions under Near-Monotone Costs (2013) (11)
Randomized Kaczmarz for rank aggregation from pairwise comparisons (2016) (11)
On De finetti coherence and kolmogorov probability (2004) (11)
The value function in ergodic control of diffusion processes with partial observations (1999) (11)
Power Optimal Opportunistic Scheduling (2008) (11)
Linear Programming Formulation of Long-Run Average Optimal Control Problem (2018) (11)
Concentration of Contractive Stochastic Approximation and Reinforcement Learning (2021) (10)
A note on linear function approximation using random projections (2008) (10)
Existence of optimal controls for partially observed diffusions (1983) (10)
Distributed and Asynchronous Methods for Semi-supervised Learning (2016) (10)
Uniform Stability of Controlled Markov Processes (2000) (10)
Online Reinforcement Learning of Optimal Threshold Policies for Markov Decision Processes (2019) (10)
A concentration bound for contractive stochastic approximation (2021) (10)
A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions (2011) (10)
Ergodic control problem for one-dimensional diffusions with near-monotone cost (1984) (10)
Feature Search in the Grassmanian in Online Reinforcement Learning (2013) (10)
Stochastic differential games: Occupation measure based approach (1992) (9)
A Convex Analytic Framework for Ergodic Control of Semi-Markov Processes (1995) (9)
A stochastic Kaczmarz algorithm for network tomography (2012) (9)
Revisiting random walk based sampling in networks: evasion of burn-in period and frequent regenerations (2018) (9)
Stochastic approximation with long range dependent and heavy tailed noise (2012) (9)
Bayesian parameter estimation and adaptive control of Markov processes with time-averaged cost (1998) (9)
Method in the madness (2000) (9)
Aerial monitoring of slow moving convoys using elliptical orbits (2019) (9)
Recursive self-tuning control of finite Markov chains (1997) (9)
The probabilistic structure of controlled diffusion processes (1988) (9)
A New Learning Algorithm for Optimal Stopping (2009) (9)
A remark on control of partially observed Markov chains (1991) (8)
User Association in Dense mmWave Networks as Restless Bandits (2021) (8)
Metastability in Stochastic Replicator Dynamics (2018) (8)
Risk sensitive optimal control framework applied to delay tolerant networks (2011) (8)
Relative Value Iteration for Stochastic Differential Games (2012) (8)
LP Formulations of Discrete Time Long-Run Average Optimal Control Problems: The NonErgodic Case (2018) (8)
Oja's algorithm for graph clustering, Markov spectral decomposition, and risk sensitive control (2012) (8)
Network pricing for QoS: A 'Regulation' approach (2005) (8)
Controlled equilibrium selection in stochastically perturbed dynamics (2015) (8)
On extremal solutions to stochastic control problems, II (1991) (8)
Reinforcement Learning for Matrix Computations: PageRank as an Example (2013) (8)
Optimal sampling for state change detection with application to the control of sleep mode (2009) (8)
Quasi-stationary distributions as centrality measures for the giant strongly connected component of a reducible graph (2010) (8)
Pathwise recurrence orders and simulated annealing (1992) (7)
Vacation policy optimization with application to IEEE 802.16e power saving mechanism (2009) (7)
Cooperative dynamics and Wardrop equilibria (2009) (7)
Application of nonlinear filtering to credit risk (2010) (7)
Finite chain approximation for a continuous stochastic control problem (1981) (7)
Distributed self-tuning of sensor networks (2006) (7)
On a controlled eigenvalue problem (2010) (7)
Collective Behaviour and Diversity in Economic Communities: Some Insights from an Evolutionary Game (1998) (7)
Computational Social Networks (2016) (7)
Actor-Critic Algorithms with Online Feature Adaptation (2016) (7)
Optimal control of semilinear stochastic evolution equations (1994) (7)
Average cost optimal control under weak ergodicity hypotheses: Relative value iterations. (2019) (7)
Control of buffer and of a wireless device : closed and open loop approaches (2005) (6)
A note on controlled diffusions on line with time-averaged cost (1984) (6)
Value functions and performance evaluation in stochastic network models (2003) (6)
Ergodic and adaptive control of nearest-neighbor motions (1991) (6)
On extremal solutions to stochastic control problems (1991) (6)
Erratum to: Risk-Sensitive Control with Near Monotone Cost (2010) (6)
Gradient Estimation with Simultaneous Perturbation and Compressive Sensing (2015) (6)
Stochastic approximation algorithms for rumor source inference on graphs (2019) (6)
Managing interprocessor delays in distributed recursive algorithms (1994) (6)
A learning algorithm for the Whittle index policy for scheduling web crawlers (2019) (6)
Finite dimensional approximation and Newton-based algorithm for stochastic approximation in Hilbert space (2009) (6)
Ergodic and adaptive control of nearest-neighbor motions (1991) (6)
Greedy Block Coordinate Descent (GBCD) Method for High Dimensional Quadratic Programs (2014) (6)
Corrections to :20Ergodic control problem for one-dimensional diffusions with near-monotone cost” (1986) (6)
Approachability in Stackelberg Stochastic Games with Vector Costs (2014) (6)
Singular Perturbations in Risk-Sensitive Stochastic Control (2010) (6)
A Simulation-Based Algorithm for Ergodic Control of Markov Chains Conditioned on Rare Events (2006) (5)
Distributed computation of fixed points of ∞-nonexpansive maps (1996) (5)
A Distributed Boyle-Dykstra-Han Scheme (2017) (5)
A Structure-aware Online Learning Algorithm for Markov Decision Processes (2018) (5)
Comparison of Random Walk Based Techniques for Estimating Network Averages (2016) (5)
On the Milito-Cruz adaptive control scheme for Markov chains (1993) (5)
Stochastic Control with Imperfect Models (2008) (5)
Controlled diffusions with boundary-crossing costs (1988) (5)
Simultaneous Small Noise Limit for Singularly Perturbed Slow-Fast Coupled Diffusions (2018) (5)
Gaussian approximations in high dimensional estimation (2016) (4)
There’s no such thing as a free lunch (1998) (4)
A Stable On-line Algorithm for Energy Efficient Multi-user Scheduling (2009) (4)
Mimicking finite dimensional marginals of a controlled diffusion by simpler controls (1989) (4)
Controlling G-AIMD by index policy (2017) (4)
Evolutionary games with two timescales (1999) (4)
Risk sensitive dynamic programming with unbounded cost (1999) (4)
Correction to "Recursive self-tuning control of finite Markov chains" (Applicationes Math. 24 (2) (1996), 169-188) (1997) (4)
Non-asymptotic error bounds for constant stepsize stochastic approximation for tracking mobile agents (2018) (4)
Some Examples of Stochastic Approximation in Communications (2007) (4)
Stability of annealing schemes and related processes (2000) (4)
Stochastic processes that generate polygonal and related random fields (1996) (4)
Controlled gossip (2011) (4)
Vector field guidance for convoy monitoring using elliptical orbits (2017) (4)
Convergence analysis for an online recommendation system (2011) (4)
Probability Theory (1995) (3)
Oja's algorithm for graph clustering and Markov spectral decomposition (2008) (3)
Stability and convergence of stochastic approximation using the ODE method (1998) (3)
Blackwell's approachability in stackelberg stochastic games: A learning version (2014) (3)
Linear and dynamic programming approaches to degenerate risk-sensitive reward processes (2017) (3)
Mathematical Programming Embeddings of Logic (2002) (3)
The value function in ergodic control of diffusion processes with partial observations II (2000) (3)
Control of a partially observed diffusion up to an exit time (1987) (3)
Avoidance of traps in stochastic approximation (2003) (3)
ADAPTIVE FEATURE PURSUIT: ONLINE ADAPTATION OF FEATURES IN REINFORCEMENT LEARNING (2011) (3)
Bounds for Tracking Error in Constant Stepsize Stochastic Approximation (2018) (3)
On ergodic control of degenerate diffusions (1995) (3)
Prospect-theoretic Q-learning (2021) (3)
The Nisio semigroup for controlled diffusions with partial observations (1986) (3)
Markov chains, Hamiltonian cycles and volumes of convex bodies (2013) (3)
QWI: Q-learning with Whittle Index (2022) (3)
An actor critic algorithm based on Grassmanian search (2014) (3)
Full Gradient DQN Reinforcement Learning: A Provably Convergent Scheme (2021) (3)
Distributed Server Allocation for Content Delivery Networks (2017) (3)
Ergodic Control of Partially Degenerate Diffusions in a Compact Domain (2003) (2)
An Information Theoretic View of Stochastic Resonance (2007) (2)
Gossip with transmission constraints (2013) (2)
Lattice approximation in the stochastic quantization of (φ4)2 fields1 (1989) (2)
Distributed Algorithms: Tsitsiklis and Beyond (2018) (2)
Lqg Control with Communication Constraints* Lqg Control with Communication Constraints (2)
SUPPLEMENT TO “ CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS (2017) (2)
Erratum: Asynchronous Stochastic Approximations (2000) (2)
Logic and mathematical programming (1997) (2)
A Learning Scheme for Approachability in MDPs and Stackelberg Stochastic Games (2014) (2)
A robustness property of the separation principle (1977) (2)
On Extremal Solutions of Controlled Nonlinear Filtering Equations (1995) (2)
Parallel and Distributed Approaches for Graph Based Semi-supervised Learning (2015) (2)
Convergence of population dynamics in symmetric routing games with a finite number of playersz (2009) (2)
Variations on a theme by neyman and pearson (2004) (2)
Correction to ``The value function in ergodic control of diffusion processes with partial observations II" (Applicationes Math. 27 (2000), 455-464) (2001) (2)
IMPROVED TEMPORAL DIFFERENCE METHODS WITH LINEAR FUNCTION APPROXIMATION1 (2003) (2)
Generalized Replicator Dynamics as a Model of Specialization and Diversity in Societies (1998) (2)
A comparison principle for certain convex functionals of a diffusion process without drift (1987) (2)
Reinforcement learning, particle filters and the EM algorithm (2014) (2)
Removing sampling bias in networked stochastic approximation (2014) (2)
On the relative value iteration with a risk-sensitive criterion (2019) (2)
Remarks on Differential Inclusion limits of Stochastic Approximation (2023) (1)
Ergodic risk-sensitive control—A survey (2022) (1)
Weak convergence methods and singularly perturbed stochastic control and filtering problems: Harold J. Kushner (1992) (1)
Actor-Critic or Critic-Actor? A Tale of Two Time Scales (2022) (1)
Optimal Distributed Uplink Channel Allocation: A Constrained MDP Formulation (2011) (1)
Ergodic Control of Diffusion Processes: Controlled Switching Diffusions (2011) (1)
Fast rumor source identification via random walks (2016) (1)
Ergodic Control of Diffusion Processes: Controlled Diffusions (2011) (1)
Postponing Collapse: Ergodic Control with a Probabilistic Constraint (2019) (1)
Power Efficient Scheduling under Delay Constraints over Multi-user Wireless Channels (2007) (1)
A Correction to "A Relative Value Iteration Algorithm for Nondegenerate Controlled Diffusions" (2017) (1)
Asymptotic and non-asymptotic convergence properties of stochastic approximation with controlled Markov noise without ensuring stability (2016) (1)
Average cost optimal control under weak hypotheses: Relative value iterations (2019) (1)
Sample complexity for markov chain self-tuner (2000) (1)
Algorithmic Mechanisms for Secure Multi-Auction Systems (2003) (1)
An Adaptive Window Scheme for Backoff in 802.11 MAC Protocol (2016) (1)
Robust parameter optimization of hidden Markov models (2013) (1)
Scheduling in Wireless Networks with Spatial Reuse of Spectrum as Restless Bandits (2019) (1)
Equation of State Calculations by Fast Computing Machines (2022) (1)
On LP Formulations of Optimal Control Problems with Time Averaging and Time Discounting Criteria in Non-Ergodic Case (2019) (1)
Maximizing Conditional Entropy for Batch-Mode Active Learning of Perceptual Metrics (2021) (1)
Linear and Dynamic Programs for Risk-Sensitive Cost Minimization (2021) (1)
Quasi-stationary distributions as centrality measures of reducible graphs (2007) (1)
Erratum to: Risk-Sensitive Control with Near Monotone Cost (2010) (1)
Existence of limit occupational measures set used for averaging of singularly perturbed controlled stochastic differential equations (2006) (1)
An efficient scheduling algorithm for solving load commitment problem under Time of Use Pricing with bound on Maximum Demand (2014) (1)
Linear Programming Based Algorithms (2012) (1)
Mean Field Limits Through Local Interactions (2016) (1)
Deep Reinforcement Learning for Web Crawling (2021) (1)
Erratum to “Ergodic control of partially observed Markov chains” [Systems Control Lett. 34 (1998) 185–189]☆ (1999) (1)
Correction to “existence of optimal controls for partially observed diffusions” (1984) (1)
Design and Implementation of SeTiA: Secure Multi Auction System I: Auction Mechanisms (2005) (1)
How to gossip if you must (2013) (1)
A Learning Scheme for Blackwell ’ s Approachability in MDPs and Stackelberg Stochastic Games (2014) (1)
Opinion Shaping in Social Networks Using Reinforcement Learning (2019) (1)
“Controlled” Versions of the Collatz–Wielandt and Donsker–Varadhan Formulae (2019) (1)
Randomized neural networks for learning stochastic dependences (1999) (1)
Dynamic Social Learning Under Graph Constraints (2020) (1)
Distributed computation of fixed points of infinity-nonexpansive maps (1996) (0)
Simultaneous Small Noise Limit for Singularly Perturbed Slow-Fast Coupled Diffusions (2019) (0)
Newton’s method (2002) (0)
Wardrop equilibria and relaxation oscillations in queuing systems (2017) (0)
Rocking in two by two: From Collatz-Wielandt to Donsker-Varadhan (2015) (0)
Foundations of Continuous-Time Processes (1995) (0)
Reinforcement learning, Sequential Monte Carlo and the EM algorithm (2018) (0)
Ergodic Control of Diffusion Processes: Epilogue (2011) (0)
Parameter estimation in stochastic systems: some recent results and applications (1982) (0)
Stochastic approximation (2013) (0)
Editorial (2012) (0)
Event-driven stochastic approximation (2016) (0)
Pictures at an exhibition — A Lagrange multiplier gallery (1998) (0)
Models for Performance Analysis and Control of Networks (2006) (0)
An Online Network Tomography Algorithm (2012) (0)
Conditioning and Martingales (1995) (0)
The Birth of MCMC (2022) (0)
Playing Dice with the Universe: Algorithms for Random Environments (0)
Accelerating MCMC by Rare Intermittent Resets (2021) (0)
Controlled Markov Chains on a Countable State Space: Some Recent Results (1990) (0)
Series expansions for nonlinear filters (1993) (0)
Asymptotic and non-asymptotic convergence properties of stochastic approximation with controlled Markov noise using lock-in probability (2016) (0)
A Concentration Bound for LSPE(λ) (2023) (0)
A variational characterization of the optimal exit rate for controlled diffusions (2020) (0)
CAPACITY OF MARKOV CHANNELS: A STOCHASTIC CONTROL APPROACH (2008) (0)
Metastability in Stochastic Replicator Dynamics (2018) (0)
Edge conductance estimation using MCMC (2016) (0)
From Collatz-Weilandt to Donkser-Varadhan via Krein-Rutman (2014) (0)
CORRECTION TO “TRANSMISSION RATE CONTROL OVER RANDOMLY VARYING CHANNELS” (2005) (0)
Constant Stepsize Algorithms (2008) (0)
Learning Decentralized Goal-based Vector Quantization (1997) (0)
A Limit Theorem for Fluctuations (2008) (0)
Discrete-Time Markov Chains [Book Review] (2005) (0)
O C ] 7 M ay 2 01 8 Linear Programming Formulation of Long Run Average Optimal Control Problem (2018) (0)
A concentration result for stochastic approximation (Extended abstract) (2016) (0)
9 Improved Temporal Difference Methods with Linear Function Approximation (2008) (0)
Probability CONTROLLED EQUILIBRIUM SELECTION IN STOCHASTICALLY PERTURBED DYNAMICS By (2017) (0)
MCMC Approaches to Rumor Source Inference using Pairwise Information (2017) (0)
Linear Programming Formulation of Long-Run Average Optimal Control Problem (2018) (0)
ERRATUM: White-Noise Representations in Stochastic Realization Theory (2010) (0)
Concentration bounds for SSP Q-learning for average cost MDPs (2022) (0)
PR ] 7 M ay 2 01 8 Metastability in Stochastic Replicator Dynamics (2018) (0)
Lock-in probability of stochastic approximation with controlled Markov noise (2016) (0)
A Power Optimal Scheduling Algorithm on a Point to Point Wireless Link (2006) (0)
Recent trends in Markov decision processes (2013) (0)
Karl Pearson (1857–1936) (2023) (0)
Editorial (2022) (0)
A Unified Batch Selection Policy for Active Metric Learning (2021) (0)
Norbert Wiener and engineering (1999) (0)
Controlled Diffusions with Partial Observations (2011) (0)
Stabilization of a quasi-linear parabolic Cauchy problem associated with ergodic control of diffusions (2014) (0)
Markov Decision Processes (2012) (0)
Variations of a Neyman and Pearson theme ∗ (2003) (0)
Lock-in Probability (2008) (0)
An Improved Block Coordinate Descent Method for Quadratic Programming in High Dimensions (2014) (0)
Revisiting SIR in the age of COVID-19: Explicit Solutions and Control Problems (2020) (0)
Interior Point and Cross-Entropy Algorithms (2012) (0)
Self-similar Structure and Hamiltonicity (2012) (0)
Problem-aware scheduling of in-network computation over multi-hop wireless networks (2012) (0)
A Concentration Bound for Lspe$(\Lambda)$ (2021) (0)
John Forbes Nash Jr (1928–2015) (2015) (0)
A Selection Procedure for Extracting the Unique Feller Weak Solution of Degenerate Diffusions (2022) (0)
Sparse Regression using Compressive Sensing with Input Shaping (2018) (0)
How low can you sink? (1997) (0)
A Fresh Look at Markov Decision Processes. (1987) (0)
Edge detection through a time-homogeneous Markov system (1998) (0)
HJB Equations for Ergodic Control Problems for Constrained Diffusions in Polyhedral Domains. (2005) (0)
Appendix: Results from Second Order Elliptic Equations (2011) (0)
Model-based clock synchronization protocol for wireless sensor networks (2013) (0)
Markov Chain Monte Carlo (MCMC) (2022) (0)
Risk sensitive optimal control framework applied to Multi-dimensional delay tolerant networks (2010) (0)
Ergodic Control of Diffusion Processes: Nondegenerate Controlled Diffusions (2011) (0)
Scheduling in Wireless Networks using Whittle Index Theory (2022) (0)
Risk-Sensitive Control and an Abstract Collatz–Wielandt Formula (2015) (0)
Markov chains, Hamiltonian cycles and volumes of convex bodies (2011) (0)
Full Gradient Deep Reinforcement Learning for Average-Reward Criterion (2023) (0)
Series Expansions for Nonlinear Filters 1 (0)
Gossip and related algorithms (2014) (0)
Event-driven stochastic approximation (2016) (0)
Basic Convergence Analysis (2008) (0)
Random Projections and Ensemble Kalman Filter BTP Stage-II Full Report by Raaz Dwivedi Roll (2016) (0)
On the fastest finite Markov processes (2016) (0)
Book Reviews (1999) (0)
An Incremental Kaczmarz Algorithm for Network Tomography (2012) (0)
Approachability in Stackelberg Stochastic Games with Vector Costs (2016) (0)
On infinitesimal σ-fields generated by random processes (1993) (0)
On the optimal exit rate for controlled diffusions (2020) (0)
Model-based clock synchronization protocol (2013) (0)
QWI (2022) (0)
Reinforcement Learning in Non-Markovian Environments (2022) (0)
Learning to cooperate in agent-based control of queueing networks (2022) (0)
Stochastic Recursive Inclusions (2008) (0)
Design and Implementation of SeTiA: Secure Multi Auction System II: Architecture and Implementation Issues (2005) (0)
Ergodic Control of Diffusion Processes: References (2011) (0)
Special Issue : Multi-Agent Dynamic Decision Making and Learning (2023) (0)
Edge detection through a time-homogeneous markov chain (2013) (0)
Greedy Block Coordinate Descent (GBCD) Method for Quadratic Programming in High Dimensions (2014) (0)
Reinforcement learning, Sequential Monte Carlo and the EM algorithm (2018) (0)
On the lock-in probability estimate of stochastic approximation with controlled Markov noise (2016) (0)
Corrigendum to "A concentration bound for contractive stochastic approximation" [Syst. Control Lett. 153 (2021) 104947] (2022) (0)
Convexity in stochastic control (1998) (0)
A dynamic programming framework for optimal home scheduling (2017) (0)
Spaces of Probability Measures (1995) (0)
On averaging of singularly perturbed stochastic differential equations (2007) (0)
Pathwise smoothing of Markov processes with noisy observations (1982) (0)
Stochastic differential equations and applications (1999) (0)
A Concentration Bound for Distributed Stochastic Approximation (2022) (0)
‘Minimum toll’ control of diffusions (1989) (0)
Various Topics in Nondegenerate Diffusions (2011) (0)
Why do clocks move clockwise? (1998) (0)
Controlled Martingale Problems (2011) (0)
Norbert Wiener and control engineering (1999) (0)
Basic Limit Theorems (1995) (0)
Stochastic control and stability with applications: Ari Arapostathis memorial issue (2023) (0)
A relative value iteration for controlled diffusions under ergodic cost (2012) (0)
Manufacturing Consent * (invited Paper) (2011) (0)
Erratum to "Avoidance of traps in stochastic approximation" [Systems Control Letters 50 (2003) 1-9] (2006) (0)
Frequently Used Notation (2011) (0)
Endorsements for Communication Networking: An Analytical Approach (2004) (0)
Opportunistic Transmission over Randomly Varying Channels (2009) (0)
Stochastic Processes at Generate olygonal and Related (1996) (0)
Revisiting random walk based sampling in networks: evasion of burn-in period and frequent regenerations (2018) (0)
Ergodic Control of Diffusion Processes: Markov Processes and Ergodic Properties (2011) (0)
Stochastic approximation with ‘bad’ noise (2011) (0)

This paper list is powered by the following services:

Other Resources About Vivek Borkar

en.wikipedia.org

What Schools Are Affiliated With Vivek Borkar?

Vivek Borkar is affiliated with the following schools:

Vivek Borkar's Academic­Influence.com Rankings

Vivek Borkar's Degrees

Why Is Vivek Borkar Influential?

Vivek Borkar's Published Works

Published Works

Other Resources About Vivek Borkar

What Schools Are Affiliated With Vivek Borkar?

Vivek Borkar's AcademicInfluence.com Rankings