Kenji Doya
#118,728
Most Influential Person Now
Researcher
Kenji Doya's AcademicInfluence.com Rankings
Kenji Doyacomputer-science Degrees
Computer Science
#4710
World Rank
#4973
Historical Rank
Machine Learning
#1017
World Rank
#1032
Historical Rank
Artificial Intelligence
#1240
World Rank
#1263
Historical Rank
Database
#1914
World Rank
#2009
Historical Rank
Download Badge
Computer Science
Kenji Doya's Degrees
- PhD Computer Science University of Tokyo
- Masters Electrical Engineering University of Tokyo
- Bachelors Electrical Engineering University of Tokyo
Similar Degrees You Can Earn
Why Is Kenji Doya Influential?
(Suggest an Edit or Addition)Kenji Doya's Published Works
Number of citations in a given year to any of this author's works
Total number of citations to an author for the works they published in a given year. This highlights publication of the most important work(s) by the author
Published Works
- A unifying computational framework for motor control and social interaction. (2003) (1154)
- Reinforcement Learning in Continuous Time and Space (2000) (929)
- Representation of Action-Specific Reward Values in the Striatum (2005) (864)
- Complementary roles of basal ganglia and cerebellum in learning and motor control (2000) (850)
- Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops (2004) (819)
- Parallel neural networks for learning sequential procedures (1999) (760)
- What are the computations of the cerebellum, the basal ganglia and the cerebral cortex? (1999) (754)
- Metalearning and neuromodulation (2002) (644)
- Modulators of decision making (2008) (603)
- Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learning (2017) (540)
- Multiple Model-Based Reinforcement Learning (2002) (475)
- The computational neurobiology of learning and reward (2006) (469)
- A Neural Correlate of Reward-Based Behavioral Learning in Caudate Nucleus: A Functional Magnetic Resonance Imaging Study of a Stochastic Decision Task (2004) (306)
- Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex (2016) (288)
- Hierarchical Bayesian estimation for MEG inverse problem (2004) (271)
- Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning (2000) (258)
- Low-Serotonin Levels Increase Delayed Reward Discounting in Humans (2008) (249)
- Robust Reinforcement Learning (2005) (231)
- Meta-learning in Reinforcement Learning (2003) (220)
- Validation of Decision-Making Models and Analysis of Decision Variables in the Rat Basal Ganglia (2009) (215)
- Optogenetic Activation of Dorsal Raphe Serotonin Neurons Enhances Patience for Future Rewards (2014) (200)
- Activation of Dorsal Raphe Serotonin Neurons Underlies Waiting for Delayed Rewards (2011) (199)
- Parallel Cortico-Basal Ganglia Mechanisms for Acquisition and Execution of Visuomotor SequencesA Computational Approach (2001) (196)
- Serotonin Differentially Regulates Short- and Long-Term Prediction of Rewards in the Ventral and Dorsal Striatum (2007) (183)
- Evidence for effector independent and dependent representations and their differential time course of acquisition during motor sequence learning (2000) (174)
- Bifurcations in the learning of recurrent neural networks (1992) (154)
- Adaptive neural oscillator using continuous-time back-propagation learning (1989) (149)
- Cerebellar aminergic neuromodulation: towards a functional understanding (2004) (138)
- Reinforcement learning: Computational theory and biological mechanisms (2007) (133)
- Electrophysiological properties of inferior olive neurons: A compartmental model. (1999) (131)
- The Role of Serotonin in the Regulation of Patience and Impulsivity (2012) (130)
- Unsupervised learning of granule cell sparse codes enhances cerebellar adaptive control (2001) (123)
- Multiple representations and algorithms for reinforcement learning in the cortico-basal ganglia circuit (2011) (112)
- Chaos may enhance information transmission in the inferior olive. (2004) (110)
- A Novel Reinforcement Model of Birdsong Vocalization Learning (1994) (107)
- Multiple Representations of Belief States and Action Values in Corticobasal Ganglia Loops (2007) (103)
- Understanding Neural Coding through the Model-Based Analysis of Decision Making (2007) (101)
- fMRI investigation of cortical and subcortical networks in the learning of abstract and effector-specific representations of motor sequences (2006) (101)
- Neural mechanisms of learning and control (2001) (99)
- Activation of dorsal raphe serotonin neurons is necessary for waiting for delayed rewards (2011) (99)
- Temporal Difference Learning in Continuous Time and Space (1995) (94)
- Humans Can Adopt Optimal Discounting Strategy under Real-Time Constraints (2006) (91)
- Neuroethics Questions to Guide Ethical Research in the International Brain Initiatives (2018) (87)
- A Kinetic Model of Dopamine- and Calcium-Dependent Striatal Synaptic Plasticity (2010) (85)
- Distinct Neural Representation in the Dorsolateral, Dorsomedial, and Ventral Parts of the Striatum during Fixed- and Free-Choice Tasks (2015) (84)
- Identification of depression subtypes and relevant brain regions using a data-driven approach (2018) (84)
- Reinforcement learning of dynamic motor sequence: learning to stand up (1998) (83)
- Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics (2006) (80)
- Neural substrate of dynamic Bayesian inference in the cerebral cortex (2016) (71)
- 25th Annual Computational Neuroscience Meeting: CNS-2016 (2016) (71)
- Multi-agent reinforcement learning: an approach based on the other agent's internal model (2000) (71)
- The Cyber Rodent Project: Exploration of Adaptive Mechanisms for Self-Preservation and Self-Reproduction (2005) (66)
- Serotonin and the Evaluation of Future Rewards (2007) (61)
- Prediction of clinical depression scores and detection of changes in whole-brain using resting-state functional MRI data with partial least squares regression (2017) (60)
- Toward Probabilistic Diagnosis and Understanding of Depression Based on Functional MRI Data Analysis with Logistic Group LASSO (2015) (59)
- Inter-module credit assignment in modular reinforcement learning (2003) (56)
- Activation of the central serotonergic system in response to delayed but not omitted rewards (2011) (55)
- PIPPS: Flexible Model-Based Policy Search Robust to the Curse of Chaos (2019) (54)
- Serotonin Affects Association of Aversive Outcomes to Past Actions (2009) (51)
- Constrained reinforcement learning from intrinsic and extrinsic rewards (2007) (50)
- Model-based action planning involves cortico-cerebellar and basal ganglia networks (2016) (49)
- Creating Brain-Like Intelligence: From Basic Principles to Complex Intelligent Systems (2009) (49)
- Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience (2018) (48)
- Metalearning, neuromodulation, and emotion (2000) (46)
- Connectivity inference from neural recording data: Challenges, mathematical bases and research directions (2017) (44)
- Memorizing oscillatory patterns in the analog neuron network (1989) (44)
- Computational Model of Recurrent Subthalamo-Pallidal Circuit for Generation of Parkinsonian Oscillations (2017) (43)
- Bifurcations of Recurrent Neural Networks in Gradient Descent Learning (1993) (43)
- Biologically inspired embodied evolution of survival (2005) (41)
- Universality of Fully-Connected Recurrent Neural Networks (1993) (40)
- A Computational Model of Birdsong Learning by Auditory Experience and Auditory Feedback (1998) (40)
- Expected energy-based restricted Boltzmann machine for classification (2015) (38)
- Nitric Oxide Regulates Input Specificity of Long-Term Depression and Context Dependence of Cerebellar Learning (2006) (38)
- Reinforcement learning with via-point representation (2004) (38)
- Reward-Predictive Neural Activities in Striatal Striosome Compartments (2018) (37)
- Evolution of recurrent neural controllers using an extended parallel genetic algorithm (2005) (37)
- Adaptive Baseline Enhances EM-Based Policy Search: Validation in a View-Based Positioning Task of a Smartphone Balancer (2017) (37)
- Recurrent networks: supervised learning (1998) (37)
- Variational Recurrent Models for Solving Partially Observable Control Tasks (2019) (36)
- Hierarchical control of goal-directed action in the cortical–basal ganglia network (2015) (36)
- Competitive-Cooperative-Concurrent Reinforcement Learning with Importance Sampling (2004) (36)
- Near-Saddle-Node Bifurcation Behavior as Dynamics in Working Memory for Goal-Directed Behavior (1998) (35)
- 3 3 A Computational Model of Avian Song Learning (2000) (35)
- Efficient Nonlinear Control with Actor-Tutor Architecture (1996) (35)
- Theoretical Analysis of Efficiency and Robustness of Softmax and Gap-Increasing Operators in Reinforcement Learning (2019) (33)
- Three-dimensional distribution of Fos-positive neurons in the supramammillary nucleus of the rat exposed to novel environment (2009) (32)
- Evidence for Model-Based Action Planning in a Sequential Finger Movement Task (2010) (32)
- Motor Control: Neural Models and Systems Theory (2001) (32)
- Changing the structure of complex visuo-motor sequences selectively activates the fronto-parietal network (2012) (31)
- Learning Sensory Feedback to CPG with Policy Gradient for Biped Locomotion (2005) (30)
- Symbolization and Imitation Learning of Motion Sequence Using Competitive Modules (2006) (30)
- Evolutionary Development of Hierarchical Learning Structures (2007) (29)
- Adaptive Synchronization of Neural and Physical Oscillators (1991) (27)
- Sparse kernel canonical correlation analysis for discovery of nonlinear interactions in high-dimensional data (2017) (26)
- Anterior and superior lateral occipito-temporal cortex responsible for target motion prediction during overt and covert visual pursuit (2006) (26)
- Evolution of meta-parameters in reinforcement learning algorithm (2003) (26)
- Statistical characteristics of climbing fiber spikes necessary for efficient cerebellar learning (2001) (26)
- Finding intrinsic rewards by embodied evolution and constrained reinforcement learning (2008) (25)
- Co-evolution of Shaping Rewards and Meta-Parameters in Reinforcement Learning (2008) (25)
- Evolution of Neural Architecture Fitting Environmental Dynamics (2005) (25)
- Darwinian embodied evolution of the learning ability for survival (2011) (24)
- Hierarchical Reinforcement Learning of Low-Dimensional Subgoals and High-Dimensional Trajectories (1998) (24)
- Inter-individual discount factor differences in reward prediction are topographically associated with caudate activation (2011) (24)
- Estimating Internal Variables and Paramters of a Learning Agent by a Particle Filter (2003) (22)
- Switching particle filters for efficient visual tracking (2006) (22)
- Derivatives of Logarithmic Stationary Distributions for Policy Gradient Reinforcement Learning (2010) (22)
- Intelligent control of a flying vehicle using fuzzy associative memory system (1992) (21)
- MOSAIC for Multiple-Reward Environments (2012) (21)
- Multiple co-clustering based on nonparametric mixture models with heterogeneous marginal distributions (2015) (21)
- Evaluation of linearly solvable Markov decision process with dynamic model learning in a mobile robot navigation task (2013) (21)
- Multi-agent reinforcement learning: using macro actions to learn a mating task (2004) (20)
- Serotonergic projections to the orbitofrontal and medial prefrontal cortices differentially modulate waiting for future rewards (2020) (19)
- Free-energy-based reinforcement learning in a partially observable environment (2010) (19)
- From free energy to expected energy: Improving energy-based value function approximation in reinforcement learning (2016) (18)
- Dimension Reduction of Biological Neuron Models by Artificial Neural Networks (1994) (18)
- A Hodgkin-Huxley Type Neuron Model That Learns Slow Non-Spike Oscillations (1993) (18)
- Parallel Representation of Value-Based and Finite State-Based Strategies in the Ventral and Dorsal Striatum (2015) (18)
- Multiple model-based reinforcement learning explains dopamine neuronal activity (2007) (18)
- Online meta-learning by parallel algorithm competition (2017) (17)
- Acquisition of Stand-up Behavior by a 3-link 2-joint Robot using Hierarchical Reinforcement Learning (2001) (17)
- Self-organization of action hierarchy and compositionality by reinforcement learning with recurrent neural networks (2019) (15)
- Reinforcement learning with state-dependent discount factor (2013) (15)
- Reinforcement Learning State Estimator (2007) (15)
- Toward evolutionary and developmental intelligence (2019) (15)
- Hierarchical reinforcement learning for motion learning: learning 'stand-up' trajectories (1998) (15)
- Recurrent Networks : Learning Algorithms ∗ (2002) (15)
- Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats (2012) (15)
- A Generalized Natural Actor-Critic Algorithm (2009) (14)
- How can we learn efficiently to act optimally and flexibly? (2009) (14)
- Neural and Personality Correlates of Individual Differences Related to the Effects of Acute Tryptophan Depletion on Future Reward Evaluation (2012) (14)
- A biologically constrained spiking neural network model of the primate basal ganglia with overlapping pathways exhibits action selection (2020) (14)
- Optimization and validation of diffusion MRI-based fiber tracking with neural tracer data as a reference (2019) (14)
- Current trends in decision making. (2007) (14)
- Multiple state estimation reinforcement learning for driving model: driver model of automobile (1999) (13)
- A model-based prediction of the calcium responses in the striatal synaptic spines depending on the timing of cortical and dopaminergic inputs and post-synaptic spikes (2013) (13)
- An Evolutionary Approach to Automatic Construction of the Structure in Hierarchical Reinforcement Learning (2003) (13)
- MarmoNet: a pipeline for automated projection mapping of the common marmoset brain from whole-brain serial two-photon tomography (2019) (13)
- A New Natural Policy Gradient by Stationary Distribution Metric (2008) (13)
- Average Reward Optimization with Multiple Discounting Reinforcement Learners (2017) (13)
- A Spiking Neural Network Model of Model-Free Reinforcement Learning with High-Dimensional Sensory Input and Perceptual Ambiguity (2015) (13)
- The Mechanism of Saccade Motor Pattern Generation Investigated by a Large-Scale Spiking Neuron Model of the Superior Colliculus (2013) (12)
- Selection of Neural Architecture and the Environment Complexity (2002) (12)
- A hierarchical Bayesian method to resolve an inverse problem of MEG contaminated with eye movement artifacts (2009) (12)
- Scaled free-energy based reinforcement learning for robust and efficient learning in high-dimensional state spaces (2013) (12)
- Chunking Phenomenon in Complex Sequential Skill Learning in Humans (2004) (12)
- Introduction for 2002 Special Issue: Computational Models of Neuromodulation (2002) (11)
- Whole brain Probabilistic Generative Model toward Realizing Cognitive Architecture for Developmental Robots (2021) (11)
- Combining learned controllers to achieve new goals based on linearly solvable MDPs (2014) (11)
- Free-Energy Based Reinforcement Learning for Vision-Based Navigation with High-Dimensional Sensory Inputs (2010) (11)
- Switching particle filters for efficient real-time visual tracking (2004) (10)
- Forward and inverse reinforcement learning sharing network weights and hyperparameters (2020) (10)
- Reinforcement Learning with Multiple Heterogeneous Modules: A Framework for Developmental Robot Learning (2005) (10)
- The Basal Ganglia and the Encoding of Value (2009) (9)
- Selecting Optimal Behaviors Based on Contexts (2003) (9)
- MOSAIC Reinforcement Learning Architecture: Symbolization by Predictability and Mimic Learning by Symbol (2001) (9)
- Decision making (2012) (8)
- Inverse reinforcement learning using Dynamic Policy Programming (2014) (8)
- Memorizing hierarchical temporal patterns in analog neuron networks (1990) (8)
- Emergence of Polymorphic Mating Strategies in Robot Colonies (2014) (8)
- Hierarchical Chunking during Learning of Visuomotor Sequences (2006) (7)
- Serotonergic modulation of cognitive computations (2021) (7)
- Multiple model-based reinforcement learning for nonlinear control (2006) (7)
- APPLICATION OF EVOLUTIONARY COMPUTATION FOR EFFICIENT REINFORCEMENT LEARNING (2006) (7)
- Learning temporal patterns in recurrent neural networks (1990) (7)
- Multiple Forward Model Architecture for Sequence Processing (2001) (7)
- Exciting Time for Neural Networks (2015) (7)
- Learning how, what, and whether to communicate: emergence of protocommunication in reinforcement learning agents (2008) (7)
- A learning algorithm for Hodgkin-Huxley type neuron models (1993) (7)
- Condition interference in rats performing a choice task with switched variable- and fixed-reward conditions (2015) (7)
- Neurocomputational models of brain disorders (2011) (6)
- A computational neural model of goal-directed utterance selection (2010) (6)
- EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot (2016) (6)
- Diffusion functional MRI reveals global brain network functional abnormalities driven by targeted local activity in a neuropsychiatric disease mouse model (2020) (6)
- Combining Modalities with Different Latencies for Optimal Motor Control (2008) (6)
- A DRIVER MODEL BASED ON REINFORCEMENT LEARNING WITH MULTIPLE-STEP STATE ESTIMATION (2001) (6)
- Emergence of communication among reinforcement learning agents under coordination environment (2016) (6)
- Reinforcement learning with multiple representations in the basal ganglia loops for sequential motor control (1998) (6)
- A full rat-scale model of the basal ganglia and thalamocortical network to reproduce Parkinsonian tremor (2015) (5)
- Computation of Driving Pleasure based on Driver's Learning Process Simulation by Reinforcement Learning (2013) (5)
- Hierarchical Reinforcement Learning for Multiple Reward Functions (2004) (5)
- Robotic neuroscience: A synthetic approach to the brain (2000) (5)
- Dynamics of Attention as Near Saddle-Node Bifurcation Behavior (1995) (5)
- Different Cortico-Basal Ganglia Loops Specialize in Reward Prediction at Different Time Scales (2003) (5)
- Evolving recurrent neural controllers for sequential tasks: a parallel implementation (2003) (5)
- Learning a dynamic policy by using policy gradient: application to biped walking (2007) (4)
- Neural network model of temporal pattern memory (1991) (4)
- Fostering deep learning and beyond (2018) (4)
- Imitation learning based on entropy-regularized forward and inverse reinforcement learning (2020) (4)
- A Study of Learning Algorithms for Continuous-TimeRecurrent Neural Networks (1991) (4)
- Neural Information Processing (2016) (4)
- Expedited review process (2012) (4)
- Policy gradient reinforcement learning method for discrete-time linear quadratic regulation problem using estimated state value function (2017) (4)
- Canonical cortical circuits and the duality of Bayesian inference and optimal control (2021) (4)
- Social impact and governance of AI and neurotechnologies (2022) (3)
- Driver model based on reinforced learning with multiple‐step state estimation (2003) (3)
- Responding to Modalities with Different Latencies (2004) (3)
- Local circuit model of the subthalamo-pallidal network for the generation of parkinsonian oscillations (2014) (3)
- Deploying and Optimizing Embodied Simulations of Large-Scale Spiking Neural Networks on HPC Infrastructure (2022) (3)
- Learning and Control (2001) (3)
- Automated segmentation of insect anatomy from micro-CT images using deep learning (2021) (3)
- Dynamics of Basal Ganglia and Thalamus in Parkinsonian Tremor (2019) (3)
- A Sequence Learning Architecture Based on Cortico-Basal Ganglionic Loops and Reinforcement Learning (1998) (3)
- Unifying Value Iteration, Advantage Learning, and Dynamic Policy Programming (2017) (3)
- [Effects of serotonin on delay discounting for rewards--an application for understanding of pathophysiology in psychiatric disorders]. (2012) (3)
- The Brain/MINDS Marmoset Connectivity Atlas: exploring bidirectional tracing and tractography in the same stereotaxic space (2022) (3)
- Policy gradient reinforcement learning with log stationary distribution gradients (2007) (2)
- Robust Population Coding in Free-Energy-Based Reinforcement Learning (2008) (2)
- Maaping Between Neural and Physical Activities of the Lobster Gastric Mill (1992) (2)
- Multiple Representations and Algorithms for Sequence Learning (1999) (2)
- Benefit of Multiple Representations for Motor Sequence Control in The Basal Ganglia Loops (1998) (2)
- A Model of the Electrophysiological Properties of the Inferior Olive Neurons (1998) (2)
- An excellent year and a transition (2011) (2)
- Self-Reproduction The Cyber Rodent Project : Exploration of Adaptive Mechanisms for Self-Preservation and (2005) (2)
- The Basal Ganglia, Reinforcement Learning, and the Encoding of Value (2014) (2)
- Chunking Patterns Reflect Effector-dependent Representation of Motor Sequence (2006) (2)
- Action-specific value representation in the striatum and the reinforcement learning model of basal ganglia (2005) (2)
- Co-evolution of Rewards and Meta-parameters in Embodied Evolution (2009) (2)
- State of Neural Networks Is Strong (2016) (2)
- Resting state functional connectivity explains individual scores of multiple clinical measures for major depression (2015) (2)
- Model-based analysis of decision variables (2011) (2)
- Natural actor-critic with baseline adjustment for variance reduction (2008) (2)
- Action value in the striatum and reinforcement-learning model of cortico-basal ganglia network (2007) (2)
- Goal-Directed Planning by Reinforcement Learning and Active Inference (2021) (2)
- Robustness of linearly solvable Markov games employing inaccurate dynamics model (2018) (2)
- Variational oracle guiding for reinforcement learning (2022) (2)
- [Artificial Intelligence and Brain Science: the Present and the Future]. (2019) (2)
- NeuroEvolution Based on Reusable and Hierarchical Modular Representation (2008) (2)
- MFM: Multiple Forward Model Architecture for Sequence Processing (1999) (2)
- Estimating Internal Variables of a Decision Maker's Brain: A Model-Based Approach for Neuroscience (2007) (2)
- Adaptation in Dynamic Environments by Learning and Evolution (2004) (2)
- Toward a Spiking-Neuron Model of the Oculomotor System (2010) (2)
- An Experimental Study of Emergence of Communication of Reinforcement Learning Agents (2019) (1)
- Bayesian System Identification of Molecular Cascades (2007) (1)
- Increased serotonin efflux in the dorsal raphe nucleus of rats working for delayed rewards (2007) (1)
- The Role of Serotonin in the Regulation of Patience and Impulsivity (2012) (1)
- Calcium Responses Model in Striatum Dependent on Timed Input Sources (2009) (1)
- Reinforcement Learning using Importance Sampling for Multiple Learning Modules (2003) (1)
- A new hybrid method for real time adaptation of intelligent agents in dynamic environments (2005) (1)
- Promoting Further Developments of Neural Networks (2017) (1)
- Numerical Data Imputation: Choose kNN over Deep Learning (2022) (1)
- Hierarchical information coding in the striatum during decision making tasks (2010) (1)
- Learning of Hierarchical Temporal Sequences in Biological Systems. (2000) (1)
- Brain computation mechanism of prediction and decision making by dorsal raphe serotonin neurons. (2017) (1)
- Multi-scale, multi-modal neural modeling and simulation (2011) (1)
- Gap-Increasing Policy Evaluation for Efficient and Noise-Tolerant Reinforcement Learning (2019) (1)
- Editorial for 2010 (2010) (1)
- Optogenetic activation of dorsal raphe serotonin neurons induces a brain-wide response in reward network (2022) (1)
- Inter Subject Correlation of Brain Activity during Visuo-Motor Sequence Learning (2014) (1)
- Maximizing the average reward in episodic reinforcement learning tasks (2015) (1)
- Emergence of Hierarchy via Reinforcement Learning Using a Multiple Timescale Stochastic RNN (2019) (1)
- Neural Information Processing (2014) (1)
- Reinforcement learning under constraints generated by multiple reward functions (2006) (1)
- Emergence of Different Mating Strategies in Artificial Embodied Evolution (2009) (1)
- Special issue on symbol emergence in robotics and cognitive systems (II) (2022) (0)
- RECENT AND RELEVANT (2008) (0)
- Self-consistent neuronal population under spike inputs and unbalanced conditions (2015) (0)
- Selective impairment of reward-based adaptive choice of actions by intra-striatal injection of dopamine D1 receptor antagonist (2007) (0)
- Erratum to "Brain mechanism of reward prediction under predictable and unpredictable environmental dynamics" [Neural Networks 19 (8) (2006) 1233-1241] (2007) (0)
- Imitation Learning by Estimating Intention of Demonstrator (2003) (0)
- Astrophysics: Magnetic star (2010) (0)
- Learning biped locomotion with a dynamic policy (2004) (0)
- TALK FRIDAY 2 . 15 PM Spontaneous activity in the developing brain (2017) (0)
- Robotics and Brain Science (2000) (0)
- Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience (2018) (0)
- Learning for Multiple Reward Functions (2010) (0)
- PREDICTING THE EFFECT OF SLIGHTLY COMPLEX UTTERANCES (2005) (0)
- Molecular and network mechanisms of reinforcement learning (2004) (0)
- Neural Information Processing, 14th International Conference, ICONIP 2007, Kitakyushu, Japan, November 13-16, 2007, Revised Selected Papers, Part I (2007) (0)
- Tutorial : The probabilistic brain (2017) (0)
- Expressing and understanding desires in language games (2004) (0)
- Toward the neurophysiology of mental simulation (2014) (0)
- Computational Complexity Reduction for Functional Connectivity Estimation in Large Scale Neural Network (2015) (0)
- Performance Evaluation of Neural Architectures for Sequential Tasks (2019) (0)
- Action-dependent state prediction in mouse posterior parietal cortex (2015) (0)
- EM-based policy hyper parameter exploration: application to standing and balancing of a two-wheeled smartphone robot (2016) (0)
- Behavioral-Switching Properties Conditioned Stimuli Rather Than Their Respond to the Outcome-Related Properties of Rat Nucleus Accumbens Neurons Predominantly (2015) (0)
- A method for removal of eye movement artifacts from MEG -- Simultaneous current source estimation of eyes and cortical activities from MEG and EOG data (2005) (0)
- Why can we envision the future (2015) (0)
- Remote sensing: Great heights (2010) (0)
- Neural circuits for reinforcement learning and mental simulation (2019) (0)
- Chunking During Learning of Visuomotor Sequences with Spatial and Arbitrary Rules: Preliminary Findings (2012) (0)
- Animal locomotion: Gutsy move (2010) (0)
- Analysis of learning-related brain activity by model-based state estimation (2005) (0)
- 25th Annual Computational Neuroscience Meeting: CNS-2016 (2016) (0)
- A Connectomics Pipeline for Tracer Injection Studies of the Marmoset Monkey Brain (2017) (0)
- Behavioral Data Analysis by Reinforcement Learning Models (2007) (0)
- Journal club (2010) (0)
- Habits and goals in synergy: a variational Bayesian framework for behavior (2023) (0)
- Uncertainty-seeking in rats’ choice behaviors and its dependence on reward context (2011) (0)
- Identification of depression subtypes and relevant brain regions using a data-driven approach (2018) (0)
- 2011 Board of Governors (2011) (0)
- Brain mechanisms for evaluating probabilistic and delayed rewards (2009) (0)
- Designing theRewardSystem: Computational andBiological Principles (2007) (0)
- Role of serotonin in delayed reward choice in humans (2007) (0)
- In pursuit of the brain mechanism of reinforcement learning (2007) (0)
- Neural Networks goes electronic at twenty! (2008) (0)
- Model-free and model-based strategies in rats’ choice behaviors (2009) (0)
- Robustness of linearly solvable Markov games employing inaccurate dynamics model (2017) (0)
- A study of decision-making for delayed and probabilistic reward (2008) (0)
- Evolution of rewards and learning mechanisms in Cyber Rodents (2011) (0)
- ESTIMATING INTENTION OF OTHERS FOR IMITATION AND COOPERATION (2005) (0)
- Learning algorithms for modeling human behaviors and identifying molecular cascades (1970) (0)
- Local circuit model of the subthalamo-pallidal network for the generation of parkinsonian oscillations (2014) (0)
- [Brain mechanisms of depression--preliminary evidence from fMRI studies]. (2014) (0)
- Robotics and the Brain Sciences (1999) (0)
- PS244. Depression severity and related characteristics correlate significantly with activation in brain areas selected through machine learning (2016) (0)
- A full rat-scale model of the basal ganglia and thalamocortical network to reproduce Parkinsonian tremor (2015) (0)
- Modeling saccades through NMDAR-mediated bursting with reciprocal inhibition in the superior colliculus (2010) (0)
- Adaptation of optimization algorithms to problem domains by transfer learning (2017) (0)
- Effects of transcranial direct current stimulation in brain-computer interface (2021) (0)
- Neurons: A Compartmental Model Electrophysiological Properties of Inferior Olive (2011) (0)
- Finding Exploratory Rewards by Embodied Evolution and Constrained Reinforcement Learning in the Cyber Rodents (2007) (0)
- Emergence of Alternative Reproductive Tactics in Simulated Robot Colonies (2020) (0)
- Neural Networks letter Meta-learning in Reinforcement Learning (2003) (0)
- Neural Mechanism of Decision Making and Reinforcement Learning (2013) (0)
- Multi-objective Parameter Optimization of DWI-based Global Fiber Tracking with Neuronal Tracer Signal as a Reference (2019) (0)
- Neural activity in the dorsal striatum during cognitive decision making (2010) (0)
- Neuronal representation of a working memory-based decision strategy in the motor and prefrontal cortico-basal ganglia loops (2022) (0)
- Reinforcement Learning and Computational Neuroscience (2002) (0)
- Ibotenic acid lesions of the supramammillary nucleus decreased c-Fos expression in the hippocampus of rats exploring in an open field (2004) (0)
- Neural Computations Supporting Cognition: Rumelhart Prize Symposium in Honor of Peter Dayan (2012) (0)
- Body and visual instabilities functionally modulate implicit reaching corrections (2022) (0)
- Intrinsic Motivation in Creative Activity (2021) (0)
- 1SK-05 A statistical learning method for identifying synaptic connections from spike train data(1SK High Performance Computational Approaches to Biological Functions,The 49th Annual Meeting of the Biophysical Society of Japan) (2011) (0)
- S3f2-5 Learning model-based analysis of neuroimaging data(S3-f2: "Advances in Anatomical, Functional, and Computational Brain Imaging",Symposia,Abstract,Meeting Program of EABS & BSJ 2006) (2006) (0)
- Title: The role of serotonin in waiting for future rewards in depression (2016) (0)
- Neural mechanisms for model-free and model-based reinforcement strategies in humans performing a multi-step navigation task (2010) (0)
- Continual growth and a transition (2022) (0)
- New action editors join the journal! Five exciting special issues in the works! (2009) (0)
- NO Regulates Input-Specificity of LTD and Context Dependence of Cerebellar Learning (2005) (0)
- IEEE Control Systems Magazine (2002) (0)
- V ARIATIONAL O RACLE G UIDING FOR R EINFORCE MENT L EARNING (2022) (0)
- Designing the Reward System: Computational and Biological Principles (2007) (0)
- Derivation of integrated state equation for combined outputs-inputs vector of discrete-time linear time-invariant system and its application to reinforcement learning (2017) (0)
- Books Received (2008) (0)
- Public health: HIV blocker (2010) (0)
- Special issue on Symbol Emergence in Robotics and Cognitive Systems (I) (2022) (0)
- Adaptive Selection of Learning Strategy for Autonomous Sequence Learning in Rats (2010) (0)
- Activity of serotonergic neurons in the dorsal raphe nucleus of freely moving rats during reward and non-reward delay period (2007) (0)
- On-line integration of multiple neural network and musculoskeletal models (2014) (0)
- Consensus Paper: Towards a Systems-Level View of Cerebellar Function: the Interplay Between Cerebellum, Basal Ganglia, and Cortex (2016) (0)
- Electrophysiological and molecular mechanisms of synaptic plasticity in the striatum (2010) (0)
- [Mathematical models of decision making and learning]. (2008) (0)
- Sparse kernel canonical correlation analysis for discovery of nonlinear interactions in high-dimensional data (2017) (0)
- Neural Activity in the Anterior Striatum during Comparison of Reward Values (2011) (0)
- Self-developed Action Hierarchy Enhances Meta Reinforcement Learning. (2019) (0)
- Model-based Empowerment Computation for Dynamical Agents (2019) (0)
- Neural Information Processing (2016) (0)
- Maximum Credibility Voting (MCV) An Integrative Approach for Accurate Diagnosis of Major Depressive Disorder from Clinically Readily Available Data (2020) (0)
- Loss of a Co-Editor-in-Chief and friend (2012) (0)
- From Circuit Architectures to Learning Mechanisms of the Cerebellum,the Basal Ganglia, and the Cerebral Cortex (2017) (0)
- Announcement of the Neural Networks Best Paper Award (2017) (0)
- Neural Information Processing (2016) (0)
- Model-free and model-based strategy for rats’ action selection (2010) (0)
- Behavioural Study of the Effect of Trial and Error VersusSupervised Learning of Visuo-Motor Skills (2010) (0)
- Speaker 2: Yasumasa Okamoto (2016) (0)
- Chunking During Learning of Visuomotor Sequences with Spatial and Arbitrary Rules: Preliminary Findings (2011) (0)
- Reward Responses on the Multiple T Task Sequential Navigation: Separation of Spatial and Neuronal Activity in the Rodent Dorsal Striatum in (2015) (0)
- Neural Networks special issue on Artificial Intelligence and Brain Science (2022) (0)
- Neuronal coding of value-based and finite state-based decision strategies in the dorsal and ventral striatum (2011) (0)
- Task-dependent uncertainty preference of rats in a free choice task (2011) (0)
- Analysis of Structure-Function Relationship Using a Whole-Brain Dynamic Model Based on MRI Images of the Common Marmoset (2018) (0)
- Unbounded Output Networks for Classification (2018) (0)
- Stochastic Action Selection in Reinforcement Learning Model of Basal Ganglia (2003) (0)
- Mini-special issue: ICONIP 2007 (2008) (0)
- A Spiking Neural Network Builder for Systematic Data-to-Model Workflow (2022) (0)
- Maintaining the Publication Infrastructure in a Worldwide Pandemic (2021) (0)
- Representation of action value in the striatum and reinforcement learning model (2007) (0)
- Reinforcement learning strategies for sequential action learning (2009) (0)
- Different representation of action and reward in the dorsal and the ventral striatum (2009) (0)
- Information Coded in the Striatum During Decision-Making (2018) (0)
- Language as Goal-Directed Sequential Behavior: Computational Theories, Brain Mechanisms, Evolutionary Roots (NII Shonan Meeting 141) (2019) (0)
- Action-Oriented State Coding by Neighbourhood Component Analysis (2007) (0)
This paper list is powered by the following services:
What Schools Are Affiliated With Kenji Doya?
Kenji Doya is affiliated with the following schools:
