Charles Lee Isbell, Jr.

Why Is Charles Lee Isbell, Jr. Influential?

According to Wikipedia, Charles Lee Isbell Jr. is an American computationalist, researcher, and educator. He has been a professor in the Georgia Institute of Technology College of Computing since 2002, and since July 2019 is the John P. Imlay, Jr. Dean of the College. His research interests focus on machine learning and artificial intelligence, particularly interactive and human-centered AI. He has published over 100 scientific papers. In addition to his research work, Isbell has been an advocate for increasing access to and diversity in higher education.

(See a Problem?)

Charles Lee Isbell, Jr.'s Published Works

Number of citations in a given year to any of this author's works

Total number of citations to an author for the works they published in a given year. This highlights publication of the most important work(s) by the author

Published Papers

MIMIC: Finding Optima by Estimating Probability Densities (1996) (553)
Policy Shaping: Integrating Human Feedback with Reinforcement Learning (2013) (272)
Detection and explanation of anomalous activities: representing activities as bags of event n-grams (2005) (157)
Transfer Learning in Real-Time Strategy Games Using Hybrid CBR/RL (2007) (157)
Discovering Characteristic Actions from On-Body Sensor Data (2006) (146)
A social reinforcement learning agent (2001) (143)
A novel sequence representation for unsupervised analysis of human activities (2009) (119)
Discovering Multivariate Motifs using Subsequence Density Estimation and Greedy Mixture Learning (2007) (103)
Environment-Independent Task Specifications via GLTL (2017) (85)
Detecting Subdimensional Motifs: An Efficient Algorithm for Generalized Multivariate Pattern Discovery (2007) (83)
Imitating Latent Policies from Observation (2018) (81)
Restructuring Sparse High Dimensional Data for Effective Retrieval (1998) (76)
A Survey and Qualitative Analysis of Recent Advances in Drama Management (2008) (76)
Cobot in LambdaMOO: A Social Statistics Agent (2000) (75)
Reinforcement learning for declarative optimization-based drama management (2006) (69)
Exploration from Demonstration for Interactive Reinforcement Learning (2016) (68)
Declarative optimization-based drama management in interactive fiction (2006) (67)
Learning From Explanations Using Sentiment and Advice in RL (2017) (65)
Policy Shaping with Human Teachers (2015) (65)
Improving Activity Discovery with Automatic Neighborhood Estimation (2007) (63)
How Multirobot Systems Research will Accelerate our Understanding of Social Animal Behavior (2006) (63)
Cobot in LambdaMOO: An Adaptive Social Statistics Agent (2006) (60)
Targeting Specific Distributions of Trajectories in MDPs (2006) (58)
Fast Nonparametric Conditional Density Estimation (2007) (57)
A Physics-Based Model Prior for Object-Oriented MDPs (2014) (55)
QUIC-SVD: Fast SVD Using Cosine Trees (2008) (52)
Schema Learning: Experience-Based Construction of Predictive Action Models (2004) (50)
Looping suffix tree-based inference of partially observable hidden state (2006) (41)
Computing Optimal Strategies to Commit to in Stochastic Games (2012) (40)
Automatic State Abstraction from Demonstration (2011) (38)
Description Logic in Practice: A CLASSIC Application (1995) (36)
(Re)defining computing curricula by (re)defining computing (2010) (35)
Point Based Value Iteration with Optimal Belief Compression for Dec-POMDPs (2013) (35)
Towards adaptive programming: integrating reinforcement learning into a programming language (2008) (35)
Threads™: how to restructure a computer science curriculum for a flat world (2007) (35)
Cobot: A Social Reinforcement Learning Agent (2001) (34)
Ishmail: Immediate Identification of Important Information (1995) (34)
From devices to tasks: automatic task prediction for personalized appliance control (2004) (31)
Unsupervised Activity Discovery and Characterization From Event-Streams (2005) (30)
Real Time Voice Processing with Audiovisual Feedback: Toward Autonomous Agents with Perfect Pitch (2002) (28)
Solving Stochastic Games (2009) (28)
Object focused q-learning for autonomous agents (2013) (27)
Fast kernel conditional density estimation: A dual-tree Monte Carlo approach (2010) (27)
Learning to Compose Skills (2017) (27)
Learning to Influence Emotional Responses for Interactive Storytelling (2009) (25)
Discovering options from example trajectories (2009) (25)
Automatic task decomposition and state abstraction from demonstration (2012) (25)
Tree-Independent Dual-Tree Algorithms (2013) (24)
A globally optimal algorithm for TTD-MDPs (2007) (24)
Authorial Idioms for Target Distributions in TTD-MDPs (2007) (23)
The Unexpected Pedagogical Benefits of Making Higher Education Accessible (2016) (22)
Comparing end-user and intelligent remote control interface generation (2006) (22)
On the Difficulty of Modular Reinforcement Learning for Real-World Partial Programming (2006) (22)
An IP Continuum for Adaptive Interface Design (1996) (22)
Desiderata for Managers of Interactive Experiences : A Survey of Recent Advances in Drama Management (2007) (20)
State Aware Imitation Learning (2017) (20)
Abstraction from demonstration for efficient reinforcement learning in high-dimensional domains (2014) (19)
The Parallel Problems Server: A Client-Server Model for Interactive Large Scale Scientific Computation (1998) (18)
Autonomous nondeterministic tour guides: improving quality of experience with TTD-MDPs (2007) (17)
Learning Options through Human Interaction (2011) (17)
Quick Polytope Approximation of All Correlated Equilibria in Stochastic Games (2011) (16)
Markov Games of Incomplete Information for Multi-Agent Reinforcement Learning (2011) (16)
Declarative Optimization-Based Drama Management ( DODM ) in the Interactive Fiction Anchorhead (2006) (15)
Supporting routine decision-making with a next-generation alarm clock (2004) (14)
Perceptual Reward Functions (2016) (14)
Batch versus interactive learning by demonstration (2010) (14)
Beyond Adversarial: The Case for Game AI as Storytelling (2009) (14)
Using influence and persuasion to shape player experiences (2009) (14)
Master's at Scale: Five Years in a Scalable Online Graduate Degree (2019) (13)
Using training regimens to teach expanding function approximators (2010) (12)
How A . I . and multi-robot systems research will accelerate our understanding of social animal behavior (2005) (12)
Player Autonomy versus Designer Intent: A Case Study of Interactive Tour Guides (2007) (12)
Ultrafast Monte Carlo for kernel estimators and generalized statistical summations (2007) (11)
Five Years of Graduate CS Education Online and at Scale (2019) (11)
Composable Modular Reinforcement Learning (2019) (11)
Rising CS Enrollments: Meeting the Challenges (2018) (11)
Estimating Player Satisfaction Through the Author ’ s Eyes (2007) (11)
Learning non-holonomic object models for mobile manipulation (2015) (10)
Estimating Q(s, s') with Deep Deterministic Dynamics Gradients (2020) (10)
Navigation Among Movable Obstacles with learned dynamic constraints (2016) (10)
Reasoning with Black Boxes: Handling Test Concepts in CLASSIC (1996) (10)
CobotDS: a spoken dialogue system for chat (2002) (9)
Using Feature Value Distributions to Estimate Player Satisfaction through an Author's Eyes (2007) (8)
Learning executable agent behaviors from observation (2006) (8)
Lessons on Using Computationally Generated Influence for Shaping Narrative Experiences (2014) (8)
Cross-Domain Perceptual Reward Functions (2017) (7)
DEXTOR: Reduced Effort Authoring for Template-Based Natural Language Generation (2011) (7)
Perceptual Values from Observation (2019) (7)
Universal Value Density Estimation for Imitation Learning and Goal-Conditioned Reinforcement Learning (2020) (7)
Peer Reviewing Short Answers using Comparative Judgement (2016) (7)
Ultrafast Monte Carlo for Statistical Summations (2007) (6)
Policy Shaping in Domains with Multiple Optimal Policies: (Extended Abstract) (2016) (6)
Interactive Supercomputing with PPMatlab (1998) (6)
A description logic-based configurator on the web (1998) (6)
Impact of user context on song selection (2008) (5)
Computing Stackelberg strategies in stochastic games (2012) (5)
A Bayesian Framework for Nash Equilibrium Inference in Human-Robot Parallel Play (2020) (5)
On the Use of Computational Models of Influence for Managing Interactive Virtual Experiences (2008) (5)
Deriving Behavior from Personality : A Reinforcement Learning Approach (2010) (5)
Activity Discovery : Sparse Motifs from Multivariate Time Series (5)
Supportive Actions for Manipulation in Human-Robot Coworker Teams (2020) (4)
MITMatlab: A Tool for Interactive Supercomputing (1999) (4)
Expressing Tasks Robustly via Multiple Discount Factors (2015) (4)
Object-Focused Advice in Reinforcement Learning (2016) (4)
Interactive Supercomputing with MITMatlab (1998) (4)
Explorations of the practical issues of learning prediction-control tasks using temporal difference learning methods (1992) (4)
Horizon-based Value Iteration (2007) (3)
State Space Decomposition and Subgoal Creation for Transfer in Deep Reinforcement Learning (2017) (3)
On the use of Computational Models of Influence for Interactive Virtual Experience Management (2008) (3)
An Architecture for Supporting Personalized Agents in Appliance Interaction (2002) (3)
Story similarity measures for drama management with ttd-mdps (2014) (3)
Towards automatic personalization of device controls (2009) (3)
Optimization problems involving collections of dependent objects (2008) (3)
The Parallel Problems Server: an Interactive Tool for Large Scale Machine Learning (1999) (3)
Discovery, Evaluation, and Exploration of Human Supplied Options and Constraints (2015) (2)
Managing Domain Knowledge and Multiple Models with Boosting (2007) (2)
Ask Me Anything about MOOCs (2017) (2)
Purely Geometric Scene Association and Retrieval - A Case for Macro Scale 3D Geometry (2018) (2)
Opportunities for Machine Learning to Impact Interactive Narrative (2007) (2)
Who speaks for AI? (2016) (2)
Randomized Local Search as Successive Estimation of Probability Densities (2006) (2)
A decision-theoretic approach to file consistency in constrained peer-to-peer device networks (2006) (2)
User modeling for personalized universal appliance interaction (2003) (2)
Boosting Diverse Learners for Domain Agnostic Time Series Classification (2007) (2)
Sparse multi-level representations for text retrieval (1998) (1)
Reports of the AAAI 2010 Conference Workshops (2010) (1)
Combining function approximation, human teachers, and training regimens for real-world RL (2010) (1)
MotifMark: Finding Regulatory Motifs in DNA Sequences (2017) (1)
DSL Design for Reinforcement Learning Agents (2017) (1)
AAAI-2002 Fall Symposium Series (2003) (1)
Accord: Middleware Support for Contextual, Ubiquitous Data Management on User Devices (2006) (1)
Policy Shaping from Simulated Critique in Domains with Multiple Optimal Policies (2016) (0)
Multi-Stage Monte Carlo Approximation for Fast Generalized Data Summations (2007) (0)
Estimating Q(s,s') with Deterministic Dynamics Gradients (2020) (0)
Mining Contexts from an Application ’ s Interaction History (2005) (0)
Partial signal extraction for mobile media players (2008) (0)
Exploiting Training Regimens to Improve Learning (2009) (0)
Deconvolution of component map time courses for task related activation discovery (2006) (0)
Dimensionality Reduction for Improved Source Separation in FMRI Data (2018) (0)
Hard Attention Control By Mutual Information Maximization (2021) (0)
Toward a Unified Framework for Inference of Hidden State under Partial Observability (2005) (0)
HARD ATTENTION CONTROL BY MUTUAL INFORMA- (2020) (0)
Topic-Centered Multi-Level Representations for Text Retrieval (1997) (0)
Transferring Agent Behaviors from Videos via Motion GANs (2017) (0)
Pattern Discovery for Locating Motifs in Multivariate , Real-valued Time-series Data (2007) (0)
MEAD (A Modeling Environment for Atmospheric Discovery) (2004) (0)
CPATH EAE: Extending contextualized computing in multiple institutions using threads (2012) (0)
Personalized agents : papers from the 2002 AAAI Fall Symposium, November 15-17, North Falmouth, Massachusetts (2002) (0)