Papers
2014
Universal Option Models
Hengshuai Yao, Csaba Szepesvari, Richard Sutton, Joseph Modayil, and Shalabh Bhatnagar. NIPS 2014.
[pdf]
Prediction Driven Behavior: Learning Predictions that Drive Fixed Responses
Joseph Modayil and Richard S. Sutton. AAAI Workshop on AI and Robotics. 2014.
[pdf]
Surprise and Curiosity for Big Data Robotics
Adam White, Joseph Modayil, and Richard S. Sutton. AAAI Workshop on Sequential Decision Making with Big Data. 2014.
[pdf]
Multi-timescale Nexting in a Reinforcement Learning Robot
Joseph Modayil, Adam White, and Richard S. Sutton. Adaptive Behavior 22(2), April 2014. pages 146--160.
[pdf] [ gzipped sensor data]
2013
Two Perspectives on Learning Rich Representations from Experience
Joseph Modayil. Presented at the AAAI Workshop on Learning Rich Representations from Low-Level Sensors. 2013.
[pdf]
2012
Acquiring a Broad Range of Empirical Knowledge in Real Time by Temporal-Difference Learning
Joseph Modayil, Adam White, Patrick M. Pilarski, Richard S. Sutton. In Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics. (SMC 2012)
[pdf] An earlier version appears at the workshop ERLARS 2012.
Scaling Life-long Off-policy Learning
Adam White, Joseph Modayil, Richard S. Sutton. In Second Joint IEEE International Conference on Development and Learning and on Epigenetic Robotics (ICDL-EpiRob 2012).
Also presented at the European Workshop on Reinforcement Learning 2012, and on ArXiv 1206.6262.
Multi-timescale Nexting in a Reinforcement Learning Robot
Joseph Modayil, Adam White, and Richard S. Sutton. In Proceedings of the International Conference on Adaptive Behaviour. SAB 2012. Also an ArXiv preprint 1112.1133
[pdf]
Scaling up Knowledge for a Cognizant Robot
Thomas Degris, Joseph Modayil. In the AAAI 2012 Spring Symposium Designing Intelligent Robots: Reintegrating AI.
[pdf]
Reports of the AAAI 2011 Conference Workshops
Nao Agmon et al. In AI Magazine, Vol 33. No. 1. Spring 2012.
Contains a brief summary of the AAAI Workshop on Lifelong Learning
[via AI Magazine]
2011
Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor experience
Richard S. Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick M. Pilarski, Adam White, and Doina Precup. In Proc. of 10th Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2011).
[pdf]
2010
Learning Grounded Communicative Intent from Human-Robot Dialog
Joseph Modayil. AAAI Fall Symposium on Dialog with Robots. 2010.
[pdf]
Extending Rapidly-Exploring Random Trees for Asymptotically Optimal Anytime Motion Planning
Yasin Abbasi-Yadkori, Joseph Modayil, and Csaba Szepesvari. International Conference on Intelligent Robots and Systems (IROS 2010).
[ pdf]
Discovering Sensor Space: Constructing Spatial Embeddings That Explain Sensor Correlations
Joseph Modayil. International Conference on Development and Learning (ICDL 2010). pages 120--125.
[ pdf ]
Factoring the mapping problem: mobile robot map-building in the Hybrid Spatial Semantic Hierarchy
Patrick Beeson, Joseph Modayil, and Benjamin Kuipers. International Journal of Robotics Research, Volume 29, Issue 4, April 2010, pages 428--459.
[ abstract]
Off-Policy Knowledge Maintenance for Robots
Joseph Modayil, Patrick M. Pilarski, Adam White, Thomas Degris, and Richard S. Sutton. Robotics Science and Systems Workshop (Towards Closing the Loop: Active Learning for Robotics). 2010.
[ poster ]
2008
The initial development of object knowledge by a learning robot
Joseph Modayil and Benjamin Kuipers. Robotics and Autonomous Systems. Volume 56, Issue 11, Nov 2008, pages 879--890.
[abstract]
Integrating sensing and cueing for more effective activity reminders
Joseph Modayil, Rich Levinson, Craig Harman, David Halper, Henry Kautz. In the 2008 AAAI Fall Symposium on AI in Eldercare.
[ abstract]
Improving the recognition of interleaved activities
Joseph Modayil, Tongxin Bai, Henry Kautz. In the Tenth International Conference on Ubiquitous Computing (Ubicomp 2008).
[ abstract]
2007
Robot Developmental Learning of an Object Ontology Grounded in Sensorimotor Experience
Joseph Modayil. Doctoral dissertation, Computer Sciences Department, University of Texas at Austin.
[pdf][abstract]
Autonomous Development of a Grounded Object Ontology by a Learning Robot
Joseph Modayil and Benjamin Kuipers. In the Proceedings of the Twenty-Second Conference on Artificial Intelligence (AAAI-07).
[pdf][abstract]
Integrating multiple representations of spatial knowledge for mapping, navigation, and communication
Patrick Beeson, Matt MacMahon, Joseph Modayil, Aniket Murarka, Benjamin Kuipers, and Brian Stankiewicz. In the Proceedings of the Symposium on Interaction Challenges for Intelligent Assistants. AAAI Spring Symposium Series, March 2007
[pdf][abstract]
Where do actions come from? Autonomous robot learning of objects and actions
Joseph Modayil and Benjamin Kuipers. In AAAI Spring Symposium Series 2007, Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems.
[pdf][abstract]
2006
Building local safety maps for a wheelchair robot using vision and lasers
(Best student paper!)
Aniket Murarka, Joseph Modayil, and Benjamin Kuipers. In Canadian Conference on Computer and Robot Vision (CRV-06).
[pdf] [abstract]
Bootstrap learning of foundational representations
Benjamin Kuipers, Patrick Beeson, Joseph Modayil, and Jefferson Provost. Connection Science, 18(2), June 2006, pages 145-158.
[pdf][abstract][Earlier workshop version]
Autonomous shape model learning for object localization and recognition
Joseph Modayil and Benjamin Kuipers. In IEEE International Conference on Robotics and Automaton (ICRA-06), pages 2991--2996.
[pdf] [abstract]
2004
Bootstrap learning for object discovery
Joseph Modayil and Benjamin Kuipers. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-04), pages 742--747.
[pdf] [abstract] [Earlier symposium version]
Local metrical and global topological maps in the Hybrid Spatial Semantic Hierarchy
Benjamin Kuipers, Joseph Modayil, Patrick Beeson, Matt MacMahon, and Francesco Savelli. In IEEE International Conference on Robotics and Automation (ICRA-04).
[pdf] [abstract]
Using the topological skeleton for scalable global metrical map-building
Joseph Modayil, Patrick Beeson and Benjamin Kuipers. In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS-04), pages 1530--1536.
[pdf] [abstract]
|