English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
  Apprenticeship learning via soft local homomorphisms

Boularias, A. (2010). Apprenticeship learning via soft local homomorphisms. In 2010 IEEE International Conference on Robotics and Automation (ICRA 2010) (pp. 2971-2976). Piscataway, NJ, USA: IEEE.

Item is

Files

show Files

Locators

show

Creators

show
hide
 Creators:
Boularias, A1, Author           
Affiliations:
1Department Empirical Inference, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497795              

Content

show
hide
Free keywords: -
 Abstract: We consider the problem of apprenticeship learning when the expert's demonstration covers only a small part of a large state space. Inverse Reinforcement Learning (IRL) provides an efficient solution to this problem based on the assumption that the expert is optimally acting in a Markov Decision Process (MDP). However, past work on IRL requires an accurate estimate of the frequency of encountering each feature of the states when the robot follows the expert‘s policy. Given that the complete policy of the expert is unknown, the features frequencies can only be empirically estimated from the demonstrated trajectories. In this paper, we propose to use a transfer method, known as soft homomorphism, in order to generalize the expert‘s policy to unvisited regions of the state space. The generalized policy can be used either as the robot‘s final policy, or to calculate the features frequencies within an IRL algorithm. Empirical results show that our approach is able to learn good policies from a small number of demonstrations.

Details

show
hide
Language(s):
 Dates: 2010-05
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: ISBN: 978-1-424-45038-1
URI: http://icra2010.grasp.upenn.edu/
DOI: 10.1109/ROBOT.2010.5509717
BibTex Citekey: 6825
 Degree: -

Event

show
hide
Title: 2010 IEEE International Conference on Robotics and Automation (ICRA 2010)
Place of Event: Anchorage, AK, USA
Start-/End Date: -

Legal Case

show

Project information

show

Source 1

show
hide
Title: 2010 IEEE International Conference on Robotics and Automation (ICRA 2010)
Source Genre: Proceedings
 Creator(s):
Affiliations:
Publ. Info: Piscataway, NJ, USA : IEEE
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 2971 - 2976 Identifier: -