English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT
 
 
DownloadE-Mail
  Policy Search for Motor Primitives in Robotics

Kober, J., & Peters, J. (2009). Policy Search for Motor Primitives in Robotics. Advances in neural information processing systems 21: 22nd Annual Conference on Neural Information Processing Systems 2008, 849-856.

Item is

Files

show Files

Locators

show

Creators

show
hide
 Creators:
Kober, J1, Author           
Peters, J1, 2, Author           
Koller, Editor
D., Editor
Schuurmans, D., Editor
Bengio, Y., Editor
Bottou, L., Editor
Affiliations:
1Department Empirical Inference, Max Planck Institute for Biological Cybernetics, Max Planck Society, ou_1497795              
2Dept. Empirical Inference, Max Planck Institute for Intelligent Systems, Max Planck Society, ou_1497647              

Content

show
hide
Free keywords: -
 Abstract: Many motor skills in humanoid robotics can be learned using parametrized motor primitives as done in imitation learning. However, most interesting motor learning problems are high-dimensional reinforcement learning problems often beyond the reach of current methods. In this paper, we extend previous work on policy learning from the immediate reward case to episodic reinforcement learning. We show that this results into a general, common framework also connected to policy gradient methods and yielding a novel algorithm for policy learning by assuming a form of exploration that is particularly well-suited for dynamic motor primitives. The resulting algorithm is an EM-inspired algorithm applicable in complex motor learning tasks. We compare this algorithm to alternative parametrized policy search methods and show that it outperforms previous methods. We apply it in the context of motor learning and show that it can learn a complex Ball-in-a-Cup task using a real Barrett WAM robot arm.

Details

show
hide
Language(s):
 Dates: 2009-06
 Publication Status: Issued
 Pages: -
 Publishing info: -
 Table of Contents: -
 Rev. Type: -
 Identifiers: ISBN: 978-1-605-60949-2
URI: http://nips.cc/Conferences/2008/
BibTex Citekey: 5411
 Degree: -

Event

show
hide
Title: Twenty-Second Annual Conference on Neural Information Processing Systems (NIPS 2008)
Place of Event: Vancouver, BC, Canada
Start-/End Date: -

Legal Case

show

Project information

show

Source 1

show
hide
Title: Advances in neural information processing systems 21 : 22nd Annual Conference on Neural Information Processing Systems 2008
Source Genre: Journal
 Creator(s):
Affiliations:
Publ. Info: Red Hook, NY, USA : Curran
Pages: - Volume / Issue: - Sequence Number: - Start / End Page: 849 - 856 Identifier: -