Title
Data-efficient reinforcement learning for variable impedance controlAuthor
xmlui.dri2xhtml.METS-1.0.item-contributorOtherinstitution
https://ror.org/020hwjq30https://ror.org/05xg72x27
Version
http://purl.org/coar/version/c_970fb48d4fbd8a85
Rights
© 2024 The AuthorsAccess
http://purl.org/coar/access_right/c_abf2Publisher’s version
https://doi.org/10.1109/ACCESS.2024.3355311Published at
IEEE Access Vol 12Publisher
IEEEKeywords
Model-based reinforcement learningvariable impedance learning control
Gaussian processes
covariance matrix adaptation
Abstract
One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot’s behaviour safe but ... [+]
One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot’s behaviour safe but also makes it more energy efficient. In this direction, the variable impedance control (VIC) approach provides a framework for a robot to adapt its compliance during execution by employing an adaptive impedance law. Nevertheless, autonomously adapting the compliance profile as demanded by the task remains a challenging problem to be solved in practice. In this work, we introduce a reinforcement learning (RL)-based approach called DEVILC (Data-Efficient Variable Impedance Learning Controller) to learn the variable impedance controller through real-world interaction of the robot. More concretely, we use a model-based RL approach in which, after every interaction, the robot iteratively learns a probabilistic model of its dynamics using the Gaussian process regression model. The model is then used to optimize a neural-network policy that modulates the robot’s impedance such that the long-term reward for the task is maximized. Thanks to the model-based RL framework, DEVILC allows a robot to learn the VIC policy with only a few interactions, making it practical for real-world applications. In simulations and experiments, we evaluate DEVILC on a Franka Emika Panda robotic manipulator for different manipulation tasks in the Cartesian space. The results show that DEVILC is a promising direction toward autonomously learning compliant manipulation skills directly in the real world through interactions. A video of the experiments is available in the link: https://youtu.be/_uyr0Vye5no . [-]
xmlui.dri2xhtml.METS-1.0.item-oaire-funderName
The Research Council of NorwayGobierno Vasco
Gobierno Vasco
xmlui.dri2xhtml.METS-1.0.item-oaire-fundingStream
IKTPLUS-ICT and digital innovationElkartek 2022
Elkartek 2023
xmlui.dri2xhtml.METS-1.0.item-oaire-awardNumber
270941KK-2022-00024
KK-2023-00055
xmlui.dri2xhtml.METS-1.0.item-oaire-awardURI
Sin informaciónSin información
Sin información
xmlui.dri2xhtml.METS-1.0.item-oaire-awardTitle
Dynamic Robot Interaction and Motion CompensationProducción Fluída y Resiliente para la Industria inteligente (PROFLOW)
Tecnologías de Inteligencia Artificial para la percepción visual y háptica y la planificación y control de tareas de manipulación (HELDU)
Collections
- Articles - Engineering [639]
The following license files are associated with this item: