2026-04-07T06:51:21Zhttps://ebiltegia.mondragon.edu/oai/requestoai:ebiltegia.mondragon.edu:20.500.11984/63592024-04-19T10:43:41Zcom_20.500.11984_473col_20.500.11984_478
eBiltegia
author
Abu-Dakka, Fares J.
other
Anand, Akhil S.
other
Kaushik, Rituraj
other
Gravdahl, Jan Tommy
2024-04-18T12:46:35Z
2024-04-18T12:46:35Z
2024
2169-3536
https://katalogoa.mondragon.edu/janium-bin/janium_login_opac.pl?find&ficha_no=174317
https://hdl.handle.net/20.500.11984/6359
One of the most crucial steps toward achieving human-like manipulation skills in robots is to incorporate compliance into the robot controller. Compliance not only makes the robot’s behaviour safe but also makes it more energy efficient. In this direction, the variable impedance control (VIC) approach provides a framework for a robot to adapt its compliance during execution by employing an adaptive impedance law. Nevertheless, autonomously adapting the compliance profile as demanded by the task remains a challenging problem to be solved in practice. In this work, we introduce a reinforcement learning (RL)-based approach called DEVILC (Data-Efficient Variable Impedance Learning Controller) to learn the variable impedance controller through real-world interaction of the robot. More concretely, we use a model-based RL approach in which, after every interaction, the robot iteratively learns a probabilistic model of its dynamics using the Gaussian process regression model. The model is then used to optimize a neural-network policy that modulates the robot’s impedance such that the long-term reward for the task is maximized. Thanks to the model-based RL framework, DEVILC allows a robot to learn the VIC policy with only a few interactions, making it practical for real-world applications. In simulations and experiments, we evaluate DEVILC on a Franka Emika Panda robotic manipulator for different manipulation tasks in the Cartesian space. The results show that DEVILC is a promising direction toward autonomously learning compliant manipulation skills directly in the real world through interactions. A video of the experiments is available in the link: https://youtu.be/_uyr0Vye5no .
eng
© 2024 The Authors
Model-based reinforcement learning
variable impedance learning control
Gaussian processes
covariance matrix adaptation
Data-efficient reinforcement learning for variable impedance control
http://purl.org/coar/resource_type/c_6501
CkVCSUxURUdJQS1OLCBNT05EUkFHT04gVU5JQkVSVFNJVEFURUtPIEdPUkRBSUxVIElSRUtJQU4sIE1BVEVSSUFMQUsgVVpURUtPIEVSQUJJTEVSQSBMSVpFTlRaSUEgRVRBIEVTS1VCSURFRU4gTEFHQVBFTiBFWi1FU0tMVVNJQk9BCgpHb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYXJlbiBlZ2lsZSBlZG8gZWdpbGUgZXNrdWJpZGVlbiB0aXR1bGFyIG5haXplbiBhbGRldGlrLCBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWFyaSBlcmFiaWxlcmEtYmFpbWVuYSBldGEvZWRvIExBR0FQRU4gRVotRVNLTFVTSUJPQSBlbWF0ZW4gZGlvdCwgZG9hbiwgbXVuZHUgZXJlbXVhbiBldGEgbGVnZXprbyBnZWhpZW5la28gZXBlYW4sIG1hdGVyaWFsIGhvcnJlbiBnYWluZWtvIGVycmVwcm9kdWt6aW8sIGJhbmFrZXRhLCBrb211bmlrYXppbyBwdWJsaWtvIOKAk2VsZWt0cm9uaWtva2kgZXNrdXJhZ2FycmkgamFydHpla28gZXNrdWJpZGVhIGJhcm5l4oCTIGV0YSBlcmFsZGF0emVrbyBlc2t1YmlkZWV0YXJha28sIGhpcnVnYXJyZW4gYmF0enVlbiBlc2t1IGphcnR6ZWtvIGF1a2VyYSBlbWFuZXosIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWwgaG9ycmkgbG90dXRha28gZGFnb2tpb24gbGl6ZW50emlhbiBlemFycml0YWtvIGVyYWJpbGVyYSBiYWxkaW50emVuIGFyYWJlcmEuCgpPTkFSVFpFTiBEVVQgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhaywgZWR1a2lhIGFsZGF0dSBnYWJlLCBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYSBnb3JkZXR6ZWtvIGJlaGFycmV6a29hayBkaXJlbiBiZXN0ZSBmb3JtYXR1IGVkbyBiaXRhcnRla28gYmF0enVldGFyYSBlcmFsZGF0emVhIGVkbyBlZ29raXR6ZWEuIEVyYSBiZXJlYW4sIE9OQVJUWkVOIERVVCBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWFrIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhcmVuIGtvcGlhIGJhdCBiYWlubyBnZWhpYWdvIGdvcmRldHplYSwgc2VndXJ0YXN1biBrb3BpYWsgZWdpdGVrbyBldGEgbWF0ZXJpYWxhIGV0b3JraXp1bmVyYWtvIGdvcmRldHpla28uCgpaSVVSVEFUWkVOIERVVCBldGEgQkVSTUFUWkVOIERVVCBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYSBuaWsgc29ydHV0YWtvIGphdG9ycml6a28gb2JyYSBkZWxhLCBldGEgbmlrIGR1ZGFsYSBMaXplbnR6aWEgaG9uZXRhbiBqYXNvdGFrbyBsYWdhcGVuYSBlbWF0ZWtvIGJlaGFycmV6a28gZWdpbGUgZXNrdWJpZGVhcmVuIHRpdHVsYXJ0YXN1bmEuCgpUaXR1bGFydGFzdW5hIHBhcnRla2F0emVuIGRlbiBrYXN1ZXRhbiwgb25hcnR6ZW4gZHV0IGdhaW5lcmFrbyB0aXR1bGFycmVuIGJhaW1lbmEgZHVkYWxhIExpemVudHppYSBoYXUgZW1hdGVrby4gRXNrdWJpZGVhayBoaXJ1Z2FycmVuIGJhdHp1ZWkgYXVycmV6IGxhZ2F0YSBpemFuZXogZ2VybywgWklVUlRBVFpFTiBkdXQgaGFpZW4gYmFpbWVuYSBkdWRhbGEgZWRvIGxpemVudHppYSBob25ldGFuIGF1cnJleiBpa3VzaXRha28gbW9kdWFuIGVza3ViaWRlYWsgZXJhYmlsdHpla28gZ2FpdGFzdW5hIG1hbnRlbnR6ZW4gZHVkYWxhLgoKTGFnYXRha28gbWF0ZXJpYWxhayBlZ2lsZSBlc2t1YmlkZWVuIHRpdHVsYXIgZXogbmFpemVuIGJlc3RlbGFrbyBtYXRlcmlhbCBiYXR6dWsgaXphbmdvIGJhbGl0dSwgWklVUlRBVFpFTiBEVVQgZXRhIEJFUk1BVFpFTiBEVVQgZGFnb2tpb24gdGl0dWxhcnJhcmVuIGJhaW1lbmEgbG9ydHUgZHVkYWxhIGF1cnJleiBMaXplbnR6aWEgaGF1IGVtYW4gYWhhbCBpemF0ZWtvIGV0YSwgZXJhIGJlcmVhbiwgWklVUlRBVFpFTiBEVVQgZXRhIEJFUk1BVFpFTiBkdXQgZ29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGFyZW4gZWR1a2lhbiBiZWhhciBiZXphbGEgaWRlbnRpZmlrYXR1dGEgZXRhIGFpdG9ydHV0YSBkYWdvZWxhIGVnaWxlIGVza3ViaWRlYXJlbiB0aXR1bGFyIGhvcmkuCgpBemtlbiBiYXRlYW4sIFpJVVJUQVRaRU4gRFVUIGV0YSBCRVJNQVRaRU4gRFVUIGVCaWx0ZWdpYW4gZ29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGFrIEVaIERVRUxBIEhBVVNURU4gaGlydWdhcnJlbiBiYXR6dWVuIGVza3ViaWRlcmlrLCBleiBqYWJldHphIGludGVsZWt0dWFsZWtvcmlrIGV6IGluZHVzdHJpYWxla29yaWssIG9ob3JlLCBpbnRpbWl0YXRlIGV0YSBpcnVkaSBlc2t1YmlkZXJpaywgZWRvIGJlc3RlbGFrbyBlZG96ZWluIGVza3ViaWRlcmlrLgoKR29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGEgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIGV6IGRlbiBiZXN0ZSBhZ2VudHppYSBlZG8gZXJha3VuZGVyZW4gYmF0ZWsgZmluYW50emF0dXRha28gaWtlcmtldGFuIG9pbmFycml0dXRhIGJhbGRpbiBiYWRhZ28sIFpJVVJUQVRaRU4gRFVUIGV0YSBCRVJNQVRaRU4gRFVUIGJldGUgZGl0dWRhbGEgZXJha3VuZGUgaG9ycmVraW4gc2luYXR1dGFrbyBrb250cmF0dWFrIGVkbyBha29yZGlvYWsgZXNrYXR1dGFrbyBiZXRlYmVoYXIgZ3V6dGlhay4KCk1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYWsga29ucHJvbWlzb2EgaGFydHplbiBkdSBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYXJlbiBlZ2lsZSBlZG8gZWdpbGUgZXNrdWJpZGVlbiB0aXR1bGFyIGdpc2EgenUgaWRlbnRpZmlrYXR6ZWtvLCBldGEgZXogZHUgbWF0ZXJpYWwgaG9ycmV0YW4gTGl6ZW50emlhIGhvbmVrIGVzcHJlc3VraSBhaGFsYmlkZXR1dGFrb2EgZXogZGVuIGFsZGFrZXRhcmlrIGVnaW5nby4KCkdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhcmVuIGVnaWxlIGVkbyBlZ2lsZSBlc2t1YmlkZWVuIHRpdHVsYXIgemFyZW4gaGVpbmVhbiwgb2JyYSBlQmlsdGVnaXRpayBrZW50emVrbyBlc2thIGRlemFrZXp1IGp1c3RpZmlrYXR1dGFrbyBhcnJhem9pIGJhdGVraW4uIEhvcnJldGFyYWtvLCBhcmR1cmFkdW5la2luIGhhcnJlbWFuZXRhbiBqYXJyaSBiZWhhcmtvIGR1enUuCgpFcmEgYmVyZWFuLCBlQmlsdGVnaWFrIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhIGtlbmR1IGFoYWwgaXphbmdvIGR1IGJlaGFyIGJlemFsYSBqdXN0aWZpa2F0dXRha28ga2FzdWV0YW4gZWRvIGphYmV0emEgaW50ZWxla3R1YWxla28gZXNrdWJpZGVlaSBsb3R1dGEgaGlydWdhcnJlbiBiYXR6dWVuIGVycmVrbGFtYXppb3JpayBqYXNveiBnZXJvLiBCaSBrYXN1ZXRhbiBhdXJyZXRpYXogZXNwcmVzdWtpIGpha2luYXJhemlrbyBkYS4KCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgoKTElDRU5DSUEgREUgVVNPIFkgQ0VTScOTTiBERSBERVJFQ0hPUyBOTyBFWENMVVNJVkEgUEFSQSBFTCBERVDDk1NJVE8gREUgTUFURVJJQUxFUyBFTiBFQklMVEVHSUEsIFJFUE9TSVRPUklPIEFCSUVSVE8gREUgTU9ORFJBR09OIFVOSUJFUlRTSVRBVEVBCgpDb21vIGF1dG9yL2EgbyB0aXR1bGFyIGRlIGxvcyBkZXJlY2hvcyBkZSBhdXRvciBkZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBvdG9yZ28gYSBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWEgbGEgYXV0b3JpemFjacOzbiBkZSB1c28geS9vIENFU0nDk04gTk8gRVhDTFVTSVZBLCBncmF0dWl0YSwgY29uIMOhbWJpdG8gbXVuZGlhbCB5IHBvciBlbCBwbGF6byBtw6F4aW1vIGxlZ2FsLCBkZSBsb3MgZGVyZWNob3MgZGUgcmVwcm9kdWNjacOzbiwgZGlzdHJpYnVjacOzbiwgY29tdW5pY2FjacOzbiBww7pibGljYSDigJJpbmNsdWlkbyBlbCBkZXJlY2hvIGRlIHB1ZXN0YSBhIGRpc3Bvc2ljacOzbiBlbGVjdHLDs25pY2HigJIgeSB0cmFuc2Zvcm1hY2nDs24gc29icmUgZGljaG8gbWF0ZXJpYWwsIHBlcm1pdGllbmRvIHBvbmVybG8gYSBkaXNwb3NpY2nDs24gZGUgdGVyY2Vyb3MsIGVuIGxhcyBjb25kaWNpb25lcyBkZSB1c28gcXVlIHNlIGVzdGFibGV6Y2FuIGVuIGxhIGNvcnJlc3BvbmRpZW50ZSBsaWNlbmNpYSBhc29jaWFkYSBhIGRpY2hvIG1hdGVyaWFsIGRlcG9zaXRhZG8uCgpBQ0VQVE8gcXVlIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSBwdWVkYSwgc2luIGFsdGVyYXIgZWwgY29udGVuaWRvLCB0cmFuc2Zvcm1hciBvIGFkYXB0YXIgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBhIGN1YWxxdWllciBvdHJvIGZvcm1hdG8gbyBtZWRpbyBxdWUgcmVzdWx0ZSBuZWNlc2FyaW8gY29uIGZpbmVzIGRlIHByZXNlcnZhY2nDs24uIElndWFsbWVudGUsIEFDRVBUTyBxdWUgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIHB1ZWRhIGd1YXJkYXIgbcOhcyBkZSB1bmEgY29waWEgZGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8gYSBmaW4gZGUgcmVhbGl6YXIgY29waWFzIGRlIHNlZ3VyaWRhZCB5IHByZXNlcnZhciBlbCBtYXRlcmlhbCBwYXJhIGVsIGZ1dHVyby4KCkFTRUdVUk8geSBHQVJBTlRJWk8gcXVlIGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8gZXMgdW5hIG9icmEgb3JpZ2luYWwgZGUgbWkgY3JlYWNpw7NuLCBzb2JyZSBsYSBxdWUgb3N0ZW50byBsYSB0aXR1bGFyaWRhZCBkZSBkZXJlY2hvcyBkZSBhdXRvciBuZWNlc2FyaWEgcGFyYSBvdG9yZ2FyIGxhIGNlc2nDs24gY29udGVuaWRhIGVuIGxhIHByZXNlbnRlIExpY2VuY2lhLgoKRW4gY2FzbyBkZSBjb3RpdHVsYXJpZGFkIGFkbWl0byBjb250YXIgY29uIGVsIGNvbnNlbnRpbWllbnRvIGRlIGxvcyByZXN0YW50ZXMgdGl0dWxhcmVzIHBhcmEgb3RvcmdhciBsYSBwcmVzZW50ZSBMaWNlbmNpYS4gRW4gY2FzbyBkZSBwcmV2aWEgY2VzacOzbiBkZSBkZXJlY2hvcyBhIHRlcmNlcm9zLCBBU0VHVVJPIGNvbnRhciBjb24gc3UgYXV0b3JpemFjacOzbiBvIHJldGVuZ28gbGEgZmFjdWx0YWQgZGUgaGFjZXIgdXNvIGRlIGVzdG9zIGRlcmVjaG9zIGVuIGxhIGZvcm1hIHByZXZpc3RhIGVuIGxhIHByZXNlbnRlIGxpY2VuY2lhLgoKRW4gZWwgY2FzbyBkZSBxdWUgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBjb250dXZpZXJhIG90cm8gbWF0ZXJpYWwgZGVsIHF1ZSBubyBzb3kgZWwvbGEgdGl0dWxhciBkZSBsb3MgZGVyZWNob3MgZGUgYXV0b3IsIEFTRUdVUk8geSBHQVJBTlRJWk8gaGFiZXIgb2J0ZW5pZG8gbGEgcHJldmlhIGF1dG9yaXphY2nDs24gZGVsIGNvcnJlc3BvbmRpZW50ZSB0aXR1bGFyIHF1ZSBtZSBwZXJtaXRlIG90b3JnYXIgbGEgcHJlc2VudGUgTGljZW5jaWEgeSwgZGVsIG1pc21vIG1vZG8sIEFTRUdVUk8geSBHQVJBTlRJWk8gcXVlIGVuIGVsIGNvbnRlbmlkbyBkZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBxdWVkYSBjb3JyZWN0YW1lbnRlIGlkZW50aWZpY2FkbyB5IHJlY29ub2NpZG8gZWwgZGljaG8gdGl0dWxhciBkZSBkZXJlY2hvIGRlIGF1dG9yLgoKRW4gZGVmaW5pdGl2YSwgQVNFR1VSTyB5IEdBUkFOVElaTyBxdWUgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBlbiBlQmlsdGVnaWEgTk8gSU5GUklOR0UgZGVyZWNobyBhbGd1bm8gZGUgdGVyY2Vyb3MsIHlhIHNlYSBkZSBwcm9waWVkYWQgaW50ZWxlY3R1YWwgbyBpbmR1c3RyaWFsLCBkZXJlY2hvIGFsIGhvbm9yLCBhIGxhIGludGltaWRhZCB5IGEgbGEgaW1hZ2VuLCBvIGN1YWxxdWllciBvdHJvIGRlcmVjaG8uCgpFbiBlbCBjYXNvIGRlIHF1ZSBlbCBtYXRlcmlhbCBkZXBvc2l0YWRvIGVzdMOpIGJhc2FkbyBlbiB1bmEgaW52ZXN0aWdhY2nDs24gZmluYW5jaWFkYSBwb3IgYWxndW5hIGFnZW5jaWEgdSBvcmdhbmlzbW8gZGlzdGludG8gZGUgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhLCBBU0VHVVJPIHkgR0FSQU5USVpPIGhhYmVyIGN1bXBsaWRvIGNvbiB0b2RhcyBsYXMgb2JsaWdhY2lvbmVzIHJlcXVlcmlkYXMgcG9yIGVsIGNvbnRyYXRvIG8gYWN1ZXJkbyBmaXJtYWRvIGNvbiBkaWNobyBvcmdhbmlzbW8uCgpNb25kcmFnb24gVW5pYmVydHNpdGF0ZWEgYWRxdWllcmUgZWwgY29tcHJvbWlzbyBkZSBpZGVudGlmaWNhcnRlIGNvbW8gYXV0b3IvYSBvIHRpdHVsYXIgZGUgZGVyZWNob3MgZGUgYXV0b3IgZGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8sIHkgbm8gZWZlY3R1YXLDoSBtw6FzIGFsdGVyYWNpb25lcyBlbiBkaWNobyBtYXRlcmlhbCBxdWUgbGFzIGV4cHJlc2FtZW50ZSBwZXJtaXRpZGFzIGVuIGVzdGEgTGljZW5jaWEuCgpDb21vIGF1dG9yL2EgbyB0aXR1bGFyIGRlIGRlcmVjaG9zIGRlIGF1dG9yIGRlbCBtYXRlcmlhbCBkZXBvc2l0YWRvIHB1ZWRlcyBzb2xpY2l0YXIgbGEgcmV0aXJhZGEgZGUgbGEgb2JyYSBkZSBlQmlsdGVnaWEgcG9yIGNhdXNhIGp1c3RpZmljYWRhLiBQYXJhIGVsbG8gZGViZXLDoXMgcG9uZXJzZSBlbiBjb250YWN0byBjb24gbGFzIHBlcnNvbmFzIHJlc3BvbnNhYmxlcyBkZWwgbWlzbW8uCgpEZSBpZ3VhbCBtb2RvLCBlQmlsdGVnaWEgcG9kcsOhIHJldGlyYXIgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBlbiBzdXB1ZXN0b3Mgc3VmaWNpZW50ZW1lbnRlIGp1c3RpZmljYWRvcyBvIGVuIGNhc28gZGUgcmVjbGFtYWNpb25lcyBkZSB0ZXJjZXJvcyByZWxhdGl2YXMgYSBsb3MgZGVyZWNob3MgZGUgcHJvcGllZGFkIGludGVsZWN0dWFsLiBFbiBhbWJvcyBzdXB1ZXN0b3MgZXhpc3RpcsOhIHVuYSBub3RpZmljYWNpw7NuIGV4cHJlc2EgcHJldmlhLgoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCgpOT04tRVhDTFVTSVZFIExJQ0VOQ0UgRk9SIFRIRSBVU0UgQU5EIEFTU0lHTk1FTlQgT0YgUklHSFRTIEZPUiBTVUJNSVNTSU9OUyBUTyBFQklMVEVHSUEsIFRIRSBPUEVOIFJFUE9TSVRPUlkgT0YgTU9ORFJBR09OIFVOSUJFUlRTSVRBVEVBCgpBcyB0aGUgYXV0aG9yIG9yIGhvbGRlciBvZiB0aGUgY29weXJpZ2h0IG9mIHRoZSBzdW1pdHRlZCBtYXRlcmlhbCwgSSBoZXJlYnkgZ3JhbnQgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIHRoZSBOT04tRVhDTFVTSVZFIGF1dGhvcmlzYXRpb24gdG8gdXNlIGFuZC9vciBBU1NJR04sIGZyZWUgb2YgY2hhcmdlLCB3b3JsZHdpZGUgYW5kIGZvciB0aGUgbWF4aW11bSBsZWdhbCB0ZXJtLCB0aGUgcmlnaHRzIHRvIHJlcHJvZHVjZSwgZGlzdHJpYnV0ZSwgcHVibGlzaCDigJIgaW5jbHVkaW5nIHRoZSByaWdodCB0byBtYWtlIGl0IGF2YWlsYWJsZSBpbiBlbGVjdHJvbmljIGZvcm1hdCDigJIgYW5kIGNvbnZlcnQgc3VjaCBtYXRlcmlhbCwgYWxsb3dpbmcgaXQgdG8gYmUgbWFkZSBhdmFpbGFibGUgdG8gdGhpcmQgcGFydGllcywgc3ViamVjdCB0byB0aGUgdGVybXMgb2YgdXNlIHNldCBmb3J0aCBpbiB0aGUgcmVzcGVjdGl2ZSBsaWNlbmNlIGFzc29jaWF0ZWQgd2l0aCB0aGUgc3VibWl0dGVkIG1hdGVyaWFsLgoKSSBoZXJlYnkgQVVUSE9SSVNFIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSB0byBjb252ZXJ0IG9yIGFkYXB0IHRoZSBzdWJtaXR0ZWQgbWF0ZXJpYWwgdG8gYW55IG90aGVyIGZvcm1hdCBvciBtZWRpdW0gdGhhdCBtYXkgYmUgbmVjZXNzYXJ5IGZvciB0aGUgcHVycG9zZSBvZiBpdHMgcHJlc2VydmF0aW9uLCB3aXRob3V0IGNoYW5naW5nIGl0cyBjb250ZW50LiBJIGFsc28gQVVUSE9SSVNFIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSB0byBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGUgc3VibWl0dGVkIG1hdGVyaWFsIHNvIHRoYXQgaXQgbWF5IG1ha2UgYmFjay11cHMgYW5kIHByZXNlcnZlIHRoZSBtYXRlcmlhbCBmb3IgdGhlIGZ1dHVyZS4KCkkgV0FSUkFOVCBhbmQgUkVQUkVTRU5UIHRoYXQgdGhlIG1hdGVyaWFsIHN1Ym1pdHRlZCBpcyBhbiBvcmlnaW5hbCB3b3JrIGNyZWF0ZWQgYnkgbWUsIGFuZCBJIGhvbGQgdGhlIG5lY2Vzc2FyeSBjb3B5cmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0IG9mIGFzc2lnbm1lbnQgY29udGFpbmVkIGluIHRoaXMgTGljZW5jZS4KCkluIHRoZSBldmVudCBvZiBqb2ludCBvd25lcnNoaXAgb2YgYXV0aG9y4oCZcyByaWdodHMsIEkgd2FycmFudCB0aGF0IEkgaGF2ZSB0aGUgY29uc2VudCBvZiB0aGUgb3RoZXIgY29weXJpZ2h0IGhvbGRlcnMgdG8gZ3JhbnQgdGhpcyBMaWNlbmNlLiBJbiB0aGUgZXZlbnQgb2YgYW55IHByaW9yIGFzc2lnbm1lbnQgb2YgdGhlIHJpZ2h0cyB0byB0aGlyZCBwYXJ0aWVzLCBJIFdBUlJBTlQgdGhhdCBJIGhhdmUgdGhlaXIgYXV0aG9yaXNhdGlvbiBvciBzdGlsbCBoYXZlIHRoZSBmYWN1bHR5IHRvIHVzZSB0aGVzZSByaWdodHMgaW4gdGhlIG1hbm5lciBzZXQgZm9ydGggaW4gdGhpcyBsaWNlbmNlLgoKSWYgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCBjb250YWlucyBhbnkgb3RoZXIgbWF0ZXJpYWwgZm9yIHdoaWNoIEkgZG8gbm90IGhvbGQgdGhlIGNvcHlyaWdodCwgSSBXQVJSQU5UIGFuZCBSRVBSRVNFTlQgdGhhdCBJIGhhdmUgb2J0YWluZWQgdGhlIHByaW9yIGF1dGhvcmlzYXRpb24gb2YgdGhlIHJlc3BlY3RpdmUgY29weXJpZ2h0IGhvbGRlciwgd2hpY2ggZW5hYmxlcyBtZSB0byBncmFudCB0aGlzIExpY2VuY2UgYW5kLCBzaW1pbGFybHksIEkgV0FSUkFOVCBhbmQgUkVQUkVTRU5UIHRoYXQgaW4gdGhlIGNvbnRlbnQgb2YgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCwgdGhlIGNvcHlyaWdodCBob2xkZXIgaXMgZHVseSBpZGVudGlmaWVkIGFuZCBhY2tub3dsZWRnZWQuCgpJbiBzaG9ydCwgSSBXQVJSQU5UIEFORCBSRVBSRVNFTlQgdGhhdCB0aGUgbWF0ZXJpYWwgc3VibWl0dGVkIHRvIGVCaWx0ZWdpYSBET0VTIE5PVCBJTkZSSU5HRSBhbnkgdGhpcmQtcGFydHkgcmlnaHRzLCB3aGV0aGVyIHJlbGF0ZXMgdG8gaW50ZWxsZWN0dWFsIG9yIGluZHVzdHJpYWwgcHJvcGVydHksIHJpZ2h0IHRvIGhvbm91ciwgcHJpdmFjeSBvciBzZWxmLWltYWdlLCBvciBhbnkgb3RoZXIgcmlnaHQuCgpJZiB0aGUgc3VibWl0dGVkIG1hdGVyaWFsIGlzIGJhc2VkIHVwb24gcmVzZWFyY2ggc3BvbnNvcmVkIG9yIHN1cHBvcnRlcyBieSBhbnkgYWdlbmN5IG9yIGluc3RpdHV0aW9uIG90aGVyIHRoYW4gTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhLCBJIFdBUlJBTlQgQU5EIFJFUFJFU0VOVCB0aGF0IEkgaGF2ZSBmdWxmaWxsZWQgYWxsIG9ibGlnYXRpb25zIHJlcXVpcmVkIGJ5IHRoZSBjb250cmFjdCBvciBhZ3JlZW1lbnQgc2lnbmVkIHdpdGggdGhlIGluc3RpdHV0aW9uLgoKTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIGhlcmVieSBhZ3JlZXMgdG8gaWRlbnRpZnkgeW91IGFzIHRoZSBhdXRob3Igb3IgaG9sZGVyIG9mIHRoZSBjb3B5cmlnaHQgb2YgdGhlIHN1Ym1pdGVkIG1hdGVyaWFsLCBhbmQgaXQgc2hhbGwgbWFrZSBubyBjaGFuZ2VzIHRvIHRoYXQgbWF0ZXJpYWwgb3RoZXIgdGhhbiB0aG9zZSBleHByZXNzbHkgcGVybWl0dGVkIGJ5IHRoaXMgTGljZW5jZS4KCkFzIHRoZSBhdXRob3Igb3IgaG9sZGVyIG9mIHRoZSBjb3B5cmlnaHQgZm9yIHRoZSBzdWJtaXR0ZWQgbWF0ZXJpYWwsIHlvdSBtYXkgcmVxdWVzdCB0aGF0IHRoZSB3b3JrIGlzIHJlbW92ZWQgZnJvbSBlQmlsdGVnaWEgaWYgdGhlcmUgaXMgZ29vZCBjYXVzZS4gSW4gc3VjaCBhbiBldmVudCwgeW91IG11c3QgY29udGFjdCB0aGUgcGVyc29ucyByZXNwb25zaWJsZSBmb3IgZG9pbmcgdGhpcy4KClNpbWlsYXJseSwgZUJpbHRlZ2lhIG1heSByZW1vdmUgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCB3aGVuIHRoZXJlIGlzIGdvb2QgY2F1c2Ugb3IgaW4gdGhlIGV2ZW50IG9mIHRoaXJkLXBhcnR5IGNsYWltcyByZWdhcmRpbmcgaW50ZWxsZWN0dWFsIHByb3BlcnR5IHJpZ2h0cy4gSW4gYm90aCBjYXNlcywgZXhwcmVzcyBwcmlvciBub3RpZmljYXRpb24gc2hhbGwgYmUgZ2l2ZW4uCg==
URL
http://ebiltegia.mondragon.edu/xmlui/bitstream/20.500.11984/6359/1/Data-Efficient_Reinforcement_Learning_for_Variable_Impedance_Control.pdf
File
MD5
c4b9f8ef288b85484ed6df17b25ef0d1
1316936
application/pdf
Data-Efficient_Reinforcement_Learning_for_Variable_Impedance_Control.pdf
URL
http://ebiltegia.mondragon.edu/xmlui/bitstream/20.500.11984/6359/4/Data-Efficient_Reinforcement_Learning_for_Variable_Impedance_Control.pdf.txt
File
MD5
0dced4cc47a555eae423d21e0c359154
55838
text/plain
Data-Efficient_Reinforcement_Learning_for_Variable_Impedance_Control.pdf.txt