2026-04-07T17:02:39Zhttps://ebiltegia.mondragon.edu/oai/request
oai:ebiltegia.mondragon.edu:20.500.11984/68982025-02-14T07:15:38Zcom_20.500.11984_473col_20.500.11984_478
eBiltegia author Elguea Aguinaco, Iñigo author Aguirre, Aitor author Izagirre, Unai author Inziarte Hidalgo, Ibai author Bogh, Simon author Arana-Arexolaleiba, Nestor 2025-02-13T09:36:03Z 2025-02-13T09:36:03Z 2025 1872-7409 https://katalogoa.mondragon.edu/janium-bin/janium_login_opac.pl?find&ficha_no=179940 https://hdl.handle.net/20.500.11984/6898 Learning to perform procedural motion or manipulation tasks in unstructured or uncertain environments poses significant challenges for intelligent agents. Although reinforcement learning algorithms have demonstrated positive results on simple tasks, the hard-to-engineer reward functions and the impractical amount of trial-and-error iterations these agents require in long-experience streams still present challenges for deployment in industrially relevant environments. In this regard, interactive reinforcement learning has emerged as a promising approach to mitigate these limitations, whereby a human supervisor provides evaluative or corrective feedback to the learning agent during training. However, the requirement of a human-in-the-loop approach throughout the learning process can be impractical for tasks that span several hours. This study aims to overcome this limitation by automating the learning process and substituting human feedback with an artificial supervisor grounded in constraint-based modeling techniques. In contrast to the logical constraints commonly used for conventional reinforcement learning, constraint-based modeling techniques offer enhanced adaptability in terms of conceptualizing and modeling the human knowledge of a task. This modeling capability allows an automated supervisor to acquire a closer approximation to human reasoning by dividing complex tasks into more manageable components and identifying the associated subtask and contextual cues in which the agent is involved. The supervisor then adjusts the evaluative and corrective feedback to suit the specific subtask under consideration. The framework was assessed using three actor-critic agents in a human–robot interaction environment, demonstrating a sample efficiency improvement of 50% and success rates of eng © 2024 The Authors Automated supervisor Contact-rich manipulation Industrial manipulators Interactive reinforcement learning Sample efficiency Procedural tasks Novel automated interactive reinforcement learning framework with a constraint-based supervisor for procedural tasks http://purl.org/coar/resource_type/c_6501 CkVCSUxURUdJQS1OLCBNT05EUkFHT04gVU5JQkVSVFNJVEFURUtPIEdPUkRBSUxVIElSRUtJQU4sIE1BVEVSSUFMQUsgVVpURUtPIEVSQUJJTEVSQSBMSVpFTlRaSUEgRVRBIEVTS1VCSURFRU4gTEFHQVBFTiBFWi1FU0tMVVNJQk9BCgpHb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYXJlbiBlZ2lsZSBlZG8gZWdpbGUgZXNrdWJpZGVlbiB0aXR1bGFyIG5haXplbiBhbGRldGlrLCBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWFyaSBlcmFiaWxlcmEtYmFpbWVuYSBldGEvZWRvIExBR0FQRU4gRVotRVNLTFVTSUJPQSBlbWF0ZW4gZGlvdCwgZG9hbiwgbXVuZHUgZXJlbXVhbiBldGEgbGVnZXprbyBnZWhpZW5la28gZXBlYW4sIG1hdGVyaWFsIGhvcnJlbiBnYWluZWtvIGVycmVwcm9kdWt6aW8sIGJhbmFrZXRhLCBrb211bmlrYXppbyBwdWJsaWtvIOKAk2VsZWt0cm9uaWtva2kgZXNrdXJhZ2FycmkgamFydHpla28gZXNrdWJpZGVhIGJhcm5l4oCTIGV0YSBlcmFsZGF0emVrbyBlc2t1YmlkZWV0YXJha28sIGhpcnVnYXJyZW4gYmF0enVlbiBlc2t1IGphcnR6ZWtvIGF1a2VyYSBlbWFuZXosIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWwgaG9ycmkgbG90dXRha28gZGFnb2tpb24gbGl6ZW50emlhbiBlemFycml0YWtvIGVyYWJpbGVyYSBiYWxkaW50emVuIGFyYWJlcmEuCgpPTkFSVFpFTiBEVVQgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhaywgZWR1a2lhIGFsZGF0dSBnYWJlLCBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYSBnb3JkZXR6ZWtvIGJlaGFycmV6a29hayBkaXJlbiBiZXN0ZSBmb3JtYXR1IGVkbyBiaXRhcnRla28gYmF0enVldGFyYSBlcmFsZGF0emVhIGVkbyBlZ29raXR6ZWEuIEVyYSBiZXJlYW4sIE9OQVJUWkVOIERVVCBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWFrIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhcmVuIGtvcGlhIGJhdCBiYWlubyBnZWhpYWdvIGdvcmRldHplYSwgc2VndXJ0YXN1biBrb3BpYWsgZWdpdGVrbyBldGEgbWF0ZXJpYWxhIGV0b3JraXp1bmVyYWtvIGdvcmRldHpla28uCgpaSVVSVEFUWkVOIERVVCBldGEgQkVSTUFUWkVOIERVVCBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYSBuaWsgc29ydHV0YWtvIGphdG9ycml6a28gb2JyYSBkZWxhLCBldGEgbmlrIGR1ZGFsYSBMaXplbnR6aWEgaG9uZXRhbiBqYXNvdGFrbyBsYWdhcGVuYSBlbWF0ZWtvIGJlaGFycmV6a28gZWdpbGUgZXNrdWJpZGVhcmVuIHRpdHVsYXJ0YXN1bmEuCgpUaXR1bGFydGFzdW5hIHBhcnRla2F0emVuIGRlbiBrYXN1ZXRhbiwgb25hcnR6ZW4gZHV0IGdhaW5lcmFrbyB0aXR1bGFycmVuIGJhaW1lbmEgZHVkYWxhIExpemVudHppYSBoYXUgZW1hdGVrby4gRXNrdWJpZGVhayBoaXJ1Z2FycmVuIGJhdHp1ZWkgYXVycmV6IGxhZ2F0YSBpemFuZXogZ2VybywgWklVUlRBVFpFTiBkdXQgaGFpZW4gYmFpbWVuYSBkdWRhbGEgZWRvIGxpemVudHppYSBob25ldGFuIGF1cnJleiBpa3VzaXRha28gbW9kdWFuIGVza3ViaWRlYWsgZXJhYmlsdHpla28gZ2FpdGFzdW5hIG1hbnRlbnR6ZW4gZHVkYWxhLgoKTGFnYXRha28gbWF0ZXJpYWxhayBlZ2lsZSBlc2t1YmlkZWVuIHRpdHVsYXIgZXogbmFpemVuIGJlc3RlbGFrbyBtYXRlcmlhbCBiYXR6dWsgaXphbmdvIGJhbGl0dSwgWklVUlRBVFpFTiBEVVQgZXRhIEJFUk1BVFpFTiBEVVQgZGFnb2tpb24gdGl0dWxhcnJhcmVuIGJhaW1lbmEgbG9ydHUgZHVkYWxhIGF1cnJleiBMaXplbnR6aWEgaGF1IGVtYW4gYWhhbCBpemF0ZWtvIGV0YSwgZXJhIGJlcmVhbiwgWklVUlRBVFpFTiBEVVQgZXRhIEJFUk1BVFpFTiBkdXQgZ29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGFyZW4gZWR1a2lhbiBiZWhhciBiZXphbGEgaWRlbnRpZmlrYXR1dGEgZXRhIGFpdG9ydHV0YSBkYWdvZWxhIGVnaWxlIGVza3ViaWRlYXJlbiB0aXR1bGFyIGhvcmkuCgpBemtlbiBiYXRlYW4sIFpJVVJUQVRaRU4gRFVUIGV0YSBCRVJNQVRaRU4gRFVUIGVCaWx0ZWdpYW4gZ29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGFrIEVaIERVRUxBIEhBVVNURU4gaGlydWdhcnJlbiBiYXR6dWVuIGVza3ViaWRlcmlrLCBleiBqYWJldHphIGludGVsZWt0dWFsZWtvcmlrIGV6IGluZHVzdHJpYWxla29yaWssIG9ob3JlLCBpbnRpbWl0YXRlIGV0YSBpcnVkaSBlc2t1YmlkZXJpaywgZWRvIGJlc3RlbGFrbyBlZG96ZWluIGVza3ViaWRlcmlrLgoKR29yZGFpbHVhbiB1dHppdGFrbyBtYXRlcmlhbGEgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIGV6IGRlbiBiZXN0ZSBhZ2VudHppYSBlZG8gZXJha3VuZGVyZW4gYmF0ZWsgZmluYW50emF0dXRha28gaWtlcmtldGFuIG9pbmFycml0dXRhIGJhbGRpbiBiYWRhZ28sIFpJVVJUQVRaRU4gRFVUIGV0YSBCRVJNQVRaRU4gRFVUIGJldGUgZGl0dWRhbGEgZXJha3VuZGUgaG9ycmVraW4gc2luYXR1dGFrbyBrb250cmF0dWFrIGVkbyBha29yZGlvYWsgZXNrYXR1dGFrbyBiZXRlYmVoYXIgZ3V6dGlhay4KCk1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYWsga29ucHJvbWlzb2EgaGFydHplbiBkdSBnb3JkYWlsdWFuIHV0eml0YWtvIG1hdGVyaWFsYXJlbiBlZ2lsZSBlZG8gZWdpbGUgZXNrdWJpZGVlbiB0aXR1bGFyIGdpc2EgenUgaWRlbnRpZmlrYXR6ZWtvLCBldGEgZXogZHUgbWF0ZXJpYWwgaG9ycmV0YW4gTGl6ZW50emlhIGhvbmVrIGVzcHJlc3VraSBhaGFsYmlkZXR1dGFrb2EgZXogZGVuIGFsZGFrZXRhcmlrIGVnaW5nby4KCkdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhcmVuIGVnaWxlIGVkbyBlZ2lsZSBlc2t1YmlkZWVuIHRpdHVsYXIgemFyZW4gaGVpbmVhbiwgb2JyYSBlQmlsdGVnaXRpayBrZW50emVrbyBlc2thIGRlemFrZXp1IGp1c3RpZmlrYXR1dGFrbyBhcnJhem9pIGJhdGVraW4uIEhvcnJldGFyYWtvLCBhcmR1cmFkdW5la2luIGhhcnJlbWFuZXRhbiBqYXJyaSBiZWhhcmtvIGR1enUuCgpFcmEgYmVyZWFuLCBlQmlsdGVnaWFrIGdvcmRhaWx1YW4gdXR6aXRha28gbWF0ZXJpYWxhIGtlbmR1IGFoYWwgaXphbmdvIGR1IGJlaGFyIGJlemFsYSBqdXN0aWZpa2F0dXRha28ga2FzdWV0YW4gZWRvIGphYmV0emEgaW50ZWxla3R1YWxla28gZXNrdWJpZGVlaSBsb3R1dGEgaGlydWdhcnJlbiBiYXR6dWVuIGVycmVrbGFtYXppb3JpayBqYXNveiBnZXJvLiBCaSBrYXN1ZXRhbiBhdXJyZXRpYXogZXNwcmVzdWtpIGpha2luYXJhemlrbyBkYS4KCgotLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tCgoKTElDRU5DSUEgREUgVVNPIFkgQ0VTScOTTiBERSBERVJFQ0hPUyBOTyBFWENMVVNJVkEgUEFSQSBFTCBERVDDk1NJVE8gREUgTUFURVJJQUxFUyBFTiBFQklMVEVHSUEsIFJFUE9TSVRPUklPIEFCSUVSVE8gREUgTU9ORFJBR09OIFVOSUJFUlRTSVRBVEVBCgpDb21vIGF1dG9yL2EgbyB0aXR1bGFyIGRlIGxvcyBkZXJlY2hvcyBkZSBhdXRvciBkZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBvdG9yZ28gYSBNb25kcmFnb24gVW5pYmVydHNpdGF0ZWEgbGEgYXV0b3JpemFjacOzbiBkZSB1c28geS9vIENFU0nDk04gTk8gRVhDTFVTSVZBLCBncmF0dWl0YSwgY29uIMOhbWJpdG8gbXVuZGlhbCB5IHBvciBlbCBwbGF6byBtw6F4aW1vIGxlZ2FsLCBkZSBsb3MgZGVyZWNob3MgZGUgcmVwcm9kdWNjacOzbiwgZGlzdHJpYnVjacOzbiwgY29tdW5pY2FjacOzbiBww7pibGljYSDigJJpbmNsdWlkbyBlbCBkZXJlY2hvIGRlIHB1ZXN0YSBhIGRpc3Bvc2ljacOzbiBlbGVjdHLDs25pY2HigJIgeSB0cmFuc2Zvcm1hY2nDs24gc29icmUgZGljaG8gbWF0ZXJpYWwsIHBlcm1pdGllbmRvIHBvbmVybG8gYSBkaXNwb3NpY2nDs24gZGUgdGVyY2Vyb3MsIGVuIGxhcyBjb25kaWNpb25lcyBkZSB1c28gcXVlIHNlIGVzdGFibGV6Y2FuIGVuIGxhIGNvcnJlc3BvbmRpZW50ZSBsaWNlbmNpYSBhc29jaWFkYSBhIGRpY2hvIG1hdGVyaWFsIGRlcG9zaXRhZG8uCgpBQ0VQVE8gcXVlIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSBwdWVkYSwgc2luIGFsdGVyYXIgZWwgY29udGVuaWRvLCB0cmFuc2Zvcm1hciBvIGFkYXB0YXIgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBhIGN1YWxxdWllciBvdHJvIGZvcm1hdG8gbyBtZWRpbyBxdWUgcmVzdWx0ZSBuZWNlc2FyaW8gY29uIGZpbmVzIGRlIHByZXNlcnZhY2nDs24uIElndWFsbWVudGUsIEFDRVBUTyBxdWUgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIHB1ZWRhIGd1YXJkYXIgbcOhcyBkZSB1bmEgY29waWEgZGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8gYSBmaW4gZGUgcmVhbGl6YXIgY29waWFzIGRlIHNlZ3VyaWRhZCB5IHByZXNlcnZhciBlbCBtYXRlcmlhbCBwYXJhIGVsIGZ1dHVyby4KCkFTRUdVUk8geSBHQVJBTlRJWk8gcXVlIGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8gZXMgdW5hIG9icmEgb3JpZ2luYWwgZGUgbWkgY3JlYWNpw7NuLCBzb2JyZSBsYSBxdWUgb3N0ZW50byBsYSB0aXR1bGFyaWRhZCBkZSBkZXJlY2hvcyBkZSBhdXRvciBuZWNlc2FyaWEgcGFyYSBvdG9yZ2FyIGxhIGNlc2nDs24gY29udGVuaWRhIGVuIGxhIHByZXNlbnRlIExpY2VuY2lhLgoKRW4gY2FzbyBkZSBjb3RpdHVsYXJpZGFkIGFkbWl0byBjb250YXIgY29uIGVsIGNvbnNlbnRpbWllbnRvIGRlIGxvcyByZXN0YW50ZXMgdGl0dWxhcmVzIHBhcmEgb3RvcmdhciBsYSBwcmVzZW50ZSBMaWNlbmNpYS4gRW4gY2FzbyBkZSBwcmV2aWEgY2VzacOzbiBkZSBkZXJlY2hvcyBhIHRlcmNlcm9zLCBBU0VHVVJPIGNvbnRhciBjb24gc3UgYXV0b3JpemFjacOzbiBvIHJldGVuZ28gbGEgZmFjdWx0YWQgZGUgaGFjZXIgdXNvIGRlIGVzdG9zIGRlcmVjaG9zIGVuIGxhIGZvcm1hIHByZXZpc3RhIGVuIGxhIHByZXNlbnRlIGxpY2VuY2lhLgoKRW4gZWwgY2FzbyBkZSBxdWUgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBjb250dXZpZXJhIG90cm8gbWF0ZXJpYWwgZGVsIHF1ZSBubyBzb3kgZWwvbGEgdGl0dWxhciBkZSBsb3MgZGVyZWNob3MgZGUgYXV0b3IsIEFTRUdVUk8geSBHQVJBTlRJWk8gaGFiZXIgb2J0ZW5pZG8gbGEgcHJldmlhIGF1dG9yaXphY2nDs24gZGVsIGNvcnJlc3BvbmRpZW50ZSB0aXR1bGFyIHF1ZSBtZSBwZXJtaXRlIG90b3JnYXIgbGEgcHJlc2VudGUgTGljZW5jaWEgeSwgZGVsIG1pc21vIG1vZG8sIEFTRUdVUk8geSBHQVJBTlRJWk8gcXVlIGVuIGVsIGNvbnRlbmlkbyBkZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBxdWVkYSBjb3JyZWN0YW1lbnRlIGlkZW50aWZpY2FkbyB5IHJlY29ub2NpZG8gZWwgZGljaG8gdGl0dWxhciBkZSBkZXJlY2hvIGRlIGF1dG9yLgoKRW4gZGVmaW5pdGl2YSwgQVNFR1VSTyB5IEdBUkFOVElaTyBxdWUgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBlbiBlQmlsdGVnaWEgTk8gSU5GUklOR0UgZGVyZWNobyBhbGd1bm8gZGUgdGVyY2Vyb3MsIHlhIHNlYSBkZSBwcm9waWVkYWQgaW50ZWxlY3R1YWwgbyBpbmR1c3RyaWFsLCBkZXJlY2hvIGFsIGhvbm9yLCBhIGxhIGludGltaWRhZCB5IGEgbGEgaW1hZ2VuLCBvIGN1YWxxdWllciBvdHJvIGRlcmVjaG8uCgpFbiBlbCBjYXNvIGRlIHF1ZSBlbCBtYXRlcmlhbCBkZXBvc2l0YWRvIGVzdMOpIGJhc2FkbyBlbiB1bmEgaW52ZXN0aWdhY2nDs24gZmluYW5jaWFkYSBwb3IgYWxndW5hIGFnZW5jaWEgdSBvcmdhbmlzbW8gZGlzdGludG8gZGUgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhLCBBU0VHVVJPIHkgR0FSQU5USVpPIGhhYmVyIGN1bXBsaWRvIGNvbiB0b2RhcyBsYXMgb2JsaWdhY2lvbmVzIHJlcXVlcmlkYXMgcG9yIGVsIGNvbnRyYXRvIG8gYWN1ZXJkbyBmaXJtYWRvIGNvbiBkaWNobyBvcmdhbmlzbW8uCgpNb25kcmFnb24gVW5pYmVydHNpdGF0ZWEgYWRxdWllcmUgZWwgY29tcHJvbWlzbyBkZSBpZGVudGlmaWNhcnRlIGNvbW8gYXV0b3IvYSBvIHRpdHVsYXIgZGUgZGVyZWNob3MgZGUgYXV0b3IgZGVsIG1hdGVyaWFsIGRlcG9zaXRhZG8sIHkgbm8gZWZlY3R1YXLDoSBtw6FzIGFsdGVyYWNpb25lcyBlbiBkaWNobyBtYXRlcmlhbCBxdWUgbGFzIGV4cHJlc2FtZW50ZSBwZXJtaXRpZGFzIGVuIGVzdGEgTGljZW5jaWEuCgpDb21vIGF1dG9yL2EgbyB0aXR1bGFyIGRlIGRlcmVjaG9zIGRlIGF1dG9yIGRlbCBtYXRlcmlhbCBkZXBvc2l0YWRvIHB1ZWRlcyBzb2xpY2l0YXIgbGEgcmV0aXJhZGEgZGUgbGEgb2JyYSBkZSBlQmlsdGVnaWEgcG9yIGNhdXNhIGp1c3RpZmljYWRhLiBQYXJhIGVsbG8gZGViZXLDoXMgcG9uZXJzZSBlbiBjb250YWN0byBjb24gbGFzIHBlcnNvbmFzIHJlc3BvbnNhYmxlcyBkZWwgbWlzbW8uCgpEZSBpZ3VhbCBtb2RvLCBlQmlsdGVnaWEgcG9kcsOhIHJldGlyYXIgZWwgbWF0ZXJpYWwgZGVwb3NpdGFkbyBlbiBzdXB1ZXN0b3Mgc3VmaWNpZW50ZW1lbnRlIGp1c3RpZmljYWRvcyBvIGVuIGNhc28gZGUgcmVjbGFtYWNpb25lcyBkZSB0ZXJjZXJvcyByZWxhdGl2YXMgYSBsb3MgZGVyZWNob3MgZGUgcHJvcGllZGFkIGludGVsZWN0dWFsLiBFbiBhbWJvcyBzdXB1ZXN0b3MgZXhpc3RpcsOhIHVuYSBub3RpZmljYWNpw7NuIGV4cHJlc2EgcHJldmlhLgoKCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KCgpOT04tRVhDTFVTSVZFIExJQ0VOQ0UgRk9SIFRIRSBVU0UgQU5EIEFTU0lHTk1FTlQgT0YgUklHSFRTIEZPUiBTVUJNSVNTSU9OUyBUTyBFQklMVEVHSUEsIFRIRSBPUEVOIFJFUE9TSVRPUlkgT0YgTU9ORFJBR09OIFVOSUJFUlRTSVRBVEVBCgpBcyB0aGUgYXV0aG9yIG9yIGhvbGRlciBvZiB0aGUgY29weXJpZ2h0IG9mIHRoZSBzdW1pdHRlZCBtYXRlcmlhbCwgSSBoZXJlYnkgZ3JhbnQgTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIHRoZSBOT04tRVhDTFVTSVZFIGF1dGhvcmlzYXRpb24gdG8gdXNlIGFuZC9vciBBU1NJR04sIGZyZWUgb2YgY2hhcmdlLCB3b3JsZHdpZGUgYW5kIGZvciB0aGUgbWF4aW11bSBsZWdhbCB0ZXJtLCB0aGUgcmlnaHRzIHRvIHJlcHJvZHVjZSwgZGlzdHJpYnV0ZSwgcHVibGlzaCDigJIgaW5jbHVkaW5nIHRoZSByaWdodCB0byBtYWtlIGl0IGF2YWlsYWJsZSBpbiBlbGVjdHJvbmljIGZvcm1hdCDigJIgYW5kIGNvbnZlcnQgc3VjaCBtYXRlcmlhbCwgYWxsb3dpbmcgaXQgdG8gYmUgbWFkZSBhdmFpbGFibGUgdG8gdGhpcmQgcGFydGllcywgc3ViamVjdCB0byB0aGUgdGVybXMgb2YgdXNlIHNldCBmb3J0aCBpbiB0aGUgcmVzcGVjdGl2ZSBsaWNlbmNlIGFzc29jaWF0ZWQgd2l0aCB0aGUgc3VibWl0dGVkIG1hdGVyaWFsLgoKSSBoZXJlYnkgQVVUSE9SSVNFIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSB0byBjb252ZXJ0IG9yIGFkYXB0IHRoZSBzdWJtaXR0ZWQgbWF0ZXJpYWwgdG8gYW55IG90aGVyIGZvcm1hdCBvciBtZWRpdW0gdGhhdCBtYXkgYmUgbmVjZXNzYXJ5IGZvciB0aGUgcHVycG9zZSBvZiBpdHMgcHJlc2VydmF0aW9uLCB3aXRob3V0IGNoYW5naW5nIGl0cyBjb250ZW50LiBJIGFsc28gQVVUSE9SSVNFIE1vbmRyYWdvbiBVbmliZXJ0c2l0YXRlYSB0byBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGUgc3VibWl0dGVkIG1hdGVyaWFsIHNvIHRoYXQgaXQgbWF5IG1ha2UgYmFjay11cHMgYW5kIHByZXNlcnZlIHRoZSBtYXRlcmlhbCBmb3IgdGhlIGZ1dHVyZS4KCkkgV0FSUkFOVCBhbmQgUkVQUkVTRU5UIHRoYXQgdGhlIG1hdGVyaWFsIHN1Ym1pdHRlZCBpcyBhbiBvcmlnaW5hbCB3b3JrIGNyZWF0ZWQgYnkgbWUsIGFuZCBJIGhvbGQgdGhlIG5lY2Vzc2FyeSBjb3B5cmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0IG9mIGFzc2lnbm1lbnQgY29udGFpbmVkIGluIHRoaXMgTGljZW5jZS4KCkluIHRoZSBldmVudCBvZiBqb2ludCBvd25lcnNoaXAgb2YgYXV0aG9y4oCZcyByaWdodHMsIEkgd2FycmFudCB0aGF0IEkgaGF2ZSB0aGUgY29uc2VudCBvZiB0aGUgb3RoZXIgY29weXJpZ2h0IGhvbGRlcnMgdG8gZ3JhbnQgdGhpcyBMaWNlbmNlLiBJbiB0aGUgZXZlbnQgb2YgYW55IHByaW9yIGFzc2lnbm1lbnQgb2YgdGhlIHJpZ2h0cyB0byB0aGlyZCBwYXJ0aWVzLCBJIFdBUlJBTlQgdGhhdCBJIGhhdmUgdGhlaXIgYXV0aG9yaXNhdGlvbiBvciBzdGlsbCBoYXZlIHRoZSBmYWN1bHR5IHRvIHVzZSB0aGVzZSByaWdodHMgaW4gdGhlIG1hbm5lciBzZXQgZm9ydGggaW4gdGhpcyBsaWNlbmNlLgoKSWYgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCBjb250YWlucyBhbnkgb3RoZXIgbWF0ZXJpYWwgZm9yIHdoaWNoIEkgZG8gbm90IGhvbGQgdGhlIGNvcHlyaWdodCwgSSBXQVJSQU5UIGFuZCBSRVBSRVNFTlQgdGhhdCBJIGhhdmUgb2J0YWluZWQgdGhlIHByaW9yIGF1dGhvcmlzYXRpb24gb2YgdGhlIHJlc3BlY3RpdmUgY29weXJpZ2h0IGhvbGRlciwgd2hpY2ggZW5hYmxlcyBtZSB0byBncmFudCB0aGlzIExpY2VuY2UgYW5kLCBzaW1pbGFybHksIEkgV0FSUkFOVCBhbmQgUkVQUkVTRU5UIHRoYXQgaW4gdGhlIGNvbnRlbnQgb2YgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCwgdGhlIGNvcHlyaWdodCBob2xkZXIgaXMgZHVseSBpZGVudGlmaWVkIGFuZCBhY2tub3dsZWRnZWQuCgpJbiBzaG9ydCwgSSBXQVJSQU5UIEFORCBSRVBSRVNFTlQgdGhhdCB0aGUgbWF0ZXJpYWwgc3VibWl0dGVkIHRvIGVCaWx0ZWdpYSBET0VTIE5PVCBJTkZSSU5HRSBhbnkgdGhpcmQtcGFydHkgcmlnaHRzLCB3aGV0aGVyIHJlbGF0ZXMgdG8gaW50ZWxsZWN0dWFsIG9yIGluZHVzdHJpYWwgcHJvcGVydHksIHJpZ2h0IHRvIGhvbm91ciwgcHJpdmFjeSBvciBzZWxmLWltYWdlLCBvciBhbnkgb3RoZXIgcmlnaHQuCgpJZiB0aGUgc3VibWl0dGVkIG1hdGVyaWFsIGlzIGJhc2VkIHVwb24gcmVzZWFyY2ggc3BvbnNvcmVkIG9yIHN1cHBvcnRlcyBieSBhbnkgYWdlbmN5IG9yIGluc3RpdHV0aW9uIG90aGVyIHRoYW4gTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhLCBJIFdBUlJBTlQgQU5EIFJFUFJFU0VOVCB0aGF0IEkgaGF2ZSBmdWxmaWxsZWQgYWxsIG9ibGlnYXRpb25zIHJlcXVpcmVkIGJ5IHRoZSBjb250cmFjdCBvciBhZ3JlZW1lbnQgc2lnbmVkIHdpdGggdGhlIGluc3RpdHV0aW9uLgoKTW9uZHJhZ29uIFVuaWJlcnRzaXRhdGVhIGhlcmVieSBhZ3JlZXMgdG8gaWRlbnRpZnkgeW91IGFzIHRoZSBhdXRob3Igb3IgaG9sZGVyIG9mIHRoZSBjb3B5cmlnaHQgb2YgdGhlIHN1Ym1pdGVkIG1hdGVyaWFsLCBhbmQgaXQgc2hhbGwgbWFrZSBubyBjaGFuZ2VzIHRvIHRoYXQgbWF0ZXJpYWwgb3RoZXIgdGhhbiB0aG9zZSBleHByZXNzbHkgcGVybWl0dGVkIGJ5IHRoaXMgTGljZW5jZS4KCkFzIHRoZSBhdXRob3Igb3IgaG9sZGVyIG9mIHRoZSBjb3B5cmlnaHQgZm9yIHRoZSBzdWJtaXR0ZWQgbWF0ZXJpYWwsIHlvdSBtYXkgcmVxdWVzdCB0aGF0IHRoZSB3b3JrIGlzIHJlbW92ZWQgZnJvbSBlQmlsdGVnaWEgaWYgdGhlcmUgaXMgZ29vZCBjYXVzZS4gSW4gc3VjaCBhbiBldmVudCwgeW91IG11c3QgY29udGFjdCB0aGUgcGVyc29ucyByZXNwb25zaWJsZSBmb3IgZG9pbmcgdGhpcy4KClNpbWlsYXJseSwgZUJpbHRlZ2lhIG1heSByZW1vdmUgdGhlIHN1Ym1pdHRlZCBtYXRlcmlhbCB3aGVuIHRoZXJlIGlzIGdvb2QgY2F1c2Ugb3IgaW4gdGhlIGV2ZW50IG9mIHRoaXJkLXBhcnR5IGNsYWltcyByZWdhcmRpbmcgaW50ZWxsZWN0dWFsIHByb3BlcnR5IHJpZ2h0cy4gSW4gYm90aCBjYXNlcywgZXhwcmVzcyBwcmlvciBub3RpZmljYXRpb24gc2hhbGwgYmUgZ2l2ZW4uCg== URL http://ebiltegia.mondragon.edu/xmlui/bitstream/20.500.11984/6898/1/Novel%20automated%20interactive%20reinforcement%20learning%20framework%20with%20a%20constraint-based%20supervisor%20for%20procedural%20tasks.pdf File MD5 014a114a54c0bba21dd718268acac337 2771932 application/pdf Novel automated interactive reinforcement learning framework with a constraint-based supervisor for procedural tasks.pdf URL http://ebiltegia.mondragon.edu/xmlui/bitstream/20.500.11984/6898/4/Novel%20automated%20interactive%20reinforcement%20learning%20framework%20with%20a%20constraint-based%20supervisor%20for%20procedural%20tasks.pdf.txt File MD5 46f09cfa6fe31ed27a53bc91ea4ba1d1 95994 text/plain Novel automated interactive reinforcement learning framework with a constraint-based supervisor for procedural tasks.pdf.txt