go-v.orgdoi

Learning to Teach Reinforcement Learning Agents

Anestis Fachantidis, Matthew Taylor, Ioannis Vlahavas · Machine Learning and Knowledge Extraction · 2017

  • DOI 10.3390/make1010002
  • Publisher Multidisciplinary Digital Publishing Institute
  • Type article
  • Issued 2017

Not cached yet. This record was fetched live for this request and is stored after the lookup. Reopening the page should serve the cached copy.

Machine Learning and Knowledge Extraction · Multidisciplinary Digital Publishing Institute · article · 2017

Abstract

In this article, we study the transfer learning model of action advice under a budget. We focus on reinforcement learning teachers providing action advice to heterogeneous students playing the game of Pac-Man under a limited advice budget. First, we examine several critical factors affecting advice quality in this setting, such as the average performance of the teacher, its variance and the importance of reward discounting in advising. The experiments show that the best performers are not always the best teachers and reveal the non-trivial importance of the coefficient of variation (CV) as a statistic for choosing policies that generate advice.

The CV statistic relates variance to the corresponding mean. Second, the article studies policy learning for distributing advice under a budget. Whereas most methods in the relevant literature rely on heuristics for advice distribution, we formulate the problem as a learning one and propose a novel reinforcement learning algorithm capable of learning when to advise or not. The proposed algorithm is able to advise even when it does not have knowledge of the student’s intended action and needs significantly less training time compared to previous learning approaches.

Finally, in this article, we argue that learning to advise under a budget is an instance of a more generic learning problem: Constrained Exploitation Reinforcement Learning.

Open the resolved locator · 10.3390/make1010002

Metadata licence: OpenAlex metadata (CC0)

Registry
OpenAlex DOI index + API
Fetched
2026-11-20 03:24 UTC
Cache state
not cached yet (bulk-index+openalex)
Locator
https://doi.org/10.3390/make1010002
Metadata licence
OpenAlex metadata (CC0)
Scope
Metadata as returned by the resolver; abstracts are never generated here.