Inferring Rewards from Language in Context

AI-generated keywords: Inferring rewards Language pragmatics FLIGHTPREF dataset Amazon Mechanical Turk Effective communication

AI-generated Key Points

  • Researchers conducted a study on inferring rewards from language in instruction following
  • They developed a model that maps language to actions and considers the underlying reward function
  • The model was tested on a flight-booking task with natural language and accurately inferred rewards and predicted optimal actions in unseen environments
  • Data collection involved recruiting Amazon Mechanical Turk workers to play games with different reward functions
  • Collected utterances exhibited a range of phenomena, with some users focusing on specific features of options while others described their reward function comprehensively
  • The pragmatic model relied on base listener and speaker models implemented for the FLIGHTPREF dataset
  • Evaluation set consisted of games where effective communication between speaker and listener was observed
  • The study demonstrated that inferring rewards from language pragmatically improves understanding user preferences and carrying out desirable actions in new contexts.
Also access our AI generated: Comprehensive summary, Lay summary, Blog-like article; or ask questions about this paper to our AI assistant.

Authors: Jessy Lin, Daniel Fried, Dan Klein, Anca Dragan

ACL 2022. Code and dataset: https://github.com/jlin816/rewards-from-language
License: CC BY 4.0

Abstract: In classic instruction following, language like "I'd like the JetBlue flight" maps to actions (e.g., selecting that flight). However, language also conveys information about a user's underlying reward function (e.g., a general preference for JetBlue), which can allow a model to carry out desirable actions in new contexts. We present a model that infers rewards from language pragmatically: reasoning about how speakers choose utterances not only to elicit desired actions, but also to reveal information about their preferences. On a new interactive flight-booking task with natural language, our model more accurately infers rewards and predicts optimal actions in unseen environments, in comparison to past work that first maps language to actions (instruction following) and then maps actions to rewards (inverse reinforcement learning).

Submitted to arXiv on 05 Apr. 2022

Ask questions about this paper to our AI assistant

You can also chat with multiple papers at once here.

AI assistant instructions?

Results of the summarizing process for the arXiv paper: 2204.02515v1

The researchers conducted a study on inferring rewards from language in the context of instruction following. They developed a model that not only maps language to actions but also considers the underlying reward function conveyed by the language. The model was tested on a flight-booking task with natural language, where it accurately inferred rewards and predicted optimal actions in unseen environments. The data collection process involved recruiting Amazon Mechanical Turk workers to play games with different reward functions. The collected utterances exhibited a range of phenomena, with some users focusing on specific features of options while others attempted to describe their reward function as comprehensively as possible. The pragmatic model relied on base listener and speaker models, which were implemented for the FLIGHTPREF dataset. To evaluate the model, the researchers used an evaluation set consisting of games where effective communication between the speaker and listener was observed. This allowed them to measure how well their model could infer user preferences from language and carry out desirable actions in new contexts. Overall, the study demonstrated that inferring rewards from language pragmatically can lead to improved performance in understanding user preferences and carrying out desirable actions in new contexts.
Created on 30 Sep. 2023

Assess the quality of the AI-generated content by voting

Score: 0

Why do we need votes?

Votes are used to determine whether we need to re-run our summarizing tools. If the count reaches -10, our tools can be restarted.

The previous summary was created more than a year ago and can be re-run (if necessary) by clicking on the Run button below.

Similar papers summarized with our AI tools

Navigate through even more similar papers through a

tree representation

Look for similar papers (in beta version)

By clicking on the button above, our algorithm will scan all papers in our database to find the closest based on the contents of the full papers and not just on metadata. Please note that it only works for papers that we have generated summaries for and you can rerun it from time to time to get a more accurate result while our database grows.

Disclaimer: The AI-based summarization tool and virtual assistant provided on this website may not always provide accurate and complete summaries or responses. We encourage you to carefully review and evaluate the generated content to ensure its quality and relevance to your needs.