Segmenting Reactions to Improve the Behavior of a Planning/Reacting Agent

Citation

Wolverton, M. and Washington, R. Segmenting Reactions to Improve the Behavior of a Planning/Reacting Agent, in Proceedings of the Third International Conference on Artificial Intelligence Planning Systems (AIPS-96), May 1996.

Abstract

An agent operating in a real-world environment will inevitably encounter some events that demand very quick response—the deadline for an action is short, and the consequences of not acting are high. For these types of events, the agent has a better chance of acting appropriately if it has a pre-stored set of reactions that can be quickly retrieved based on features of the situation. In this paper, we examine the problem of selecting the best set of reactions for an agent to store. In particular, we examine the benefit of including *intervals* of reactions—i.e., executing some reactions only across segments of the complete numeric ranges over which they are defined. We present a decision-theoretic algorithm for selecting the optimal set of reaction intervals, and we present experiments with a computer implementation of that algorithm, called KNEEJERK. The experiments show that the benefit of breaking down reactions into intervals is quite high under a wide range of circumstances.


Read more from SRI

  • surgeons around a surgical robot

    The SRI research behind today’s surgical robotics

    Intuitive’s da Vinci 5 system represents a major leap in robotic-assisted medicine. It all started at SRI, which continues to advance teleoperation technologies.

  • a collage of digital graphs

    A banner year for quantum

    SRI-managed QED-C’s annual report on quantum trends captures an industry accelerating rapidly from technical promise toward major global impact.

  • ICE Cube containing SRI’s aerogel experiment, photographed prior to launch. Source: Aerospace Applications North America

    An SRI carbon capture experiment launches into space

    By synthesizing carbon-absorbing aerogels in microgravity, SRI research will give us a rare glimpse into how these materials could be radically improved.