Discovering Action Idioms: Bridging the Gap between System-Level Events and Human-Level Actions

Citation

Gervasio, M., & Lee, T. J. (2013, 15-19 September). Discovering action idioms: bridging the gap between system-level events and human-level actions. Paper presented at the IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC ’13), San Jose, CA.

Abstract

As computing devices become more pervasive in our daily lives, effective communication between the user and the system becomes increasingly important. The ability to describe actions at a human level of abstraction is key. However, the level at which computer system events is most easily captured is often well below the level at which humans conceptualize actions. We present a sequential pattern mining approach to discovering human-level actions-action idioms – from instrumentation logs of lower-level events. To support validation by a human expert, idiom discovery is designed to maximize recall, with filtering heuristics applied to help eliminate false positives. Empirical evaluation on data from a fielded application shows the promise of the approach for the automatic discovery of action idioms.


Read more from SRI

  • Banner and attendees at the IEEE Hard Tech Venture Summit

    Cultivating hard tech startups that scale

    IEEE’s Hard Tech Venture Summit convened innovators at SRI to refine strategies and build new networks.

  • Patient going into a MRI

    Bringing surgical tools inside the MRI

    Drawing on SRI’s unique innovation ecosystem, the startup Medical Devices Corner is seeking to improve cancer surgery by advancing MRI-safe teleoperation.

  • Christopher Mims and Susan Patrick

    PARC Forum: How to AI

    The Wall Street Journal tech columnist Christopher Mims and SRI Education’s Susan Patrick discuss how AI can strengthen human agency.