Global Heading Estimation for Wide Area Augmented Reality Using Road Semantics for Geo-referencing

,

Citation

T. Oskiper, S. Samarasekera and R. Kumar, “Global Heading Estimation For Wide Area Augmented Reality Using Road Semantics For Geo-referencing,” 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2021, pp. 427-428, doi: 10.1109/ISMAR-Adjunct54149.2021.00096.

Abstract

In this paper, we present a method to estimate global camera heading by associating directional information from road segments in the camera view with annotated satellite imagery. The system is based on a multi-sensor fusion framework that relies on GPS, camera and an inertial measurement unit (IMU). The backbone of the system is built on a very strong visual-inertial navigation (VIO) pipeline with very low drift rate and the proposed algorithm combines relative motion provided by VIO with global cues obtained by an image segmentation module to extract heading information for geo-referenced AR applications over wide area.

Keywords: Image segmentation, Visualization, Satellites, Measurement units, Head, Roads, Semantics.


Read more from SRI

  • Banner and attendees at the IEEE Hard Tech Venture Summit

    Cultivating hard tech startups that scale

    IEEE’s Hard Tech Venture Summit convened innovators at SRI to refine strategies and build new networks.

  • Patient going into a MRI

    Bringing surgical tools inside the MRI

    Drawing on SRI’s unique innovation ecosystem, the startup Medical Devices Corner is seeking to improve cancer surgery by advancing MRI-safe teleoperation.

  • Christopher Mims and Susan Patrick

    PARC Forum: How to AI

    The Wall Street Journal tech columnist Christopher Mims and SRI Education’s Susan Patrick discuss how AI can strengthen human agency.