Global Heading Estimation for Wide Area Augmented Reality Using Road Semantics for Geo-referencing

,

Citation

T. Oskiper, S. Samarasekera and R. Kumar, “Global Heading Estimation For Wide Area Augmented Reality Using Road Semantics For Geo-referencing,” 2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), 2021, pp. 427-428, doi: 10.1109/ISMAR-Adjunct54149.2021.00096.

Abstract

In this paper, we present a method to estimate global camera heading by associating directional information from road segments in the camera view with annotated satellite imagery. The system is based on a multi-sensor fusion framework that relies on GPS, camera and an inertial measurement unit (IMU). The backbone of the system is built on a very strong visual-inertial navigation (VIO) pipeline with very low drift rate and the proposed algorithm combines relative motion provided by VIO with global cues obtained by an image segmentation module to extract heading information for geo-referenced AR applications over wide area.

Keywords: Image segmentation, Visualization, Satellites, Measurement units, Head, Roads, Semantics.

↓ Review online

Read more from SRI

  • surgeons around a surgical robot

    The SRI research behind today’s surgical robotics

    Intuitive’s da Vinci 5 system represents a major leap in robotic-assisted medicine. It all started at SRI, which continues to advance teleoperation technologies.

  • a collage of digital graphs

    A banner year for quantum

    SRI-managed QED-C’s annual report on quantum trends captures an industry accelerating rapidly from technical promise toward major global impact.

  • ICE Cube containing SRI’s aerogel experiment, photographed prior to launch. Source: Aerospace Applications North America

    An SRI carbon capture experiment launches into space

    By synthesizing carbon-absorbing aerogels in microgravity, SRI research will give us a rare glimpse into how these materials could be radically improved.