Head-Worn Markerless Augmented Reality Inside a Moving Vehicle

Abstract

This paper describes a system that provides general head-worn outdoor augmented reality (AR) capability for the user inside a moving vehicle. Our system follows the concept of combining pose estimation from both vehicle navigation system and wearable sensors to address the failure of commercial AR devices inside a moving vehicle. We continuously match natural visual features from the camera against a prebuilt database of interior vehicle scenes. To improve the robustness in a moving vehicle with other passengers, a human detection module is adapted to filter out people from the camera scene. Experiments demonstrate the effectiveness of the proposed solution.

 Keywords: Visualization, Three-dimensional displays, Conferences, Pose estimation, User interfaces, Cameras, Robustness.