Head-Worn Markerless Augmented Reality Inside a Moving Vehicle

, ,


Zhiwei Zhu, Mikhail Sizintsev, Glenn Murray, Han-Pang Chiu, Ali Chaudhry, Supun Samarasekera, Rakesh Kumar, Head-Worn Markerless Augmented Reality Inside a Moving Vehicle, IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2022.


This paper describes a system that provides general head-worn outdoor augmented reality (AR) capability for the user inside a moving vehicle. Our system follows the concept of combining pose estimation from both vehicle navigation system and wearable sensors to address the failure of commercial AR devices inside a moving vehicle. We continuously match natural visual features from the camera against a prebuilt database of interior vehicle scenes. To improve the robustness in a moving vehicle with other passengers, a human detection module is adapted to filter out people from the camera scene. Experiments demonstrate the effectiveness of the proposed solution.

 Keywords: Visualization, Three-dimensional displays, Conferences, Pose estimation, User interfaces, Cameras, Robustness.

Read more from SRI