Zhiwei Zhu, Mikhail Sizintsev, Glenn Murray, Han-Pang Chiu, Ali Chaudhry, Supun Samarasekera, Rakesh Kumar, Head-Worn Markerless Augmented Reality Inside a Moving Vehicle, IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2022.
This paper describes a system that provides general head-worn outdoor augmented reality (AR) capability for the user inside a moving vehicle. Our system follows the concept of combining pose estimation from both vehicle navigation system and wearable sensors to address the failure of commercial AR devices inside a moving vehicle. We continuously match natural visual features from the camera against a prebuilt database of interior vehicle scenes. To improve the robustness in a moving vehicle with other passengers, a human detection module is adapted to filter out people from the camera scene. Experiments demonstrate the effectiveness of the proposed solution.