Towards Reliable and Secure Extended Reality (XR) Systems (H.-N. Dai et al.)

Extended reality (XR), including virtual reality (VR) and augmented reality (AR) has been considered as an evolutionary technology to bring an immersive Mixed Reality (MR) experience to users. The boost of XR users has also proliferated the diverse XR apps running on top of heterogeneous XR devices equipped with diverse built-in sensors. However, the proliferation of mobile XR apps has also brought security and privacy concerns, which have become extremely serious since wearable XR devices are deployed unprecedentedly close to human bodies and continually keep tracking sensitive human biometrics. Meanwhile, no effective and efficient tools to guarantee the reliability of XR applications, which have been developed on top of complex XR engines, such as Unity and Unreal Engine.

In this project, we plan to tackle these challenging issues by (1) constructing perception and consciousness mechanisms to effectively detect security vulnerabilities across the entire XR system, (2) proposing a suite of security schemes to enforce effective protection from both hardware and software perspective, and (3) developing adaptive immunity mechanisms to fight against new threats by recent advances in artificial intelligence (AI). The findings in this project will be adopted in XR software companies and the open-source community. Moreover, they will also be extended to new research areas, such as embodied AI and spatial intelligence.


References:


For further information on this research topic, please contact Prof. Hong-Ning Dai.