Paper at UIST 2025: Perceptual Manipulations in Augmented Reality

In 2025, I published my first full paper, at the UIST 2025 conference in Busan, South Korea. At the conference, I then presented it in my first paper talk. Additionally, I showcased the project in a demo, both at UIST 2025 and ISMAR 2025 (Daejeon, South Korea). You can find the abstract, the full paper, and more information below.

Abstract

Perceptual manipulations (PMs) like redirected walking (RDW) are frequently applied in Virtual Reality (VR) to overcome technological limitations. These PMs manipulate the user’s visual perceptions (e.g. through rotational gains), which is currently challenging in Augmented Reality (AR). We propose SwitchAR, a PM for video pass-through AR leveraging change and inattentional blindness to imperceptibly switch between the camera stream of the real environment and a 3D reconstruction. This enables perceptual manipulations in what users still perceive as AR. We present our pipeline consisting of (1) Reconstruction, (2) Switch (AR -> VR), (3) PM and (4) Switch (VR -> AR), and discuss its challenges and our solutions. In a user study (n=20), we found that no participant noticed the switch and only one the PM. Additionally, despite revealing that a manipulation happened, participants could not detect the switch in a consecutive run. SwitchAR is a fundamental basis enabling AR PMs.

Find out more

Paper PDF DOI Video Preview (30 s) Video Figure (5 min)

Embedded reader (paper PDF):