Challenges of Remote XR Experimentation: Balancing the Trade-Offs for a Successful Remote Study

Abstract

In recent years, accelerated by the worldwide pandemic, remote research has become of critical interest to the research community. Although remote experimentation is not a novel topic in Human-Computer Interaction, there is a lack of a unified model and procedural knowledge on how to prepare and conduct remote experiments, particularly when incorporating complex, state-of-the-art technologies like Extended Reality. To address this, we reflect on three remote mixed methods experiments, conducted during the pandemic. Drawing from our lessons learned, we aim to share our insights and enrich the existing literature on preparing for remote experimentation and mitigating its limitations. We introduce the concept of reverse remote moderation and contribute further by outlining the dimensions of control in remote experimentation and categorizing the associated challenges, thereby advancing the future of remote experimentation in the after-covid time.