Space Probe Retrieval: A LiDAR-Based Augmented Reality Game for Forest Data Collection

Abstract

The addition of LiDAR sensors to consumer smartphones and tablets, such as iPhone 12 and later models, has enabled users to generate and collect point cloud data of their physical environment. This development has opened up opportunities for a playful crowdsourcing approach to gather much-needed environmental data for improving forest planning and management to tackle deforestation and climate change. We present an interactive augmented reality (AR) game designed and developed to guide the user to move their smartphone in a way that (1) yields usable point cloud data and (2) is enjoyable. In the game, the user pilots an alien spacecraft that has come to Earth to retrieve "data collecting units" scattered around the physical environment. Through gameplay, it is possible to record a wide range of data automatically generated by the mobile device, such as point cloud and mesh data of the surrounding environment and the device’s movement. Preliminary testing among the developers in forest environments shows promising findings in terms of both (1) the generated data and (2) the enjoyability of the user experience. We discuss these findings and propose avenues for future research.