Cognition in Multisensory Virtual Reality: A Systematic Literature Review

Abstract

Virtual technologies have revolutionized information systems by enabling the digitalization, substitution, augmentation, and modification of human senses. Despite growing attention, it remains unclear whether and how sensory perception in multimodal virtual environments impacts cognitive functions, such as information processing, memory, and knowledge creation. To provide a clearer understanding of the current state-of-the-art research, this systematic literature review investigates cognition in multisensory virtual realities (VRs), analysing 142 empirical studies in the interdisciplinary fields of information systems, human-computer interaction, and cognitive psychology. The review identifies methodological practices, cognitive domains, and senses measured or manipulated in VR research. Most importantly, it synthesizes and discusses empirical results based on identified cognitive themes. The review concludes by summarizing the core findings and identifying six agendas for future directions of multisensory research in virtual information systems and cognition.