Virtual reality as narrative medium: the emotional effects of full immersion in VR-based film Aladin
DOI:
https://doi.org/10.64595/lingtech.v1i1.29Keywords:
emotional engagement, heart rate, physiological responses, virtual reality, visual storytellingAbstract
Background: Virtual Reality (VR) has emerged as a transformative medium, offering immersive storytelling experiences compared to traditional 2D films. Objective: This study aims to compare emotional and physiological responses elicited by Virtual Reality (VR) and Youtube (YT) versions of Aladin: Escape the Cave of Wonders. Method: Using a mixed-methods approach, emotional data were collected through PANAS (Positive and Negative Affect Schedule), while physiological responses such as skin temperature (SKT), heart rate (HR), and respiratory patterns were recorded. Results: Results indicate that VR elicits stronger emotional engagement, with significant increases in negative affect (e.g., fear and nervousness) and higher HR compared to YT films. Scene-specific analyses reveal that immersive environments amplify emotions during intense scenes, supported by physiological markers of heightened arousal. Implication: This research advances the understanding of how immersive media like VR can redefine narrative engagement, with implications for fields ranging from media psychology to digital storytelling. Novelty: This study underscores VR’s potential as a narrative medium and provides insights into its application for enhancing audience engagement across genres.
Downloads
References
Abdou, N., Dzhamalova, M., Désirée, S., Goff, T. L., Mesz, B., & Sakdavong, J.-C. (2024). The Mediating Effect of Presence on Musical Emotions in Virtual Environments. 15030 LNCS, 3–20. https://doi.org/10.1007/978-3-031-71713-0_1
Abdullah, F., Yang, C., Paliyawan, P., Thawonmas, R., Harada, T., & Bachtiar, F. A. (2019). Promoting Emotions with Angry Birds-like Gameplay on Rube Goldberg Machine Levels. 149–150. https://doi.org/10.1109/ICCE-Asia46551.2019.8941596
Adetunla, A., Akinlabi, E., Jen, T. C., Okokpujie, I. P., & Ajibade, S.-S. (2024). A review on the Challenges and Prospects in Harnessing Virtual Reality in Education. International Conference on Science, Engineering and Business for Driving Sustainable Development Goals, SEB4SDG 2024. https://doi.org/10.1109/SEB4SDG60871.2024.10630094
Bayro, A., Buneo, C., & Jeong, H. (2023). Emotion Recognition in Virtual Reality: Investigating the Effect of Gameplay Variations on Affective Responses. 67(1), 1516–1517. https://doi.org/10.1177/21695067231192600
Blackford, E. B., Estepp, J. R., Piasecki, A. M., Bowers, M. A., & Klosterman, S. L. (2016). Long-range non-contact imaging photoplethysmography: Cardiac pulse wave sensing at a distance. 9715. https://doi.org/10.1117/12.2208130
Cabioch, T., Champagnat, R., Bosser, A.-G., Chiganne, J.-N., & Dieguez, M. (2019). Timing interactive narratives. 2019-August. https://doi.org/10.1109/CIG.2019.8847967
Carpio, R., Baumann, O., & Birt, J. (2023). Evaluating the viewer experience of interactive virtual reality movies. Virtual Reality, 27(4), 3181–3190. https://doi.org/10.1007/s10055-023-00864-2
Chirico, A., & Gaggioli, A. (2019). When Virtual Feels Real: Comparing Emotional Responses and Presence in Virtual and Natural Environments. Cyberpsychology, Behavior, and Social Networking, 22(3), 220–226. https://doi.org/10.1089/cyber.2018.0393
Diemer, J., Kothgassner, O. D., Herrmann, M. J., & Zwanzger, P. (2024). VR-supported therapy for anxiety and posttraumatic stress disorder: Current possibilities and limitations. Nervenarzt, 95(3), 223–229. https://doi.org/10.1007/s00115-023-01570-9
Ding, N., Zhou, W., & Fung, A. Y. H. (2018). Emotional effect of cinematic VR compared with traditional 2D film. Telematics and Informatics, 35(6), 1572–1579. https://doi.org/10.1016/j.tele.2018.04.003
Fawzy, R. M. (2024). VR as a metaleptic possible world of global citizenship embodiment: A cognitive stylistic approach. Digital Scholarship in the Humanities, 39(1), 124–141. https://doi.org/10.1093/llc/fqad078
Fernández, D. T., Moya, E. B., & Sánchez, R. P. (2021). Immersion and emotional arousal with virtual reality videogames. Revista de Psicologia (Peru), 39(2), 531–551. https://doi.org/10.18800/PSICO.202102.002
Gallai, B., Miranda, L., Mele, C., & Rega, A. (2024). Virtual Reality and ADHD: a review of literature. 3751, 26–30. https://doi.org/10.3345/kjp.2017.60.11.337
Garrett, B., Taverner, T., Gromala, D., Tao, G., Cordingley, E., & Sun, C. (2018). Virtual reality clinical research: Promises and challenges. JMIR Serious Games, 6(4). https://doi.org/10.2196/10839
Gioia, F., Nardelli, M., Scilingo, E. P., & Greco, A. (2023). Autonomic Regulation of Facial Temperature during Stress: A Cross-Mapping Analysis. Sensors, 23(14). https://doi.org/10.3390/s23146403
He, E., Lin, J., Liu, Z., & Zhang, Y. (2021). Research on Perceptual Cues of Interactive Narrative in Virtual Reality. 12765 LNCS, 283–296. https://doi.org/10.1007/978-3-030-78321-1_22
Helle, N., Vikman, M. D., Dahl-Michelsen, T., & Lie, S. S. (2023). Health Care and Social Work Students’ Experiences With a Virtual Reality Simulation Learning Activity: Qualitative Study. JMIR Medical Education, 9. https://doi.org/10.2196/49372
Irshad, S., & Perkis, A. (2020). Increasing User Engagement in Virtual Reality:The Role of Interactive Digital Narratives to Trigger Emotional Responses. ACM International Conference Proceeding Series. https://doi.org/10.1145/3419249.3421246
Kelly, R. (2021). The Universe of You: Using Remote VR to Improve Psychoeducation Through Spatial Presence, Attention Allocation, and Interaction. In Play Therapy and Telemental Health: Foundations, Populations, and Interventions (pp. 229–239). https://doi.org/10.4324/9781003166498-15
Kim, A., Chang, M., Choi, Y., Jeon, S., & Lee, K. (2018). The Effect of Immersion on Emotional Responses to Film Viewing in a Virtual Environment. 601–602. https://doi.org/10.1109/VR.2018.8446046
Kim, C. J., & Chang, M.-H. (2016). Actual Emotion and False Emotion Classification by Physiological Signal. 21–24. https://doi.org/10.1109/SIP.2015.17
Kim, Y. E., & Khajavi, M. J. (2024). Exploring the Viewer’s Role in Narrative-Based Animated Virtual Reality Experiences: Strategies for Role Activation and Immersive Storytelling. Animation, 19(2–3), 101–128. https://doi.org/10.1177/17468477241281635
Klotzsche, F., Mariola, A., Hofmann, S., Nikulin, V. V., Villringer, A., & Gaebler, M. (2018). Using EEG to Decode Subjective Levels of Emotional Arousal during an Immersive VR Roller Coaster Ride. 605–606. https://doi.org/10.1109/VR.2018.8446275
Kreibig, S. D. (2010). Autonomic nervous system activity in emotion: A review. Biological Psychology, 84(3), 394–421. https://doi.org/10.1016/j.biopsycho.2010.03.010
Krishna, A. P. V., Satheesh, A., Abhishek, N. M., Menon, H. P., & Devasia, D. (2023). Application of Virtual Reality (VR) to Advance Social Ability in Children with ASD. 1581–1586. https://doi.org/10.1109/ICACRS58579.2023.10404594
Kroczek, L. O. H., Pfaller, M., Lange, B., Müller, M., & Mühlberger, A. (2020). Interpersonal Distance During Real-Time Social Interaction: Insights From Subjective Experience, Behavior, and Physiology. Frontiers in Psychiatry, 11. https://doi.org/10.3389/fpsyt.2020.00561
Kujur, A., Khan, S. H., & Kumar, J. (2022). EVALUATING LEARNING EXPERIENCE AND EMOTIONAL TRIGGERS OF VIRTUAL LEARNING ENVIRONMENTS (VLES) USING PSYCHOGALVANIC REFLEXES AND BEHAVIOURAL ANALYSIS. Proceedings of the 24th International Conference on Engineering and Product Design Education: Disrupt, Innovate, Regenerate and Transform, E and PDE 2022. https://doi.org/10.35199/EPDE.2022.77
Martínez‐Cano, F.-J. (2024). The Stigma Machine: A Study of the Prosocial Impact of Immersive VR Narratives on Youth in Spain and Canada. Media and Communication, 12. https://doi.org/10.17645/mac.8548
Nava, E., & Jalote-Parmar, A. (2022). Virtual Reality Revolution: Strategies for treating mental and emotional disorders. 2022-October, 3373–3378. https://doi.org/10.1109/SMC53654.2022.9945483
Nie, K., Guo, M., & Gao, Z. (2023). Enhancing Emotional Engagement in Virtual Reality (VR) Cinematic Experiences through multi-sensory Interaction Design. 47–53. https://doi.org/10.1109/CEII60565.2023.00017
Niu, Y., Wang, D., Wang, Z., Sun, F., Yue, K., & Zheng, N. (2020). User Experience Evaluation in Virtual Reality based on Subjective Feelings and Physiological Signals. 2020(13). https://doi.org/10.2352/J.ImagingSci.Technol.2019.63.6.060413
Oliveira, T., Noriega, P., Carvalhais, J., Rebelo, F., & Lameira, V. (2020). How Deep Is a Virtual Reality Experience? Virtual Environments, Emotions and Physiological Measures. 955, 462–471. https://doi.org/10.1007/978-3-030-20227-9_43
Palmiero, M., Nori, R., Rogolino, C., D’Amico, S., & Piccardi, L. (2015). Situated navigational working memory: The role of positive mood. Cognitive Processing, 16, 327–330. https://doi.org/10.1007/s10339-015-0670-4
Pavic, K., Chaby, L., Gricourt, T., & Vergilino-Perez, D. (2023). Feeling Virtually Present Makes Me Happier: The Influence of Immersion, Sense of Presence, and Video Contents on Positive Emotion Induction. Cyberpsychology, Behavior, and Social Networking, 26(4), 238–245. https://doi.org/10.1089/cyber.2022.0245
Peter, L., Proto, A., & Cerny, M. (2018). Investigation of a possibility of ECG and PPG common measurement. 68(2), 851–855. https://doi.org/10.1007/978-981-10-9038-7_157
Polo, E. M., Rey, A. V., Mollura, M., Paglialonga, A., & Barbieri, R. (2023). Exploring Emotional Responses in Virtual Reality Through Skin Conductance Signal. 189–194. https://doi.org/10.1109/MetroXRAINE58569.2023.10405636
Raheel, A. (2024). Emotion analysis and recognition in 3D space using classifier-dependent feature selection in response to tactile enhanced audio–visual content using EEG. Computers in Biology and Medicine, 179. https://doi.org/10.1016/j.compbiomed.2024.108807
Rizzo, A., & Wiederhold, B. K. (2005). Virtual reality technology for behavioral/cognitive/neuropsychological assessment and intervention: Applications and issues. 309. https://doi.org/10.1109/VR.2005.1492814
Škola, F., Boskovic, D., Rizvic, S., Skarlatos, D., & Liarokapis, F. (2024). Assessing User Experience and Cognitive Workload in Virtual Reality Digital Storytelling. International Journal of Human-Computer Interaction, 40(6), 1479–1486. https://doi.org/10.1080/10447318.2023.2247846
Szita, K., Gander, P., & Wallstén, D. (2021). The effects of cinematic virtual reality on viewing experience and the recollection of narrative elements. Presence: Teleoperators and Virtual Environments, 27(4), 410–425. https://doi.org/10.1162/PRES_a_00338
Tresser, S. (2012). Case study: Using a novel virtual reality computer game for occupational therapy intervention. Presence: Teleoperators and Virtual Environments, 21(3), 359–371. https://doi.org/10.1162/PRES_a_00118
Wang, Z., Lv, J., Hou, Y., & Song, D. (2024). Enhancing experience: Investigating the impact of different personal perspectives in virtual reality with lower limb rehabilitation robots on participants’ motivation, experience, and engagement. International Journal of Industrial Ergonomics, 99. https://doi.org/10.1016/j.ergon.2023.103496
Weng, H.-C., Huang, L.-Y., & Lin, W.-Y. (2024). Empathetic Skills through Virtual Reality: A New Frontier in Emotional Training. 171–175. https://doi.org/10.1109/ECEI60433.2024.10510873
Wolfe, A., Louchart, S., & Loranger, B. (2022). The Impacts of Design Elements in Interactive Storytelling in VR on Emotion, Mood, and Self-reflection. 13762 LNCS, 616–633. https://doi.org/10.1007/978-3-031-22298-6_40
Yu, H., Abdullah, A., & Saat, R. M. (2014). Overcoming time and ethical constraints in the qualitative data collection process: A case of information literacy research. Journal of Librarianship and Information Science, 46(3), 243–257. https://doi.org/10.1177/0961000614526610
Zhu, Y., & Dey, A. (2022). Comparing Physiological and Emotional Effects of Happy and Sad Virtual Environments Experienced in Video and Virtual Reality. 848–849. https://doi.org/10.1109/VRW55335.2022.00275
Zulkarnain, A. H. B., Cao, X., Kókai, Z., & Gere, A. (2024). Self-Assessed Experience of Emotional Involvement in Sensory Analysis Performed in Virtual Reality. Foods, 13(3). https://doi.org/10.3390/foods13030375
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Arvina Dwi Romadhani
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Creative Commons Attribution 4.0 International License