Multimodal poetics in digital literature: A corpus-based analysis of visual-verbal design, screen-based textuality, and reader interaction
DOI:
https://doi.org/10.64595/cy0q2n14Keywords:
digital literature, digital poetics, interactivity, multimodality, reader navigationAbstract
Digital literature has transformed literary experience by shifting reading from a page-bound encounter with verbal text into a screen-based engagement with visual design, textual movement, interface structure, and reader participation. This study aims to examine how selected digital-born literary works construct meaning through the integrated operation of verbal, visual, and interactive forms. Using a qualitative interpretive design, the study analyses works drawn from recognized electronic literature archives through Multimodal Discourse Analysis, Digital Poetics Analysis, and Interface and Interaction Analysis. The findings show that visual-verbal configuration functions as a core poetic mechanism, in which typography, layout, image, colour, spatial arrangement, and screen composition actively reshape verbal meaning. The study also finds that fragmentation, movement, and screen-based textuality expand poetic form beyond stable printed structures by making language dynamic, procedural, and temporally organized. Reader navigation further emerges as a crucial mode of meaning-making, as clicking, scrolling, selecting, waiting, observing, and activating textual elements transform reading into a performative negotiation between agency and constraint. The novelty of this study lies in its corpus-based multimodal poetics framework, which integrates visual-verbal design, digital textual dynamics, and interactive readerly performance into a single analytical model for examining digital-born literature.
Downloads
References
Adawiyah, R. (2024). Regulation and production of contemporary literature: An examination of literary evolution in the digital age. LITERA. https://doi.org/10.21831/ltr.v23i2.72965
Adhikary, R. P. (2025). Computational neurocognitive poetics: Towards an integrated philosophical, psychological, and ethical framework for literary analysis. Revue Congo Research Papers. https://doi.org/10.59937/sufu9139
Alagiya, K. (2023). Exploring the Potential of Twine Fiction as an Interactive Learning Tool for Literature Education: A Case Study of Girish Karnad’s Naga-Mandala. Vidhyayana. https://doi.org/10.58213/vidhyayana.v9isi1.1584
Aliagas, C., Correro, C., & Fittipaldi, M. (2024). Digital Fiction in Literary Education: What do secondary-school teachers think about this multimodal artform as a pedagogical resource? L1-Educational Studies in Language and Literature, 24(3), 1–27.
Atzenbeck, C. (2024). Interview with Mariusz Pisarski. ACM SIGWEB Newsletter, 2024, 1–5. https://doi.org/10.1145/3643603.3643606
Burin, D. I., Barreyro, J. P., Saux, G., & Irrazábal, N. C. (2015). Navigation and comprehension of digital expository texts: Hypertext structure, previous domain knowledge, and working memory capacity. Electronic Journal of Research in Educational Psychology, 13(3), 529–550. https://doi.org/10.14204/ejrep.37.14136
Busareva, S. (2024). Brian Bilston’s multimodal poetic practices: Interactions between the digital and the analogue. Slovo.Ru: Baltic Accent. https://doi.org/10.5922/2225-5346-2024-3-8
Fawaid, A., Kholil, M., & Dewi, N. A. R. (2024). The role of culturally-responsive gamification to improve multiethnic students’ self-engagement in Islamic education. Al-Fikru: Jurnal Pendidikan Dan Sains, 5(2), 267–275. https://doi.org/10.55210/al-fikru.v5i2.1868
Höglund, H. (2022). The Heartbeat of Poetry: Student Videomaking in Response to Poetry. Written Communication, 39, 276–302. https://doi.org/10.1177/07410883211070862
Joshwa, J. (2023). Reading hypertextuality: A critical reading of Dictionary of the Khazars (1984). New Review of Hypermedia and Multimedia, 29, 151–166. https://doi.org/10.1080/13614568.2023.2258848
Kress, G., & Van Leeuwen, T. (2020). Modality and validity. In G. Kress & T. Van Leeuwen, Reading Images (3rd ed., pp. 149–178). Routledge. https://doi.org/10.4324/9781003099857-6
Kucirkova, N. (2019). Theorising materiality in children’s digital books. Libri et Liberi, 8(2), 279–292. https://doi.org/10.21066/carcl.libri.8.2.2
Lagerkvist, L., & Ghajargar, M. (2020). Multiverse: Exploring Human Machine Learning Interaction through Cybertextual Generative Literature. ACM International Conference Proceeding Series. https://doi.org/10.1145/3423423.3423424
Liu, L. (2024). Hearing Rhythm, Seeing Rhythm: A Research Approach to Reimagining Traditions of Chinese Poetic ‘rules of rhythm.’ Journal for Artistic Research. https://doi.org/10.22501/jar.1900487
Loh, C., Steagall, M., & Tavares, T. (2021). Logical Coding & Emotional Poetry: An exploration of poetic expression in the digital. Link Symposium Abstracts 2020. https://doi.org/10.24135/link2021.v2i1.164
Long, J. (2024). A Review of the Poem “Invisible Rhythm”: Visible Sound of Invisible Rhythm. Verse Veison. https://doi.org/10.64699/bola1299
Morris, K. W. (2024). Transforming the Chaos: The ‘Writing’ Experiments of the Postdigital Ludic Writer. Anglica. An International Journal of English Studies. https://doi.org/10.7311/0860-5734.33.2.06
Mustofa, A., & Lestari, L. (2023). LITERARY CRITICISM IN THE DIGITAL AGE: ADDRESSING THE PROBLEMS AND OPPORTUNITIES OF DIGITAL LITERATURE IN EFL PEDAGOGY. English Review: Journal of English Education. https://doi.org/10.25134/erjee.v11i1.7137
Nag, A. D. (2024). CURATING THE SELF: BODY IMAGE AND THE AESTHETICS OF LANGUAGE IN YOUTH-CENTRIC INSTAGRAM LITERATURE. ShodhKosh: Journal of Visual and Performing Arts. https://doi.org/10.29121/shodhkosh.v5.i5.2024.5262
Petrenko, T., Levina, N., Airapetov, G., Keleynikova, A., & Kotliarevskaia, I. (2024, January 1). Francophone literature in the digital age: Language and style. SHS Web of Conferences. https://doi.org/10.1051/shsconf/202419502002
Prozorova, N. (2024). SOUND IMAGES IN POETICS BY O. F. BERGHOLZ. Проблемы Исторической Поэтики. https://doi.org/10.15393/j9.art.2024.13802
Qin, X., & He, L. (2011). Parodic intertextuality and ironic intertextuality in Austin Clarke’s The Polished Hoe and More. Foreign Literature Studies, 33(5), 80–85.
Ramya, R., & Rukmini, S. (2021). Literature in new media: A comparative study of literary affordances of lance Olsen’s “10:01” in traditional and digital medium. Rupkatha Journal on Interdisciplinary Studies in Humanities, 13(2). https://doi.org/10.21659/RUPKATHA.V13N2.45
Sastre, M. S., & Garcia, E. F. (2022). From Text on Paper to Digital Poetry: Creativity and Digital Literary Reading Practices in Initial Teacher Education. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.882898
Skains, R. L. (2023). THE INFLUENCE OF DIGITAL PLATFORMS ON AUTHORS OF ELECTRONIC LITERATURE AND INTERACTIVE DIGITAL NARRATIVES. In The Routledge Companion to Literary Media (pp. 209–220). https://doi.org/10.4324/9781003119739-20
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Ridhatullah Assyabani

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.








Creative Commons Attribution 4.0 International License