Spatial audio and immersive journalism: production, narrative design, and sense of presence

Authors

DOI:

https://doi.org/10.3145/epi.2022.sep.19

Keywords:

Immersive journalism, Immersive storytelling, Audio storytelling, Narrative, Binaural sound, Spatial audio, Emotional turn, Journalism, Cinematic radio, Audio documentary, Audio communication

Abstract

This article presents the findings from an experimental study on the use of binaural audio in two long-form journalistic features broadcast on Portuguese radio. From a production and narrative design perspective, our objective is to examine whether/how binaural audio implies a transformation of previously established news radio production work principles and practices, as well as of storytelling ideation and techniques. From a user experience viewpoint, we examine whether the use of binaural audio translates into higher levels of self-reported immersion and place illusion (n = 77). Despite the spread of new audio journalism formats, media and communication studies have until now largely neglected the role of spatial audio in the construction of immersion and the illusion of place. We argue that this epistemic omission translates into an image-centric conception and operationalization of the immersive journalism proposal, which stands out as a knowledge gap regarding the work of journalistic storytellers and relating to participants´ actual experience. The original contribution of this article is threefold: (1) conceptual, by broadening the perspective of journalism studies´ scholars and media professionals on the concept of immersive journalism, which, in our view, is often incorrectly considered to be synonymous with that of virtual reality journalism; (2) practical, by generating a more nuanced understanding of how actual practitioners perceive and employ immersive journalism; (3) phenomenological, by developing an examination of the factors that influence listeners´ ultimate perception of the immersive experience.

Downloads

Download data is not yet available.

References

Aitamurto, Tanja (2019). "Normative paradoxes in 360° journalism: contested accuracy and objectivity". New media & society, v. 21, n. 1, pp. 3-19. https://doi.org/10.1177/1461444818785153

Archer, Dan; Finger, Katharina (2018). Walking in another´s virtual shoes: do 360-degree video news stories generate empathy in viewers?. Columbia Journalism School: Tow Center for Digital Journalism. https://www.cjr.org/tow_center_reports/virtual-reality-news-empathy.php

Aveyard, Karina; Moran, Albert (2013) "Introduction: sound media, sound cultures". Media international Australia, v. 148, n. 1, pp. 79-83. https://doi.org/10.1177/1329878X1314800109

Bal, Mieke (1985). Narratology: introduction to the theory of narrative. University of Toronto Press. ISBN: 1442628340

Berger, Peter-Ludwig; Luckmann, Thomas (1967). The social construction of reality: a treatise in the sociology of knowledge. New York: Anchor Books. ISBN: 978 0 385058988

Bird, S. Elizabeth; Dardenne, Robert W. (1988). "Myth, chronicle, and story: exploring the narrative qualities of news". In: Carey, James W. (ed.). Media, myths, and narratives: television and the press. Beverly Hills: SAGE Publications, pp. 67-87. ISBN: 0803930488

Bird, S. Elizabeth; Dardenne, Robert W. (2009). "Rethinking news and myth as storytelling". In: Wahl-Jorgensen, Karin; Hanitzsch, Thomas (eds.). The handbook of journalism studies. New York: Routledge. ISBN:"Ž 0805863435

Clifford, Katrina; White, Rob (2020). "Mediated representations of prisoner experience and public empathy". In: Harmes, Marcus; Harmes, Meredith; Harmes, Barbara (eds.). The Palgrave handbook of incarceration in popular culture. Cham: Palgrave Macmillan, pp. 265-287. ISBN: 978 3 030 36059 7

De-la-Peña, Nonny; Weil, Peggy; Llobera, Joan; Giannopoulos, Elias; Pomés, Ausiàs; Spaniang, Bernhard; Friedman, Doron; Sánchez-Vives, Marí­a V.; Slater, Mel (2010). "Immersive journalism: immersive virtual reality for the first-person experience of news". Presence: teleoperators and virtual environments, v. 19, n. 4, pp. 291-301. https://doi.org/10.1162/PRES_a_00005

Domí­nguez, Eva (2013). Periodismo inmersivo: la influencia de la realidad virtual y del videojuego en los contenidos informativos. Barcelona: UOC. ISBN: 8490297762

Dowling, David O.; Miller, Kyle J. (2019) "Immersive audio storytelling: podcasting and serial documentary in the digital publishing industry". Journal of radio & audio media, v. 26, n. 1, pp. 167-184. https://doi.org/10.1080/19376529.2018.1509218

Edmond, Maura (2015). "All platforms considered: contemporary radio and transmedia engagement". New media & society, v. 17, n. 9, pp. 1566-1582. https://doi.org/10.1177/1461444814530245

Engberg, Maria; Bolter, Jay-David (2020). "The aesthetics of reality media". Journal of visual culture, v. 19, n. 1, pp. 81-95. https://doi.org/10.1177/1470412920906264

Ferjoux, Céline; Dupont, í‰mile-Ropert (2020). "Journalisme immersif et empathie: l´émotion comme connaissance immédiate du reel". Communiquer. Revue de communication sociale et publique, n. 28, pp. 73-99. https://doi.org/10.4000/communiquer.5477

Gallagher, Michael (2015). "Field recording and the sounding of spaces". Environment and planning D: society and space, v. 33, n. 3, pp. 560-576. https://doi.org/10.1177/0263775815594310

Gerrig, Richard (1993). Experiencing narrative worlds: on the psychological activities of reading. New Haven: Yale University Press. ISBN: 0300054343

Godulla, Alexander; Planer, Rosanna; Wolf, Cornelia; Lí¼ck, Annika; VaaíŸen, Fiona (2021). "An immersive journey through flawed technology: users´ perceptions of VR in journalism". Journalism and media, v. 2, n. 3. https://doi.org/10.3390/journalmedia2030027

Gorini, Alessandra; Capideville, Claret S.; De-Leo, Gianluca; Mantovani, Fabrizia; Riva, Giuseppe (2010). "The role of immersion and narrative in mediated presence: the virtual hospital experience". Cyberpsychology, behavior, and social networking, v. 14, n. 3, pp. 99-105. https://doi.org/10.1089/cyber.2010.0100

Goutier, Nele; De-Haan, Yael; De-Bruin, Kiki; Lecheler, Sophie; Kruikemeier, Sanne (2021). "From "˜cool observer´ to "˜emotional participant´: the practice of immersive journalism". Journalism studies, v. 22, n. 12, pp. 1648-1664. https://doi.org/10.1080/1461670X.2021.1956364

Green, Melanie C.; Brock, Timothy C. (2000). "The role of transportation in the persuasiveness of public narratives". Journal of personality and social psychology, v. 79, n. 5, pp. 701-721. https://doi.org/10.1037/0022-3514.79.5.701

Hassan, Robert (2020). "Digitality, virtual reality and the "˜empathy machine´". Digital journalism, v. 8, n. 2, pp. 195-212. https://doi.org/10.1080/21670811.2018.1517604

Hendriks-Vettehen, Paul; Wiltink, Daan; Huiskamp, Maite; Schaap, Gabi; Ketelaar, Paul (2019). "Taking the full view: how viewers respond to 360-degree video news". Computers in human behavior, n. 91, pp. 24-32. https://doi.org/10.1016/j.chb.2018.09.018

Herman, David (2009). Basic elements of narrative. West Sussex: Wiley-Blackwell. ISBN: 978 1 405141543

Ijsselsteijn, Wijnand; Riva, Giuseppe (2003) "Being there: the experience of presence in mediated environments". In: Riva, Giuseppe; Davide, Fabrizio; Ijsselsteijn, Wijnand (eds.). Being there: concepts, effects and measurement of user presence in synthetic environments. Amsterdam: IOS Press. ISBN: 1586033018

Jenkins, Kerinne; Murphy, Stephen; Thomas, Penelope (2018). Precipice: an AFTRS applied innovation project. Australian film television and radio school. https://www.aftrs.edu.au/news/2018/white-paper-no-2-precipice-binaural

Kool, Hollis (2016). "The ethics of immersive journalism: a rethorical analysis of news storytelling with virtual reality technology". Intersect, v. 9, n. 3. https://ojs.stanford.edu/ojs/index.php/intersect/article/view/871

Kukkakorpi, Mariia; Pantti, Mervi (2021). "A sense of place: VR journalism and emotional engagement". Journalism practice, v. 15, n. 6, pp. 785-802. https://doi.org/10.1080/17512786.2020.1799237

Laarni, Jari; Ravaja, Niklas; Saari, Timo; Bí¶cking, Saskia; Hartmann, Tilo; Schramm, Holger (2015). "Ways to measure spatial presence: review and future directions". In: Lombard, Matthew; Biocca, Frank; Freeman, Jonathan; IJsselsteijn, Wijnand; Schaevitz, Rachel J. (eds). Immersed in media: telepresence theory, measurement & technology. Cham: Springer International Publishing, pp. 139-185. ISBN: 978 3 319 10190 3

LaRocco, Michael (2020). "Developing the "˜best practices´ of virtual reality design: industry standards at the frontier of emerging media". Journal of visual culture, v. 19, n. 1, pp. 96-111. https://doi.org/10.1177/1470412920906255

Lecheler, Sophie (2020). "The emotional turn in journalism needs to be about audience perceptions". Digital journalism, v. 8, n. 2, pp. 287-291. https://doi.org/10.1080/21670811.2019.1708766

Marconi, Francesco; Nakagawa, Taylor (2017). The age of dynamic storytelling: a guide for journalists in a world of immersive 3-D content. Associated Press. https://www.amic.media/media/files/file_352_1328.pdf

Martí­nez, M. Ángeles (2014). "Storyworld possible selves and the phenomenon of narrative immersion: testing a new theoretical construct". Narrative, v. 22, n. 1, pp. 110-131. https://doi.org/10.1353/nar.2014.0004

Milk, Chris (2015). "How virtual reality can create the ultimate empathy machine". TED2015. https://www.ted.com/talks/chris_milk_how_virtual_reality_can_create_the_ultimate_empathy_machine?language=en

Murray, Janet H. (2020). "Virtual/reality: how to tell the difference". Journal of visual culture, v. 19, n. 1, pp. 11-27. https://doi.org/10.1177/1470412920906253

Nash, Kate (2018). "Virtual reality witness: exploring the ethics of mediated presence". Studies in documentary film, v. 12, n. 2, pp. 119-131. https://doi.org/10.1080/17503280.2017.1340796

Nilsson, Niels-Christian; Nordahl, Rolf; Serafin, Stefania (2016). "Immersion revisited: a review of existing definitions of immersion and their relation to different theories of presence". Human technology, v. 12, n. 2, pp. 108-134. https://vbn.aau.dk/en/publications/immersion-revisited-a-review-of-existing-definitions-of-immersion

Pérez-Seijo, Sara (2017) "Immersive journalism: from audience to first-person experience of news". In: Campos, Francisco; Rúas, Xosé; Martí­nez, Valentí­n-Alejandro (eds.). Media and metamedia management. Cham: Springer, pp. 113-119. ISBN: 978 3 319 46068 0

Pérez-Seijo, Sara; Vicente, Paulo-Nuno (2022). "After the hype: how hi-tech is reshaping journalism". In: Vázquez-Herrero, Jorge; Silva-Rodrí­guez, Alba; Negreira-Rey, Cruz; Toural-Bran, Carlos; López-Garcí­a, Xosé (eds.). Total journalism: models, techniques and challenges. Cham: Springer, pp. 41-52. ISBN: 3030880273

Revill, George (2016). "How is space made in sound? Spatial mediation, critical phenomenology and the political agency of sound". Progress in human geography, v. 40, n. 2, pp. 240-256. https://doi.org/10.1177/0309132515572271

Ross, Miriam (2020). "Virtual reality´s new synesthetic possibilities". Television & new media, v. 21, n. 3, pp. 297-314. https://doi.org/10.1177/1527476418805240

Ryan, Marie-Laure (2015). Narrative as virtual reality 2: revisiting immersion and interactivity in bibliografí­e and electronic media. Baltimore: Johns Hopkins University Press. ISBN: 1421417979

Sánchez-Laws, Ana-Luisa (2020). "Can immersive journalism enhance empathy?". Digital journalism, v. 8, n. 2, pp. 213-228. https://doi.org/10.1080/21670811.2017.1389286

Shin, Donghee; Biocca, Frank (2018). "Exploring immersive experience in journalism". New media & society, v. 20, n. 8, pp. 2800-2823. https://doi.org/10.1177/1461444817733133

Slater, Mel (1999). "Measuring presence: a response to the Witmer and Singer presence questionnaire". Presence: teleoperators and virtual environments, v. 8, n. 5, pp. 560-565. https://doi.org/10.1162/105474699566477

Sundar, S. Shyam; Kang, Jin; Oprean, Danielle (2017). "Being there in the midst of the story: how immersive journalism affects our perceptions and cognitions". Cyberpsychology, behavior, and social networking, v. 20, n. 11, pp. 672-682. https://doi.org/10.1089/cyber.2017.0271

Tuchman, Gaye (1972). "Objectivity as strategic ritual: an examination of newmen´s notions of objectivity". The American journal of sociology, v. 77, n. 4, pp. 660-679. https://doi.org/10.1086/225193

Van-Damme, Kristin; All, Anissa; De-Marez, Lieven; Van-Leuven, Sarah (2019). "360 video journalism: experimental study on the effect of immersion on news experience and distant suffering". Journalism studies, v. 20, n. 14, pp. 2053-2076. https://doi.org/10.1080/1461670X.2018.1561208

Van-Leeuwen, Theo (2007). "Sound and vision". Visual communication, v. 6, n. 2, pp. 136-145. https://doi.org/10.1177/1470357207077443

Vicente, Paulo-Nuno (2018). "Ledes and story structures". In: Vos, Tim P.; Hanusch, Foljer (eds.). The international encyclopedia of journalism studies. Oxford: Wiley-Blackwell. ISBN: 1118841670

Vicente, Paulo-Nuno (2020). "Interactive media". In: Merskin, Debra L. (ed.). The SAGE international encyclopedia of mass media and society. California: SAGE Publications. ISBN: 1483375536

Wahl-Jorgensen, Karin (2020). "An emotional turn in journalism studies?". Digital journalism, v. 8, n. 2, pp. 175-194. https://doi.org/10.1080/21670811.2019.1697626

Wake, Alexandra; Bahfen, Nasya (2016). "Redefining radio: implications for journalism education in an era of digital audio storytelling". Radio journal: international studies in broadcast & audio media, v. 14, n. 2, pp. 231-242. https://doi.org/10.1386/rjao.14.2.231_1

Wincott, Abigail; Martin, Jean; Richards, Ivor (2020). Spatial awareness: state of the art and future needs of spatial audio journalism. Project Report. http://repository.falmouth.ac.uk/4059

Wirth, Werner; Hartmann, Tilo; Bí¶cking, Saskia; Vorderer, Peter; Klimmt, Christoph; Schramm, Holger; Laarni, Jari; Ravaja, Niklas; Gouveia, Feliz R.; Biocca, F.; Sacau, A.; Jí¤ncke, Lutz; Baumgartner, Thomas; Jí¤ncke, Petra (2007). "A process model of the formation of spatial presence experiences". Media psychology, v. 9, n. 3, pp. 493-525. https://doi.org/10.1080/15213260701283079

Witmer, Bob G.; Singer, Michael J. (1998). "Measuring presence in virtual environments: a presence questionnaire". Presence: teleoperators and virtual environments, v. 7, n. 3, pp. 225-240. https://doi.org/10.1162/105474698565686

Published

2022-10-24

How to Cite

Vicente, P.-N., & Pérez-Seijo, S. (2022). Spatial audio and immersive journalism: production, narrative design, and sense of presence. Profesional De La información, 31(5). https://doi.org/10.3145/epi.2022.sep.19