Skip to main content
Intended for healthcare professionals
Restricted access
Research article
First published online May 13, 2016

Multimedia news storytelling as digital literacies: An alternative paradigm for online journalism education

Abstract

This article analyzes a journalism student’s multimedia news storytelling project in the format of audio slideshows as required by an introductory course on online journalism. Combining classroom ethnography, semi-structured interviews, content and textual analysis, the study focuses in detail on how the student designs a character-driven, audio-visual story through the theoretical lens of digital literacies and multimodality. The findings reveal the complexity of multimodal and generic design made by the journalism student. It is also found that the design process helps her to assert an authorial stance as an emergent online journalist who negotiates heterogeneity of journalistic professional Discourses. This article proposes a genre-aware, semiotic-aware, critical framework informed by digital literacy studies and embeds a case study in the theoretical framework in order to understand the ‘literacies’ as required and performed in multimedia news storytelling. Theoretical and pedagogical implications are also discussed at the end of the article.

Get full access to this article

View all access and purchase options for this article.

Appendices

Appendix 1. Multimodal analysis of Shine for Life.
Slide indexTimeImageDescriptionSubtitleSound
10:00:00The shoe-shiner in his working placeI can’t remember how long I have been a shoe-shiner. It must be over decades. 
20:00:05The shoe-shiner is workingI didn’t learn from others. It’s all about experience. 
30:00:12The shoe-shiner is fetching for shoe oilYou can’t be too stingy. 
40:00:16A shoe under shiningOr the shoes would not look shiny.Clinging sound of shoe shining tools
50:00:21Shining shoes for Customer 1It takes me a very long time to polish shoes. 
60:00:28Add oil to a shoeI take it seriously. I want to make sure my customers are satisfied. 
70:00:35Customer 1N/A 
80:00:40A shined shoe of Customer 1N/A 
90:00:45Customer 2I have been his customer for more than 10 years. 
100:00:51A hand of the shoe-shinerHe is definitely an expert. 
110:00:56Shining shoes for Customer 2I have never seen someone shines as well as him. Never. 
120:01:01A side profile of the shoe-shinerI worked in many different industries before. 
130:01:05Counting moneyI would take any jobs, as long as I could feed my children. 
140:01:10Hands of the shoe-shinerLife is hard. But it is good to be self-reliant. 
150:01:15A shoe frameworkNo big deal. Just grit my teeth. 
160:01:20Customer 3I really appreciate him. He shows the Hong Kong spirit. 
170:01:25Shining shoes for Customer 3I know it is very tough for him, but he never gives up. 
180:01:30A shined shoe of Customer 3We will be sad if this great shoe-shiner retires. 
190:01:34Rolling up a sleeveHe always takes care of me. We are friends now! 
200:01:39Iron bars next to the shoe-shinerThere are less and less shoe-shiners in Hong Kong. 
210:01:43Shoe polishing with a focus on the shoe-shinerSome Chinese people are old-fashioned. They look down on us. 
220:01:47Shoe polishing with a focus on the shoeNo one wants to enter the industry.Sound of wrapping a newspaper
230:01:52Talking with a customerN/A 
240:01:56Two pairs of shoesN/A 
250:02:01A box of polishing oilI will send them back to him after polishing. 
260:02:07A customer filling water into the shoe-shiner’s cupCustomers here are very nice. They help me a lot.Hissing sound of a plastic bag
270:02:12Having lunchEven provide food to me. I am grateful. 
280:02:17Smiling while talking with his customerAlthough I am poor, I’m happy to work here. 
290:02:26People pass by the shiner’s working placeI am almost 80 years old and I will work until the end of my life. 
300:02:32OverpassBut probably my craft is dying out.Clinging sound of shoe shining tools

References

Bakhtin M (1986) Speech Genres and Other Late Essays (trans. McGee VW). Austin, TX: University of Texas Press.
Baldry A, Thibault J (2006) Multimodal Transcription and Text Analysis: A Multimedia Toolkit and Coursebook with Associated on-line Course. London; New York: Equinox Publishing.
Barton D, Hamilton M (1998) Local Literacies: Reading and Writing in One Community. London: Routledge.
Becker LB, Vlad T, Kalpen K (2011) 2011 annual survey of journalism and mass communication enrollments: Enrollments decline, reversing the increase of a year earlier, and suggesting slow growth for future. Journalism & Mass Communication Educator 66(4): 299–324.
Blom R, Davenport LD (2012) Searching for the core of journalism education: Program directors disagree on curriculum priorities. Journalism & Mass Communication Educator 67(1): 70–86.
Bor SE (2014) Teaching social media journalism: Challenges and opportunities for future curriculum design. Journalism & Mass Communication Educator 69(3): 243–255.
Bordwell D (2004) Neo-structuralist narratology and the functions of filmic storytelling. In: Ryan ML (ed.) Narrative across Media: The Languages of Storytelling. Lincoln, NE; London: University of Nebraska Press, pp. 203–219.
Bruner J (1990) Acts of Meaning. Cambridge, MA: Harvard University Press.
Cazden C, Cope B, Fairclough N, et al. (1996) A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66(1): 60–92.
Chen M (2013) Bu yao yin wei zou de tai yuan, er wang ji wei shen me chu fa. Beijing, China: China Renmin University Press (in Chinese).
Cochrane T, Sissons H, Mulrennan D (2012) Journalism 2.0: Exploring the impact of mobile and social media on journalism education. In: Sánchez IA, Isaias P (eds) Proceedings of the IADIS International Conference on Mobile Learning 2012. Berlin: IADIS International Association for Development of the Information Society, pp. 165–172.
Dahlgren P (1996) Media logic in cyberspace: Repositioning journalism and its publics. Javnost: The Public 3(3): 59–72.
Deuze M (1999) Journalism and the web: An analysis of skills and standards in an online environment. International Communication Gazette 61(5): 373–390.
Du YR (2014) What is needed versus what is taught: Students’ perception of online journalism courses in Hong Kong. Asia Pacific Media Educator 24(2): 225–237.
Du YR, Lo SCE (2014) The gap between online journalism education and practice: A Hong Kong study. Journalism & Mass Communication Educator 69(4): 415–434.
Fahmy S (2008) How online journalists rank importance of news skills. Newspaper Research Journal 29(2): 23–39.
Galtung J, Ruge M (1965) The structure of foreign news: The presentation of the Congo, Cuba and Cyprus crises in four Norwegian newspapers. Journal of International Peace Research 2(1): 64–91.
Gee JP ([1990] 2012) Social Linguistics and Literacies: Ideology in Discourses. London: Routledge.
Gee JP (2014) Unified Discourse Analysis: Language, Reality, Virtual Worlds and Video Games. London: Routledge.
Gilje Ø (2010) Multimodal redesign in filmmaking practices: An inquiry of young filmmakers’ deployment of semiotic tools in their filmmaking practice. Written Communication 27(4): 494–522.
Gillmor D (2006) We the Media: Grassroots Journalism by the People for the People. Sebastopol, CA: O’Reilly.
Hafner CA (2014) Embedding digital literacies in English Language Teaching: Students’ digital video projects as multimodal ensembles. TESOL Quaterly 48(4): 655–685.
Hajunen J (2013) At the crossroads of participation and objectivity: Reinventing citizen engagement in the SBS newsroom. New Media & Society 15(6): 947–962.
Halliday MAK (1978) Language as Social Semiotics. London: Edward Arnold.
Hart J (2011) Story Craft: The Complete Guide to Writing Narrative Nonfiction. Chicago, IL: University of Chicago Press.
Jacobson S, Marino J, Gutsche RE (2015) The digital animation of literary journalism. Journalism. Epub ahead of print 5 February.
Jones RH, Hafner CA (2012) Understanding Digital Literacies: A Practical Introduction. London: Routledge.
Karlsson M (2010) Rituals of transparency: Evaluating online news outlets’ uses of transparency rituals in the United States, United Kingdom and Sweden. Journalism Studies 11(4): 535–545.
Kress GR (2003) Literacy in the New Media Age. New York: Routledge.
Kress GR (2010) Multimodality: A Social Semiotic Approach to Contemporary communication. London; New York: Routledge.
Kress GR, Van Leeuwen T (1996) Reading Images: The Grammar of Visual Design. London; New York: Routledge.
Lankshear C, Knobel M (2011) New Literacies, 3rd edn. New York: Open University Press.
Lewis SC (2012) The tension between professional control and open participation: Journalism and its boundaries. Information, Communication & Society 15(6): 836–867.
Lillie J (2011) How and why journalists create audio slideshows. Journalism Practice 5(3): 350–365.
Lipschultz JH (2012) Media storytelling, curriculum, and the next 100 years. Journalism & Mass Communication Educator 67(4): 408–412.
Luke A (1995) Text and discourse in education: An introduction to critical discourse analysis. Review of Research in Education 21(1): 3–48.
Martin JR, Rose D (2008) Genre Relations: Mapping Culture. London; Oakville, CT: Equinox Publishing.
Martin JR, White R (2005) The Language of Evaluation. London: Palgrave Macmillan.
Matheson D (2004) Weblogs and the epistemology of the ‘news’: Some trends in online journalism. New Media & Society 6(4): 443–468.
Mills KA (2010) A review of the ‘digital turn’ in the new literacy studies. Review of Educational Research 80(2): 246–271.
New London Group (1996) A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review 66: 60–92.
Nichols B (2001) Introduction to Documentary. Bloomington, IN: Indiana University Press.
Pauly J (2008) New journalism. In: Donsbach W (ed.) The International Encyclopedia of Communication. Oxford: Blackwell, pp. 3209–3211.
Pavlik JV (2001) Journalism and New Media. New York: Columbia University Press.
Pérez-Milans M (2011) Being a Chinese newcomer in Madrid compulsory education: Ideological constructions in language education practice. Journal of Pragmatics 43(4): 1005–1022.
Peters C (2011) Emotion aside or emotional side? Crafting an ‘experience of involvement’ in the news. Journalism 12(3): 297–316.
Schudson M (2003) The Sociology of News. New York; London: W. W. Norton & Company.
Schudson M, Anderson C (2009) Objectivity, professionalism, and truth seeking in journalism. In: Wahl-Jorgensen K, Hanitzsch T (eds) The Handbook of Journalism Studies. New York: Routledge, pp. 88–101.
Soffer O (2009) The competing ideals of objectivity and dialogue in American journalism. Journalism: Theory, Practice & Criticism 10(4): 473–491.
Tuchman G (1978) Making News: A Study in the Social Construction of Reality. London: The Free Press.
Van Leeuwen T (2005) Introducing Social Semiotics. New York: Psychology Press.
Vasudevan L, Schultz J, Bateman J (2010) Rethinking composing in a digital age: Authoring literate identities through multimodal storytelling. Written Communication 27(4): 442–468.
Wenger DL, Owens L, Thompson P (2014) Help wanted: Mobile journalism skills required by top U.S. news companies. Electronic News 8(2): 138–149.
Woolley B (2014) WIL-power: Developing journalism students’ intercultural communications and international reporting skills on field trips to Vietnam. Asia Pacific Media Educator 24(2): 157–173.
Yuan EJ (2013) Online journalism in social transformations. Journalism Studies 14(1): 78–93.

Biographies

Yang Song is currently an assistant professor at the Department of English Language and Literature, Fudan University. Her research interests include digital literacies, online journalism education, discourse analysis, and computer-assisted teaching and learning.