Música, Sonido y Alfabetización Multimodal: Una Revisión Sistemática

Authors

DOI:

https://doi.org/10.7203/LEEME.0.27500

Keywords:

Alfabetización, Sonido, Música, Educación.

Abstract

La alfabetización multimodal implica el uso de múltiples modos de comunicación en la comprensión y producción de textos. Esta revisión examina el sonido y la música en la investigación sobre alfabetización multimodal, analizando 48 trabajos de las bases de datos Web of Science y Scopus. Identifica métodos y aspectos educativos comunes en los textos y explora cómo se aplica la alfabetización multimodal en entornos académicos. El estudio destaca la versatilidad del modo auditivo, que abarca efectos sonoros, vocalizaciones, música y otros. Sin embargo, algunos estudios limitan el uso del sonido a la "música de fondo", sin profundizar demasiado en su función comunicativa. Esta investigación contribuye a comprender las implicaciones del sonido y su potencial para implicar a los alumnos en una sociedad multimodal.

Author Biographies

José J. Roa-Trejo, Universidad Loyola Andalucía

Departamento de Comunicación y Educación, Ayudante de Investigación.

Alejandra Pacheco-Costa, Universidad de Sevilla

Departamento Educación Artística, Profesora Titular.

Francisco Cuadrado, Universidad Loyola Andalucía

Departamento de Comunicación y Educación, Profesor Titular. 

References

Alexander, K. P., DePalma, M. J., & Ringer, J. M. (2016). Adaptive Remediation and the Facilitation of Transfer in Multiliteracy Center Contexts. Computers and Composition, 41, 32-45. https://doi.org/10.1016/j.compcom.2016.04.005  

Anderson, K. T., & Kachorsky, D. (2019). Assessing students' multimodal compositions: An analysis of the literature. English Teaching: Practice & Critique, 18(3), 312-334. https://doi.org/10.1108/ETPC-11-2018-0092 

Baize, J. (2019). Classics in Their Own "Words": Analytical Remixes in a Land of Essays. Journal of Adolescent & Adult Literacy, 6(6), 625-633. https://doi.org/10.1002/jaal.942 

Barton, G., Burke, K., & Freebody, P. (2022). Disciplinary literacies in the arts: Semiotic explorations of teachers' use of multimodal and aesthetic metalanguage. International Journal of Education & the Arts, 23(8), 1-22. http://doi.org/10.26209/ijea23n8 

Bazalgette, C., & Buckingham, D. (2013). Literacy, media and multimodality: A critical response: Literacy, media and multimodality. Literacy, 47(2), 95-102. https://doi.org/10.1111/j.1741-4369.2012.00666.x   

Bezemer, J., & Kress, G. (2008). Writing in Multimodal Texts: A Social Semiotic Account of Designs for Learning. Written Communication, 25(2), 166-195. https://doi.org/10.1177/0741088307313177   

Binder, M., & Kotsopoulos, S. (2011). Multimodal literacy narratives: Weaving the threads of young Children's identity through the arts. Journal of Research in Childhood Education, 25 (4), 339-363. https://doi.org/10.1080/02568543.2011.606762  

Blom, N. (2017). Creative Criticism: Dialogue and Aesthetics in the English Language Arts Classroom. Journal of Adolescent & Adult Literacy, 61(1), 45-54. https://doi.org/10.1002/jaal.634  

Bloome, D. & Green, J. (2015). The social and linguistic turns in studying language and literacy. In J. Rowsell & K. Pahl (Eds.). The Routledge Handbook of Literacy Studies (pp. 19-34). Routledge. https://doi.org/10.4324/9781315717647 

Burn, A. (2016). Making machinima: Animation, games, and multimodal participation in the media arts. Learning, Media and Technology, 41(2), 310-329. https://doi.org/10.1080/17439884.2015.1107096   

Butler, E. D., Flint, T. K., & da Silva Iddings, A. C. (2021). The liberatory potentials of multimodality: Collaborative Reggaeton music video production in Habana, Cuba. Media, Culture & Society, 43(5), 842-859. https://doi.org/10.1177/0163443720987747   

Chen, C. W. (2021). Composing print essays versus composing across modes: Students' multimodal choices and overall preferences. Literacy, 55(1), 25-38. https://doi.org/10.1111/lit.12234  

Cooke, A., Smith, D., & Booth, A. (2012). Beyond PICO: The SPIDER tool for qualitative evidence synthesis. Qualitative Health Research, 22(10), 1435-1443. https://doi.org/10.1177/1049732312452938   

Countryman, J., & Gabriel, M. A. (2014). Recess as a Site for Language Play. Language and Literacy, 16(3), 4-26. https://doi.org/10.20360/G2Q301  

Crafton, L. K.; Silvers, P. & Brennan, M. (2009) Creating a critical multiliteracies curriculum: repositioning art in the early childhood classroom. In M. Narey (Ed.), Making Meaning Constructing Multimodal Perspectives of Language, Literacy, and Learning through Arts-based Early Childhood Education (pp. 31-51) Springer. https://doi.org/10.1007/978-0-387-87539-2 

Dallacqua, A. K., Kersten, S., & Rhoades, M. (2015). Using Shaun Tan's Work to Foster Multiliteracies in 21st-Century Classrooms. The Reading Teacher, 69(2), 207-217. https://doi.org/10.1002/trtr.1395   

Dalton, B., & Musetti, K. (2018). Tactile Picture Book Making and Multimodal Composition: Students Design for Equity in English Language Arts. In E. Ortlieb, E. H. Cheek, & P. Semingson (Eds.), Literacy Research, Practice and Evaluation (pp. 195-213). Emerald Publishing Limited. https://doi.org/10.1108/S2048-045820180000009015  

Dalton, B., & Smith, B. E. (2015). How Do I Know What I Think until I See What I Produce in My Video: A Case for Video Reflection. In E. Ortlieb, L. E. Shanahan, & M. B. McVee (Eds.), Literacy Research, Practice and Evaluation (pp. 231-248). Emerald Group Publishing Limited. https://doi.org/10.1108/S2048-045820150000006011  

DeNora, T. (2009). Music in Everyday Life. Cambridge University Press. https://doi.org/10.1017/CBO9780511489433  

DePalma, M. (2015). Tracing transfer across media: Writers' perceptions of cross-contextual and rhetorical reshaping in processes of remediation. College Composition and Communication, 67(1), 615-642. https://www.jstor.org/stable/43491903  

Doerr-Stevens, C., & Buckley-Marudas, M. (2019). Hearing Knowledge into Action: Mobilizing Sound for Multicultural Imaginaries. International Journal of Multicultural Education, 21(1), 105-124. https://doi.org/10.18251/ijme.v21i1.1735  

Domingo, M. (2012). Linguistic layering: Social language development in the context of multimodal design and digital technologies. Learning, Media and Technology, 37(2), 177-197. https://doi.org/10.1080/17439884.2012.670645  

Domingo, M., Jewitt, C., & Kress, G (2015). Multimodal social semiotics. Writing in online contexts. In J. Rowsell & K. Pahl (Eds.), The Routledge handbook of literacy studies (pp. 251-256). Routledge. https://doi.org/10.4324/9781315717647 

Elwick, A., Burnard, P., Osgood, J., Huhtinen-Hildén, L., & Pitt, J. (2020). Young children's experiences of music and soundings in museum spaces: Lessons, trends and turns from the literature. Journal of Early Childhood Research, 18(2), 174-188. https://doi.org/10.1177/1476718X19888717  

Flewitt, R. (2013). Multimodal perspectives on early childhood literacies. In The SAGE Handbook of Early Childhood Literacy, Second Edition (pp. 295-310). SAGE Publications Ltd.  https://doi.org/10.4135/9781446247518  

Garcia, A., Robillard, S. M., Suzara, M., & Garcia, J. E. (2021). Bus riding leitmotifs: Making multimodal meaning with elementary youth on a public school bus. English Teaching: Practice & Critique, 20(3), 398-412. https://doi.org/10.1108/ETPC-07-2020-0080  

Gillen, J. & Hall, N. (2013). The emergence of early childhood literacy. In J. Larson & J. Marsh (Eds.). The SAGE handbook of early childhood literacy (pp. 28-39). SAGE Publications Ltd. https://doi.org/10.4135/9781446247518 

Hackett, A., & Somerville, M. (2017). Posthuman literacies: Young children moving in time, place and more-than-human worlds. Journal of Early Childhood Literacy, 17(3), 374-391. https://doi.org/10.1177/1468798417704031  

Hannah Park, J. (2021). "Dear Future Me: Connecting College L2 Writers' Literacy Paths to an Envisioned Future Self Through a Multimodal Project. In D. Shin, T. Cimasko, & Y. Yi (Eds.), Multimodal Composing in K-16 ESL and EFL Education (pp. 73-86). Springer Singapore. https://doi.org/10.1007/978-981-16-0530-7_5  

Harrop-Allin, S. (2017). Multimodality and the Multiliteracies Pedagogy: "Design" and "Recruitment" in South African Children's Musical Games. Journal of Research in Music Education, 65(1), 25-51. https://doi.org/10.1177/0022429417694874  

Hess, J., Watson, V. W. M., & Deroo, M. R. (2019). "Show Some Love": Youth and Teaching Artists Enacting Literary Presence and Musical Presence in an After-School Literacy-and-Songwriting Class. Teachers College Record: The Voice of Scholarship in Education, 121(5), 1-44. https://doi.org/10.1177/016146811912100502  

Hsieh, H. F., & Shannon, S. E. (2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687  

Höglund, H. (2022). The Heartbeat of Poetry: Student Videomaking in Response to Poetry. Written Communication, 39 (2), 276-302. https://doi.org/10.1177/07410883211070862 

Huang, S. (2017). Critical multimodal literacy with moving-image texts. English Teaching: Practice & Critique, 16(2), 194-206. https://doi.org/10.1108/ETPC-02-2017-0018  

Hutchison, A. (2018). Using Virtual Reality to Explore Science and Literacy Concepts. The Reading Teacher, 72(3), 343-353. https://doi.org/10.1002/trtr.1720  

Kim, D., & Li, M. (2021). Digital storytelling: Facilitating learning and identity development. Journal of Computers in Education, 8(1), 33-61. https://doi.org/10.1007/s40692-020-00170-9  

Kress, G. (2010). Multimodality. A Social Semiotic Approach to Contemporary Communication. Routledge. http://bit.ly/3nPMm78  

Kuby, C. R., Rucker, T. G., & Kirchhofer, J. M. (2015). 'Go Be a Writer': Intra-activity with materials, time and space in literacy learning. Journal of Early Childhood Literacy, 15(3), 394-419. https://doi.org/10.1177/1468798414566702 

Latorre, A. (2005). La investigación-acción. Conocer y cambiar la práctica educativa. Graó. https://bit.ly/3OdHW5a  

Leander, K., & Boldt, G. (2013). Rereading "A Pedagogy of Multiliteracies." Journal of Literacy Research, 45(1), 22-46. https://doi.org/10.1177/1086296X12468587  

Lemieux, A., & Mason, S. (2022). When in Doubt, Map it Out: Teachers' Digital Storytelling Researched through Documentation. Canadian Journal of Learning and Technology, 48(1). https://doi.org/10.21432/cjlt28002  

Lewis, J. (2020). How children listen: Multimodality and its implications for K-12 music education and music teacher education. Music Education Research, 22(4), 373-387. https://doi.org/10.1080/14613808.2020.1781804  

Lim, V. F., & Tan, S. K. Y. (2018). Developing Multimodal Literacy Through Teaching the Critical Viewing of Films in Singapore. Journal of Adolescent & Adult Literacy, 62(3), 291-300. https://doi.org/10.1002/jaal.882  

Lozada, V., Rios-Jimenez, E., Hansen-Thomas, H., Richins, L. G., & South, S. (2022). A Night of Music: Sustaining Our Students' Culture. Journal of General Music Education, 35(2), 13-19. https://doi.org/10.1177/10483713211032311  

MacLure, M. (2016). The Refrain of the A-Grammatical Child: Finding Another Language in/for Qualitative Research. Cultural Studies ↔ Critical Methodologies, 16(2), 173-182. https://doi.org/10.1177/1532708616639333  

Marsh, J. (2004). Popular culture, new media and digital literacy in early childhood. Routledge. Http://bit.ly/40l8apy 

McIntire, A. M. (2020). Musical text: An effective instrument in teaching language and culture. Journal of Visual Literacy, 39(3-4), 185-200. https://doi.org/10.1080/1051144X.2020.1826221  

Mills, K. A., & Unsworth, L. (2018). The multimodal construction of race: A review of critical race theory research. Language and Education, 32(4), 313-332. https://doi.org/10.1080/09500782.2018.1434787 

Morera, B. J., Nadal, I. & López, M. B. (2020). Música y lengua de signos a cuatro voces: una experiencia educativa y musical para la inclusión. Revista Electrónica de LEEME, 45, 35-52. https://doi.org/10.7203/LEEME.45.16244  

Morgade, M., Verdesoto, A., & Poveda, D. (2016). Hip-Hop echoes in south Madrid teenagers' soundscapes. Linguistics and Education, 36, 27-34. https://doi.org/10.1016/j.linged.2016.07.001  

Narey, M. J. (2019). Understanding Stories as Multimodal Experiences in Young Children's Development. In K. J. Kerry-Moran & J.-A. Aerila (Eds.), Story in Children's Lives: Contributions of the Narrative Mode to Early Childhood Development, Literacy, and Learning (pp. 131-152). Springer International Publishing. https://doi.org/10.1007/978-3-030-19266-2_8  

Nash, B. L. (2023). Attending to the Sounds of Stories: The Affordances of Audiobooks in the English Classroom. Changing English, 1-8. https://doi.org/10.1080/1358684X.2023.2169899  

Ocaña-Fernández, A., & Reyes-López, M. (2010). The sonic imagination of children in Andalusia: A musical analysis of the TV programme "The Band". El imaginario sonoro de la población infantil andaluza: Análisis musical de "La Banda" [The sonic imagination of children in Andalusia: A musical analysis of the TV programme "The Band"]. Comunicar, 35, 193-200. https://doi.org/10.3916/C35-2010-03-13 

Olaussen, I. O. (2022). A playful orchestration in narrative expressions by toddlers-A contribution to the understanding of early literacy as event. Early Years, 42(2), 137-150. https://doi.org/10.1080/09575146.2019.1600138  

Pahl, K. (2019). Recognizing young people's civic engagement practices: Re-thinking literacy ontologies through co-production. Studies in Social Justice, 13 (1), 20-39. https://doi.org/10.26522/SSJ.V13I1.1950  

Page, M.J., Mckenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J.M., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E.W., Mayo-Wilson, E., Mcdonald, S., McGuiness, L.A., Stewart, L.A., Thomas, J., Tricco, A.C., Welch, V.A., Whiting, P., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, (89), 10-10. https://doi.org/10.1186/s13643-021-01626-4  

Petchauer, E. (2020). “Oh boy, I ain’t playin’ no games!”: Making sense with youth in the aural imaginary. English Teaching, 19(3), 365-379. https://doi.org/10.1108/ETPC-08-2019-0103  

Pytash, K. E., Kist, W., & Testa, E. (2017). Remixing My Life: The Multimodal Literacy Memoir Assignment and STEM. Journal of Adolescent & Adult Literacy, 61(2), 163-172. https://doi.org/10.1002/jaal.633  

Rowsell, J. (2013). Working with multimodality: Rethinking literacy in a digital age. Routledge. https://bit.ly/41Hjhcg  

Rowsell, J., & Walsh, M. (2011). Rethinking literacy education in new times: multimodality, multiliteracies & new literacies. Brock Education Journal, 21(1), 53-62. https://doi.org/10.26522/brocked.v21i1.236 

Salmon, A. (2010). Using music to promote children's thinking and enhance their literacy development, Early Child Development and Care, 180(7), 937-945. https://doi.org/10.1080/03004430802550755  

Seely Flint, A., Rohloff, R., & Williams, S. (2021). "I like the first slide. I like how we put it like that [words and pictures on a diagonal]:" composing multimodal texts in a grade four classroom. English Teaching: Practice & Critique, 20(3), 277-297. https://doi.org/10.1108/ETPC-12-2019-0173  

Shanahan, L. (2012). Use of sound with digital text: Moving beyond sound as an add-on or decoration. Contemporary Issues in Technology and Teacher Education, 12(3), 264-285. https://bit.ly/43aDyZM  

Simpson, A., & Walsh, M. (2015). Children's literature in the digital world: How does multimodality support affective, aesthetic and critical response to narrative? English Teaching: Practice & Critique, 14(1), 28-43. https://doi.org/10.1108/ETPC-12-2014-0005  

Smith, B. E., & Dalton, B. (2016). "Seeing It From a Different Light": Adolescents' Video Reflections About Their Multimodal Compositions. Journal of Adolescent & Adult Literacy, 59(6), 719-729. https://doi.org/10.1002/jaal.503  

Smith, B. E., Pacheco, M. B., & de Almeida, C. R. (2017). Multimodal codemeshing: Bilingual adolescents' processes composing across modes and languages. Journal of Second Language Writing, 36, 6-22. https://doi.org/10.1016/j.jslw.2017.04.001  

Stufft, C. J., & Gillern, S. (2021). Fostering Multimodal Analyses of Video Games: Reflective Writing in the Middle School. Journal of Adolescent & Adult Literacy, 65(3), 245-255. https://doi.org/10.1002/jaal.1198  

Street, B. V. (1985). Literacy in Theory and Practice. Cambridge University Press.  

Street, B. V. (2011). Literacy inequalities in theory and practice: The power to name and define. International Journal of Educational Development, 31(6), 580-586. https://doi.org/10.1016/j.ijedudev.2010.09.005  

Tomlinson, M. M. (2014). Young Children's Music Play Ideas: Two Case Studies of Syncretic Literacy Practice in Classroom and Home Settings. International Journal of Early Childhood, 47(1), 119-134. https://doi.org/10.1007/s13158-014-0128-3  

Tomlinson, M. M. (2015). Transmodal redesign in music and literacy: Diverse multimodal classrooms. Journal of Early Childhood Literacy, 15(4), 533-567. https://doi.org/10.1177/1468798414552509  

Valtin, R., Bird, V., Brooks, G., Brozo, B., Clement, C., Ehmig, S., Garbe, C., Greef, M., Hanemann, K., Mallows, D., Nascimbeni, F., Sulkunen, S., Tamburlini, G. (2016). European declaration of the right to literacy. European Literacy Policy Network. http://bit.ly/3zCBPiu   

van Leeuwen, T. (1999). Speech, Music, Sound. MacMillan Press. https://doi.org/10.1007/978-1-349-27700-1  

Wallner, L. (2020). The Visual made Audible - Co-constructing Sound Effects as Devices of Comic Book Literacy in Primary School. Cuadernos Del Centro de Estudios de Diseño y Comunicación, 89. https://doi.org/10.18682/cdc.vi89.3810  

Wargo, J. M. (2017). Rhythmic rituals and emergent listening: Intra-activity, sonic sounds and digital composing with young children. Journal of Early Childhood Literacy, 17(3), 392-408. https://doi.org/10.1177/1468798417712573  

Wargo, J. M. (2018). #SoundingOutMySilence: Reading an LGBTQ Youth's Sonic Cartography as Multimodal (Counter)Storytelling. Journal of Adolescent & Adult Literacy, 62(1), 13-23. https://doi.org/10.1002/jaal.752  

Wargo, J. M. (2018). Writing With Wearables? Young Children's Intra-Active Authoring and the Sounds of Emplaced Invention. Journal of Literacy Research, 50(4), 502-523. https://doi.org/10.1177/1086296X18802880  

Wessel-Powell, C., Kargin, T., & Wohlwend, K. E. (2016). Enriching and Assessing Young Children's Multimodal Storytelling. The Reading Teacher, 70(2), 167-178. https://doi.org/10.1002/trtr.1491  

Wessel-Powell, C., Lu, Y.-H., & Wohlwend, K. (2018). Walking Dead Literacies: Zombies, Boys, and (Re)Animated Storytelling. The Reading Teacher, 72(3), 313-324. https://doi.org/10.1002/trtr.1721  

Williams, W. R. (2020). Examining Studio Ghibli's Animated Films: A Study of Students' Viewing Paths and Creative Projects. Journal of Adolescent & Adult Literacy, 63(6), 639-650. https://doi.org/10.1002/jaal.1043  

Wohlwend, K. E. (2015). One Screen, Many Fingers: Young Children's Collaborative Literacy Play With Digital Puppetry Apps and Touchscreen Technologies. Theory Into Practice, 54(2), 154-162. https://doi.org/10.1080/00405841.2015.1010837  

Yeh, H.-C., & Tseng, S.-S. (2020). Enhancing multimodal literacy using augmented reality. Language Learning, 24(1) 27-37. https://doi.org/10125/44706  

Yin, R. (2018). Case study research and applications: design and methods. Sage Publications. 

Zhang, K., Djonov, E., & Torr, J. (2016). Reading and Reinterpreting Picture Books on Children's Television: Implications for Young Children's Narrative Literacy. Children's Literature in Education, 47(2), 129-147. https://doi.org/10.1007/s10583-015-9259-x  

Additional Files

Published

2023-12-04