Música, Sonido y Alfabetización Multimodal: Una Revisión Sistemática
DOI:
https://doi.org/10.7203/LEEME.0.27500Keywords:
Alfabetización, Sonido, Música, Educación.
Abstract
La alfabetización multimodal implica el uso de múltiples modos de comunicación en la comprensión y producción de textos. Esta revisión examina el sonido y la música en la investigación sobre alfabetización multimodal, analizando 48 trabajos de las bases de datos Web of Science y Scopus. Identifica métodos y aspectos educativos comunes en los textos y explora cómo se aplica la alfabetización multimodal en entornos académicos. El estudio destaca la versatilidad del modo auditivo, que abarca efectos sonoros, vocalizaciones, música y otros. Sin embargo, algunos estudios limitan el uso del sonido a la "música de fondo", sin profundizar demasiado en su función comunicativa. Esta investigación contribuye a comprender las implicaciones del sonido y su potencial para implicar a los alumnos en una sociedad multimodal.
Author Biographies
José J. Roa-Trejo, Universidad Loyola Andalucía
Alejandra Pacheco-Costa, Universidad de Sevilla
Francisco Cuadrado, Universidad Loyola Andalucía
References
Alexander, K. P., DePalma, M. J., & Ringer, J. M. (2016). Adaptive Remediation and the Facilitation of Transfer in Multiliteracy Center Contexts. Computers and Composition, 41, 32-45. https://doi.org/10.1016/j.compcom.2016.04.005
Anderson, K. T., & Kachorsky, D. (2019). Assessing students' multimodal compositions: An analysis of the literature. English Teaching: Practice & Critique, 18(3), 312-334. https://doi.org/10.1108/ETPC-11-2018-0092
Baize, J. (2019). Classics in Their Own "Words": Analytical Remixes in a Land of Essays. Journal of Adolescent & Adult Literacy, 6(6), 625-633. https://doi.org/10.1002/jaal.942
Barton, G., Burke, K., & Freebody, P. (2022). Disciplinary literacies in the arts: Semiotic explorations of teachers' use of multimodal and aesthetic metalanguage. International Journal of Education & the Arts, 23(8), 1-22. http://doi.org/10.26209/ijea23n8
Bazalgette, C., & Buckingham, D. (2013). Literacy, media and multimodality: A critical response: Literacy, media and multimodality. Literacy, 47(2), 95-102. https://doi.org/10.1111/j.1741-4369.2012.00666.x
Bezemer, J., & Kress, G. (2008). Writing in Multimodal Texts: A Social Semiotic Account of Designs for Learning. Written Communication, 25(2), 166-195. https://doi.org/10.1177/0741088307313177
Binder, M., & Kotsopoulos, S. (2011). Multimodal literacy narratives: Weaving the threads of young Children's identity through the arts. Journal of Research in Childhood Education, 25 (4), 339-363. https://doi.org/10.1080/02568543.2011.606762
Blom, N. (2017). Creative Criticism: Dialogue and Aesthetics in the English Language Arts Classroom. Journal of Adolescent & Adult Literacy, 61(1), 45-54. https://doi.org/10.1002/jaal.634
Bloome, D. & Green, J. (2015). The social and linguistic turns in studying language and literacy. In J. Rowsell & K. Pahl (Eds.). The Routledge Handbook of Literacy Studies (pp. 19-34). Routledge. https://doi.org/10.4324/9781315717647
Burn, A. (2016). Making machinima: Animation, games, and multimodal participation in the media arts. Learning, Media and Technology, 41(2), 310-329. https://doi.org/10.1080/17439884.2015.1107096
Butler, E. D., Flint, T. K., & da Silva Iddings, A. C. (2021). The liberatory potentials of multimodality: Collaborative Reggaeton music video production in Habana, Cuba. Media, Culture & Society, 43(5), 842-859. https://doi.org/10.1177/0163443720987747
Chen, C. W. (2021). Composing print essays versus composing across modes: Students' multimodal choices and overall preferences. Literacy, 55(1), 25-38. https://doi.org/10.1111/lit.12234
Cooke, A., Smith, D., & Booth, A. (2012). Beyond PICO: The SPIDER tool for qualitative evidence synthesis. Qualitative Health Research, 22(10), 1435-1443. https://doi.org/10.1177/1049732312452938
Countryman, J., & Gabriel, M. A. (2014). Recess as a Site for Language Play. Language and Literacy, 16(3), 4-26. https://doi.org/10.20360/G2Q301
Crafton, L. K.; Silvers, P. & Brennan, M. (2009) Creating a critical multiliteracies curriculum: repositioning art in the early childhood classroom. In M. Narey (Ed.), Making Meaning Constructing Multimodal Perspectives of Language, Literacy, and Learning through Arts-based Early Childhood Education (pp. 31-51) Springer. https://doi.org/10.1007/978-0-387-87539-2
Dallacqua, A. K., Kersten, S., & Rhoades, M. (2015). Using Shaun Tan's Work to Foster Multiliteracies in 21st-Century Classrooms. The Reading Teacher, 69(2), 207-217. https://doi.org/10.1002/trtr.1395
Dalton, B., & Musetti, K. (2018). Tactile Picture Book Making and Multimodal Composition: Students Design for Equity in English Language Arts. In E. Ortlieb, E. H. Cheek, & P. Semingson (Eds.), Literacy Research, Practice and Evaluation (pp. 195-213). Emerald Publishing Limited. https://doi.org/10.1108/S2048-045820180000009015
Dalton, B., & Smith, B. E. (2015). How Do I Know What I Think until I See What I Produce in My Video: A Case for Video Reflection. In E. Ortlieb, L. E. Shanahan, & M. B. McVee (Eds.), Literacy Research, Practice and Evaluation (pp. 231-248). Emerald Group Publishing Limited. https://doi.org/10.1108/S2048-045820150000006011
DeNora, T. (2009). Music in Everyday Life. Cambridge University Press. https://doi.org/10.1017/CBO9780511489433
DePalma, M. (2015). Tracing transfer across media: Writers' perceptions of cross-contextual and rhetorical reshaping in processes of remediation. College Composition and Communication, 67(1), 615-642. https://www.jstor.org/stable/43491903
Doerr-Stevens, C., & Buckley-Marudas, M. (2019). Hearing Knowledge into Action: Mobilizing Sound for Multicultural Imaginaries. International Journal of Multicultural Education, 21(1), 105-124. https://doi.org/10.18251/ijme.v21i1.1735
Domingo, M. (2012). Linguistic layering: Social language development in the context of multimodal design and digital technologies. Learning, Media and Technology, 37(2), 177-197. https://doi.org/10.1080/17439884.2012.670645
Domingo, M., Jewitt, C., & Kress, G (2015). Multimodal social semiotics. Writing in online contexts. In J. Rowsell & K. Pahl (Eds.), The Routledge handbook of literacy studies (pp. 251-256). Routledge. https://doi.org/10.4324/9781315717647
Elwick, A., Burnard, P., Osgood, J., Huhtinen-Hildén, L., & Pitt, J. (2020). Young children's experiences of music and soundings in museum spaces: Lessons, trends and turns from the literature. Journal of Early Childhood Research, 18(2), 174-188. https://doi.org/10.1177/1476718X19888717
Flewitt, R. (2013). Multimodal perspectives on early childhood literacies. In The SAGE Handbook of Early Childhood Literacy, Second Edition (pp. 295-310). SAGE Publications Ltd. https://doi.org/10.4135/9781446247518
Garcia, A., Robillard, S. M., Suzara, M., & Garcia, J. E. (2021). Bus riding leitmotifs: Making multimodal meaning with elementary youth on a public school bus. English Teaching: Practice & Critique, 20(3), 398-412. https://doi.org/10.1108/ETPC-07-2020-0080
Gillen, J. & Hall, N. (2013). The emergence of early childhood literacy. In J. Larson & J. Marsh (Eds.). The SAGE handbook of early childhood literacy (pp. 28-39). SAGE Publications Ltd. https://doi.org/10.4135/9781446247518
Hackett, A., & Somerville, M. (2017). Posthuman literacies: Young children moving in time, place and more-than-human worlds. Journal of Early Childhood Literacy, 17(3), 374-391. https://doi.org/10.1177/1468798417704031
Hannah Park, J. (2021). "Dear Future Me: Connecting College L2 Writers' Literacy Paths to an Envisioned Future Self Through a Multimodal Project. In D. Shin, T. Cimasko, & Y. Yi (Eds.), Multimodal Composing in K-16 ESL and EFL Education (pp. 73-86). Springer Singapore. https://doi.org/10.1007/978-981-16-0530-7_5
Harrop-Allin, S. (2017). Multimodality and the Multiliteracies Pedagogy: "Design" and "Recruitment" in South African Children's Musical Games. Journal of Research in Music Education, 65(1), 25-51. https://doi.org/10.1177/0022429417694874
Hess, J., Watson, V. W. M., & Deroo, M. R. (2019). "Show Some Love": Youth and Teaching Artists Enacting Literary Presence and Musical Presence in an After-School Literacy-and-Songwriting Class. Teachers College Record: The Voice of Scholarship in Education, 121(5), 1-44. https://doi.org/10.1177/016146811912100502
Hsieh, H. F., & Shannon, S. E. (2005). Three Approaches to Qualitative Content Analysis. Qualitative Health Research, 15(9), 1277-1288. https://doi.org/10.1177/1049732305276687
Höglund, H. (2022). The Heartbeat of Poetry: Student Videomaking in Response to Poetry. Written Communication, 39 (2), 276-302. https://doi.org/10.1177/07410883211070862
Huang, S. (2017). Critical multimodal literacy with moving-image texts. English Teaching: Practice & Critique, 16(2), 194-206. https://doi.org/10.1108/ETPC-02-2017-0018
Hutchison, A. (2018). Using Virtual Reality to Explore Science and Literacy Concepts. The Reading Teacher, 72(3), 343-353. https://doi.org/10.1002/trtr.1720
Kim, D., & Li, M. (2021). Digital storytelling: Facilitating learning and identity development. Journal of Computers in Education, 8(1), 33-61. https://doi.org/10.1007/s40692-020-00170-9
Kress, G. (2010). Multimodality. A Social Semiotic Approach to Contemporary Communication. Routledge. http://bit.ly/3nPMm78
Kuby, C. R., Rucker, T. G., & Kirchhofer, J. M. (2015). 'Go Be a Writer': Intra-activity with materials, time and space in literacy learning. Journal of Early Childhood Literacy, 15(3), 394-419. https://doi.org/10.1177/1468798414566702
Latorre, A. (2005). La investigación-acción. Conocer y cambiar la práctica educativa. Graó. https://bit.ly/3OdHW5a
Leander, K., & Boldt, G. (2013). Rereading "A Pedagogy of Multiliteracies." Journal of Literacy Research, 45(1), 22-46. https://doi.org/10.1177/1086296X12468587
Lemieux, A., & Mason, S. (2022). When in Doubt, Map it Out: Teachers' Digital Storytelling Researched through Documentation. Canadian Journal of Learning and Technology, 48(1). https://doi.org/10.21432/cjlt28002
Lewis, J. (2020). How children listen: Multimodality and its implications for K-12 music education and music teacher education. Music Education Research, 22(4), 373-387. https://doi.org/10.1080/14613808.2020.1781804
Lim, V. F., & Tan, S. K. Y. (2018). Developing Multimodal Literacy Through Teaching the Critical Viewing of Films in Singapore. Journal of Adolescent & Adult Literacy, 62(3), 291-300. https://doi.org/10.1002/jaal.882
Lozada, V., Rios-Jimenez, E., Hansen-Thomas, H., Richins, L. G., & South, S. (2022). A Night of Music: Sustaining Our Students' Culture. Journal of General Music Education, 35(2), 13-19. https://doi.org/10.1177/10483713211032311
MacLure, M. (2016). The Refrain of the A-Grammatical Child: Finding Another Language in/for Qualitative Research. Cultural Studies ↔ Critical Methodologies, 16(2), 173-182. https://doi.org/10.1177/1532708616639333
Marsh, J. (2004). Popular culture, new media and digital literacy in early childhood. Routledge. Http://bit.ly/40l8apy
McIntire, A. M. (2020). Musical text: An effective instrument in teaching language and culture. Journal of Visual Literacy, 39(3-4), 185-200. https://doi.org/10.1080/1051144X.2020.1826221
Mills, K. A., & Unsworth, L. (2018). The multimodal construction of race: A review of critical race theory research. Language and Education, 32(4), 313-332. https://doi.org/10.1080/09500782.2018.1434787
Morera, B. J., Nadal, I. & López, M. B. (2020). Música y lengua de signos a cuatro voces: una experiencia educativa y musical para la inclusión. Revista Electrónica de LEEME, 45, 35-52. https://doi.org/10.7203/LEEME.45.16244
Morgade, M., Verdesoto, A., & Poveda, D. (2016). Hip-Hop echoes in south Madrid teenagers' soundscapes. Linguistics and Education, 36, 27-34. https://doi.org/10.1016/j.linged.2016.07.001
Narey, M. J. (2019). Understanding Stories as Multimodal Experiences in Young Children's Development. In K. J. Kerry-Moran & J.-A. Aerila (Eds.), Story in Children's Lives: Contributions of the Narrative Mode to Early Childhood Development, Literacy, and Learning (pp. 131-152). Springer International Publishing. https://doi.org/10.1007/978-3-030-19266-2_8
Nash, B. L. (2023). Attending to the Sounds of Stories: The Affordances of Audiobooks in the English Classroom. Changing English, 1-8. https://doi.org/10.1080/1358684X.2023.2169899
Ocaña-Fernández, A., & Reyes-López, M. (2010). The sonic imagination of children in Andalusia: A musical analysis of the TV programme "The Band". El imaginario sonoro de la población infantil andaluza: Análisis musical de "La Banda" [The sonic imagination of children in Andalusia: A musical analysis of the TV programme "The Band"]. Comunicar, 35, 193-200. https://doi.org/10.3916/C35-2010-03-13
Olaussen, I. O. (2022). A playful orchestration in narrative expressions by toddlers-A contribution to the understanding of early literacy as event. Early Years, 42(2), 137-150. https://doi.org/10.1080/09575146.2019.1600138
Pahl, K. (2019). Recognizing young people's civic engagement practices: Re-thinking literacy ontologies through co-production. Studies in Social Justice, 13 (1), 20-39. https://doi.org/10.26522/SSJ.V13I1.1950
Page, M.J., Mckenzie, J.E., Bossuyt, P.M., Boutron, I., Hoffmann, T.C., Mulrow, C.D., Shamseer, L., Tetzlaff, J.M., Akl, E.A., Brennan, S.E., Chou, R., Glanville, J., Grimshaw, J.M., Hróbjartsson, A., Lalu, M.M., Li, T., Loder, E.W., Mayo-Wilson, E., Mcdonald, S., McGuiness, L.A., Stewart, L.A., Thomas, J., Tricco, A.C., Welch, V.A., Whiting, P., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Systematic Reviews, (89), 10-10. https://doi.org/10.1186/s13643-021-01626-4
Petchauer, E. (2020). “Oh boy, I ain’t playin’ no games!”: Making sense with youth in the aural imaginary. English Teaching, 19(3), 365-379. https://doi.org/10.1108/ETPC-08-2019-0103
Pytash, K. E., Kist, W., & Testa, E. (2017). Remixing My Life: The Multimodal Literacy Memoir Assignment and STEM. Journal of Adolescent & Adult Literacy, 61(2), 163-172. https://doi.org/10.1002/jaal.633
Rowsell, J. (2013). Working with multimodality: Rethinking literacy in a digital age. Routledge. https://bit.ly/41Hjhcg
Rowsell, J., & Walsh, M. (2011). Rethinking literacy education in new times: multimodality, multiliteracies & new literacies. Brock Education Journal, 21(1), 53-62. https://doi.org/10.26522/brocked.v21i1.236
Salmon, A. (2010). Using music to promote children's thinking and enhance their literacy development, Early Child Development and Care, 180(7), 937-945. https://doi.org/10.1080/03004430802550755
Seely Flint, A., Rohloff, R., & Williams, S. (2021). "I like the first slide. I like how we put it like that [words and pictures on a diagonal]:" composing multimodal texts in a grade four classroom. English Teaching: Practice & Critique, 20(3), 277-297. https://doi.org/10.1108/ETPC-12-2019-0173
Shanahan, L. (2012). Use of sound with digital text: Moving beyond sound as an add-on or decoration. Contemporary Issues in Technology and Teacher Education, 12(3), 264-285. https://bit.ly/43aDyZM
Simpson, A., & Walsh, M. (2015). Children's literature in the digital world: How does multimodality support affective, aesthetic and critical response to narrative? English Teaching: Practice & Critique, 14(1), 28-43. https://doi.org/10.1108/ETPC-12-2014-0005
Smith, B. E., & Dalton, B. (2016). "Seeing It From a Different Light": Adolescents' Video Reflections About Their Multimodal Compositions. Journal of Adolescent & Adult Literacy, 59(6), 719-729. https://doi.org/10.1002/jaal.503
Smith, B. E., Pacheco, M. B., & de Almeida, C. R. (2017). Multimodal codemeshing: Bilingual adolescents' processes composing across modes and languages. Journal of Second Language Writing, 36, 6-22. https://doi.org/10.1016/j.jslw.2017.04.001
Stufft, C. J., & Gillern, S. (2021). Fostering Multimodal Analyses of Video Games: Reflective Writing in the Middle School. Journal of Adolescent & Adult Literacy, 65(3), 245-255. https://doi.org/10.1002/jaal.1198
Street, B. V. (1985). Literacy in Theory and Practice. Cambridge University Press.
Street, B. V. (2011). Literacy inequalities in theory and practice: The power to name and define. International Journal of Educational Development, 31(6), 580-586. https://doi.org/10.1016/j.ijedudev.2010.09.005
Tomlinson, M. M. (2014). Young Children's Music Play Ideas: Two Case Studies of Syncretic Literacy Practice in Classroom and Home Settings. International Journal of Early Childhood, 47(1), 119-134. https://doi.org/10.1007/s13158-014-0128-3
Tomlinson, M. M. (2015). Transmodal redesign in music and literacy: Diverse multimodal classrooms. Journal of Early Childhood Literacy, 15(4), 533-567. https://doi.org/10.1177/1468798414552509
Valtin, R., Bird, V., Brooks, G., Brozo, B., Clement, C., Ehmig, S., Garbe, C., Greef, M., Hanemann, K., Mallows, D., Nascimbeni, F., Sulkunen, S., Tamburlini, G. (2016). European declaration of the right to literacy. European Literacy Policy Network. http://bit.ly/3zCBPiu
van Leeuwen, T. (1999). Speech, Music, Sound. MacMillan Press. https://doi.org/10.1007/978-1-349-27700-1
Wallner, L. (2020). The Visual made Audible - Co-constructing Sound Effects as Devices of Comic Book Literacy in Primary School. Cuadernos Del Centro de Estudios de Diseño y Comunicación, 89. https://doi.org/10.18682/cdc.vi89.3810
Wargo, J. M. (2017). Rhythmic rituals and emergent listening: Intra-activity, sonic sounds and digital composing with young children. Journal of Early Childhood Literacy, 17(3), 392-408. https://doi.org/10.1177/1468798417712573
Wargo, J. M. (2018). #SoundingOutMySilence: Reading an LGBTQ Youth's Sonic Cartography as Multimodal (Counter)Storytelling. Journal of Adolescent & Adult Literacy, 62(1), 13-23. https://doi.org/10.1002/jaal.752
Wargo, J. M. (2018). Writing With Wearables? Young Children's Intra-Active Authoring and the Sounds of Emplaced Invention. Journal of Literacy Research, 50(4), 502-523. https://doi.org/10.1177/1086296X18802880
Wessel-Powell, C., Kargin, T., & Wohlwend, K. E. (2016). Enriching and Assessing Young Children's Multimodal Storytelling. The Reading Teacher, 70(2), 167-178. https://doi.org/10.1002/trtr.1491
Wessel-Powell, C., Lu, Y.-H., & Wohlwend, K. (2018). Walking Dead Literacies: Zombies, Boys, and (Re)Animated Storytelling. The Reading Teacher, 72(3), 313-324. https://doi.org/10.1002/trtr.1721
Williams, W. R. (2020). Examining Studio Ghibli's Animated Films: A Study of Students' Viewing Paths and Creative Projects. Journal of Adolescent & Adult Literacy, 63(6), 639-650. https://doi.org/10.1002/jaal.1043
Wohlwend, K. E. (2015). One Screen, Many Fingers: Young Children's Collaborative Literacy Play With Digital Puppetry Apps and Touchscreen Technologies. Theory Into Practice, 54(2), 154-162. https://doi.org/10.1080/00405841.2015.1010837
Yeh, H.-C., & Tseng, S.-S. (2020). Enhancing multimodal literacy using augmented reality. Language Learning, 24(1) 27-37. https://doi.org/10125/44706
Yin, R. (2018). Case study research and applications: design and methods. Sage Publications.
Zhang, K., Djonov, E., & Torr, J. (2016). Reading and Reinterpreting Picture Books on Children's Television: Implications for Young Children's Narrative Literacy. Children's Literature in Education, 47(2), 129-147. https://doi.org/10.1007/s10583-015-9259-x
Downloads
Additional Files
Published
Issue
Section
License
Authors who have publications with this journal agree to the following terms:
a) Authors will retain their copyright and will grant the journal the right of first publication of their work, which will simultaneously be subject to the Creative Commons Attribution License that allows third parties to share the work as long as its author and first publication in this journal are indicated.
b) Authors may enter into other non-exclusive licensing arrangements for the distribution of the published version of the paper (e.g. depositing it in an institutional telematic archive or publishing it in a monographic volume) provided that initial publication in this journal is indicated.
c) Authors are allowed and encouraged to disseminate their work via the Internet (e.g. in institutional telematic archives or on their website) before and during the submission process, which may lead to interesting exchanges and increase citations of the published work.
d) They agree to act as reviewers, if requested by the journal's editorial team.
Language
Information