Article In: AILA Review: Online-First Articles
Challenges and affordances in the assessment of digital multimodal composing
A systematic review
This content is being prepared for publication; it may be subject to changes.
Abstract
Digital multimodal composing (DMC), a key practice in multiliteracies learning, involves students creating
multimodal texts through digital tools. As literacy education broadens to include the engagement with digital multimodal texts,
DMC has emerged as an innovative pedagogical approach in literacy learning. While research has established its learning benefits,
comparatively less attention has been devoted to how DMC is assessed. This gap is critical because effective assessment is
essential to understanding how students engage with and learn through DMC. This systematic review synthesizes current research on
DMC assessment to examine the learning outcomes assessed and the approaches employed. Guided by the PRISMA protocol, 17 studies
published between 2010 and 2025 were analyzed, encompassing 20 distinct DMC assessment cases. The findings reveal that DMC
assessments commonly target language skills, multimodal competencies, and transversal outcomes. Self-developed or theory-informed
rubrics are the predominant tools used, with over half of the assessments adopting product-oriented approaches that focus solely
on final outputs. Two major challenges were then identified. First, while rubrics offer structure and practicality, their rigid
and prescriptive nature limits their ability to capture the multifaceted and emergent learning outcomes of DMC. Second, applying
rubrics to assess students’ DMC artefacts provides limited insight into students’ non-linear, fine-grained, and contextualized
learning processes. These constraints restrict DMC assessment’s potential to meaningfully scaffold learning and provide formative
feedback to students in the composing process. The paper concludes by discussing how the challenges of DMC assessment in language
classrooms can be addressed through innovative approaches that harness the affordances of digital tools and spaces.
Article outline
- 1.Introduction
- 2.Prior reviews, research gaps, and significance
- 3.Method
- 3.1Databases search
- 3.2Search strings
- 3.3Inclusion and exclusion criteria
- 3.4Coding scheme
- 4.Results
- 4.1General information
- 4.2What learning outcomes are assessed in DMC practices?
- 4.3What approaches are adopted to assess these learning outcomes in extant DMC practices?
- 5.Discussion and implications
- 5.1Toward a holistic understanding of DMC learning outcomes
- 5.2From fixed rubrics to adaptive, process-aware and technology-supported assessment
- 5.3Toward co-designed and participatory assessment ecologies
- 6.Conclusion
- Author queries
References
References (70)
Aagaard, T., & Lund, A. (2013). Mind
the gap: Divergent objects of assessment in technology-rich learning environments. Nordic
Journal of Digital
Literacy, 2013, 225–243.
Adsanatham, C. (2012). Integrating
assessment and instruction: Using student-generated grading criteria to evaluate multimodal digital
projects. Computers and
Composition, 29(2), 152–174.
Akoto, M. (2021). Collaborative
multimodal writing via Google Docs: Perceptions of French FL learners. Languages
(Basel), 6(3), 140.
Anderson, K. T. (2013). Contrasting
systemic functional linguistic and situated literacies approaches to multimodality in literacy and writing
studies. Written
communication, 30(3), 276–299.
Arms, V. M. (2012). Hybrids,
multi-modalities and engaged learners: A composition program for the Twenty-First
Century. Rocky Mountain review (Rocky Mountain Modern Language
Association), 66(2), 219–236.
Bengochea, A., Sembiante, S. F., & Gort, M. (2020). Attracting
and responding to an audience: Preschoolers’ multimodal composing in show-and-tell
activity. Language
Arts, 97(3), 135–145.
Black, P., & Wiliam, D. (2009). Developing
the theory of formative assessment. Educational Assessment Evaluation and
Accountability, 21, 5–31.
Bowen, T. (2017). Assessing
visual literacy: a case study of developing a rubric for identifying and applying criteria to undergraduate student
learning. Teaching in Higher
Education, 22(6), 705–719.
Burnett, R. E., Frazee, A., Hanggi, K., & Madden, A. (2014). A
programmatic ecology of assessment: Using a common rubric to evaluate multimodal processes and
artifacts. Computers and
Composition, 31(1), 53–66.
New London Group. (1996). A
pedagogy of multiliteracies: designing social futures. Harvard educational
review, 66(1), 60–92.
Cheung, A. (2023). Developing
and evaluating a set of process and product-oriented classroom assessment rubrics for assessing digital multimodal
collaborative writing in L2 classes. Assessing
writing, 56, 100723.
Cumming, J., Kimber, K., & Wyatt-Smith, C. (2012). Enacting
policy, curriculum and teacher conceptualisations of multimodal literacy and English in assessment and
accountability. English in Australia; v.47 n.1 p.9–18;
2012, 47(1), 9–18.
Curwood, J. S. (2012). Cultural
shifts, multimodal representations, and assessment practices: A case study. E-Learning and
Digital
Media, 9(2), 232–244.
Davis, H., & Reed, Y. (2003). Assessing
multimodal texts in multilingual classrooms. Perspectives in
Education, 21, 101–118.
Dawson, S., & Siemens, G. (2014). Analytics
to literacies: The development of a learning analytics framework for multiliteracies
assessment. International review of research in open and distance
learning, 15(4), 284–305.
Deng, Y., Liu, D., & Feng, D. (2023). Students’
perceptions of peer review for assessing digital multimodal composing: the case of a discipline-specific English
course. Assessment and evaluation in higher education,
ahead-of-print(ahead-of-print), 1–14.
Fjørtoft, H. (2020). Multimodal
digital classroom assessments. Computers and
education, 152, 103892.
Gašević, D., Dawson, S. & Siemens, G. Let’s
not forget: Learning analytics are about
learning. TechTrends 59, 64–71 (2015).
Hafner, C., & Ho, J. (2020). Assessing
digital multimodal composing in second language writing: Towards a process-based model. Journal
of Second Language Writing, 47, 100710.
Hafner, C., & Miller, L. (2011). Fostering
learner autonomy in English for science: A collaborative digital video project in a technological learning
environment. Language, Learning and
Technology, 15, 68–86.
Hafner, C. (2014). Embedding
digital literacies in English language teaching: Students’ digital video projects as multimodal
ensembles. TESOL
Quarterly, 48(4), 655–685.
Hung, H.-T., Chiu, Y.-C. J., & Yeh, H.-C. (2013). Multimodal
assessment of and for learning: A theory-driven design rubric. British Journal of Educational
Technology, 44(3), 400–409.
Jewitt, C. (2003). Re-thinking
assessment: Multimodality, literacy and computer-mediated learning. Assessment in Education:
Principles, Policy &
Practice, 10(1), 83–102.
Jiang, L., & Gu, M. (2025). Enabling
critical digital literacies through GenAI-assisted multimodal composing: A longitudinal inquiry of an ethnic minority English
teacher. System, 135, 103870.
Jiang, L., & Hafner, C. (2024). Digital
multimodal composing in L2 classrooms: A research agenda. Language
Teaching, 58(4), 528–546.
Jiang, L., & Luk, J. (2016). Multimodal
composing as a learning activity in English classrooms: Inquiring into the sources of its motivational
capacity. System
(Linköping), 59, 1–11.
Jiang, L., & Ren, W. (2020). Digital
Multimodal Composing in L2 Learning: Ideologies and Impact. Journal of Language, Identity &
Education, 20, 1–16.
Jiang, L., Yang, M., & Yu, S. (2020). Chinese
Ethnic Minority Students’ Investment in English Learning Empowered by Digital Multimodal
Composing. TESOL
Quarterly, 54(4), 954–979.
Jiang, L., Yu, S., & Lee, I. (2022). Developing
a genre-based model for assessing digital multimodal composing in second language writing: Integrating theory with
practice. Journal of Second Language Writing.
Kim, D., & Li, M. (2020). Digital
storytelling: facilitating learning and identity development. Journal of Computers in
Education, 8.
Kim, Y., Kang, S., Nam, Y., & Skalicky, S. (2022). Peer
interaction, writing proficiency, and the quality of collaborative digital multimodal composing task: Comparing guided and
unguided planning. System
(Linköping), 106, 102722.
Kress, G., & Selander, S. (2012). Multimodal
design, learning and cultures of recognition. The Internet and higher
education, 15(4), 265–268.
Lam, K. Y., & Putri, E. W. (2024). A
study on the affordances of digital fairy-tale rewriting: A critical literacy approach to digital multimodal
composing. System, 127, 103536.
Li, J., & Li, M. (2022). Assessing
L2 writing in the digital age: Opportunities and challenges. Journal of Second Language
Writing, 57, 100913.
Li, M. (2020). Multimodal
pedagogy in TESOL teacher education: Students’ perspectives. System
(Linköping), 94, 102337.
Liang, W. J., & Lim, F. V. (2021). A
pedagogical framework for digital multimodal composing in the English Language
classroom. Innovation in Language Learning and
Teaching, 15(4), 306–320.
Lim, F. V., & Nguyen, T. T. H. (2023). ‘If
you have the freedom, you don’t need to even think hard’ — considerations in designing for student agency through digital
multimodal composing in the language classroom. Language and
education, 37(4), 409–427.
Lim, F. V., Weninger, C., and Nguyen, T. T. H. (2021) “I
expect boredom”: Students’ experiences and expectations of multiliteracies
learning. Literacy, 55: 102–112.
Lim, F. V., Toh, W., & Ong, M. (2024). Assessing
multiliteracies: a systematic review and a perspective from Singapore. Asia Pacific Journal of
Education, 44(3), 597–610.
Lim, F. V., & Toh, W. (2026). Designing
learning with digital play: A multimodal
perspective. Routledge.
Liu, M., Zhang, L. J., & Neufeld, T. J. (2025). Chinese
EFL learners’ GenAI literacy in digital multimodal composing and self-regulated writing: chain mediation effects of needs
satisfaction and creative selfconcept. Innovation in Language Learning and
Teaching, 1–26.
Liu, Y., & Lim, F. V. (2025). Designing
for multimodal literacy and socio-emotional learning through digital multimodal
composing. In Querol-Julián, M. & Fortanet-Gómez, I. (Eds.). Multimodal
Literacy in English as an Additional Language in Higher
Education. (pp. 43–66). Routledge, London & New York.
Loerts, T., & Heydon, R. (2017). Multimodal
literacy learning opportunities within a grade six classroom literacy curriculum: constraints and
enablers. Education
3–13, 45(4), 490–503.
Long, P., & Siemens, G. (2011). What
is learning analytics. In Proceedings of the 1st International
Conference Learning Analytics and Knowledge,
LAK (Vol. 11).
Matthewman, S., Blight, A., & Davies, C. (2004). What
does multimodality mean for English? Creative tensions in teaching new texts and new
literacies. Education, Communication &
Information, 4(1), 153–176.
McGrail, E., & Behizadeh, N. (2017). K–12
multimodal assessment and interactive audiences: An exploratory analysis of existing
frameworks. Assessing
writing, 31, 24–38.
McHugh, M. L. (2012). Interrater
reliability: the kappa statistic. Biochemia
medica, 22(3), 276–282.
Mills, K. A., & Exley, B. (2014). Time,
space, and text in the elementary school digital writing classroom. Written
Communication, 31(4), 434–469.
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009). Preferred
reporting items for systematic reviews and meta-analyses: The PRISMA statement. Physical
Therapy, 89(9), 873–880.
Nash, B. (2018). Exploring
multimodal writing in secondary English classrooms: a literature review. English Teaching:
Practice and
Critique, 17(4), 342–356.
Nelson, M. E., Hull, G. A., & Roche-Smith, J. (2008). Challenges
of multimedia self-presentation: Taking, and mistaking, the show on the road. Written
Communication, 25(4), 415–440.
Pirbhai-Illich, F., Turner, K. C. N., & Austin, T. Y. (2009). Using
digital technologies to address Aboriginal adolescents’ education: An alternative school
intervention. Multicultural Education & Technology
Journal, 3(2), 144–162.
Ryu, J., Kim, Y. A., Eum, S., Park, S., Chun, S., & Yang, S. (2022). The
assessment of memes as digital multimodal composition in L2 classrooms. Journal of Second
Language Writing, 57, 100914.
Silseth, K., & Gilje, Ø. (2019). Multimodal
composition and assessment: a sociocultural perspective. Assessment in Education: Principles,
Policy &
Practice, 26(1), 26–42.
Smith, B. E. (2017). Composing
across modes: a comparative analysis of adolescents’ multimodal composing processes. Learning,
Media and
Technology, 42(3), 259–278.
Smith, B. E., Pacheco, M. B., & Khorosheva, M. (2021). Emergent
bilingual students and digital multimodal composition: A systematic review of research in secondary
classrooms. Reading Research
Quarterly, 56(1), 33–52.
Towndrow, P. A., Nelson, M. E., & Yusuf, W. F. B. M. (2013). Squaring
literacy assessment with multimodal design: An analytic case for semiotic awareness. Journal of
Literacy
Research, 45(4), 327–355.
Unsworth, L. (2006). Towards
a metalanguage for multiliteracies education: Describing the meaning-making resources of language-image
interaction. English Teaching: Practice and
Critique, 5(1), 55–76.
VanKooten, C., & Berkley, A. (2016). Messy
problem-exploring through video in first-year writing: Assessing what counts. Computers and
Composition, 40, 151–163.
Vincent, J. (2006). Children
writing: Multimodality and assessment in the writing
classroom. Literacy, 40(1), 51–57.
Webster, J., & Watson, R. T. (2002). Analyzing
the past to prepare for the future: Writing a literature review. MIS
Quarterly, 26(2), xiii–xxiii. [URL].
Wyatt-Smith, C., & Kimber, K. (2009). Working
multimodally: Challenges for assessment. English Teaching: Practice and
Critique, 8(3), 70. [URL]
Yi, Y., King, N., & Safriani, A. (2017). Reconceptualizing
assessment for digital multimodal Literacy. TESOL
Journal, 8(4), 878–885.
Yi, Y., Shin, D. S., & Cimasko, T. (2020). Multimodal
literacies in teaching and learning English in and outside of school. The Handbook of TESOL in
K-12, 163–177.
Yu, S., Zhang, E. D., & Liu, C. (2024). Research
into practice: Digital multimodal composition in second language writing. Language
Teaching, 59(2), 119–213.
Zammit, K. (2018). “We’re
all real serious filmmakers”: Learning about and creating multimodal
mini-documentaries. English Teaching: Practice &
Critique, 17.
Zhang, M., & Chen, W. (2022). Assessing
collaborative writing in the digital age: An exploratory study. Journal of Second Language
Writing, 57, 100868.