Article published In:
Information Design JournalVol. 25:3 (2019) ► pp.249–258
Information design and multimodality
New possibilities for engagement across theory and practice
Despite a long association between information design and semiotics, connections remain limited in many respects. This contribution argues that one reason for this is the traditionally weak connection between semiotics and empirical methods. To counter this, a model of multimodal communication is introduced in which theoretical description and empirical research are tightly bound methodologically. Several illustrations of the relevance of the model for information design are offered.
Keywords: multimodality, semiotics, empirical methods
Article outline
- 1.Introduction: A missing puzzle piece
- 2.The semiotics of semiotic modes
- 3.Consequences of the model
- 4.Description and mapping design choices
- 5.Experimentation and prediction
- 6.Conclusions and outlook
- Notes
-
References
References
Adami, E.
(2017) Multimodality. In O. García, N. Flores, & M. Spotti (Eds.), The Oxford handbook of language and society (pp. 451–472). Oxford: Oxford University Press.
Bateman, J. A.
(2018) Peircean semiotics and multimodality: Towards a new synthesis. Multimodal Communication, 7(1). 
(2019) Transmediality and the end of disembodied semiotics. International Journal of Semiotics and Visual Rhetoric, 3(2), 1–23.
Bateman, J. A., Beckmann, A., & Varela, R.
(2018) From empirical studies to visual narrative organization: Exploring page composition. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 127–153). London: Routledge.
Bateman, J. A. & Schmidt-Borcherding, F.
(2018) The communicative effectiveness of education videos: Towards an empirically-motivated multimodal account. Multimodal Technologies and Interaction, 2(3), 59.
Bateman, J. A., Veloso, F. O., & Lau, Y. L.
(2019) On the track of visual style: A diachronic study of page composition in comics and its functional motivation. Visual Communication.
Bateman, J. A., Wildfeuer, J., & Hiippala, T.
(2017) Multimodality – foundations, research and analysis. A problem-oriented introduction. Berlin: de Gruyter Mouton.
Black, A., Luna, P., Lund, O., & Walker, S.
(2017) Information design: Research and practice. London: Routledge.
Drucker, J. & McGann, J.
(2001) Images as the text: Pictographs and pictographic rhetoric. Information Design Journal, 10(2), 95–106.
Farias, P. L. & Queiroz, J.
(2006) Images, diagrams, and metaphors: Hypoicons in the context of Peirce’s Sixty-six-fold classification of signs. Semiotica, 1621, 287–308.
Frascara, J.
(2017) Review: Information design, research and practice. Information Design Journal, 23(2), 238–242.
Goodman, N.
(1969) Languages of Art. An approach to a theory of symbols. London: Oxford University Press.
Kress, G.
(2004) Reading images: Multimodality, representation and new media. Information Design Journal, 12(2), 110–119.
Morrissy, S.
(2017) Inexplicable in the last resort: A critique of Theo van Leeuwen’s identification of typography as a ‘mode’. Information Design Journal, 23(2), 184–193.
Skaggs, S.
(2017) The semiotics of non-virtuous data visualization: Why information design can never be pure. Information Design Journal, 23(2), 219–233.
Sless, D.
Tseng, C. I., Laubrock, J., & Pflaeging, J.
(2018) Character Developments in comics and graphic novels: A systematic analytical scheme. In A. Dunst, J. Laubrock, & J. Wildfeuer (Eds.), Empirical comics research. Digital, multimodal, and cognitive methods (pp. 154–175). London: Routledge.
Tufte, E. R.
(1983) The visual display of quantitative information. Cheshire, CT: Graphics Press.
van Leeuwen, T.