Jewitt, C. (2012)

This chapter from The Sage Handbook of Digital Technology Research  provides an introduction to the field of multimodality and discusses its potential application for researching digital data and environments. It begins by outlining what multimodality is, its theoretical origins in social semiotics, and its underlying assumptions. A number of concepts central to multimodality are introduced: these include mode, semiotic resource, materiality, modal affordance, multimodal ensemble and meaning functions. The scope and potential of multimodality for researching digital technologies are then discussed. The chapter sets out an illustrative example of multimodal research. It concludes with a discussion of the limitations and challenges of a multimodal approach for researching digital technologies.

Read the full chapter on NCRM eprints