Search the World's Largest Database of Information Science & Technology Terms & Definitions
InfInfoScipedia LogoScipedia
A Free Service of IGI Global Publishing House
Below please find a list of definitions for the term that
you selected from multiple scholarly research resources.

What is Multimodality

Handbook of Research on ICTs and Management Systems for Improving Efficiency in Healthcare and Social Care
A modality, or, more explicitly, a modality of information representation, is a way of representing information in some medium ( Bernsen & Dybkjaer, 2009 ). By definition, a multimodal interactive system uses at least two different modalities for input and/or output. Multimodality allows an integrated use of various forms of interaction simultaneously.
Published in Chapter:
New Telerehabilitation Services for the Elderly
António Teixeira (University of Aveiro, Portugal), Carlos Pereira (University of Aveiro, Portugal), Miguel Oliveira e Silva (University of Aveiro, Portugal), Joaquim Alvarelhão (University of Aveiro, Portugal), Anabela G. Silva (University of Aveiro, Portugal), Margarida Cerqueira (University of Aveiro, Portugal), Ana Isabel Martins (University of Aveiro, Portugal), Osvaldo Pacheco (University of Aveiro, Portugal), Nuno Almeida (University of Aveiro, Portugal), Catarina Oliveira (University of Aveiro, Portugal), Rui Costa (GOVCOPP, University of Aveiro, Portugal), António Neves (University of Aveiro, Portugal), Alexandra Queirós (University of Aveiro, Portugal), and Nelson Rocha (University of Aveiro, Portugal)
DOI: 10.4018/978-1-4666-3990-4.ch006
Abstract
The world’s population is getting older with the percentage of people over 60 increasing more rapidly than any other age group. Telerehabilitation may help minimise the pressure this puts on the traditional healthcare system, but recent studies showed ease of use, usability, and accessibility as unsolved problems, especially for older people who may have little experience or confidence in using technology. Current migration towards multimodal interaction has benefits for seniors, allowing hearing and vision problems to be addressed by exploring redundancy and complementarity of modalities. This chapter presents and contextualizes work in progress in a new telerehabilitation service targeting the combined needs of the elderly to have professionally monitored exercises without leaving their homes with their need regarding interaction, directly related to age-related effects on, for example, vision, hearing, and cognitive capabilities. After a brief general overview of the service, additional information on its two supporting applications are presented, including information on user interfaces. First results from a preliminary evaluation are also included.
Full Text Chapter Download: US $37.50 Add to Cart
More Results
New Telerehabilitation Services for the Elderly
A modality, or, more explicitly, a modality of information representation, is a way of representing information in some medium (Bernsen & Dybkjaer, 2009). By definition, a multimodal interactive system uses at least two different modalities for input and/or output. Multimodality allows an integrated use of various forms of interaction simultaneously.
Full Text Chapter Download: US $37.50 Add to Cart
Service-Learning as a Means for Preparing Preservice Teachers to Work With English Language Learners
Using multiple means of communication to teach a lesson, such as visual, aural, linguistic, textual, etc.
Full Text Chapter Download: US $37.50 Add to Cart
Game Design as Literacy-First Activity: Digital Tools With/In Literacy Instruction
Modes (e.g., aural, spatial, gestural, visual, or linguistic) combined in a variety of ways to make meaning. Emphasis is on the unique affordances of each mode as they contribute to the meaning as a whole.
Full Text Chapter Download: US $37.50 Add to Cart
Digital Communication Landscapes on Language Learning Telecollaboration: A Cyberpragmatic Analysis of the Multimodal Elements of WhatsApp Interactions
Refers to the interplay between different representational modes, for instance, between images and written or spoken word.
Full Text Chapter Download: US $37.50 Add to Cart
Exploring Semiotic Approaches to Analysing Multidimensional Concept Maps Using Methods that Value Collaboration
This term refers to meanings made in many representational and communicational modes that include speech, writing, gesture, music, drawing and animation.
Full Text Chapter Download: US $37.50 Add to Cart
Transmedial and Transformational Practices in Comics Work
Communication practices that unite across modes, or methods of reproducing content.
Full Text Chapter Download: US $37.50 Add to Cart
Multiliteracies Performance Assessment Zones (MPAZ): A New Tool to Explore Multimodal Interactions for Virtual Learning
Multimodality has a twofold meaning: first it refers to the way in which a text has been designed, and second, it refers to the process involved during design. The intention is to tackle the deeper process of transition between written, oral, visual, audio, tactile, gestural and spatial modes, when a learner tries to make meaning from a particular text.
Full Text Chapter Download: US $37.50 Add to Cart
A Comparative Study on E-Note-Taking
An electronic system that enhances interactivity by amalgamating audio, visual and speech metaphors.
Full Text Chapter Download: US $37.50 Add to Cart
Legitimation by Digital Discourses: The Case of the Indigenous Protest in Ecuador, October 2019
Research design concerned about sources which contain the interaction and integration of two or more semiotic resources —text, static images or moving images (gifs, videos).
Full Text Chapter Download: US $37.50 Add to Cart
Use of Apps and Devices for Fostering Mobile Learning of Literacy Practices
Using visual, auditory, textual, and image-based ways of representation for the purposes of communicating with and engaging audiences.
Full Text Chapter Download: US $37.50 Add to Cart
Media Literacy in a Digital Age: Multimodal Social Semiotics and Reading Media
Multimodality refers to the use of more than one mode (such as linguistic, textual, spatial, and visual modes, etc.) in communication practices to create a particular message or set of messages.
Full Text Chapter Download: US $37.50 Add to Cart
Pedagogic Potentials of Multimodal Literacy
Refers to the simultaneous reading, processing and/or producing and interacting with various modes of print, image, movement, graphics, animation, sound, music and gesture. These modes, as well as language, are often referred to as different semiotic resources ( Kress & van Leeuwen, 2001 AU16: The citation "Kress & van Leeuwen, 2001" matches the reference "Kress VanLeeuwen 2001", but the capitalization is different. ) in that they each are symbol systems for communicating meaning.
Full Text Chapter Download: US $37.50 Add to Cart
Improving Multimedia Digital Libraries Usability Applying NLP Sentence Similarity to Multimodal Sentences
By definition, “multimodal” should refer to using more than one modality, regardless of the nature of the modalities. However, many researchers use the term “multimodal,” referring specifically to modalities that are commonly used in communication between people, such as speech, gestures, handwriting, and gaze. Multimodality seamlessly combines graphics, text, and audio output with speech, text, and touch input to deliver a dramatically enhanced end-user experience. When compared to a single-mode of interface in which the user can only use either voice/ audio or visual modes, multimodal applications gives them multiple options for inputting and receiving information.
Full Text Chapter Download: US $37.50 Add to Cart
Full Text Chapter Download: US $37.50 Add to Cart
Exploring Electronic Portfolio Assessment With Secondary Emergent Bi/Multilingual Students
A practice in which multiple modes (e.g., visual, textual, spatial, aural) are used for communication.
Full Text Chapter Download: US $37.50 Add to Cart
An Autoethnographic Approach to Adaptations and Limitations in Comics
As in the work of Gunther Kress, the way that certain texts work to unite design features across means of communication.
Full Text Chapter Download: US $37.50 Add to Cart
Learning for the Future: Emerging Technologies and Social Participation
This term is used to describe the different modes of human communication (visual, verbal, gestural etc). In many web-based texts, meaning is communicated through a subtle interplay between different expressive modes.
Full Text Chapter Download: US $37.50 Add to Cart
Influence of Positive Student-Teacher Interaction on the Meaning-Making Process in Virtual Learning: A Study in the Primary English Class
A complex entity that occurs in both print and digital settings [and] uses a variety of cultural and semiotic resources to articulate, represent, represent, and communicate a variety of narratives, concepts, or information.
Full Text Chapter Download: US $37.50 Add to Cart
Linguistically-Responsive Literacy Pedagogies Across Primary and Secondary Classrooms
A field of study that examines meaning-making through signs beyond just written language, including image, composition, gesture, and sound.
Full Text Chapter Download: US $37.50 Add to Cart
Empowering Teachers for Cultural and Linguistic Diversity via Multimodal Critical Identity Collages
Refers to both a process and a product that simultaneously uses more than mode or channel (e.g., spoken, written, visual images, gestural, musical) to represent and interpret a given communicative act or message.
Full Text Chapter Download: US $37.50 Add to Cart
Language Teachers' Investment in Digital Multimodal Composing (DMC) as a Manifold Application of Computer-Mediated Communication
It is known to be the “normal state of human communication” ( Kress, 2010 , p. 1), through and in which individuals create meaning through socially shaped semiotic modes and resources.
Full Text Chapter Download: US $37.50 Add to Cart
Designing for Purpose-Driven Technology Use Among Preservice English Teachers
The notion of multimodality considers the many situated modes that people use to communicate in their everyday lives. A multimodal perspective challenges assumptions regarding the dominance of language as a meaning making resource and focuses on how communication is accomplished through a range and combination of communication modes.
Full Text Chapter Download: US $37.50 Add to Cart
Sight Translation: Best Practices in Healthcare and in Training
Multimodality provides a framework for the analysis of visual, aural, embodied, and spatial aspects of communication, and the relationships between these modes.
Full Text Chapter Download: US $37.50 Add to Cart
An Innovative Architecture of a System for Storing and Managing Intangible Cultural Heritage
quality of a system to allow more than one communication modality to be used during human-computer interaction.
Full Text Chapter Download: US $37.50 Add to Cart
Expanding Potential for Written Engagement With the Visual and Textual
Full Text Chapter Download: US $37.50 Add to Cart
Fostering (Digital) Media Literacy Skills and Global Citizenship in the EFL Classroom: Digital Stories of Undocumented Youth
The language for digital storytelling, which, on YouTube, requires the capacity to understand how to best combine modes, such as texts, images, audio, or video in order to craft a visual argument.
Full Text Chapter Download: US $37.50 Add to Cart
Filmic Curation and Combination
The theoretical lens that guides examination of the ways that meaning is made across and within particular aspects/modes of a text.
Full Text Chapter Download: US $37.50 Add to Cart
Humor and Play in CMC
communication in more than one mode, e.g. text/graphics or text/audio
Full Text Chapter Download: US $37.50 Add to Cart
Reflecting on the Hive: Digital Literacy Trends
A theory that examines the meaning that is made across affordances in text, according to the designs of these texts.
Full Text Chapter Download: US $37.50 Add to Cart
Minecraft and Elementary Literacy Learning: The Perspectives and Ideas of Preservice Teachers
The use and integration of multiple communicative modes in media and human communication, such as visual, oral, and written information.
Full Text Chapter Download: US $37.50 Add to Cart
Implications for Choosing Film
The theoretical lens that guides examination of the ways that meaning is made across and within particular aspects/modes of a text.
Full Text Chapter Download: US $37.50 Add to Cart
Having social semiotic theory as a point of departure, multimodality considers that—like speech and writing—all modes (i.e. images, gestures, 3-dimensional forms, animation) consist of semiotic resources upon which people draw for the meaningful representation of events and relations. Adopting a multimodal approach at linguistic analysis entails looking at how language is embedded within a broader social semiotic rather than a decision to “side-line” language (Jewitt, 2008).
Full Text Chapter Download: US $37.50 Add to Cart
Good Practices in ESP: The Interplay Between Technology and Interaction Through Multimodal and Multichannel Practices
The interplay between three diverse modes: linguistic (speech), paralinguistic (prosody), and non-linguistic (body postures, facial expressions, gaze, gestures, spatiality, and positionality).
Full Text Chapter Download: US $37.50 Add to Cart
Technological Challenges to the Research and Development of Collaborative Working Environments
Multimodality harmoniously combines the different methods of communication between man and machine.
Full Text Chapter Download: US $37.50 Add to Cart
Multimedia Information Retrieval at a Crossroad
Multiple types of media data, or multiple aspects of a data item. Its emphasis is on the existence of more than one type (aspects) of data. For example, a clip of digital broadcast news video has multiple modalities, include the audio, video frames, closed-caption (text), and so forth.
Full Text Chapter Download: US $37.50 Add to Cart
Assessment of EAP Literacies in Diverse and Multilingual Classrooms
Combining different individual modes such as discipline-specific texts, audios, images, and videos to create meaningful communication that encourages interaction and learning in an EAP context.
Full Text Chapter Download: US $37.50 Add to Cart
It Is Real Colouring?: Mapping Children's Im/Material Thinking in a Digital World
Multimodality is a theory of communication. It refers to an artifact or product comprised of multiple modes (e.g. textual, aural, visual). Multimodal artifacts can be “read” using multiple senses.
Full Text Chapter Download: US $37.50 Add to Cart
Academic, Emotional, and Social Growth in the Second Language Classroom: A Study of Multimodality
An inter-disciplinary approach that advances the idea that communication and representations involves multiple modes including visual, aural, embodied, and spatial aspects.
Full Text Chapter Download: US $37.50 Add to Cart
Digital Storytelling and Augmented Reality-Based Scenarios for Foreign Language Teaching
The ability to understand and use a variety of visual, written and spoken data within one medium.
Full Text Chapter Download: US $37.50 Add to Cart
Multimodal Narrative Texts, Creativity, and English Teaching as a Foreign Language
Theory which studies how people communicate interact with each other not just through written text but with multiple modes such as images, gesture, color, music, posture, and so forth.
Full Text Chapter Download: US $37.50 Add to Cart
Film and Representation
The theoretical lens that guides examination of the ways that meaning is made across and within particular aspects/modes of a text.
Full Text Chapter Download: US $37.50 Add to Cart
Suggestopedia Meets TELTL: A Perfect Match?
In the context of this research: the pedagogical use of different modes (auditory, visual, spatial) of meaning afforded by digital tools.
Full Text Chapter Download: US $37.50 Add to Cart
Commercium and Cognitionis Project: A Gamification Experience in an Undergraduate Course
A property of messages and media, which states that meaning is always produced via multiple modes of communication and their combinations (written, oral, visual, procedural, gestural, sound).
Full Text Chapter Download: US $37.50 Add to Cart
Seeing Beyond the Screen: A Multidimensional Framework for Understanding Digital-Age Literacies
A field of study that examines meaning-making through signs beyond just written language, including image, composition, gesture, and sound.
Full Text Chapter Download: US $37.50 Add to Cart
What Does Digital Media Allow Us to “Do” to One Another?: Economic Significance of Content and Connection
Refers to multiple forms of communication that include language but do not privilege it over other modes such as still and moving images, sounds, gestures, icons, and performances.
Full Text Chapter Download: US $37.50 Add to Cart
The Appification of Literacy
A reference to the use of various ways to construct and communicate using print, visual, auditory, or even performance modes in combinations. Although the term if often associated with digital modes, it has also been used to distinguish between print and other visual modes that appear in genres like graphic novels.
Full Text Chapter Download: US $37.50 Add to Cart
The Effect of Multimodal Learning Preferences on Two English Instructional Programs
The use of more than one mode (e.g., image, video, gestures) to convey meaning or communicate.
Full Text Chapter Download: US $37.50 Add to Cart
Multimodal and Community-Based Literacies: Agentive Bilingual Learners in Elementary School
The use of and affirmation that a variety of modes carry semiotic meaning (e.g. oral, written, linguistic, visual, auditory, kinesthetic, spatial, etc.).
Full Text Chapter Download: US $37.50 Add to Cart
Authorial Work With Film
The theoretical lens that guides examination of the ways that meaning is made across and within particular aspects/modes of a text.
Full Text Chapter Download: US $37.50 Add to Cart
Toward a Participatory View of Early Literacies in Second Language Contexts: A Reflection on Research From Colombia
“We consider a multimodal text as any way that children use to express their ideas. Teachers can also use multimodality in their classes by including different ways to present the information” ( Cañas Mejía & Ocampo Castro, 2015 , p.22).
Full Text Chapter Download: US $37.50 Add to Cart
eContent Pro Discount Banner
InfoSci OnDemandECP Editorial ServicesAGOSR