Multimodality and Type

Overview: Sensory design

The multi-sensory connections we form with the world allow us to create meaning and memory. As a part of my master's study, I wanted to understand multimodal experiences and their connections with typography. "As individuals, we intake information through our senses, creating awareness: our perception. Then, we process that information into our understanding (cognition), which in turn shapes our reality. These multi-sensory connections that form in our brain allow us to create meaning and memory. The more senses we engage, the more strongly we are tied to a moment, an object, a space. Studying the connection between senses and experiences, I found some of the experiments that combine different senses thus enhancing the memory of a particular event.

Type creates Experiences

Multimodality and type are closely related. How much does typography affect us? Do fonts have the power to change the mood and tone of a message? For example, just think about how a message in capslock feels like someone is YELLING at us.Typeface and font families are a part of the “Picture superiority effect” ( human beings are more likely to recall visual stimuli) Understanding how this typography contributes to cross-modal communication, I came across the experiments at the Crossmodal research laboratory at Oxford University, where Professor Charles Spence and his team research the links between words, shapes. Thus proving how typefaces depict different feelings and emotions. Experiments around type and how type is a visual metaphor.

Type and Multimodality: Experiment Series

Take away:

Multimodality helps understand how senses create experiences. The multi-sensory experiences inspire stronger, more memorable reactions. Type here shows the potential of visual metaphor. The sensory design supports the opportunity to receive information, explore the world, and experience joy, wonder, and social connections, regardless of the level of sensory abilities.

@matersprojectAUB