Comics and Cognition develops an analytical approach to multimodal communication in comics through insights from embodied cognitive science, especially cognitive linguistics and visual psychology. Mike Borkent extends previous cognitive poetic frameworks to the study of multimodality in comics, providing a cohesive analytical framework that connects comics to other literary and artistic interests. His approach highlights the embodiment of cognition, a process which structures knowledge in long term memory, and activates it through perception, mental simulation, and blending. These cognitive processes allow readers to make impressions, predictions, inferences, and eventually conclusions about a text. Many of these layers of reader comprehension are unconscious but emerge into a conscious experience of the multimodal text with a richly construed and nuanced texture.
This book unpacks the dynamic interplay between the reader and the multimodal text throughout the processes of reading, including opportunities for interaction, interrogation, and improvisation of meaning derived from the reader's embodied and textual experiences, tackling crucial features of the comics form, and their impact on such issues as viewpoint, temporality, abstraction, metacommentary, and transmediation. The proposed multimodal cognitive poetics applies to narrative and art comics, in both print and digital media.
Using insights from cognitive science, Comics and Cognition provides a cohesive framework for understanding how readers make meaning out of the many features of comics, including images, language, and layouts, and in a range of styles from realistic to very abstract cues. Mike Borkent unpacks many unconscious patterns and processes that support the why's and how's of the textual experience, showing how perception, interaction, synthesis, and improvisation produce a dynamic interplay between the reader and the text creating a unique texture to readerly experience, including the development of different viewpoints, senses of time, and metacommentaries.