The ability to communicate cultural codes in multimedia depends on their meaning and beauty, as perceived by different audiences around the globe. In this book, the ongoing research on computational modeling of visual, musical and textual contents is described in terms of identifying and mapping their semantic representations across different cultures. The underlying psychology of sense-making is quantified through analysis of aesthetics in terms of organizational and structural aspects of the contents that influence an audience"s formation of expectations for future signals, violations of these expectations, and explanations of their meaning. Complexity-accuracy tradeoffs in sound representation are further used to develop new computational methods that capture poietic and aesthetic aspects in music communication. Experimental studies are reported that try to characterize preferences for complexity in abstract, classical and traditional art and music across samples of Western and
Far Eastern cultures. These experiments illustrate how aesthetics can be computed in terms of semantic and information measures, highlighting commonalities and uncovering differences in aesthetic preferences across cultures and individuals.
Introduction.- A "Kansei" Multimedia and Semantic Computing System for Cross-Cultural Communication.- Cross-cultural Aesthetics: Analyses and Experiments in Verbal and Visual Arts.- Information Sensibility as a Cultural Characteristic: Tuning to Sound Details for Aesthetic Experience.
|
1 A `Kansei' Multimedia and Semantic Computing System for Cross-Cultural Communication |
|
|
1 | (20) |
|
|
1 | (1) |
|
1.2 The Mathematical Model of Meaning (MMM) |
|
|
2 | (1) |
|
1.3 Cross-Cultural Computing System for Music |
|
|
3 | (5) |
|
1.3.1 System Architecture |
|
|
4 | (2) |
|
1.3.2 Impression-Based Metadata Extraction for a Cross-Cultural Music Environment |
|
|
6 | (2) |
|
1.4 An Applied Model of MMM to Automatic Media-Decoration |
|
|
8 | (1) |
|
1.4.1 Basic Semantic Spaces and a Media-Transmission Space |
|
|
8 | (1) |
|
1.4.2 Basic Functions for Media Decoration |
|
|
9 | (1) |
|
1.5 Media Design with "Automatic Decorative Multimedia Creation" |
|
|
9 | (5) |
|
1.5.1 Music Decoration with Images |
|
|
10 | (1) |
|
1.5.2 Color-Based Impression Analysis for Video and Decoration with "Kansei" Information |
|
|
11 | (3) |
|
1.6 Cross-Cultural Computing System for Images |
|
|
14 | (4) |
|
|
18 | (3) |
|
|
19 | (2) |
|
2 Cross-Cultural Aesthetics: Analyses and Experiments in Verbal and Visual Arts |
|
|
21 | (22) |
|
2.1 A Theoretical Framework for Computing Aesthetics |
|
|
21 | (4) |
|
|
22 | (1) |
|
|
23 | (1) |
|
|
24 | (1) |
|
2.2 A Computational Model of Verbal Aesthetics |
|
|
25 | (4) |
|
|
25 | (2) |
|
|
27 | (1) |
|
2.2.3 Amusing Advertisements |
|
|
28 | (1) |
|
2.3 An Experimental Study of Visual Aesthetics |
|
|
29 | (9) |
|
|
30 | (4) |
|
2.3.2 Personal Preferences |
|
|
34 | (1) |
|
2.3.3 Cultural Comparison |
|
|
35 | (3) |
|
2.4 The Fundamental Challenge of Computing Semantics |
|
|
38 | (5) |
|
|
39 | (4) |
|
3 Information Sensibility as a Cultural Characteristic: Tuning to Sound Details for Aesthetic Experience |
|
|
43 | |
|
|
43 | (2) |
|
3.1.1 Information Dynamics |
|
|
45 | (1) |
|
3.2 Information Seeking as an Aesthetic Perception |
|
|
45 | (4) |
|
3.2.1 Information Dynamics and Music Cognition |
|
|
46 | (1) |
|
3.2.2 Musical Information: Structure Versus Meaning |
|
|
46 | (2) |
|
3.2.3 Paradigmatic Analysis Revisited |
|
|
48 | (1) |
|
3.3 The Variable Markov Oracle (VMO) Model: Capturing the Past to Predict the Future |
|
|
49 | (5) |
|
|
51 | (1) |
|
3.3.2 The Oracle Structure |
|
|
52 | (2) |
|
|
54 | (1) |
|
3.4 Neutral, Aesthetic and Poietic: Tuning Acoustic Sensibility in Order to Maximize the Information Rate |
|
|
54 | (4) |
|
3.4.1 Choice of Experimental Repertoire |
|
|
55 | (1) |
|
|
55 | (3) |
|
3.5 Results and Discussion |
|
|
58 | (2) |
|
3.5.1 Multi-level Listening |
|
|
60 | (1) |
|
|
60 | (1) |
|
|
61 | |
|
|
61 | |
Shlomo Dubnov is a Professor in Music and Computer Science in UCSD. He holds PhD in Computer Science from Hebrew University, MSc in EE from Israel Institute of Technology (Technion) and B.Mus in music composition from Rubin Academy in Jerusalem. He served as a researcher at Institute for Research and Coordination in Acoustics and Music (IRCAM) in Centre Pompidou, Paris and was a visiting professor in KEIO University, Japan, and Computer Science Laboratory (LaBRI) in University of Bordeaux, France. His work on computational modeling of style and computer audition has led to development of several computer music programs for improvisation and machine understanding of music. He currently directs the Center for Research in Entertainment and Learning (CREL) at UCSD's Qualcomm Institute (Calit2) and serves as a lead editor in ACM Computers in Entertainment Journal. Kevin Burns is a Cognitive Scientist researching human perceptions, decisions, emotions, andinteractions between humans and machines with applications to national security, industrial safety, organizational efficiency, and personal artistry. The objective across these diverse domains is to measure and model how people think and feel, as a basis for building machines that can help humans manage risk and enjoy life. Kevin is employed by The MITRE Corporation and holds engineering degrees from the Massachusetts Institute of Technology. Yasushi Kiyoki received his B.E., M.E. and Ph.D. degrees in electrical engineering from Keio University in 1978, 1980 and 1983, respectively. From 1984 to 1996, he was with Institute of Information Sciences and Electronics, Univ. of Tsukuba, as an assistant professor and then an associate professor. In 1990 and 1991, he was in University of California at Irvine, as a visiting researcher. Since 1996, he has been with Department of Environment and Information Studies at Keio University, and from 1998 he is currently a professor. Since 2011, he is a chair and coordinator of Global Environmental System Leader Program (GESL) in KEIO University. His research addresses semantic computing, environmental engineering, multimedia database systems and knowledge base systems. His original semantic model is Mathematical Model of Meaning (MMM), and he has more than 100 paper publications related to MMM. He serves as the editor-in-chief on Information Modelling and Knowledge Bases (IOS Press). He has also served as the program chair for several international conferences, such as International Conferences on Information Modelling and Knowledge Bases (2004 Present). He was a keynote speaker in 7th IEEE International Conference on Semantic Computing, Sept. 2013, as the title of A Kansei: Multimedia Computing System for Environmental Analysis and Cross-Cultural Communication.