8 2 2011 119129 The comprehension of synesthetic expressions with onomatopeic words Yukiyasu YAGUCHI (Graduate School of Humanities, Hosei University) Synesthetic expressions combine words that belong to di#erent sensory modalities. It is known that the understanding of synesthetic expressions is influenced by how the modalities are combined. However, expressions that use onomatopoeic words have not been examined to date, even though onomatopoeic words are synesthetic words. The present study examines comprehensible combinations of sensory modalities within synesthetic expressions that employ onomatopoeic words. In Experiment 1, the participants were asked to evaluate the sensory relevances of 47 onomatopoeic words. The results indicate that 39 of the onomatopoeic words are related to one of the five modalities (vision, hearing, touch, taste, and olfaction). In Experiment 2, the participants were asked to evaluate the degree to which 195 synesthetic expressions were comprehensible. The results indicate that, in principle, modification of high-modal words by lower-modal words can be understood. In addition, hearing was found to be independent of the other modalities within the structure of modification. Key words : Onomatopoeic words, Sensory relevance, Synesthetic expressions 1 47 39 2 195 (1999) (2007) (2005) 20 5 4 (2007) 4 (2005) (1980) 2005 (2009) 135 69 (51) 119
8 2 (2006) 10 1988 1999 1988 Ullmann (1959) Williams (1976) (1988) (1988) (1988) (1988) Marks (1982a, b) (1988) (1999) (ERP) N400 (1988) (1988) (1988) (1999) 1 120
(2006) (2006) MD (2006) (1999) 2 (1988) 1 1 47 1974 2003 1991 (1988) 33 9 3 13 5 3 14 1 7 5 1 47 Table 1 ABAB AB 67 31 36 20 SD0.98 A 36 12 24 B 31 19 12 (2006) 10 7 0 1 2 3 4 5 6 A 47 23 B 47 27 A 23 3 B 2 3 3 2 0.98 0.98 0.99 2 2 2 0.89 0.93 1 3 47 5 67 2 47 5 7 4 4.00 (Table 1) 1 27 2 121
8 2 Table 1 Mean scores of sensory relevance of 47 onomatopoeic words Vision Hearing Touch Taste Olfaction First group 4.50 1.97 2.20 1.51 2.28 4.42 1.94 3.13 2.10 1.90 5.50 1.53 2.72 0.83 0.72 5.61 1.45 1.74 0.52 0.68 5.61 2.94 1.39 0.92 0.83 5.72 2.14 0.92 0.78 0.83 5.16 2.42 1.06 1.58 1.71 5.65 2.39 1.94 1.39 1.26 5.23 3.81 1.58 0.71 1.10 4.89 1.67 1.25 0.61 2.08 3.94 5.45 1.77 0.87 0.87 3.94 4.94 0.94 0.58 0.71 3.77 5.52 0.94 0.68 0.84 3.08 5.00 0.86 0.56 1.00 2.97 4.65 1.84 0.77 0.77 3.52 4.03 3.23 2.39 1.03 2.44 4.50 2.22 2.33 1.14 3.92 2.23 5.03 3.56 1.61 3.45 3.10 4.50 1.10 0.77 3.94 1.97 5.58 2.39 1.89 3.97 2.87 5.50 3.20 1.17 3.33 1.25 4.92 3.89 1.92 3.68 2.45 4.58 1.84 0.84 3.06 0.97 2.97 5.25 2.64 3.06 1.32 1.94 5.65 2.55 3.22 2.81 3.11 3.69 4.97 2.00 3.29 0.84 1.39 4.87 Second group 4.50 1.83 5.50 2.28 0.81 4.92 1.89 5.61 1.86 0.75 4.28 2.36 5.61 3.61 1.03 4.13 1.81 5.06 3.94 2.03 5.17 1.11 5.42 1.44 0.86 4.71 2.13 5.48 2.90 1.45 4.10 1.52 5.81 3.35 1.29 4.31 4.83 2.61 1.00 0.94 3.74 4.39 5.48 1.65 0.55 4.36 1.25 2.58 5.08 2.50 Third group 4.03 1.32 4.71 4.94 2.35 4.56 4.89 4.36 1.37 0.83 Fourth group 3.10 1.70 1.17 1.00 1.83 3.00 1.97 1.03 0.94 1.00 3.03 1.72 1.97 2.64 1.25 2.46 3.44 2.47 1.83 1.54 3.92 3.25 3.64 2.19 1.61 3.94 1.77 3.58 2.55 0.71 3.61 2.33 2.03 1.08 0.92 3.58 1.71 2.13 1.74 0.94 The values more than a standard value(4) were painted out. 122
10 3 2 4 8 1 2 3 2 4 1 3 39 (Figure 1).1 5 (F(4, 152)40.59, p.05), Bon#eroni (p.05; Figure 1) Table 1 39 Table1 Ward Figure 2 Figure 1. Mean score of 39 onomatopoeic words. F(4, 38)10.39, p.05 F(4, 38)17.11, p.05; F(4,38)44.63, p.01; F(4, 38)19.95, p.05; F(4, 38)33.86 p.01 1 3 2 2 1 39 Ullmann (1959) Williams (1976) (1988) 1 47 39 Figure 2 (1988) 39 5 1 195 123
8 2 Figure 2. Result of the cluster analysis. 80 39 41 21.8 1 6 1 2 3 4 5 6 195 Table 2 39 5 Ullmann (1959) Williams (1976) (1988) 124
Table 2 Mean scores of intelligibility of 195 synesthetic expressions Vision Hearing Touch Taste Olfaction 4.54 3.51 4.12 3.66 3.66 5.18 4.25 3.68 3.80 3.85 5.02 4.49 2.29 2.51 2.02 5.30 2.93 2.25 2.23 1.93 5.32 4.12 3.85 4.51 3.83 5.02 4.00 3.27 4.20 3.46 4.18 4.33 2.55 2.25 2.15 5.07 2.98 2.61 1.95 1.85 3.54 2.90 2.63 2.05 1.83 5.59 3.61 3.29 3.17 3.80 Mean 4.87 3.71 3.05 3.03 2.84 SD 0.62 0.61 0.68 0.96 0.94 2.53 4.50 3.28 2.80 2.50 3.35 5.38 3.60 3.18 3.05 2.80 5.46 3.39 2.34 2.20 3.65 5.73 3.40 2.78 2.38 3.93 5.00 2.45 2.80 2.43 3.37 5.76 2.37 2.44 2.00 2.24 4.66 1.83 1.78 2.00 2.90 5.18 2.23 2.50 2.58 Mean 3.10 5.21 2.82 2.58 2.39 SD 0.57 0.46 0.67 0.42 0.34 2.63 3.32 5.80 3.13 2.24 3.27 2.90 5.71 3.22 1.93 5.46 2.44 4.32 2.27 2.12 3.24 3.76 5.34 4.20 2.22 3.85 3.32 5.73 3.63 2.02 4.27 3.27 5.20 3.90 3.17 3.63 2.73 5.95 4.00 2.80 2.88 3.63 5.56 3.07 2.63 3.90 3.68 4.83 5.20 3.75 3.98 2.37 5.12 4.66 3.54 3.34 2.27 3.83 3.34 3.54 3.15 2.05 3.23 4.28 3.50 4.05 4.34 4.85 3.73 2.90 2.20 4.07 4.44 2.98 1.61 3.20 4.29 5.54 2.83 1.90 3.10 4.83 4.53 2.18 2.10 Mean 3.51 3.33 5.00 3.54 2.62 SD 0.76 0.82 0.77 0.82 0.70 3.78 2.10 3.11 5.90 4.46 4.45 3.10 3.60 5.83 4.05 4.71 2.80 3.90 5.61 4.93 Mean 4.31 2.67 3.54 5.78 4.48 SD 0.48 0.52 0.40 0.15 0.44 2.46 2.66 2.83 3.85 5.39 1.83 3.37 1.73 2.05 5.32 Mean 2.15 3.01 2.28 2.95 5.35 SD 0.45 0.50 0.73 1.28 0.05 125
8 2 Figure 3. Construction of comprehensible combination of senses. This indicate mean scores of construction more than 3.5. 5 5 (1988) 3.5 3.5 6 3.50 Figure 3 3.50 1 3.54 4.31 4.48 2 3.54 3 1 2 1 47 39 2 1 39 28 (1999) 3 2 Table 1 12 Figure 2 (1988) (1988) 126
1 1 2 3 1 Figure 3 12 Table 2 3.5 Table 2 3.5 (1988) (1988) (1997) (2000) (2000) 127
8 2 (2000) 1, 2 (2000) 2008 (2007) (2009) 1988 3 (1974) (Amanuma, Y.) (2000) 30, 4759. (Hayakawa. F. (2000). The use of onomatopoeic terms for describing food properties according to sex and/or age. Bulletin/Odawara women s Junior College, 30, 4759.) (2000) 47, 197207. (Hayakawa. F., Hatae, K., & Shimada, A. (2000). Characterization of onomatopoeic terms for describing food poperties. Journal of the Japanese Society for Food Science and Technology, 47, 197207.) (2009) pp. 2331. (Hayakawa, F.) (2007) (Hirose, T.) (2006) 7, 119128. (Ikeda, T., Hayakawa, F., & Kamiyama, K.) (1988) 58, 373380. (Kusumi, T. (1988). Comprehension of synesthetic expressions: Cross-modal modifications of sense adjectives. The Japanese Journal of Psychology, 58, 373380.) Marks, J. E. (1982a). Synesthetic perception and poetic metaphor. Journal of Experimental Psychology: Human Perception and performance, 8, 1523. Marks, J. E. (1982b). Bright sneezes and dark coughs, loud sunlight and soft moonlight. Journal of Experimental Psychology: Human Perception and Performance, 8, 177193. (2009) 109, 5964. (Miura, K., & Uemura, S. (2009). Selection and integration of pictorial and linguistic information in the determination of a sense of speed: motion-line and onomatopoeia. IEICE Technical Report, 109, 5964.) (1980) SD 28, 183191. (Murakami, Y. (1980). The Inquiry of Phonetic Symbolism Hypothesis: Analyses of ono- 128
matopoeias by the olustering of the ontroduced oomponents of phonemes, SD technique, associated nouns, and associated verbs. The Japanese Journal of Educational Psychology, 28, 183191.) (2008) (Ministry of Education, Culture, Sports, Science and Technology) (1999) 99, 5559. (Oda, J., Matsuishi, K., Arao, H., & Sakamoto, T. (1999). Analysis of comprehension process of synaesthetic expressions, measuring Event-Related Potentials. IEICE Technical Report, 99, 5559.) (1999) (Osaka, N.) (1997) 1, 109113. (Sakurai, H., & Jingu, H. (1997). Verbal Expression of Perfume Material due to Synaesthesia. Japanese Journal of Sensory Evaluation, 1, 109113.) (2000). 4, 4551. (Sakurai, H. (2000). Verbal expression of fragrance due to synaesthesia in skin lotionsthe e#ects of hapic expressions. Japanese Journal of Sensory Evaluation, 4, 4551.) (2006). 77, 464470. (Suzuki, M., Gyoba, J., Kawabata, H., Yamaguchi, H., & Komatsu, K. (2006). Analyses of the sensory-relevance of adjective pairs by the modality di#erential method. The Japanese Journal of Psychology, 77, 464 470.) (1991) (Shogakutosyo gengokenkyujyo) (2005) 5, 9398. (Tsuchida, S.) Ullmann, S. (1959). The principles of semantics. 2nd ed. Oxford: Blackwell. Williams, J. M. (1976). Synaesthic adjectives: A possible law of semantic change. Language, 52, 461478. (2003) (Yamaguchi, N.) (1988) (Yamanashi, M.) (2005) 10, 115122. Yamauchi, K., & Iwamiya, S. (2005). Functional imagery and onomatopeic representation of auditory signals using frequencymodulated tones. Japanese Journal of Physiological Anthropology, 10, 115122. (2007) 54, 6776. (Yoshimura, H., & Sekiguchi, H. (2007). The world of up-down inverted vision verbalized by onomatopoeia. Bulletin of Faculty of Letters, Hosei University, 54, 6776.) 2010218 2010826 129