臺灣博碩士論文加值系統

先前研究顯示：一個在眾多低音（低音流）中的高音，會增進與其同時呈現的視覺刺激之辨識。過去學者猜測：此視覺辨識提升是因高音吸引了注意力，而注意力延長了刺激表徵的持續時間所致，彷若高音「凍結」了視覺刺激，故稱此現象為「凍結效應」。凍結效應是否存在於視覺之外的感官、和背後機制究竟為何，至今仍是個謎。本研究首次發表聽覺和觸覺間的凍結效應：一個低音流中的高音，會增進同時呈現的觸覺刺激辨識（實驗一）。本研究進一步使用定值刺激法，搭配二選項的強迫選擇(two-alternative forced-choice)，得到觸覺刺激持續時間長度和強度的主觀相等點，以代表受試者內在的主觀持續時間和主觀強度。結果顯示：和先前學者的猜測相反，高音並不會延長觸覺刺激的主觀持續時間，反而會加強主觀強度約12%（實驗二）。若直接提高觸覺刺激的物理強度12%，受試者的刺激辨識亦隨之提升（實驗三）。綜觀之，相較於延長刺激持續時間的注意力機制，本研究更加支持增加主觀強度的跨感官整合機制為凍結效應的背後歷程。

Identification of a visual target can be enhanced by a simultaneously presented high tone embedded in a sequence of low tones. This is called “freezing effect” because it is as if the target display was frozen in time by the tone. Until now, however, it has not been known whether this sound facilitation effect exists for a target with modalities other than vision, such as tactility, and if so, what its underlying mechanism is. We demonstrate, for the first time, an audio-tactile freezing effect (Experiment 1). We use a method of constant stimuli in conjunction with a 2-AFC task to determine the point of subjective equality (PSE) of the duration (Experiment 2A) or intensity (Experiment 2B) of the tactile target. Results do not support the view that a high tone expands the duration of the tactile target; rather, that the tone enhances participants’ subjective tactile intensity. When the tactile intensity of the target was increased to match the shift of PSE as in Experiment 2B, this increased intensity indeed improved identification, further suggesting that intensity enhancement is the mechanism (Experiment 3). The perceived tactile intensity enhancement by a sound indicates genuine multisensory integration.

誌謝 ...............................................................................................................................i
發表紀錄 ......................................................................................................................ii
摘要 .............................................................................................................................iii
Abstract ........................................................................................................................iv
Introduction ...................................................................................................................1
Experiment 1 .................................................................................................................5
Experiment 2 ...............................................................................................................11
Experiment 3 ...............................................................................................................17
General Discussion ......................................................................................................20
Acknowledgments .......................................................................................................27
References ...................................................................................................................28
Figures .........................................................................................................................35

Andersen, T. S., & Mamassian, P. (2008). Audiovisual integration of stimulus transients. Vision Research, 48, 2537–2544. doi:10.1016/j.visres.2008.08.018
Arabzadeh, E., Clifford, C. W. G., & Harris, J. A. (2008). Vision merges with touch in a purely tactile discrimination. Psychological Science, 19, 635–641. doi:10.1111/j.1467-9280.2008.02134.x
Carlander, O., & Eriksson, L. (2006). Uni- and bimodal threat cueing with vibrotactile and 3D audio technologies in a combat vehicle. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 50, 1552–1556. doi:10.1177/154193120605001608
Chen, K. M., & Yeh, S. L. (2009). Asymmetric cross-modal effects in time perception. Acta Psychologica, 130, 225–234. doi:10.1016/j.actpsy.2008.12.008
Eriksson, L., Berglund, A., Willen, B., Svensson, J., Petterstedt, M., Carlander, O., Lindahl, B., & Allerbo, G. (2008). On visual, vibrotactile, and 3D audio directional cues for dismounted soldier waypoint navigation. Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 52, 1282–1286. doi:10.1177/154193120805201827
Ernst, M. O., & Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature, 415, 429–433. doi:10.1038/415429a
Foxe, J. J., Wylie, G. R., Martinez, A., Schroeder, C. E., Javitt, D. C., Guilfoyle, D., Ritter, W., & Murray, M. M. (2002). Auditory-somatosensory multisensory processing in auditory association cortex: An fMRI study. Journal of Neurophysiology, 88, 540–543.
Gillmeister, H., & Eimer, M. (2007). Tactile enhancement of auditory detection and perceived loudness. Brain Research, 1160, 58–68. doi:10.1016/j.brainres.2007.03.041
Hidaka, S., Teramoto, W., Gyoba, J., & Suzuki, Y. (2010). Sound can prolong the visible persistence of moving visual objects. Vision Research, 50, 2093–2099. doi:10.1016/j.visres.2010.07.021
Hillstorm, A. P., Shapiro, K., & Spence, C. (2002). Attentional and perceptual limitations in processing sequentially presented vibrotactile targets. Perception & Psychophysics, 64, 1068–1082. doi:10.3758/BF03194757
Holmes, N. P., & Spence, C. (2005). Multisensory integration: Space, time and superadditivity. Current Biology, 15, R762–R764. doi: 10.1016/j.cub.2005.08.058
Lippert, M., Logothetis, N. K., & Kayser, C. (2007). Improvement of visual contrast detection by a simultaneous sound. Brain Research, 1173, 102–109. doi:10.1016/j.brainres.2007.07.050
Meredith, M. A. (2002). On the neuronal basis for multisensory convergence: A brief overview. Cognitive Brain Research, 14, 31–40. doi:10.1016/S0926-6410(02)00059-9
Ngo, K. M., & Spence, C. (2010a). Auditory, tactile, and multisensory cues facilitate search for dynamic visual stimuli. Attention, Perception, & Psychophysics, 72, 1654–1665. doi:10.3758/APP.72.6.1654
Ngo, K. M., & Spence, C. (2010b). Crossmodal facilitation of masked visual target discrimination by informative auditory cuing. Neuroscience Letters, 479, 102–106. doi:10.1016/j.neulet.2010.05.035
Ngo, K. M., & Spence, C. (2010c). Crossmodal facilitation of masked visual target identification. Attention, Perception, & Psychophysics, 72, 1938–1947. doi:10.3758/APP.72.7.1938
Ngo, K. M., & Spence, C. (in press). Facilitation of masked visual target identification in the absence of sound. Experimental Brain Research.
Noesselt, T., Bergmann, D., Hake, M., Heinze, H. J., & Fendrich, R. (2008). Sound increases the saliency of visual events. Brain Research, 1220, 157–163. doi:10.1016/j.brainres.2007.12.060
Oskarsson, P. A., Eriksson, L., & Carlander, O. (2012). Enhanced perception and performance by multimodal threat cueing in simulated combat vehicle. Human Factors, 54, 122–137. doi:10.1177/0018720811424895
Pick, H., Warren, D., & Hay, J. (1969). Sensory conflict in judgments of spatial direction. Attention, Perception, & Psychophysics, 6, 203–205.
Ro, T., Hsu, J., Yasar, N. E., Elmore, L. C., & Beauchamp, M. S. (2009). Sound enhances touch perception. Experimental Brain Research, 195, 135–143. doi:10.1007/s00221-009-1759-8
Rock, I., & Victor, J. (1964). Vision and touch: An experimentally created conflict between the two senses. Science, 143, 594–596. doi:10.1126/science.143.3606.594
Schurmann, M., Caetano, G., Hlushchuk, Y., Jousmaki, V., & Hari, R. (2006). Touch activates human auditory cortex. NeuroImage, 30, 1325–1331. doi:10.1016/j.neuroimage.2005.11.020
Schurmann, M., Caetano, G., Jousmaki, V., & Hari, R. (2004). Hands help hearing: Facilitatory audiotactile interaction at low sound-intensity levels. Journal of the Acoustical Society of America, 115, 830–832. doi:10.1016/j.neuroimage.2005.11.020
Schroeder, C. E., Lindsley, R. W., Specht, C., Marcovici, A., Smiley, J. F., & Javitt, D. C. (2001). Somatosensory input to auditory association cortex in the macaque monkey. Journal of Neurophysiology, 85, 1322–1327.
Spence, C., & Ho, C. (2008). Tactile and multisensory spatial warning signals for drivers. IEEE Transactions on Haptics, 1, 121–129. doi:10.1109/TOH.2008.14
Spence, C., & Ngo, M. K. (2012). Does crossmodal attention or multisensory integration explain the crossmodal facilitation of masked visual target identification in the freezing effect? In B. E. Stein (Ed.), The new handbook of multisensory processing (pp. 345–358). Cambridge, MA: MIT Press.
Sperdin, H. F., Cappe, C., & Murray, M. M. (2010). Auditory–somatosensory multisensory interactions in humans: Dissociating detection and spatial discrimination. Neuropsychologia, 48, 3696–3705. doi:10.1016/j.neuropsychologia.2010.09.001
Stein, B. E., London, N., Wilkinson, L. K., & Price, D. D. (1996). Enhancement of perceived visual intensity by auditory stimuli: A psychophysical analysis. Journal of Cognitive Neuroscience, 8, 497–506. doi:10.1162/jocn.1996.8.6.497
Talsma, D., Senkowski, D., Soto-Faraco, S., & Woldorff, M. G. (2010). The multifaceted interplay between attention and multisensory integration. Trends in Cognitive Sciences, 14, 400–410. doi:10.1016/j.tics.2010.06.008
Theeuwes, J. (1992). Perceptual selectivity for color and form. Perception & Psychophysics, 51, 599–606. doi:10.3758/BF03211656
Theeuwes, J. (1994). Stimulus-driven capture and attentional set: Selective search for color and visual abrupt onsets. Journal of Experimental Psychology: Human Perception and Performance, 20, 799–806. doi:10.1037/0096-1523.20.4.799
Tse, P. U., Intriligator, J., Rivest, J., & Cavanagh, P. (2004). Attention and the subjective expansion of time. Perception & Psychophysics, 66, 1171–1189. doi:10.3758/BF03196844
Van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: Nonspatial auditory signals improve spatial visual search. Journal of Experimental Psychology: Human Perception and Performance, 34, 1053–1065. doi:10.1037/0096-1523.34.5.1053
Vitello, M., & Ernst, M. O. (2007). Sound alters tactile motion perception. Paper presented at the 8th Annual Meeting of the International Multisensory Research Forum (IMRF), Sydney, Australia.
Vroomen, J., & de Gelder, B. (2000). Sound enhances visual perception: Cross-modal effects of auditory organization on vision. Journal of Experimental Psychology: Human Perception and Performance, 26, 1583–1590. doi:10.1037/0096-1523.26.5.1583
Wilson, E. C., Braida, L. D., & Reed, C. M. (2010). Perceptual interactions in the loudness of combined auditory and vibrotactile stimuli. Journal of the Acoustical Society of America, 127, 3038–3043. doi:10.1121/1.3377116
Wilson, E. C., Reed, C. M., & Braida, L. D. (2010). Integration of auditory and vibrotactile stimuli: Effects of frequency. Journal of the Acoustical Society of America, 127, 3044–3059. doi:10.1121/1.3365318
Zampini, M., Torresan, D., Spence, C., & Murray, M. M. (2007). Auditory-somatosensory multisensory interactions in front and rear space. Neuropsychologia, 45, 1869–1877. doi:10.1016/j.neuropsychologia.2006.12.004