臺灣博碩士論文加值系統

摘 要

當聽覺事件與視覺事件出現的時間和空間距離都接近但卻來源不完全相同時，其中一項知覺訊息與另一項知覺訊息會產生空間上的交互作用。換句話說，即是其中一項感官刺激的訊息受到另一項感官刺激訊息的影響或干擾而在空間知覺上產生偏移的現象。這類視聽覺訊息在空間知覺上交互作用的現象可統稱為「腹語術」（ventriloquism）的現象。認知因素與訊息結構的因素對腹語術現象的影響，一直是受爭議的議題，而本研究主要在探討認知不一致、練習與預期等認知因素對腹語術現象的影響。

我們採用擬生活化的實驗材料來呈現視覺與聽覺刺激，要求受試者對實驗影片中人員所唸出雙字詞進行覆誦並計算覆誦正確率以排除傳統位置判斷法的缺失。本研究共進行三個實驗，實驗一採視覺訊息呈現位置（左螢幕/右螢幕）與視聽訊息認知一致性（一致/不一致）2 × 2二因子混合設計；實驗二採視覺訊息呈現位置（左螢幕/右螢幕）與視聽覺認知不一致訊息的練習與否（練習/不練習）2 × 2二因子混合設計；實驗三採視覺訊息呈現位置（左螢幕/右螢幕）與視聽訊息認知不一致可否預期（可預期/不可預期）2 × 2二因子混合設計，依變項皆為覆誦正確率，分別探討認知一致性、練習效果與預期對腹語術現象中知覺融合的影響。每個實驗有六十位受試者，共計180位受試者參與實驗。

實驗結果顯示，認知一致性與預期對視覺與聽覺訊息在空間上的整合會產生一定程度的影響；練習則無法改變受試者原先的認知狀態，對整合效果並不產生影響。這樣的結果，支持個體認知因素對此類事件的影響，而本研究的研究方法亦是一項突破。

Abstract

When auditory and visual events occur closely in time domain but at somewhat disparate spatial locations, the source localization of one modality interacts with that of the other modality in characteristic ways. That is, the spatial localization of one modality will be biased toward the other modality. We use the collective term “Ventriloquism” to call all these similar auditory-visual spatial interactions. The influences of cognitive factors and physical structure factors on ventriloquism are a controversial issue. In this study, we tested these cognitive factors such as Cognitive Inconsistence, Practice and Anticipation to see how they influence the ventriloquism phenomena.

We used fairly realistic materials to present visual and auditory stimulations. Subjects were asked to repeat Chinese double-character terms, and we counted the ratio of correct to avoid the defects in conventional position-judgment methods. There are three experiments in our study. In experiment 1, we used visual stimulus positions（left / right）and the visual-auditory cognitive consistence（consistence / inconsistence）as independent variables in a 2 × 2 mixed design；in experiment 2, we used the visual stimulus positions（left / right）and practices（practice / non-practice）as independent variables in a 2 × 2 mixed design；in experiment 3, we used the visual stimulus positions（left / right）and anticipation（anticipation / non- anticipation）as independent variables in a 2 × 2 mixed design. The dependent variables are response correct-ratios to test the cognitive factors such as Cognitive Inconsistence, Practice and Anticipation how to influence ventriloquism. There were 60 subjects participated in each experiment, and totally there were 180 subjects participating this study.

The findings of the present study suggested that: the magnitudes of visual-auditory perceptual fusion were influenced by cognitive inconsistence and anticipation, but were not influenced by practice. The results showed the influences of cognitive factors on ventriloquism and a new experiment paradigm was suggested.

目 錄

緒論-------------------------------------------------------------1
第一章 感覺訊息的處理-------------------------------------------4
第一節 感覺訊息的登錄------------------------------------4
第二節 感覺間的偏誤現象----------------------------------5
第三節 雙作業情境中聽覺訊息與視覺訊息的相互影響----------8
第二章 視覺強勢現象--------------------------------------------11
第一節 何謂視覺強勢（visual dominance）--------------------11
第二節 影響視覺強勢的因素--------------------------------13
第三章 腹語術現象----------------------------------------------15
第一節 腹語術現象的類型----------------------------------15
第二節 跨知覺偏誤與知覺融合之差異------------------------19
第三節 擬真情境與非擬真情境之差異------------------------22
第四節 結構性因素與認知因素在腹語術現象中扮演的角色------24
第五節 本研究的看法--------------------------------------33
第六節 研究假設------------------------------------------39
第四章 研究方法------------------------------------------------41
第一節 實驗一--------------------------------------------41
第二節 實驗二--------------------------------------------47
第三節 實驗三--------------------------------------------51
綜合討論與建議--------------------------------------------------55
參考文獻--------------------------------------------------------58

表 目 錄

表一之一 影響腹語術現象產生效果的結構性因素----------------------------25

表一之二 影響腹語術現象產生效果的認知因素-------------------------------26

表二 實驗一之實驗設計-------------------------------------------------------44

表三 實驗一兩組受試者在左右螢幕反應正確率的平均數、標準差
，以及平均數的差異顯著性考驗-------------------------------------45

表四 實驗二之實驗設計-------------------------------------------------------48

表五 實驗二兩組受試者在左右螢幕反應正確率的平均數、標準差
，以及平均數的差異顯著性考驗-------------------------------------49

表六 實驗三之實驗設計-------------------------------------------------------52

表七 實驗三兩組受試者在左右螢幕反應正確率的平均數、標準差
，以及平均數的差異顯著性考驗-------------------------------------53

圖 目 錄

圖一 跨管道偏誤模式圖（Welch ＆ Warren，1980）----------------------32

圖二 實驗室配置圖-------------------------------------------------------------------42

圖三 實驗一受試者反應正確率比較圖-------------------------------------------46

圖四 實驗二受試者反應正確率比較圖-------------------------------------------50

圖六 實驗三受試者反應正確率比較圖-------------------------------------------54

參考文獻

一、中文部分
葉素玲（著）（民88）。視覺與認知（第12章 視覺空間注意力）。台北：遠流出版公司。
劉英茂（著）（民69）。基本心理歷程。台北：大洋出版社。
鄭昭明 （編）（民82）。認知心理學。台北：桂冠圖書公司。
教育部國語推行委員會（編）（民87）。八十七年口語語料調查報告書。
二、外文部分
Bermant, R. I., & Welch, R. B. (1976). The effect of degree of visual-auditory stimulus separation and eye position upon the spatial interaction of vision and audition. Perceptual & Motor Skill, 43, 487-493.
Bertelson, P., & Aschersleben, G. (1998). Automatic visual bias of perceived auditory location. Psychonomic Bulletin & Review, 5(3), 482-489.
Bertelson, P., & Redeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception & Psychophysics, 29(6), 578-584.
Bertelson, P., & Redeau, M. (1976). Ventriloquism, sensory interaction, and response bias: Remarks on the paper by Choe, Welch, Gilford, and Juola. Perception & Psychophysics, 19(6), 531-535.
Bertelson, P., Vroomen, J., de Gelder, B., & Driver, J. (2000). The ventriloquist effect does not depend on the direction of deliberate visual attention. Perception & Psychophysics, 62(2), 321-332.
Choe, C. S., Welch, R. B., Gliford, R. M., & Juola, J. F. (1975). The “ventriloquist fffect”: Visual dominance or response bias? Perception & Psychophysics,18(1), 55-60.
Colavita, F. B. (1974). Human sensory dominance. Perception & Psychophysics, 1974, 16, 409-412.
Colavita, F. B. (1982). Visual dominance and attention in space. Bulletin of the Psychonomic Society, 19(5), 261-262.
Colavita, F. B., & Weisberg, D. (1979). A further investigation of visual dominance. Perception & Psychophysics, 25(4), 345-347.
de Gelder, B., & Vroomen, J. (2000). The perception of emotions by ear and by eyes. Cognition and Emotion, 14(3), 289-311.
Dixon, N. F., & Spitz, L. (1980). The detection of auditory visual desynchrony. Perception, 9(6), 719-721.
Driver, J. (1996). Enhancement of selective listening by illusory mislocation of speech sounds due to lip-reading. Nature, 381, 66-68.
Doody, S. G., & Long, M. A. (1984). Suppression of visual dominance in bimodal reation time. Perception and Motor Skills, 58, 602.
Ehrenstein, W. H., & Reinhardt-Rutland, A. H. (1996). A cross-modal aftereffect: Auditory displacement following adaptation to visual motion. Perception and Motor Skills, 82, 23-26.
Ellis, M. C. (1989). The effect of concurrent music reading and performance on the ability to detect tempo change. Journal of Research in Music Education, 37(4), 288-297.
Evens, G. W., Hygge, S., & Bullinger, M. (1995). Chronic noise and psychological stress. Psychological Science, 6(6), 333-338.
Fogelson, S. (1973). Music as distractor on reading-test performance of eighth grade students. Perceptual and Motor Slills, 36(3), 1265-1266.
Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech information across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception & Psychophysics, 50(6), 524-536.
Green, K. P., Kuhl, P. K., Meltzoff, A. N. (1988). Factors affecting the integration of auditory and visual information in speech: The effect of vowel environment. Journal of the Acoustical Society of America, 84, S155.
Hockey, R., Dornic, S., & Hamilton, P. (1975). Selective attention during reading : The effects of noise. Reports From The Institute of Applied Psychology, V. Stockholm, 66(pp:6).
Jack, C. E., & Thurlow, W. R. (1973). Effect of degree of visual association and angle of displacement on the “ventriloquism” effect. Perceptual & Motor Skills, 38, 967-979.
Kiger, M. C. (1989). Effect of music information load on a reading comprehension task. Perceptual and Motor Skills, 69(2), 531-534.
Madsen, C. K., & Wolfe, D. E. (1979). The effect of interrupted music and incompatible responses on bodily movement and music attentiveness. Journal of Music Therapy, 16(1), 17-30.
McGrath, M., & Summerfield, Q. (1985). Intermodal timing relations and audio-visual speech recognition by normal-hearing adults. Journal of the Acoustical Society of America, 77, 678-685.
Posner, M. I., Nissen, M. J., & Klein, R. M. (1976). Visual dominance: An information-processing account of its origins and significance. Psychological Review, 83(2), 157-171.
Predebon, J., & Woolley, J.S. (1994). The familiar-size cue to depth under reduced-cue viewing conditions. Perception, 23, 1301-1312.
Redeau, M. (1985). Signal intensity, task context, and auditory-visual interactions. Perception, 14, 571-577.
Redeau, M., & Bertelson, P. (1977). Adaption to auditory- visual discordance and ventriloquism in semirealistic situations. Perception & Psychophysics, 22(2), 137-146.
Redeau, M., & Bertelson, P. (1987). Auditory-visual interaction and the timing of inputs. Psychological Research, 49, 17-22.
Radeau, M., & Bertelson, P. (1974). The after-effects of ventriloquism. Quarterly Journal of Experimental Psychology, 26, 63-71.
Redeau, M., & Bertelson, P. (1976). The effect of a textured visual field on modality dominance in a ventriloquism situation. Perception & Psychophysics, 20(4), 227-235.
Shapiro, K. L., Egerman, B., & Klein, R. M. (1984). Effect of arousal on human visual dominance. Perception & Psychophysics, 35(6), 547-552.
Spence, C., & Driver, J. (1996). Audiovisual links in endogenous covert spatial attention. Journal of Experimental Psychology: Human Perception and Performance, 22(4), 1005-1030.
Spence, C., & Driver, J. (2000). Attracting attention to the illusory location of a sound : reflexive crossmodal orienting and ventriloquism. NeuroReport, 11(9), 2057-2061.
Spence, C., & Driver, J. (1997). Audiovisual links in exogenous covert spatial orienting. Perception & Psychophysics, 59(1), 1-22.
Tloczynski, J. (1993). Attention and visual dominance in motor learning. Perceptual and Motor Skills, 76, 655-666.
Vroomen, J., Bertelson, P., & de Gelder, B. (2001). The ventriloquist effect does not depend on the direction of automatic visual attention. Perception & Psychophysics. 63(4), 651-659.
Warren, D. H., Welch, R. B., & Mccarthy, T. J. (1981). The role of visual-auditory “compellingness” in the ventriloquism effect: Implications for transitivity among the spatial senses. Perception & Psychophysics, 30(6), 557-564.
Welch, R. B., & Warren, D. H. (1980). Immediate perceptual response to intersensory discrepancy. Psychological Bulletin, 88(3), 638-667.
Yantis, S., & Jonides, J. (1990). Abrupt visual onsets and selective attention: Voluntary versus automatic allocation. Journal of Expermental Psychology: Human Perception and Performance, 16(1), 121-134.