跳到主要內容

臺灣博碩士論文加值系統

(44.192.114.32) 您好!臺灣時間:2022/07/07 04:11
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:劉耘非
研究生(外文):Yun-Fei Liu
論文名稱:自然閱讀時腦部活動之受試者間相關係數研究
論文名稱(外文):Inter-Subject Neuronal Correlation during Natural Article Reading
指導教授:林發暄
口試委員:李佳穎吳嫻郭文瑞
口試日期:2015-05-22
學位類別:碩士
校院名稱:國立臺灣大學
系所名稱:生醫電子與資訊學研究所
學門:工程學門
學類:生醫工程學類
論文種類:學術論文
論文出版年:2015
畢業學年度:103
語文別:英文
論文頁數:62
中文關鍵詞:受試者間相關係數可讀性自然刺激右半腦功能性核磁共振造影
外文關鍵詞:inter-subject correlation (ISC)readabilitynatural stimuliright hemispherefunctional magnetic resonance imaging (fMRI)
相關次數:
  • 被引用被引用:0
  • 點閱點閱:282
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
過去針對閱讀理解的腦造影研究多半使用嚴格控制且簡化過的閱讀材料,並以迥異於日常閱讀情境的方式呈現給受試者。本實驗中,我們讓受試者以自然的方式閱讀整篇文章,並以功能性磁振造影(functional magnetic resonance imaging, fMRI)揭露對文章的用字遣詞與文字排列方式有所反應的腦區。具體而言,我們讓受試者閱讀選自紐約時報(新聞)與讀者文摘(故事)之英文原文經由專業譯者或翻譯軟體產生的兩種中文譯文。我們計算閱讀同一篇文章的各受試者腦部活動的相關係數。藉由本實驗的設計,我們得以探討一般情境下腦部活動因文體(紐約時報對上讀者文摘)或翻譯方式(人類對上機械翻譯)的差異而導致的腦部活動變化。
我們發現fMRI訊號的受試者間相關係數的空間分布情形確實受到文體與翻譯方式的調控。不論閱讀何種文體或翻譯方式的文章,我們都能在上、中顳葉皮質觀察到較低的受試者間相關係數(inter-subject correlation, ISC),同時能在中央溝前後的背內側皮質觀察到較高的ISC值。
進行文體間的對比後,發現右側前顳葉區域的ISC值在閱讀新聞時比閱讀故事時低;翻譯方式之間的對比則顯示右側下方額葉皮質在閱讀機械翻譯文章時的ISC值較高。綜上所述,當受試者需要使用較高的閱讀整合能力以理解一篇文章,右半腦的活動便會顯著提升。未來的神經語言學家若要進一步揭露自然語言裡解所牽涉的腦部處理歷程,本實驗所採用的方法與觀察到的結果可能有所助益。


Most neuroimaigng studies on reading comprehension use well-controlled simplified materials and show them in a way different from natural reading. In this study, we used functional magnetic resonance imaging (fMRI) with texts presented in a natural way to reveal brain areas sensitive to word choices and arrangements. Specifically, articles from the New York Times and the Reader’s Digest translated either by human or machine were presented to participants. The correlation of brain activity across participants during article reading was calculated. This experiment design allowed us to study how the common brain activity changes between text genres (New York Times vs. Reader’s Digest) and translations (human vs. machine translations).
We found that spatial distributions of correlated fMRI signal across participants were modulated by article genre and translation. Across text genres and translation, we found low inter-subject correlation (ISC) at superior and middle temporal cortices and high ISC at dorsal medial pre- and post-central cortices.
Comparing between text gernes, we found ISC values at right anterior temporal lobe were lower during news article reading than during fictional article reading. Comparing between translations, increased ISC values were observed at right inferior frontal cortex when reading texts translated by machine. Taken together, the right hemisphere is more activated when a higher demand in the reading comprehension capacity is required. The experimental approach and results described in this study may be useful for neurolinguists to further elucidate brain processes related to natural language comprehension.


口試委員審定書 ii
謝辭 iii
摘要 iv
Abstract v
CONTENTS vi
List of Figures vii
1. Introduction 1
1-1 Background and Problem Statement 1
1-2 Objectives of Study 5
1-3 Results in Brief 6
2. METHOD 7
2-1 Materials 7
2-1-1 Participants 7
2-1-2 Materials 8
2-1-3 Experiment Paradigm 10
2-1-4 MRI data acquisition 13
2-2 Data analysis 14
2-2-1 Preprocessing 14
2-2-2 Inter-subject Correlation Calculation and General Linear Model 15
3. RESULT 17
3-1 Behavioral results 17
3-2 Brain regions involved in reading each single genre or translation 18
3-3 Contrasts 21
3-4 Interaction 23
4. DISCUSSION 24
4-1 Brain Areas Involved in Natural Reading 25
4-2 Inter-genre Contrast 29
4-3 Inter-translation Contrast 32
4-4 Interaction effect 34
5. CONCLUSION 36
REFERENCES 37
Appendix Reading material used in this experiment 41


AbdulSabur, N. Y., Y. S. Xu, S. Y. Liu, H. M. Chow, M. Baxter, J. Carson and A. R. Braun (2014). "Neural correlates and network connectivity underlying narrative production and comprehension: A combined fMRI and PET study." Cortex 57: 107-127.
Beeman, M., R. B. Friedman, J. Grafman, E. Perez, S. Diamond and M. B. Lindsay (1994). "Summation Priming and Coarse Semantic Coding in the Right Hemisphere." Journal of Cognitive Neuroscience 6(1): 26-45.
Belitski, A., A. Gretton, C. Magri, Y. Murayama, M. A. Montemurro, N. K. Logothetis and S. Panzeri (2008). "Low-frequency local field potentials and spikes in primary visual cortex convey independent visual information." J Neurosci 28(22): 5696-5709.
Benjamini, Y. (2010). "Discovering the false discovery rate." Journal of the Royal Statistical Society: Series B (Statistical Methodology) 72(4): 405-416.
Bransfor.Jd, J. R. Barclay and J. J. Franks (1972). "SENTENCE MEMORY - CONSTRUCTIVE VERSUS INTERPRETIVE APPROACH." Cognitive Psychology 3(2): 193-209.
Bright, P., H. E. Moss, O. Longe, E. A. Stamatakis and L. K. Tyler (2007). "Conceptual structure modulates anteromedial temporal involvement in processing verbally presented object properties." Cerebral Cortex 17(5): 1066-1073.
Burin, D. I., L. Acion, J. Kurczek, M. C. Duff, D. Tranel and R. E. Jorge (2014). "The role of ventromedial prefrontal cortex in text comprehension inferences: Semantic coherence or socio-emotional perspective?" Brain and Language 129: 58-64.
Bush, G., P. Luu and M. I. Posner "Cognitive and emotional influences in anterior cingulate cortex." Trends in Cognitive Sciences 4(6): 215-222.
Cohen, L., S. Dehaene, L. Naccache, S. Lehéricy, G. Dehaene-Lambertz, M.-A. Hénaff and F. Michel (2000). "The visual word form area Spatial and temporal characterization of an initial stage of reading in normal subjects and posterior split-brain patients." Brain 123(2): 291-307.
Coltheart, M., K. Rastle, C. Perry, R. Langdon and J. Ziegler (2001). "DRC: a dual route cascaded model of visual word recognition and reading aloud." Psychological review 108(1): 204.
Correia, J., E. Formisano, G. Valente, L. Hausfeld, B. Jansma and M. Bonte (2014). "Brain-Based Translation: fMRI Decoding of Spoken Words in Bilinguals Reveals Language-Independent Semantic Representations in Anterior Temporal Lobe." The Journal of Neuroscience 34(1): 332-338.
Costafreda, S. G., C. H. Y. Fu, L. Lee, B. Everitt, M. J. Brammer and A. S. David (2006). "A systematic review and quantitative appraisal of fMRI studies of verbal fluency: Role of the left inferior frontal gyrus." Human Brain Mapping 27(10): 799-810.
Coulson, S. and Y. C. Wu (2005). "Right hemisphere activation of joke-related information: An event-related brain potential study." Journal of Cognitive Neuroscience 17(3): 494-506.
Crinion, J. T., M. A. Lambon‐Ralph, E. A. Warburton, D. Howard and R. J. Wise (2003). "Temporal lobe regions engaged during normal speech comprehension." Brain 126(5): 1193-1201.
Diaz, M. T., K. T. Barrett and L. J. Hogstrom (2011). "The influence of sentence novelty and figurativeness on brain activity." Neuropsychologia 49(3): 320-330.
Diaz, M. T. and L. J. Hogstrom (2011). "The Influence of Context on Hemispheric Recruitment during Metaphor Processing." Journal of Cognitive Neuroscience 23(11): 3586-3597.
Erickson, T. D. and M. E. Mattson (1981). "From words to meaning: A semantic illusion." Journal of Verbal Learning and Verbal Behavior 20(5): 540-551.
Ferstl, E. C., J. Neumann, C. Bogler and D. Y. von Cramon (2008). "The Extended Language Network: A Meta-Analysis of Neuroimaging Studies on Text Comprehension." Human brain mapping 29(5): 581-593.
Ferstl, E. C. and D. Y. von Cramon (2002). "What Does the Frontomedian Cortex Contribute to Language Processing: Coherence or Theory of Mind?" NeuroImage 17(3): 1599-1612.
Fisher, R. A. (1915). "Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population." Biometrika: 507-521.
Friederici, A. D. (2011). "The brain basis of language processing: from structure to function." Physiological reviews 91(4): 1357-1392.
Friederici, A. D. and S. M. E. Gierhan (2013). "The language network." Current Opinion in Neurobiology 23(2): 250-254.
Friederici, A. D., M. Meyer and D. Y. von Cramon (2000). "Auditory language comprehension: an event-related fMRI study on the processing of syntactic and lexical information." Brain and language 74(2): 289-300.
Friederici, A. D., S.-A. Rueschemeyer, A. Hahne and C. J. Fiebach (2003). "The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes." Cerebral cortex 13(2): 170-177.
Giora, R. (2003). On our mind: Salience, context, and figurative language, Oxford University Press New York.
Goldin, P. R., K. McRae, W. Ramel and J. J. Gross (2008). "The Neural Bases of Emotion Regulation: Reappraisal and Suppression of Negative Emotion." Biological Psychiatry 63(6): 577-586.
González, J., A. Barros-Loscertales, F. Pulvermüller, V. Meseguer, A. Sanjuán, V. Belloch and C. Ávila (2006). "Reading cinnamon activates olfactory brain regions." NeuroImage 32(2): 906-912.
Hasson, U., R. Malach and D. J. Heeger (2010). "Reliability of cortical activity during natural stimulation." Trends Cogn Sci 14(1): 40-48.
Hasson, U., Y. Nir, I. Levy, G. Fuhrmann and R. Malach (2004). "Intersubject Synchronization of Cortical Activity During Natural Vision." Science 303(5664): 1634-1640.
Holroyd, C. B. and N. Yeung (2012). "Motivation of extended behaviors by anterior cingulate cortex." Trends in Cognitive Sciences 16(2): 122-128.
Holtgraves, T. (2012). "The role of the right hemisphere in speech act comprehension." Brain and Language 121(1): 58-64.
Humphries, C., J. Binder, D. Medler and E. Liebenthal (2006). "Syntactic and semantic modulation of neural activity during auditory sentence comprehension." Cognitive Neuroscience, Journal of 18(4): 665-679.
Hutsler, J. and R. A. W. Galuske (2003). "Hemispheric asymmetries in cerebral cortical networks." Trends in Neurosciences 26(8): 429-435.
Jobard, G., F. Crivello and N. Tzourio-Mazoyer (2003). "Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies." Neuroimage 20(2): 693-712.
Jung-Beeman, M. (2005). "Bilateral brain processes for comprehending natural language." Trends in Cognitive Sciences 9(11): 512-518.
Kerns, J. G., J. D. Cohen, A. W. MacDonald, R. Y. Cho, V. A. Stenger and C. S. Carter (2004). "Anterior cingulate conflict monitoring and adjustments in control." Science 303(5660): 1023-1026.
Kuo, W.-J., T.-C. Yeh, C.-Y. Lee, Y. u.-T. e. Wu, C.-C. Chou, L.-T. Ho, D. L. Hung, O. J. L. Tzeng and J.-C. Hsieh (2003). "Frequency effects of Chinese character processing in the brain: an event-related fMRI study." NeuroImage 18(3): 720-730.
Lerner, Y., C. J. Honey, L. J. Silbert and U. Hasson (2011). "Topographic mapping of a hierarchy of temporal receptive windows using a narrated story." The Journal of Neuroscience 31(8): 2906-2915.
Mechler, F., J. D. Victor, K. P. Purpura and R. Shapley (1998). "Robust temporal coding of contrast by V1 neurons for transient but not for steady-state stimuli." J Neurosci 18(16): 6583-6598.
Mummery, C. J., K. Patterson, R. J. Wise, R. Vandenbergh, C. Price and J. Hodges (1999). "Disrupted temporal lobe connections in semantic dementia." Brain 122(1): 61-73.
Patterson, K., P. J. Nestor and T. T. Rogers (2007). "Where do you know what you know? The representation of semantic knowledge in the human brain." Nature Reviews Neuroscience 8(12): 976-987.
Pulvermüller, F., O. Hauk, V. V. Nikulin and R. J. Ilmoniemi (2005). "Functional links between motor and language systems." European Journal of Neuroscience 21(3): 793-797.
Ralph, M. A. L., G. Pobric and E. Jefferies (2009). "Conceptual knowledge is underpinned by the temporal pole bilaterally: convergent evidence from rTMS." Cerebral Cortex 19(4): 832-838.
Sanides, F. (1972). "Representation in the cerebral cortex and its areal lamination patterns." The structure and function of nervous tissue 5: 329-453.
Slotnick, S. D., W. L. Thompson and S. M. Kosslyn (2012). "Visual memory and visual mental imagery recruit common control and sensory regions of the brain." Cognitive Neuroscience 3(1): 14-20.
St George, M., M. Kutas, A. Martinez and M. I. Sereno (1999). "Semantic integration in reading: engagement of the right hemisphere during discourse processing." Brain 122: 1317-1325.
Subramaniam, K., M. Faust, M. Beeman and N. Mashal (2012). "The Repetition Paradigm: Enhancement of novel metaphors and suppression of conventional metaphors in the left inferior parietal lobe." Neuropsychologia 50(12): 2705-2719.
Sun, F., M. Morita and L. Stark (1985). "Comparative patterns of reading eye movement in Chinese and English." Perception & Psychophysics 37(6): 502-506.
Vigneau, M., V. Beaucousin, P.-Y. Hervé, G. Jobard, L. Petit, F. Crivello, E. Mellet, L. Zago, B. Mazoyer and N. Tzourio-Mazoyer (2011). "What is right-hemisphere contribution to phonological, lexico-semantic, and sentence processing?: Insights from a meta-analysis." NeuroImage 54(1): 577-593.
Vigneau, M., V. Beaucousin, P.-Y. Herve, H. Duffau, F. Crivello, O. Houde, B. Mazoyer and N. Tzourio-Mazoyer (2006). "Meta-analyzing left hemisphere language areas: phonology, semantics, and sentence processing." Neuroimage 30(4): 1414-1432.
Virtue, S., T. Parrish and M. Jung-Beeman (2008). "Inferences during Story Comprehension: Cortical Recruitment Affected by Predictability of Events and Working Memory Capacity." Journal of Cognitive Neuroscience 20(12): 2274-2284.
Visser, M., E. Jefferies and M. L. Ralph (2010). "Semantic processing in the anterior temporal lobes: a meta-analysis of the functional neuroimaging literature." Journal of Cognitive Neuroscience 22(6): 1083-1094.
Xu, J., S. Kemeny, G. Park, C. Frattali and A. Braun (2005). "Language in context: emergent features of word, sentence, and narrative comprehension." Neuroimage 25(3): 1002-1015.
Yao, H., L. Shi, F. Han, H. Gao and Y. Dan (2007). "Rapid learning in cortical coding of visual scenes." Nat Neurosci 10(6): 772-778.



QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top