臺灣博碩士論文加值系統

本研究的研究目的是探討影片字幕的呈現方式對於英語聽力理解與詞彙學習的影響。受測對象為105位台灣大學生，其英語程度為中低級，字幕的呈現方式為以下五種之一：(1)無字幕(控制組)、(2)完整字幕無聲、(3)完整字幕有聲、(4)完整字幕加目標詞標記、(5)完整字幕加目標詞標記和第一語言注釋。受測者看完影片後，依順序完成影片理解和三項詞彙測驗包含詞形辨識、詞義辨識及詞義回想。研究結果顯示，字幕呈現不同不會影響影片理解但是會影響詞彙學習。依據量化分析顯示，控制組和四組實驗組在影片理解測驗中平均分數無顯著差異。在詞形辨識測驗中，完整字幕有聲組、目標詞標記組和第一語言注釋組得分高於完整字幕無聲組和無字幕組。至於在詞義辨識和詞義回想測驗中，第一語言注釋組得最高分，其次是完整字幕有聲組，目標詞標記組、完整字幕無聲組和無字幕組得分最低。總而言之，第一語言注釋在詞彙學習的三方面幫助最大，表示有助於強化新單字詞形和詞義的連結。雖然目標詞標記有助於詞形辨識，卻無法有效幫助學習者辨識和回想詞義，因為目標詞標記只能提高學習者在詞形的注意力而不是詞彙的意義。完整字幕無聲組和無字幕組的學習效益不高，顯示適合詞彙學習的教材須同時包含聲音、影像和字幕。

This study investigated how different caption types influenced Chinese-speaking EFL learners in the vocabulary learning of videos. 105 Taiwanese undergraduates watched videos under one of five caption types: (1) no caption (NC), (2) full caption with no audio (NA), (3) full caption (FC), (4) full caption with highlighted target-words (HTW), and (5) full caption with highlighted target-words and L1 gloss (L1), and completed comprehension tests and three vocabulary tests including form recognition, meaning recognition and meaning recall.
The findings revealed that caption types did not affect video comprehension but did affect vocabulary acquisition. The groups scored around 53-66 percent of maximum score in the comprehension tests. As for vocabulary acquisition, the FC, HTW, and L1 groups performed significantly better than the NC and NA groups in form recognition. For meaning recognition and recall, the L1 group achieved the highest scores, followed by the FC group, while the NC, NA, and HTW groups obtained the lowest scores. Overall, L1 gloss facilitated all the three aspects of vocabulary acquisition, suggesting that it could reinforce form-meaning connection of new words. Although HTW improved form recognition, it did not have a positive effect on meaning recognition and recall, as HTW might increase attention to forms rather than to meanings. NC and NA were not helpful for vocabulary acquisition, suggesting that the participants learned vocabulary better with a combination of audio, image, and caption.

ABSTRACT (Chinese) i
ABSTRACT (English) ii
ACKNOWLEDGEMENTS iv
TABLE OF CONTENTS v
LIST OF TABLES viii
LIST OF FIGURES ix
CHAPTER ONE 1
Research Background 1
Research Questions 3
Significance of the Study 4
Outline of the Study 4
CHAPTER TWO 5
Theoretical Backgrounds of Multimedia Learning 5
Video Captioning Effects on Second Language Comprehension 7
Video Captioning Effects on Second Language Vocabulary Acquisition 10
Influence of Second Language Proficiency on Video Captioning Effects 12
Summary 15
CHAPTER THREE 18
Research Design 18
Participants 18
Materials 19
Videos 19
Instruments 22
Comprehension Tests 22
Vocabulary Tests 22
Procedures 23
Data Analysis 24
CHAPTER FOUR 25
Research Question 1: How do different types of captioning influence Chinese-speaking EFL learners’ comprehension of video content? 25
Research Question 2: How do different types of captioning influence Chinese-speaking EFL learners’ vocabulary acquisition, including form recognition, meaning recognition and meaning recall? 27
Form Recognition 27
Meaning Recognition 29
Meaning Recall 32
CHAPTER FIVE 35
Summary of the Study 35
Discussion of the Major Findings 36
The Effects of Video Captioning on Chinese-speaking EFL learners’ Comprehension 36
The Effects of Video Captioning on Chinese-speaking EFL learners’ Vocabulary Acquisition 38
Form Recognition 38
Meaning Recognition and Recall 41
Pedagogical Implications 43
Limitation and Suggestions for Future Studies 44
Conclusion 46
REFERENCES (English) 47
REFERENCES (Chinese) 55
APPENDIXES 56
Appendix A: Scripts of the Two Video Clips 56
Appendix B: Comprehension Test 60
Appendix C: Vocabulary Tests 64
Form Recognition Test 64
Meaning Recognition Test 66
Meaning Recall Test 68

Al-Seghayer, K. (2001). The effect of multimedia annotation modes on L2 vocabulary acquisition: A comparative study. Language Learning & Technology, 5 (1), 202-232.
Aldera, A. S. (2015). Investigating multimedia strategies to aid L2 listening
comprehension in EFL environment. Theory and Practice in Language Studies, 5(10), 1983.
Aldera, A. S., & Mohsen, M. A. (2013). Annotations in captioned animation: Effects
on vocabulary learning and listening skills. Computers & Education, 68, 60–75.
Alkhatnai, M. (2012). The effect of TV captions on the comprehension of non-native
Saudi learners of English. Sino-US English Teaching, 9(10), 1573–1579.
Alsaawi, A. (2013). To what extent guessing the meaning, from the context, is helpful
in teaching vocabulary. ARECLS, 10, 130–146
Amir Marzban, & Razieh Hadipour. (2012). Depth versus breadth of vocabulary knowledge: Aesscessing their roles in Iranian intermediate EFL students’ lexcial inferencing success through reading. Procedia-Social and Behavioral Sciences,46 (2012) 5296 – 5300
Bailey, Kathleen M. (1998). Learning about language assessment: Dilemmas, decisions, and directions. Boston, MA: Heinle, Cengage Learning
Baltova, I. (1994). The impact of video on the comprehension skills of core French
students. The Canadian Modern Language Review, 50, 507–532.
Baltova, I. (1999). The effect of subtitled and staged video input on the learning and
retention of content and vocabulary in a second language. Unpublished doctoral dissertation. University of Toronto, Toronto, Canada.
Başaran, H. F., & Köse, G. D. (2013). The effects of captioning on EFL learners’
listening comprehension. Procedia-Social and Behavioral Sciences, 70, 702–708.
Bird, S. A., & Williams, J. N. (2002). The effect of bimodal input on implicit and
explicit memory: An investigation into the benefits of within-language subtitling. Applied Psycholinguistics, 23(04), 509–533.
Brinton, D. (2001). The use of media in language teaching. In M. Celce-Murcia (Ed.),
Teaching English as a second or foreign language (pp. 459–476). Boston, MA: Heinle & Heinle.
Chandler, P., & Sweller, J. (1991). Cognitive load theory and the format of instruction.
Cognition and Instruction, 8, 293–332
Chun, D. M., & Plass, J. L. (1996). Effects of multimedia annotations on vocabulary
acquisition. The modern language journal, 80(2), 183–198.
Common European Framework of Reference for Languages. (n.d.) In Wikipedia. Retrieved June 27, 2017, from https://en.wikipedia.org/wiki/Common_European_Framework_of_Reference_for_Languages
Danan, M. (1992). Reversed subtitling and Dual Coding Theory: New directions for
foreign language instruction. Language Learning, 42(4), 497–527.
Danan, M. (1995). Reversed subtitling and dual coding theory: New directions for
foreign language instruction. In B.Harley (Ed.), Lexical issues in language learning (pp. 253–282). Ann Arbor, MI: Language LearningNohn Behjamins.
Danan, M. (2004). Captioning and subtitling: Undervalued language learning
strategies. Meta: Journal des traducteursMeta:/Translators' Journal, 49(1), 67–77.
de la Fuente, M. J. (2014). Learners' attention to input during focus on form listening
tasks: the role of mobile technology in the second language classroom. Computer Assisted Language Learning, 27(3), 261–276.
Dovedan, Z., Seljan, S., & Vučković, K. (2002). Multimedia in foreign language
learning. MIPRO 2002, Opatija. pp. 72–75.
Etemadi, A. (2012). Effects of bimodal subtitling of English movies on content
comprehension and vocabulary recognition. International journal of English linguistics, 2(1), 239.
Fazilatfar, A. M., Ghorbani, S., & Samavarchi, L. (2012). The effect of standard and
reversed subtitling versus no subtitling mode on L2 vocabulary learning. Journal of Teaching Language Skills, 30(1), 43–64.
Francis, M. A., & Simpson, M. L. (2009). Vocabulary development. Handbook of
college reading and study strategy research, 2, 97–120.
Garza, T. J. (1991). Evaluating the use of captioned video materials in advanced foreign language learning. Foreign Language Annals, 24(3), 239–258.
Gass, S. M. (1997). Input, interaction, and the second language learner. Mahwah, NJ:
Lawrence Erlbaum Associates.
Grgurović, M. (2005). Research into the use of help options in a multimedia listening
unit.
Guillory, H. G. (1998). The effects of keyword captions to authentic French video on
learner comprehension. Calico Journal, 89–108.
Hirsh, D., & Nation, P. (1992). What vocabulary size is needed to read unsimplified
texts for pleasure? Reading in a foreign language, 8, 689–689.
Homer, B. D., Plass, J. L., & Blake, L. (2008). The effects of video on cognitive load
and social presence in multimedia-learning. Computers in Human Behavior, 24(3), 786–797.
Hoogeveen, M. (1995). Towards a new multimedia paradigm: is multimedia assisted
instruction really effective. Paper presented at the Proceedings of ED-MEDIA.
Hsu, C.-K., Hwang, G.-J., Chang, Y.-T., & Chang, C.-K. (2013). Effects of Video
Caption Modes on English Listening Comprehension and Vocabulary Acquisition Using Handheld Devices. Educational Technology & Society, 16(1), 403–414.
Hu, H.-P., & Deng, L.-J. (2007). Vocabulary acquisition in multimedia environment.
US-China Foreign Language, 5(8), 55–59.
Hughes, Arthur. (1989). Testing for language teachers. Cambridge, UK: Cambridge University Press.
Jones, L. C. (2003). Supporting listening comprehension and vocabulary acquisition
with multimedia annotations: The students' voice. Calico Journal, 41–65.
Jones, L. C., & Plass, J. L. (2002). Supporting listening comprehension and
vocabulary acquisition in French with multimedia annotations. The modern language journal, 86(4), 546–561.
Laufer, B., & Nation, P. (1999). A vocabulary-size test of controlled productive
ability. Language testing, 16(1), 33–51.
Lee, J. F., & Van Patten, B. (2003). Making communicative language teaching
happen. New York, NY: McGraw Hill.
Leveridge, A. N., & Yang, J. C. (2013). Testing learner reliance on caption supports in
second language listening comprehension multimedia environments. ReCALL, 25(02), 199-214.
Leveridge, A. N., & Yang, J. C. (2014). Learner perceptions of reliance on captions in
EFL multimedia listening comprehension. Computer Assisted Language Learning, 27(6), 545–559.
Linebarger, D., Piotrowski, J. T., & Greenwood, C. R. (2010). On‐screen print: the
role of captions as a supplemental literacy tool. Journal of Research in Reading, 33(2), 148–167.
Liu, N., & Nation, I. S. P. (1985). Factors affecting guessing vocabulary in context. RELC Journal, 16(1), 33–42.
Liu, Y. T., & Todd, A. G. (2014). Dual‐Modality Input in Repeated Reading for
Foreign Language Learners With Different Learning Styles. Foreign language annals, 47(4), 684–706.
Lwo, L., & Lin, M. C.-T. (2012). The effects of captions in teenagers' multimedia L2
learning. ReCALL: the Journal of EUROCALL, 24(2), 188.
Martin, F., & Ertzberger, J. (2013). Here and now mobile learning: An experimental
study on the use of mobile technology. Computers & Education, 68, 76–85.
Markham, P. (2001). The influence of culture-specific background knowledge and captions on second language comprehension. Journal of Educational Technology Systems, 29(4), 331–343.
Mayer, R. E. (2005). The Cambridge handbook of multimedia learning. New York, NY: Cambridge university press.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia
learning. Educational psychologist, 38(1), 43–52.
Miller, Z. F., & Maloney, J. (2016). REVIEW OF LANGUAGE LEARNING WITH
DIGITAL VIDEO. About Language Learning & Technology, 46.
Mohsen, M. A. (2016). Effects of help options in a multimedia listening environment
on L2 vocabulary acquisition. Computer Assisted Language Learning, 29(7), 1220–1237.
Mohsen, M. A., & Balakumar, M. (2011). A review of multimedia glosses and their
effects on L2 vocabulary acquisition in CALL literature. ReCALL, 23(02), 135–159.
Montero Perez, M. & Peters, E. & Clarebout, G. & Desmet, P. (2014). Effects of
captioning on video comprehension and incidental vocabulary. Language, Learning & Technology, 18(1), 118–141.
Montero Perez, M. & Desmet, P. (2012). The effect of input enhancement in L2
listening on incidental vocabulary learning: A review. Procedia-Social and Behavioral Sciences, 34, 153–157.
Montero Perez, M. & Van Den Noortgate, W. & Desmet, P. (2013). Captioned video
for L2 listening and vocabulary learning: A meta-analysis. System, 41(3), 720–739.
Nation, I. S. (2001). Learning vocabulary in another language. Cambridge:
Cambridge University Press.
Neuman, S. B., & Koskinen, P. (1992). Captioned television as comprehensible input:
Effects of incidental word learning from context for language minority students. Reading research quarterly, 95–106.
Paivio, A. (1991). Dual coding theory: Retrospect and current status. Canadian Journal of Psychology, 45, 255–287.
Pavlova, M. (2013). Effective ways of foreign language learning with the cognitive
approach. Trakia Journal of Sciences, 11(3), 291.
Perfetti, C. A., & Tan, L. H. (1998). The time course of graphic, phonological, and
semantic activation in Chinese character identification. Journal of Experimental Psychology: Learning, Memory, and Cognition, 24(1), 101.
Peters, E., Heynen, E., & Puimège, E. (2016). Learning vocabulary through
audiovisual input: The differential effect of L1 subtitles and captions. System, 63, 134–148.
Plass, J. L., Chun, D. M., Mayer, R. E., & Leutner, D. (2003). Cognitive load in
reading a foreign language text with multimedia aids and the influence of verbal and spatial abilities. Computers in Human Behavior, 19(2), 221–243.
Prince, P. (1996). Second language vocabulary learning: The role of context versus
translations as a function of proficiency. The modern language journal, 80(4), 478–493.
Qian, D. D. (1999). Assessing the roles of depth and breadth of vocabulary knowledge in reading comprehension. Canadian Modern Language Review, 56, 282-307.
Rokni, A., & Ataee, A. (2014). Movies in EFL classrooms: With or without subtitles.
The Dawn Journal, 3(1), 715–726.
Stewart, M. A., & Pertusa, I. (2004). Gains to language learners from viewing target
language closed‐captioned films. Foreign language annals, 37(3), 438–442.
Sweller, J. (1988). Cognitive load during problem solving: Effects on learning.
Cognitive science, 12(2), 257–285
Sweller, J. (1989). Cognitive technology: Some procedures for facilitating learning
and problem solving in mathematics and science. Journal of educational psychology, 81(14), 457
Sydorenko, T. (2010). Modality of input and vocabulary acquisition. Language
Learning & Technology, 14(2), 50–73.
Talaván, N. (2007). Learning vocabulary through authentic video and subtitles.
Tesol-Spain Newsletter, 31, 5–8.
van Zeeland, H., & Schmitt, N. (2012). Lexical coverage in L1 and L2 listening
comprehension: The same or different from reading comprehension? Applied Linguistics, 33(5), 1–24.
Vanderplank, R. (1993). A very verbal medium: Language learning through closed
captions. TESOL journal, 3(1), 10–14.
Vanderplank, R. (1988). The value of teletext-sub-titles in language learning. English Language Teaching Journal, 42(4), 272-281
Vanderplank, R. (2010). Déjà vu? A decade of research on language laboratories,
television and video in language learning. Language teaching, 43(01), 1-37.
VanPatten, B., Williams, J., & Rott, S. (2004). Form-meaning connections in second
language acquistion. In B. Van Patten, J. Williams, S. Rott, & M. Overstreet (Eds.), Form-meaning connections in second language acquisition (pp. 1–26.) Mahwah, NJ: Lawrence Erlbaum.
Winke, P., Gass, S., & Sydorenko, T. (2010). The effects of captioning videos used for
foreign language listening activities. Language Learning & Technology, 14(1), 65–86.
Winke, P., Gass, S., & Syorenko, T. (2013). Factors influencing the use of captions by foreign language learners: An eye-tracking study. The Modern Language Journal, 97 (1), 254–275
Wu, J.-c., & Chu, H.-c. (2007). The effects of multimedia annotations on the
vocabulary retention of EFL readers. 英語教學期刊, 31(2), 89–126.
Yang, J. C., & Chang, P. (2014). Captions and reduced forms instruction: The impact
on EFL students’ listening comprehension. ReCALL, 26(01), 44–61.
Yanguas, I. (2009). Multimedia glosses and their effect on L2 text comprehension and
vocabulary learning. Language Learning & Technology, 13(2), 48–67.
Yuksel, D., & Tanriverdi, B. (2009). Effects of watching captioned movie clip on
vocabulary development of EFL learners. TOJET: The Turkish Online Journal of Educational Technology, 8(2).
Zanón, N. T. (2006). Using subtitles to enhance foreign language learning. Porta
Linguarum: revista internacional de didáctica de las lenguas extranjeras(6), 4.
Zarei, A. A., & Mahmoudzadeh, P. O. (2013). Multimedia Glosses: In L2 Vocabulary
Learning and Reading Comprehension: LAP LAMBERT Academic Publishing.