臺灣博碩士論文加值系統

本文旨從語用和語音方面，來探討中文「敘述性」言談(narrative discourse)對話中，說話者自然產生的節拍手勢。在語用方面，主要是觀察說話者使用節拍手勢表達前後景(Grounding)和新/舊訊息(Information state)的關係。研究結果發現，說話者較常使用節拍手勢來傳達前景(foreground)的新訊息，以提示聽話者注意。此外，說話者在敘述的過程中，常使用節拍手勢來預示前後景訊息的轉換。在語音方面，主要探討說話者使用節拍手勢時，其所對應的語句之音調高低及說話能量強度的關係。研究發現，語句的音高和強度無法預測這類手勢的產生；但是，當傳達前景的新訊息時，這類手勢的出現常伴隨著較強的語氣。此外，研究結果也顯示，說話者使用節拍手勢通常是有規律性的。

This thesis investigates gestural beats in Chinese narrative discourse at both pragmatic and acoustic levels. The relationship among grounding, information state and beat gestures is examined at the pragmatic level, and at the acoustic level, the relationship among pitch, intensity, and gestural beats is analyzed. Moreover, whether there is a rhythmic pattern for beat gestures is further studied. The subjects were four undergraduates who were asked to view an animated color cartoon episode and then to immediately recount the events in it to a listener. The subjects were audio-video taped. They were not informed of the particular interest of the study. 291 beats were transcribed and analyzed. The audio data was analyzed on Praat and a Kay’s Model 4100. The continuous beats were further analyzed to investigate the rhythmic patterns and were annotated in Anvil, a video annotation tool. Gestural beats, narrative data, and the annotations were statistically analyzed and five phenomena for beat gestures were explored. First, gestural beats can appear in both foregrounded and backgrounded clauses. Second, the occurrence of beat gestures signals shifts between levels of the narrative structure. Third, speakers usually incline to utter new information in foregrounded clauses in Chinese narrative discourse with accompanying beats. Fourth, neither intensity nor pitch changes can predict and correlate with the occurrence of gestural beats in the relationship between beats and two acoustic factors. However, when grounding and the information state of the associated referents are considered, beats are produced for new information in foregrounded clauses with greater intensity. Finally, there is a rhythmic pattern in the production of continuous beats and the regularity of the patterns correlates with the clause boundary. A close relationship is revealed between speech and gestures in this thesis. The findings provide some linguistic details that may help explore the performance of gestural beats and speech in Chinese narrative discourse.

ACKNOWLEDGEMENTS iv
TABLE OF CONTENTS vi
FIGURES viii
TABLES ix
CHINESE ABSTRACT xi
ENGLISH ABSTRACT xii


CHPATER
1. INTRODUCTION 1
1.1 Introduction 1
1.2 Other Types of Gesture 10
1.3 Motivation and Purpose 15
1.4 Database 17
1.5 Organization of the Thesis 21

2. LITERATURE REVIEW 23
2.1 Pragmatic Level 23
2.1.1 Grounding 23
2.1.2 Information State 28
2.2 Acoustic Level 32

3. GESTURAL BEATS, GROUNDING AND INFORMATION STATE 36
3.1 Is There any Relationship Between Gestural Beats
and Grounding? 36
3.2 Are Gestural Beats and Information State Related? 46
3.3 Summary 49

4. GESTURAL BEATS AND ACOUSTIC PATTERNS 51
4.1 Pitch, Intensity and Gestural Beats 51
4.2 Gestural Beats and Rhythmic Patterns 60
4.3 Summary 85

5. CONCLUSION: INFORMATION BETWEEN PRAGMATIC AND
ACOUSTIC PATTERNING OF BEAT GESTURES 87
5.1 Interaction between Pragmatic Level and Acoustic
Level for Gestural Beats 87
5.2 Summary and Implications of the Thesis 92
5.3 Suggestions for Further Research 96

APPENDIXES 98
A. Events in the Main Story Line of the Cartoon
Episode The Beach Party in Sequential Order 98
B. Abbreviations of Linguistic Terms 111
C. Transcription Conventions 112

REFERENCES 114

FIGURES

Figure 1. Narrative Structure and Gesture 27
Figure 2. Parallel Example of Pitch Directions and
Movements of Gestural Beats 53
Figure 3. Non-Parallel Example of Pitch Directions and
Movements of Gestural Beats 54
Figure 4. The Occurrence of Gestural Beats with Greater
Intensity 57
Figure 5. The Occurrence of Gestural beats with Lower
Intensity 58

TABLES

Table 1. Frequency Distribution of Various Types of
Gestures in English Narratives 15
Table 2. Frequency Distribution of Gestural Types in
Chinese Conversation 16
Table 3. Frequency Distribution of Gestural Types in
Chinese Narratives 19
Table 4. Frequency Distribution of Syntactic Categories
and Pauses for Gestural Beats 19
Table 5. Frequency Distribution of Three Movements for
Gestural Beats 20
Table 6. Frequency Distribution of Grounding in Chinese
Narratives across Four Gestures 40
Table 7. Frequency Distribution of Signaling Shifts across
Four Gestural Types 45
Table 8. Frequency Distribution of Information State in
Gestural Beats 47
Table 9. Frequency Distribution of Information State vs.
Grounding in Gestural Beats 48
Table 10.Cross-table Analysis of Information State and
Grounding in Gestural Beats 49
Table 11.Frequency Distribution of Pitch Directions in
Beat Gestures 55
Table 12.Frequency Distribution of Intensity in Beat
Gestures 59
Table 13.Frequency Distribution of Continuous Beats in
Four Categories 61
Table 14.Frequency Distribution of Continuous Gestural
Beats 62

Table 15.Frequency Distribution of Continuous Gestural
Beats in Three Categories 62
Table 16.Frequency Distribution of Regularity for
Continuous Gestural Beats in Rhythmic Groups 77
Table 17.IU Boundary and Regularity of Rhythmic Patterns
for 2 and 3 Continuous Beats 78
Table 18.Clause Boundary and Regularity of Rhythmic
Patterns for 2 and 3 Continuous Beats 80
Table 19.Clause Boundary and Regularity of Rhythmic
Patterns for 4 and 5 Continuous Beats 82
Table 20.Frequency Distribution of Regularity for
Continuous Gestural Beats in Rhythmic Groups with
3 Movement Sequences 84
Table 21.Frequency Distribution of Intensity and Grounding
in Beat Gestures 88
Table 22.Frequency Distribution of Intensity and
Information State in Beat Gestures 89
Table 23.Frequency Distribution of Grounding and Regularity
of Rhythmic Patterns in Gestural Beats 91

Bavelas, Janet Beavin, Nicole Chovil, Douglas A. Lawrie, and Allen Wade. 1992. Interactive gestures. Discourse Processes 15.4.469-89.
Boersma, Paul. 2001. PRAAT, a system for doing phonetics by computer. Glot International 5.9/10.341-345.
Bolinger, Dwight. 1983. Intonation and Gesture. American Speech 58.2.156-174.
Chafe, Wallace. 1976. Givenness, Contrastiveness, Definiteness, Subjects, Topics, and Point of View. Subject and Topic, ed. by Charles N. Li, 26-55. New York: Academic Press.
Chafe, Wallace.1987. Cognitive Constraints on Information Flow. Coherence and Grounding in Discourse, ed. by Russell S. Tomlin, 21-51. Amsterdam: John Benjamins Publishing Company.
Chui, Kawai. 2001. Topic chain and grounding in Chinese discourse. Taipei: Crane Publishing.
Chui, Kawai. 2003. Categorization of gestures in communication. Form and Function: Linguistic Studies in Honor of Shuanfan Huang, ed. by Lily I-wen Su, Chinfa Lien, and Kawai Chui, 105-129. Taipei: Crane Publishing.
Chui, Kawai. 2005a. Temporal patterning of speech and iconic gestures in conversational discourse. Journal of Pragmatics 37.871-887.
Chui, Kawai. 2005b. Topicality and gestures in Chinese conversational discourse. Language and Linguistics 6.4.635-654.
Clark, Herbert H., and Susan E. Haviland. 1977. Comprehension and the Given-New Contract. Discourse Production and Comprehension, ed. by R. Freedle, 1-40. Hillsdale, N. J.: Lawrence Erlbaum Associates.
Crystal, David. 2000. A Dictionary of Linguistics and Phonetics. Oxford, UK: Blackwell Publishers.
De Ruiter, Jan Peter. 2000. The production of gesture and speech. Language and Gesture, ed. by David McNeill, 284-311. Cambridge: Cambridge University Press.
Du Bois, John W., Stephan Schuetze-Coburn, Susanna Cumming, and Danae Paolino. 1993. Outline of discourse transcription. Talking Data: Transcription and Coding in Discourse Research, ed. by Jane A. Edwards and Martin D. Lampert, 45-89. Hillsdale, N.J.: Lawrence Erlbaum Associates.
Efron, D. 1972 [1941]. Gesture, Race and Culture. The Hague: Mouton. [First printed as Gesture and Environment. New York: King's Crown Press, 1941].
Givón, Talmy. 1990. Syntax: a functional-typological introduction. Vol. 2. Amsterdam: John Benjamins.
Holliday, M. A. K. 1985. An Introduction to Functional Grammar. London: Edward Arnold.
Hopper, Paul J. 1979a. Aspect and Foregrounding in Discourse. Syntax and Semantics: Discourse and Syntax, vol. 12, ed. by T. Givón, 213-41. New York: Academic Press.
Hopper, Paul J. 1979b. Some Observations on the Typology of Focus and Aspect in Narrative Language. Studies in Language 3.1.37-64.
Hopper, Paul J., and Sandra A. Thompson. 1980. Transitivity in Grammar and Discourse. Language 56.251-99.
Kendon, Adam. 1972. Some relationships between body motion and speech. Studies in dyadic communication, ed. by Aron Wolfe Siegman and Benjamin Pope, 177-210. Elmsford, N.Y.: Pergamon.
Kendon, Adam. 1980. Gesticulation and speech: Two aspects of the process of utterance. The Relationship of Verbal and Nonverbal Communication, ed. by Mary Ritchie Key, 207-227. The Hague: Mouton.
Kendon, Adam. 1983. Gesture and speech: how they interact. Nonverbal Interaction, ed. by John Wiemann and Randall Harrison, 13-45. Beverly Hills, CA: Sage Publications.
Kendon, Adam. 1984. Some uses of gesture. Perspectives on Silence, ed. by D.Tannen and M. Saville-Troike, 215-234. Norwood, N.J.: Ablex Publishing Corporation.
Kendon, Adam. 2000. Language and gesture: Unity or duality. Language and Gesture, ed. by David McNeill, 47-63. Cambridge: Cambridge University Press.
Kipp, Michael. 2001. Anvil-A Generic Annotation Tool for Multimodal Dialogue. Proceedings of the 7th European Conference on Speech and Technology (Eurospeech), 1367-1370. Aalborg, Denmark.
Levy, Elena T., and David McNeill. 1992. Speech, gesture, and discourse. Discourse Processes 15.277-301.
Loehr, Daniel P. 2004. Gesture and Intonation. Unpublished Doctoral Dissertation. Georgetown University, Washington D.C.
McClave, Evelyn. 1994. Gestural Beats: The Rhythm Hypothesis. Journal of Psycholinguistic Research 23.1.45-66.
McClave, Evelyn. 1998. Pitch and manual gestures. Journal of Psycholinguistic Research 27.69-89.
McNeill, David. 1985. So you think gestures are nonverbal? Psychological Review 92.350-71.
McNeill, David. 1992. Hand and Mind – What Gestures Reveal about Thought. Chicago: The University of Chicago Press.
McNeill, David, and Elena T. Levy. 1993. Cohesion and gesture. Discourse Processes 16.363-386.
McNeill, David. (ed.) 2000. Language and Gesture. Cambridge: Cambridge University Press.
Prince, Ellen F. 1981. Toward a Taxonomy of Given-New Information. Radical Pragmatics, ed. by Peter Cole, 223-255. New York: Academic Press.
Schegloff, Emanuel A. 1984. On some gestures’ relation to talk. Structures of social action: studies in conversation analysis, ed. by J. Maxwell Atkinson and John Heritage, 266-296. Cambridge: Cambridge University Press.
Schuetze-Coburn, Stephan, Marian Shapley, and Elizabeth G. Weber. 1991. Units of Intonation in Discourse: A Comparison of Acoustic and Auditory Analyses. Language and Speech 34.3.207-234.
Tuite, Kevin. 1993. The production of gesture. Semiotica 93.83-105.
Zeng, Hui-ling. 1997. Gestural contextualization in Chinese conversation. National Chengchi University, Taipei: Unpublished M.A. Thesis.