臺灣博碩士論文加值系統

在操作制約中，呈現酬賞物之延宕時間是影響增強效果之主要因子之一，在過去文獻中設計數種行為典範測量增強效果與延宕時間之關係，然而仍存在混淆變項，如行為間之競爭、第二級酬賞物之效果等。本論文使用雙桿連續操作制約研究延宕時間與增強效果之關係。實驗一採用雙桿延宕酬賞連續增強作業，在有效鍵之反應與酬賞物之間安排一延宕時間，無效鍵與酬賞物無關，結果發現延宕時間會降低有效鍵之反應速率。實驗二採用雙桿tandem VI COD作業，第二按鍵設定之change-over-delay(COD)使第一按鍵反應和給予酬賞物之間具有一段延宕時間；以第一按鍵反應速率測量COD延宕之增強效果，結果發現延宕時間愈長，第一按鍵之反應速率愈低，兩者呈倒數形式之關係。實驗三採用雙桿tandem VI FI作業，觀察酬賞速率與反應速率之關係，結果發現酬賞速率並不會顯著改變第一按鍵之反應速率，排除實驗二中酬賞速率降低第一按鍵反應速率之解釋。實驗四採用雙桿tandem VI FR作業，探討第一按鍵反應和第二按鍵反應之關係，結果發現第二按鍵之壓桿行為會和第一按鍵之壓桿行為競爭增強效果，然而第一按鍵之酬賞延宕時間也有差異。綜合以上結果顯示，酬賞之延宕時間以及行為間之競爭，皆會影響操作制約之反應速率，延宕時間與行為競爭之綜合效果值得未來研究進一步探討。

The effect of delayed reinforcement is a topic that has been intensively studied in the past. Numerous paradigms were designed to find out the relationship between the reinforcement strength and the length of delay. However, confounding factors, such as competition between behaviors, effects of secondary reinforcements etc., still prevent us from its full understanding. In the present study a series of schedules were applied to two-keys free operant paradigms to investigated the relationship between the length of delay and the strength of reinforcement. In experiment 1, the two-keys delayed continuous reinforcement task, a delay was inserted between the response of the active key and the delivery of rewards. Responses on the other key had no consequence. Results indicated that delay of reward could reduce responding rate of active key. In experiment 2 a tandem VI/COD schedule was applied. The change-over-delay (COD) defined on key 2 forced a delay between the last response of key 1 and the delivery of reward. The rate of key 1 response was supposed to be able to measure the strength of COD-delayed reinforcement. Results showed that the response rate of first key decreased with increasing COD length. Again a hyperbolic function was found to fit well the curve of key 1 responding rate and experienced delay. By using the 2 keys tandem VI / FI schedule, it was found in experiment 3 that the reinforcement rate did not alter significantly the responding rate of key 1, ruling out the alternative interpretation of results found in experiment 2 that reduction of key 1 responding was caused by decreased reinforcement rate. By using a two-keys tandem VI/FR schedule, it was found in experiment 4 that key 2 pressing behavior competed for reinforcement effects with key 1 response. However, it turned out that there were experienced delays for key 1 as well. In conclusion, both delay of reward and competition between behaviors had influence on the responding rate of key 1. How this combined effect shall be modeled will be an interesting topic for further studies.

摘　要 1
Abstract 2
第一章　序　論 4
第一節　延宕酬賞之相關理論 4
第二節　延宕酬賞之相關研究 6
第三節　研究目的 15
第二章　研究方法 25
受試者 25
實驗儀器 25
實驗基本程序 26
統計分析 27
第三章　實驗一：酬賞之延宕時間對連續增強制約反應速率之影響 30
目的 30
實驗步驟 30
結果 31
討論 32
第四章　實驗二：酬賞之延宕時間對制約反應速率之影響 35
目的 35
實驗步驟 35
結果 36
討論 37
第五章　實驗三：酬賞速率對制約反應速率之影響 42
目的 42
實驗步驟 42
結果 43
討論 44
第六章　實驗四：觀察行為對制約反應速率之影響 47
目的 47
實驗步驟 47
結果 48
討論 49
第七章　綜合討論 52
參考文獻 58

Ainslie, G. (1975). Specious reward: A behavioral theory of impulsiveness and impulse control. Psychological Bulletin, 82, 463-496.
Brockel, Becky A., Cory-Slechta, & Deborah A. (1998). Lead, attention, and impulsive behavior: change in a fixed-ratio waiting-for-reward paradigm. Pharmacology Biochemistry and Behavior, 60(2), 545-552.
Caraco, T., S. Martindale, & T.S. Whittam. (1980). An empirical demonstration of risk-sensitive foraging preferences. Animal Behavior, 28, 820-830.
Bruner, C. A., Avila S., R., Acuna, L., & Gallardo, L. M. (1998). Effects of reinforcement rate and delay on the acquisition of lever pressing by rats. Journal of the Experimental Analysis of Behavior, 69(1), 59-75.
Catania, AC., Sagvolden, T., & Keller, KJ. (1988). Reinforcement schedules: retroactive and proactive effects of reinforcer inserted into fixed-interval performance. Journal Experimental Animal Behavior, 49, 49-73.
Berger, D. F., Lombardo, J. P., Jeffers, P. M., Hunt, A. E., Bush, B., Casey, A., & Quimby, F. (2001). Hyperactivity and impulsiveness in rats fed diets supplemented with either Aroclor 1248 or PCB-contaminated St. Lawrence river fish. Behavioural Brain Research, 126, 1-11.
Bergen, D. F. & Sagvolden, T. (1998). Sex differences in operant discrimination behavior in an animal model of attention-deficit hyperactivity disorder. Behavior Brain Research, 94, 73-82.
Pierce, David W., & Eplingi, Frank W. (2003). Behavior analysis and learning (2nd ed.), Prentice Hall: University of Alberta. 275-280.
Schaal, David W., Shahan, Timotjyi A., Kovera, Graig A., & Reilly, Mark P. (1998). Mechanisms underlying the effects of unsignaled delayed reinforcement on key pecking of pigeon under variable-interval schedule. Journal of the Experimental Analysis of Behavior, 69(2), 103-122.
Dickinson, A., Watt, A., & Griffiths, W.J.H. (1992). Free-operant acquisition with delayed reinforcement. The Quarterly Journal of Experimental Psychology, 45(3), 241-258.
Johansen, EB. & Sagvolden, T. (2004). Response disinhibition may be explained as an extinction deficit in an animal model of attention-deficit /hyperactivity disorder(ADHD). Behavioural Brain Research, 149, 183-196.
Fantino, E. (1977). Conditioned reinforcement: Choice and information. In W. K. Honig & J. E. R. Staddon (Eds.), Handbook of operant behavior (pp. 313–339). Englewood Cliffs, NJ: Prentice Hall.
Herrnstein, R. J. (1970). On the law of effect. Journal of the Experimental Analysis of Behavior, 13, 243-266.
Heyman, G. M., & Monaghan, M. M. (1987). Effects of changes in response requirement and deprivation on the parameters of the matching law equation: New data and review. Journal of Experimental Psychology: Animal Behavior Processes, 13, 384-394.
Salamone, J. D., Wisniecki, A., Carlson, B. B., & Correa, M. (2001). Nucleus Accumbens Dopamine depletions make animals highly sensitive to high fixed ratio requirements but do not impair primary food reinforcement. Neuroscience, 105(4), 863-870.
Lattal, A. K., & Gleeson, S. (1990). Response acquisition with delayed reinforcement. Journal of Experimental Psychology: Animal Behavior Process, 16, 27-39.
Mazur, J. E. (1984). Tests of an equivalence rule for fixed and variable reinforcer delays. Journal of Experimental Psychology: Animal Behavior Process, 10(4), 426-436.
Mazur, J. E. (1985). Influences of delay and rate of reinforcement on discrete-trial choice. Journal of Experimental Psychology: Animal Behavior Process, 11(4), 565-575.
Mazur, J. E. (1986). Fixed and variable ratios and delays: further tests of an equivalence rule. Journal of Experimental Psychology: Animal Behavior Processes, 12(2), 116-124.
Mazur, J. E. (1988). Estimation of indifference points with an adjusting-delay procedure. Journal of the Experimental Analysis of Behavior, 49, 37-47.
Mazur, J. E. (1992). Choice behavior in transition: development of preference with ratio and interval schedules. Journal of Experimental Psychology: Animal Behavior Processes, 18(4), 364-378.
Mazur, J. E. (1997). Choice, delay, probability, and conditioned reinforcement. Animal Learning & Behavior, 25(2), 131-147.
Mazur, J. E.(1999). Learning and behavior. (4th. ed.). Upper Saddle River, New Jersey: Prentice Hall.
Mazur, J. E. (2000). Tradeoffs among delay, rate, and amount of reinforcement. Behavioral Processes, 49, 1-10.
McSweeney, F. K. (1978). Prediction of concurrent keypeck treadle-press responding from simple schedule performance. Animal Learning & Behavior, 6, 444-450.
Killeen, Peter R. (1994). Mathematical principles of reinforcement. Behavioral and Brain Sciences, 17, 105-172.
Rachlin, H. (1974). Self-control. Behaviorism, 2, 94-107.
Cardinal, Rudolf N., Cheung, Timothy HC. (2005). Nucleus accumbens core lesions retard instrumental learning and performance with delayed reinforcement in the rat. BioMed Central Neuroscience, 6:9, 1-23.
Grice, Robert R. (1948). The relation of secondary reinforcement to delayed reward in visual discrimination learning. Journal of experimental psychology, 38(1), 1-16.
Sidman, M. (1960). Tactics of scientific research. New York: Basic Books.
Sagvolden, T., Aase, H., Zeiner, P., & Berger, D. (1998). Altered reinforcement mechanisms in attention-deficit/hyperactivity disorder. Behavioral Brain Research, 94, 61-71.
Sizemore, O. J., & Lattal, K. A. (1977). Dependency, temporal contiguity, and response-independent reinforcement. Journal of the Experimental Analysis of Behavior. 27, 119-125.
Byrne, T., Sutphin, G., & Poling, A. (1998). Acquisition, extinction, and reacquisition of responding with delayed and immediate reinforcement. Behavioural Processes, 43, 97-101.
Williams, A. M., & Lattal, K. A. (1999). The role of the response-reinforcement relation in delay-of-reinforcement effects. Journal of the Experimental Analysis of Behavior, 71, 187-194.
Williams, B. A. (1978). Information effects on the response-reinforcer association. Animal Learning and Behavior, 6, 371-379.
Wolfe, J. B. (1934). The effect of delay reward upon learning in the white rat. Journal of Comparative Psychology, 17, 1-21.
Schultz, W. (1997). Dopamine neurons and their role in reward mechanisms. Neurobiology, 7, 191-197.