跳到主要內容

臺灣博碩士論文加值系統

(3.236.84.188) 您好!臺灣時間:2021/08/06 10:46
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:林欣怡
研究生(外文):Hsin-Yi Lin
論文名稱:GRM模式之試題局部獨立性偵測指標模擬研究
論文名稱(外文):Simulation Study on Detection for Local Dependence Indices of GRM
指導教授:林原宏林原宏引用關係
指導教授(外文):Yuan-Horng Lin
學位類別:碩士
校院名稱:國立臺中教育大學
系所名稱:教育測驗統計研究所
學門:教育學門
學類:教育測驗評量學類
論文種類:學術論文
論文出版年:2007
畢業學年度:95
語文別:中文
論文頁數:83
中文關鍵詞:局部獨立性等級反應模式試題反應理論
外文關鍵詞:item response theorylocal independencegrade response model
相關次數:
  • 被引用被引用:1
  • 點閱點閱:302
  • 評分評分:
  • 下載下載:45
  • 收藏至我的研究室書目清單書目收藏:0
本研究旨在進行資料模擬探究,針對違反局部獨立性之試題,在等級反應模式下,探討局部獨立性之多元計分之四個偵測指標 , , 、 的偵測表現。此多元計分之四個偵測指標由Kim, Cohen and Lin (2005)所提出,本研究使用兩個模擬設計進行探討,第一個模擬設計針對等級反應模式之多元計分資料。以RESGEN模擬資料,模擬的因子包括:(1)題數:分為20、40、80題三種;(2)潛在特質維度:分為強維度與弱維度,其潛在特質之間的相關係數分別為0.5和0.1;(3)反應類別數:分為3、4、5三種反應類別,共有3 × 2 × 3 = 18種情境組合。第二個模擬設計則是二元計分單維度速度測驗試題,模擬因子包括:(1)題數:分為20、40、60、80題四種;(2)遺漏比率水準:分別為100%、50%,25%及0%。共有4×4=16種情境組合。
此兩種模擬試驗設計下,每種情境均假設為1000人,研究者使用MULTILOG軟體,進行等級反應模式之能力參數和試題參數值估計,最後運用LDIP軟體讀取MULTILOG輸出資料,在虛無假設的臨界值下,分析四個指標的局部獨立性偵測結果。
本研究的結果摘要如下:
一、多元計分多維度資料
(一)四個偵測指標 、 、 、 ,皆能偵測出違反局部獨立性之試題配對,此結果可供實證資料分析時之參考。
(二) , 指標用於偵測違反局部獨立性的結果是相近的; 指標受到題數影響最大。
二、二元計分單維度速度測驗資料
(一)四個偵測指標 、 、 、 ,皆能偵測出違反局部獨立性的試題配對,此結果可供實證資料分析時之參考。
(二) , 指標皆在題數少時能明確偵測出違反局部獨立性,而 和 則較不受題數影響。
最後,根據研究結果,研究者提出未來進一步研究的相關建議。

關鍵字:局部獨立性、等級反應模式、試題反應理論
The purpose of this study is to investigate indices of local independence for polytomous items based on data simulation. Four indices, , , 、 , are provided by Kim, Cohen and Lin (2005) and these four indices are used in this study. There are two simulation designed. The first one is polytomous and multidimensional items in Graded Response Model. The RESGEN program is used to generate data and three factors are considered in this study. They are: (1) number of items: 20, 40 and 80; (2) latent characteristic dimension: the strong dimension with correlation coefficient 0.5 and the weak dimension with correlation coefficient 0.1; (3) response category numbers: three kinds of response categories are 3, 4 and 5. Altogether, there are 3 * 2 * 3 = 18 kinds of simulation combinations. The second one is dichotomous and unidimensional speed test. The simulated factors includes: (1) number of items: 20, 40, 60 and 80. (2) ratio of missing items:100%, 50%, 25% and 0%. Altogether, there are 4 *4 = 16 kinds of situation combinations.
There are 1000 sample points within each cell. MULTILOG is used to estimate the person and item parameters and LDIP is to analyze data by four indices based on the results of MULTILOG. Based on the results of these two simulation, there are some results as follows:
1. For the first one simulation, these four indices, , , , , could detect the violation of local independence sensitively. This result consists with the prediction of theoretical foundation. Moreover, the results of detection for and is quite similar. And will be influenced by number greatly.
2. As to the second simulation, all indices, , , , , show that they could detect the violation of local independence. This result is meaningful information. Both and perform quite well in situation for small number of items. and will not be influenced by number of items greatly.
Based on the findings and results, some suggestions for future research are discussed.
Key words: item response theory, local independence, grade response model
目錄

第一章 緒論 …………………………………………………………………… 1
第一節 研究動機 ………………………………………………………… 1
第二節 研究目的 ………………………………………………………… 3
第三節 名詞釋義 ………………………………………………………… 4
第二章 文獻探討 ……………………………………………………………… 5
第一節 試題反應理論模式 …………………………………………… 5
第二節 多維度試題反應理論 ………………………………………… 15
第三節 局部獨立性假設及意義 ……………………………………… 18
第四節 局部獨立性的偵測指標 ……………………………………… 24
第三章 研究方法 ……………………………………………………………… 31
第一節 研究架構 ……………………………………………………… 31
第二節 研究工具 ……………………………………………………… 33
第三節 資料模擬流程 ………………………………………………… 34
第四章 結果與討論 ………………………………………………………… 39
第一節 四種指標於虛無假設下局部獨立性之分析 ………………… 39
第二節 多元計分多維度資料分析 ……………………………………… 42
第三節 二元計分單維度速度測驗資料分析 …………………………… 64
第五章 結論與建議 ………………………………………………………… 73
第一節 結論 …………………………………………………………… 73
第二節 建議 …………………………………………………………… 75
參考文獻 ……………………………………………………………………… 77
中文部分 ………………………………………………………………… 77
英文部分 ………………………………………………………………… 78
參考文獻
中文部份
王寶鏞(1995)。現代測驗理論。台北市:心理出版社。
余民寧(1991)。試題反應理論的介紹(一):測驗理論的發展趨勢。研習資訊,8(6),13-18。
余民寧(1992a)。試題反應理論的介紹(二):基本概念和假設。研習資訊,9(1),5-9。
余民寧(1992b)。試題反應理論的介紹(三):試題反應模式及其特性。研習資訊,9(2),6-10。
余民寧(1992c)。試題反應理論的介紹(四):能力與試題參數的估計。研習資訊,9(3),6-12。
余民寧(1992d)。試題反應理論的介紹(五):模式與資料間適合度的檢定。研習資訊,9(4),6-10。
林清山(1992)。心理與教育統計。台北市:東華書局。
林原宏(2006)。數學試題的局部獨立性與題組反應模式:兼論其在數學考卷的評析與檢驗。數學考卷編製暨評析研討會。台中市:國立台中教育大學。
林欣怡、林原宏(2006)。多元計分的局部獨立性偵測指標之模擬研究-GRM的多元多向度資料探討。第三屆測量統計方法學學術研討會。
陳佳秀(2004)。試題反應理論中一些參數的估計。逢甲大學統計與精算研究所碩士論文。
陳柏熹(2005)。電腦化適性測驗的理論與應用。國家精英季刊,1(1),157-174。
趙素珍(1998)。IRT軟體估計精準度之比較。國立台中教育大學國民教育研究所碩士論文。
英文部分
Ackerman, T. (1987). The robustness of LOGIST and BILOG IRT estimation programs to violations of local independence. Act research report series, 87-14. Iowa City, IA:American College Testing.
Adam, R. J., Wilson, M., & Wang, W. C. (1997). The multidimensional random
coefficients multinomial logit model. Applied Psychological Measurement,
21(1), 1-12.
Agresti, A. (1996). An introduction to categorical data analysis. New York: Wiley.
Andrich, D. (1985). A latent trait model for items with response depen-dencies:implications for test construction and analysis. In Embretson, S., (Ed.), Test design: contributions form psychology, education, and psychometrics. New York: Academic Press.
Baker, F. B. (1992). Item response theory:parameter estimation techniques. New York:Marcel Dekker, Inc.
Bao, H., & Mislevy, R. J. (2004). Assessing Local Item Dependence in Building Explanation Tasks. Department of Measurement, Statistics & Evaluation, University of Maryland, College Park.
Birnbaum, A. (1968). Some latent trait models and their user in inferring an examinee’s ability. In F. M. Lord & M. R. Novick, Statistical theories of mental rest scores (pp. 397-479). Reading, MA: Addison-Wesley.
Bishop, Y. M. M., Fienberg, S. E., & Holland, P. W. (1975). Discrete multivariate analysis. Cambridge, MA: MIT Press.
Chen, W. H., & Thissen, D. (1997). Local dependence indexes for item pairs using item response theory. Journal of Educational and Behavioral Statistics, 22, 265-289.
Douglas, J., Kim, H. R., Habing, B., & Gao, F. (1998). Investigating local dependence with conditional functions. Journal of Educational and Behavioral Statistics, 23(2), 129-151.
Fischer, G, H. (1973). Ein Beitrag zum Speed-Power Problem [A contribution to the speed-power problem]. In G. Reinert(Ed.), Bericht ueber den 27. Kongress der Deutschen Gesellschaft fuer Psychologie in Kiel 1970. Goettingen, Germany:Verlag fuer Psychologie.
Ferrara, S., Huynh, H., & Michaels, H. (1999). Contextual explanations of local
dependence in item clusters in a large scale hands-on science performance
Assessment. Journal of Educational Measuremet, 36(2), 119-140
Hambleton, R. J., & Swaminathan, H. (1985). Item response theory: Principles and Applications. Boston: Klvwer Nijhoff.
Hoskens, M., & De Boeck, P. (1995). Componential IRT models for polytomous items. Journal of Educational Measuremet, 32, 364-384.
Hoskens, M., & De Boeck, P. (2001). Multidimensional componential item response theory models for polytomous items. Applied Psychological Measurement, 25, 19-37.
Jiao, H., & Kamata, A. (2003). Model Comparisons in the Presence of Local Item
Dependence. Paper presented at the Annual Meeting of the American
Educational Research Association, Chicago, IL. April 21-25, 2003.
Johnson, M.& Sinharay, S. (2005). Calibration of Polytomous item families using bayesian hierarchical modeling. Applied Psychological Measurement, 29(5), 369-400.
Kim, S. H., Cohen, A. S., & Lin, Y. H. (2005). LDIP:A Computer Program for Local Dependence Indices for Polytomous Items [Software and Manual]. Athens, GA: University of Georgia.
Kreiner, S., & Christensen, K, B. (2004). Analysis of Local Dependence and Multidimensionality in Graphical Loglinear Rasch Models. Communications in Statistics - Theory and Methods, 1239-1276.
Lee, Y. (1998). Examining the suitability of an IRT-based testlet approach to the construction and analysis of passage-based items in an EFL reading comprehension test in the Korean High School Context. Unpublished doctoral dissertation, The Pennsylvania State University, University Park, PA.
Lee, Y. (2004). Examining passage-relatedlocalitem dependence(LID)andmeasurement
construct using Q3 statistics in an EFL reading comprehension test. Educational Testing Service, Princeton.
Lin, Y. H., Kim, S. H., & Cohen, A. S. (2006). Local dependence indices and detection investigation for polytomous items. Paper Presented on the 71st Annual Meeting of the Psychometric Society. Montreal, Canada. (June 14-17)
Lord, F. M. (1952). A theory of test scores. Psychometrika Monograph No. 7, 17.
Lord, F. M. (1980). Applications of items response theory to practical testing problems. Hillsdale, NJ: Lawrence Erlbaum Associates.
Masters, G. N. (1982). A Rasch model for partical credit scoring. Psychometrika, 47,149-174.
Muraki, E. (1996). RESGEN: Item Response Generator [Software and Manual].
Rasch, G. (1960). Probabilistic models for some intelligence and attainment
test. Conpenhagen: Danish Institute for Educational.
Reckase, M. D. (1985). The difficulty of test items that measure more than one ability.
Paper presented at the annual meeting of the American Educational Research
Association, Chicago, IL.
Reckase, M. D., & McKinley, R. L (1991). The discriminating power of items that measure more than one dimension. Applied Psychological Measurement, 15(4), 361-373.
Reckase, M. D. (1997). A linear logistic multidimensional model for polytomously scored items. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp.271-286). New York: Springer-Verlag.
Rosenbaum, P. R. (1988). Item bundles. Psychometrika, 53, 349-59.
Samejima, F. (1969). Estimation of a latent ability using a response pattern of graded scores. Psychometric Monographs, No.17.
Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp.85-100). New York: Springer-Verlag.
Spray, J., & Ackerman, T. (1987). The effect of item response dependency on trait or ability dimensionality. ACT Research Report Series, 87-10. Iowa City, IA:American College Testing.
Smits, D. M., Boeck, P. D., & Hoskens, K. U. (2003). Examining the structure of concepts: using interactions between items. Applied Psychological Measurement, 27(6), 415-439.
Thissen, D., Steinberg, L., & Mooney J. A. (1989). Trace Lines for testlets: a use of multiple-categorical response models. Journal of Educational Mearsurement, 26, 247-60.
Thissen, D. (1991). MULTILOG user’s guide:multiple categorical item analysis and test scoring using item response theory. Chicago, IN:Scientific software.
Thissen, D., Chen, W.-H., & Bock, R. D. (2002). MULTILOG (Version 7.03) [Computer software]. Lincolnwood, IL: Scientific Software International.
Tuerlinckx, F., & De Boeck, P. (1999). Distinguishing constant and dimension-dependent interaction:A simulation study. Applied Psychological Measurement, 23(4), 299-307.
Van den Wollenberg, A. L. (1982). Two text statistics for the Rasch model.
Psychometrika, 47, 123-140.
Wainer, H., & Kiely, G. L. (1987). Item clusters and computerized adaptive testing: a case for testlets. Journal of Educational Mearsurement, 24(3), 185-201.
Wainer, H., & Wang, X. (2000). Using a new statistical model for testlets to score TOEFL. Journal of Educational Measurement, 37, 203-20.
Wang, W. C., & Wilson, M. (2005). Exploring local item dependence using a
random-effect facet model. Applied Psychological Measurement, 29(4),
296-318.
Wilson, M., & Adams, R. (1995). Rasch model for item bundles. Psychometrika, 60, 181-98.
Yen, W. M. (1981). Using simulation results to choose a latent trait model.
Applied Psychological Measurement, 5, 245-262.
Yen, W. M. (1984). Effects of local item dependence on the fit and equating performance of the three-parameter logistic model. Applied Psychological Measurement, 8, 125-145.
Yen, W. M. (1993). Scaling performance assessment: strategies for managing local
item dependence. Journal of Educational Measurement, 30, 187-213.
Zenisky, A. L., Hambelton, R. K., & Sireci, S. G. (2000). Effects of local item dependence on the validity of IRT item, test, and ability statistics. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top