跳到主要內容

臺灣博碩士論文加值系統

(3.236.110.106) 您好!臺灣時間:2021/07/25 06:56
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:蔡曜仲
研究生(外文):Tsai Yao-Chung
論文名稱:AD1lh5Pf具試題曝光率控管之電腦適性測驗系統研發
論文名稱(外文):The investigation of CAT with item exposure rate controlling
指導教授:郭伯臣郭伯臣引用關係
指導教授(外文):Kuo Bor-Cheng
學位類別:碩士
校院名稱:國立臺中教育大學
系所名稱:教育測驗統計研究所
學門:教育學門
學類:教育測驗評量學類
論文種類:學術論文
論文出版年:2007
畢業學年度:95
語文別:中文
論文頁數:60
中文關鍵詞:電腦適性測驗試題曝光率控管測驗安全
外文關鍵詞:CATcontrolling item exposure ratetest security
相關次數:
  • 被引用被引用:1
  • 點閱點閱:339
  • 評分評分:
  • 下載下載:44
  • 收藏至我的研究室書目清單書目收藏:0
摘 要
電腦化適性測驗(computerized adaptive testing,簡稱CAT)是最近教育測驗的趨勢,由於電腦化適性測驗是一種變動長度及變動試題的測驗,因此在測量受試者能力時會更有效率,在考試時間的安排上也會更具彈性。然而,隨著電腦化適性測驗的普及運用,電腦化適性測驗開始面臨試題安全性的議題。現今對於題庫安全最主要的兩種評估依據就是試題重疊率(item overlap rate)以及試題曝光率(item exposure rate),本研究則是以試題曝光率作為主要的探討對象。試題曝光率控管方法有很多,目前實務上最常使用的是SH(Sympson & Hetter procedure,簡稱SH),SH的試題曝光率控管模式是先模擬一群受試者的能力值,此群的模擬能力值通常必須和未來施測的樣本群能力值分佈相仿,利用此一群模擬能力值對試題進行模擬施測,最後每道試題即產生一個曝光控制參數,在未來進行施測時,該試題的曝光率即受此曝光控制參數控管,雖然SH能有效控管試題曝光率,但難以保證未來受試者樣本群能力值與模擬的受試者群能力值相仿,如果,模擬群的能力分佈與施測時受試者群的能力分佈相差太大,部分試題的曝光率控制將會大打扣。有鑑於此,Stocking & Lewis (1998)將SH的理論作延伸,提出一種條件曝光控管法(Stocking & Lewis conditional procedure,簡稱SLC),然而,由於SLC在選題的過程中必須使用複雜的演算方式,且這種演算對於曝光率控管成效未必有明顯幫助,因此,Chang(2003)提出,以SHC來代替SLC不但可以使用簡便的最大訊息法選題,也能分層控管試題曝光率。
本研究的目的是實作一個電腦化適性測驗系統,並比較在同一題庫的條件下,分別使用改良式SH(本文中簡稱為SH-b)與改良式SHC(本文中簡稱為ASHC-b)時,對於系統實作的可行性與試題曝光率控管的優劣比較。

關鍵字:電腦適性測驗、試題曝光率控管、測驗安全性
Abstract
Recently, Educational testing tends to computerized adaptive testing. Because the items and item length of CAT are variable. So, it would be more efficiency when estimating the ability of test-takers and more flexible when arranging test schedule. However, as the popular use of CAT, the subject of the security of item pool becomes seriously. Today, the major two standards of evaluating item pool security are item overlap rate and item exposure rate. In my study, item exposure rate is the major object to be investigated. There are many kinds of item exposure controlling model, the most used model in practice is SH(Simpson & Hetter procedure). What the SH model does is to simulate a group of ability in advance which is similar to the group that would be tested in the future. To take a simulation with the group of ability, you can result the exposure controlling parameter of each item. When you take a test in the future, the item exposure rate would be controlled by the item expousure parameters. Although, SH can take an efficiency control of item expouser rate. It can not ensure that the simulation group of ability would be similar to the real one.If the difference of simulation and reality is too far, some results of item exposure controlling would not be good. As a result, Stocking & Lewis(1998) extend the SH theory, they recommend a conditional controlling procedure as SLC(Stocking & Lewis Conditional procedure). But, SLC must use a complex method of selecting items, this method is not useful for controlling expouser rate in evidence. Chang(2003) suggest that to display SLC as SHC is not only using simple method of maximum information but also controlling exposure rate of each level well.
The main purpose of my study is to implement a CAT testing system and to compare the feasibility and efficiency of improved SH and improved SHC in the sample item pool size.


Kye words: CAT, controlling item exposure rate, test security
目 錄
摘要……………………………………………………………………… I
Abstract………………………………………………………………….. II
目錄……………………………………………………………………… III
圖目錄…………………………………………………………………… V
表目錄…………………………………………………………………… VI
第一章 緒論…………………………………………………………… 1
  第一節 研究動機…………………………………………………. 1
  第二節 研究目的…………………………………………………. 3
第二章 文獻探討……………………………………………………… 4
  第一節 試題反應理論……………………………………………. 4
  第二節 電腦化適性測驗初始階段選題法……………………… 6
  第三節 電腦化適性測驗選題法………………………………… 7
  第四節 曝光率之相關研究……………………………………… 8
  第五節 能力估計…………………………………………………. 13
  第六節 電腦化適性測驗…………………………………………. 14
第三章 研究方法………………………………………………………. 16
  第一節 曝光控制參數……………………………………………. 16
  第二節 施測樣本與內容………………………………………… 20
  第三節 施測工具…………………………………………………. 20
  第四節 施測流程…………………………………………………. 23
第四章 研究結果與分析……………………………………………… 28
  第一節 曝光率結果分析…………………………………………. 28
  第二節 系統效能………………………………………………… 30
第五章 結論與建議…………………………………………………… 31
參考文獻………………………………………………………………… 32
附錄A 試題三參數…………………………………………………… 37
附錄B SH-b所使用的曝光控制參數………………………………… 44
附錄C ASHC-b所使用的曝光控制參數…………………………….. 46
附錄D 資料庫表單…………..………………………………………… 59
參考文獻
一、中文部份
王寶墉(1995),現代測驗理論,臺北市心理出版社。
朱怡君(2005),a-分層電腦適性測驗之曝光率控制,碩士論文,嘉義縣國立中正大學心理研究所,未出版。
余民寧(1997a)。試題反應理論的介紹─能力與試題參數的估計。研習資訊,9(3),6-12。
余民寧(1997b)。試題反應理論的介紹─訊息函數。研習資訊,9(6),5-9。
余民寧(1997c)。試題反應理論的介紹─電腦化適性測驗。研習資訊,10(5),5-9。
李茂能(2000)。中文電腦化適性測驗系統之應用與評鑑。文景書局。
何政翰(2004),國小數學領域電腦適性化測驗系統之建置,碩士論文,國立臺中教育大學教育測驗統計研究所,未出版。
周文欽、歐滄和、許擇基、盧欽銘、金樹人、范德鑫(2003),心理與教育測驗,臺北市心理出版社。
陳俊宏(2004),電腦適性測驗之模擬研究,碩士論文,國立臺中教育大學教育測驗統計研究所,未出版。
陳昇座(2007),以能力分佈為基礎之SHC曝光率控制法,碩士論文,國立臺中教育大學教育測驗統計研究所,未出版。
陳仁欽(2004),多分題之多向度電腦適性測驗,碩士論文,國立中正大學心理學研究所。
郭冠廷(2005),電腦適性化測驗雛型系統之研究,碩士論文,中興大學資訊科學研究所,未出版。
鄧景麟(2005),以三年級數學科能力指標為基礎的電腦適性測驗評量系統,碩士論文,健康暨管理學院資訊工程學系碩士在職專班,未出版。
錢永財、劉家惠、郭伯臣(2005),初始階段試題b值分層選題對曝光率之影響,第十屆人工智慧研討會論文,未出版。
錢永財(2006),以a-鄰近法為選題策略之電腦化適性測驗模擬研究,碩士論文,國立臺中教育大學教育測驗統計研究所,未出版。

二、英文部份
Baker, F. B., & Kim, S.-H.(2004). Item Response Theory : Parameter Estimation Techniques. Basel, N. Y. : Marcel Dekker, Inc.
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick, Statistical theories of mental test scores (chapters 17-20). Reading, MA: Addison-Wesley.
Chang, H. H. & Ying, Z. (1996). A global information approach to computerized adaptive testing. Applied Psychological Measurement, 20, 3, 231-229.
Chang, H.-H., & Ying, Z. (1999). α-Stratified multistage computerized adaptive testing. Applied Psychological Measurement, 23, 211-222.
Chang, S.-W., & Ansley, T. N. (2003). A comparative study of item exposure control methods in computerized adaptive testing. Journal of Educational Measurement, 40, 71-103.
Chang, S.-W., Ansley, T. N., & Lin, S. H. (2000). Performance of item exposure control methods in computerized adaptive testing: Further explorations. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA.
Chang, S.-W., Ansley, T. N., & Twu, B.-Y. (2002). Performance of item exposure control methods in computerized adaptive testing: Further Explorations. Psychological Testing, 49(2), 235-263.
Chang, S. W., & Twu, B.-Y. (2001). Effects of changes in the Examinees’ ability distribution on the exposure control method in CAT. Paper presented at the Annual Meeting of the American Educational Research Association, Seattle, WA.
Davey, T., & Parshall, C. G.(1995,April). New algorithms for item selection and exposure control with computerized adaptive testing. Paper presented at the annual meeting of American Educational Research Association, San Francisco.
Embretson, S. E., & Reise, S. P. (2000). Item Response Theory for Psychologists. Mahwah, N. J. : Lawrence Erlbaum.
Hambleton R. K., & Swaminathan H., & Rogers H. J.(1991) Fundamentals of Item Response Theory : SAGE.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff Publishing.
Hambleton, R. K., Zaal, J. N., & Pieters, J. P. M. (1991). Computerized adaptive testing: Theory, applications, and standards.
In R. K. Hambleton & J. N. Zaal (Eds.), Advances in educational and psychological testing: Theory and applications. Boston: Kluwer Academic Publishers.
In W. J. van der Linden & C. A. W. Glas (Eds.), Computerized adaptive testing: Theory and practice (pp. 163-182). London: Kluwer Academic Publishers.
Harrison, D. A. (1986). Robustness of IRT parameter estimation to violations of the unidimensionality assumption. Journal of Educational Statistics, 11, 91-115.
Hattie, J. (1981). Decision criteria for determining unidimensionality. Unpublished doctoral dissertation, University of Toronto, Canada.
Hetter, R. D., & Sympson, J. B. (1997). Item exposure control in CAT-ASVAB. In W. A.
Leung, C. K ., Chang , H. H., & Hau, K. T. (2000). Content Balancing in Stratified Comuterized Adaptive Testing Designs. Paper for presented at the AERA Annual Meeting 2000,New Orleans.
Leung, C. K ., Chang , H. H., & Hau, K. T. (2002). Comparing Three Itme Selection Approaches for Computerized Adaptive Testing with Content Balancing Requirement. The Journal of Technology, Learning, and Assessment, volumn 2,Number, ,December 2003.
Lord, F. M. (1977). Practical applications of item characteristic curve theory. Jaurnal of Educational Measurement, 14, 117-138.
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Hillsdale, NJ: Lawrence Eribaum Associates.
Stocking, M. L. (1994). Three practical issues for modern adaptive testing item pools (ETS Research Report 94-5). Princeton, NJ: Educational Testing Service.
Stocking, M. L., & Lewis, C. (1995). A new method for controlling item exposure in computerized adaptive testing (ETS Research Report RR-95-25). Princeton, NJ:Educational Testing Service.
Stocking, M. L., & Lewis, C. (1998). Controlling item exposure conditional on ability in computerized adaptive testing. Journal of Educational and Behavioral Statistics, 23,57-75.
Stocking, M. L., & Lewis, C. (2000). Methods of controlling the exposure of items in CAT.
Stocking, M. L., & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17 (3), 277-292.
Su, Ya-Hui (2007). Simultaneous Control over Item Exposure and Test Overlap in Computerized Adaptive Testing for Testlet-based Items and Multidimensional Items, Department of Psychology, National Chung Cheng University.
Wainer, H. (2000). Computerized Adaptive Testing: A Primer. (2nd Ed.) New Jersey: Lawrence Erlbaum Associates, Inc.
Weiss, D. J. (1974). Strategies of adaptive ability measurement (Research Report 74-5). University of Minnesota, Department of Psychology, Psychometric Methods Program.
Weiss, D. J. (Ed.). (1983). New horizons in testing. New York: Academic Press.
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top