臺灣博碩士論文加值系統

隨著電腦科技的演進及網路的普及，近年有越來越多的線上學習資源能夠擔任輔助台灣學生英語學習的工具。其中，英語聊天機器人(chatbots)能夠處理鍵盤輸入的語言並以螢幕呈現文字的方式回應，此種科技已經在部分英語系國家的線上訂票系統及商店中擔任諮詢者的角色，顧客能於網路上提出問題，而線上的英語聊天機器人能夠運用關鍵字、資料庫查詢、句型轉換等技術來及時提供適切的回答，文獻探討指出目前主要有五種建構聊天機器人的程式語言，然而僅有其中三種提供完整的對談記錄；而先前的研究主要是針對使用者的觀感做分析，迄今卻鮮有針對英語聊天機器人對英語學習成效上的實證性研究。本研究之主要目的即是探討先後與三種英語聊天機器人(Cleverbot, Skynet-AI, 及Meg)進行開放性互動是否能提升學習者英文語言使用上的句型複雜度、文法準確度、訊息適切度及流暢度。本研究也比較是否學習者的語言使用以及學習者對於「不同聊天機器人對於英語學習」的看法是否會因為聊天機器人的選擇而有不同。
本研究的受試者由南投一社區高中的42位高一學生所組成，在實驗之初，所有受試者都在電腦教室中與三個機器人各進行十五分鐘的互動，研究者回收聊天記錄檔案並分析受試者在句型複雜度、文法準確度、訊息適切度及流暢度上的起始能力。接著在六個星期的過程中，受試者分別自行與所有三個機器人進行兩次三十分鐘的開放式聊天並針對每次選用的機器人填寫一份問卷。至實驗結束時，所有的受試者再次在電腦教室中與三個相同的機器人各進行十五分鐘的互動，研究者同樣回收聊天記錄並以統計比較實驗後受試者的句型複雜度、文法準確度、訊息適切度及流暢度是否有變化。在六個星期的過程中，受試者必須在與機器人互動後將聊天記錄及問卷繳回給實驗者。
然而，在回收資料的過程中，研究者發現僅有20位受試者與每個機器人進行兩次三十分鐘的開放式互動，因此，在資料分析時，研究者將受試者分為在六個星期的實驗中完整與機器人互動共三個小時的「實驗處理組」(20人)及平均跟機器人互動不到一小時的「部份參與組」(12人)兩組，剩下的10人並未完成前測或後測而被排除。
為探索學習成效，採用組內比較同樣的受試者在前、後測中的表現是否有顯著差異。在確認「實驗處理組」及「部份參與組」兩組之可比性後，研究者也進行跨組的比較；此外，本研究也使用組內重複量數來比較相同學生在與三種機器人互動時是否有不一樣的表現，藉此觀察機器人的選用是否會影響受試者的英文使用。在受試者對於不同機器人的看法方面，本研究以描述性統計以及單因子變異數分析來呈現並比較學習者對於不同機器人的看法是否有差異。
本研究的結果摘要如下：
1. 與英語聊天機器人定期互動一段時間後，學生的句型複雜度並無顯著變化。
2. 定期與英語聊天機器人聊天能提升英語學習者的文法精確度，但對於訊息適切度上卻沒有顯著影響。學生與聊天機器人的互動中可能零星地從機器人的語句中學到一些新的文法概念或是藉由模仿機器人的用語而提升文法水平。
3. 與英語聊天機器人互動達三小時對學生英文流暢度有顯著助益。學生也在問卷中指出使用聊天機器人能提供他們更多使用英文的機會，因此，英文流暢度的提升可能是機器人提供了更多練習機會的結果。
4. 不同程式語言建構出的聊天機器人僅對學生少數的語言複雜度指標產生影響，但對流暢度沒有影響。
5. 學生對「不同聊天機器人對於英語學習」的看法指出Skynet-AI的反應速度快於Cleverbot，因此，程式語言的選用可能影響機器人的回應速度；學習者也指出Meg在訊息適切度上明顯低於Skynet-AI以及Cleverbot。
關鍵字：聊天機器人、自然語言處理、語料庫分析

With the advancement of computer technology and the popularity of the Internet, there are gradually more online learning resources that can serve as English-learning tools for Taiwanese students. Among those resources, chatbots can process typed messages and respond by showing texts on the screen. Chatbot technology has been incorporated by some English-speaking countries, whose online ticket reservation system and stores adopt conversational agents to serve as information staff. Customers can pose questions online and chatbots can immediately offer appropriate responses using keyword matching, database searching, or pattern transformation. Literature showed that there are now five major types of chatbot construction mechanisms, though only three of which offer complete interaction transcripts. Previous studies on chatbots mainly focused on user perception. Few studies were conducted on chatbots’ effects on language learning. The main purpose of this study is to explore the effects of open-ended chats with three chatbots on English learners’ syntactic complexity, grammar accuracy, message appropriateness, and fluency. This study also examines learners’ interactions with different chatbots and investigates if learners’ perception of chatbots for English learning changes after chatting with different chatbots.
The participants were a cohort of 42 10th graders from a community-based senior high school in Nantou. This study lasted for eight weeks. In Week 1, all students spent forty-five minutes chatting with three chatbots. The transcripts were collected and analyzed for learners’ syntactic complexity, grammar accuracy, message appropriateness, and fluency as initial proficiency. Between Week 2 to Week 7, participants chatted in an open-ended manner with all three chatbots for two thirty-minute sessions on their own and filled out a perception questionnaire for each bot they used. In Week 8, all participants chatted again with all three chatbots for fifteen minutes each. The transcripts were once again collected and analyzed for syntactic complexity, grammar accuracy, message appropriateness, and fluency to compare if pre- and post-tests were significantly different. During the six weeks from Week 2 to Week 7, participants were required to turn in their transcripts and questionnaires to the researcher to prove their participantion.
However, during data collection, the researcher found that only 20 students finished the two thirty-minute sessions with each chatbot; hence, participants were put into two groups based on their degree of participation. Those who spent three hours chatting with bots were labeled as complete experiment group (CEG), while those who finished less than one hour were categorized as partial participation group (PPG). The rest of 10 students failed to finish either pre- or post-tests and were excluded.
To examine the effects of bots, paired sample t-tests were first used to explore if within group differences in the pre- and post-tests achieved significance. After ensuring comparability between CEG and PPG, cross group analyses were computed to investigate the effects of interacting with chatbots on English learning. Moreover, repeated measure ANOVAs were adopted to compare if the same students performed differently when interacting with different chatbots. As for perception, descriptive statistics and one-way ANOVAs were computed to check if students had different perception of different chatbots.
The five major findings are summarized below.
1. After interacting with bots for three hours, students’ syntactic complexity did not change.
2. Regularly chatting with bots raised English learners’ grammar accuracy, but did not significantly influence message appropriateness. In the interactions with bots, students might sporadically pick up some new grammar concepts or simply mimic chatbots’ language and developed their grammar level as a result.
3. Interacting with bots for three hours significantly increased students’ fluency. Students indicated in the questionnaire that using chatbots offered them more time to use English for communication; thus, fluency might have improved due to increased time to practice English.
4. Chatbots made using different construction mechanisms had some influence on syntactic complexity, but they did not affect fluency.
5. Students’ perception indicated that Skynet-AI responded at a faster rate than Cleverbot. Learners also indicated that Meg’s message appropriateness was much weaker than Skynet-AI and Cleverbot, suggesting that different mechanisms might also influence bots’ processing speed and chatbots’ message appropriateness.
Keywords: chatbots, natural language processing (NLP), corpus analysis

Chinese Abstract i
English Abstract iii
Acknowledgements v
Table of Contents vi
List of Tables ix
List of Figures xi

CHAPTER ONE: INTRODUCTION 1
1.1 Motivation 1
1.2 Background and Rationale 2
1.3 Purpose of the Study and Research Questions 4
1.4 Significance of the Study 5

CHAPTER TWO: LITERATURE REVIEW 7
2.1 Introduction to Chatbots 7
2.1.1 Definition 7
2.1.2 Development of Chatbots 8
2.1.3 Turing Test 11
2.1.4 Chatbot Contests 12
2.1.5 Chatbot Mechanisms 14
2.1.5.1 AIML 15
2.1.5.2 Jabberwacky 17
2.1.5.3 Personality Forge 18
2.1.5.4 Façade 18
2.1.5.5 ChatScript 19
2.2 Chatbot Research in Language Learning and Teaching 20
2.2.1 Proposals of Novel Chatbot Systems 20
2.2.2 Studies With Neutral or Positive Results 22
2.2.3 Studies With Negative Results 30
2.3 Chatbots, EFL, and the Research Gaps 32

CHAPTER THREE: METHODOLOGY 35
3.1 Selection Process and Design of Chatbots 35
3.1.1 Chatbot Selection 35
3.1.2 Design of the Selected Chatbots 37
3.1.2.1 Meg 37
3.1.2.2 Cleverbot 38
3.1.2.3 Skynet-AI 39
3.2 Design of the Study 41
3.2.1 Participants 41
3.2.2 Instruments 41
3.2.3 Data Collection Procedures 42
3.2.4 Data Analysis Procedures 43

CHAPTER FOUR: RESULTS AND DISCUSSION 54
4.1 Chatbots’ Influence on Syntactic Complexity 57
4.2 Chatbots’ Influence on Grammar Accuracy and Message Appropriateness 63
4.3 Chatbots’ Influence on Linguistic Structure Frequency 75
4.4 Chatbots’ Influence on Learners’ Interactions with Different Chatbots 80
4.5 Learners’ Perception of the Chatbots 91



CHAPTER FIVE: CONCLUSION 109
5.1 Limitations and Suggestions for Future Research 109
5.2 Pedagogical Implications 112
5.3 Conclusion 113

REFERENCES 114

APPENDIX 123
Appendix A. Research consent form 123
Appendix B. User manual of the three selected chatbots 125
Appendix C. The installation manual of dictionary pulg-ings 129
Appendix D. The first version of learner perception questionnaire 130
Appendix E. Formal user satisfaction questionnaire 133
Appendix F. The questionnaire for the last survey 135
Appendix G. Email communication with Meg’s botmaster 137
Appendix H. Email communication with Skynet’s botmaster 138










List of Tables

Table 1. Evaluation Summary of Linguistic Resources (Reproduced from Coniam, 2008a) 25
Table 2. Evaluation Summary of Interface (Reproduced from Coniam, 2008b) 26
Table 3. Details of the Original Chatbot Candidates for the Current Study 36
Table 4. The Research Schedule 43
Table 5. Research Questions, Data Collection and Data Analysis Methods 53
Table 6. Results of the Pearson Product-Moment Correlation between English Semester
Scores and the Duration Engaged with Chatbots 55
Table 7. Paired Sample T-tests of Within Group Difference on Syntactic Complexity 58
Table 8. Independent Sample T-tests of Syntactic Complexity in the Pretest 60
Table 9. Independent Sample T-tests of Syntactic Complexity in the Posttest 61
Table 10. Inter-rater Reliability Analyses 64
Table 11. Results of Paired Sample T-tests on the Pre- and Post-tests on Grammar Accuracy
and Message Appropriateness 64
Table 12. Independent Sample T-tests of Grammar Accuracy and Message Appropriateness in
the Pretest 65
Table 13. Independent Sample T-test of Grammar Accuracy and One-way ANCOVA of
Message Appropriateness in the Posttest 66
Table 14. CEG Students’ Error Tally Count and Error per Sentence Ratio in the Pre- and
Post-tests 67
Table 15. Results of Wilcoxon Signed Ranks Tests on the within Group
Difference on Linguistic Structure Frequency 76
Table 16. Results of Mann-Whitney Tests of Structure Frequency in the Pretest 77
Table 17. Results of Mann-Whitney Tests of Structure Frequency in the Posttest 78
Table 18. Results of ANOVAs on Learners’ Syntactic Complexity with Different Bots 81
Table 19. Friedman’s ANOVA Summaries for Learners’ Fluency with Different Bots 84
Table 20. Tally Count of Verb Phrases and Clauses from Extract 9 to Extract 14 90
Table 21. Descriptive Statistics of Chatbots’ Overall Functionality 91
Table 22. Results of ANOVAs on Participants’ Perceptions of Chatbots’ Functionality 93
Table 23. Descriptive Statistics of Chatbots’ Special Features 95
Table 24. Students’ Reported Comments on Cleverbot’s “Think For Me!” Function 96
Table 25. Students’ Reported Comments on Skynet-AI’s Online Resource Searching Function 97
Table 26. Students’ Reported Comments on Skynet-AI’s Voice Synthesis Function 98
Table 27. Students’ Reported Comments on Skynet-AI’s Memory and Logical Thinking 99
Table 28. Students’ Reported Comments on Meg’s Suggested Sentences 100
Table 29. Students’ Reported Comments on Meg’s Suggested Topics 101
Table 30. Students’ Reported Comments on Meg’s Voice Synthesis Function 101















List of Figures

Figure 1: Online Interactive Q&;A Service of Copa Airlines 11
Figure 2: Online Interactive Q&;A Service of IKEA 11
Figure 3: User Interface of Meg in SpeakGlobal, Ltd. 37
Figure 4: Simultaneous Translation Using Transover with Meg 38
Figure 5: The Interface of Cleverbot 39
Figure 6: The Interface of Skynet-AI 40
Figure 7: Five Types of Syntactic Complexity Indices Automated (Reproduced from Lu, 2010) 44
Figure 8: The Interface of L2SCA 45
Figure 9: A Sample Analysis Result Using L2SCA 46
Figure 10: The Syntactic Complexity Index Change between Pre- and Post-tests 62
Figure 11: The Error-free Sentence Ratio (EFS/S) Change between Pre- and Post-tests 71
Figure 12: The Structure Occurrence Frequence Change between Pre- and Post-tests 74
Figure 13: The Appropriate Sentence Ratio (AS/S) Change between Pre- a

Abu Schawar, B., &; Atwell, E. (2003). Using the corpus of spoken Afrikaans to generate an Afrikaans chatbot. SALALS Journal: Southern African Linguistics and Applied Language Studies, 21, 283-294.
Abu Shawar, B., &; Atwell, E. (2005). A chatbot system as a tool to animate a corpus. ICAME Journal, 29, 5-24.
Abu Shawar, B., &; Atwell, E. (2007a). Chatbots: Are they really useful? LDV-Forum 2007, 22(1), 29-49. Retrieved December, 2011 from http://media.dwds.de/jlcl/2007_Heft1/Bayan_Abu-Shawar_and_Eric_Atwell.pdf
Abu Shawar, B., &; Atwell, E (2007b). Fostering language learner autonomy through adaptive conversation tutors. Proceedings of 2007 Corpus Linguistics Conference. Retrieved December, 2011 from http://ucrel.lancs.ac.uk/publications/CL2007/paper/51_Paper.pdf
Adams, B. (2012). Bildgesmythe passes the Turing Test. [Web log post]. Retrieved July, 2012 from http://www.personalityforge.com/news/turing-test-passed.php
Adams, R. (2007). Do second language learners benefit from interacting with each other? In A. Macky (ed.), Conversational interaction in second language acquisition (pp. 29-51). NY: Oxford University Press.
A.L.I.C.E. AI Fundation (2007). AIML bots. Retrieved July, 2012 from http://www.alicebot.org/aimlbots.html
Anonymous (2011). [Bruce Wilcox interview - Loebner 2011 winner]. Retrieved July, 2012 from http://aidreams.co.uk/forum/index.php?page=Bruce_Wilcox_Interview_-_Loebner_2011_winner
Aron, J. (2011). Software tricks people to think it is human. New Scientist. [Online magazine]. Retrieved July, 2012 from http://www.newscientist.com/article/dn20865-software-tricks-people-into-thinking-it-is-human.html
Atwell, E. (2005). Web chatbots: the next generation of speech systems? European CEO, November-December, 142-144. Retrieved December 31st from http://www.comp.leeds.ac.uk/eric/atwell05ecj.pdf
Beatty, K. (2003). Teaching and researching computer-assisted language learning. New York: Pearson Education Limited.
Brown, H. D. (2000). Principles of language learning and teaching (4th ed.). New York: Longman.
Chatbots (n.d.). Chatbot. Retrieved July, 2012 from http://www.chatbots.org/chatbot/
Chen, C.-K. (2012). Can I learn English from robots? Discourse coherence, vocabulary range, and perceived effectiveness of award-winning chatbots. In J. Colpaert, A. Aerts, W. V. Wu, &; Y.-C. J. Chao (Eds), The Medium Matters, Proceedings CALL 2012, Providence University, Taichung, Taiwan.
Child, T. (2006). By George! How one chatbot got smart. Retrieved July, 2012 from http://cordis.europa.eu/ictresults/index.cfm?section=news&;tpl=article&;BrowsingType=Features&;ID=88722
Chun, D. M. (1994). Using computer networking to facilitate the acquisition of interactive competence. System, 22(1), 17-31.
Coniam, D. (2008a). Evaluating the language resources of chatbots for their potential in English as a second language. ReCall Journal, 20(1), 98-116.
doi: 10.1017/S0958344008000815
Coniam, D. (2008b). An evaluation of chatbots as software aids to learning English as a Second Language. The EUROCALL Review, 13.
Available at: http://www.eurocall-languages.org/.
Dodigovic, M. (2006). Artificial intelligence in second language learing: Raising error awareness (人工智慧在第二語言教學中的應用 : 提高對偏誤的意識). Beijing: 世界圖書出版公司北京公司.
Dornyei, Z. (2003). Questionnaires in second language research: Construction, administration, and processing. Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc.
Dornyei, Z. (2010). Questionnaires in second language research: Construction, administration, and processing (2nd ed.). Mahwah, New Jersey: Lawrence Erlbaum Associates, Inc.
Ellis, R. (2008). The study of second language acquisition (2nd ed.). Oxford: Oxford University Press.
ESL glossary (n.d.). Retrieved July, 2012 from http://bogglesworldesl.com/glossary/interactionism.htm
Fryer, L., &; Carpenter, R. (2006). Emerging technologies: Bots as language learning tools. Language Learning &; Technology, 10(3), 8-14.
Gee, S. (2011). Rosette wins Loebner Prize 2011. IProgrammer [Online magazine]. Retrieved July, 2012 from http://www.i-programmer.info/about-us.html
Goh, O. S., &; Fung, C. C. (2008). The design of interactive conversation agents. WSEAS Transactions on Information Science &; Applications, 6, 901-912.
Goldie, A. D. (2011). Chatter: A spoken language dialogue system for language learning applications (Master’s thesis), Massachusetts Institute of Technology (MIT), Department of Electrical Engineering and Computer Science. Retrieved December 31, 2011 from http://groups.csail.mit.edu/sls/publications/2011/Goldie_MEngThesis_2011.pdf
Heller, B., Proctor, M., Mah, D., Jewell, L., &; Cheung, B. (2005). Freudbot: An investigation of chatbot technology in distance education. Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2005, 3913-3918. Retrieved December, 2011 rom http://psych.athabascau.ca/html/chatterbot/ChatAgent-content/EdMediaFreudbotFinal.pdf
Horrigan, S. (2009). Skynet: Speech-enabled conversational agent to support second language acquisition (Master’s thesis), University of California at Berkeley. Retrieved December, 2011 from http://www.cs.berkeley.edu/~eomer/files/MSReport.pdf
Hsieh, S-W.(2011). Effects of cognitive styles on an MSN virtual learning companion system as an adjunct to classroom instructions. Educational Technology &; Society, 14(2), 161-174.
Huang, Y.-T., Lin, Y.-L., Yang, J.-C., &; Wu, Y.-C. (2008a). An English dialogue companion system for supporting conversation practice. Proceedings of the 16th International Conference on Computers in Education (ICCE). Taipei, Taiwan, 43-48. Retrieved December, 2011 from http://apsce.net/icce2008/papers/ICCE2008-paper270.pdf
Huang, Y.-T., Yang, J.-C., &; Wu, Y.-C. (2008b). The development and evaluation of an English dialogue companion system. Proceedings of the 2008 Advanced Learning Technologies, 864 – 868. Retrieved December 30th, 2011 from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4561853
Icogno Ltd. (n.d.). Why did you create the Jabberwacky? Retrieved July, 2012 from http://www.icogno.com/why_create_chatbot_jabberwacky.html
Jabberwacky (n.d.). About the Jabberwacky AI. Retrieved July, 2012 from http://www.jabberwacky.com/j2about
Jeon, K. S. (2007). Interaction-driven L2 learning: Characterizing linguistic development. In A. Macky (ed.), Conversational interaction in second language acquisition (pp. 379-403). NY: Oxford University Press.
Jia, J. (2004a). The study of the application of a keywords-based chatbot system on the teaching of foreign languages.Research report at the University of Augsburg. Retrieved July , 2012 from http://arxiv.org/ftp/cs/papers/0310/0310018.pdf
Jia, J. (2004b). CSIEC (Computer Simulator in Educational Communication): An intelligent web-based teaching system for foreign language learning. In L. Cantoni&; C. McLoughlin (Eds.), Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2004, 4147-4152. Chesapeake, VA: AACE.
Retrieved December, 2011 from http://arxiv.org/ftp/cs/papers/0312/0312030.pdf
Jia, J., Chen, W., &;Hou, S. (2006). Improving the CSIEC project through agent technology and adapting it to English instruction in China. Proceedings of ICCE 2006, pp. 47-54. Retrieved July, 2012 from http://arxiv.org/ftp/cs/papers/0602/0602018.pdf
Jia, J., &; Chen, W. (2008). Motivate the learners to practice English through playing with chatbot CSIEC. Proceedings of the 3rd International Conference on E-learning and Games (Edutainment 2008) (LNCS 5080), Nanjing, China, 180-191.
Kerly, A., &; Bull, S. (2006). The potential for chatbots in negotiated learner modeling: A wizard-of-oz study. Proceedings of the 8th International Conference on Intelligent Tutoring Systems (ITS'2006). LNCS No.4053, Lecture Notes in Computer Science, 645-654. Retrieved December 31st from http://www.springerlink.com/content/l85108303h1617r0/
Kerly, A., Hall, P., &; Bull, S. (2006). Bringing chatbots into education: Towards natural language negotiation of open learner models. In R. Ellis, T. Allen, &; A. Tuson (Eds), Applications and Innovations in Intelligent Systems XIV-Proceedings of AI-2006, 26th SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, Springer.
Kerly, A., Ellis, R., &; Bull, S. (2008). Conversational agents in E-learning. Proceedings of AI-2008, the Twenty eighth SGAI International Conference on Innovative Techniques and Applications of Artificial Intelligence, Springer, London. Retrieved December, 2011 from http://www.eee.bham.ac.uk/bull/papers-pdf/AI08.pdf

Kirakowski, J., O’Donnell, P., &; Yiu, A. (2009). Establishing the hallmarks of a convincing chatbot-human dialogue. Human-Computer Interaction, In I. Maurtua (Ed.), ISBN: 978-953-307-022-3, InTech. Retrieved December, 2011 from http://www.intechopen.com/articles/show/title/establishing-the-hallmarks-of-a-convincing-chatbot-human-dialogue
Lai, C. (2005). Introduction: The role of communicative practices with and through the computer. In Y. Zhao (Ed.), Research in technology and second language education developments and directions (pp. 249-258). Greenwich, CT: Information Age Publishing.
Larson-Hall, J. (2010). A guide to doing statistics in second language research using SPSS. Oxon, OX: Routledge.
Last, R. W. (1989). Artificial intelligence techniques in language learning. Chichester, England: Ellis Horwood Limited.
Lightbown, P. M., &; Spada, N. (2004). How languages are learned. Oxford: Oxford University Press.
Loebner, H. (2009). What is the Loebner Prize? [Web log post]. Retrieved July, 2012 from http://www.chatbots.org/awards/loebner_prize/loebner_prize/
Loebner, H. (2010). Selection process. [Web log post]. Retrieved July, 2012 from http://www.chatbots.org/awards/loebner_prize/year_2011/
Loebner Prize (n.d.). What is the Loebner Prize? Retrieved July, 2012 from http://www.loebner.net/Prizef/loebner-prize.html
Lu, C.-H., Chiou, G.-F., Day, M.-Y., &; Ong, C.-S. (2006). Using instant messaging to provide an intelligent learning environment. Lecture Notes in Computer Science, 4053, 575-583.
Mackey, A., &; Goo, J. (2007). Interaction research in SLA: A meta-analysis and research synthesis. In A. Macky (ed.), Conversational interaction in second language acquisition (pp. 29-51). NY: Oxford University Press.

Oppy, G., &;Dowe, D. (2011). The Turing Test. In E. N. Zalta (Ed.), The Stanford Encyclopedia of Philosophy. Retrieved from July 22nd from http://plato.stanford.edu/entries/turing-test/#AltTes
Perry, D., Hall, P., &; Ellis, R. (2008). The present and future of conversational learning systems in education (TeachBot English Project Research Report). Retrieved December, 2011 from http://www.data.org.uk/generaldocs/curric2008/Designbots/DesignBot%20Report%20summary.pdf
Personality Forge (n.d.). About the Personality Forge. Retrieved July, 2012 from http://www.personalityforge.com/info.php
Procedural Arts (n.d.). What is Façade? Retrieved July, 2012 from http://www.interactivestory.net/faq/#what
Richards, J. C., &; Schmidt, R. (2002). Dictionary of language teaching &; applied linguistics (3rd ed.). Essex: Person Education Limited.
Schumaker, R P., &; Chen, H. (2010). Interaction analysis of the ALICE chatterbot: A two-study investigation of dialog and domain questioning. IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans, 40(1), 40-51. Retrieved December 31st from http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=5272316&;tag=1
Schumaker, R. P., Ginsburg, M., Chen, H., &; Liu, Y. (2006). An evaluation of the chat and knowledge delivery components of a low-level dialog system: The AZ-ALICE experiment. Decision Support System, 42, 2236-2246.
Sha, G. (2009). AI-based chatterbots and spoke English teaching: A critical analysis. Computer Assisted Language Learning, 22(3), 269-281. Retrieved December, 2011 from http://www.ingentaconnect.com/content/routledg/call/2009/00000022/00000003/art00005
Shieber, S. M. (1993). Lessons from a restricted Turing Test. Communications of the Association for Computing Machinery, 37(6), 70-78.
Stewart I. A. D., &; File, P. (2007). Let’s Chat: A conversational dialogue system for second language practice. Computer Assisted Language Learning, 20(2), 97-116.
Swain, M. (2007). The output hypothesis: Its history and its future its history and its future. Proceedings of the 5th International Conference on ELT in China &; the 1st Congress of Chinese Applied Linguistics. Retrieved April, 2013 from http://www.celea.org.cn/2007/keynote/ppt/merrill%20swain.pdf
Torma, N. (2011). Artificial intelligence: Overview on question answering and chatbots. Retrieved December, 2011 from http://www.logic.at/lvas/185054/
Tudini, V. (2003). Using native speakers in chat. Langauge &; Technology, 7(3), 141-159.
Turing, A. M. (1950). Computing machinery and intelligence. Mind, 59(236), 433-460.
Vrajitoru, D. (2006). NPCs and chatterbots with personality and emotional response. Proceedings of Computational Intelligence and Games 2006 IEEE Symposium, 142-147.
Webb, N., Benyon, D., Hansen, P., &; Mival, O. (2010). Evaluating human-machine conversation for appropriateness. Proceedings of the Seventh conference on International Language Resources and Evaluation. Retrieved December, 2011 from http://www.nick-webb.net/Home/Publications_files/NJW_LREC10_Evaluation.pdf
Wilcox, B. (2008, August 14). Beyond AIML: Chatbots 102. [Web log post]. Retrieved July, 2012 from http://www.gamasutra.com/view/feature/3761/beyond_aiml_chatbots_102.php
Wilcox, B. (2011a, March 15). Beyond Façade: Pattern matching for natural language applications. [Web log post]. Retrieved July, 2012 from http://www.gamasutra.com/view/feature/6305/beyond_fa%C3%A7ade_pattern_matching_.php


Wilcox, B. (2011b, June 23). Suzette, the most human computer. [Web log post]. Retrieved July, 2012 from http://www.gamasutra.com/blogs/BruceWilcox/20110622/7840/Suzette_the_Most_Human_Computer.php
Williams, L., &; van Compernlle, R. A. (2009). The chatbots as a peer/tool for learners of French. In L. Lomicka, &; G. Lord (Eds.), The next generation: Online collaboration and social networking in CALL (pp. 145-172). San Marcos, TX: Calico.
Wolfe-Quintero, K., Inagaki, S., &; Kim, H.-Y. (1998). Second language development in writing: Measures of fluency, accuracy &; complexity. University of Hawai Press, HI: Honolulu.