( 您好!臺灣時間:2021/03/05 09:05
字體大小: 字級放大   字級縮小   預設字形  


研究生(外文):Chia-Hsun Lee
論文名稱(外文):「Interactive Media」- A Multimodal Approach to Interface Design for Human-Computer Interaction in Digital Design Environments
指導教授(外文):Taysheng Jeng
外文關鍵詞:Multimodal InteractionDigital Design MediaHuman-Centered ComputingHuman-Computer Interaction
  • 被引用被引用:96
  • 點閱點閱:6062
  • 評分評分:系統版面圖檔系統版面圖檔系統版面圖檔系統版面圖檔系統版面圖檔
  • 下載下載:1461
  • 收藏至我的研究室書目清單書目收藏:13
Currently, digital technologies are intensively deployed in design studios. But the user interfaces of input and output devices, as like keyboards and mice, are not user friendly to designers. Designers have to issue a set of commands manually in front of workstations in order to gain control over the digital representations.
This paper provides an innovative concept of “Interactive Media” for human-computer interaction interface design. We augment design media with vision and speech recognition technologies. The focus is on how designers interact directly through multimodal interaction with a combination of traditional and digital design media.
We use “a symphony conductor” metaphor to designer presenting design work using voices, gestures, annotations to conduct various design media to express the design concept. We can use programmable laser pointers and gestures to manipulate digital information as the same way we do physically.
In an experiential HCI manner, we show the presentation activities can be improved by using augmented traditional design presentation tools with interactive media, so that designers can control digital information in an intuitive manner.
第一章 導論
1.1 研究背景 ■ 01
1.2 研究問題與目標 ■ 02
1.3 研究範疇與準則 ■ 03
1.4 研究架構 ■ 05
第二章 文獻回顧
2.1 相關理論回顧 ■ 07
2.2 研究成果回顧 ■ 17
第三章 多模式互動
3.1 設計發表與討論方式 ■ 27
3.2 互動式媒體之多模式控制 ■ 31
3.3 互動式媒體之呈現方式 ■ 36
3.4 多模式互動架構 ■ 38
第四章 互動介面設計與實作
4.1 設計者如同指揮家 ■ 43
4.2 指揮介面實作 ■ 46
4.3 電腦視覺運算與光點辨識 ■ 48
4.4 雷射指示器指揮設計媒材之呈現 ■ 51
4.5 手勢指揮設計媒材之呈現 ■ 55
4.6 動作瀏覽之實體媒介 ■ 59
4.7 圖面互動之實體媒介 ■ 63
4.8 語意聲控瀏覽 ■ 67
第五章 應用實例
5.1 智慧型空間角 ■ 71
5.2 設計發表場景 ■ 76
5.3 設計討論場景 ■ 79
5.4 作品展示走廊 ■ 81
第六章 結論與建議
6.1 結論 ■ 83
6.2 議題探討 ■ 84
6.3 後續研究 ■ 86
參考文獻 ■ 87
.Abowd, G. D., E.D. Mynatt, T. Rodden, The Human Experience, in IEEE Pervasive Computing Jan-Mar 2002 Vol. 1 Issue 1, pp. 48-57, 2002
.Anderson, D.(ed.), Tangible Interaction + Graphical Interpretation: A New Approach to 3D Modeling, in Proceedings of SIGGRAPH 2000, ACM Press, pp393-402, 2000
.Bellotti, V., M. Back, W.K. Edwards, R.E. Grinter, A. Henderson, C. Lopes, Making Sense of Sensing Systems: Five Questions for Designers and Researchers, in Proceedings of CHI 2002, ACM Press, pp. 415-422, 2002
.Brook, R., A Robust Layered Control System for a Mobile Robot, IEEE Journal of Robotics and Automation, RA-2, 1986
.Brooks, R.(ed.), The Intelligent Room Project, in Proceedings of the Second International Cognitive Technology Conference (CT'97), Aizu, Japan, 1997
.Brooks, R., New Ways of Interacting with Computers, presentation in Amsterdam, June 12, 2001
.Brown, J.S., P. Duguid, The Social Life of Information, Harvard Business School Press, 2000
.Buxton, W., G. Fitzmanurice, R. Balakrishnan, G. Kurtenbach, Large Displays in Automotive Design, in IEEE Computer Graphics and Applications, July/August 2000, pp. 68-75, 2000
.Camarata, K., E. Y. Do, B.R. Johnson, M.D. Gross, Navigational Blocks: Tangible Navigation of Digital Information, in Proceedings of CHI 2002, ACM Press, pp.752-753, 2002
.Cavens, D., F. Vogt, S. Fels, M. Meitner, Interacting with Big Screen: Pointers to Ponder, in Proceedings of CHI 2002, ACM Press, pp. 678-679, 2002
.Coen, M., B. Phillips, N. Warshawsky, L. Weisman, S. Peters, K. Gajos, P. Finin, Meeting the computational needs of intelligent environments: The Metaglue System, in Proceedings of MANSE’99, Dublin, Ireland. 1999.
.Coen, M., Design Principles for Intelligent Environments, in Proceedings of AAAI'98., 1998
.Coen, M., Multimodal Integration - A Biological View, in Proceedings of IJCAI'01. Seattle, WA, 2001.
.Davies, N., H-W Gellersen, Beyond Prototypes: Challenges in Deploying Ubiquitous Systems, in IEEE Pervasive Computing Jan-Mar 2002 Vol. 1 Issue 1, pp. 26-35, 2002
.Dertouzos, M.L., The Oxygen Project, Scientific American, vol. 282, no. 3, pp. 52-63, August, 1999
Dertouzos, M.L., The Unfinished Revolution: Human-centered computers and what they can do for us, HarperCollins Publishers, Inc., USA, 2001
Dey, A.K., D. Salber, and G. D. Abowd., A Context-based Infrastructure for Smart Environments, in Proceedings of the 1st International Workshop on Managing Interactions in Smart Environments (MANSE '99), Dublin, Ireland, pp. 114-128, 1999
.Dourish, P., Where the Action is: The Foundations of Embodied Interaction, MIT Press., 2001
.Gajos, K., A. Kulkarni, FIRE: An Information Retrieval Interface for Intelligent Environment, in Proceedings of International Workshop on Information Presentation and Natural Multimodal Dialogue IPNMD’01, Verona, Italy, 2001
.Gajos, K., Rascal- a Resource Manager for Multi-Agent Systems in Smart Spaces, in Proceedings of The Second International Workshop of Central and Eastern Europe on Multi-Agent Systems CEEMAS 2001, 2001
.Gershenfeld, N., When Things Start to Think, Raphael Sagalyn, Inc., 1999
.Grossman, T., R. Balakrishnan, G. Kurtenbach, G. Fitzmaurice, A. Khan, B. Buxton, Creating Principal 3D Curves with Digital Tape Drawing, in Proceedings of CHI 2002, pp121-128, 2002
.Hanssens, N., A. Kulkarni, R. Tuchida, T. Horton, Building Agent-Based Intelligent Workspaces, AI Lab, MIT, 2002
.Ishii, H., B. Ullmer, Tangible Bits: Towards Seamless Interfaces between People, Bits, and Atoms., in Proceedings of CHI 97, ACM Press, pp. 234-241, 1997
.Ishii, H., S. Ren, P. Frei, Pinwheels: Visualizing Information Flow in an Architectural Space, Published in the Extended Abstract of CHI’01, ACM Press, 2001
.Jacob, R.J.K., H. Ishii, G. Pangaro, J. Patten, A Tangible Interface for Organizing Information Using a Grid, in Proceedings of CHI 2002, ACM Press, 2002
.Jacob, R.J.K., User Interfaces, in Encyclopedia of Computer Science, Fourth Edition, Grove Dictionaries Inc., 2000
.Jancke, G., G.D. Venolia, J. Grudin, J. Cadiz, A. Gupta, Linking Public Spaces: Technical and Social Issues, in Proceedings of CHI 2001, ACM Press, pp530-537, 2001
.Jeng, T., C.H. Lee, C. Chen, Y.P. Ma, Interaction and Social Issues in a Human-Centered Reactive Environment, in Proceedings of CAADRIA 2002, pp285-292 , 2002
.Johanson, B., A. Fox, The Interactive Workspaces Project: Ubiquitous Computing Rooms, in IEEE Pervasive Computing 2002 Vol. 1 Issue 2, pp. 67-74, 2002
.Kulkarni, A., Design Principles of a Reactive Behavioral System for the Intelligent Room, in Bitstream: The MIT Journal of EECS Student Research, 2002
.Laurel, B., Computer as Theatre, Addison-Wesley Publishing Company, Inc., 1993
.Laurel, B., Interface as Mimesis, In User Centered System Design: New Perspectives on Human-Computer Interaction, edited by D.A. Norman and S. Draper. Hillsdale, NJ: Lawrence Erlbaum, 1986
.Lee, C.H., T. Jeng, A ContextManager for Multimedia Presentation in Intelligent Corners, in Proceedings of CAADRIA 2002, Malaysia, pp159-166, 2002
.Mackay, W. E., Augmented Reality: Linking real and virtual worlds- A new paradigm for interacting with computers, In Proceedings of AVI’98, ACM Conference on Advanced Visual Interfaces, New York: ACM Press, 1998
.Minsky, M., The Society of Mind, Simon & Schuster, Inc., 1988
.Mitchell, W.J., e-topia, MIT Press, 1999
.Olsen Jr., D.R., T. Nielsen, Laser Pointer Interaction, in Proceedings of CHI 2001, ACM Press, pp17-22, 2001
.Oviatt, S.L., Ten Myths of Multimodal Interaction, Communication of ACM, November 1999/Vol.42, No 11, pp74-81, 1999
.Patten, J., H. Ishii, J. Hines, G. Pangaro, Sensetable: A Wireless Object Tracking Platform for Tangible User Interface, in Proceedings of CHI 2001, ACM Press, 2001
.Pesce, M., The Playful World: how technology is transforming our imagination, Donadio & Ashworth (Olson), Inc., 2001
.Piaget, J., Construction of reality in the child, London: Routledge & Kegan Paul, 1954
.Pinhanez, C., Augmenting Reality with Projected Interactive Displays, in Proceedings of International Symposium on Virtual and Augmented Architecture (VAA'01), Dublin, Ireland, 2001
.Piper, B., C. Ratti, H. Ishii, Illuminating Clay: A 3-D Tangible Interface for Landscape Analysis, in Proceedings of CHI 2002, ACM Press, 2002
.Rekimoto, J., B. Ullmer, H. Oba, DataTiles: A Modular Platform for Mixed Physical and Graphical Interactions, in Proceedings of CHI 2001, ACM Press, pp269-276, 2001
.Rekimoto, J., Pick-and-Drop: A Direct Manipulation Technique for Multiple Computer Environments, in Proceedings of UIST ’97, pp. 31-39, 1997
.Rekimoto, J., SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces, in Proceedings of CHI 2002, ACM Press, pp.113-120, 2002
.Spiller (ed.), N., Cyber_Reader: Critical writings for the digital era, Phaidon Press Limited, 2002
.Svanaes, D., In Search of Metaphors for Tangible User Interfaces, in Proceedings of DARE 2000, April, 2000 Elsinore, Denmark, pp121-129, 2000
.Tennenhouse, D., Proactive Computing, Communication of ACM, May 2000/Vol.43 No.5, pp43-50, 2000
.Ullmer, B. and H. Ishii, Emerging Frameworks for Tangible User Interfaces, in Human-Computer Interaction in the New Millennium, Addison-Wesley, pp. 579-601, 2001
.Ullmer, B., E. Kim, A. Kilian, S. Gray, H. Ishii, Strata/ICC: Physical Models as Computational Interfaces, short paper of CHI’ 01, ACM Press, 2001
.Ullmer, B., H. Ishii, The metaDESK: Models and Prototypes for Tangible User Interfaces, in Proceedings of UIST’97, ACM Press, 1997
Underkoffler, J., B. Ullmer, H. Ishii, Emancipated Pixels: Real-World Graphics in the Luminous Room, in Proceedings of SIGGRAPH ’99, ACM Press, 1999
.Underkoffler, J., H. Ishii, Illuminating Light: an Optical Design Tool with a Luminous-Tangible Interface, in Proceedings of CHI 98, Los Angeles CA, USA, ACM Press, 1998
.Want, R., T. Pering, G. Borriello, K. I. Farkas, Disappearing Hardware, in IEEE Pervasive Computing Jan-Mar 2002 Vol. 1 Issue 1, pp. 36-47, 2002
.Wegner, P., Why interaction is more powerful than algorithms, Communication of ACM, May 1997/Vol.40 No.5, pp. 80-91, 1997
Weiser, M., The Computer for the 21st Century, Scientific American, Vol. 265, no. 3, pp. 94-104, September 1991
.Yarin, P., H. Ishii, TouchCounters: Designing Interactive Electronic Labels for Physical Containers, Conference Abstracts of CHI 2000, ACM Press, 2000

.朱新明&李亦菲 著,架設人與電腦的橋樑:西蒙的認知與管理心理學,貓頭鷹出版,2001
.約翰史立布朗&保羅杜奎德 著,顧淑馨 譯,資訊革命了什麼?,先覺出版,2001
.馬克畢西 著,蔡文英 譯,遊習世紀:小玩具 大科學 遊戲中發現宇宙,大塊文化出版,2001
.張春興 編譯,教育心理學:三化取向的理論與實踐,東華書局,pp85-97,1996
.葛申菲爾德 著,王昱海 譯,當鞋子開始思考,遠見出版,2002
.德托羅斯 著,羅耀宗 譯,科技活氧革命:資訊進入人性化時代,時報文化,2001

Logitech Mouse, http://www.logitech.com.tw
Macromedia Director, http://www.macromedia.com
Microsoft Agent Technology, http://www.microsoft.com/msagent
Microsoft Visual Studio.Net, http://msdn.microsoft.com/vstudio/
Source for Digital Imaging Technology, http://www.theimagingsource.com
StrokeIt- Mouse Gesture for Windows, http://www.tcbnetworks.com/strokeit/
Tangible Media Group, MIT Media Lab, http://tangible.media.mit.edu/
Things That Think, MIT Media Lab, http://www.media.mit.edu/ttt/
Ti- RFID, http://www.ti.com/tiris/default.htm
TrackThemColors Xtra for Director, http://www.smoothware.com/
註: 此連結為研究生畢業學校所提供,不一定有電子全文可供下載,若連結有誤,請點選上方之〝勘誤回報〞功能,我們會盡快修正,謝謝!
第一頁 上一頁 下一頁 最後一頁 top
系統版面圖檔 系統版面圖檔