臺灣博碩士論文加值系統

　　過去十年內網格運算已經成為國際性研究計畫常用的資源，但因現有的網格架構需要昂貴的硬體設備與高速光纖網路，離一般人的生活仍然非常遙遠。
　　本文試圖用網際網路上可以免費取得的Gmail信箱，建立一個具備傳統資料網格大部份功能，適合個人使用者使用的『個人化資料網格』，這些功能包括：
¨ 供使用者上傳與下載檔案的一致性介面
¨ 過大的檔案會切割成多個片段以存入Gmail信箱，下載時自動組合
¨ 增加Gmail信箱就能增加資料網格的總容量
¨ 存入系統的檔案會製作多份複本並存入不同信箱，提升系統的容錯能力
¨ 完整的複本定位服務，可以部份或全部檔案名稱作為搜尋關鍵字
並運用在科技藝術領域中需要大量儲存空間的場合，以讓更多人享受到網格運算帶給我們的便利。

Grid Computing has become a regular resource of international research projects for the past ten years. Since current grid structures still need expensive hardware and fiber network connections, the gap between grid computing and general users is still very large.

In this paper, we try to build a data grid system suitable for general users using free Gmail mailbox. It has most of the functions belong to traditional data grid system like:

¨ A uniform interface that allow users to upload and download files. The size of files is only limited to the total storage capacity of this data grid.
¨ When file size exceeds the limit of single message of Gmail, the system will split the file into many slices and save each slice as a plain file. These slices will be merged into the original file when downloads.
¨ The total capacity of this data grid will grow as the number of mail accounts used as storage grows.
¨ Files uploaded will have multiple replicas. These replicas will be saved to the mail accounts that have the freest space. This mechanism prevents the system to fail when single mail account cannot be accessed.
¨ A complete Replica Location Service that allows users to search files stored in the data grid using part or the full name of files. This service will list all the files and their replicas meet the query requirements.

This system can be used in any circumstances of Technical Art area which needs huge storage space, and let more people to benefit from the grid computing research.

圖目錄 5
第一章　緒論 6
1.1 研究動機 6
1.2 研究目的 7
1.3 研究方法 8
實驗用資料的來源 8
1.4 論文架構 8
第二章　相關研究 10
2.1 網格運算簡介 10
2.2 資料網格的架構 12
2.3 複本的製作與遠端讀寫 15
2.4 複本定址服務 (Replica Location Service) 17
第三章 個人化資料網格 20
3.1 Email-based 網路磁碟的工作原理 20
3.2 網路磁碟與Gmail-based網路磁碟的差異 22
3.3 個人化資料網格與一般資料網格的差異 23
第四章　實作方法 25
4.1 個人化資料網格的系統架構 25
4.2 檔案的切割與讀寫 27
4.3 複本的建立 28
4.3.1 Centralized Replica Strategy 28
4.3.2 Diversed Replica Strategy 28
4.4 複本定址服務 29
第五章　實驗數據與效能分析 32
5.1 信件數量 v.s. 讀取時間 33
5.2 壓力測試 38
第六章　結論與未來方向 40
參考文獻 42
參考資料 45

1.Abbas, A. (2004). Types of Grids. Grid Computing: A Practical Guide to Technology and Applications (pp. 64-67). Hingham, MA, USA: Charles River Media.
2.Allcock, W., Bresnahan, J., Foster, I., Liming, L., Link, J., & Plaszczac, P. (2002). GridFTP Update January 2002. Technical Report.
3.Allcock, B., Bester, J., Bresnahan, J., Chervenak, A. L., Foster, I., Kesselman, C., Meder, S., Nefedova, V., Quesnal, D., & Tuecke S. (2002). Data Management and Transfer in High Performance Computational Grid Environments. Parallel Computing Journal, 28(5)(pp. 749-771). New York: Elsevier.
4.Allcock, W. (2003). GridFTP: Protocol Extensions to FTP for the Grid. Argonne, IL, USA: Argonne National Laboratory.
5.Allcock, W., Foster, I., & Madduri, R. (2004). Reliable Data Transport: A Critical Service for the Grid. Building Service Based Grids Workshop. Global Grid Forum 11.
6.Allcock, W., Bresnahan, J., Kettimuthu, R., Link, M., Dumitrescu, C., Raicu, I., & Foster, I. (2005). The Globus Striped GridFTP Framework and Server. Proceedings of Super Computing 2005 (SC05).
7.Chervenak, A. Foster, I., Kesselman, C., Salisbury, C., & Tuecke, S. (2000). The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications, 23(3) (pp. 187-200). New York: Elsevier.
8.Chervenak, A., Deelman, E., Foster, I., Guy, L., Hoschek, W., Iamnitchi, A., Kesselman, C., Kunszt, P., Ripeanu, M., Schwartzkopf, B., Stockinger, H., Stockinger, K., & Tierney, B. (2002). Giggle: A Framework for Constructing Sclable Replica Location Services. Proceedings of Supercomputing 2002 (SC2002).
9.Chervenak, A., Palavalli, N., Bharathi, S., Kesselman, C., Schwartzkopf, R. (2004). Performance and Scalability of a Replica Location Service. Proceedings of the International IEEE Symposium on High Performance Distributed Computing 2004 (HPDC-13).
10.Crispin, M. (2003). Internet Message Access Protocol - Version 4 rev 1. The Internet Engineering Task Force RFC 3501. http://www.ietf.org/rfc/rfc3501.txt .
11.Freed, N., & Borenstein, N. (1996). Multipurpose Internet Mail Extension (MIME). The Internet Engineering Task Force RFC 2045 & 2046. http://www.ietf.org/rfc/rfc2046.txt & http://www.ietf.org/rfc/rfc2046.txt .
12.Foster, I., Geisler J., Nickless B., Smith W., & Tuecke S. (1997). Software Infrastructure for the I-WAY High-Performance Distributed Computing Experiment. Proceedings of 5th IEEE Symposium on High Performance Distributed Computing (pp. 562-571). Los Alamitos, CA, USA: IEEE Publication Office.
13.Foster, I. (2001). The Emergence of the Grid. Nature Web Matters. http://www.nature.com/nature/webmatters/grid/grid.html, captured in 2006/5.
14.Jones, R. (2004). Gmail Filesystem. Google Hacks. http://richard.jones.name/google-hacks/gmail-filesystem/gmail-filesystem.html ; captured in 2005/11.
15.Klensin, J. (2001). Simple Mail Transfer Protocol. The Internet Engineering Task Force RFC 2821. http://www.ietf.org/rfc/rfc2821.txt .
16.Madduri, R., Allcock, W., & Hood, C. (2002). Reliable File Transfers in Grid Environments. Proceedings of the the 27th IEEE Conference on Local Computer Networks (p737-738). Los Alamitos, CA, USA: IEEE Publication Office.
17.Myers, J., Mellon, C., & Rose, M. (1996). Post Office Protocol - Version 3. The Internet Engineering Task Force RFC 1939. http://www.ietf.org/rfc/rfc1939.txt .
18.Postel, J, & Reynolds, J. (1985). File Transfer Protocol (FTP). The Internet Engineering Task Force RFC 959. http://www.ietf.org/rfc/rfc959.txt .
19.Ripeanu, M., Foster, I., & Iamnitchi, A. (2002). Mapping the Gnutella Network: Properties of Large-Scale Peer-to-Peer Systems and Implications for System Design. IEEE Internet Computing Journal, 6(1) (pp. 50-57). Los Alamitos, CA, USA: IEEE Publication Office.
20.Stoica, I., Morris, R., Karger, D., Kaashoek, M. F., & Balakrishnan, H. (2001). Chord: A Scalable Peer-to-peer Lookup Service for Internet Applications. Proceedings of ACM SIGCOMM 2001 in San Diego, California.