跳到主要內容

臺灣博碩士論文加值系統

(216.73.216.152) 您好!臺灣時間:2025/11/01 23:18
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:林庭禾
研究生(外文):Ling, Ting-He
論文名稱:以分散式檔案系統探討雲端儲存的架構與應用-以GPFS為例
論文名稱(外文):Explore the architecture and applications of cloud storage by distributed file system – a case of GPFS
指導教授:楊千楊千引用關係
指導教授(外文):Yang,, Chyan
學位類別:碩士
校院名稱:國立交通大學
系所名稱:管理學院資訊管理學程
學門:商業及管理學門
學類:其他商業及管理學類
論文種類:學術論文
論文出版年:2012
畢業學年度:100
語文別:中文
論文頁數:71
中文關鍵詞:雲端儲存分散式系統負載平衡檔案系統異地備援
外文關鍵詞:Cloud storagedistribution file systemLoad BalanceDisaster Recovery
相關次數:
  • 被引用被引用:2
  • 點閱點閱:522
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
對一個企業來說,資料是最重要的資產,近年來各種天災人禍造成的資料遺失,導致許多企業蒙受巨大的損害,許多人開始思考資料安全的問題,資料備份到哪裡才是安全的?隨著Big data時代的來臨,與雲端概念的興起,新的儲存模式不斷被提出,分散式系統高效能與高容錯的特性為資料儲存提供一個不錯的選擇。本研究透過研究分散式檔案系統的特性,提出一套具備高可靠、高可用以及具備Scale-out架構的高擴充度虛擬化儲存檔案系統,整套系統具有高度的容錯能力,即使任何一個區域的機房因為天災或任何不可抗力因素,導致區域性的停止服務,整套系統還是能夠依靠另外兩個區域的正常運作,繼續提供服務,對於一個雲端儲存服務來說,這是一個非常重要的關鍵因素。不過在本研究的測試中,可以發現整個檔案系統的效能因受限於網路的效能,不論是區域網路設備還是廣域網路路由的規劃,都是決定系統效能的關鍵,根據本研究所測試的效能,能夠提供一個小規模企業的私有雲使用,如果要運用在較大的規模,必須改善其網路環境。本研究亦架設了常見的雲端儲存服務如WebDAV、Web-Base file manager、Virtualization,來驗證此一架構的應用靈活度。
Business data is the most important asset of an enterprise. Many enterprises suffered great damage due to data loss caused by various natural disasters in recent years. People start thinking about the issue of data security and backup solution. With the era of the Big data coming and the rise of the cloud concept, a new storage model is proposed. Distributed systems, high performance and high fault tolerance features provide a good choice for data storage. This study implements a cloud storage with high reliability, high availability, high scalability, scale-out architecture, and virtualization. The entire system has a high degree of fault tolerance. No matter which one server room of a region failed due to natural disasters or any reason, resulting in regional failure. The entire system is able to rely on the normal operation of the other two regions and continue to provide services for a cloud storage service. This is very important factor for a cloud storage service. However, the performance will be limited by network, whether LAN equipment or WAN route planning is the key factor to determine the system performance. The system in this study can provide a private cloud for a small-scale enterprises. The network environment must be improved if it used in public cloud or large-scale environment. This study also implements some common cloud storage services such as WebDAV, Web-Base file manager and virtualization to verify the flexibility of this system.
目 錄 IV
圖目錄 VII
表目錄 IX
一、 緒 論 1
1.1. 研究背景與動機 1
1.2. 研究目的 1
1.3. 論文結構與研究流程 1
1.4. 研究限制 2
二、 文獻探討 3
2.1. 常見儲存架構 3
2.1.1. 直接附加式儲存裝置(Direct Attached Storage, DAS) 3
2.1.2. 網路附加式儲存裝置(Network Attached Storage, NAS) 4
2.1.3. 儲存區域網路(Storage Attachment Network, SAN) 5
2.2. 儲存虛擬化 7
2.2.1. 分散式檔案系統(Distributed file system, DFS) 7
2.2.2. 常見的分散式系統 8
2.2.3. 分散式檔案系統的共同點 14
2.3. 網路虛擬化與相關技術 15
2.3.1. Bonding 15
2.3.2. VPLS 18
2.4. 雲端運算與雲端技術 19
2.4.1. 雲端的定義 20
2.4.2. 雲端運算的架構 21
2.4.3. 雲端服務的關鍵要素 23
2.4.4. 雲端的挑戰 26
三、 實驗系統設計與檔案系統介紹 29
3.1. 研究單位介紹 29
3.1.1. 踏入雲端 29
3.2. 檔案系統介紹 31
3.2.1. GPFS基本結構 31
3.2.2. GPFS的重要特性 32
3.2.3. 小結 37
3.3. 系統架構 38
3.3.1. 儲存層 38
3.3.2. 儲存應用層 40
3.3.3. 分流層 43
3.3.4. 整體架構 47
四、 實驗與測試結果 48
4.1. 可靠度測試 48
4.2. 負載平衡與效能測試 51
4.2.1. 檔案傳輸的分流情形 51
4.2.2. 網路效能測試 54
4.2.3. 應用伺服器效能測試 56
4.3. 雲端儲存應用測試 60
4.3.1. Web-base儲存空間管理 60
4.3.2. 將遠端WebDAV伺服器掛載成本機目錄 64
4.3.3. 主機虛擬化支援 65
五、 結論與未來發展 66
5.1. 結論 66
5.2. 未來發展 66
5.2.1. 更大的網路頻寬 66
5.2.2. 更低的成本 67
六、 參考文獻 68

中文文獻:
[1] 李佳航,「伺服器管理及維護方式的創新-以X公司為例」,國立交通大學,碩士論文,民國一○○年一月。
[2] 林孝盈,「Data Confidentiality and Robustness in Decentralized Cloud Storage Systems」,國立交通大學,碩士論文,民國九十九年五月。
[3] 郭文俊,「高效能雲端儲存管理策略之研究」,國立交通大學,碩士論文,民國一○○年六月。
[4] 陳瀅等著,雲端策略:雲端運算與虛擬化技術,天下,2010。
[5] 翟本喬,雲端運算的服務理念 ,2011 COMPUTEX TAIPEI 雲端運算應用服務論壇,2011。
[6] 廖本加,「於雲端計算環境上高可用性儲存系統之實作」,私立東海大學,碩士論文,民國一○○年七月。
[7] 黃智霖,「實作一個雲端計算上具資源監控的分散式資料儲存系統」,私立東海大學,碩士論文,民國一○○年七月。。
[8] 陳信宏,「網頁伺服器負載平衡架構效能之比較」,私立大同大學,碩士論文,民國九十八年一月。
[9] 鳥哥〔蔡德明〕,鳥哥的 Linux 私房菜 -- 基礎學習篇,二版,台北市,上奇,民國九十六年八月。
[10] 許憲忠,「網路與通訊:淺談『主從式架構』」,中央研究院計算中心通訊,第十一卷 第九期,民國九十四年。
[11] 蔡佳帆,梁德昭,「虛擬化技術之績效測試比較」,淡江大學,碩士論文,民國九十七年。
英文文獻:
[12] H. Liu, S.J. Liu, X.G. Meng, C. Yang, and Y. Zhang, “LBVS: A Load Balancing Strategy for Virtual Storage”, International Conference on Service Sciences (ICSS), IEEE, 2010, pages257-262.
[13] R. Singhal, P. Pawar, S. Bokare. “Enterprise Storage Architecture for Optimal Business Continuity.” Proceeding of IEEE on Data Storage and Data Engineering. 2010, pp.73-77
[14] F. Schmuck, R. Haskin. ”GPFS: A Shared-Disk File System for Large Computing Clusters.” Proceedings of the Conference on File and Storage Technologies. 2002, pp.231-244
[15] S. Zhang, S. Zhang, X. Chen, and S. Wu, "Analysis and Research of Cloud Computing System Instance," in Future Networks, 2010. ICFN '10. Second International Conference on, 2010, pp. 88-92.
[16] Z. Shuai, Z. Shufen, C. Xuebin, and H. Xiuzhen, "Cloud Computing Research and Development Trend," in Future Networks, 2010. ICFN '10. Second International Conference on, 2010, pp. 93-97.
[17] G. Chunye, L. Jie, Z. Qiang, C. Haitao, and G. Zhenghu, "The Characteristics of Cloud Computing" in Parallel Processing Workshops (ICPPW), 2010 39th International Conference on, 2010, pp. 275-279.
[18] K. N. Honwadkar and T. R. Sontakke, "An Integrated High-performance Distributed File System Based on NFS," in Methods and Models in Computer Science, 2009. ICM2CS 2009. Proceeding of International Conference on, 2009, pp. 1-5.
[19] R. V. Kassick, F. Z. Boito, and P. O. A. Navaux, "Impact of I/O Coordination on A NFS-Based Parallel File System with Dynamic Reconfiguration," in Computer Architecture and High Performance Computing (SBAC-PAD), 2010 22nd International Symposium on, 2010, pp. 199-206.
[20] A. Bianco, J. Finochietto, M. Modesti, and F. Neri, "Distributed Storage on Networks of Linux PCs Using The iSCSI Protocol," in High Performance Switching and Routing, 2008. HSPR 2008. International Conference on, 2008, pp. 252-256.
[21] J. Shafer, S. Rixner, and A. L. Cox, "The Hadoop Distributed Filesystem: Balancing Portability and Performance," in Performance Analysis of Systems & Software (ISPASS), 2010 IEEE International Symposium on, 2010, pp. 122-133.
[22] S. A. Weil, S. A. Brandt, E. L. Miller, D. D. E. Long, and C. Maltzahn, "Ceph: A Scalable, High-performance Distributed File System," in In Proceedings of the 7th Symposium on Operating Systems Design and Implementation (OSDI 2006), 2006, pp. 307-320.
[23] S. A. Weil, S. A. Brandt, E. L. Miller, and C. Maltzahn, "CRUSH: Controlled, Scalable, Decentralized Placement of Replicated Data," in SC 2006 Conference, Proceedings of the ACM/IEEE, 2006, pp. 31-31.
[24] J. H. Yun, Y. H. Park, S. J. Lee, S. M. Jang, and J. S. Yoo, "Design and Implementation of A Non-Shared Metadata Server Cluster for Large Distributed File Systems," in Computer Science and its Applications, 2008. CSA '08. International Symposium on, 2008, pp. 343-346.
[25] D. Wang and D. Feng, "A Hypervisor-Based Secure Storage Scheme," in Networks Security Wireless Communications and Trusted Computing (NSWCTC), 2010 Second International Conference on, 2010, pp. 81-86.
[26] S. Ghemawat, H. Gobioff, and S.T. Leung, The google file system. In SOSP ’03: Proceedings of the nineteenth ACM symposium on Operating systems principles (New York, NY, USA, 2003), ACM, pp. 29–43.
[27] P. Mell and T. Grance. “NIST definition of cloud computing.” National Institute of Standards and Technology. 2011.
[28] P. J. Braam. The Lustre storage architecture. http://www.lustre.org/, Cluster File Systems, Inc., Aug. 2004.
網路文獻:
[29] Haproxy http://haproxy.1wt.eu/ (access date:2011-06-11)
[30] David Chappell, Chappell & Associates,Windows虛擬化技術概觀,2007年7月。http://download.microsoft.com/download/b/4/7/b47653cc-2b52-4d9e-9f61-882aa0f42e80/MS_Virtualization_Overview_v1_1.doc
(access date:2011-10-13)
[31] 王宏仁、鄭逸寧(2011年5月)。「從東日本大震災重新檢視臺灣異地備援」, iThome。取自http://www.ithome.com.tw/itadm/article.php?c=67673&s=4
(access date:2011-11-07)
[32] ITHome,「三大主流的x86 伺服器虛擬化技術」
http://www.ithome.com.tw/itadm/article.php?c=41169&s=5,2006.
(access date:2011-11-27)
[33] Wikipedia, Virtualization. http://en.wikipedia.org/wiki/Virtualization
(access date:2011-12-21)
[34] Wikipedia,Kernel-based Virtual Machine.
http://en.wikipedia.org/wiki/Kernel-based_Virtual_Machine
(access date:2011-12-27)
[35] 虛擬系統的前世今生
http://linuxkvm.blogspot.com/2011/04/blog-post_30.html
(access date:2012-01-14)
[36] bonding | The Linux Foundation
http://www.linuxfoundation.org/collaborate/workgroups/networking/bonding (access date:2012-01-20)
[37] Google的十大核心技術 http://www.590103.idv.tw/blog/archives/1096
(access date:2012-01-20)
[38] 企業儲存架構--DAS、NAS與SAN簡介http://www2.yvtc.gov.tw/training/net/%E7%B6%B2%E8%B7%AF%E8%A6%8F%E5%8A%83%E4%BD%9C%E6%A5%AD/%E7%95%B0%E5%9C%B0%E5%82%99%E6%8F%B4/DAS%20&%20NAS%20&%20SAN%282%29.htm
(access date:2012-02-07)
[39] Wiki雲端運算。http://zh.wikipedia.org/wiki/%E9%9B%B2%E7%AB%AF%E9%81%8B%E7%AE%97 (access date:2012-02-07)
[40] IBM.com General Parallel File System. http://www-03.ibm.com/systems/software/gpfs/ (access date:2012-02-24)
[41] 財團法人國家實驗研究院國家高速網路與計算中心。
http://www.nchc.org.tw/tw/ (access date:2012-2-24)
[42] Linux High-Availability-HOWTO
http://www.linux.org.tw/CLDP/OLD/High-Availability-HOWTO/High-Availability-HOWTO-2.html (access date:2012-03-10)
連結至畢業學校之論文網頁點我開啟連結
註: 此連結為研究生畢業學校所提供,不一定有電子全文可供下載,若連結有誤,請點選上方之〝勘誤回報〞功能,我們會盡快修正,謝謝!
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top