跳到主要內容

臺灣博碩士論文加值系統

(18.97.14.81) 您好!臺灣時間:2025/02/13 08:38
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

: 
twitterline
研究生:陳柏誠
研究生(外文):Po-ChengChen
論文名稱:GSSI: 支援單系統映像之格網系統
論文名稱(外文):GSSI: a Grid System Supporting a Single System Image
指導教授:謝錫堃謝錫堃引用關係
指導教授(外文):Ce-Kuen Shieh
學位類別:博士
校院名稱:國立成功大學
系所名稱:電腦與通信工程研究所
學門:工程學門
學類:電資工程學類
論文種類:學術論文
論文出版年:2012
畢業學年度:100
語文別:英文
論文頁數:89
中文關鍵詞:分散式共享記憶體單系統映像非專屬資源遠端資料存取資源重組
外文關鍵詞:Distributed Shared Memory (DSM)Single system imageNon-dedicated resourceRemote data accessResource reconfiguration
相關次數:
  • 被引用被引用:0
  • 點閱點閱:389
  • 評分評分:
  • 下載下載:12
  • 收藏至我的研究室書目清單書目收藏:0
本研究主要探討如何設計並實現一個支援單系統映像之格網系統。我們將該系統命名為GSSI,它使用抽象層的軟體模型封裝分散於廣域網路上的各個格網節點;從GSSI使用者的角度而言,整個格網系統就如同一台虛擬的對稱式多重處理器(symmetric multiprocessor, SMP)電腦。
GSSI建立了虛擬多處理器(virtual multiprocessor)以及虛擬共享位址空間(virtual shared address space)的抽象層;因此,使用者不需再像使用MPI 和PVM 一樣,必須費心處理行程之間的訊息傳遞問題。反之,使用者只要具備多引線(multithreaded)平行程式設計的概念,便能夠快速地開發出可執行在格網環境的平行應用程式。再者,GSSI亦支援虛擬單一檔案層次結構(virtual single file hierarchy);如此一來使用者可以透通地(transparently)存取本地端與遠端檔案,而不必考慮檔案存放的實際位置。
此外,考慮到格網節點本身的非專屬特性(non-dedication),有時格網使用者不得不與格網節點提供者同時共享一個節點的計算資源;而所謂的共享,在各個工作都亟需計算資源時,就變成了彼此競爭了,這將會造成了格網節點的資源可得性問題(The availability problem)。對格網使用者來說,他們正在使用的某個格網節點在下一秒可能會被回收而無法使用,資源的服務品質將無法得到保證。對節點的提供者來說,他們熱心的共享資源,卻需要與格網使用者競爭本來就是自己所擁有的計算資源。這樣的現象將降低格網計算對人們的吸引力。為了改善這些問題,GSSI亦加入了多層次的資源重組機制,可根據格網節點提供者的工作負載量,動態的調整格網使用者對格網節點資源的使用,藉此將使得格網節點資源得到最有效的利用,並降低對格網節點提供者的干擾。
整體而言,GSSI最大的貢獻是,能夠讓過去針對對稱式多重處理器(SMP)電腦所設計的多執行緒程式,在不需修改程式碼的情況下直接運行於格網環境。而且,GSSI完全採取使用者階層(user-level)的設計,無須在格網節點上安裝作業系統補丁(patch),如此一來可有效降低格網節點提供者的管理負擔。

This dissertation presents the design and implementation of a grid system supporting a single system image, designated as GSSI. GSSI encapsulates the grid nodes distributed over a wide-area network in an abstract layer, and thereby the applications above the layer can see the encapsulated grid nodes as a virtual symmetric multiprocessor (SMP) computer.
GSSI supports a virtual multiprocessor abstraction and a virtual shared address space. Thus, the users can design grid applications by using multithreaded programming paradigm that relieves the users of worrying about the complexities of data communication and workload distribution issues. Moreover, GSSI supports a virtual single file hierarchy. Accordingly, grid applications can transparently access the distributed files without concern about the physical locations of the required files.
Additionally, grid nodes are non-dedicated, and thus grid applications are sometimes forced to compete with resource owners’ applications for idle CPU cycles. As a result, the turnaround time of both sets of applications are invariably delayed. Consequently, GSSI also provides a set of resource reconfiguration mechanisms for facilitating the idle CPU cycles of each grid node to be fully exploited by grid applications with minimum interference to the owners’ applications.
In summary, the most significant contribution of GSSI is facilitating legacy multithreaded programs to be directly executed in the grid environment without modification. Besides, the design of GSSI is a completed user-level solution; adopting GSSI does not require the user (or grid resource owners) to install any software and to modify the underlying operating system.

摘要 I
Abstract III
Acknowledgement V
Contents VI
Figures VIII
Tables IX
Chapter 1 Introduction 1
Chapter 2 Related Work 5
2.1 Single System Image 5
2.2 Grid Programming Toolkits and DSM Systems 8
2.3 Remote Data Access Schemes 10
2.4 Resource Reconfiguration Schemes 13
Chapter 3 System Design 15
3.1 Execution Environment 17
3.2 GSSI Middleware 20
3.3 DSM Subsystem 22
3.4 User-level Filesystem Module (UFM) 25
3.4.1 Access Transparency 26
3.4.2 Latency hiding 27
3.4.3 User-level Cache 29
3.5 Resource Reconfiguration Module (RRM) 31
3.5.1 Classification of Owner Workload States 31
3.5.2 Progressive, Multi-layer Resource Reconfiguration 36
Chapter 4 Implementation 39
4.1 DSM Subsystem 39
4.1.1 Thread Management 41
4.1.2 Memory Management 43
4.1.3 Two-Level Consistency Protocol 45
4.2 User-level Filesystem Module (UFM) 49
4.2.1 Data Co-allocation Download 51
4.2.2 Exponential Growth Pre-fetching 52
4.2.3 User-level Cache 53
4.3 Resource Reconfiguration Module (RRM) 57
4.3.1 Classification of Owner Workload States 57
4.3.2 Processor Reconfiguration 58
4.3.3 Node Reconfiguration 59
4.3.4 Site Reconfiguration 60
4.3.5 Progressive Reconfiguration Manner 61
Chapter 5 Performance Evaluation 64
5.1 Impact of the Two-Level Consistency Protocol 64
5.2 Practicality of Dynamic Resource Reconfiguration 69
5.3 Performance of Remote Files Access 75
Chapter 6 Conclusion 80
Bibliography 84

[1]D. P. Anderson, and G. Fedak, “The Computational and Storage Potential of Volunteer Computing, in Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, 2006.
[2]World Community Grid, 2010; http://www.worldcommunitygrid.org.
[3]Cross Campus Grid, 2010; http://www.cs.virginia.edu/~vcgr/.
[4]P.-C. Shih, H.-M. Chen, Y.-C. Chung, C.-M. Wang, R.-S. Chang, C.-H. Hsu, K.-C. Huang, and C.-T. Yang, “Middleware of Taiwan Unigrid, in Proceedings of the 2008 ACM symposium on Applied computing, Fortaleza, Ceara, Brazil, 2008.
[5]E. Huedo, R. S. Montero, and I. M. Llorente, “A Framework for Adaptive Execution in Grids, Software Practice and Experience, vol. 34, no. 7, pp. 631-651, 2004.
[6]S. Vadhiyar, and J. Dongarra, “Self Adaptivity in Grid Computing, Concurrency and Computation: Practice and Experience, vol. 17, no. 2-4, pp. 235-257, 2005.
[7]N. T. Karonis, B. Toonen, and I. Foster, “Mpich-G2: A Grid-Enabled Implementation of the Message Passing Interface, J. Parallel Distrib. Comput., vol. 63, no. 5, pp. 551-563, 2003.
[8]K. Seymour, H. Nakada, S. Matsuoka, J. Dongarra, C. Lee, and H. Casanova, “Overview of Gridrpc: A Remote Procedure Call Api for Grid Computing, in Proceedings of the Third International Workshop on Grid Computing, 2002, pp. 274-278.
[9]G. v. Laszewski, I. Foster, and J. Gawor, “Cog Kits: A Bridge between Commodity Distributed Computing and High-Performance Grids, in Proceedings of the ACM 2000 conference on Java Grande, San Francisco, California, United States, 2000, pp. 97-106.
[10]D. Kondo, G. Fedak, F. Cappello, A. A. Chien, and H. Casanova, “Characterizing Resource Availability in Enterprise Desktop Grids, Future Generation Computer Systems, vol. 23, no. 7, pp. 888-903, 2007.
[11]K. Krauter, R. Buyya, and M. Maheswaran, “A Taxonomy and Survey of Grid Resource Management Systems for Distributed Computing, Software - Practice and Experience, vol. 32, no. 2, pp. 135-164, 2002.
[12]P.-C. Chen, J.-B. Chang, T.-Y. Liang, and C.-K. Shieh, “A Progressive Multi-Layer Resource Reconfiguration Framework for Time-Shared Grid Systems, Future Generation Computer Systems, vol. 25, no. 6, pp. 662-673, 2009.
[13]A. Barak, and O. La'adan, “The Mosix Multicomputer Operating System for High Performance Cluster Computing, Future Generation Computer Systems, vol. 13, no. 4-5, pp. 361-372, 1998.
[14]A. Barak, A. Shiloh, and L. Amar, “An Organizational Grid of Federated Mosix Clusters, in Proceedings of the Fifth IEEE International Symposium on Cluster Computing and the Grid - Volume 01, 2005, pp. 350-357.
[15]C. Morin, “Xtreemos: A Grid Operating System Making Your Computer Ready for Participating in Virtual Organizations, in Proceedings of the 10th IEEE International Symposium on Object and Component-Oriented Real-Time Distributed Computing, 2007, pp. 393-402.
[16]W. Zhu, C.-L. Wang, and F. C. M. Lau, “Jessica2: A Distributed Java Virtual Machine with Transparent Thread Migration Support, in Proceedings of the IEEE International Conference on Cluster Computing, 2002, pp. 381.
[17]Y. Aridor, M. Factor, and A. Teperman, “Cjvm: A Single System Image of a Jvm on a Cluster, in Proceedings of the 1999 International Conference on Parallel Processing, 1999, pp. 4.
[18]R. Buyya, M. Murshed, D. Abramson, and S. Venugopal, “Scheduling Parameter Sweep Applications on Global Grids: A Deadline and Budget Constrained Cost-Time Optimization Algorithm, Softw. Pract. Exper., vol. 35, no. 5, pp. 491-512, 2005.
[19]I. Foster, “Globus Toolkit Version 4: Software for Service-Oriented Systems, Journal of Computer Science and Technology, vol. 21, no. 4, pp. 513-520, 2006.
[20]S. Zhou, M. Stumm, K. Li, and D. Wortman, “Heterogeneous Distributed Shared Memory, IEEE Trans. Parallel Distrib. Syst., vol. 3, no. 5, pp. 540-554, 1992.
[21]J. P. Ryan, and B. A. Coghlan, “Smg: Shared Memory for Grids, in Proceedings of 6th IASTED International Conference on Parallel and Distributed Computing and Systems, Innsbruck, Austria, 2004, pp. 439-451.
[22]D. Chen, C. Tang, X. Chen, S. Dwarkadas, and M. L. Scott, “Multi-Level Shared State for Distributed Systems, in Proceedings of the 2002 International Conference on Parallel Processing, 2002, pp. 131.
[23]M. Wan, A. Rajasekar, R. Moore, and P. Andrews, “A Simple Mass Storage System for the Srb Data Grid, in Proceedings of the 20 th IEEE/11 th NASA Goddard Conference on Mass Storage Systems and Technologies (MSS'03), 2003.
[24]G. Antoniu, L. Bougé, and M. Jan, “Juxmem: An Adaptive Supportive Platform for Data Sharing on the Grid, Scalable Computing: Practice and Experience, vol. 6, no. 33, pp. 45-55, 2005.
[25]G. Antoniu, J. F. Deverge, and S. Monnet, “How to Bring Together Fault Tolerance and Data Consistency to Enable Grid Data Sharing, Concurrency and Computation: Practice and Experience, vol. 18, no. 13, pp. 1705-1723, 2006.
[26]G. Antoniu, H. L. Bouziane, M. Jan, C. Pérez, and T. Priol, “Combining Data Sharing with the Master---Worker Paradigm in the Common Component Architecture, Cluster Computing, vol. 10, no. 3, pp. 265-276, 2007.
[27]S. S. Vazhkudai, X. Ma, V. W. Freeh, J. W. Strickland, N. Tammineedi, and S. L. Scott, “Freeloader: Scavenging Desktop Storage Resources for Scientific Data, in Proceedings of the 2005 ACM/IEEE conference on Supercomputing, 2005, pp. 56.
[28]X. Ma, V. W. Freeh, T. Yang, S. S. Vazhkudai, T. A. Simon, and S. L. Scott, “Coupling Prefix Caching and Collective Downloads for Remote Dataset Access, in Proceedings of the 20th annual international conference on Supercomputing, Cairns, Queensland, Australia, 2006, pp. 229-238.
[29]J. Zhang, and P. Honeyman, “A Replicated File System for Grid Computing, Concurrency and Computation: Practice and Experience, vol. 20, no. 9, pp. 1113 - 1130, 3 Jun 2008, 2008.
[30]O. Tatebe, Y. Morita, S. Matsuoka, N. Soda, and S. Sekiguchi, “Grid Datafarm Architecture for Petascale Data Intensive Computing, in Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2002.
[31]D. Thain, J. Basney, S.-C. Son, and M. Livny, “The Kangaroo Approach to Data Movement on the Grid, in Proceedings of the 10th IEEE International Symposium on High Performance Distributed Computing, 2001.
[32]D. Thain, and M. Livny, “Parrot: Transparent User-Level Middleware for Data-Intensive Computing, Scalable Computing: Practice and Experience, vol. 6, no. 3, pp. 9-18, 2005.
[33]R. Andersen, and B. Vinter, “Direct Application Access to Grid Storage, Concurrency and Computation: Practice and Experience, vol. 19, no. 9, pp. 1287-1298, 2007.
[34]FUSE. Filesystem in Userspace, 2010; http://fuse.sourceforge.net/.
[35]D. Thain, and T. T. M. Livny, “Distributed Computing in Practice: The Condor Experience, Concurrency and Computation: Practice and Experience, vol. 17, no. 2-4, pp. 323-356, 2005.
[36]K.-D. Ryu, and J. K. Hollingsworth, “Resource Policing to Support Fine-Grain Cycle Stealing in Networks of Workstations, IEEE Transactions on Parallel and Distributed Systems, vol. 15, pp. 878-892, September, 2004.
[37]K.-D. Ryu, and J. K. Hollingsworth, “Unobtrusiveness and Efficiency in Idle Cycle Stealing for Pc Grids, in Proceedings of 18th International Parallel and Distributed Processing Symposium, New Mexico, USA, 2004, pp. 62-.
[38]K. E. Maghraoui, T. Desell, J. , B. Szymanski, K. , and C. Varela, A. , “The Internet Operating System: Middleware for Adaptive Distributed Computing, International Journal of High Performance Computing Applications, vol. 20, no. 4, pp. 467-480, 2006.
[39]D. B. Weatherly, D. K. Lowenthal, M. Nakazawa, and F. Lowenthal, “Dyn-Mpi: Supporting Mpi on Medium-Scale, Non-Dedicated Clusters, Journal of Parallel and Distributed Computing, vol. 66, no. 6, pp. 822-838, 2006.
[40]H. Jiang, and V. Chaudhary, “Migthread: Thread Migration in Dsm Systems, in Proceedings of Workshop on Compile/Runtime Techniques for Parallel Computing, held with International Conference on Parallel Processing, Canada, 2002, pp. 581-588.
[41]J. Hollingsworth, and P. Keleher, “Prediction and Adaptation in Active Harmony, Cluster Computing, vol. 2, no. 3, pp. 195-205, 1999.
[42]K. Thitikamol, and P. Keleher, “Thread Migration and Load Balancing in Non-Dedicated Environments, in Proceedings of the 14th International Symposium on Parallel and Distributed Processing Dallas, Texas, USA, 2000, pp. 583-588.
[43]D. G. Feitelson, and L. Rudolph, “Towards Convergence in Job Schedulers for Parallel Supercomputers, in Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing, 1996, pp. 1-26.
[44]C. Amza, A. L. Cox, S. Dwarkadas, P. Keleher, H. Lu, R. Rajamony, W. Yu, and W. Zwaenepoel, “Treadmarks: Shared Memory Computing on Networks of Workstations, Computer, vol. 29, no. 2, pp. 18-28, 1996.
[45]A. Sim, J. Gu, A. Shoshani, and V. Natarajan, “Datamover: Robust Terabyte-Scale Multi-File Replication over Wide-Area Networks, in Proceedings of the 16th International Conference on Scientific and Statistical Database Managment (SSDBM'04), 2004, pp. 403- 412.
[46]A. Shoshani, A. Sim, and J. Gu, Storage Resource Managers: Essential Components for the Grid, Grid Resource Management: State of the Art and Future Trends, pp. 321-340: Kluwer Academic Publishers, 2004.
[47]J. Bent, V. Venkataramani, N. LeRoy, A. Roy, J. Stanley, A. C. Arpaci-Dusseau, R. H. Arpaci-Dusseau, and M. Livny, “Flexibility, Manageability, and Performance in a Grid Storage Appliance, in Proceedings of the 11th IEEE International Symposium on High Performance Distributed Computing, 2002.
[48]Y. Zhao, M. Wilde, I. Foster, J. Voeckler, T. Jordan, E. Quigg, and J. Dobson, “Grid Middleware Services for Virtual Data Discovery, Composition, and Integration, in Proceedings of the 2nd workshop on Middleware for grid computing, Toronto, Ontario, Canada, 2004.
[49]M. Beck, T. Moore, and J. S. Plank, “An End-to-End Approach to Globally Scalable Network Storage, in Proceedings of the 2002 conference on Applications, technologies, architectures, and protocols for computer communications, Pittsburgh, Pennsylvania, USA, 2002.
[50]W. Allcock, J. Bresnahan, R. Kettimuthu, and M. Link, “The Globus Striped Gridftp Framework and Server, in Proceedings of the 2005 ACM/IEEE conference on Supercomputing, 2005.
[51]B. Lin, and P. A. Dinda, “Towards Scheduling Virtual Machines Based on Direct User Input, in Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing, 2006, pp. 6.
[52]J. W. Strickland, V. W. Freeh, and S. S. Vazhkudai, “Governor: Autonomic Throttling for Aggressive Idle Resource Scavenging, in Proceedings of the Second International Conference on Automatic Computing, 2005, pp. 64-75.
[53]D. S. Nikolopoulos, and C. D. Polychronopoulos, “Adaptive Scheduling under Memory Constraints on Non-Dedicated Computational Farms, Future Generation Computer Systems, vol. 19, no. 4, pp. 505-519, 2003.
[54]T.-Y. Liang, C.-Y. Wu, J.-B. Chang, and C.-K. Shieh, “Teamster-G: A Grid-Enabled Software Dsm System, in Proceeding of The 2005 International Workshop on Distributed Shared Memory on Clusters at the IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005), Cardiff, UK, 2005, pp. 905-912.
[55]P.-C. Chen, J.-B. Chang, Y.-L. Su, and C.-K. Shieh, “On-Demand Data Co-Allocation with User-Level Cache for Grids, Concurrency and Computation: Practice and Experience, Accepted 18, February. 2010, 2010.
[56]P.-C. Chen, J.-B. Chang, C.-K. Shieh, C.-H. Lin, and Y.-C. Zhuang, “A Dsm-Based Fragmented Data Sharing Framework for Grids, Future Generation Computer Systems, vol. 26, no. 4, pp. 668-677, 2010.
[57]R. L. Collins, and J. S. Plank, “Downloading Replicated, Wide-Area Files - a Framework and Empirical Evaluation, in Proceedings of the Network Computing and Applications, Third IEEE International Symposium, 2004.
[58]NIST. Nist Net, 2010; http://snad.ncsl.nist.gov/nistnet/.
[59]R. Buyya, T. Cortes, and H. Jin, “Single System Image, Int. J. High Perform. Comput. Appl., vol. 15, no. 2, pp. 124-135, 2001.
[60]P.-C. Chen, J.-B. Chang, C.-K. Shieh, J.-H. Yang, and S.-H. Hsieh, “A Variable-Grain Consistency Maintenance Scheme for Shared Data on Emergency and Rescue Applications, in Proceedings of the 1st Symposium on Cloud and Service Computing (SC2-2011), Taipei, Taiwan, 2011.
[61]J. Simão, J. Lemos, and L. Veiga, A2-Vm : A Cooperative Java Vm with Support for Resource-Awareness and Cluster-Wide Thread Scheduling
on the Move to Meaningful Internet Systems: Otm 2011, Lecture Notes in Computer Science R. Meersman, T. Dillon, P. Herrero, A. Kumar, M. Reichert, L. Qing, B.-C. Ooi, E. Damiani, D. Schmidt, J. White, M. Hauswirth, P. Hitzler and M. Mohania, eds., pp. 302-320: Springer Berlin / Heidelberg, 2011.
[62]G. Qingyi, T. Peng, D. Ting, and W. Tianyu, Virtualrank: A Prediction Based Load Balancing Technique in Virtual Computing Environment. pp. 247-256.
[63]M. Amini Salehi, B. Javadi, and R. Buyya, “Qos and Preemption Aware Scheduling in Federated and Virtualized Grid Computing Environments, Journal of Parallel and Distributed Computing, vol. 72, no. 2, pp. 231-245, 2012.
[64]P.-C. Chen, C.-I. Lin, S.-W. Huang, J.-B. Chang, C.-K. Shieh, and T.-Y. Liang, “A Performance Study of Virtual Machine Migration Vs. Thread Migration for Grid Systems, in Proceedings of the 22nd International Conference on Advanced Information Networking and Applications - Workshops, 2008, pp. 86-91.

連結至畢業學校之論文網頁點我開啟連結
註: 此連結為研究生畢業學校所提供,不一定有電子全文可供下載,若連結有誤,請點選上方之〝勘誤回報〞功能,我們會盡快修正,謝謝!
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top