臺灣博碩士論文加值系統

在大量運用虛擬化技術(Virtualization)的雲端運算(Cloud Computing)環境中，尤其是IaaS (Infrastructure as a Service)基礎設施的服務模式，如何管理成群的虛擬機器叢集(Cluster)，有效控制資源分配，一直是管理者致力解決的問題。除了選擇付費制度的公有雲(Public Cloud)管理平台，如何在成本與有限資源的考量下，管理私有雲(Private Cloud)的虛擬機器(Virtual Machine)更是一大考驗。
本論文架構於私有雲的IaaS服務模式，整合虛擬機器的資源管理。透過Libvirt API的應用，管理每台實體機器上的KVM (Kernel-based Virtual Machine) 與QEMU運作。以選單式的樣版部署虛擬機器，讓使用者可以節省配置時間並降低操作與設定的失誤。以SNMP (Simple Network Management Protocol) 定時監測實體機器(Physical Machine)與虛擬機器的CPU、記憶體使用率，藉此判斷實體機器與虛擬機器的工作負載。針對虛擬機器使用狀況，可於主控端自動調節記憶體的資源配置，搭配啟用虛擬機器動態遷移(Live Migration)的機制，達到動態負載分配的功能。在模擬虛擬機器網站運作的結果顯示，當虛擬機器記憶體使用率高於上限80%，能夠自動動態增加記憶體；當實體機器可用記憶體不足以供應虛擬機器額外需求，自動執行動態遷移的動作，以有效控制資源使用的負載。

As the extensive use of virtualization technology in the cloud computing environment, in particular IaaS (Infrastructure as a Service), how to effectively manage a cluster of virtual machines has been an emergent problem to be resolve. Other than the adoption of public cloud management platform, virtual machine management under limited resources in the private cloud is a challenge.
This thesis focuses on the IaaS management issues in the private cloud environment, and provides an integration resource adjustment. By applying libvirt API for management, each physical machine is assumed to be equipped with KVM and QEMU. Menu-style model is developed for virtual machines configuration so that users can save time as well as reduce operational mistakes. SNMP is employed to regularly monitor CPU and memory usage on both physical machines and virtual machines. Based on the resource consumption, we are able to automatically adjust the memory allocation for each virtual machine. When its memory usage exceeds 80%, an extra memory will be added if available. If the physical machine can not supply the additional memory demand for virtual machines, migrated to another physical machine will be automatically taken place. Experimental results show that by applying the proposed mechanism, the loading of virtual machines and physical machines can be balanced and resources can be efficiently utilized.

摘要 i
Abstract ii
目次 iii
表目次 v
圖目次 vi
第一章 緒論 1
1.1 研究動機 1
1.2 研究目的 3
1.3 論文架構 4
第二章 相關研究 5
2.1 雲端運算架構 5
2.2 虛擬化的相關技術與管理工具 6
2.2.1 KVM & QEMU 6
2.2.2 Libvirt API 7
2.2.3 libvirt-php 7
2.3 虛擬機器的檔案系統部署 7
2.4 虛擬機器的監測機制 8
2.4.1 SNMP 8
2.4.2 libvirt-snmp 8
2.5 虛擬機器的動態調節機制 9
2.5.1 CPU Hot-Plug 9
2.5.2 Memory Hot-Add 9
2.5.3 Live Migration 10
第三章 系統架構與設計 11
3.1 整體架構設計 11
3.2 主控端的功能模組 12
3.2.1 資源配置與規則定義(Configure) 13
3.2.2 虛擬機器部署(Deploy) 14
3.2.3 監測機制(Monitor) 15
3.2.4 動態調節資源(Adjust) 17
3.2.5 稽核與記錄(Log) 19
3.3 被控端的架構 19
第四章 系統實作 20
4.1 主從式管理平台的開發 20
4.2 共用儲存式資料庫、儲存池的架設 22
4.3 虛擬機器的部署實作 23
4.4 監測實體與虛擬機器的實作 26
4.5 動態調節虛擬機器配置與動態遷移的實作 29
4.5.1 動態調節虛擬機器的記憶體 30
4.5.2 動態遷移虛擬機器 30
4.5.3 後端自動調節的規則 30
第五章 情境模擬與討論 33
5.1 實體環境架設 33
5.2 高負載的記憶體動態調節模擬 35
5.3 低負載的記憶體動態調節模擬 43
5.4 綜合討論 44
第六章 結論與未來研究方向 45
參考文獻 47
附錄 49

[1] 陳瀅 等, “雲端策略:雲端運算與虛擬化技術”, 天下雜誌, March 2010.
[2] 楊文誌, “雲端運算技術指南”, 松崗, July 2010.
[3] 胡志凱, ”雲端運算中動態調整虛擬機器運算資源機制”, 碩士論文, 大同大學資訊工程研究所, July 2010.
[4] “AbiCloud”, online available at http://community.abiquo.com/display/AbiCloud, cited in Sep. 2010.
[5] “ACPI”, online available at http://www.acpi.info/, cited in Nov. 2010.
[6] Armbrust, M., et al., “Above the Clouds: A Berkeley View of Cloud Computing”, EECS Department University of California, Berkeley, Technical Report No. UCB/EECS-2009 -28, 2009.
[7] J. Case, et al., “A Simple Network Management Protocol (SNMP)”, IETF RFC 1157, May 1990.
[8] Clark, C.,et al., ”Live Migration of Virtual Machine”, Proceeding of the 2nd conference on Symposium on Networked Systems Design & Implementation, 2005.
[9] “CPU Hot-Plug”, online available at http://www.kernel.org/doc/Documentation/cpu-hotplug.txt, cited in Sep. 2010.
[10] “Gartner Identifies the Top 10 Strategic Technologies for 2011”, online available at http://www.gartner.com/it/page.jsp?id=1454221, cited in Nov. 2010.
[11] P. Grillo, S. Waldbusser, “Host Resources MIB”, IETF RFC 1514, Sep. 1993.
[12] M. Tim Jones, “Anatomy of the libvirt virtualization library”, online available at https://www.ibm.com/developerworks/linux/library/l-libvirt/, cited in July 2010.
[13] Richard WM Jones, “Virtio balloon”, online available at http://rwmj.wordpress.com/2010/07/17/virtio-balloon/, cited in July 2010.
[14] “KVM”, online available at http://www.linux-kvm.org/page/Main_Page, cited in July 2010.
[15] “LibVirt API”, online available at http://libvirt.org/, cited in July 2010.
[16] “libvirt-php”, online available at http://libvirt.org/php/, cited in Feb. 2011.
[17] “libvirt-snmp”, online available at http://wiki.libvirt.org/page/Libvirt-snmp, cited in March 2011.
[18] Dan Marinescu and Reinhold Kroeger, ”Towards a Framework for the Autonomic Management of Virtualization-Based Environments”, GI/ITG KuVS Fachgespraech Virtualisierung Paderborn, 2008.
[19] “National Institute of Standards and Technology”, online available at http://www.nist.gov, cited in March 2010.
[20] “Nimbus”, online available at http://www.nimbusproject.org/, cited in Aug. 2010.
[21] “OpenNebula”, online available at http://www.opennebula.org/, cited in April 2010.
[22] Pradeep Padala, ”Automated Management of Virtualized Data Centers”, Ph.D''s thesis, UNIVERSITY OF MICHIGAN, Nov. 2010.
[23] “QEMU”, online available at http://wiki.qemu.org/Main_Page, cited in July 2010.
[24] “Siege”, online available at http://www.joedog.org, cited in March 2011.
[25] Matthew Vliet, “Creating and Controlling KVM Guests using libvirt”, University of Victoria Faculty of Engineering Work Term Report, 30 April 2009.
[26] “Microsoft Hyper-V Dynamic Memory”, online available at http://technet.microsoft.com/en-us/library/ff817651(WS.10).aspx, cited in June 2011.
[27] “Virtio”, online available at http://www.linux-kvm.org/page/Virtio, cited in July 2010.
[28] “VMware vMotion”, online available at http://www.vmware.com/products/vmotion/overview.html, cited in Aug. 2010.
[29] “VMware vSphere”, online available at http://www.vmware.com/support/vsphere4/doc/vsp_40_new_feat.html, cited in June 2011.
[30] “WOL”, online available at http://en.wikipedia.org/wiki/Wake-on-LAN, cited in Oct. 2010.