跳到主要內容

臺灣博碩士論文加值系統

(44.213.60.33) 您好!臺灣時間:2024/07/17 03:01
字體大小: 字級放大   字級縮小   預設字形  
回查詢結果 :::

詳目顯示

我願授權國圖
: 
twitterline
研究生:涂世昱
研究生(外文):Shih-Yu Tu
論文名稱:以遠端記憶體優化虛擬記憶體及檔案系統快取
論文名稱(外文):Enhancing Virtual Memory and Filesystem Cache with Remote Memories
指導教授:洪士灝洪士灝引用關係
指導教授(外文):Shih-Hao Hung
口試委員:梁文耀徐慰中
口試委員(外文):Wen-Yau LiangWei-Chung Hsu
口試日期:2020-11-27
學位類別:碩士
校院名稱:國立臺灣大學
系所名稱:資訊工程學研究所
學門:工程學門
學類:電資工程學類
論文種類:學術論文
論文出版年:2020
畢業學年度:109
語文別:英文
論文頁數:22
中文關鍵詞:遠端記憶體直接存取資料交換快取資料儲存虛擬記憶盤
外文關鍵詞:RDMAI/Ocachestorageramdisk
DOI:10.6342/NTU202100453
相關次數:
  • 被引用被引用:0
  • 點閱點閱:151
  • 評分評分:
  • 下載下載:0
  • 收藏至我的研究室書目清單書目收藏:0
在以大型的資料為主的高效能運算應用中,例如基因分析,資料儲存裝置時常成為效能的瓶頸。為了有效增進儲存裝置資料交換的效率,在本篇論文當中我們利用遠端記憶體存取的技術,將遠端機器的記憶體作為近端機器儲存裝置的快取,在兩台機器之間以高速的網路界面控制器作為資料交換的媒介。相較於傳統以固態硬碟作為快取裝置的作法,我們所提出的方法有更高的頻寬與可靠度。我們針對了不同的資料存取的模式個別進行簡單的效能評測,在循序讀取方面,相較於將資料存放在固態硬碟的方式,我們提出的方法可以達到 3.5 倍的加速。另外我們也以實際基因分析的案例 (bigsnpr) 做效能測試,實驗結果顯示有 2 倍的效能加速。
For high-performance computing applications with big data, such as genomic analysis, the storage devices often become the performance bottleneck. In order to improve the performance of storage devices, we propose to borrow memory from a remote server via a high bandwidth network to serve as a caching device for the local machine’ s storage device. Our proposed method offers higher bandwidth and reliability compared to the traditional practice of using SSD as a caching device, and our implementation takes advantage of the remote direct memory access (RDMA) capability supported by the network adapter to reduce the overhead of accessing the proposed cache device. We have carried out simple micro-benchmarks as well as a application case study to demonstrate the benefits of the proposed method. In a sequential read test, compared to the traditional method of storing data on an SSD, the proposed method achieved a speedup of 3.5x. As to the real-world workload for running genomic analysis with bigsnpr, our proposed method provided 2x speedup against the traditional practice.
誌謝 i
摘要 ii
Abstract iii
1 Introduction 1
2 Background 5
2.1 Block Layer Cache Subsystem 5
2.2 Remote Direct Memory Access (RDMA) 6
2.3 Related Work 7
3 The Proposed Method 8
3.1 I/O Block Layer Cache - Bcache 8
3.2 RDMA Block Device Creation 9
3.3 System Diagram 10
3.4 Performance Issues 11
4 Performance Evaluation 12
4.1 Experimental Setup 12
4.1.1 Hardware and Operating System Speculation 12
4.1.2 Micro-benchmark - Fio test 13
4.1.3 Real world workload - Bigsnpr 13
4.2 Experimental Results 14
4.2.1 Fio Test 14
4.2.2 Bigsnpr 15
4.3 Performance Issues Discussion 16
4.3.1 Network Adapter’s Speed 16
4.3.2 With or Without RDMA 17
4.3.3 CPU Cores 17
4.3.4 Remote Ramdisk Overhead 18
5 Conclusion and Future Works 19
5.1 Conclusion 19
5.2 Future Works 20
Bibliography 21
[1] 3d xpoint technology. https://www.micron.com/products/advanced-solutions/3d-xpoint-technology.
[2] Nvme over fabrics. https://nvmexpress.org/wp-content/uploads/NVMe_Over_Fabrics.pdf.
[3] Page frame reclamation. https://www.kernel.org/doc/gorman/html/understand/understand013.html.
[4] B. Abali, R. Eickemeyer, H. Franke, C.-S. Li, and M. Taubenblatt. Disaggregated and optically interconnected memory: when will it be cost effective? 03 2015.
[5] M. K. Aguilera, N. Amit, I. Calciu, X. Deguillard, J. Gandhi, P. Subrahmanyam, L. Suresh, K. Tati, R. Venkatasubramanian, and M. Wei. Remote memory in the age of fast networks. In Proceedings of the 2017 Symposium on Cloud Computing, SoCC ’17, page 121– 127, New York, NY, USA, 2017. Association for Computing Machinery.
[6] N. Bellinger. Linuxio. http://linux-iscsi.org/wiki/LIO.
[7] M. S. Bhaskaran, J. Xu, and S. Swanson. Bankshot: Caching slow storage in fast non-volatile memory. SIGOPS Oper. Syst. Rev., 48(1):73 – 81, May 2014.
[8] Z. Fan, D. H. C. Du, and D. Voigt. H-arc: A non-volatile memory based cache policy for solid state drives. In 2014 30th Symposium on Mass Storage Systems and Technologies (MSST), pages 1–11, 2014.
[9] B. D. Gregg. Flamegraph. https://github.com/brendangregg/FlameGraph.21 doi:10.6342/NTU202100453
[10] C. Guo, H. Wu, Z. Deng, G. Soni, J. Ye, J. Padhye, and M. Lipshteyn. Rdma over commodity ethernet at scale. SIGCOMM ’16, page 202 – 215, New York, NY, USA, 2016. Association for Computing Machinery.
[11] M. Hoseinzadeh. A survey on tiering and caching in high-performance storage systems, 2019.
[12] T.-H. Kao. Aggregating Unused Memory with Efficient Remote Swapping. 2017.
[13] G. Lee, H. G. Lee, J. Lee, B. S. Kim, and S. L. Min. An empirical study on nvm-based block i/o caches. In Proceedings of the 9th Asia-Pacific Workshop on Systems, APSys ’18, New York, NY, USA, 2018. Association for Computing Machinery.
[14] K. Overstreet. A block layer cache. https://www.kernel.org/doc/Documentation/bcache.txt.
[15] D. Patterson, G. Gibson, and R. Katz. A case for redundant arrays of inexpensive disks (raid). ACM SIGMOD Record, 17, 07 1988.
[16] A. Prateek. Bcache and aerospike. https://www.slideshare.net/anshprat/bcache-lspe.
[17] F. Privé, H. Aschard, A. Ziyatdinov, and M. G. B. Blum. Efficient analysis of large-scale genome-wide data with two r packages: bigstatsr and bigsnpr. Bioinformatics(Oxford, England), 34(16):2781—2787, August 2018.
[18] W. Ruan, C. Liu, K. Shiu, S. Hung, M. Hsiao, A. Liang, and K. Lin. More exploration to composable infrastructure: The application and analysis of composable memory. In 2019 Spring Simulation Conference (SpringSim), pages 1–12, 2019.
[19] M. Srinivasan. A write back block cache for linux. https://github.com/facebookarchive/flashcache.
[20] J. Thornber. dm-cache. https://www.kernel.org/doc/Documentation/device-mapper/cache.txt.
連結至畢業學校之論文網頁點我開啟連結
註: 此連結為研究生畢業學校所提供,不一定有電子全文可供下載,若連結有誤,請點選上方之〝勘誤回報〞功能,我們會盡快修正,謝謝!
QRCODE
 
 
 
 
 
                                                                                                                                                                                                                                                                                                                                                                                                               
第一頁 上一頁 下一頁 最後一頁 top