臺灣博碩士論文加值系統

隨著網路技術與雲端技術的發展，Web 2.0 服務已經轉化成使用者角色為資訊產生者，使用者將上傳的資料交給不同的網路服務，藉由每家網路服務的伺服器端統一管理使用者的資料，並且儲存於公司內部的儲存設備中，每家公司必須花大量成本購買可確保使用者資料可靠性的硬體設備，對公司是一種負擔。
現在雲端儲存服務愈來愈流行，例如Dropbox、Google Drive及微軟的OneDrive，對於使用者而言，能隨時隨地透過網路即可存取自己的資料，而對於網路服務提供者而言，可以使用目前已提供的雲端儲存API(Application Programming Interface)，來將資料儲存到使用者的雲端空間中，減少自身在儲存空間上的成本支出，但每家雲端儲存空間都有各自的API連接方式，導致網路服務提供者需要額外支出成本去了解與設計不同的連接方式。
本研究發展出一個基於CDMI(Cloud Data Management Interface)標準格式的雲端儲存連結閘道，可以解決Dropbox、 Google Drive及微軟的OneDrive三家雲端儲存空間使用不同API形式的困擾。一般網路服務後端都會有資料庫管理使用者的資料，本研究也發展出透過連結閘道可創立與操作雲端儲存空間上的關聯式資料庫檔案與非關聯式資料庫檔案的API，能讓使用者將資料儲存到資料庫檔案中並且儲存至使用者自己的雲端儲存空間中。除了能夠讓網路服務提供者減少維護儲存空間的成本，使用者也能管理自己的資料。

Web 2.0 services have been let users become an information producer and distributor. Users upload their data to different web services. The data are managed by server-side of each web service and then they are stored in the business's internal storage devices. Every businesses must spend a lot of cost purchasing storage devices that can ensure reliability of data. Therefore, this situation lays big burden on them.
Cloud storage services (CSSs) such as Dropbox, Google Drive and Microsoft’s OneDrive are more and more popular. For users, anytime and anywhere they can access their data through the Internet. On the other hand, for web service providers (WSPs), they can store data on user’s cloud storage by using CSSs’ API and reduce their costs on storage devices. But each CSS has its own connection method of cloud storage’s API, WSPs must spend additional time understanding their APIs.
In this thesis, we propose a CDMI-compliant cloud storage access gateway to solve Dropbox, Google Drive and OneDrive three different connection methods of APIs. Moreover, WSPs usually use a database to manage user-generated data, so we propose two APIs on the access gateway that can operate the relational database file and non-relational database file on CSSs. By using them, user-generated data are stored on the database file and then it can be uploaded to users’ cloud storage. WSPs can reduce the cost of maintaining storage space and users can manage their own data.

摘 要 I
Abstract II
Acknowledgements III
Table of Contents IV
List of Figures VIII
List of Tables X
1. Introduction 1
1.1 Motivation 1
1.2 Objective 2
1.3 Outline 3
2. Backgrounds 4
2.1 Backgrounds 4
2.1.1 Cloud storage services 4
2.1.2 OAuth 4
2.1.3 RESTful API 5
2.1.4 CDMI 5
2.1.5 SQLite 7
2.1.6 Berkeley DB 7
2.2 Related Works 7
2.2.1 File identifier of three CSSs 7
2.2.2 Existing cloud API integration services 8
3. System Design 11
3.1 System Overview 11
3.2 Two Main Component 12
3.2.1 Metadata Database 12
3.2.2 Database Cache 13
3.3 Five Application programming interfaces (APIs) 14
3.3.1 Auth API. 15
3.3.2 CDMI API 17
3.3.3 SQL API and NoSQL API 18
3.3.4 Cache API 20
4. System Evaluation and Implement 22
4.1 CDMI API evaluation 22
4.1.1 Experiment 22
4.1.2 Result 22
4.2 SQL API and NoSQL API evaluation 25
4.2.1 Experiment 25
4.2.2 Result 26
4.3 Web service demonstration 28
4.3.1 Demonstration 28
4.3.2 Scale out the access gateway 33
5. Conclusions and Future Works 34
5.1 Conclusion 34
5.2 Future work 35
6. Reference 36
Appendix A. API Document 39
A.1 Auth API 39
A.1.1 Get Authorization Link 39
A.1.2 Get Access Token and Refresh Token 41
A.2 CDMI API 45
A.2.1 Create Data Object 45
A.2.2 Read Data Object 48
A.2.3 Update Data Object 53
A.2.4 Delete Data Object 55
A.2.5 Create Container Object 57
A.2.6 Read Container Object 60
A.2.7 Delete Container Object 65
A.3 SQL API 67
A.3.1 Request Headers 67
A.3.2 Request Message Body 67
A.3.3 Response Header 68
A.3.4 Response Message Body 68
A.3.5 Response Status 68
A.3.6 Examples 69
A.4 NoSQL API 69
A.4.1 Read Data 69
A.4.2 Write Data 73
A.4.3 Delete Data 76
A.4.4 Read Database 78
A.4.5 Delete Database 81
A.5 Cache API 83
A.5.1 Get Relational Database Cache Information 83
A.5.2 Get Relational Database File Information 85
A.5.3 Delete Relational Database File 88
A.5.4 Get Non-relational Database Cache Information 89
A.5.5 Get Non-relational Database File Information 91
A.5.6 Delete Non-relational Database File 94
A.6 Metadata Field 95
A.7 CDMI Capability 96

[1] Google Drive. Available: https://www.google.com.tw/intl/zh-TW/drive/
[2] Dropbox. Available: https://www.dropbox.com/home
[3] OneDrive. Available: https://onedrive.live.com/
[4] CDMI. Available: http://www.snia.org/cdmi
[5] P. Kaila, "OAuth and OpenID 2.0," From End-to-End to Trust-to-Trust, vol. 18, pp. 18-22, 2008.
[6] OAuth 2.0 process. Available: http://sugionline.com/blog/?p=236
[7] F. Belqasmi, R. Glitho, and F. Chunyan, "RESTful web services for service provisioning in next-generation networks: a survey," IEEE Commun. Mag, vol. 49, pp. 66-73, 2011.
[8] SINA. Available: http://www.snia.org/
[9] J. Lv, S. Xu, and Y. Li, "Application Research of Embedded Database SQLite," in IFITA '09. International Forum on Information Technology and Applications, pp. 539-543, 2009.
[10] M. A. Olson, K. Bostic, and M. I. Seltzer, "Berkeley DB," in USENIX Annual Technical Conference on FREENIX Track, pp. 183-191, 1999.
[11] D. Petcu, "Portability and interoperability between clouds: challenges and case study," in Towards a Service-Based Internet, ed: Springer, pp. 62-74, 2011.
[12] JCloud. Available: https://jclouds.apache.org/
[13] SimpleCloud. Available: http://www.ibm.com/developerworks/library/os-simplecloud/
[14] F. AlShahwan and K. Moessner, "Providing SOAP Web Services and RESTful Web Services from Mobile Hosts," in Fifth International Conference on Internet and Web Applications and Services (ICIW), pp. 174-179, 2010.
[15] L. Hongjun, "RESTful Web service frameworks in Java," in IEEE International Conference on Signal Processing, Communications and Computing (ICSPCC), pp. 1-4, 2011.
[16] W. Ratinimittum and K. Piromsopa, "An implementation of RESTful-based Scalable File System," in International Joint Conference on Computer Science and Software Engineering (JCSSE), pp. 136-141, 2012.
[17] Cloud Elements. Available: http://cloud-elements.com/
[18] Kloudless. Available: https://developers.kloudless.com/
[19] N. Nurseitov, M. Paulson, R. Reynolds, and C. Izurieta, "Comparison of JSON and XML Data Interchange Formats: A Case Study," Caine, vol. 9, pp. 157-162, 2009.
[20] G. S. Machado, D. Hausheer, and B. Stiller, "Considerations on the Interoperability of and between Cloud Computing Standards," in 27th Open Grid Forum (OGF27), G2C-Net Workshop on From Grid to Cloud Networks, pp. 1-4, 2009.
[21] R. Teckelmann, C. Reich, and A. Sulistio, "Mapping of cloud standards to the taxonomy of interoperability in IaaS," in IEEE Third International Conference on Cloud Computing Technology and Science (CloudCom), pp. 522-526, 2011.
[22] Z. Zhang, C. Wu, and D. W. L. Cheung, "A survey on cloud interoperability: taxonomies, standards, and practice," SIGMETRICS Perform. Eval. Rev., vol. 40, pp. 13-22, 2013.
[23] I. Livenson and E. Laure, "Towards transparent integration of heterogeneous cloud storage platforms," in fourth international workshop on Data-intensive distributed computing, pp. 27-34, 2011.
[24] CDMI-Proxy. Available: http://resources.venus-c.eu/cdmiproxy/docs/index.html
[25] D. Gannon, D. Fay, D. Green, K. Takeda, and W. Yi, "Science in the cloud: lessons from three years of research projects on microsoft azure," in 5th ACM workshop on Scientific cloud computing, pp. 1-8, 2014.
[26] Amazon Simple Storage Service. Available: http://aws.amazon.com/tw/s3/
[27] dCache. Available: https://github.com/dCache/CDMI
[28] Google Developers Console. Available: https://console.developers.google.com/project/magnetic-math-686/apiui/credential?authuser=0
[29] W. Qinglin and W. Yan, "Performance Testing and Optimization of J2EE-Based Web Applications," in Second International Workshop on Education Technology and Computer Science (ETCS), pp. 681-683, 2010.
[30] H. Jing, E. Haihong, L. Guan, and D. Jian, "Survey on NoSQL database," in 6th International Conference on Pervasive Computing and Applications (ICPCA), pp. 363-366, 2011.
[31] Amazon Elastic Compute Cloud. Available: http://aws.amazon.com/tw/ec2/
[32] miniBB Forum. Available: http://www.minibb.com/
[33] Box. Available: https://www.box.com/