臺灣博碩士論文加值系統

針對單標籤分類、多標籤分類與回歸預測的問題，我們提出了一個演算法來解決這些問題，這個演算法主要可以分成四個步驟，分別是旋轉相似度計算、加權關聯性計算、混合式學習與門檻值檢測。
一開始，我們將訓練樣本輸入演算法中進行旋轉群相似度計算，它會將每筆訓練樣本都轉換成一表示各旋轉群的相似度的向量，而旋轉群是一種更妥善描述資料分佈的方法，尤其是當資料分佈的形狀越接近超球體、超橢圓體或是斜角超橢圓體。我們會將轉換過後的相似度進行加權合併整合，以得到此樣本與每種類別標籤或是輸出目標值的關聯性；之後，運用混合式學習演算法來修正演算法中的參數，以提升系統的效能，讓預測的結果更加的準確；我們會依照不同的問題類型而設定不同的門檻值函數，最後透過門檻值檢測取得演算法的預測輸出結果。
使用者並不需要預先設定旋轉群的數量，而是在訓練階段時，每個群將會自動建立與形成。最後我們透過一些實驗可以得知我們的方法的效能。

We propose an algorithm for single label classification, multi-label classification, and regression estimation which incorporates a rotating similarity, weighted relevance, hybrid learning, and threshold checking.
Firstly, the rotating cluster similarity is more suitable of the distribution of the data set with hyper-spherical, hyper-ellipsoidal, or oblique hyper-ellipsoidal shapes and it is used to transform each input instance into a rotating cluster similarity. Then, the similarity of the input instance will be combined to obtain the weighted relevance of the input instance to each particular category or output value. Next, we use the hybrid learning method to refine the parameters which is in this algorithm to get better performance. Finally, the threshold checking is used to obtain the output. We will set different kind of threshold functions to determine the output due to the kind of problems.
The number of rotating clusters do not need to be specified in advance. Each cluster will self-construct during the training phase. A number of experimental results are shown the effectiveness of our proposed method.

致謝 i
摘要 ii
Abstract iii
圖目錄 vi
表目錄 vii
第一章 導論 1
1.1. 研究動機與文獻回顧 1
1.2. 問題描述 4
1.3. 論文架構 4
第二章 文獻探討 5
2.1. 主成分分析(PCA) 5
2.2. Versatile elliptic basis function neural network (VEBF) 7
2.2.1. VEBF架構與概述 7
2.2.2. Geometrical Growth Criterion 8
2.2.3. Merging Strategy 10
2.3. LO Method 11
2.3.1. Structure Identification 13
2.3.2. Parameter Identification 15
第三章 研究方法 18
3.1. 系統流程與架構 18
3.2. 旋轉群相似度計算(Rotating Cluster Similarity) 20
3.2.1. 自構性規範(Self-Constructing Criterion) 21
3.3. 加權關聯性計算(Weighted Relevance) 25
3.4. 混合式學習法(Hybrid Learning) 27
3.5. 門檻值檢測(Threshold Checking) 29
3.6. 演算法與時間複雜度分析(Time Complexity Analysis) 30
3.7. 範例說明 32
第四章 實驗結果與分析 38
4.1. 單標籤分類 38
4.2. 多標籤分類 41
4.3. 回歸預測 43
第五章 結論與未來研究方向 47
參考文獻 49

[1]I. Maglogiannis, H. Sarimveis, C.T. Kiranoudis, A.A. Chatziioannou, N. Oikonomou, and V. Aidinis, &;quot;Radial basis function neural netwroks classification for the recognition of idiopathic pulmonary fibrosis in microscopic images,&;quot; IEEE Transaction on Information Technology in Biomedicine, vol. 12, pp. 42-54, January 2008.
[2]B.S. Lin, B.S. Lin, F.C. Chong, and F. Lai, &;quot;Higher-order-statisticsbased radial basis function networks for signal enhancement,&;quot; IEEE Transactions on Neural Networks, vol. 18, pp.823-832, May 2008.
[3]R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval. Addison Wesley, 1999.
[4]G. Tsoumkas, E. Spyromitros-Xioufis, J. Vilcek, and I. Vlahavas, &;quot;A java library for multi-label learning,&;quot; Journal of Machine Learning Research, 2011.
[5]G. Salton and M. J. McGill, Introduction to Modern Retrieval. McGraw-Hill Book Company, 1983.
[6]A. Elisseeff and J. Weston, &;quot;A kernel method for multi-labelled classification,&;quot; Advances in Neural Information Processing Systems 14, MIT Press, Cambridge, pp. 681–687, 2002.
[7]H. Leung, T. Lo, and S. Wang, &;quot;Prediction of noisy chaotic time series using an optimal radial basis function neural network,&;quot; IEEE Transactions on Neural Networks, vol. 12, pp. 1163-1172, September 2001.
[8]S.M. Chen and C.D Chen, &;quot;TAIEX forecasting based on fuzzy time series and fuzzy variation groups,&;quot; IEEE Transactions on Fuzzy Systems, vol. 19, pp. 1-12, February 2011.
[9]S.M. Chen, H.P. Chu, and T.W. Sheu, &;quot;TAIEX forecasting using fuzzy time series and automatically generated weighted of multiple factors,&;quot; IEEE Transactions on System, Man, and Cybernetics, Part A, vol. 42, pp. 1485-1495, November 2012.
[10]A. Kusiak, H. Zheng, and Z. Song, &;quot;Short-term prediction of wind farm power: A data mining approach,&;quot; IEEE Transactions on Energy Conversion, vol. 24, pp. 125-136, March 2009.
[11]D.W. Aha, &;quot;Lazy learning: Special issue editorial,&;quot; Artificial Intelligence Review, vol. 24, pp. 125-136, February 1997.
[12]J. MacQueen, &;quot;Some methods for classification and analysis of multivariate observations,&;quot; Proceedings of 5-th Berkeley Symposium on Mathmatical Satistics and Probability, Berkeley, University of California press, vol. 1, pp. 281-297, 1967.
[13]T. Mitchell, Machine Learning. McGraw-Hill, 1997.
[14]T. Kohonen, Self-organizaing Maps. Springer, 1995.
[15]N.B. Karayiannis, &;quot;Reformulated radial basis neural networks trained by gradient descent,&;quot; IEEE Transactions on Neural Networks, vol. 12, pp. 1163-1172, May 1999.
[16]M.J.L. Orr, Introduction to radial basis function networks. Centre for Cognitive Science, University of Edinburgh, 2, Buccleuch Place, Edinburgh EH8 9LW, Scotland, 1996.
[17]S. Haykin, Neural Network- A Comprehensive Foundation. Upper Saddle River, NJ, USA: Prentice - Hall, 1999.
[18]C. Cortes and V. Vapnik, &;quot;Support-Vector networks,&;quot; Machine Learning, vol. 20, pp. 273-297, 1995.
[19]T. Joachims, &;quot; Text categorization with support vector machines: Learning with many relevant features,&;quot; European Conference on Machine Learning, pp. 137-142, 1998.
[20]S.R. Gunn, Support Vector Machines for Classification and Regression. UNIVERSITY OF SOUTHAMPTON, 1998.
[21]M.W. Mak and S.Y. Kung, &;quot;Estimation of elliptical basis function parameters by the EM algorithm with application to speaker verification,&;quot; IEEE Transactions on Neural Networks, vol. 11, pp. 961-969, July 2000.
[22]J.C. Luo, Q.X. Chem, J. Zheng, Y. Leung, and J.H. Ma, &;quot;An elliptical basis function network for classification of remote-sensing images,&;quot; IEEE International on Geoscience and Remote Sensing Symposium, vol. 6, pp. 3489-3494, 2003.
[23]S. Jaiyen, C. Lursinsap, and S. Phimoltares, &;quot;A very fast neural learning for classification using only new incoming datum,&;quot; IEEE Transactions on Neural Networks, vol. 21, pp. 381-392, March 2010.
[24]G. Tsoumakas and I. Katakis, &;quot;Multi-label classification: An overview,&;quot; International Journal of Data Warehousing and Mining, vol. 3, pp. 1-13, 2007.
[25]G. Tsoumakas, I. Katakis and I. Vlahavas, &;quot;Random k-labelsets for multi-label classification,&;quot; IEEE Transactions on Knowledge and Data Engineering, vol. 23, pp. 1079-1088, July 2011.
[26]M. Boutell, J. Luo, X. Shen, and C. Brown, &;quot;Learning multi-label scene classification,&;quot; Pattern Recognition, vol. 37, pp. 1757-1771, March 2004.
[27]H.Y. Lo, S.D. Lin, and H.M. Wang, &;quot;Generalized k-labelsets ensemble for multi-label and cost-sensitive classification,&;quot; IEEE Transactions on Knowledge and Data Engineering, vol. 26, pp. 1679-1691, July 2014.
[28]R.E. Schapire and Y. Singer, &;quot;BoosTexter: A boosting-based system for text categorization,&;quot; Machine Learning, vol. 39, pp. 135-168, May 2000.
[29]A. McCallum, &;quot;Multi-label text classification with a mixture model trained by EM,&;quot; Working Notes of the AAAI99 Workshop on Text Learning, 1999.
[30]M.L. Zhang and Z.H. Zhou, &;quot;Multilabel neural networks with applications to functional genomics and text categorization,&;quot; IEEE Transactions on Knowledge and Data Engineering, vol. 18, pp. 1138-1351, October 2006.
[31]M.L. Zhang and Z.H. Zhou, &;quot;MLKNN: A lazy learning approach to multi-label learning,&;quot; Pattern Recognition, vol. 40, pp. 2038-2048, July 2007.
[32]M.L. Zhang, &;quot;ML-RBF: RBF neural networks for multi-label learning,&;quot; Neural Processing Letters, vol. 29, pp. 61-74, April 2009.
[33]A.J. Smola and B. Scholkopf, &;quot;A tutorial on support vector regression,&;quot; Statistics and Computing, vol. 14, pp. 199-222, August 2004.
[34]G.Wang, D.Y. Yeung, and F.H. Lochovsky, &;quot;A new solution path algorithm in support vector regression,&;quot; IEEE Transactions on Neural Networks, vol. 19, pp. 1753-1767, October 2008.
[35]D. Li, R.M. Mersereau, and S. Simske, &;quot;Blind image deconvolution through support vector regression,&;quot; IEEE Transactions on Neural Networks, vol. 18, pp. 931-935, May 2007.
[36]D.H. Hong and C. Hwang, &;quot;Interval regression analysis using quadratic loss support vector machine,&;quot; IEEE Transactions on Fuzzy Systems, vol. 13, pp. 229-237, April 2005.
[37]C.C Chuang, &;quot;Fuzzy weighted support vector regression with a fuzzy partition,&;quot; IEEE Transactions on System, Man, and Cybernetics, Part B: Cybernetics, vol. 37, pp. 630-640, June 2007.
[38]P.Y. Hao and J.H. Chiang, &;quot;Fuzzy regression analysis by support vector learning approach,&;quot; IEEE Transactions on Fuzzy Systems, vol. 16, pp. 428-441, April 2008.
[39]S.J. Lee and C.S. Ouyang, &;quot;A neuro-fuzzy system modeling with self-constructing rule generation and hybrid SVD-based learning,&;quot; IEEE Transactions on Fuzzy Systems, vol. 11, pp. 341-353, June 2003.
[40]J.A.K. Suykens and J. Vandewalle, &;quot;Least squares support vector machine classifiers,&;quot; Neural Process Letter, vol. 9, pp. 293-300, June 1999.
[41]G.B. Huang, Q.Y. Zhu, and C.K. Siew, &;quot;Extreme learning machine: A new learning scheme of feedforward neural networks,&;quot; Proceeding IJCNN, vol. 2, pp. 985-990, 2004.
[42]G.B. Huang, H.M. Zhou, X.J. Ding, and R. Zhang, &;quot;Extreme learning machine for regression and multiclass classification,&;quot; IEEE Transactions on System, Man, and Cybernetics, Part B: Cybernetics, vol. 42, pp. 513-529, April 2012.
[43]G.H. Golub and C.F.V. Loan, Matrix computations. Baltimore, MD, USA: The Johns Hopkins University Press, 1996.
[44]K. Pearson, &;quot;On lines and planes of closest fit to systems of points in space,&;quot; Philosophical Magazine, vol. 52, pp. 559-572, 1901.
[45]H. Hotelling, &;quot;Analysis of a complex of sattistical variables into principal componetns,&;quot; Journal of Educational Psychology, vol. 24, pp. 417-4412, 1933.
[46]A. Asuncion and D. Newman. UCI machine learning repository. Schl. Inf. Comput. Sci. Univ. California, Irvine, CA, 2007
[47]N.T. Hagna, H.B. Demuth, and M.H. Beale, Neural network design. PWS Pub. Co., 1995.
[48]MATLAB SVM. Available: http://www.mathworks.com/help/stats/svmtrain.html.
[49]G. Tsoumakas, E. Spyromitros-Xioufis, J. Vilcek, and I. Vlahavas, &;quot;Mulan: A Java library for multi-label learning,&;quot; Journal of Machine Learning Research, vol. 12, pp. 2411-2414, 2011.
[50]Mulan: A Java library for multi-label learning. Available: http://mulan.sourceforge.net/datasets-mlc.html.
[51]Code for multi-label classification learning . Available: http://cse.seu.edu.cn/people/zhangml/resources.htm.
[52]M.Mike, Statistical datasets. Dept. Statist. Univ. Carnegie Mellon, Pittsburgh, PA, 1989.
[53]StatLib dataset. Available: http://lib.stat.cmu.edu/datasets/.