臺灣博碩士論文加值系統

在本論文中，我們將常用於線性參數化迴歸問題中以 Ramsay function為代價函數之M估測器推廣至可應用於非線性迴歸問題之非參數化Ramsay模糊神經網路。我們的重點特別放在這種模糊神經網路抑制離群值之韌性。當面對一般非線性學習問題時，它提供了另一種機器學習的選擇。在本論文中，我們將根據最陡梯度法與重複加權最小平方法提出簡單的權重更新規則。此外，我們將提供一些數值範例用以比較一般模糊神經網路和Ramsay模糊神經網路對於抑制離群值之韌性。經由模擬結果顯示，Ramsay模糊神經網路具有較佳抑制離群值之韌性。

In this thesis, M-estimators with Ramsay’s function used in robust regression theory for linear parametric regression problems will be generalized to nonparametric Ramsay fuzzy neural networks (RFNNs) for nonlinear regression problems. Emphasis is put particularly on the robustness against outliers. This provides alternative learning machines when faced with general nonlinear learning problems. Simple weight updating rules based on incremental gradient descent and iteratively reweighted least squares (IRLS) will be derived. Some numerical examples will be provided to compare the robustness against outliers for usual fuzzy neural networks (FNNs) and the proposed RFNNs. Simulation results show that the RFNNs proposed in this thesis have good robustness against outliers.

誌謝 i
摘要 ii
Abstract iii
圖形與表格目錄 iv
第一章 介紹 1
1.1 動機 1
1.2 論文內容簡述 3
第二章 模糊神經網路 5
2.1 模糊系統 5
2.2 模糊神經網路 11
第三章 Ramsay 模糊神經網路 17
3.1 線性 M 估測器 17
3.2 Ramsay 模糊神經網路 26
3.3 重複加權最小平方法 30
第四章 範例 33
第五章 結論與未來展望 50
參考文獻 52

[Bert.1]D. P. Bertsekas, Nonlinear Programming. 2nd ed. Belmont, MA: Athena Scientific, 1999.
[Bos.1]B. E. Boser, I. M. Guyon, and V. N. Vapnik, “A training algorithm for optimal margin classifiers,” in Proc. The Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, Pennsylvania, pp. 144-152, 1992.
[Chu.1]C. C. Chuang, J. T. Jeng, and P. T. Lin, “Annealing robust radial basis function networks for function approximation with outliers,” Neurocomputing, vol. 56, pp. 123-139, 2004.
[Cor.1]C. Cortes and V. N. Vapnik, “Support vector networks,” Machine Learning, vol. 20, pp. 273-297, 1995.
[Far.1]J. J. Faraway, Linear Model with R, Boca Raton, FL: Chapman & Hall/CRC, 2005.
[Hor.1]K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, no. 5, pp. 359-366, 1989.
[Kos.1]B. Kosko, “Fuzzy systems as universal approximators,” IEEE Transactions on Computers, vol. 43, no. 11, pp. 1329-1333, 1994.
[Mon.1]D. C. Montgomery, E. A. Peck, and G. G. Vining, Introduction to Linear Regression Analysis, 4th ed. Hoboken, NJ: Wiley, 2006.
[Ram.1]J. O. Ramsay, “A comparative study of several robust estimates of slope, intercept, and scale in linear regression,” Journal of American Statistical Association, vol. 72, no. 359, pp. 608-615, 1977.
[Rou.1]P. J. Rousseeuw, A. M. Leroy, Robust Regression and Outlier Detection, Hoboken, NY: Wiley, 1987.
[Rum.1]D. E. Rumelhart, G.. E. Hinton, and R. J. Williams, “Learning internal representations by error propagation,” in Parallel Distributed Processing﹕Explorations in the Microstructure of Cognition, D. E. Rumelhart, J. L. McClelland, and the PDP Research Group Eds. Cambridge, MA: MIT Press, vol. 1, Foundations, pp. 318-362, 1986.
[Wang.1]L. X. Wang and J. M. Mendel, “Fuzzy basis functions, universal approximation, and orthogonal least squares learning,” IEEE Transactions on Neural Networks, vol. 3, no. 5, pp. 807-814, 1992.
[Wang.2]L. X. Wang, A Course in Fuzzy Systems and Control. Englewood Cliffs, NJ: Prentice-Hall, 1997.