Please use this identifier to cite or link to this item: http://hdl.handle.net/11455/8536
標題: 新穎的前向式與遞迴式第二類型模糊類神經網路設計和FPGA實現
Novel Approaches For Feedforward / Recurrent Interval Type-2 Fuzzy Neural Network Design and FPGA Implementation
作者: 黃仁伯
Huang, Ren-Bo
關鍵字: Feedforward
前向式
Recurrent
Type-2
Fuzzy Neural Network
遞迴式
模糊類神經網路
出版社: 電機工程學系所
引用: [1] N. N. Karnik, J. M. Mendel, and Q. Liang, “Type-2 fuzzy logic systems,” IEEE Trans. on Fuzzy Systems, vol. 7, no. 6, pp. 643-658, 1999. [2] J. M. Mendel and R. I. John, “Type-2 fuzzy sets made simple,” IEEE Trans. On Fuzzy Systems, vol. 10, no. 2, pp. 117-127, 2002. [3] J. M. Mendel, Uncertain Rule-Based Fuzzy Logic System: Introduction and New Directions, Prentice Hall, Upper Saddle River, NJ2001. [4]Q. Liang and J. M. Mendel, “Interval type-2 fuzzy logic systems: theory and design,” IEEE Trans. On Fuzzy Systems, vol. 8, no. 5, pp. 535-550, 2000. [5] H. Hagras, “A hierarchical type-2 fuzzy logic control architecture for autonomous mobile robots,” IEEE Trans. Fuzzy Systems, vol. 12, no. 524-539, 2004. [6] C. H. Lee, Y. C. Lin, and W. Y. Lai, “Systems identification using type-2 fuzzy neural network (Type-2 FNN) systems,” Proc. IEEE Int. Symp. Computational Intelligence in Robotics and Automation, vol. 3, pp. 1264-1269, 2003. [7] C. H. Wang, C. S. Cheng, and T. T. Lee, “Dynamical optimal training for interval type-2 fuzzy neural network (T2FNN),” IEEE Trans. on Syst., , Man, and Cyber. - Part B: Cybernetics, vol. 34, no. 3, pp. 1462-1477, 2004. [8] J. M. Mendel, “Computing derivatives in interval type-2 fuzzy logic system,” IEEE Trans. On Fuzzy Systems, vol. 12. no. 1, pp. 84-98, Feb. 2004. [9] H. Hagras, “Comments on dynamical optimal training for interval type-2 fuzzy neural network (T2FNN),” IEEE Trans. Syst., Man and Cyber. - Part B: Cybernetics, vol. 36, no. 5, pp. 1206-1209, Oct. 2006. [10] C. F. Juang and Y. W. Tsao, “A type-2 self-organizing neural fuzzy system and its FPGA implementation”, IEEE Trans. Syst., Man, and Cyber., Part B: Cyber. vol.38, no.6, pp.1537-1548, 2008. [11] V. Vapnik, The Nature of Statistical Learning Theory, Springer, New York, 1995. [12] C. Cortes, V. Vapnik, “Support vector networks, ” Machine Learning Journal vol.20, no.3, pp.1-25, 1995. [13] A.J. Smola, B. Scholkopf, “A tutorial on support vector regression,” Statistics and Computing vol.14, no.3, pp.199-222, 2004. [14] J.A.K. Suykens, J. Vandewalle,“Recurrent least squares support vector machines,” IEEE Transactions on Circuits Systems—I: Fundamental Theory and Applications vol.47, no.7, pp.1109-1114, 2000. [15] J.H. Chiang, P.Y. Hao, “Support vector learning mechanism for fuzzy rule-based modeling: a new approach,” IEEE Transactions on Fuzzy Systems vol.12, no.1, pp.1-11, 2004. [16]B.Ribeiro,“Kernelized based functions with Minkovsky's norm for SVM regression,” in: Proc. IEEE Internat. Joint Conf. on Neural Networks, vol. 3, Honolulu, Hawaii , pp. 2198-2203, 2002. [17] D.R. Musicant, A. Feinberg,“Active set support vector regression,”IEEE Transactions on Neural Networks vol.15, no.2, pp. 268-275, 2004. [18] C.C. Chuang, S.F. Su, J.T. Jeng, C.C. Hsiao, “Robust support vector regression networks for function approximation with outliers,” IEEE Transactions on Neural Networks vol.13, no.6, pp.1322-1330, 2002. [19] C.F. Juang and C.T. Lin,“A recurrent self-organizing neural fuzzy inference network, ” IEEE Trans. Neural Networks vol.10, no.4, pp. 828-845, 1999. [20] C. H. Lee and C. C. Teng, “Identification and control of dynamic systems using recurrent fuzzy neural networks,” IEEE Trans. Fuzzy Systems vol.8, no.4, pp. 349-366, 2000. [21] P. A. Mastorocostas and J. B. Theocharis,“A recurrent fuzzy-neural model for dynamic system identification”, IEEE Trans. Syst., Man and Cyber., - Part B: Cybernetics vol.32, no.2, pp. 176-190, 2002. [22] C. F. Juang,“A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithm,” IEEE Trans. Fuzzy Systems vol.10, no.2, pp.155-170, 2002. [23] C. J. Lin and C. C. Chin,“Prediction and identification using wavelet-based recurrent fuzzy neural networks”, IEEE Trans. Sys., Man and Cyber. - Part B: Cybernetics vol.34, no.5, pp.2144-2154, 2004. [24] Y. Gao and M. J. Er, “NARMAX time series model prediction: feedforward and recurrent fuzzy neural network approaches,”Fuzzy Sets and Systems vol.150, pp.331-350, 2005. [25] C. F. Juang, C. T. Chiou, and C. L. Lai, “Hierarchical singleton-type recurrent neural fuzzy networks for noisy speech recognition,”IEEE Trans. Neural Networks, vol.18, no.3, pp.833-843, 2007. [26] Paris A. Mastorocostas, “A recurrent fuzzy filter for the analysis of lung sounds”, Fuzzy Sets and Systems vol.157, no.4, pp.578-594, 2006. [27] C. F. Juang, S. H. Chiu, and S. W. Chang, “A self-organizing TS-type fuzzy network with support vector learning and its application to classification problems”, IEEE Trans. Fuzzy Systems vol.15, no.5, pp.998-1008, 2007. [28] O. R. E. Motlagh, T. S. Hong, and N. Ismail, “Development of a new minimum avoidance system for a behavior-based mobile robot”, Fuzzy Sets and Systems vol.160, no.13, pp.1929-1946, 2009. [29] H. Shu; Q. Liang; and J. Gao,“Wireless sensor network lifetime analysis using interval type-2 fuzzy logic systems”, IEEE Trans. Fuzzy Systems vol.16, no.2, pp. 416-427, 2008. [30] H. Bustince, E. Barrenechea, M. Pagola, J. Fernandez,“Interval-valued fuzzy sets constructed from matrices: Application to edge detection”, Fuzzy Sets and Systems vol.160, no.13, pp.1819-1840, 2009. [31]J. Echanobe, I. del Campo, J.M. Tarela,“Issues concerning the analysis and implementation of a class of fuzzy controllers”, Fuzzy Sets and Systems vol.155, no.2, pp.252-271, 2005. [32] C. F. Juang and C. T. Lin, “An on-line self-constructing neural fuzzy inference network and its applications,” IEEE Trans. Fuzzy Systems, vol. 6. no. 1, pp. 12-32, Feb. 1998. [33] Q. Cao, M. H. Lim, J. H. Li, Y. S. Ong, and W. L. Ng, “A context switchable fuzzy inference chip”, IEEE Trans. Fuzzy Systems vol.14, no.4, pp.552-567 ,2006. [34]S. Sanchez-Solano, A. J. Cabrera, I. Baturone, F. J. Moreno-Velo, M. Brox, “FPGA implementation of embedded fuzzy controllers for robotic applications”, IEEE Trans. Industrial Electronics vol.54, no.4, pp.1937-1945, 2007. [35]S. H. Huang and Y. R. Chen, “VLSI implementation of type-2 fuzzy inference processor”, Proc. IEEE Int. Symp. Circuits and Systems, vol.4, pp. 3 7-3310. 2005, [36]M. Melgarejo and C. A. Pena-Reyes,“Implementing interval type-2 fuzzy processors”, IEEE Computational Intelligence Magazine vol.2, no.1, pp.63-71 2007. [37]J. Friedman, “Multivariate adaptive regression splines (with discussion),”Ann. Stat., vol. 19, pp. 1-141, 1991. [38]J. Carney and P. Cunningham, “Tuning diversity in bagged ensembles,”Int. J. Neural Syst., vol. 10, no. 4, pp. 267-279, 2000. [39]Eric W. M. Lee, Chee Peng Lim, Richard K. K. Yuen, and S. M. Lo , “A Hybrid Neural Network Model for Noisy Data Regression”, IEEE trans on systems, MAN, and Cyber—Part B, vol.34, no. 2, 2004. [40]D. Kim and C. Kim, “Forecasting time series with genetic fuzzy predictor ensemble,” IEEE Trans. Fuzzy Systems, vol. 5, no. 4, pp. 523-535, 1997. [41]M. Russo, “Genetic fuzzy learning,” IEEE Trans. Evolutionary Computation, vol. 4, pp. 259-273, 2000. [42] A. S. Weigend and N. A. Gersehnfield, Time Series Prediction: Forecasting the Future and Understanding the Past, Reading, MA: Addison-Wesley, 1994. [43]S. Singh, “Noise impact on time-series forecasting using an intelligent pattern matching technique,” Pattern Recognition, vol. 32, no. 8, pp. 1389-1398, Aug. 1999 [44]G. Chen, Y. Chen, and H. Ogmen, “Identifying chaotic system via a wiener-type cascade model, ” IEEE Trans. Contr. Syst. vol.17 , no.5, pp. 29-36, 1997. [45] J. L. Elman, “Finding structure in time ”, Cognit. Sci., vol.14, pp. 179-211 ,1990
摘要: 本論文提出一個新穎的前向式區間第二類型模糊類神經網路,其設計基於支持向量回歸法(IT2FNN-SVR),IT2FNN-SVR使用Takagi-Sugeno-Kang (TSK)模糊規則形式,IT2FNN-SVR中的每一條模糊規則的前件部使用第二類型模糊集合。網路輸入端分為實數值與Type-1模糊集合輸入,後者被用來增進抵抗雜訊能力。IT2FNN-SVR包含架構學習以及參數學習部分,在架構學習中,架構學習演算法運用於線上產生模糊規則。參數學習中,後件部參數運用支持向量回歸法學習並賦予網路高度的綜合能力。在雜訊回歸問題上,與Type-1,Type-2模糊類神經系統及Gaussian-kernel SVR比較來證明IT2FNN-SVR的效能的優化。 本論文也提出一個新的遞迴式區間第二類型模糊類神經網路(RIT2FNN)針對動態系統建立。另外對於RIT2FNN利用可程式邏輯閘陣列(FPGA)晶片實現上提出一個新的硬體實現技術。不同於現有的遞迴式Type-1模糊系統,RIT2FNN的前件部與後件部都是利用Type-2模糊集合來增進網路抗雜訊能力。RIT2FNN經由架構學習及參數學習來建立一個新的遞迴式架構伴隨著遞迴迴路來處裡動態系統問題。在於RIT2FNN硬體實現上,pipeline技術跟針對Type簡化運算的新電路也被提出來增進晶片的效能。模擬與比較上與遞迴式Type-1模糊類神經網路和前向式Type-2模糊類神經網路驗證RIT2FNN的效能。
This thesis proposes a novel feedforward interval type-2 fuzzy neural network, an Interval Type-2 Fuzzy Neural Network with Support Vector Regression (IT2FNN-SVR). The antecedent part in each fuzzy rule of an IT2FNN-SVR uses interval type-2 fuzzy sets and the consequent part is Takagi-Sugeno-Kang (TSK)-type. The networks inputs may be numerical values or type-1 fuzzy sets, where the latter is used to improve network noise resistance ability. The IT2FNN-SVR learning consists of structure learning and parameter learning. The structure learning algorithm is responsible for on-line rule generation. After structure learning, the parameters are learned through linear support vector regression (SVR) to endow the network high generalization ability. Performance of IT2FNN-SVR is verified through comparisons with those of neural networks, type-1, type-2 neural fuzzy systems, and Gaussian-kernel SVR on noisy regression problems. This paper also proposes a new recurrent interval type-2 fuzzy neural network (RIT2FNN) for dynamic system modeling. A new hardware implementation technique for the RIT2FNN using a field-programmable gate array (FPGA) chip is then proposed. Unlike existing recurrent fuzzy systems that focus on the use of type-1 fuzzy sets, the antecedent and consequent parts in a RIT2FNN use interval type-2 fuzzy sets in order to increase the network noise resistance ability. A new recurrent structure is proposed in RIT2FNN, with the recurrent loops enabling it to handle dynamic system processing problems. A RIT2FNN is constructed from structure and parameter learning. For hardware implementation of the RIT2FNN, the pipeline technique and a new circuit for type reduction operation are proposed to improve the chip performance. Simulations and comparisons with other recurrent type-1 fuzzy neural networks and feedforward type-2 fuzzy neural networks verify the performance of the RIT2FNN under noisy conditions.
URI: http://hdl.handle.net/11455/8536
其他識別: U0005-1808200914260500
文章連結: http://www.airitilibrary.com/Publication/alDetailedMesh1?DocID=U0005-1808200914260500
Appears in Collections:電機工程學系所

文件中的檔案:

取得全文請前往華藝線上圖書館



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.