Hybrid Generalised Additive Type-2 Fuzzy-Wavelet- Neural Network in Dynamic Data Mining
Abstract
In the paper, a new hybrid system of computational intelligence is proposed. This system combines the advantages of neuro-fuzzy system of Takagi-Sugeno-Kang, type-2 fuzzy logic, wavelet neural networks and generalised additive models of Hastie-Tibshirani. The proposed system has universal approximation properties and learning capability based on the experimental data sets which pertain to the neural networks and neuro-fuzzy systems; interpretability and transparency of the obtained results due to the soft computing systems and, first of all, due to type-2 fuzzy systems; possibility of effective description of local signal and process features due to the application of systems based on wavelet transform; simplicity and speed of learning process due to generalised additive models. The proposed system can be used for solving a wide class of dynamic data mining tasks, which are connected with non-stationary, nonlinear stochastic and chaotic signals. Such a system is sufficiently simple in numerical implementation and is characterised by a high speed of learning and information processing.
Keywords: |
Computational intelligence; evolutionary computations; fuzzy neural networks; hybrid intelligent systems
|
Full Text: |
References
L. Rutkowski, Computational Intelligence: Methods and Techniques. Berlin: Springer-Verlag, 2008. http://dx.doi.org/10.1007/978-3-540-76288-1
K.-L. Du and M.N.S. Swamy, Neural Networks and Statistical Learning. London: Springer-Verlag, 2014. http://dx.doi.org/10.1007/978-1-4471-5571-3
C.L. Mumfold and L.C. Jain, Computational Intelligence Collaboration, Fusion and Emergence. Berlin: Springer-Verlag, 2009.
S. Haykin, Neural Networks. A Comprehensive Foundation Upper Saddle River. N.J.: Prentice Hall, 1999.
O. Nelles, Nonlinear System Identification. Berlin: Springer, 2001.
J.-S. R. Jang, C. T. Sun, and E. Mizutani, Neuro-Fuzzy and Soft Computing: A Computational Approach to Learning and Machine Intelligence. N.J.: Prentice Hall, 1997.
R.A. Aliev and B.G. Guirimov, Type-2 Fuzzy Neural Networks and Their Applications. Switzerland: Springer; 2014.
A.K. Alexandridis and A.D. Zapranis, Wavelet Neural Networks: With Applications in Financial Engineering, Chaos, and Classification. John Wiley & Sons, 2014. ttp://dx.doi.org/10.1002/9781118596272
R. Abiyev and O. Kaynak, “Fuzzy wavelet neural networks for identification and control of dynamic plants – a novel structure and a comparative study,” IEEE Trans. on Industrial Electronics, vol. 2, no. 55, pp. 3133–3140, Aug. 2008. http://dx.doi.org/10.1109/TIE.2008.924018
Ye. Bodyanskiy and O. Vynokurova, “Hybrid adaptive wavelet-neuro- fuzzy system for chaotic time series identification,” Information Science, no. 220, pp. 170–179, Jan. 2013. http://dx.doi.org/10.1016/j.ins.2012.07.044
E. Lughofer, Evolving Fuzzy Systems - Methodologies, Advanced Concepts and Applications. Springer, 2011. http://dx.doi.org/10.1007/978-3-642-18087-3
C. Aggarwal, Data Streams: Models and Algorithms (Advances in Database Systems). Springer, 2007. http://dx.doi.org/10.1007/978-0- 387-47534-9
A. Bifet Adaptive Stream Mining: Pattern Learning and Mining from Evolving Data Streams. Amsterdam: IOS Press, 2010.
N.N. Karnik and J.M. Mendel, “Application of type-2 fuzzy logic systems to forecasting of time-series,” Information Sciences, vol. 120, pp. 89–111, Nov. 1999. http://dx.doi.org/10.1016/S0020-0255(99)00067-5
J. Mendel, Uncertain Rule-Based Fuzzy Logic Systems: Introduction and New Directions, Upper-Saddle River, NJ: Prentice Hall, 2001.
R. John and S. Coupland, “Type-2 fuzzy logic: A historical view,” IEEE Computational Intelligence Magazine, vol. 2, no. 1, pp. 57–62, Feb. 2007. http://dx.doi.org/10.1109/MCI.2007.357194
M. Singh, S. Srivastava, M. Hanmandlu and J.R.P. Gupta, “Type-2 fuzzy wavelet networks (T2FWN) for system identification using fuzzy differential and Lyapunov stability algorithm,” Applied Soft Computing, vol. 9, no. 3, pp. 977–989, Jun. 2009. http://dx.doi.org/10.1016/j.asoc.2008.03.017
R.H. Abiyev, O. Kaynak, T. Alshanableh and F Mamedov, “A type-2 neuro-fuzzy system based on clustering and gradient techniques applied to system identification and channel equalization,” Applied Soft Computing, vol. 11, no. 1, pp. 1396–1406, Jan. 2011. http://dx.doi.org/10.1016/j.asoc.2010.04.011
T. Hastie and R. Tibshirani, Generalized Additive Models. Chapman and Hall/CRC, 1990.
T. Hastie, R. Tibshirani and J. Friedman, The Elements of Statistical Learning: Data Mining, Inference, and Prediction, Springer, 2013.
T. Takagi and M. Sugeno, “Fuzzy identification of systems and its applications to modeling and control,” IEEE Trans. on Systems, Man and Cybernetics, vol 15, no. 1, pp. 116–132, Jan-Feb. 1985. http://dx.doi.org/10.1109/TSMC.1985.6313399
M. Sugeno and G.T. Kang, “Structure identification of fuzzy model,” Fuzzy Sets and Systems, vol. 28, pp. 15–33, 1988. http://dx.doi.org/10.1016/0165-0114(88)90113-3
H. Takagi and I. Hayashi, “NN-driven fuzzy reasoning,” Int. J. of Approximate Reasoning, vol. 5, no. 3, pp. 191–212, May 1991. http://dx.doi.org/10.1016/0888-613X(91)90008-A
S. Mitaim and B. Kosko, “What is the best shape for a fuzzy set in function approximation?” in Proc. 5th IEEE Int. Conf. on Fuzzy Systems “Fuzz-96”, vol. 2, pp. 1237–1213, 1996. http://dx.doi.org/10.1109/fuzzy.1996.552354
S. Mitaim and B. Kosko, “Adaptive joint fuzzy sets for function approximation,” in Proc. Int. Conf. on Neural Networks “ICNN-97”, pp. 537–542, 1997. http://dx.doi.org/10.1109/icnn.1997.611726
Ye. Bodyanskiy, N. Lamonova, I. Pliss, and O. Vynokurova, “An adaptive learning algorithm for a wavelet neural network,” Expert Systems, vol. 22, no. 5, pp. 235–240, 2005. http://dx.doi.org/10.1111/j.1468-0394.2005.00314.x
Ye. Bodyanskiy and O. Vynokurova “Hybrid type-2 wavelet-neuro- fuzzy network for businesses process prediction”, Business Informatics, no. 21, pp. 9–21, Feb. 2011.
Ye. Bodyanskiy, I. Pliss and O. Vynokurova, “Type-2 Fuzzy-Wavelet- Neuron for Solving Data Mining Problems,” in Proc. East West Fuzzy Colloquium 2012, 19-th Zittau Fuzzy Colloquium. Zittau / Goerlitz: HS, pp. 96–103, 2012.
Ye. Bodyanskiy, O. Kharchenko and O. Vynokurova, “Least squares support vector machine based on wavelet-neuron,” Information Technology and Management Science, vol. 17, pp. 19–24, 2014. http://dx.doi.org/10.1515/itms-2014-0002
T. Yamakawa, “A novel nonlinear synapse neuron model guaranteeing a global minimum – Wavelet neuron,” in Proc. 28-th IEEE Int. Symp. on Multiple-Valued Logic. Fukuoka, Japan: IEEE Comp. Soc., pp. 335–336, 1998.
T. Yamakawa, E. Uchino, T. Miki and H. Kusanagi, “A neo-fuzzy neuron and its applications to system identification and prediction of the system behaviour,” in Proc. 2-nd Int. Conf. on Fuzzy Logic and Neural Networks “IIZUKA-92”, Iizuka, Japan, pp. 477–483, 1992.
E. Uchino and T. Yamakawa, “Soft computing based signal prediction, restoration and filtering,” in Intelligent Hybrid Systems: Fuzzy Logic, Neural Networks and Genetic Algorithms, Da Ruan Eds., Boston: Kluwer Academic Publisher, 1997, pp. 331–349. http://dx.doi.org/10.1007/978-1-4615-6191-0_14
P. Otto, Ye. Bodyanskiy, V. Kolodyazhniy, “A new learning algorithm for a forecasting neuro-fuzzy network,” Integrated Computer-Aided Engineering, 10, N4, Amsterdam: IOS Press, pp. 399–409, Apr. 2003.
Refbacks
- There are currently no refbacks.
Copyright (c) 2015 Yevgeniy Bodyanskiy, Olena Vynokurova, Iryna Pliss, Yuliia Tatarinova
This work is licensed under a Creative Commons Attribution 4.0 International License.