Flexible fractional wavelet neural network for non-linear system identification

Dadashzadeh, Hasan; Ahmadi, Ghasem; Edrisi Tabrizi, Yousef; Rezaei, Behrooz

doi:10.22034/cmde.2025.64339.2915

Flexible fractional wavelet neural network for non-linear system identification

Document Type : Research Paper

Authors

¹ Department of Mathematics, Payame Noor University, Tehran, Iran.

² Faculty of Electrical and Computer Engineering, Babol Noshirvani University of Technology, Babol, Iran.

10.22034/cmde.2025.64339.2915

Abstract

This paper presents a novel neural network architecture called the flexible fractional wavelet neural network (FFrWNN), which enhances traditional wavelet networks by introducing two additional fractional wavelet parameters. These fractional parameters, along with the translation and scale parameters, are dynamically adjusted during the learning process, offering greater flexibility and improved approximation power. The network is trained using a stochastic gradient descent algorithm, and iterative online training formulas are developed for optimizing both the wavelet parameters and network weights. The stability of the network is proven through the Lyapunov stability approach, ensuring reliable convergence. The proposed FFrWNN is evaluated in the context of both one-dimensional and multi-dimensional dynamic system identification. Results demonstrate that the fractional wavelet parameters significantly improve the network’s accuracy and efficiency. Compared to conventional neural networks, the FFrWNN shows superior performance in terms of precision and learning capability, making it a powerful tool for complex system modeling and signal processing applications.

Keywords

Main Subjects

Numerical methods for wavelets

References

[1] R. H. Abiyev and O. Kaynak, Fuzzy wavelet neural networks for identification and control of dynamic plants–A novel structure and a comparative study, IEEE Transactions on Industrial Electronics, 55(8) (2008), 3133–3140.
[2] S. Agarwal and S. Gupta, Applications of Fractional Wavelets in Non-Stationary Signal Analysis, Mathematical Methods in the Applied Sciences, 44(14) (2021), 9532–9549.
[3] G. Ahmadi, Stochastic gradient-based hyperbolic orthogonal neural networks for nonlinear dynamic systems identification, Journal of Mathematical Modeling, 10(3) (2022), 529–547.
[4] G. Ahmadi and M. Teshnehlab, Designing and implementation of stable sinusoidal rough-neural identifier, IEEE Trans. Neural Netw. Learn. Syst., 28(8) (2017), 1774–1786.
[5] A. K. Alexandridis and A. D. Zapranis, Wavelet neural networks: A practical guide, Neural Networks, 42, (2013), 1–27.
[6] K. Anoh, S. Jones, O. Ochonogor, and Y. Dama, Novel fractional wavelet transform with closed-form expression, Int. J. Adv Comput Sci Appl., (2014), 182–187.
[7] S. Bajpai and N. R. Kidwai, Fractional wavelet filter based low memory coding for hyperspectral image sensors, Springer Multimedia Tools and Applications, 83 (2024), 26281–26306.
[8] I. V. Bazhlekov and A. K. Grozdev, Fractional Wavelets for Multi-Scale Image Analysis and Compression, Journal of Mathematical Imaging and Vision, 62(4) (2020), 445–461.
[9] A. Coviello, F. Linsalata, U. Spagnolini, and M. Magarini, Artificial Neural Networks-Based Real-Time Classification of ENG Signals for Implanted Nerve Interfaces, IEEE Selected Areas in Communications, 42 (2024), 2080–2095.
[10] H. Dai, Z. Zheng, and W. Wang, A new fractional wavelet transform, Commun. Non-linear Sci. Numer. Simul., 44 (2017), 19–36.
[11] X. Gao and L. Li, Time-Frequency Analysis of Non-Stationary Signals Using Fractional Wavelets, IEEE Transactions on Signal Processing, 70 (2022), 1554–1565.
[12] J. Gonzalez and J. Villarreal, Fractional Wavelet Transform in Chaotic Systems, Chaos, Solitons and Fractals, 144(110689) (2021).
[13] I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning (Adaptive Computation and Machine Learning series), MIT Press, (2016).
[14] Y. Guo, B. Z. Li, and L. D. Yang, Novel fractional wavelet transform: Principles, MRA and application, Digit. Signal Process., 110 (2021).
[15] T. Guo, T. Zhang, E. Lim, M. Lopez-Benitez, F. Ma, and L. Yu, A review of wavelet analysis and its applications: challenges and opportunities, IEEE Access., 10 (2022), 58869–58903.
[16] H. G. Han, Z. L. Lin, and J. F. Qiao, Modeling of nonlinear systems using the self-organizing fuzzy neural network with adaptive gradient algorithm, Neurocomputing, 226 (2017), 566–578.
[17] I. Houamed, L. Saidi, and F. Srairi, ECG signal denoising by fractional wavelet transform thresholding, Research on Biomedical Engineering, (2020), 349–360.
[18] D. Jiawei, Y. Xiaoyu, and Y. Xiaozhong, Power harmonic and inter-harmonic detection based on fractional wavelet transform combined with variational modal decomposition algorithm, Review of scientific instruments, 94(12) (2023).
[19] C. F. Juang, A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms, IEEE Trans. Fuzzy Syst., 10(2) (2002), 155–170.
[20] C. F. Juang and C. T. Lin, A recurrent self-organizing neural fuzzy inference network, IEEE Trans. Neural Netw., 10(4) (1999), 828–845.
[21] K. P. Kakarla, D. C. S.Kiran, and M. Kanchana, Stock Price Prediction Using LSTM, CNN and ANN , Springer, Soft Computing and Signal Processing. ICSCSP., (2023), 141–153.
[22] C. Ko, Identification of nonlinear systems with outliers using wavelet neural networks based on annealing dynamical learning algorithm, Engineering Applications of Artificial Intelligence, 25 (2012), 533–543.
[23] R. Kumar, S. Srivastava, J. R. P. Gupta, and A. Mohindru, Self-recurrent wavelet neural network–based identification and adaptive predictive control of nonlinear dynamical systems, Int J Adapt Control Signal Process, (2018), 1–33.
[24] D. Mendlovic, Z. Zalevsky, D. Mas, J. Garcıa, and C. Ferreira, Fractional wavelet transform, Appl. Opt., 36 (1997), 4801–4806.
[25] T. Mohd, J. Abhinandan, K. Ekram, and H. Mohd, Low Memory Architectures of Fractional Wavelet Filter for Low-Cost Visual Sensors and Wearable Devices, IEEE sensors journal, 20(13) (2020), 6863–6871.
[26] K. S. Narendra and K. Parthasarathy, Identification and control of dynamical systems using neural networks, IEEE Trans. Neural Netw., 1 (1990), 4–27.
[27] P. Podder, S. Bharati, M. R. H. Mondal, P. K. Paul, and U. Kose, Artificial Neural Network for Cybersecurity: A Comprehensive Review, Journal of Information Assurance and Security., 16 (2021), 10–23.
[28] J. Shi, N. T. Zhang, and X. P. Liu, A novel fractional wavelet transform and its applications, Sci. China Inf. Sci., 55(6) (2012), 1270–1279.
[29] H. M. Srivastava, K. Khatterwani, and S. K. Upadhyay, A certain family of fractional wavelet transformations, Math Meth Appl Sci., (2019), 1–20.
[30] G. Strang and T. Nguyen, Wavelets and Filter Banks, Wellesley-Cambridge Press., (1996).
[31] N. V. Sukhanova and S. A. Sheptunov, The Neural Network Models in Mechanical Engineering, International Conference on Quality Management, Transport and Information Security, Information Technologies., (2021), 551–553.
[32] Z. Wang and J. Xu, Fractional Wavelet Transforms for Signal Processing: A Survey and New Results, Signal Processing., 158 (2019), 1–16.
[33] X. Y. Yang, D. Baleanu, H. M. Srivastava, and J. A. T. Machado, On local fractional continuous wavelet transform, Abstr Appl Anal., 2013(1) (2013), 1–5.
[34] Q. Zhang and A. Benveniste, Wavelet networks, IEEE Trans Neural Netw., (1992), 889–898.