ImageNet classification with deep convolutional neural networks
Alex Krizhevsky, Ilya Sutskever et al.
551
Citations
12
Influential Citations
IEEE Access
Venue
2022
Year
As a general and rigid mathematical tool, wavelet theory has found many applications and is constantly developing. This article reviews the development history of wavelet theory, from the construction method to the discussion of wavelet properties. Then it focuses on the design and expansion of wavelet transform. The main models and algorithms of wavelet transform are discussed. The construction of rational wavelet transform (RWT) is provided by examples emphasizing the advantages of RWT over traditional wavelet transform through a review of the literature. The combination of wavelet theory and neural networks is one of the key points of the review. The review covers the evolution of Wavelet Neural Network (WNN), the system architecture and algorithm implementation. The review of the literature indicates the advantages and a clear trend of fast development inWNNthat can be combined with existing neural network algorithms. This article also introduces the categories of wavelet-based applications. The advantages of wavelet analysis are summarized in terms of application scenarios with a comparison of results. Through the review, new research challenges and gaps have been clarified, which will serve as a guide for potential wavelet-based applications and new system designs.
Wavelet analysis is a cornerstone of signal processing, offering time-frequency localization that is superior to traditional Fourier methods for non-stationary signals. This review is significant because it consolidates decades of wavelet theory development into a single accessible resource, making it valuable for both newcomers and experts. The paper's emphasis on the rational wavelet transform (RWT) and wavelet neural networks (WNN) highlights the ongoing evolution of wavelet methods toward more flexible and intelligent systems.
Moreover, the review bridges the gap between classical signal processing and modern machine learning. By detailing how wavelet theory can be integrated with neural networks, it provides a roadmap for developing hybrid models that leverage the strengths of both approaches. This is particularly timely given the growing interest in interpretable and efficient AI models.
The paper does not present new experimental results but synthesizes findings from the literature. It reports that RWT outperforms traditional wavelet transforms in scenarios requiring high frequency resolution, such as certain biomedical and communication applications. For WNN, the review notes a clear trend of fast development, with advantages in convergence speed and approximation accuracy compared to standard neural networks. Comparative results from cited studies indicate that wavelet-based methods often achieve better performance in non-stationary signal analysis tasks.
The broader impact of this review lies in its potential to inspire new hybrid models that combine wavelet theory with deep learning. By clarifying the strengths and limitations of current wavelet methods, it provides a foundation for developing more efficient and interpretable AI systems. The identified research challenges, such as adaptive wavelet selection and computational efficiency, are likely to drive future innovations. For practitioners, the paper serves as a practical guide to selecting appropriate wavelet tools for specific applications, thereby accelerating the adoption of wavelet analysis in emerging fields like edge AI and real-time signal processing.
Alex Krizhevsky, Ilya Sutskever et al.
Ashish Vaswani, Noam Shazeer et al.
Douglas M. Bates, Martin Mächler et al.
Diederik P. Kingma, Jimmy Ba